-- Logs begin at Sat 2022-03-26 20:01:24 UTC, end at Sat 2022-03-26 22:09:15 UTC. -- Mar 26 20:32:25.977614 ncdv-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Mar 26 20:32:25.985544 ncdv-master-1 devstack@keystone.service[97187]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 26 20:32:25.987509 ncdv-master-1 devstack@keystone.service[97187]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Mar 26 20:32:25 2022] *** Mar 26 20:32:25.987509 ncdv-master-1 devstack@keystone.service[97187]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 26 20:32:25.987509 ncdv-master-1 devstack@keystone.service[97187]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 26 20:32:25.987509 ncdv-master-1 devstack@keystone.service[97187]: nodename: ncdv-master-1 Mar 26 20:32:25.987509 ncdv-master-1 devstack@keystone.service[97187]: machine: x86_64 Mar 26 20:32:25.987509 ncdv-master-1 devstack@keystone.service[97187]: clock source: unix Mar 26 20:32:25.987509 ncdv-master-1 devstack@keystone.service[97187]: pcre jit disabled Mar 26 20:32:25.987509 ncdv-master-1 devstack@keystone.service[97187]: detected number of CPU cores: 4 Mar 26 20:32:25.988031 ncdv-master-1 devstack@keystone.service[97187]: current working directory: / Mar 26 20:32:25.988031 ncdv-master-1 devstack@keystone.service[97187]: detected binary path: /usr/bin/uwsgi-core Mar 26 20:32:25.988031 ncdv-master-1 devstack@keystone.service[97187]: your processes number limit is 47680 Mar 26 20:32:25.988031 ncdv-master-1 devstack@keystone.service[97187]: your memory page size is 4096 bytes Mar 26 20:32:25.988031 ncdv-master-1 devstack@keystone.service[97187]: detected max file descriptor number: 2048 Mar 26 20:32:25.988031 ncdv-master-1 devstack@keystone.service[97187]: lock engine: pthread robust mutexes Mar 26 20:32:25.988031 ncdv-master-1 devstack@keystone.service[97187]: thunder lock: enabled Mar 26 20:32:25.988031 ncdv-master-1 devstack@keystone.service[97187]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 26 20:32:25.990272 ncdv-master-1 devstack@keystone.service[97187]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 26 20:32:26.040110 ncdv-master-1 devstack@keystone.service[97187]: Python main interpreter initialized at 0x55a724fe69c0 Mar 26 20:32:26.040110 ncdv-master-1 devstack@keystone.service[97187]: python threads support enabled Mar 26 20:32:26.040110 ncdv-master-1 devstack@keystone.service[97187]: your server socket listen backlog is limited to 100 connections Mar 26 20:32:26.040372 ncdv-master-1 devstack@keystone.service[97187]: your mercy for graceful operations on workers is 90 seconds Mar 26 20:32:26.040447 ncdv-master-1 devstack@keystone.service[97187]: mapped 403077 bytes (393 KB) for 2 cores Mar 26 20:32:26.040565 ncdv-master-1 devstack@keystone.service[97187]: *** Operational MODE: preforking *** Mar 26 20:32:26.040829 ncdv-master-1 devstack@keystone.service[97187]: *** uWSGI is running in multiple interpreter mode *** Mar 26 20:32:26.040829 ncdv-master-1 devstack@keystone.service[97187]: spawned uWSGI master process (pid: 97187) Mar 26 20:32:26.041021 ncdv-master-1 systemd[1]: Started Devstack devstack@keystone.service. Mar 26 20:32:26.041911 ncdv-master-1 devstack@keystone.service[97187]: spawned uWSGI worker 1 (pid: 97202, cores: 1) Mar 26 20:32:26.042006 ncdv-master-1 devstack@keystone.service[97187]: spawned uWSGI worker 2 (pid: 97203, cores: 1) Mar 26 20:32:26.042113 ncdv-master-1 devstack@keystone.service[97187]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 26 20:32:31.896319 ncdv-master-1 devstack@keystone.service[97203]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:32:31.896319 ncdv-master-1 devstack@keystone.service[97203]: from cryptography.utils import int_from_bytes Mar 26 20:32:31.897110 ncdv-master-1 devstack@keystone.service[97202]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:32:31.897110 ncdv-master-1 devstack@keystone.service[97202]: from cryptography.utils import int_from_bytes Mar 26 20:32:31.897556 ncdv-master-1 devstack@keystone.service[97203]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:32:31.897556 ncdv-master-1 devstack@keystone.service[97203]: from cryptography.utils import int_from_bytes Mar 26 20:32:31.897681 ncdv-master-1 devstack@keystone.service[97202]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 26 20:32:31.897681 ncdv-master-1 devstack@keystone.service[97202]: from cryptography.utils import int_from_bytes Mar 26 20:32:31.942120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 26 20:32:31.942300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 26 20:32:31.942386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 26 20:32:31.942475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] command line args: [] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 26 20:32:31.942557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 26 20:32:31.942669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] command line args: [] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 26 20:32:31.942753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 26 20:32:31.942895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ================================================================================ {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 26 20:32:31.942980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 26 20:32:31.943097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ================================================================================ {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 26 20:32:31.943184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] admin_token = **** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.943349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] admin_token = **** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.943435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] config_dir = [] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.943546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.943631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] config_dir = [] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.943726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] config_source = [] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.943814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.943893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] debug = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.943988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] config_source = [] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.944113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.944365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] debug = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.944365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.944522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.944583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.944641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.944698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] insecure_debug = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.944886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.944976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] list_limit = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] list_limit = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] log_config_append = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] log_config_append = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] log_dir = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.945960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] log_dir = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.946021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] log_file = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.946079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] log_file = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.946255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.946362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.946499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.946613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.946741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.946849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.946983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.947101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.947199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.947303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.947407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.947516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.947614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.947715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.947838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.948009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.948140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.948217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.948337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.948411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.948537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.948661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.948742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.949452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.949571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.949662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.949747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.949824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] notification_format = cadf {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.949948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.950030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.950408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.950497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.950577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] publish_errors = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.950695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] publish_errors = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.950807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.950928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] standard_threads = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.951979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] standard_threads = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] strict_password_check = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] use_eventlog = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] use_journal = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] use_journal = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] use_json = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.952938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] use_json = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.953020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] use_stderr = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.953100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] use_stderr = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.953178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] use_syslog = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.953248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] use_syslog = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.953403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.953484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] watch_log_file = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 26 20:32:31.953653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.953740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.953889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.953972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.954141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.954218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.954375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.954461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.954619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.954701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.954854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.954938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.955099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.955254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.955328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.955445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.955559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.955637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.955801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.955888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.956074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.956153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.956302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.956388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.956545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.956624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.956776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.956858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.957021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.957127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.957265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.957371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.957498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.957609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.957749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.957853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.958000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.958082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.958242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.958320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.958471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.958548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.958720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.958798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.958975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.959052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.959225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.959302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.959471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.959551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.959699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.959777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.959948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.960063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.960185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.960323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.960463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.960547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.960651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.960729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.960884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.960958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.961111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.961196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.961335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.961413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.961579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.961658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.961824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.961907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.962054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.962133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.962301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.962379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.962528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.962606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.962759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.962835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.962988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.963065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.963214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.963292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.963438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.963515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.963664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.963742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.963887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.964040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.964144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.964247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.964407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.964484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.964641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.964723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.964872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.964958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.965098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.965180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.965329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.965407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.965547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.965629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.965793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.965902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.966017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.966096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.966251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.966338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.966484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.966569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.966716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.966794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.966946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.967032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.967178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.967257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.967404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.967487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.967646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.967731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.967875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.967985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.968132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.968212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.968359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.968448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.968618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.968706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.968849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.968926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.969078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.969155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.969310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.969396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.969542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.969620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.969804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.969883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.970039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.970125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.970286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.970365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.970523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.970602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.970756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.970842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.970985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.971064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.971217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.971295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.971458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.971545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.enabled = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.971692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.971778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.971961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.972055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.972185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.972339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.972424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.972497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.972640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.972726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.972872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.972958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.973102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.973180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.973335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.973416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.973589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.973676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.973826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.974173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.974331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.974415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.974566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.974645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.974802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.974881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.975035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.975114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.975269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.975357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.975501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.975580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.975727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.975810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.975972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.976054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.976201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.976281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.976433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.976517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.976656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.976734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.976892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.976972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.977122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.977200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.977365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.977442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.977596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.977686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.977848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.977927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.978102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.978180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.978337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.978416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.978565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] auth.external = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.978648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] auth.external = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.978790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.978873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] auth.mapped = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.979082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.979190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.979309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.979388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.979535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] auth.password = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.979665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] auth.password = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.979748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] auth.token = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.979821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] auth.token = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.980018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.980103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.980262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.980341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] catalog.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.980506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.980595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.980737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.980816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.980986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.981065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.981230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.981308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.981457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.981537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.981686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] credential.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.981764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] credential.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.981929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.982017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] credential.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.982174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.982253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.982418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.982496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.982652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.982738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.982891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.982969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.983120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.983199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.983380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.983466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.983630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.983709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.983867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.983975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.984145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.984233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.984424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.984503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.984666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.984745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.984923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.985009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.985160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.985238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.985410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.985495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.985641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] federation.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.985727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] federation.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.985870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.985949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.986111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.986189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] federation.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.986352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.986511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.986589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.986706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.986810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.986897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.987044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.987131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.987293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.987373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.987523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.987602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.987771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.987859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.988027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.988110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.988272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.988362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.988503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.988591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.988747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.988827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.988991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.989071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.989223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.989312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.989454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.989534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.989697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.989784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.989924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.990011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.990155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.990234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.990399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.990478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.990645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.990735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.990871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.990949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.991097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.991176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.991321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.991408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.991560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.991639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.991800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.991878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.992066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.992147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.992315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.992393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.992559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.992638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.992825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.992904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.993054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.993132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.993287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.993365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.993513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.993592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.993741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.993819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.993968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.994046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.994200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.994280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.994432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.994510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.994667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.994746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.994910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.994990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.995136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.995215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.995458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.995547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.995629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.996226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.996387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.996466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.996629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.996709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.996872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.996952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.997097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.997175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.997332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.997410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.997557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.997636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.password = **** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.997790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.997869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.998022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.998101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.998261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.998340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.998493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.998572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.998725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.998803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.998967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.999047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.999217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.999295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.999441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.999519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.999667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.999749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:31.999911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.000096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.000195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.000275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.000398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.000480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.000629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.000715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.000860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.000939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.001086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.001165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.001320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.001399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.001575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.001655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.001802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.001882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.002043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.002123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.002285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.002363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.002525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.002604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.002754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.002834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.002977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.003062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.003205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.003286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.003435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.003513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.003663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.003741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.003887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.004077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.004163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.004235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.004383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.004475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.004624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.004703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.004865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.004943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.005106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.005193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.005330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.005409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.005571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.005685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.005804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.005917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.006022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.006121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.006256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.006363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.006486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.006599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.006724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.006829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.006967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.007072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.007199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.007317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.007449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.007554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] policy.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.007673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.007777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.007911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.008061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.008161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.008257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.008382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.008489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] receipt.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.008613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.008726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.008855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.008967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.009094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.009198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.009319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.009501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.009603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.009699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.009795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] resource.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.009898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] resource.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.009996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.010102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.010241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.010347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] resource.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.010473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.010578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.010717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.010852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.010962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.011042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.011195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.011274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] revoke.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.012022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.012133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.012260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.012340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.012497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.012577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] role.cache_time = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.012727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] role.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.012814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] role.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.012971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] role.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.013051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] role.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.013199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.013278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] role.list_limit = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.013442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.013530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.013688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.013768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.013933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.014013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.014178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.014266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.014420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.014501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.014664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.014744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.014908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.014995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.015149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.015228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.015378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.015457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.015620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.015757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.015870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.015999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.016141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.016219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.016386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.016466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.016775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.016860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.017009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.017088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.017253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.017370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.017499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.017605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.017745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.017851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.018258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.018364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.018463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.018560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.018657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.018753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.018859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.018963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.019061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.019157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.019253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.019349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.019454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.019551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.019648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.019743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.019840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.020931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.021027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] token.cache_time = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.021123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] token.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.021219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] token.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.021352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.021460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.021596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.021702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] token.provider = fernet {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.021890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.021975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.022050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.022123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.022299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.022380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.022535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.022623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.022773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.022853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.023013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.023092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.023255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.023343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] trust.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.023488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.023566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.023710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.023834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.023950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.024043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.024199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.024280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.024444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.024524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.024672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.024751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.024907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.024985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.025194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.025273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.025450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.connection = **** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.025539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.connection = **** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.025690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.025782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.025932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.026011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.026166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.026248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.026401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.026488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.026627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.026707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.026858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.026960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.027116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.027204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.027351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.027432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.027588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.027668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.027819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.027907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.028081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.028162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.028313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.028393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.028556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.028718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.028797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.028869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.029014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.029094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.029239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.029327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.029472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.029552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.029702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.029781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 26 20:32:32.029874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97203) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 26 20:32:32.029962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=97202) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 26 20:32:32.060996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.061204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.061295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.061439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.061545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.061667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.069980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.070223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.099134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.099368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.099471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.099635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.153916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.154265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.204840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.205068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.205346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.205582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.272594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.272732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.272823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.272904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.273025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.273113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.273240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.273333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.273453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.273537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.273665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.273749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.297754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.297905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.298955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.299039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.299166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.310918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.311101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.323182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.323416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.323510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.323614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.323697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.323857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.323987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.324107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.324237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.324324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.324398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.324525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.324612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97202) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.324737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=97203) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 26 20:32:32.341518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.341725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 26 20:32:32.341920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.342127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 26 20:32:32.342284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.342441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 26 20:32:32.342524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.342709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 26 20:32:32.342801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.343042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.343135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.343200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.343262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.343495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.343590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.343655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.354507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.354605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.354781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.354877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.355577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.355668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.355856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.355957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.363830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.363940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.367045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.367135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.367318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.367400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.367591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.367673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.367864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.368008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.368163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.368257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.368419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.368500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.368789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.368871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.369061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.369141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.369324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.369403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.369593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.369671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.369853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.369933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.396209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.396305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.397901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.398002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.398177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.398259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.403335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.403418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.403609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.403692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.403882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.404018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.410994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.411079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.411273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.411354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.415631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.415715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.416063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.416158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.416349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.416468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.416628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.416722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.416896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.416988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.417164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.417254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.417425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.418347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.418438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.418515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.437048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.437198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.437339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.437486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.441873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.442036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.445444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.445662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.445805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.445939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.450665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.450911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.454229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.454517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.457898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.458190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.458384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.458514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.458709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.458845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.458999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.459127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.459265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.459400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.459554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.459843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.478117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.478401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.478661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.478790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.478921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.479078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.479343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.479603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.487219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.487998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.488915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.489187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.489673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.489953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.492167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.492438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.492720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.492954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.493037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.493244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.493328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.493522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.493809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.494085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.508162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.508436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.508711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.508990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.509080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.509261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.509342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.509526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.509609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.509793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.509876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.510101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.510373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.510653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.630092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.630319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.633359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.633446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.636650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.636736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.638225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.638309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.639807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.639898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.640113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.640209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.640395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.640477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.647669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.647793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.649272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.649378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.652468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.652566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.652754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.652837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.653032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.653114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.653303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.653385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.662410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.662610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.662743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.662868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.662996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.663125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.671254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97203) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.671427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=97202) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 26 20:32:32.671555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.671685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.671814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.671957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.672093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.672219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.672344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.672468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.672592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.672716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.672857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.672983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.673117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.673295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.673432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.673558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.673684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.673809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.673934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.674067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.674203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.674330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.674456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.674580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.674714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97203) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.674840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=97202) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 26 20:32:32.712159 ncdv-master-1 devstack@keystone.service[97203]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a724fe69c0 pid: 97203 (default app) Mar 26 20:32:32.712444 ncdv-master-1 devstack@keystone.service[97202]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a724fe69c0 pid: 97202 (default app) Mar 26 20:32:32.716005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be871c55-3687-4bbd-ae12-82d183d269d2 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:32.716299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be871c55-3687-4bbd-ae12-82d183d269d2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:32.716573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be871c55-3687-4bbd-ae12-82d183d269d2 None None] PATH_INFO: `/v3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:32.720774 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sat Mar 26 20:32:32 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:32:41.035589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac59c7a-5a9d-4017-b71c-01742e138894 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:41.036173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac59c7a-5a9d-4017-b71c-01742e138894 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:41.036173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac59c7a-5a9d-4017-b71c-01742e138894 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:41.041092 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:32:41.047965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:41.047965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:41.047965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:41.077577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG oslo_db.sqlalchemy.engines [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97203) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:32:41.265071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG passlib.handlers.bcrypt [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=97203) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 26 20:32:41.265499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG passlib.handlers.bcrypt [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97203) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 26 20:32:41.321619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:41.323157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:41.447794 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 26 20:32:41.602400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac59c7a-5a9d-4017-b71c-01742e138894 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:41.636876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG oslo_db.sqlalchemy.engines [None req-6ac59c7a-5a9d-4017-b71c-01742e138894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=97202) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 26 20:32:41.767674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac59c7a-5a9d-4017-b71c-01742e138894 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:41.772144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126bf70-1b20-4113-a59b-1387175ad606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:41.772721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126bf70-1b20-4113-a59b-1387175ad606 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:41.773008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126bf70-1b20-4113-a59b-1387175ad606 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:41.773286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126bf70-1b20-4113-a59b-1387175ad606 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:41.782626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126bf70-1b20-4113-a59b-1387175ad606 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:41.833241 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9126bf70-1b20-4113-a59b-1387175ad606 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 26 20:32:41.833593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126bf70-1b20-4113-a59b-1387175ad606 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:41.844540 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Mar 26 20:32:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:32:41.850701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:41.866399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3b247-418a-4234-a8da-3577336378c4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:41.870959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ae438-5f08-4eb5-90cf-3971547f232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:41.872147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ae438-5f08-4eb5-90cf-3971547f232e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:41.872439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ae438-5f08-4eb5-90cf-3971547f232e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:41.872715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ae438-5f08-4eb5-90cf-3971547f232e admin admin] PATH_INFO: `/v3/projects/3c773729259f41fda13a8dbc3d1e265c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:41.874236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ae438-5f08-4eb5-90cf-3971547f232e admin admin] RBAC: Authorizing `identity:get_project(project_id=3c773729259f41fda13a8dbc3d1e265c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:41.927004 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.common.rbac_enforcer.enforcer [None req-694ae438-5f08-4eb5-90cf-3971547f232e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 26 20:32:41.927356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ae438-5f08-4eb5-90cf-3971547f232e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:41.932193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Mar 26 20:32:41 2022] GET /identity/v3/projects/3c773729259f41fda13a8dbc3d1e265c => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:32:44.270507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e173f-d1bb-46f3-b3ed-00fb6b521812 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:44.271017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e173f-d1bb-46f3-b3ed-00fb6b521812 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:44.271111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e173f-d1bb-46f3-b3ed-00fb6b521812 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:44.275638 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:32:44.282600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296625cd-906c-484c-86d8-8bf5715fb571 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:44.283005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296625cd-906c-484c-86d8-8bf5715fb571 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:44.283163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296625cd-906c-484c-86d8-8bf5715fb571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:44.302160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-296625cd-906c-484c-86d8-8bf5715fb571 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:44.303675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-296625cd-906c-484c-86d8-8bf5715fb571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:44.311414 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 26 20:32:44.335410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e173f-d1bb-46f3-b3ed-00fb6b521812 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:44.348025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e173f-d1bb-46f3-b3ed-00fb6b521812 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:44.352484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac44889-58d5-4199-9448-ba6eaca0d280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:44.353104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac44889-58d5-4199-9448-ba6eaca0d280 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:44.353391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac44889-58d5-4199-9448-ba6eaca0d280 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:44.353673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac44889-58d5-4199-9448-ba6eaca0d280 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:44.361239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac44889-58d5-4199-9448-ba6eaca0d280 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:44.363028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac44889-58d5-4199-9448-ba6eaca0d280 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:44.371599 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Mar 26 20:32:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:32:44.377606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296625cd-906c-484c-86d8-8bf5715fb571 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:44.386829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296625cd-906c-484c-86d8-8bf5715fb571 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:44.391130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc0cad-56bf-4814-8c48-2ea1f7021667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:44.392016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc0cad-56bf-4814-8c48-2ea1f7021667 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:44.392301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc0cad-56bf-4814-8c48-2ea1f7021667 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:44.392580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc0cad-56bf-4814-8c48-2ea1f7021667 admin admin] PATH_INFO: `/v3/users/ebbe1a3c461148b98c3d0846726c2888` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:44.393976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc0cad-56bf-4814-8c48-2ea1f7021667 admin admin] RBAC: Authorizing `identity:get_user(user_id=ebbe1a3c461148b98c3d0846726c2888)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:44.395819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc0cad-56bf-4814-8c48-2ea1f7021667 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:44.397393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sat Mar 26 20:32:44 2022] GET /identity/v3/users/ebbe1a3c461148b98c3d0846726c2888 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:32:46.843896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4f294-fe3c-43b3-a0f2-7b313e7d5d37 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:46.844461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4f294-fe3c-43b3-a0f2-7b313e7d5d37 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:46.844636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4f294-fe3c-43b3-a0f2-7b313e7d5d37 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:46.846517 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:32:46.853302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef795-d26b-40aa-8ad5-9729e6aba365 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:46.853760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef795-d26b-40aa-8ad5-9729e6aba365 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:46.853985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ef795-d26b-40aa-8ad5-9729e6aba365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:46.870414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-083ef795-d26b-40aa-8ad5-9729e6aba365 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:46.871618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-083ef795-d26b-40aa-8ad5-9729e6aba365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:46.871944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f741b-c876-4904-936c-6c07241c8572 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:46.872324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f741b-c876-4904-936c-6c07241c8572 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:46.872605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f741b-c876-4904-936c-6c07241c8572 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:46.874300 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:32:46.880883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52d52c-9c53-4619-bb1f-3991759e61ae None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:46.881241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52d52c-9c53-4619-bb1f-3991759e61ae None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:46.881527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52d52c-9c53-4619-bb1f-3991759e61ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:46.922201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG passlib.handlers.bcrypt [None req-ca52d52c-9c53-4619-bb1f-3991759e61ae None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=97202) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 26 20:32:46.922620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG passlib.handlers.bcrypt [None req-ca52d52c-9c53-4619-bb1f-3991759e61ae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=97202) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 26 20:32:46.949508 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:32:46.969580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ca52d52c-9c53-4619-bb1f-3991759e61ae None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:46.974180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ca52d52c-9c53-4619-bb1f-3991759e61ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:46.974328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef795-d26b-40aa-8ad5-9729e6aba365 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:47.066351 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:32:47.067645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ef795-d26b-40aa-8ad5-9729e6aba365 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:47.091317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52d52c-9c53-4619-bb1f-3991759e61ae None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:47.100222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa4de-1083-4f84-8600-94966bef72b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:47.100813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa4de-1083-4f84-8600-94966bef72b7 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:47.101101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa4de-1083-4f84-8600-94966bef72b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:47.101381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79aa4de-1083-4f84-8600-94966bef72b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:47.163809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79aa4de-1083-4f84-8600-94966bef72b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:47.165326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79aa4de-1083-4f84-8600-94966bef72b7 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:47.185383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52d52c-9c53-4619-bb1f-3991759e61ae None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:47.218582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2f203-a47d-49ff-99ea-1e69081f7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:47.219585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2f203-a47d-49ff-99ea-1e69081f7432 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:47.219871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2f203-a47d-49ff-99ea-1e69081f7432 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:47.220176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2f203-a47d-49ff-99ea-1e69081f7432 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:47.231452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a2f203-a47d-49ff-99ea-1e69081f7432 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:32:47.238258 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-80a2f203-a47d-49ff-99ea-1e69081f7432 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:32:47.239435 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 8/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:32:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:32:47.245719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2f203-a47d-49ff-99ea-1e69081f7432 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:47.258721 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 7/15] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:32:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 26 20:32:47.264823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa4de-1083-4f84-8600-94966bef72b7 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:47.339279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2f203-a47d-49ff-99ea-1e69081f7432 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:47.357010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79aa4de-1083-4f84-8600-94966bef72b7 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:47.371494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae62b16-1351-46e1-abda-b5076a5f2e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:47.372188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae62b16-1351-46e1-abda-b5076a5f2e17 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:47.372469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae62b16-1351-46e1-abda-b5076a5f2e17 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:47.372743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae62b16-1351-46e1-abda-b5076a5f2e17 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:47.373472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae62b16-1351-46e1-abda-b5076a5f2e17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:32:47.373778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae62b16-1351-46e1-abda-b5076a5f2e17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:47.375221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae62b16-1351-46e1-abda-b5076a5f2e17 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:47.386479 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:32:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:47.389036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e0c95-db8b-4c7d-9add-f104bd15ac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:47.389817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e0c95-db8b-4c7d-9add-f104bd15ac32 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:47.390097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e0c95-db8b-4c7d-9add-f104bd15ac32 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:47.390370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e0c95-db8b-4c7d-9add-f104bd15ac32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:47.391848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae62b16-1351-46e1-abda-b5076a5f2e17 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:47.400088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e0c95-db8b-4c7d-9add-f104bd15ac32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:47.401606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e0c95-db8b-4c7d-9add-f104bd15ac32 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:47.418125 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-f18e0c95-db8b-4c7d-9add-f104bd15ac32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:32:47.419289 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 8/17] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:32:47.424887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e0c95-db8b-4c7d-9add-f104bd15ac32 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:47.484249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae62b16-1351-46e1-abda-b5076a5f2e17 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:47.516048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e67d4-9aa2-4fdf-a6e1-56801a15a7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:47.516900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e67d4-9aa2-4fdf-a6e1-56801a15a7db None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:47.517182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e67d4-9aa2-4fdf-a6e1-56801a15a7db None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:47.517341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e0c95-db8b-4c7d-9add-f104bd15ac32 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:47.517471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e67d4-9aa2-4fdf-a6e1-56801a15a7db None admin] PATH_INFO: `/v3/users/ebbe1a3c461148b98c3d0846726c2888` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:47.519039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e67d4-9aa2-4fdf-a6e1-56801a15a7db None admin] RBAC: Authorizing `identity:get_user(user_id=ebbe1a3c461148b98c3d0846726c2888)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:47.520540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0e67d4-9aa2-4fdf-a6e1-56801a15a7db None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:47.522134 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:32:47 2022] GET /identity/v3/users/ebbe1a3c461148b98c3d0846726c2888 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:47.527321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e67d4-9aa2-4fdf-a6e1-56801a15a7db None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:47.549083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1770d-ccc9-4098-8a88-eebe61f49a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:47.549725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1770d-ccc9-4098-8a88-eebe61f49a10 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:47.550011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1770d-ccc9-4098-8a88-eebe61f49a10 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:47.550284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1770d-ccc9-4098-8a88-eebe61f49a10 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:47.550988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1770d-ccc9-4098-8a88-eebe61f49a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:32:47.551291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1770d-ccc9-4098-8a88-eebe61f49a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:47.552710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1770d-ccc9-4098-8a88-eebe61f49a10 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:47.569530 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:47.625581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e67d4-9aa2-4fdf-a6e1-56801a15a7db None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:47.659891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c4e47-cac0-4c22-af48-b7199861319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:47.660728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c4e47-cac0-4c22-af48-b7199861319a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:47.661012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c4e47-cac0-4c22-af48-b7199861319a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:47.661286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c4e47-cac0-4c22-af48-b7199861319a None admin] PATH_INFO: `/v3/domains/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:47.662556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c4e47-cac0-4c22-af48-b7199861319a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:47.664133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c4e47-cac0-4c22-af48-b7199861319a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:47.665775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:32:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:47.672214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1770d-ccc9-4098-8a88-eebe61f49a10 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:47.771947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1770d-ccc9-4098-8a88-eebe61f49a10 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:47.804073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27a6fa-ae71-4b3e-ab9c-f05bf3d9adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:47.804736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27a6fa-ae71-4b3e-ab9c-f05bf3d9adb4 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:47.805025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27a6fa-ae71-4b3e-ab9c-f05bf3d9adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:47.805301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27a6fa-ae71-4b3e-ab9c-f05bf3d9adb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:47.806126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27a6fa-ae71-4b3e-ab9c-f05bf3d9adb4 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.domain.id=default, user.id=ebbe1a3c461148b98c3d0846726c2888) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:32:47.806443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27a6fa-ae71-4b3e-ab9c-f05bf3d9adb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:47.808470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27a6fa-ae71-4b3e-ab9c-f05bf3d9adb4 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:47.815311 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Mar 26 20:32:47 2022] GET /identity/v3/role_assignments?user.id=ebbe1a3c461148b98c3d0846726c2888&scope.domain.id=default&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:32:50.134765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc4f29-9106-47c9-8411-96e3bda95ff5 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:50.135803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc4f29-9106-47c9-8411-96e3bda95ff5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:50.136311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc4f29-9106-47c9-8411-96e3bda95ff5 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:50.138597 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:32:50.145095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91db5d-e690-4e1f-8d6f-3443f192f0c9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:50.145922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91db5d-e690-4e1f-8d6f-3443f192f0c9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:50.146396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91db5d-e690-4e1f-8d6f-3443f192f0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:50.169055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3f91db5d-e690-4e1f-8d6f-3443f192f0c9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:50.170624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3f91db5d-e690-4e1f-8d6f-3443f192f0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:50.253189 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:32:50.292819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc4f29-9106-47c9-8411-96e3bda95ff5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:50.444851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc4f29-9106-47c9-8411-96e3bda95ff5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:50.447470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf21e-a212-4045-835a-45d3b0aebb27 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:50.448198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf21e-a212-4045-835a-45d3b0aebb27 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:50.448715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cf21e-a212-4045-835a-45d3b0aebb27 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:50.451070 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 12/24] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:32:50.458962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd641ad-ee93-4e00-b785-5738fb5fd2d6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:50.459579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd641ad-ee93-4e00-b785-5738fb5fd2d6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:50.460136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd641ad-ee93-4e00-b785-5738fb5fd2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:50.488551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff9a3a-a698-48e8-82ae-b0572634059a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:50.492329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff9a3a-a698-48e8-82ae-b0572634059a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:50.493037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff9a3a-a698-48e8-82ae-b0572634059a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:50.493323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff9a3a-a698-48e8-82ae-b0572634059a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:50.497464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4fd641ad-ee93-4e00-b785-5738fb5fd2d6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:50.498975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4fd641ad-ee93-4e00-b785-5738fb5fd2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:50.530330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff9a3a-a698-48e8-82ae-b0572634059a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:50.531841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff9a3a-a698-48e8-82ae-b0572634059a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:50.578592 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-34ff9a3a-a698-48e8-82ae-b0572634059a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:32:50.585985 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 13/25] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:32:50.593122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff9a3a-a698-48e8-82ae-b0572634059a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:50.646238 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:32:50.693200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd641ad-ee93-4e00-b785-5738fb5fd2d6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:50.730694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff9a3a-a698-48e8-82ae-b0572634059a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:50.778520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4fa7e-e7ee-4da5-bb2b-c81ffa23b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:50.779580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4fa7e-e7ee-4da5-bb2b-c81ffa23b26f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:50.780781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4fa7e-e7ee-4da5-bb2b-c81ffa23b26f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:50.781265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4fa7e-e7ee-4da5-bb2b-c81ffa23b26f None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:50.782372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4fa7e-e7ee-4da5-bb2b-c81ffa23b26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:32:50.784294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4fa7e-e7ee-4da5-bb2b-c81ffa23b26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:50.785951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4fa7e-e7ee-4da5-bb2b-c81ffa23b26f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:50.826537 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 14/27] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:32:50.845872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4fa7e-e7ee-4da5-bb2b-c81ffa23b26f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:50.875577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd641ad-ee93-4e00-b785-5738fb5fd2d6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:50.928540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fe797-43b0-4447-9c9b-febad6ea7379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:50.929215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fe797-43b0-4447-9c9b-febad6ea7379 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:50.929493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fe797-43b0-4447-9c9b-febad6ea7379 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:50.929764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fe797-43b0-4447-9c9b-febad6ea7379 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:50.930507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fe797-43b0-4447-9c9b-febad6ea7379 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:50.931898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898fe797-43b0-4447-9c9b-febad6ea7379 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:50.956698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4fa7e-e7ee-4da5-bb2b-c81ffa23b26f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:50.996025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab3075-12ac-4974-ad99-ba17867bc658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:50.996694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab3075-12ac-4974-ad99-ba17867bc658 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:50.996979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab3075-12ac-4974-ad99-ba17867bc658 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:50.997256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab3075-12ac-4974-ad99-ba17867bc658 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:50.998015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab3075-12ac-4974-ad99-ba17867bc658 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:50.999544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab3075-12ac-4974-ad99-ba17867bc658 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:51.119113 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 14/28] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Mar 26 20:32:50 2022] POST /identity/v3/roles => generated 219 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:32:51.125796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0159ae-ba91-407b-a846-cdc1a79b4eed None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:51.126414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0159ae-ba91-407b-a846-cdc1a79b4eed None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:51.126898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0159ae-ba91-407b-a846-cdc1a79b4eed None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:51.129290 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 15/29] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:32:51.135821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c39c8-67d5-4c72-97e5-b3b0d724793d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:51.136408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c39c8-67d5-4c72-97e5-b3b0d724793d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:51.136894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c39c8-67d5-4c72-97e5-b3b0d724793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:51.176841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4f6c39c8-67d5-4c72-97e5-b3b0d724793d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:51.196438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4f6c39c8-67d5-4c72-97e5-b3b0d724793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:51.329264 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 15/30] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:32:50 2022] POST /identity/v3/projects => generated 301 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:32:51.429691 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 16/31] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:32:51.476476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab3075-12ac-4974-ad99-ba17867bc658 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:51.546379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76aa65-bed1-45cd-ac0d-ddabfb4e2a88 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:51.546695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76aa65-bed1-45cd-ac0d-ddabfb4e2a88 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:51.546939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76aa65-bed1-45cd-ac0d-ddabfb4e2a88 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:51.548740 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 17/32] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:32:51.555613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c380be-d66b-4cbf-a689-e07378ead34b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:51.556171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c380be-d66b-4cbf-a689-e07378ead34b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:51.556593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c380be-d66b-4cbf-a689-e07378ead34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:51.589711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-05c380be-d66b-4cbf-a689-e07378ead34b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:51.591217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-05c380be-d66b-4cbf-a689-e07378ead34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:51.610105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab3075-12ac-4974-ad99-ba17867bc658 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:51.653224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a588-b579-4f30-9e93-370afec7f2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:51.654035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a588-b579-4f30-9e93-370afec7f2b6 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:51.654321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a588-b579-4f30-9e93-370afec7f2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:51.654604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678a588-b579-4f30-9e93-370afec7f2b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:51.672709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678a588-b579-4f30-9e93-370afec7f2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:32:51.681717 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-9678a588-b579-4f30-9e93-370afec7f2b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:32:51.683343 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:32:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:32:51.689763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a588-b579-4f30-9e93-370afec7f2b6 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:51.695093 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 18/34] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:32:51.723714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c380be-d66b-4cbf-a689-e07378ead34b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:51.798082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678a588-b579-4f30-9e93-370afec7f2b6 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:51.832415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c380be-d66b-4cbf-a689-e07378ead34b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:51.834645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130cf4-0c07-4716-8c4e-8a606c5382e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:51.835335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130cf4-0c07-4716-8c4e-8a606c5382e1 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:51.835787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130cf4-0c07-4716-8c4e-8a606c5382e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:51.836286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3130cf4-0c07-4716-8c4e-8a606c5382e1 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:51.837200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130cf4-0c07-4716-8c4e-8a606c5382e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:32:51.837658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130cf4-0c07-4716-8c4e-8a606c5382e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:51.840007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3130cf4-0c07-4716-8c4e-8a606c5382e1 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:51.849727 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 17/35] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:32:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:32:51.855716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130cf4-0c07-4716-8c4e-8a606c5382e1 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:51.872408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c6d1b-b89c-4908-b4b8-5bfba36ca457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:51.873090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c6d1b-b89c-4908-b4b8-5bfba36ca457 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:51.873377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c6d1b-b89c-4908-b4b8-5bfba36ca457 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:51.873657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c6d1b-b89c-4908-b4b8-5bfba36ca457 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:51.874410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c6d1b-b89c-4908-b4b8-5bfba36ca457 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:51.875993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c6d1b-b89c-4908-b4b8-5bfba36ca457 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:51.892925 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 19/36] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Mar 26 20:32:51 2022] POST /identity/v3/roles => generated 225 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:32:51.974923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3130cf4-0c07-4716-8c4e-8a606c5382e1 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:52.025365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3c144-ab65-44df-ab1d-db788be66db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:52.027033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3c144-ab65-44df-ab1d-db788be66db3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.027470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3c144-ab65-44df-ab1d-db788be66db3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.027894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3c144-ab65-44df-ab1d-db788be66db3 None admin] PATH_INFO: `/v3/users/ebbe1a3c461148b98c3d0846726c2888` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.029476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3c144-ab65-44df-ab1d-db788be66db3 None admin] RBAC: Authorizing `identity:get_user(user_id=ebbe1a3c461148b98c3d0846726c2888)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:52.031142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3c144-ab65-44df-ab1d-db788be66db3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:52.033029 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 18/37] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:32:51 2022] GET /identity/v3/users/ebbe1a3c461148b98c3d0846726c2888 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:52.038794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c6d1b-b89c-4908-b4b8-5bfba36ca457 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:52.142487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c6d1b-b89c-4908-b4b8-5bfba36ca457 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:52.160607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253a058-2b61-4dc2-9458-f58e9ef89929 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.161259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253a058-2b61-4dc2-9458-f58e9ef89929 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.161547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253a058-2b61-4dc2-9458-f58e9ef89929 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.163465 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 19/38] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:32:52.169848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178628b0-9d00-4f41-a206-06e5e6106ffd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.170137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178628b0-9d00-4f41-a206-06e5e6106ffd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.170419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178628b0-9d00-4f41-a206-06e5e6106ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.179475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5e7fc-a798-4a14-9a94-7f697b1a8ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:52.180315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5e7fc-a798-4a14-9a94-7f697b1a8ef8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.180603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5e7fc-a798-4a14-9a94-7f697b1a8ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.180884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5e7fc-a798-4a14-9a94-7f697b1a8ef8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.182613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5e7fc-a798-4a14-9a94-7f697b1a8ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:52.184844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5e7fc-a798-4a14-9a94-7f697b1a8ef8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:52.186658 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 20/39] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:32:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:32:52.188734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-178628b0-9d00-4f41-a206-06e5e6106ffd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:52.190260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-178628b0-9d00-4f41-a206-06e5e6106ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:52.191809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5e7fc-a798-4a14-9a94-7f697b1a8ef8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:52.257181 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:32:52.263546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f9f0-9ecf-4713-bc87-1ebf5c2c4c23 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.263838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f9f0-9ecf-4713-bc87-1ebf5c2c4c23 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.264152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294f9f0-9ecf-4713-bc87-1ebf5c2c4c23 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.266044 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 21/41] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:32:52.272103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80b9ce-edc5-4715-a5c1-1388e720c916 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.272385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80b9ce-edc5-4715-a5c1-1388e720c916 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.272665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80b9ce-edc5-4715-a5c1-1388e720c916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.289051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5e7fc-a798-4a14-9a94-7f697b1a8ef8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:52.289619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2b80b9ce-edc5-4715-a5c1-1388e720c916 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:52.290793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2b80b9ce-edc5-4715-a5c1-1388e720c916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:52.321130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c83e5-508c-4509-8b82-9817a364a6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:52.321992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c83e5-508c-4509-8b82-9817a364a6d9 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.322279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c83e5-508c-4509-8b82-9817a364a6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.322554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c83e5-508c-4509-8b82-9817a364a6d9 None admin] PATH_INFO: `/v3/domains/default/users/ebbe1a3c461148b98c3d0846726c2888/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.324576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c83e5-508c-4509-8b82-9817a364a6d9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ebbe1a3c461148b98c3d0846726c2888, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:52.326029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c83e5-508c-4509-8b82-9817a364a6d9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:52.341535 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Mar 26 20:32:52 2022] PUT /identity/v3/domains/default/users/ebbe1a3c461148b98c3d0846726c2888/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:32:52.342400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c83e5-508c-4509-8b82-9817a364a6d9 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:52.359968 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 22/43] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:32:52.384051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80b9ce-edc5-4715-a5c1-1388e720c916 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:52.461171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c83e5-508c-4509-8b82-9817a364a6d9 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:52.490781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80b9ce-edc5-4715-a5c1-1388e720c916 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:52.501023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083973-b2a5-43fe-b851-e1a9fd54005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:52.502100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083973-b2a5-43fe-b851-e1a9fd54005b None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.502604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083973-b2a5-43fe-b851-e1a9fd54005b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.503098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083973-b2a5-43fe-b851-e1a9fd54005b None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.504063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083973-b2a5-43fe-b851-e1a9fd54005b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:52.505520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083973-b2a5-43fe-b851-e1a9fd54005b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:52.520041 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Mar 26 20:32:52 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:32:52.534437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d66bf-2b40-4467-8e72-eb99921e2de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:52.535311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d66bf-2b40-4467-8e72-eb99921e2de2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.535608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d66bf-2b40-4467-8e72-eb99921e2de2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.535885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d66bf-2b40-4467-8e72-eb99921e2de2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.537280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d66bf-2b40-4467-8e72-eb99921e2de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:52.538811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d66bf-2b40-4467-8e72-eb99921e2de2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:52.540603 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:32:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:52.547106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083973-b2a5-43fe-b851-e1a9fd54005b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:52.657566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083973-b2a5-43fe-b851-e1a9fd54005b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:52.691812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576375f-c0dd-4267-8e6d-86d314f130b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:52.692517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576375f-c0dd-4267-8e6d-86d314f130b3 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:52.692803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576375f-c0dd-4267-8e6d-86d314f130b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:52.693080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576375f-c0dd-4267-8e6d-86d314f130b3 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:52.693803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576375f-c0dd-4267-8e6d-86d314f130b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:52.695290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576375f-c0dd-4267-8e6d-86d314f130b3 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:52.724196 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:32:52 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:32:54.689418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287391-ae02-49ba-92e4-5764ce4e2f0f None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:54.689970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287391-ae02-49ba-92e4-5764ce4e2f0f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:54.689970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76287391-ae02-49ba-92e4-5764ce4e2f0f None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:54.691711 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:32:54.698197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc66cd4-69ba-49d3-8d2b-c509ff7b9eaa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:54.698613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc66cd4-69ba-49d3-8d2b-c509ff7b9eaa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:54.698839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc66cd4-69ba-49d3-8d2b-c509ff7b9eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:54.717827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-afc66cd4-69ba-49d3-8d2b-c509ff7b9eaa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:54.719055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-afc66cd4-69ba-49d3-8d2b-c509ff7b9eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:54.784733 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:32:54.809188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287391-ae02-49ba-92e4-5764ce4e2f0f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:54.905344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76287391-ae02-49ba-92e4-5764ce4e2f0f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:54.936783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f48ee3-13ec-4c1f-aa2c-c7d51e57d2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:54.937561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48ee3-13ec-4c1f-aa2c-c7d51e57d2fd None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:54.937843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48ee3-13ec-4c1f-aa2c-c7d51e57d2fd None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:54.938119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f48ee3-13ec-4c1f-aa2c-c7d51e57d2fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:54.948332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f48ee3-13ec-4c1f-aa2c-c7d51e57d2fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:32:54.954911 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-52f48ee3-13ec-4c1f-aa2c-c7d51e57d2fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:32:54.956097 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:32:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:32:54.961734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc66cd4-69ba-49d3-8d2b-c509ff7b9eaa None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:55.055599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc66cd4-69ba-49d3-8d2b-c509ff7b9eaa None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:55.087424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63cb9e-b423-43a9-a1b7-dff3b51523fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:55.088139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63cb9e-b423-43a9-a1b7-dff3b51523fa None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:55.088993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63cb9e-b423-43a9-a1b7-dff3b51523fa None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:55.089271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63cb9e-b423-43a9-a1b7-dff3b51523fa None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:55.090016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63cb9e-b423-43a9-a1b7-dff3b51523fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:32:55.090326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63cb9e-b423-43a9-a1b7-dff3b51523fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:55.091764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63cb9e-b423-43a9-a1b7-dff3b51523fa None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:55.092749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597ffd-26b0-4e9b-8f91-2455aa7ca3bc None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:55.093043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597ffd-26b0-4e9b-8f91-2455aa7ca3bc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:55.093328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86597ffd-26b0-4e9b-8f91-2455aa7ca3bc None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:55.095090 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 26/50] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:32:55.101642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e2c8-7d4b-424a-9423-31b613d33b4b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:55.101933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e2c8-7d4b-424a-9423-31b613d33b4b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:55.102215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2e2c8-7d4b-424a-9423-31b613d33b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:55.105850 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 25/51] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:32:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:32:55.110905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63cb9e-b423-43a9-a1b7-dff3b51523fa None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:55.119785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dbe2e2c8-7d4b-424a-9423-31b613d33b4b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:55.121021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dbe2e2c8-7d4b-424a-9423-31b613d33b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:55.184531 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 27/52] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:32:55.204365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63cb9e-b423-43a9-a1b7-dff3b51523fa None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:55.209298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2e2c8-7d4b-424a-9423-31b613d33b4b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:55.235794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9d03-ac0d-41bd-b16d-7ebc46d3245e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:55.236688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9d03-ac0d-41bd-b16d-7ebc46d3245e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:55.236979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9d03-ac0d-41bd-b16d-7ebc46d3245e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:55.237260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c9d03-ac0d-41bd-b16d-7ebc46d3245e None admin] PATH_INFO: `/v3/users/ebbe1a3c461148b98c3d0846726c2888` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:55.238476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9d03-ac0d-41bd-b16d-7ebc46d3245e None admin] RBAC: Authorizing `identity:get_user(user_id=ebbe1a3c461148b98c3d0846726c2888)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:55.239977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c9d03-ac0d-41bd-b16d-7ebc46d3245e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:55.241586 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:32:55 2022] GET /identity/v3/users/ebbe1a3c461148b98c3d0846726c2888 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:55.247176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9d03-ac0d-41bd-b16d-7ebc46d3245e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:55.301626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2e2c8-7d4b-424a-9423-31b613d33b4b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:55.333934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fb8a7-0357-43de-8c30-85f713288a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:55.334804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fb8a7-0357-43de-8c30-85f713288a42 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:55.335092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fb8a7-0357-43de-8c30-85f713288a42 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:55.335371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fb8a7-0357-43de-8c30-85f713288a42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:55.336572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fb8a7-0357-43de-8c30-85f713288a42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:55.338041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885fb8a7-0357-43de-8c30-85f713288a42 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:55.339630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c9d03-ac0d-41bd-b16d-7ebc46d3245e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:55.339747 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 28/54] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:32:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:55.345299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fb8a7-0357-43de-8c30-85f713288a42 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:55.371796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c6346-efe5-4059-a3b1-e8c233161b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:55.372604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c6346-efe5-4059-a3b1-e8c233161b17 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:55.372889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c6346-efe5-4059-a3b1-e8c233161b17 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:55.373164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c6346-efe5-4059-a3b1-e8c233161b17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:55.374331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c6346-efe5-4059-a3b1-e8c233161b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:55.375793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c6346-efe5-4059-a3b1-e8c233161b17 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:55.377407 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:32:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:55.382914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c6346-efe5-4059-a3b1-e8c233161b17 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:55.438832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885fb8a7-0357-43de-8c30-85f713288a42 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:55.471563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b776d-09b7-4616-8fb8-4ff9990452c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:55.472172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b776d-09b7-4616-8fb8-4ff9990452c8 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:55.472459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b776d-09b7-4616-8fb8-4ff9990452c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:55.472734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b776d-09b7-4616-8fb8-4ff9990452c8 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:55.473683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b776d-09b7-4616-8fb8-4ff9990452c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:55.475117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b776d-09b7-4616-8fb8-4ff9990452c8 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:55.478214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c6346-efe5-4059-a3b1-e8c233161b17 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:55.504582 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 29/56] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Mar 26 20:32:55 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:32:55.513483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da4e73-34f7-4907-8aea-3adc5b8b8e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:55.514172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da4e73-34f7-4907-8aea-3adc5b8b8e0d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:55.514464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da4e73-34f7-4907-8aea-3adc5b8b8e0d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:55.514746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da4e73-34f7-4907-8aea-3adc5b8b8e0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:55.515594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da4e73-34f7-4907-8aea-3adc5b8b8e0d None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.domain.id=default, user.id=ebbe1a3c461148b98c3d0846726c2888) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:32:55.515931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da4e73-34f7-4907-8aea-3adc5b8b8e0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:55.517476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da4e73-34f7-4907-8aea-3adc5b8b8e0d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:55.524419 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Mar 26 20:32:55 2022] GET /identity/v3/role_assignments?user.id=ebbe1a3c461148b98c3d0846726c2888&scope.domain.id=default&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:32:57.870583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f78df-074f-4244-8439-f73744d58a1b None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:57.871106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f78df-074f-4244-8439-f73744d58a1b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:57.871188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f78df-074f-4244-8439-f73744d58a1b None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:57.872937 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:32:57.879227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883b34-94fa-404e-b3ad-7d4988c8af7e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:57.879637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883b34-94fa-404e-b3ad-7d4988c8af7e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:57.879788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04883b34-94fa-404e-b3ad-7d4988c8af7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:57.896713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-04883b34-94fa-404e-b3ad-7d4988c8af7e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:32:57.897879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-04883b34-94fa-404e-b3ad-7d4988c8af7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:32:57.960463 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:32:57.986413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f78df-074f-4244-8439-f73744d58a1b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:58.081770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f78df-074f-4244-8439-f73744d58a1b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:58.113561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43e623-bd52-423a-bfc6-80f97abf16f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:58.114330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43e623-bd52-423a-bfc6-80f97abf16f2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:58.114610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43e623-bd52-423a-bfc6-80f97abf16f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:58.114885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43e623-bd52-423a-bfc6-80f97abf16f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:58.116063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43e623-bd52-423a-bfc6-80f97abf16f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:58.117501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43e623-bd52-423a-bfc6-80f97abf16f2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:58.119064 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:32:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:32:58.124644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04883b34-94fa-404e-b3ad-7d4988c8af7e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:32:58.215979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04883b34-94fa-404e-b3ad-7d4988c8af7e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:32:58.247188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e943e-5bf8-4137-a3fa-be6f7bc70c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:32:58.247830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e943e-5bf8-4137-a3fa-be6f7bc70c4f None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:32:58.248143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e943e-5bf8-4137-a3fa-be6f7bc70c4f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:32:58.248420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e943e-5bf8-4137-a3fa-be6f7bc70c4f None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:32:58.249112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e943e-5bf8-4137-a3fa-be6f7bc70c4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:32:58.250554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e943e-5bf8-4137-a3fa-be6f7bc70c4f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:32:58.274461 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:32:58 2022] POST /identity/v3/users => generated 275 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:01.969964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248006af-8c05-4c28-8468-8e82c1c2a187 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:01.970952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248006af-8c05-4c28-8468-8e82c1c2a187 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:01.971472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248006af-8c05-4c28-8468-8e82c1c2a187 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:01.973992 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:01.982214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e319433-6eb5-49ea-afe8-4e7226d060a2 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:01.983187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e319433-6eb5-49ea-afe8-4e7226d060a2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:01.983686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e319433-6eb5-49ea-afe8-4e7226d060a2 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:01.985839 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:01.987373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8497551-da76-42c1-b625-3865d55242b2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:01.987667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8497551-da76-42c1-b625-3865d55242b2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:01.987976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8497551-da76-42c1-b625-3865d55242b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.000822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78aa21-1032-44bd-98e7-dc51f710e201 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.001454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78aa21-1032-44bd-98e7-dc51f710e201 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.001987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78aa21-1032-44bd-98e7-dc51f710e201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.009473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d8497551-da76-42c1-b625-3865d55242b2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:02.010715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d8497551-da76-42c1-b625-3865d55242b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:02.036918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2d78aa21-1032-44bd-98e7-dc51f710e201 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:02.038110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2d78aa21-1032-44bd-98e7-dc51f710e201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:02.118220 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 33/64] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:02.142347 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 32/65] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:02.168177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8497551-da76-42c1-b625-3865d55242b2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.168466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78aa21-1032-44bd-98e7-dc51f710e201 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.270407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78aa21-1032-44bd-98e7-dc51f710e201 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:02.304544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8497551-da76-42c1-b625-3865d55242b2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:02.305419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf12c73-475a-47f4-a3f6-1f90d0ed65e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:02.306213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf12c73-475a-47f4-a3f6-1f90d0ed65e5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.306526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf12c73-475a-47f4-a3f6-1f90d0ed65e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.306811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf12c73-475a-47f4-a3f6-1f90d0ed65e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.317648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf12c73-475a-47f4-a3f6-1f90d0ed65e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:02.325096 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-1bf12c73-475a-47f4-a3f6-1f90d0ed65e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:33:02.326278 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 33/66] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:02.327481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744f91-c6e3-4e3e-9030-78f5aee7ce71 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.327774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744f91-c6e3-4e3e-9030-78f5aee7ce71 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.328092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744f91-c6e3-4e3e-9030-78f5aee7ce71 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.329888 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 34/67] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:02.330975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd810a1f-dbb3-4b87-9ca9-9dbd158ccb82 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.331112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd810a1f-dbb3-4b87-9ca9-9dbd158ccb82 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.331393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd810a1f-dbb3-4b87-9ca9-9dbd158ccb82 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.333008 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 35/68] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:02.334097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa6ce8-45a1-4476-9c8b-d8f89456b9c0 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.334387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa6ce8-45a1-4476-9c8b-d8f89456b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.334669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa6ce8-45a1-4476-9c8b-d8f89456b9c0 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.336482 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 36/69] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:02.337071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa6ce8-45a1-4476-9c8b-d8f89456b9c0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.345152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba771f-d9e6-4b97-966a-6a06ba71ff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:02.345950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba771f-d9e6-4b97-966a-6a06ba71ff84 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.346234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba771f-d9e6-4b97-966a-6a06ba71ff84 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.346515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba771f-d9e6-4b97-966a-6a06ba71ff84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.356710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba771f-d9e6-4b97-966a-6a06ba71ff84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:02.363470 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-b8ba771f-d9e6-4b97-966a-6a06ba71ff84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:02.364669 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 34/70] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:02.365817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483b87-d399-4215-a870-308bc0230422 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.366092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483b87-d399-4215-a870-308bc0230422 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.366366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7483b87-d399-4215-a870-308bc0230422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.382197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c7483b87-d399-4215-a870-308bc0230422 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:02.383381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c7483b87-d399-4215-a870-308bc0230422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:02.441684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa6ce8-45a1-4476-9c8b-d8f89456b9c0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:02.446355 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 35/71] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:02.447627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3979-a82f-4880-9857-85a676c640f8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.447931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3979-a82f-4880-9857-85a676c640f8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.448226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f3979-a82f-4880-9857-85a676c640f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.463721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b93f3979-a82f-4880-9857-85a676c640f8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:02.464906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b93f3979-a82f-4880-9857-85a676c640f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:02.477451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eed835-388c-4c2f-9631-3a00d1c8c80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:02.478121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eed835-388c-4c2f-9631-3a00d1c8c80f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.478929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eed835-388c-4c2f-9631-3a00d1c8c80f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.479213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eed835-388c-4c2f-9631-3a00d1c8c80f None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.479988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eed835-388c-4c2f-9631-3a00d1c8c80f None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:02.480304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eed835-388c-4c2f-9631-3a00d1c8c80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:02.481724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eed835-388c-4c2f-9631-3a00d1c8c80f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:02.490295 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:02.491332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f47d5-cc79-40f3-94b1-9ac459ebe59a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.491628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f47d5-cc79-40f3-94b1-9ac459ebe59a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.491941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f47d5-cc79-40f3-94b1-9ac459ebe59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.509345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d51f47d5-cc79-40f3-94b1-9ac459ebe59a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:02.511471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d51f47d5-cc79-40f3-94b1-9ac459ebe59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:02.528953 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 36/73] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:02.529720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3979-a82f-4880-9857-85a676c640f8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.578992 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 38/74] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:02.579891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f47d5-cc79-40f3-94b1-9ac459ebe59a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.625681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f3979-a82f-4880-9857-85a676c640f8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:02.656788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5535-9955-47e2-97f6-68f3d4311029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:02.657438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5535-9955-47e2-97f6-68f3d4311029 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.657723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5535-9955-47e2-97f6-68f3d4311029 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.657999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad5535-9955-47e2-97f6-68f3d4311029 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.658737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad5535-9955-47e2-97f6-68f3d4311029 None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:02.659045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad5535-9955-47e2-97f6-68f3d4311029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:02.660462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ad5535-9955-47e2-97f6-68f3d4311029 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:02.668591 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:02.669359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5535-9955-47e2-97f6-68f3d4311029 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.674109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f47d5-cc79-40f3-94b1-9ac459ebe59a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:02.706204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe3dc2-5272-4e29-bcae-cdf279c5b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:02.707000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe3dc2-5272-4e29-bcae-cdf279c5b236 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.707301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe3dc2-5272-4e29-bcae-cdf279c5b236 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.707582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe3dc2-5272-4e29-bcae-cdf279c5b236 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.717589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe3dc2-5272-4e29-bcae-cdf279c5b236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:02.725072 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-5dfe3dc2-5272-4e29-bcae-cdf279c5b236 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:02.726436 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:02.726969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe3dc2-5272-4e29-bcae-cdf279c5b236 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.766182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad5535-9955-47e2-97f6-68f3d4311029 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:02.798250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854b761-81ce-4ce6-ace7-f74006f6351b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:02.799050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854b761-81ce-4ce6-ace7-f74006f6351b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.799335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854b761-81ce-4ce6-ace7-f74006f6351b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.799615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854b761-81ce-4ce6-ace7-f74006f6351b None admin] PATH_INFO: `/v3/users/ebbe1a3c461148b98c3d0846726c2888` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.800839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854b761-81ce-4ce6-ace7-f74006f6351b None admin] RBAC: Authorizing `identity:get_user(user_id=ebbe1a3c461148b98c3d0846726c2888)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:02.802319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8854b761-81ce-4ce6-ace7-f74006f6351b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:02.803942 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 38/77] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/users/ebbe1a3c461148b98c3d0846726c2888 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:02.804695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854b761-81ce-4ce6-ace7-f74006f6351b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.821033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe3dc2-5272-4e29-bcae-cdf279c5b236 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:02.854503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79250e-fdf0-446f-a464-da809e4008d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:02.855293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79250e-fdf0-446f-a464-da809e4008d7 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.855583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79250e-fdf0-446f-a464-da809e4008d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.855866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79250e-fdf0-446f-a464-da809e4008d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.857088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79250e-fdf0-446f-a464-da809e4008d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:02.858717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79250e-fdf0-446f-a464-da809e4008d7 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:02.860425 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 40/78] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:02.861268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79250e-fdf0-446f-a464-da809e4008d7 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.901006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854b761-81ce-4ce6-ace7-f74006f6351b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:02.933045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a61867-e880-4baa-8578-b9ed8363850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:02.933827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a61867-e880-4baa-8578-b9ed8363850d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.934115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a61867-e880-4baa-8578-b9ed8363850d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.934394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a61867-e880-4baa-8578-b9ed8363850d None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:02.944752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a61867-e880-4baa-8578-b9ed8363850d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:02.952126 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-59a61867-e880-4baa-8578-b9ed8363850d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:02.953298 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 39/79] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:02.954055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a61867-e880-4baa-8578-b9ed8363850d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:02.958859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79250e-fdf0-446f-a464-da809e4008d7 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:02.990537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f68d4d-97f0-4e74-9ad8-b5d082e78435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:02.991407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68d4d-97f0-4e74-9ad8-b5d082e78435 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:02.991698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68d4d-97f0-4e74-9ad8-b5d082e78435 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:02.992015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f68d4d-97f0-4e74-9ad8-b5d082e78435 None admin] PATH_INFO: `/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.005275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f68d4d-97f0-4e74-9ad8-b5d082e78435 None admin] RBAC: Authorizing `identity:get_user(user_id=3928202b4ef24ba2bc9eb5d29b739b6b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.006767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f68d4d-97f0-4e74-9ad8-b5d082e78435 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.008459 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 41/80] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:03.009241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f68d4d-97f0-4e74-9ad8-b5d082e78435 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.055008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a61867-e880-4baa-8578-b9ed8363850d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.086268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b458179-bb03-4304-81d8-f976ad55718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.086954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b458179-bb03-4304-81d8-f976ad55718a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.087296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b458179-bb03-4304-81d8-f976ad55718a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.087581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b458179-bb03-4304-81d8-f976ad55718a None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.088366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b458179-bb03-4304-81d8-f976ad55718a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:03.088676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b458179-bb03-4304-81d8-f976ad55718a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.090075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b458179-bb03-4304-81d8-f976ad55718a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.097679 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 40/81] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:03.102504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b458179-bb03-4304-81d8-f976ad55718a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.102581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f68d4d-97f0-4e74-9ad8-b5d082e78435 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.134803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446808-e7de-4148-9573-d455308a661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.135444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446808-e7de-4148-9573-d455308a661e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.135730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446808-e7de-4148-9573-d455308a661e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.136038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4446808-e7de-4148-9573-d455308a661e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.193297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b458179-bb03-4304-81d8-f976ad55718a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.199037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4446808-e7de-4148-9573-d455308a661e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.200576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4446808-e7de-4148-9573-d455308a661e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.224591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9582-a206-4515-a18b-930c85813ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.225253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9582-a206-4515-a18b-930c85813ac0 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.225539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9582-a206-4515-a18b-930c85813ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.225814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9582-a206-4515-a18b-930c85813ac0 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.226517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d9582-a206-4515-a18b-930c85813ac0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.227990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d9582-a206-4515-a18b-930c85813ac0 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.253060 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 41/82] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:03 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:03.254059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9582-a206-4515-a18b-930c85813ac0 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.300756 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 42/83] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:03.301999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446808-e7de-4148-9573-d455308a661e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.374922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9582-a206-4515-a18b-930c85813ac0 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.406196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4446808-e7de-4148-9573-d455308a661e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.409566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a17d2-0acf-442c-9615-16c1c7924246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.410250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a17d2-0acf-442c-9615-16c1c7924246 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.410540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a17d2-0acf-442c-9615-16c1c7924246 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.410824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a17d2-0acf-442c-9615-16c1c7924246 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.411588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a17d2-0acf-442c-9615-16c1c7924246 None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:03.411900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a17d2-0acf-442c-9615-16c1c7924246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.413375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a17d2-0acf-442c-9615-16c1c7924246 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.422979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:03.423661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a17d2-0acf-442c-9615-16c1c7924246 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.449225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96958e2-db63-4759-ada2-c04a30cfe01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.449225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96958e2-db63-4759-ada2-c04a30cfe01a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.449480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96958e2-db63-4759-ada2-c04a30cfe01a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.449711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96958e2-db63-4759-ada2-c04a30cfe01a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.518994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96958e2-db63-4759-ada2-c04a30cfe01a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.520751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96958e2-db63-4759-ada2-c04a30cfe01a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.527389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a17d2-0acf-442c-9615-16c1c7924246 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.561817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d097ebd-e280-4b2a-8479-30f6a78f41c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.563013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d097ebd-e280-4b2a-8479-30f6a78f41c2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.563478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d097ebd-e280-4b2a-8479-30f6a78f41c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.563946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d097ebd-e280-4b2a-8479-30f6a78f41c2 None admin] PATH_INFO: `/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.565391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d097ebd-e280-4b2a-8479-30f6a78f41c2 None admin] RBAC: Authorizing `identity:get_user(user_id=3928202b4ef24ba2bc9eb5d29b739b6b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.567070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d097ebd-e280-4b2a-8479-30f6a78f41c2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.568911 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 43/85] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:03 2022] GET /identity/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:03.569869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d097ebd-e280-4b2a-8479-30f6a78f41c2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.622773 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 43/86] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:03.623549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96958e2-db63-4759-ada2-c04a30cfe01a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.675533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d097ebd-e280-4b2a-8479-30f6a78f41c2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.709470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d5ed-a65a-4e83-bc02-4b2f53c71b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.710325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d5ed-a65a-4e83-bc02-4b2f53c71b6f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.710613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d5ed-a65a-4e83-bc02-4b2f53c71b6f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.710894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d5ed-a65a-4e83-bc02-4b2f53c71b6f None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.712158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d5ed-a65a-4e83-bc02-4b2f53c71b6f None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.714193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d5ed-a65a-4e83-bc02-4b2f53c71b6f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.716230 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 44/87] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:03 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:03.717096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d5ed-a65a-4e83-bc02-4b2f53c71b6f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.721666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96958e2-db63-4759-ada2-c04a30cfe01a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.756287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c57c53-be4d-431b-960b-0086f8012d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.757227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c57c53-be4d-431b-960b-0086f8012d36 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.757510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c57c53-be4d-431b-960b-0086f8012d36 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.757786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c57c53-be4d-431b-960b-0086f8012d36 None admin] PATH_INFO: `/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.759040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c57c53-be4d-431b-960b-0086f8012d36 None admin] RBAC: Authorizing `identity:get_user(user_id=3928202b4ef24ba2bc9eb5d29b739b6b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.760574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c57c53-be4d-431b-960b-0086f8012d36 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.762290 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 44/88] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:03 2022] GET /identity/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:03.763056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c57c53-be4d-431b-960b-0086f8012d36 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.817914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d5ed-a65a-4e83-bc02-4b2f53c71b6f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.852446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0260b-f873-486c-857b-64f7823bea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.853099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0260b-f873-486c-857b-64f7823bea61 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.853421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0260b-f873-486c-857b-64f7823bea61 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.853707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0260b-f873-486c-857b-64f7823bea61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.862637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c57c53-be4d-431b-960b-0086f8012d36 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:03.895696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557437f8-b304-493b-8001-8feb4dfcf4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:03.896585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557437f8-b304-493b-8001-8feb4dfcf4bd None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:03.896870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557437f8-b304-493b-8001-8feb4dfcf4bd None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:03.897147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557437f8-b304-493b-8001-8feb4dfcf4bd None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:03.898333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557437f8-b304-493b-8001-8feb4dfcf4bd None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.899804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557437f8-b304-493b-8001-8feb4dfcf4bd None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.902408 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 45/89] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:03 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:03.903202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557437f8-b304-493b-8001-8feb4dfcf4bd None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:03.923673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0260b-f873-486c-857b-64f7823bea61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:03.925335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0260b-f873-486c-857b-64f7823bea61 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:03.998567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557437f8-b304-493b-8001-8feb4dfcf4bd None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:04.026753 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 45/90] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:04.031949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0260b-f873-486c-857b-64f7823bea61 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:04.036605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23b6f9-e7e3-4602-a515-3c6c9822bc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:04.037263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23b6f9-e7e3-4602-a515-3c6c9822bc81 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:04.037549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23b6f9-e7e3-4602-a515-3c6c9822bc81 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:04.037828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23b6f9-e7e3-4602-a515-3c6c9822bc81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:04.038643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23b6f9-e7e3-4602-a515-3c6c9822bc81 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=a2d411ec96874463bba5e37d88810748, user.id=ebbe1a3c461148b98c3d0846726c2888) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:04.038956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23b6f9-e7e3-4602-a515-3c6c9822bc81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:04.040476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23b6f9-e7e3-4602-a515-3c6c9822bc81 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:04.046059 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 46/91] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:03 2022] GET /identity/v3/role_assignments?user.id=ebbe1a3c461148b98c3d0846726c2888&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:04.046679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23b6f9-e7e3-4602-a515-3c6c9822bc81 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:04.131366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0260b-f873-486c-857b-64f7823bea61 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:04.148206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23b6f9-e7e3-4602-a515-3c6c9822bc81 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:04.169110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2bc64-d54f-4495-b964-add57bccd3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:04.170043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2bc64-d54f-4495-b964-add57bccd3cd None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:04.170536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2bc64-d54f-4495-b964-add57bccd3cd None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:04.170965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2bc64-d54f-4495-b964-add57bccd3cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:04.185594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c08f5-9ab5-4497-a2ff-74208eda3c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:04.186255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c08f5-9ab5-4497-a2ff-74208eda3c57 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:04.186538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c08f5-9ab5-4497-a2ff-74208eda3c57 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:04.186811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c08f5-9ab5-4497-a2ff-74208eda3c57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:04.187629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c08f5-9ab5-4497-a2ff-74208eda3c57 None admin] RBAC: Adding query filter params (role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=a2d411ec96874463bba5e37d88810748, user.id=3928202b4ef24ba2bc9eb5d29b739b6b) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:04.188145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c08f5-9ab5-4497-a2ff-74208eda3c57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:04.189763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c08f5-9ab5-4497-a2ff-74208eda3c57 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:04.196143 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 47/92] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:04 2022] GET /identity/v3/role_assignments?user.id=3928202b4ef24ba2bc9eb5d29b739b6b&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:04.197691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c08f5-9ab5-4497-a2ff-74208eda3c57 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:04.251894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2bc64-d54f-4495-b964-add57bccd3cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:04.257441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2bc64-d54f-4495-b964-add57bccd3cd None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:04.303370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c08f5-9ab5-4497-a2ff-74208eda3c57 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:04.340841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d05c2b-218f-413d-b0a8-4343a5d07e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:04.341960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d05c2b-218f-413d-b0a8-4343a5d07e54 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:04.342389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d05c2b-218f-413d-b0a8-4343a5d07e54 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:04.342812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d05c2b-218f-413d-b0a8-4343a5d07e54 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:04.344289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d05c2b-218f-413d-b0a8-4343a5d07e54 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:04.345915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d05c2b-218f-413d-b0a8-4343a5d07e54 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:04.348187 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:04 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:04.354133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d05c2b-218f-413d-b0a8-4343a5d07e54 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:04.368852 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 46/94] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:04.375373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2bc64-d54f-4495-b964-add57bccd3cd None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:04.458767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d05c2b-218f-413d-b0a8-4343a5d07e54 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:04.490423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2bc64-d54f-4495-b964-add57bccd3cd None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:04.494701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6231a-a702-4e55-8284-aa198ff547f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:04.495599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6231a-a702-4e55-8284-aa198ff547f8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:04.496095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6231a-a702-4e55-8284-aa198ff547f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:04.496512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6231a-a702-4e55-8284-aa198ff547f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:04.497480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6231a-a702-4e55-8284-aa198ff547f8 None admin] RBAC: Adding query filter params (role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=a2d411ec96874463bba5e37d88810748, user.id=3928202b4ef24ba2bc9eb5d29b739b6b) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:04.497932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6231a-a702-4e55-8284-aa198ff547f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:04.499679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6231a-a702-4e55-8284-aa198ff547f8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:04.505905 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 49/95] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:04 2022] GET /identity/v3/role_assignments?user.id=3928202b4ef24ba2bc9eb5d29b739b6b&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:04.529992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08944e17-7099-42c2-ba1e-5ffbd99a8346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:04.530880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08944e17-7099-42c2-ba1e-5ffbd99a8346 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:04.531169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08944e17-7099-42c2-ba1e-5ffbd99a8346 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:04.531453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08944e17-7099-42c2-ba1e-5ffbd99a8346 None admin] PATH_INFO: `/v3/projects/1c975a825fc243169e172fc822838a2b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:04.535317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08944e17-7099-42c2-ba1e-5ffbd99a8346 None admin] RBAC: Authorizing `identity:get_project(project_id=1c975a825fc243169e172fc822838a2b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:04.536908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08944e17-7099-42c2-ba1e-5ffbd99a8346 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:04.539104 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 47/96] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:04 2022] GET /identity/v3/projects/1c975a825fc243169e172fc822838a2b => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:04.545552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6231a-a702-4e55-8284-aa198ff547f8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:04.670751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6231a-a702-4e55-8284-aa198ff547f8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:04.707380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff41644-953a-484a-83d9-d7c209429d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:04.708321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41644-953a-484a-83d9-d7c209429d59 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:04.708746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41644-953a-484a-83d9-d7c209429d59 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:04.709163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff41644-953a-484a-83d9-d7c209429d59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:04.710165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff41644-953a-484a-83d9-d7c209429d59 None admin] RBAC: Adding query filter params (role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=1c975a825fc243169e172fc822838a2b, user.id=3928202b4ef24ba2bc9eb5d29b739b6b) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:04.710608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff41644-953a-484a-83d9-d7c209429d59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:04.712237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff41644-953a-484a-83d9-d7c209429d59 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:04.718634 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 50/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:04 2022] GET /identity/v3/role_assignments?user.id=3928202b4ef24ba2bc9eb5d29b739b6b&scope.project.id=1c975a825fc243169e172fc822838a2b&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:06.584203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43b345-7682-434e-bfee-e0efff409f65 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:06.584813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43b345-7682-434e-bfee-e0efff409f65 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:06.584813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43b345-7682-434e-bfee-e0efff409f65 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:06.586732 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 48/98] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:06.602983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead7866-6381-43ba-acfa-96ab7bd9ab7b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:06.603531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead7866-6381-43ba-acfa-96ab7bd9ab7b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:06.603612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead7866-6381-43ba-acfa-96ab7bd9ab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:06.626313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4ead7866-6381-43ba-acfa-96ab7bd9ab7b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:06.627520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4ead7866-6381-43ba-acfa-96ab7bd9ab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:06.708547 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 51/99] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:06.733258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43b345-7682-434e-bfee-e0efff409f65 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:06.837251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43b345-7682-434e-bfee-e0efff409f65 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:06.872783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215bed-2cb7-46b9-a03f-2a63ef392e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:06.873585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215bed-2cb7-46b9-a03f-2a63ef392e4f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:06.873861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215bed-2cb7-46b9-a03f-2a63ef392e4f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:06.874141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215bed-2cb7-46b9-a03f-2a63ef392e4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:06.885058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90215bed-2cb7-46b9-a03f-2a63ef392e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:06.892017 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-90215bed-2cb7-46b9-a03f-2a63ef392e4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 26 20:33:06.893534 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 49/100] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:06.899217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead7866-6381-43ba-acfa-96ab7bd9ab7b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:07.008676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead7866-6381-43ba-acfa-96ab7bd9ab7b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:07.042358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8d8c6-0755-4c56-be26-4ca8cf9d727f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:07.043034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d8c6-0755-4c56-be26-4ca8cf9d727f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.043325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d8c6-0755-4c56-be26-4ca8cf9d727f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.043604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d8c6-0755-4c56-be26-4ca8cf9d727f None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.044393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8d8c6-0755-4c56-be26-4ca8cf9d727f None admin] RBAC: Adding query filter params (name=reader) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:07.044709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8d8c6-0755-4c56-be26-4ca8cf9d727f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:07.046116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8d8c6-0755-4c56-be26-4ca8cf9d727f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:07.054586 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 52/101] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:07.060088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215bed-2cb7-46b9-a03f-2a63ef392e4f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:07.157418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9f2a5-6993-46f6-9625-494f412e8954 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.157719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9f2a5-6993-46f6-9625-494f412e8954 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.157913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9f2a5-6993-46f6-9625-494f412e8954 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.159982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 53/102] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:07.166154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8288b6-58ff-49a2-82d8-cb396f08df3a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.166488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8288b6-58ff-49a2-82d8-cb396f08df3a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.166780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8288b6-58ff-49a2-82d8-cb396f08df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.185979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215bed-2cb7-46b9-a03f-2a63ef392e4f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:07.194592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5e8288b6-58ff-49a2-82d8-cb396f08df3a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:07.195814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5e8288b6-58ff-49a2-82d8-cb396f08df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:07.248599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e81eb2-8c74-467d-8fcb-f08c7a6c4c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:07.249833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e81eb2-8c74-467d-8fcb-f08c7a6c4c41 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.250326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e81eb2-8c74-467d-8fcb-f08c7a6c4c41 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.250809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e81eb2-8c74-467d-8fcb-f08c7a6c4c41 None admin] PATH_INFO: `/v3/users/5c9f2575150b4a23a6801feb971c5669` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.273193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 54/103] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:07.280683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e81eb2-8c74-467d-8fcb-f08c7a6c4c41 None admin] RBAC: Authorizing `identity:get_user(user_id=5c9f2575150b4a23a6801feb971c5669)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:07.282165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e81eb2-8c74-467d-8fcb-f08c7a6c4c41 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:07.284176 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 50/104] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:07 2022] GET /identity/v3/users/5c9f2575150b4a23a6801feb971c5669 => generated 289 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:07.294830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8288b6-58ff-49a2-82d8-cb396f08df3a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:07.331620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e81eb2-8c74-467d-8fcb-f08c7a6c4c41 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:07.410729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8288b6-58ff-49a2-82d8-cb396f08df3a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:07.449581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0625-3b28-4301-babe-249721946c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:07.450289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0625-3b28-4301-babe-249721946c50 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.450586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0625-3b28-4301-babe-249721946c50 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.450868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0625-3b28-4301-babe-249721946c50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.522167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0625-3b28-4301-babe-249721946c50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:07.523676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0625-3b28-4301-babe-249721946c50 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:07.524852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e81eb2-8c74-467d-8fcb-f08c7a6c4c41 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:07.608653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fd090-7e0f-46ef-a2cd-93fd22616bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:07.610268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fd090-7e0f-46ef-a2cd-93fd22616bab None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.610763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fd090-7e0f-46ef-a2cd-93fd22616bab None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.611275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fd090-7e0f-46ef-a2cd-93fd22616bab None admin] PATH_INFO: `/v3/domains/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.612753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fd090-7e0f-46ef-a2cd-93fd22616bab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:07.614446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fd090-7e0f-46ef-a2cd-93fd22616bab None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:07.616680 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 51/105] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:07.618068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f138d-96eb-46ef-b187-420f427f1f59 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.618556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f138d-96eb-46ef-b187-420f427f1f59 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.619084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f138d-96eb-46ef-b187-420f427f1f59 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.627943 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 52/106] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:07.628122 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 55/107] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:07.630002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea4fd-3876-4f2e-ab7d-43b1f27e376a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.630506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea4fd-3876-4f2e-ab7d-43b1f27e376a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.631000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ea4fd-3876-4f2e-ab7d-43b1f27e376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.632182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0625-3b28-4301-babe-249721946c50 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:07.664955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-125ea4fd-3876-4f2e-ab7d-43b1f27e376a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:07.666500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-125ea4fd-3876-4f2e-ab7d-43b1f27e376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:07.735500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0625-3b28-4301-babe-249721946c50 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:07.771360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007017b8-e156-4e9f-a7ed-0e91e6677b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:07.772116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007017b8-e156-4e9f-a7ed-0e91e6677b75 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.772406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007017b8-e156-4e9f-a7ed-0e91e6677b75 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.772690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007017b8-e156-4e9f-a7ed-0e91e6677b75 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.773458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007017b8-e156-4e9f-a7ed-0e91e6677b75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:07.774911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007017b8-e156-4e9f-a7ed-0e91e6677b75 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:07.801455 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 56/108] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:33:07 2022] POST /identity/v3/projects => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:07.802363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007017b8-e156-4e9f-a7ed-0e91e6677b75 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:07.806878 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 53/109] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:07.846583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ea4fd-3876-4f2e-ab7d-43b1f27e376a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:07.916234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007017b8-e156-4e9f-a7ed-0e91e6677b75 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:07.953048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6e31a-65c0-456c-980b-b7923023348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:07.953935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6e31a-65c0-456c-980b-b7923023348b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.954225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6e31a-65c0-456c-980b-b7923023348b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.954507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6e31a-65c0-456c-980b-b7923023348b None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.955803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6e31a-65c0-456c-980b-b7923023348b None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:07.957368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6e31a-65c0-456c-980b-b7923023348b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:07.960413 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 57/110] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:07 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:07.965558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe806bd6-74f0-422d-93aa-9c030fd9dcb8 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:07.965711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe806bd6-74f0-422d-93aa-9c030fd9dcb8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:07.966006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe806bd6-74f0-422d-93aa-9c030fd9dcb8 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:07.972508 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 58/111] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:07.977039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe806bd6-74f0-422d-93aa-9c030fd9dcb8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:07.994450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ea4fd-3876-4f2e-ab7d-43b1f27e376a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.038589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d3251-3087-4fd1-bf4c-3a850212f2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:08.039771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d3251-3087-4fd1-bf4c-3a850212f2c6 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.040485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d3251-3087-4fd1-bf4c-3a850212f2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.041585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d3251-3087-4fd1-bf4c-3a850212f2c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.054133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d3251-3087-4fd1-bf4c-3a850212f2c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:08.061829 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-8d8d3251-3087-4fd1-bf4c-3a850212f2c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:08.063491 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 54/112] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:08.065090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b80b88-e357-4486-a9a8-e1e194d1064f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.065653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b80b88-e357-4486-a9a8-e1e194d1064f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.066131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b80b88-e357-4486-a9a8-e1e194d1064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.085034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-26b80b88-e357-4486-a9a8-e1e194d1064f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:08.086747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-26b80b88-e357-4486-a9a8-e1e194d1064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:08.108416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe806bd6-74f0-422d-93aa-9c030fd9dcb8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.145956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b8cc8-8717-4c0d-8425-ea6d7953148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:08.146625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b8cc8-8717-4c0d-8425-ea6d7953148b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.146920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b8cc8-8717-4c0d-8425-ea6d7953148b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.147200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b8cc8-8717-4c0d-8425-ea6d7953148b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.148338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b8cc8-8717-4c0d-8425-ea6d7953148b None admin] RBAC: Adding query filter params (role.id=650bb9543cc549219855a68f47ec7e75, scope.project.id=a2d411ec96874463bba5e37d88810748, user.id=5c9f2575150b4a23a6801feb971c5669) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:08.148547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b8cc8-8717-4c0d-8425-ea6d7953148b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:08.150596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b8cc8-8717-4c0d-8425-ea6d7953148b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:08.157101 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 59/113] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:07 2022] GET /identity/v3/role_assignments?user.id=5c9f2575150b4a23a6801feb971c5669&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=650bb9543cc549219855a68f47ec7e75 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:08.158185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a9a3-2517-4e51-b826-3de35ae5706c None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.158519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a9a3-2517-4e51-b826-3de35ae5706c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.158754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd03a9a3-2517-4e51-b826-3de35ae5706c None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.160807 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 55/114] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:08.161439 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 60/115] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:08.162099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b80b88-e357-4486-a9a8-e1e194d1064f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:08.169866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabfece-507a-4e3d-9e68-51ee2e82ecaf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.170162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabfece-507a-4e3d-9e68-51ee2e82ecaf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.170484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabfece-507a-4e3d-9e68-51ee2e82ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.195300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fdabfece-507a-4e3d-9e68-51ee2e82ecaf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:08.197888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fdabfece-507a-4e3d-9e68-51ee2e82ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:08.291502 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 61/116] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:08.292739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabfece-507a-4e3d-9e68-51ee2e82ecaf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:08.298032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b80b88-e357-4486-a9a8-e1e194d1064f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.344071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040c76b-9120-4781-a717-5aecbc2e944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:08.344752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040c76b-9120-4781-a717-5aecbc2e944f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.345044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040c76b-9120-4781-a717-5aecbc2e944f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.345332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040c76b-9120-4781-a717-5aecbc2e944f None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.346083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040c76b-9120-4781-a717-5aecbc2e944f None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:08.346392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040c76b-9120-4781-a717-5aecbc2e944f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:08.348272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040c76b-9120-4781-a717-5aecbc2e944f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:08.357945 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 56/117] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:08.358813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040c76b-9120-4781-a717-5aecbc2e944f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:08.407053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabfece-507a-4e3d-9e68-51ee2e82ecaf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.455826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546d26-502f-4778-bcf6-3a9c76745caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:08.456587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546d26-502f-4778-bcf6-3a9c76745caf None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.456872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546d26-502f-4778-bcf6-3a9c76745caf None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.457150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a546d26-502f-4778-bcf6-3a9c76745caf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.466391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040c76b-9120-4781-a717-5aecbc2e944f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.476046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a546d26-502f-4778-bcf6-3a9c76745caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:08.485212 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0a546d26-502f-4778-bcf6-3a9c76745caf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:33:08.486847 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 62/118] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:08.487748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546d26-502f-4778-bcf6-3a9c76745caf None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:08.521621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7e6a9-9afb-4845-bbe3-d2da340821dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:08.522807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7e6a9-9afb-4845-bbe3-d2da340821dc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.523317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7e6a9-9afb-4845-bbe3-d2da340821dc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.523822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7e6a9-9afb-4845-bbe3-d2da340821dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.556903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7e6a9-9afb-4845-bbe3-d2da340821dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:08.573128 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-52d7e6a9-9afb-4845-bbe3-d2da340821dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:08.574625 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 57/119] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:08.575629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7e6a9-9afb-4845-bbe3-d2da340821dc None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:08.608358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a546d26-502f-4778-bcf6-3a9c76745caf None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.645139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4413ae-d2fd-4aa8-b274-080a7ec157a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:08.651843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4413ae-d2fd-4aa8-b274-080a7ec157a8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.651843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4413ae-d2fd-4aa8-b274-080a7ec157a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.651843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4413ae-d2fd-4aa8-b274-080a7ec157a8 None admin] PATH_INFO: `/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.651843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4413ae-d2fd-4aa8-b274-080a7ec157a8 None admin] RBAC: Authorizing `identity:get_user(user_id=3928202b4ef24ba2bc9eb5d29b739b6b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:08.651843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4413ae-d2fd-4aa8-b274-080a7ec157a8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:08.651843 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 63/120] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:08 2022] GET /identity/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:08.652450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4413ae-d2fd-4aa8-b274-080a7ec157a8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:08.754054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4413ae-d2fd-4aa8-b274-080a7ec157a8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.781846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7e6a9-9afb-4845-bbe3-d2da340821dc None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.788134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebdf93-e75c-4001-afa9-0a8d98fd6716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:08.789016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebdf93-e75c-4001-afa9-0a8d98fd6716 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.789410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebdf93-e75c-4001-afa9-0a8d98fd6716 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.789808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ebdf93-e75c-4001-afa9-0a8d98fd6716 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.790693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebdf93-e75c-4001-afa9-0a8d98fd6716 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:08.791156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebdf93-e75c-4001-afa9-0a8d98fd6716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:08.792684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ebdf93-e75c-4001-afa9-0a8d98fd6716 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:08.800766 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 64/121] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:08.805294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebdf93-e75c-4001-afa9-0a8d98fd6716 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:08.829396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50d4c2a-f800-45c8-99b2-9e2a4c7155e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:08.830669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d4c2a-f800-45c8-99b2-9e2a4c7155e6 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.831390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d4c2a-f800-45c8-99b2-9e2a4c7155e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.831850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50d4c2a-f800-45c8-99b2-9e2a4c7155e6 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.833316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d4c2a-f800-45c8-99b2-9e2a4c7155e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:08.833954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d4c2a-f800-45c8-99b2-9e2a4c7155e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:08.835812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50d4c2a-f800-45c8-99b2-9e2a4c7155e6 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:08.846094 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 58/122] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:08.851342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b05dd-7d63-4ada-a26e-e2a4cef53562 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.851342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b05dd-7d63-4ada-a26e-e2a4cef53562 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.851342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b05dd-7d63-4ada-a26e-e2a4cef53562 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.853956 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 59/123] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:08.857208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b05dd-7d63-4ada-a26e-e2a4cef53562 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:08.932573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ebdf93-e75c-4001-afa9-0a8d98fd6716 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.965402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b05dd-7d63-4ada-a26e-e2a4cef53562 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:08.968785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c9ae8-e2a3-4d5e-945a-b9254371ae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:08.969814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c9ae8-e2a3-4d5e-945a-b9254371ae15 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:08.970201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c9ae8-e2a3-4d5e-945a-b9254371ae15 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:08.970632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c9ae8-e2a3-4d5e-945a-b9254371ae15 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:08.971971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c9ae8-e2a3-4d5e-945a-b9254371ae15 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:08.973938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c9ae8-e2a3-4d5e-945a-b9254371ae15 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:08.975958 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 65/124] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:08 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:08.976887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c9ae8-e2a3-4d5e-945a-b9254371ae15 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:09.008887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdb109-0f34-4747-9cbf-562f2e2755e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:09.009640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdb109-0f34-4747-9cbf-562f2e2755e0 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:09.009925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdb109-0f34-4747-9cbf-562f2e2755e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:09.010205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdb109-0f34-4747-9cbf-562f2e2755e0 None admin] PATH_INFO: `/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:09.013054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdb109-0f34-4747-9cbf-562f2e2755e0 None admin] RBAC: Authorizing `identity:get_user(user_id=3928202b4ef24ba2bc9eb5d29b739b6b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:09.014522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdb109-0f34-4747-9cbf-562f2e2755e0 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:09.016227 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 60/125] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:08 2022] GET /identity/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:09.021301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4b57c-5ab3-419a-80f1-3e0abab0dafb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:09.021301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4b57c-5ab3-419a-80f1-3e0abab0dafb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:09.021301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4b57c-5ab3-419a-80f1-3e0abab0dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:09.048418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f1c4b57c-5ab3-419a-80f1-3e0abab0dafb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:09.050394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f1c4b57c-5ab3-419a-80f1-3e0abab0dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:09.110403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c9ae8-e2a3-4d5e-945a-b9254371ae15 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:09.119268 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 61/126] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:09.120199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4b57c-5ab3-419a-80f1-3e0abab0dafb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:09.155747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f087-76e9-4e5d-84f8-706c61c2070a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:09.156711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f087-76e9-4e5d-84f8-706c61c2070a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:09.157004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f087-76e9-4e5d-84f8-706c61c2070a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:09.157290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24f087-76e9-4e5d-84f8-706c61c2070a None admin] PATH_INFO: `/v3/users/ebbe1a3c461148b98c3d0846726c2888` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:09.158555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24f087-76e9-4e5d-84f8-706c61c2070a None admin] RBAC: Authorizing `identity:get_user(user_id=ebbe1a3c461148b98c3d0846726c2888)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:09.160257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24f087-76e9-4e5d-84f8-706c61c2070a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:09.162033 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 66/127] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:08 2022] GET /identity/v3/users/ebbe1a3c461148b98c3d0846726c2888 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:09.162709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f087-76e9-4e5d-84f8-706c61c2070a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:09.236957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4b57c-5ab3-419a-80f1-3e0abab0dafb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:09.266266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24f087-76e9-4e5d-84f8-706c61c2070a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:09.278548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982a118-4bfa-4d45-9d42-0e9bc70e6b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:09.279613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982a118-4bfa-4d45-9d42-0e9bc70e6b32 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:09.279901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982a118-4bfa-4d45-9d42-0e9bc70e6b32 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:09.280560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982a118-4bfa-4d45-9d42-0e9bc70e6b32 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748/users/3928202b4ef24ba2bc9eb5d29b739b6b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:09.282932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982a118-4bfa-4d45-9d42-0e9bc70e6b32 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2d411ec96874463bba5e37d88810748, user_id=3928202b4ef24ba2bc9eb5d29b739b6b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:09.284734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982a118-4bfa-4d45-9d42-0e9bc70e6b32 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:09.302549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396f442-13dc-45e6-abca-da65e2b5747f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:09.303195 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 62/128] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:33:09 2022] PUT /identity/v3/projects/a2d411ec96874463bba5e37d88810748/users/3928202b4ef24ba2bc9eb5d29b739b6b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:09.303734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396f442-13dc-45e6-abca-da65e2b5747f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:09.304108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396f442-13dc-45e6-abca-da65e2b5747f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:09.304221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982a118-4bfa-4d45-9d42-0e9bc70e6b32 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:09.304401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396f442-13dc-45e6-abca-da65e2b5747f None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:09.305655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396f442-13dc-45e6-abca-da65e2b5747f None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:09.307752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3396f442-13dc-45e6-abca-da65e2b5747f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:09.309808 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 67/129] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:09 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:09.310539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396f442-13dc-45e6-abca-da65e2b5747f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:09.497400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982a118-4bfa-4d45-9d42-0e9bc70e6b32 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:09.523020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396f442-13dc-45e6-abca-da65e2b5747f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:09.553651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e876f-a998-4bf3-86d7-60386b834c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:09.554799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e876f-a998-4bf3-86d7-60386b834c09 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:09.555089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e876f-a998-4bf3-86d7-60386b834c09 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:09.555372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e876f-a998-4bf3-86d7-60386b834c09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:09.567722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e876f-a998-4bf3-86d7-60386b834c09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:09.574783 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-fd3e876f-a998-4bf3-86d7-60386b834c09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:09.577646 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 63/130] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:09.578242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e876f-a998-4bf3-86d7-60386b834c09 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:09.584618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a34ef-a4f6-40e5-b36b-9a6cd21b3fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:09.585492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a34ef-a4f6-40e5-b36b-9a6cd21b3fd1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:09.585782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a34ef-a4f6-40e5-b36b-9a6cd21b3fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:09.586065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a34ef-a4f6-40e5-b36b-9a6cd21b3fd1 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:09.589087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a34ef-a4f6-40e5-b36b-9a6cd21b3fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:09.590966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a34ef-a4f6-40e5-b36b-9a6cd21b3fd1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:09.595108 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 68/131] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:09 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:09.596095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a34ef-a4f6-40e5-b36b-9a6cd21b3fd1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:09.689231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e876f-a998-4bf3-86d7-60386b834c09 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:09.725849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a34ef-a4f6-40e5-b36b-9a6cd21b3fd1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:09.732930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6956c3-01b2-4893-95cb-1de6fcc78460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:09.733818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6956c3-01b2-4893-95cb-1de6fcc78460 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:09.734103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6956c3-01b2-4893-95cb-1de6fcc78460 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:09.734381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6956c3-01b2-4893-95cb-1de6fcc78460 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748/users/3928202b4ef24ba2bc9eb5d29b739b6b/roles/e875b4dda15a40c6aa7d8d75c96b3597` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:09.742771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6956c3-01b2-4893-95cb-1de6fcc78460 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2d411ec96874463bba5e37d88810748, user_id=3928202b4ef24ba2bc9eb5d29b739b6b, role_id=e875b4dda15a40c6aa7d8d75c96b3597)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:09.746224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6956c3-01b2-4893-95cb-1de6fcc78460 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:09.773384 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 64/132] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:33:09 2022] PUT /identity/v3/projects/a2d411ec96874463bba5e37d88810748/users/3928202b4ef24ba2bc9eb5d29b739b6b/roles/e875b4dda15a40c6aa7d8d75c96b3597 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:09.774199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6956c3-01b2-4893-95cb-1de6fcc78460 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:09.796763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ae77a-8ed0-4c7d-98af-95d749b724df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:09.797452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ae77a-8ed0-4c7d-98af-95d749b724df None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:09.797740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ae77a-8ed0-4c7d-98af-95d749b724df None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:09.798075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ae77a-8ed0-4c7d-98af-95d749b724df None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:09.798833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ae77a-8ed0-4c7d-98af-95d749b724df None admin] RBAC: Adding query filter params (name=member) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:09.799224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ae77a-8ed0-4c7d-98af-95d749b724df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:09.800686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ae77a-8ed0-4c7d-98af-95d749b724df None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:09.826132 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 69/133] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:09.836137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ae77a-8ed0-4c7d-98af-95d749b724df None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:09.965439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6956c3-01b2-4893-95cb-1de6fcc78460 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:10.022099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362e998-4248-48a5-b087-601f3740c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:10.023025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362e998-4248-48a5-b087-601f3740c1cf None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:10.023315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362e998-4248-48a5-b087-601f3740c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:10.023654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362e998-4248-48a5-b087-601f3740c1cf None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748/users/ebbe1a3c461148b98c3d0846726c2888/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:10.027945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362e998-4248-48a5-b087-601f3740c1cf None admin] RBAC: Authorizing `identity:create_grant(project_id=a2d411ec96874463bba5e37d88810748, user_id=ebbe1a3c461148b98c3d0846726c2888, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:10.027945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362e998-4248-48a5-b087-601f3740c1cf None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:10.055067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ae77a-8ed0-4c7d-98af-95d749b724df None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:10.057709 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 65/134] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:33:09 2022] PUT /identity/v3/projects/a2d411ec96874463bba5e37d88810748/users/ebbe1a3c461148b98c3d0846726c2888/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:10.109880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02096b72-b6cd-4df5-9fb7-ceb4ed658292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:10.110807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02096b72-b6cd-4df5-9fb7-ceb4ed658292 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:10.111123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02096b72-b6cd-4df5-9fb7-ceb4ed658292 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:10.111408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02096b72-b6cd-4df5-9fb7-ceb4ed658292 None admin] PATH_INFO: `/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:10.112675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02096b72-b6cd-4df5-9fb7-ceb4ed658292 None admin] RBAC: Authorizing `identity:get_user(user_id=3928202b4ef24ba2bc9eb5d29b739b6b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:10.114157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02096b72-b6cd-4df5-9fb7-ceb4ed658292 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:10.116053 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 70/135] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:09 2022] GET /identity/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:10.122478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362e998-4248-48a5-b087-601f3740c1cf None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:10.272520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362e998-4248-48a5-b087-601f3740c1cf None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:10.309417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3116a1-c2f8-4fbd-864b-ee3c89a22701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:10.310208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3116a1-c2f8-4fbd-864b-ee3c89a22701 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:10.310501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3116a1-c2f8-4fbd-864b-ee3c89a22701 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:10.310847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3116a1-c2f8-4fbd-864b-ee3c89a22701 None admin] PATH_INFO: `/v3/projects/1c975a825fc243169e172fc822838a2b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:10.312024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3116a1-c2f8-4fbd-864b-ee3c89a22701 None admin] RBAC: Authorizing `identity:get_project(project_id=1c975a825fc243169e172fc822838a2b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:10.313511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3116a1-c2f8-4fbd-864b-ee3c89a22701 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:10.315196 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 66/136] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:10 2022] GET /identity/v3/projects/1c975a825fc243169e172fc822838a2b => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:10.322314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02096b72-b6cd-4df5-9fb7-ceb4ed658292 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:10.458098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02096b72-b6cd-4df5-9fb7-ceb4ed658292 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:10.495905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0061244-33bc-4219-8490-21445f53de29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:10.496828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061244-33bc-4219-8490-21445f53de29 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:10.497112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061244-33bc-4219-8490-21445f53de29 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:10.497391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061244-33bc-4219-8490-21445f53de29 None admin] PATH_INFO: `/v3/projects/1c975a825fc243169e172fc822838a2b/users/3928202b4ef24ba2bc9eb5d29b739b6b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:10.499380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0061244-33bc-4219-8490-21445f53de29 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c975a825fc243169e172fc822838a2b, user_id=3928202b4ef24ba2bc9eb5d29b739b6b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:10.501035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0061244-33bc-4219-8490-21445f53de29 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:10.531837 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 71/137] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:33:10 2022] PUT /identity/v3/projects/1c975a825fc243169e172fc822838a2b/users/3928202b4ef24ba2bc9eb5d29b739b6b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:10.961228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae5ee-623f-4742-af3b-4adafe502f6f None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:10.961594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae5ee-623f-4742-af3b-4adafe502f6f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:10.961800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccae5ee-623f-4742-af3b-4adafe502f6f None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:10.964148 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 67/138] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:10.970684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1140e-74cc-4c1e-b811-974366f5ede9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:10.971239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1140e-74cc-4c1e-b811-974366f5ede9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:10.971239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1140e-74cc-4c1e-b811-974366f5ede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:10.991060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-79b1140e-74cc-4c1e-b811-974366f5ede9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:10.992301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-79b1140e-74cc-4c1e-b811-974366f5ede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:11.080051 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 72/139] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:11.123463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae5ee-623f-4742-af3b-4adafe502f6f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:11.246995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccae5ee-623f-4742-af3b-4adafe502f6f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:11.282236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e078ad-4955-414f-b62f-57034f6b630b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:11.283034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e078ad-4955-414f-b62f-57034f6b630b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:11.283323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e078ad-4955-414f-b62f-57034f6b630b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:11.283606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e078ad-4955-414f-b62f-57034f6b630b None admin] PATH_INFO: `/v3/domains/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:11.284821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e078ad-4955-414f-b62f-57034f6b630b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:11.286659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e078ad-4955-414f-b62f-57034f6b630b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:11.288728 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 68/140] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:11.301012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1140e-74cc-4c1e-b811-974366f5ede9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:11.428622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1140e-74cc-4c1e-b811-974366f5ede9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:11.429055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa65a5-042f-4037-935e-7a462559773a None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:11.429450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa65a5-042f-4037-935e-7a462559773a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:11.429841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa65a5-042f-4037-935e-7a462559773a None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:11.432866 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 69/141] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:11.439422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9787b-c01f-4c77-85de-362f2463294f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:11.439832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9787b-c01f-4c77-85de-362f2463294f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:11.440257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9787b-c01f-4c77-85de-362f2463294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:11.457852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3cd9787b-c01f-4c77-85de-362f2463294f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:11.459183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3cd9787b-c01f-4c77-85de-362f2463294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:11.467377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca141-60a3-4f57-9d13-e295d1e18987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:11.468080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca141-60a3-4f57-9d13-e295d1e18987 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:11.468371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca141-60a3-4f57-9d13-e295d1e18987 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:11.468648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dca141-60a3-4f57-9d13-e295d1e18987 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:11.469364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca141-60a3-4f57-9d13-e295d1e18987 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:11.470839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dca141-60a3-4f57-9d13-e295d1e18987 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:11.507067 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 73/142] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:11 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:11.544202 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 70/143] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:11.571492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca141-60a3-4f57-9d13-e295d1e18987 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:11.703941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dca141-60a3-4f57-9d13-e295d1e18987 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:11.748402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf0bfb-a1d8-46bd-989c-37c525210f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:11.749626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf0bfb-a1d8-46bd-989c-37c525210f56 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:11.750152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf0bfb-a1d8-46bd-989c-37c525210f56 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:11.750667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf0bfb-a1d8-46bd-989c-37c525210f56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:11.767726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf0bfb-a1d8-46bd-989c-37c525210f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:11.775928 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-78cf0bfb-a1d8-46bd-989c-37c525210f56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 26 20:33:11.777506 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 74/144] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:11.784150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9787b-c01f-4c77-85de-362f2463294f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:11.892540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9787b-c01f-4c77-85de-362f2463294f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:11.933052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3931989-002d-4160-af98-6e6cb136c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:11.934088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3931989-002d-4160-af98-6e6cb136c987 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:11.934601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3931989-002d-4160-af98-6e6cb136c987 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:11.935077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3931989-002d-4160-af98-6e6cb136c987 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:11.936082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3931989-002d-4160-af98-6e6cb136c987 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:11.936655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3931989-002d-4160-af98-6e6cb136c987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:11.938374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3931989-002d-4160-af98-6e6cb136c987 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:11.948402 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 71/145] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:11.954494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf0bfb-a1d8-46bd-989c-37c525210f56 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:12.066354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf0bfb-a1d8-46bd-989c-37c525210f56 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:12.103906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c62e5-f133-426d-8a14-95263e91ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:12.104800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c62e5-f133-426d-8a14-95263e91ea4b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:12.105088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c62e5-f133-426d-8a14-95263e91ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:12.105362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c62e5-f133-426d-8a14-95263e91ea4b None admin] PATH_INFO: `/v3/users/5c9f2575150b4a23a6801feb971c5669` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:12.106573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c62e5-f133-426d-8a14-95263e91ea4b None admin] RBAC: Authorizing `identity:get_user(user_id=5c9f2575150b4a23a6801feb971c5669)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:12.108099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c62e5-f133-426d-8a14-95263e91ea4b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:12.109874 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 75/146] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:11 2022] GET /identity/v3/users/5c9f2575150b4a23a6801feb971c5669 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:12.115278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3931989-002d-4160-af98-6e6cb136c987 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:12.222657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3931989-002d-4160-af98-6e6cb136c987 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:12.255628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d55693-ca2b-40fa-87de-3b2ed8645c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:12.256534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d55693-ca2b-40fa-87de-3b2ed8645c04 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:12.256817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d55693-ca2b-40fa-87de-3b2ed8645c04 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:12.257091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d55693-ca2b-40fa-87de-3b2ed8645c04 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:12.258312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d55693-ca2b-40fa-87de-3b2ed8645c04 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:12.260565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d55693-ca2b-40fa-87de-3b2ed8645c04 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:12.262572 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 72/147] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:12 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:12.268573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c62e5-f133-426d-8a14-95263e91ea4b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:12.373143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c62e5-f133-426d-8a14-95263e91ea4b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:12.416449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6bcec-d8e0-4426-bada-6b26c80bfa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:12.417342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6bcec-d8e0-4426-bada-6b26c80bfa74 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:12.417672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6bcec-d8e0-4426-bada-6b26c80bfa74 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:12.417964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6bcec-d8e0-4426-bada-6b26c80bfa74 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748/users/5c9f2575150b4a23a6801feb971c5669/roles/650bb9543cc549219855a68f47ec7e75` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:12.420011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6bcec-d8e0-4426-bada-6b26c80bfa74 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2d411ec96874463bba5e37d88810748, user_id=5c9f2575150b4a23a6801feb971c5669, role_id=650bb9543cc549219855a68f47ec7e75)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:12.421473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6bcec-d8e0-4426-bada-6b26c80bfa74 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:12.438814 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 76/148] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:33:12 2022] PUT /identity/v3/projects/a2d411ec96874463bba5e37d88810748/users/5c9f2575150b4a23a6801feb971c5669/roles/650bb9543cc549219855a68f47ec7e75 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:33:12.736552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fd200-e422-41e7-8556-3ad7aad60bc6 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:12.737057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fd200-e422-41e7-8556-3ad7aad60bc6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:12.737438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fd200-e422-41e7-8556-3ad7aad60bc6 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:12.739470 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 73/149] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:12.746256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe412d5-5327-4095-a546-2b2b1b554627 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:12.746549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe412d5-5327-4095-a546-2b2b1b554627 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:12.746829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe412d5-5327-4095-a546-2b2b1b554627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:12.767943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-abe412d5-5327-4095-a546-2b2b1b554627 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:12.769171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-abe412d5-5327-4095-a546-2b2b1b554627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:12.852984 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 77/150] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:12.897767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fd200-e422-41e7-8556-3ad7aad60bc6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:13.025605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fd200-e422-41e7-8556-3ad7aad60bc6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:13.067172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97931ff4-9834-473b-9a9c-596608fe1156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:13.068043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931ff4-9834-473b-9a9c-596608fe1156 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:13.068498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931ff4-9834-473b-9a9c-596608fe1156 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:13.068832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97931ff4-9834-473b-9a9c-596608fe1156 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:13.081743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97931ff4-9834-473b-9a9c-596608fe1156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:13.089594 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-97931ff4-9834-473b-9a9c-596608fe1156 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:13.091079 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 74/151] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:13.096425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe412d5-5327-4095-a546-2b2b1b554627 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:13.224409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe412d5-5327-4095-a546-2b2b1b554627 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:13.267017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe77c75-5a90-42e4-a70c-1ef77ebe61f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:13.268101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe77c75-5a90-42e4-a70c-1ef77ebe61f2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:13.268578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe77c75-5a90-42e4-a70c-1ef77ebe61f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:13.269041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe77c75-5a90-42e4-a70c-1ef77ebe61f2 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:13.269992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe77c75-5a90-42e4-a70c-1ef77ebe61f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:13.270521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe77c75-5a90-42e4-a70c-1ef77ebe61f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:13.272409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe77c75-5a90-42e4-a70c-1ef77ebe61f2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:13.281931 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 78/152] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:13.287254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97931ff4-9834-473b-9a9c-596608fe1156 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:13.401626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97931ff4-9834-473b-9a9c-596608fe1156 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:13.440096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbaed56-5cef-4a5a-ba80-c4ccef3415ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:13.441383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaed56-5cef-4a5a-ba80-c4ccef3415ae None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:13.441874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaed56-5cef-4a5a-ba80-c4ccef3415ae None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:13.442471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbaed56-5cef-4a5a-ba80-c4ccef3415ae None admin] PATH_INFO: `/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:13.443849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaed56-5cef-4a5a-ba80-c4ccef3415ae None admin] RBAC: Authorizing `identity:get_user(user_id=3928202b4ef24ba2bc9eb5d29b739b6b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:13.445564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbaed56-5cef-4a5a-ba80-c4ccef3415ae None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:13.448264 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 75/153] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:13 2022] GET /identity/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:13.453396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe77c75-5a90-42e4-a70c-1ef77ebe61f2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:13.558663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe77c75-5a90-42e4-a70c-1ef77ebe61f2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:13.599388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90bb90-296a-4f45-9778-91be9f26e8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:13.600587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90bb90-296a-4f45-9778-91be9f26e8f9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:13.601079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90bb90-296a-4f45-9778-91be9f26e8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:13.601547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90bb90-296a-4f45-9778-91be9f26e8f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:13.670196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90bb90-296a-4f45-9778-91be9f26e8f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:13.672128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90bb90-296a-4f45-9778-91be9f26e8f9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:13.691333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ef6f-599a-4dcd-a9b3-0c7004cb6db7 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:13.691947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ef6f-599a-4dcd-a9b3-0c7004cb6db7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:13.692428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ef6f-599a-4dcd-a9b3-0c7004cb6db7 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:13.694728 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 76/154] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:13.709809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef052c-4bbf-4ef6-87a6-916baf140a7a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:13.710459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef052c-4bbf-4ef6-87a6-916baf140a7a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:13.710928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef052c-4bbf-4ef6-87a6-916baf140a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:13.738123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4bef052c-4bbf-4ef6-87a6-916baf140a7a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:13.739662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4bef052c-4bbf-4ef6-87a6-916baf140a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:13.843470 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 77/155] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:13.856442 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 79/156] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:13.861687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef052c-4bbf-4ef6-87a6-916baf140a7a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:13.901291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90bb90-296a-4f45-9778-91be9f26e8f9 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:14.037082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef052c-4bbf-4ef6-87a6-916baf140a7a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:14.083549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90bb90-296a-4f45-9778-91be9f26e8f9 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:14.110123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac43a5c-5b1f-436a-9de7-be9831cc2248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:14.110914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac43a5c-5b1f-436a-9de7-be9831cc2248 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:14.111197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac43a5c-5b1f-436a-9de7-be9831cc2248 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:14.111473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac43a5c-5b1f-436a-9de7-be9831cc2248 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:14.116652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac43a5c-5b1f-436a-9de7-be9831cc2248 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:14.118126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac43a5c-5b1f-436a-9de7-be9831cc2248 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:14.119867 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 78/157] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:13 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:14.127166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac43a5c-5b1f-436a-9de7-be9831cc2248 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:14.127300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18a678-25ec-42e7-bb65-441fdc39e5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:14.128193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18a678-25ec-42e7-bb65-441fdc39e5eb None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:14.128476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18a678-25ec-42e7-bb65-441fdc39e5eb None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:14.128750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18a678-25ec-42e7-bb65-441fdc39e5eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:14.147739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18a678-25ec-42e7-bb65-441fdc39e5eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:14.155545 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0e18a678-25ec-42e7-bb65-441fdc39e5eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:14.158447 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 80/158] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:14.164581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18a678-25ec-42e7-bb65-441fdc39e5eb None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:14.291941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac43a5c-5b1f-436a-9de7-be9831cc2248 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:14.334388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a51db2-2921-432a-87e5-7d84256b64a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:14.335394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51db2-2921-432a-87e5-7d84256b64a9 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:14.335678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51db2-2921-432a-87e5-7d84256b64a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:14.336130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a51db2-2921-432a-87e5-7d84256b64a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:14.336958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a51db2-2921-432a-87e5-7d84256b64a9 None admin] RBAC: Adding query filter params (role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=a2d411ec96874463bba5e37d88810748, user.id=3928202b4ef24ba2bc9eb5d29b739b6b) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:14.337871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a51db2-2921-432a-87e5-7d84256b64a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:14.339638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a51db2-2921-432a-87e5-7d84256b64a9 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:14.354249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18a678-25ec-42e7-bb65-441fdc39e5eb None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:14.354816 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 79/159] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:14 2022] GET /identity/v3/role_assignments?user.id=3928202b4ef24ba2bc9eb5d29b739b6b&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:14.361423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961e016-1f05-4424-acd9-2b265b0fe8f7 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:14.361676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961e016-1f05-4424-acd9-2b265b0fe8f7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:14.361904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961e016-1f05-4424-acd9-2b265b0fe8f7 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:14.364155 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 80/160] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:14.371005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd77d4-1f78-4846-9bbe-a0af6f3cffd6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:14.371290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd77d4-1f78-4846-9bbe-a0af6f3cffd6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:14.371554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd77d4-1f78-4846-9bbe-a0af6f3cffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:14.398125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-01fd77d4-1f78-4846-9bbe-a0af6f3cffd6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:14.399339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-01fd77d4-1f78-4846-9bbe-a0af6f3cffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:14.411642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199fd34-f837-4fc3-9e55-3a0908e71b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:14.412427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199fd34-f837-4fc3-9e55-3a0908e71b2e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:14.412711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199fd34-f837-4fc3-9e55-3a0908e71b2e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:14.413020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199fd34-f837-4fc3-9e55-3a0908e71b2e None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:14.413812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199fd34-f837-4fc3-9e55-3a0908e71b2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:14.414120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199fd34-f837-4fc3-9e55-3a0908e71b2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:14.416224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199fd34-f837-4fc3-9e55-3a0908e71b2e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:14.430696 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 81/161] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:14.437374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199fd34-f837-4fc3-9e55-3a0908e71b2e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:14.495039 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 81/162] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:14.536186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd77d4-1f78-4846-9bbe-a0af6f3cffd6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:14.600080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199fd34-f837-4fc3-9e55-3a0908e71b2e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:14.657075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd77d4-1f78-4846-9bbe-a0af6f3cffd6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:14.669199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316444-bfeb-4286-ab4b-74c2f407db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:14.670146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316444-bfeb-4286-ab4b-74c2f407db72 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:14.670432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316444-bfeb-4286-ab4b-74c2f407db72 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:14.670708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34316444-bfeb-4286-ab4b-74c2f407db72 None admin] PATH_INFO: `/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:14.672267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34316444-bfeb-4286-ab4b-74c2f407db72 None admin] RBAC: Authorizing `identity:get_user(user_id=3928202b4ef24ba2bc9eb5d29b739b6b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:14.673808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34316444-bfeb-4286-ab4b-74c2f407db72 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:14.675453 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 82/163] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:14 2022] GET /identity/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:14.681442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316444-bfeb-4286-ab4b-74c2f407db72 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:14.698355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d1d69-52c3-4739-a3ec-27f6a4e5593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:14.699177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d1d69-52c3-4739-a3ec-27f6a4e5593a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:14.699457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d1d69-52c3-4739-a3ec-27f6a4e5593a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:14.699731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d1d69-52c3-4739-a3ec-27f6a4e5593a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:14.718220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5d1d69-52c3-4739-a3ec-27f6a4e5593a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:14.729976 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-cd5d1d69-52c3-4739-a3ec-27f6a4e5593a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:33:14.731600 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 82/164] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:33:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:14.737230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d1d69-52c3-4739-a3ec-27f6a4e5593a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:14.879706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34316444-bfeb-4286-ab4b-74c2f407db72 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:14.919831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53461479-95f0-4b4a-a00a-6253b01c9c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:14.920902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461479-95f0-4b4a-a00a-6253b01c9c44 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:14.921440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461479-95f0-4b4a-a00a-6253b01c9c44 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:14.923517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53461479-95f0-4b4a-a00a-6253b01c9c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:14.960492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d1d69-52c3-4739-a3ec-27f6a4e5593a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:15.036836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8321d2-b494-482c-a44e-7b20a312752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:15.038033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8321d2-b494-482c-a44e-7b20a312752c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:15.038537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8321d2-b494-482c-a44e-7b20a312752c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:15.039009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8321d2-b494-482c-a44e-7b20a312752c None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:15.039999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8321d2-b494-482c-a44e-7b20a312752c None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:15.041021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8321d2-b494-482c-a44e-7b20a312752c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:15.043297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8321d2-b494-482c-a44e-7b20a312752c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:15.058151 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 83/165] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:15.059772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b56f-fac8-41eb-9937-961474d23c4b None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:15.060348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b56f-fac8-41eb-9937-961474d23c4b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:15.061083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b56f-fac8-41eb-9937-961474d23c4b None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:15.062927 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 84/166] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:15.069127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0b56f-fac8-41eb-9937-961474d23c4b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:15.070837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461479-95f0-4b4a-a00a-6253b01c9c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:15.072437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53461479-95f0-4b4a-a00a-6253b01c9c44 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:15.234997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0b56f-fac8-41eb-9937-961474d23c4b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:15.292536 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 83/167] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 26 20:33:15.293853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1628c-f3d0-4f03-9043-fc2b74a679da None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:15.294138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1628c-f3d0-4f03-9043-fc2b74a679da None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:15.294414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1628c-f3d0-4f03-9043-fc2b74a679da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:15.311122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d0001-9977-4abf-a4d8-92869e6d9d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:15.312719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d0001-9977-4abf-a4d8-92869e6d9d35 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:15.313222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d0001-9977-4abf-a4d8-92869e6d9d35 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:15.313703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d0001-9977-4abf-a4d8-92869e6d9d35 None admin] PATH_INFO: `/v3/users/ebbe1a3c461148b98c3d0846726c2888` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:15.315130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d0001-9977-4abf-a4d8-92869e6d9d35 None admin] RBAC: Authorizing `identity:get_user(user_id=ebbe1a3c461148b98c3d0846726c2888)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:15.317118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d0001-9977-4abf-a4d8-92869e6d9d35 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:15.318938 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 85/168] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:15 2022] GET /identity/v3/users/ebbe1a3c461148b98c3d0846726c2888 => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:15.319876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d0001-9977-4abf-a4d8-92869e6d9d35 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:15.320034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-53e1628c-f3d0-4f03-9043-fc2b74a679da None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:15.321289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-53e1628c-f3d0-4f03-9043-fc2b74a679da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:15.450559 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 84/169] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:15.451482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1628c-f3d0-4f03-9043-fc2b74a679da None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:15.503733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d0001-9977-4abf-a4d8-92869e6d9d35 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:15.564670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874076c-5070-41aa-91d3-4f9d47e4f331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:15.565558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874076c-5070-41aa-91d3-4f9d47e4f331 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:15.565839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874076c-5070-41aa-91d3-4f9d47e4f331 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:15.566113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874076c-5070-41aa-91d3-4f9d47e4f331 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:15.567380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874076c-5070-41aa-91d3-4f9d47e4f331 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:15.568823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1628c-f3d0-4f03-9043-fc2b74a679da None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:15.568934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7874076c-5070-41aa-91d3-4f9d47e4f331 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:15.570915 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 86/170] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:15 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:15.572289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874076c-5070-41aa-91d3-4f9d47e4f331 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:15.611288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b7104-af45-437f-bed1-a2391b62ae05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:15.612329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b7104-af45-437f-bed1-a2391b62ae05 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:15.612805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b7104-af45-437f-bed1-a2391b62ae05 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:15.613267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b7104-af45-437f-bed1-a2391b62ae05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:15.698183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b7104-af45-437f-bed1-a2391b62ae05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:15.699688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b7104-af45-437f-bed1-a2391b62ae05 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:15.731406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7874076c-5070-41aa-91d3-4f9d47e4f331 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:15.777306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0437f-d9aa-4e1e-9005-53a4aad52fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:15.778040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0437f-d9aa-4e1e-9005-53a4aad52fe1 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:15.778327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0437f-d9aa-4e1e-9005-53a4aad52fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:15.778607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d0437f-d9aa-4e1e-9005-53a4aad52fe1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:15.796925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d0437f-d9aa-4e1e-9005-53a4aad52fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:15.798589 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 85/171] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:15.799431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b7104-af45-437f-bed1-a2391b62ae05 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:15.810506 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-84d0437f-d9aa-4e1e-9005-53a4aad52fe1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:15.811721 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 87/172] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:15.817156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0437f-d9aa-4e1e-9005-53a4aad52fe1 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:15.901627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b7104-af45-437f-bed1-a2391b62ae05 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:15.940601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c947195-d2d5-416b-8f55-69c1912b2d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:15.941252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c947195-d2d5-416b-8f55-69c1912b2d60 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:15.941531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c947195-d2d5-416b-8f55-69c1912b2d60 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:15.941804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c947195-d2d5-416b-8f55-69c1912b2d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:15.942623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c947195-d2d5-416b-8f55-69c1912b2d60 None admin] RBAC: Adding query filter params (role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=a2d411ec96874463bba5e37d88810748, user.id=3928202b4ef24ba2bc9eb5d29b739b6b) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:15.942930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c947195-d2d5-416b-8f55-69c1912b2d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:15.944430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c947195-d2d5-416b-8f55-69c1912b2d60 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:15.955749 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 86/173] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:15 2022] GET /identity/v3/role_assignments?user.id=3928202b4ef24ba2bc9eb5d29b739b6b&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:15.956580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c947195-d2d5-416b-8f55-69c1912b2d60 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:15.975080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d0437f-d9aa-4e1e-9005-53a4aad52fe1 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:16.060611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312b308-a0e3-4767-a796-f37ac45c0afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:16.061106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312b308-a0e3-4767-a796-f37ac45c0afb None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:16.061502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312b308-a0e3-4767-a796-f37ac45c0afb None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:16.061871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312b308-a0e3-4767-a796-f37ac45c0afb None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:16.063203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312b308-a0e3-4767-a796-f37ac45c0afb None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:16.064825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312b308-a0e3-4767-a796-f37ac45c0afb None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:16.066655 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 88/174] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:15 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:16.073027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312b308-a0e3-4767-a796-f37ac45c0afb None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:16.093018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c947195-d2d5-416b-8f55-69c1912b2d60 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:16.133247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b132-4182-4b88-ab96-f6a8df7c9c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:16.135120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b132-4182-4b88-ab96-f6a8df7c9c74 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:16.135576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b132-4182-4b88-ab96-f6a8df7c9c74 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:16.136049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b132-4182-4b88-ab96-f6a8df7c9c74 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:16.136949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b132-4182-4b88-ab96-f6a8df7c9c74 None admin] RBAC: Adding query filter params (name=member) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:16.137781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b132-4182-4b88-ab96-f6a8df7c9c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:16.139386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387b132-4182-4b88-ab96-f6a8df7c9c74 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:16.149144 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 87/175] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:16.157263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b132-4182-4b88-ab96-f6a8df7c9c74 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:16.298950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312b308-a0e3-4767-a796-f37ac45c0afb None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:16.331180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387b132-4182-4b88-ab96-f6a8df7c9c74 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:16.367550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870752-31d8-4d86-9c7b-8c0374fae1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:16.368886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870752-31d8-4d86-9c7b-8c0374fae1a3 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:16.369330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870752-31d8-4d86-9c7b-8c0374fae1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:16.369742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85870752-31d8-4d86-9c7b-8c0374fae1a3 None admin] PATH_INFO: `/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:16.371105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85870752-31d8-4d86-9c7b-8c0374fae1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=3928202b4ef24ba2bc9eb5d29b739b6b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:16.372792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85870752-31d8-4d86-9c7b-8c0374fae1a3 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:16.375211 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 88/176] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:16 2022] GET /identity/v3/users/3928202b4ef24ba2bc9eb5d29b739b6b => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:16.379151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2a43d-79e6-494a-9653-0df2da753af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:16.379151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2a43d-79e6-494a-9653-0df2da753af8 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:16.379151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2a43d-79e6-494a-9653-0df2da753af8 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:16.379151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2a43d-79e6-494a-9653-0df2da753af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:16.379854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2a43d-79e6-494a-9653-0df2da753af8 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=a2d411ec96874463bba5e37d88810748, user.id=ebbe1a3c461148b98c3d0846726c2888) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:16.380074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2a43d-79e6-494a-9653-0df2da753af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:16.381057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870752-31d8-4d86-9c7b-8c0374fae1a3 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:16.381555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2a43d-79e6-494a-9653-0df2da753af8 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:16.395975 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 89/177] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:16 2022] GET /identity/v3/role_assignments?user.id=ebbe1a3c461148b98c3d0846726c2888&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:16.499501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85870752-31d8-4d86-9c7b-8c0374fae1a3 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:16.548812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2cb83-16d9-480e-84e4-c1190be1e5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:16.549727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2cb83-16d9-480e-84e4-c1190be1e5ef None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:16.550158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2cb83-16d9-480e-84e4-c1190be1e5ef None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:16.550607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2cb83-16d9-480e-84e4-c1190be1e5ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:16.643037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2cb83-16d9-480e-84e4-c1190be1e5ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:16.644828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2cb83-16d9-480e-84e4-c1190be1e5ef None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:16.765060 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 89/178] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:16.770936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2a43d-79e6-494a-9653-0df2da753af8 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:16.911207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2a43d-79e6-494a-9653-0df2da753af8 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:16.948051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05907e99-6a3f-49d3-b1d1-31473a242ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:16.948901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05907e99-6a3f-49d3-b1d1-31473a242ecb None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:16.949177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05907e99-6a3f-49d3-b1d1-31473a242ecb None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:16.949448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05907e99-6a3f-49d3-b1d1-31473a242ecb None admin] PATH_INFO: `/v3/projects/1c975a825fc243169e172fc822838a2b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:16.956644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05907e99-6a3f-49d3-b1d1-31473a242ecb None admin] RBAC: Authorizing `identity:get_project(project_id=1c975a825fc243169e172fc822838a2b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:16.958111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05907e99-6a3f-49d3-b1d1-31473a242ecb None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:16.959817 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 90/179] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:16 2022] GET /identity/v3/projects/1c975a825fc243169e172fc822838a2b => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:16.966492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2cb83-16d9-480e-84e4-c1190be1e5ef None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.042523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6106512-7a36-4648-95da-8bda650b27eb None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.042852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6106512-7a36-4648-95da-8bda650b27eb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.043081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6106512-7a36-4648-95da-8bda650b27eb None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.048796 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 91/180] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:17.053107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c17d1-ad77-423a-ab62-ff4989ccee71 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.053355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c17d1-ad77-423a-ab62-ff4989ccee71 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.053622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c17d1-ad77-423a-ab62-ff4989ccee71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.072060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-977c17d1-ad77-423a-ab62-ff4989ccee71 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:17.073254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-977c17d1-ad77-423a-ab62-ff4989ccee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:17.142954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2cb83-16d9-480e-84e4-c1190be1e5ef None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:17.156046 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 92/181] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:17.157588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1fed8-54cf-4dd4-97c5-77e8b9e9b9e0 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.157881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1fed8-54cf-4dd4-97c5-77e8b9e9b9e0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.158155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1fed8-54cf-4dd4-97c5-77e8b9e9b9e0 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.159863 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 93/182] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:17.180753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e5b3e-166a-4e44-8143-420f89825093 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.181065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e5b3e-166a-4e44-8143-420f89825093 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.181303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e5b3e-166a-4e44-8143-420f89825093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.186270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630995-b441-4b63-b57d-9d19c37ff329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:17.187031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630995-b441-4b63-b57d-9d19c37ff329 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.187313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630995-b441-4b63-b57d-9d19c37ff329 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.187586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630995-b441-4b63-b57d-9d19c37ff329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.188561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28630995-b441-4b63-b57d-9d19c37ff329 None admin] RBAC: Adding query filter params (role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=1c975a825fc243169e172fc822838a2b, user.id=3928202b4ef24ba2bc9eb5d29b739b6b) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:17.188871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28630995-b441-4b63-b57d-9d19c37ff329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:17.191473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28630995-b441-4b63-b57d-9d19c37ff329 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:17.198907 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 90/183] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:16 2022] GET /identity/v3/role_assignments?user.id=3928202b4ef24ba2bc9eb5d29b739b6b&scope.project.id=1c975a825fc243169e172fc822838a2b&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:17.199738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630995-b441-4b63-b57d-9d19c37ff329 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.206972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-693e5b3e-166a-4e44-8143-420f89825093 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:17.208663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-693e5b3e-166a-4e44-8143-420f89825093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:17.282429 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 94/184] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:17.284266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f23df2-f0b1-46ea-9f7f-cd3d865447f0 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.284814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f23df2-f0b1-46ea-9f7f-cd3d865447f0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.285299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f23df2-f0b1-46ea-9f7f-cd3d865447f0 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.287582 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 95/185] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:17.295644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c129-5c8a-4486-af5c-90d3adab9d54 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.296296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c129-5c8a-4486-af5c-90d3adab9d54 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.298441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085c129-5c8a-4486-af5c-90d3adab9d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.330993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3085c129-5c8a-4486-af5c-90d3adab9d54 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:17.332448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3085c129-5c8a-4486-af5c-90d3adab9d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:17.354020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630995-b441-4b63-b57d-9d19c37ff329 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:17.392339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86941cc8-10e7-4191-8713-04c52a5a4681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:17.393477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86941cc8-10e7-4191-8713-04c52a5a4681 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.393962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86941cc8-10e7-4191-8713-04c52a5a4681 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.394338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86941cc8-10e7-4191-8713-04c52a5a4681 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.407034 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 96/186] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:17.408436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085c129-5c8a-4486-af5c-90d3adab9d54 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.413455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86941cc8-10e7-4191-8713-04c52a5a4681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:17.421201 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-86941cc8-10e7-4191-8713-04c52a5a4681 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:33:17.423948 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 91/187] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:33:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:17.430532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86941cc8-10e7-4191-8713-04c52a5a4681 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.529838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085c129-5c8a-4486-af5c-90d3adab9d54 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:17.550593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86941cc8-10e7-4191-8713-04c52a5a4681 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:17.562454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591788a-66c8-413d-8067-bdf96802938a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:17.563249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591788a-66c8-413d-8067-bdf96802938a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.563532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591788a-66c8-413d-8067-bdf96802938a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.563809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591788a-66c8-413d-8067-bdf96802938a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.573467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2591788a-66c8-413d-8067-bdf96802938a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:17.580690 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2591788a-66c8-413d-8067-bdf96802938a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:17.581866 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 97/188] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:17.582612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591788a-66c8-413d-8067-bdf96802938a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.587212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae59c9-9849-4c44-ae46-d77c535e3ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:17.587866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae59c9-9849-4c44-ae46-d77c535e3ebe None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.588172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae59c9-9849-4c44-ae46-d77c535e3ebe None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.588447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae59c9-9849-4c44-ae46-d77c535e3ebe None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.589191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae59c9-9849-4c44-ae46-d77c535e3ebe None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:17.589495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae59c9-9849-4c44-ae46-d77c535e3ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:17.590902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae59c9-9849-4c44-ae46-d77c535e3ebe None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:17.599223 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 92/189] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:17.600457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809d109-9346-4df9-8efb-336843128c5e None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.600745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809d109-9346-4df9-8efb-336843128c5e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.601019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809d109-9346-4df9-8efb-336843128c5e None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.603303 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 93/190] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:17.603874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809d109-9346-4df9-8efb-336843128c5e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.680756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591788a-66c8-413d-8067-bdf96802938a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:17.699338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809d109-9346-4df9-8efb-336843128c5e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:17.711451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130a5bc-bf15-494b-b072-02e3e5ec9988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:17.712767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130a5bc-bf15-494b-b072-02e3e5ec9988 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.713046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130a5bc-bf15-494b-b072-02e3e5ec9988 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.713315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130a5bc-bf15-494b-b072-02e3e5ec9988 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.723078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130a5bc-bf15-494b-b072-02e3e5ec9988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:17.730401 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-b130a5bc-bf15-494b-b072-02e3e5ec9988 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 26 20:33:17.731550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968c6a6-d750-425d-8750-3542301ee24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:17.731662 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 98/191] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:17.732348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130a5bc-bf15-494b-b072-02e3e5ec9988 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.736633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968c6a6-d750-425d-8750-3542301ee24e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.736927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968c6a6-d750-425d-8750-3542301ee24e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.737209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968c6a6-d750-425d-8750-3542301ee24e None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.737967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968c6a6-d750-425d-8750-3542301ee24e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:17.738281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968c6a6-d750-425d-8750-3542301ee24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:17.739676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f968c6a6-d750-425d-8750-3542301ee24e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:17.747745 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 94/192] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:17.749050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb527ed3-8858-4aea-b300-94208a52490d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.749358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb527ed3-8858-4aea-b300-94208a52490d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.749619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb527ed3-8858-4aea-b300-94208a52490d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.765195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fb527ed3-8858-4aea-b300-94208a52490d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:17.766358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fb527ed3-8858-4aea-b300-94208a52490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:17.824864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130a5bc-bf15-494b-b072-02e3e5ec9988 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:17.829549 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 95/193] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:17.830354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb527ed3-8858-4aea-b300-94208a52490d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.857445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cecdd-b428-4fee-a583-3dd4b5cbf950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:17.858306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cecdd-b428-4fee-a583-3dd4b5cbf950 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.858588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cecdd-b428-4fee-a583-3dd4b5cbf950 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.858862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cecdd-b428-4fee-a583-3dd4b5cbf950 None admin] PATH_INFO: `/v3/users/943478fc7cbf418e9d9a7d7d055b6fba` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.871822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cecdd-b428-4fee-a583-3dd4b5cbf950 None admin] RBAC: Authorizing `identity:get_user(user_id=943478fc7cbf418e9d9a7d7d055b6fba)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:17.873321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cecdd-b428-4fee-a583-3dd4b5cbf950 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:17.874937 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 99/194] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:17 2022] GET /identity/v3/users/943478fc7cbf418e9d9a7d7d055b6fba => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:17.876034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cecdd-b428-4fee-a583-3dd4b5cbf950 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.922928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb527ed3-8858-4aea-b300-94208a52490d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:17.954853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f70e1-90c7-4435-a8a9-d6a68e30bbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:17.955501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f70e1-90c7-4435-a8a9-d6a68e30bbe0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:17.955778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f70e1-90c7-4435-a8a9-d6a68e30bbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:17.956085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f70e1-90c7-4435-a8a9-d6a68e30bbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:17.956816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f70e1-90c7-4435-a8a9-d6a68e30bbe0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:17.957118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f70e1-90c7-4435-a8a9-d6a68e30bbe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:17.958488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f70e1-90c7-4435-a8a9-d6a68e30bbe0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:17.966173 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 96/195] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:17.966949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f70e1-90c7-4435-a8a9-d6a68e30bbe0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:17.967814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cecdd-b428-4fee-a583-3dd4b5cbf950 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.000763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5435e-e45d-470c-bb54-45eb24a2f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.001618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5435e-e45d-470c-bb54-45eb24a2f55d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.001897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5435e-e45d-470c-bb54-45eb24a2f55d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.002179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5435e-e45d-470c-bb54-45eb24a2f55d None admin] PATH_INFO: `/v3/users/943478fc7cbf418e9d9a7d7d055b6fba` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.003344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5435e-e45d-470c-bb54-45eb24a2f55d None admin] RBAC: Authorizing `identity:get_user(user_id=943478fc7cbf418e9d9a7d7d055b6fba)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.004821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5435e-e45d-470c-bb54-45eb24a2f55d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.006423 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 100/196] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:17 2022] GET /identity/v3/users/943478fc7cbf418e9d9a7d7d055b6fba => generated 283 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:18.012250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5435e-e45d-470c-bb54-45eb24a2f55d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.061076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f70e1-90c7-4435-a8a9-d6a68e30bbe0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.093047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d00d3-c01d-4f34-837a-525a64c713b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.093746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d00d3-c01d-4f34-837a-525a64c713b2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.094024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d00d3-c01d-4f34-837a-525a64c713b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.094296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d00d3-c01d-4f34-837a-525a64c713b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.095467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d00d3-c01d-4f34-837a-525a64c713b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.096958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d00d3-c01d-4f34-837a-525a64c713b2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.098793 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 97/197] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:18.099538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d00d3-c01d-4f34-837a-525a64c713b2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.106013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5435e-e45d-470c-bb54-45eb24a2f55d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.138146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fa421-520b-4896-aa45-ef7dd75a0024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.138788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fa421-520b-4896-aa45-ef7dd75a0024 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.139071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fa421-520b-4896-aa45-ef7dd75a0024 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.139343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386fa421-520b-4896-aa45-ef7dd75a0024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.190427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d00d3-c01d-4f34-837a-525a64c713b2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.201605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fa421-520b-4896-aa45-ef7dd75a0024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.203081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386fa421-520b-4896-aa45-ef7dd75a0024 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.221778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb8a21-1156-4343-843e-e48352fead8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.222875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb8a21-1156-4343-843e-e48352fead8c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.223152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb8a21-1156-4343-843e-e48352fead8c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.223423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb8a21-1156-4343-843e-e48352fead8c None admin] PATH_INFO: `/v3/users/5c9f2575150b4a23a6801feb971c5669` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.224597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb8a21-1156-4343-843e-e48352fead8c None admin] RBAC: Authorizing `identity:get_user(user_id=5c9f2575150b4a23a6801feb971c5669)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.226022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb8a21-1156-4343-843e-e48352fead8c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.227619 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 98/198] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/users/5c9f2575150b4a23a6801feb971c5669 => generated 289 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:18.228385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb8a21-1156-4343-843e-e48352fead8c None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.299111 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 101/199] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:18.299749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fa421-520b-4896-aa45-ef7dd75a0024 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.318998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb8a21-1156-4343-843e-e48352fead8c None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.354779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac106d-0aaf-4e35-bbae-68a34b3c9434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.355399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac106d-0aaf-4e35-bbae-68a34b3c9434 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.355614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac106d-0aaf-4e35-bbae-68a34b3c9434 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.355888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac106d-0aaf-4e35-bbae-68a34b3c9434 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.393050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386fa421-520b-4896-aa45-ef7dd75a0024 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.418527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac106d-0aaf-4e35-bbae-68a34b3c9434 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.420024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac106d-0aaf-4e35-bbae-68a34b3c9434 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.424823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b9b27-426c-4c8f-80d6-9d55a2f4e681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.425481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b9b27-426c-4c8f-80d6-9d55a2f4e681 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.425762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b9b27-426c-4c8f-80d6-9d55a2f4e681 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.426039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b9b27-426c-4c8f-80d6-9d55a2f4e681 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.426766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b9b27-426c-4c8f-80d6-9d55a2f4e681 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.428225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b9b27-426c-4c8f-80d6-9d55a2f4e681 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.446889 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 102/200] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:18 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:18.447686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b9b27-426c-4c8f-80d6-9d55a2f4e681 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.522737 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 99/201] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:18.523417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac106d-0aaf-4e35-bbae-68a34b3c9434 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.554822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b9b27-426c-4c8f-80d6-9d55a2f4e681 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.589752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a459f-f7b6-40c5-8f31-3afa670f32ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.590409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a459f-f7b6-40c5-8f31-3afa670f32ab None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.590691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a459f-f7b6-40c5-8f31-3afa670f32ab None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.590970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a459f-f7b6-40c5-8f31-3afa670f32ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.626511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac106d-0aaf-4e35-bbae-68a34b3c9434 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.660256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed8c3b-c3d7-43e5-9f55-ece901fbb8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.661122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8c3b-c3d7-43e5-9f55-ece901fbb8b9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.661398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8c3b-c3d7-43e5-9f55-ece901fbb8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.661670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed8c3b-c3d7-43e5-9f55-ece901fbb8b9 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.662524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a459f-f7b6-40c5-8f31-3afa670f32ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.662840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed8c3b-c3d7-43e5-9f55-ece901fbb8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.664032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a459f-f7b6-40c5-8f31-3afa670f32ab None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.664345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed8c3b-c3d7-43e5-9f55-ece901fbb8b9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.666659 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 100/202] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:18.668870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed8c3b-c3d7-43e5-9f55-ece901fbb8b9 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.767566 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 103/203] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:18.768717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a459f-f7b6-40c5-8f31-3afa670f32ab None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.776387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed8c3b-c3d7-43e5-9f55-ece901fbb8b9 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.811148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b641d-baf0-44d0-bcb3-d39045403214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.812048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b641d-baf0-44d0-bcb3-d39045403214 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.812331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b641d-baf0-44d0-bcb3-d39045403214 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.812605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b641d-baf0-44d0-bcb3-d39045403214 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.813805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b641d-baf0-44d0-bcb3-d39045403214 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.815281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7b641d-baf0-44d0-bcb3-d39045403214 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.817323 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 101/204] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:18.818110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b641d-baf0-44d0-bcb3-d39045403214 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.876941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a459f-f7b6-40c5-8f31-3afa670f32ab None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.914696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5c49e-6edf-4e99-a4dc-bd703e2d444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.915381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5c49e-6edf-4e99-a4dc-bd703e2d444d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.915662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5c49e-6edf-4e99-a4dc-bd703e2d444d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.915956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5c49e-6edf-4e99-a4dc-bd703e2d444d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.916791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5c49e-6edf-4e99-a4dc-bd703e2d444d None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=c562afec45df41a7843efc9f64c6e8ed, user.id=943478fc7cbf418e9d9a7d7d055b6fba) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:18.917097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5c49e-6edf-4e99-a4dc-bd703e2d444d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.917668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b641d-baf0-44d0-bcb3-d39045403214 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:18.918669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5c49e-6edf-4e99-a4dc-bd703e2d444d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.924413 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 104/205] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/role_assignments?user.id=943478fc7cbf418e9d9a7d7d055b6fba&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:18.925296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5c49e-6edf-4e99-a4dc-bd703e2d444d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:18.954183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62528d1f-0b93-4696-b722-b7e368322101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:18.955061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62528d1f-0b93-4696-b722-b7e368322101 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:18.955338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62528d1f-0b93-4696-b722-b7e368322101 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:18.955608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62528d1f-0b93-4696-b722-b7e368322101 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:18.956986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62528d1f-0b93-4696-b722-b7e368322101 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:18.958515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62528d1f-0b93-4696-b722-b7e368322101 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:18.960530 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 102/206] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:18.967044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62528d1f-0b93-4696-b722-b7e368322101 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:19.041465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5c49e-6edf-4e99-a4dc-bd703e2d444d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:19.072832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62528d1f-0b93-4696-b722-b7e368322101 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:19.078880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f1b95-e7c8-420b-a7d3-1f606d27ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:19.079546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f1b95-e7c8-420b-a7d3-1f606d27ce69 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:19.079831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f1b95-e7c8-420b-a7d3-1f606d27ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:19.080144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f1b95-e7c8-420b-a7d3-1f606d27ce69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:19.080982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f1b95-e7c8-420b-a7d3-1f606d27ce69 None admin] RBAC: Adding query filter params (role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=c562afec45df41a7843efc9f64c6e8ed, user.id=943478fc7cbf418e9d9a7d7d055b6fba) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:19.081295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f1b95-e7c8-420b-a7d3-1f606d27ce69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:19.082860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f1b95-e7c8-420b-a7d3-1f606d27ce69 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:19.089474 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 105/207] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/role_assignments?user.id=943478fc7cbf418e9d9a7d7d055b6fba&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:19.129467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d71f6-9e4f-4668-a339-09463632ba15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:19.130061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d71f6-9e4f-4668-a339-09463632ba15 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:19.130346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d71f6-9e4f-4668-a339-09463632ba15 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:19.130624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d71f6-9e4f-4668-a339-09463632ba15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:19.131476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d71f6-9e4f-4668-a339-09463632ba15 None admin] RBAC: Adding query filter params (role.id=650bb9543cc549219855a68f47ec7e75, scope.project.id=a2d411ec96874463bba5e37d88810748, user.id=5c9f2575150b4a23a6801feb971c5669) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:19.131788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d71f6-9e4f-4668-a339-09463632ba15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:19.133326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d71f6-9e4f-4668-a339-09463632ba15 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:19.140048 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 103/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:18 2022] GET /identity/v3/role_assignments?user.id=5c9f2575150b4a23a6801feb971c5669&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=650bb9543cc549219855a68f47ec7e75 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:21.067739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b7652-5919-4c00-ae9a-ec077f04e71b None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.068291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b7652-5919-4c00-ae9a-ec077f04e71b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.068391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b7652-5919-4c00-ae9a-ec077f04e71b None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.070115 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 106/209] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:21.077475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c735c7-77bb-4885-a4dc-9fa9dfb4d791 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.077951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c735c7-77bb-4885-a4dc-9fa9dfb4d791 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.078024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c735c7-77bb-4885-a4dc-9fa9dfb4d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.095851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-91c735c7-77bb-4885-a4dc-9fa9dfb4d791 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:21.097339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-91c735c7-77bb-4885-a4dc-9fa9dfb4d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:21.117344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6b02b-a9f7-44b6-b545-d8779794ae36 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.118050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6b02b-a9f7-44b6-b545-d8779794ae36 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.118547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6b02b-a9f7-44b6-b545-d8779794ae36 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.120673 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 107/210] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:21.128376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89eff-07f2-4458-9e92-d80a706ece06 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.129019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89eff-07f2-4458-9e92-d80a706ece06 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.129494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b89eff-07f2-4458-9e92-d80a706ece06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.148408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d5b89eff-07f2-4458-9e92-d80a706ece06 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:21.150481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d5b89eff-07f2-4458-9e92-d80a706ece06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:21.171639 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 104/211] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:21.195841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c735c7-77bb-4885-a4dc-9fa9dfb4d791 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:21.221719 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 108/212] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:21.248711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89eff-07f2-4458-9e92-d80a706ece06 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:21.300195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c735c7-77bb-4885-a4dc-9fa9dfb4d791 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:21.334466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab4424-0ab5-473b-9b2c-03beefe0ee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:21.335270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab4424-0ab5-473b-9b2c-03beefe0ee81 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.335552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab4424-0ab5-473b-9b2c-03beefe0ee81 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.335828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab4424-0ab5-473b-9b2c-03beefe0ee81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.349362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b89eff-07f2-4458-9e92-d80a706ece06 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:21.350017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab4424-0ab5-473b-9b2c-03beefe0ee81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:21.358506 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-62ab4424-0ab5-473b-9b2c-03beefe0ee81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:21.360124 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 105/213] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:21.365659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab4424-0ab5-473b-9b2c-03beefe0ee81 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:21.388534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193aed8-4445-499d-a7cf-6d28f64bb6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:21.389631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193aed8-4445-499d-a7cf-6d28f64bb6c2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.390108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193aed8-4445-499d-a7cf-6d28f64bb6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.390602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193aed8-4445-499d-a7cf-6d28f64bb6c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.392002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193aed8-4445-499d-a7cf-6d28f64bb6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:21.393720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c193aed8-4445-499d-a7cf-6d28f64bb6c2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:21.395635 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 109/214] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:21.401842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193aed8-4445-499d-a7cf-6d28f64bb6c2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:21.468220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab4424-0ab5-473b-9b2c-03beefe0ee81 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:21.503836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193aed8-4445-499d-a7cf-6d28f64bb6c2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:21.504159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d619-10cb-444d-bc69-f5ec716596af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:21.504994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d619-10cb-444d-bc69-f5ec716596af None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.505280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d619-10cb-444d-bc69-f5ec716596af None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.505556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb3d619-10cb-444d-bc69-f5ec716596af None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.506409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3d619-10cb-444d-bc69-f5ec716596af None admin] RBAC: Adding query filter params (name=member) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:21.506599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3d619-10cb-444d-bc69-f5ec716596af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:21.508170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb3d619-10cb-444d-bc69-f5ec716596af None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:21.517863 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 106/215] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:21.523359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d619-10cb-444d-bc69-f5ec716596af None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:21.544501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6524ee-6fe6-4a9d-8d3e-cefda6537dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:21.545543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6524ee-6fe6-4a9d-8d3e-cefda6537dcb None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.546002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6524ee-6fe6-4a9d-8d3e-cefda6537dcb None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.546472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6524ee-6fe6-4a9d-8d3e-cefda6537dcb None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.547357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6524ee-6fe6-4a9d-8d3e-cefda6537dcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:21.549035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6524ee-6fe6-4a9d-8d3e-cefda6537dcb None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:21.569705 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 110/216] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:21 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:33:21.571437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b6873-26ac-45d4-ad25-566e9e9dbcbc None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.571885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b6873-26ac-45d4-ad25-566e9e9dbcbc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.572366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b6873-26ac-45d4-ad25-566e9e9dbcbc None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.574767 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 111/217] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:21.584071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819297-b3e7-43e1-ad31-54e16b1eb64a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.584071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819297-b3e7-43e1-ad31-54e16b1eb64a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.584071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a819297-b3e7-43e1-ad31-54e16b1eb64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.600681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7a819297-b3e7-43e1-ad31-54e16b1eb64a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:21.601886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7a819297-b3e7-43e1-ad31-54e16b1eb64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:21.631498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb3d619-10cb-444d-bc69-f5ec716596af None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:21.668124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379bb57-5bf1-4270-a793-fd3847088e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:21.669122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379bb57-5bf1-4270-a793-fd3847088e16 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.669454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379bb57-5bf1-4270-a793-fd3847088e16 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.669730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379bb57-5bf1-4270-a793-fd3847088e16 None admin] PATH_INFO: `/v3/users/de54fa5ac4fe455fbbc5ea375d446c8a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.683979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 112/218] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:21.683979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eb215-1fcb-40d4-aea7-6c36eb077df4 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.683979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eb215-1fcb-40d4-aea7-6c36eb077df4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.683979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343eb215-1fcb-40d4-aea7-6c36eb077df4 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.683979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 113/219] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:21.685094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2832-8521-4046-bcc3-ac48344fc585 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.685271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379bb57-5bf1-4270-a793-fd3847088e16 None admin] RBAC: Authorizing `identity:get_user(user_id=de54fa5ac4fe455fbbc5ea375d446c8a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:21.685364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2832-8521-4046-bcc3-ac48344fc585 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.685638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb2832-8521-4046-bcc3-ac48344fc585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.686995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379bb57-5bf1-4270-a793-fd3847088e16 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:21.689082 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 107/220] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:21 2022] GET /identity/v3/users/de54fa5ac4fe455fbbc5ea375d446c8a => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:21.694393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379bb57-5bf1-4270-a793-fd3847088e16 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:21.707115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e0bb2832-8521-4046-bcc3-ac48344fc585 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:21.708659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e0bb2832-8521-4046-bcc3-ac48344fc585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:21.786455 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 114/221] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:21.786455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb2832-8521-4046-bcc3-ac48344fc585 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:21.802008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379bb57-5bf1-4270-a793-fd3847088e16 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:21.836854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc1a2-8e2f-4a9b-9c70-6cead214d82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:21.837441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc1a2-8e2f-4a9b-9c70-6cead214d82f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.837709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc1a2-8e2f-4a9b-9c70-6cead214d82f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.837978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc1a2-8e2f-4a9b-9c70-6cead214d82f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.904772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb2832-8521-4046-bcc3-ac48344fc585 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:21.906771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fc1a2-8e2f-4a9b-9c70-6cead214d82f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:21.908300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fc1a2-8e2f-4a9b-9c70-6cead214d82f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:21.943757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7823-8af8-47df-a957-cc391637e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:21.944577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7823-8af8-47df-a957-cc391637e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:21.944858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7823-8af8-47df-a957-cc391637e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:21.945128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7823-8af8-47df-a957-cc391637e4b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:21.955581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d7823-8af8-47df-a957-cc391637e4b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:21.962464 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-859d7823-8af8-47df-a957-cc391637e4b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:33:21.963841 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 115/222] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:33:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:21.965983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7823-8af8-47df-a957-cc391637e4b8 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.011644 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 108/223] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 26 20:33:22.012597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc1a2-8e2f-4a9b-9c70-6cead214d82f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.082732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7823-8af8-47df-a957-cc391637e4b8 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.111515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc1a2-8e2f-4a9b-9c70-6cead214d82f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.119177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76c7c-ffc2-428a-9d2f-28c05660f43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.120260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76c7c-ffc2-428a-9d2f-28c05660f43f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.120746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76c7c-ffc2-428a-9d2f-28c05660f43f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.121163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76c7c-ffc2-428a-9d2f-28c05660f43f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.132931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f76c7c-ffc2-428a-9d2f-28c05660f43f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:22.141346 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-42f76c7c-ffc2-428a-9d2f-28c05660f43f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:22.143063 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 116/224] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:22.144024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76c7c-ffc2-428a-9d2f-28c05660f43f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.146407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e63799-65b1-4cd0-a14e-df764b263915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.147079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63799-65b1-4cd0-a14e-df764b263915 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.147452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63799-65b1-4cd0-a14e-df764b263915 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.147737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63799-65b1-4cd0-a14e-df764b263915 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.148520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e63799-65b1-4cd0-a14e-df764b263915 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:22.148827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e63799-65b1-4cd0-a14e-df764b263915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.150789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e63799-65b1-4cd0-a14e-df764b263915 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:22.159977 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 109/225] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:22.160499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e63799-65b1-4cd0-a14e-df764b263915 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.249867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76c7c-ffc2-428a-9d2f-28c05660f43f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.262855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e63799-65b1-4cd0-a14e-df764b263915 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.282889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ba87-aa02-4239-a214-b6c5b9e89bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.283748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ba87-aa02-4239-a214-b6c5b9e89bed None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.284076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ba87-aa02-4239-a214-b6c5b9e89bed None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.284356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ba87-aa02-4239-a214-b6c5b9e89bed None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.285536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ba87-aa02-4239-a214-b6c5b9e89bed None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.287179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ba87-aa02-4239-a214-b6c5b9e89bed None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:22.289179 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 117/226] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:22 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:22.290035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ba87-aa02-4239-a214-b6c5b9e89bed None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.297169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbaf9f0-11d2-4a12-ac04-2db296258e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.297843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaf9f0-11d2-4a12-ac04-2db296258e69 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.298127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaf9f0-11d2-4a12-ac04-2db296258e69 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.298401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbaf9f0-11d2-4a12-ac04-2db296258e69 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.299201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbaf9f0-11d2-4a12-ac04-2db296258e69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:22.299514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbaf9f0-11d2-4a12-ac04-2db296258e69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.300987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbaf9f0-11d2-4a12-ac04-2db296258e69 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:22.309992 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 110/227] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:22.310921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbaf9f0-11d2-4a12-ac04-2db296258e69 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.388772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ba87-aa02-4239-a214-b6c5b9e89bed None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.412441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbaf9f0-11d2-4a12-ac04-2db296258e69 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.424483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff939f-3d3f-42eb-b150-9be14977fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.425351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff939f-3d3f-42eb-b150-9be14977fb58 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.425634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff939f-3d3f-42eb-b150-9be14977fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.425909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff939f-3d3f-42eb-b150-9be14977fb58 None admin] PATH_INFO: `/v3/users/943478fc7cbf418e9d9a7d7d055b6fba` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.427092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff939f-3d3f-42eb-b150-9be14977fb58 None admin] RBAC: Authorizing `identity:get_user(user_id=943478fc7cbf418e9d9a7d7d055b6fba)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.428607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff939f-3d3f-42eb-b150-9be14977fb58 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:22.430398 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 118/228] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:22 2022] GET /identity/v3/users/943478fc7cbf418e9d9a7d7d055b6fba => generated 283 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:22.430992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff939f-3d3f-42eb-b150-9be14977fb58 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.447394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bffbfd-a984-476e-8c38-8320789c5290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.448153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bffbfd-a984-476e-8c38-8320789c5290 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.448439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bffbfd-a984-476e-8c38-8320789c5290 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.448725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bffbfd-a984-476e-8c38-8320789c5290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.449545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bffbfd-a984-476e-8c38-8320789c5290 None admin] RBAC: Adding query filter params (role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=c562afec45df41a7843efc9f64c6e8ed, user.id=de54fa5ac4fe455fbbc5ea375d446c8a) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:22.449859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bffbfd-a984-476e-8c38-8320789c5290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.451330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bffbfd-a984-476e-8c38-8320789c5290 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:22.457229 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 111/229] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:22 2022] GET /identity/v3/role_assignments?user.id=de54fa5ac4fe455fbbc5ea375d446c8a&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:22.457996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bffbfd-a984-476e-8c38-8320789c5290 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.553372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff939f-3d3f-42eb-b150-9be14977fb58 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.570843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bffbfd-a984-476e-8c38-8320789c5290 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.588713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9298b-2149-4f8d-b91a-59be496cc1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.589605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9298b-2149-4f8d-b91a-59be496cc1b0 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.589886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9298b-2149-4f8d-b91a-59be496cc1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.590158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9298b-2149-4f8d-b91a-59be496cc1b0 None admin] PATH_INFO: `/v3/users/943478fc7cbf418e9d9a7d7d055b6fba` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.591427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9298b-2149-4f8d-b91a-59be496cc1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=943478fc7cbf418e9d9a7d7d055b6fba)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.592962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9298b-2149-4f8d-b91a-59be496cc1b0 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:22.594958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 119/230] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:22 2022] GET /identity/v3/users/943478fc7cbf418e9d9a7d7d055b6fba => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:22.601014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9298b-2149-4f8d-b91a-59be496cc1b0 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.632269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87706-f76d-42e1-97b7-834307ef0161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.633212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87706-f76d-42e1-97b7-834307ef0161 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.634057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87706-f76d-42e1-97b7-834307ef0161 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.638523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87706-f76d-42e1-97b7-834307ef0161 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.641431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb87706-f76d-42e1-97b7-834307ef0161 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.644075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb87706-f76d-42e1-97b7-834307ef0161 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:22.646373 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 112/231] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:22 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:22.657895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87706-f76d-42e1-97b7-834307ef0161 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.726240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9298b-2149-4f8d-b91a-59be496cc1b0 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.777065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba13d-ef96-4539-adb2-3004e3c051e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.779146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba13d-ef96-4539-adb2-3004e3c051e7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.779424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba13d-ef96-4539-adb2-3004e3c051e7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.779698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ba13d-ef96-4539-adb2-3004e3c051e7 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.782857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba13d-ef96-4539-adb2-3004e3c051e7 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.784358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ba13d-ef96-4539-adb2-3004e3c051e7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:22.787780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 120/232] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:22 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:22.798375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba13d-ef96-4539-adb2-3004e3c051e7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:22.845142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87706-f76d-42e1-97b7-834307ef0161 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.911728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f574de9-1806-40cf-bbe6-aea26ab9ce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.912607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574de9-1806-40cf-bbe6-aea26ab9ce56 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.912892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574de9-1806-40cf-bbe6-aea26ab9ce56 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.913161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f574de9-1806-40cf-bbe6-aea26ab9ce56 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed/users/943478fc7cbf418e9d9a7d7d055b6fba/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.916971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f574de9-1806-40cf-bbe6-aea26ab9ce56 None admin] RBAC: Authorizing `identity:create_grant(project_id=c562afec45df41a7843efc9f64c6e8ed, user_id=943478fc7cbf418e9d9a7d7d055b6fba, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.918428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f574de9-1806-40cf-bbe6-aea26ab9ce56 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:22.939632 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 113/233] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:33:22 2022] PUT /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed/users/943478fc7cbf418e9d9a7d7d055b6fba/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:33:22.955335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ba13d-ef96-4539-adb2-3004e3c051e7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:22.991299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c67a7d-2f45-4543-988c-d2385e532e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:22.992275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c67a7d-2f45-4543-988c-d2385e532e85 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:22.992551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c67a7d-2f45-4543-988c-d2385e532e85 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:22.992909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c67a7d-2f45-4543-988c-d2385e532e85 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed/users/943478fc7cbf418e9d9a7d7d055b6fba/roles/e875b4dda15a40c6aa7d8d75c96b3597` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:22.995208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c67a7d-2f45-4543-988c-d2385e532e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=c562afec45df41a7843efc9f64c6e8ed, user_id=943478fc7cbf418e9d9a7d7d055b6fba, role_id=e875b4dda15a40c6aa7d8d75c96b3597)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:22.996737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c67a7d-2f45-4543-988c-d2385e532e85 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:23.028323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 121/234] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:33:22 2022] PUT /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed/users/943478fc7cbf418e9d9a7d7d055b6fba/roles/e875b4dda15a40c6aa7d8d75c96b3597 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:33:24.562750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b40b7-c777-417b-ae82-1a541246e235 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:24.562750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b40b7-c777-417b-ae82-1a541246e235 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:24.562750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b40b7-c777-417b-ae82-1a541246e235 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:24.563805 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 114/235] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:24.569354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb7561-6e46-4259-a8d1-31bf57b903a6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:24.570213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb7561-6e46-4259-a8d1-31bf57b903a6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:24.570684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb7561-6e46-4259-a8d1-31bf57b903a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:24.593922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-51cb7561-6e46-4259-a8d1-31bf57b903a6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:24.595424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-51cb7561-6e46-4259-a8d1-31bf57b903a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:24.627473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658826-e307-46c3-898e-d710cec7f65d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:24.627765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658826-e307-46c3-898e-d710cec7f65d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:24.628024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac658826-e307-46c3-898e-d710cec7f65d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:24.630181 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 115/236] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:24.639941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04964664-0eed-4298-9a33-5c3796d5163f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:24.639941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04964664-0eed-4298-9a33-5c3796d5163f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:24.639941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04964664-0eed-4298-9a33-5c3796d5163f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:24.665670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-04964664-0eed-4298-9a33-5c3796d5163f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:24.666891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-04964664-0eed-4298-9a33-5c3796d5163f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:24.696997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 122/237] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:24.722625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb7561-6e46-4259-a8d1-31bf57b903a6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:24.825522 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 116/238] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:24.828321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb7561-6e46-4259-a8d1-31bf57b903a6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:24.863730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04964664-0eed-4298-9a33-5c3796d5163f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:24.873432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e30e74-00f0-4fab-95d5-2d1dbaf9df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:24.874224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e30e74-00f0-4fab-95d5-2d1dbaf9df7b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:24.874500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e30e74-00f0-4fab-95d5-2d1dbaf9df7b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:24.874770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e30e74-00f0-4fab-95d5-2d1dbaf9df7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:24.892062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e30e74-00f0-4fab-95d5-2d1dbaf9df7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:24.898766 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-67e30e74-00f0-4fab-95d5-2d1dbaf9df7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 26 20:33:24.900500 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 123/239] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:24.908834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e30e74-00f0-4fab-95d5-2d1dbaf9df7b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:25.063511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04964664-0eed-4298-9a33-5c3796d5163f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:25.107163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104ad6f-4ad8-46d4-a40b-13e0aff0e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:25.108003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104ad6f-4ad8-46d4-a40b-13e0aff0e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:25.108289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104ad6f-4ad8-46d4-a40b-13e0aff0e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:25.108613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104ad6f-4ad8-46d4-a40b-13e0aff0e3a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:25.109082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e30e74-00f0-4fab-95d5-2d1dbaf9df7b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:25.109903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104ad6f-4ad8-46d4-a40b-13e0aff0e3a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:25.113132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104ad6f-4ad8-46d4-a40b-13e0aff0e3a1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:25.113244 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 117/240] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:25.119310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104ad6f-4ad8-46d4-a40b-13e0aff0e3a1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:25.157714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82cd2c-979c-4587-9551-c8ee027be8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:25.158781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82cd2c-979c-4587-9551-c8ee027be8fc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:25.159260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82cd2c-979c-4587-9551-c8ee027be8fc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:25.159754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82cd2c-979c-4587-9551-c8ee027be8fc None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:25.160726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82cd2c-979c-4587-9551-c8ee027be8fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:25.161227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82cd2c-979c-4587-9551-c8ee027be8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:25.162818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82cd2c-979c-4587-9551-c8ee027be8fc None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:25.172313 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 124/241] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:25.173902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84360d-07b0-4d7c-a379-ddb2f832d026 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:25.174406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84360d-07b0-4d7c-a379-ddb2f832d026 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:25.174872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84360d-07b0-4d7c-a379-ddb2f832d026 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:25.176882 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 125/242] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:25.183559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84360d-07b0-4d7c-a379-ddb2f832d026 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:25.224818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104ad6f-4ad8-46d4-a40b-13e0aff0e3a1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:25.258720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f203f-949e-425b-9c38-3f3590c85a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:25.259714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f203f-949e-425b-9c38-3f3590c85a8d None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:25.260245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f203f-949e-425b-9c38-3f3590c85a8d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:25.260693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f203f-949e-425b-9c38-3f3590c85a8d None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:25.261575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f203f-949e-425b-9c38-3f3590c85a8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:25.263298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f203f-949e-425b-9c38-3f3590c85a8d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:25.285457 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 118/243] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:25 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:33:25.287074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989696a-9b16-44f2-812e-54cff7ed0afa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:25.287525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989696a-9b16-44f2-812e-54cff7ed0afa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:25.288015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989696a-9b16-44f2-812e-54cff7ed0afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:25.329790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a989696a-9b16-44f2-812e-54cff7ed0afa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:25.332581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a989696a-9b16-44f2-812e-54cff7ed0afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:25.354541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84360d-07b0-4d7c-a379-ddb2f832d026 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:25.423615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff5c9-f4c2-4796-b14e-5485e88d0ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:25.424843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff5c9-f4c2-4796-b14e-5485e88d0ab4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:25.425264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff5c9-f4c2-4796-b14e-5485e88d0ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:25.425710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ff5c9-f4c2-4796-b14e-5485e88d0ab4 None admin] PATH_INFO: `/v3/users/1ac90d8bac874ec6a7f868c69f2ebc86` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:25.451560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ff5c9-f4c2-4796-b14e-5485e88d0ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=1ac90d8bac874ec6a7f868c69f2ebc86)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:25.454583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ff5c9-f4c2-4796-b14e-5485e88d0ab4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:25.457730 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 119/244] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:25.459001 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 126/245] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:25 2022] GET /identity/v3/users/1ac90d8bac874ec6a7f868c69f2ebc86 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:25.469080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989696a-9b16-44f2-812e-54cff7ed0afa None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:25.483827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff5c9-f4c2-4796-b14e-5485e88d0ab4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:25.614499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ff5c9-f4c2-4796-b14e-5485e88d0ab4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:25.618295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989696a-9b16-44f2-812e-54cff7ed0afa None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:25.655764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a747d-7b31-4fd1-99d4-0d8191a62b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:25.656885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a747d-7b31-4fd1-99d4-0d8191a62b0c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:25.657167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a747d-7b31-4fd1-99d4-0d8191a62b0c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:25.657443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a747d-7b31-4fd1-99d4-0d8191a62b0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:25.663617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d94bc-0855-417d-85d6-5e358725bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:25.664299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d94bc-0855-417d-85d6-5e358725bc20 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:25.664667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d94bc-0855-417d-85d6-5e358725bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:25.665121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d94bc-0855-417d-85d6-5e358725bc20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:25.668813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a747d-7b31-4fd1-99d4-0d8191a62b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:25.679774 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f70a747d-7b31-4fd1-99d4-0d8191a62b0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:25.681491 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 127/246] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:25.689083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a747d-7b31-4fd1-99d4-0d8191a62b0c None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:25.766845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d94bc-0855-417d-85d6-5e358725bc20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:25.766845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d94bc-0855-417d-85d6-5e358725bc20 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:25.831774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a747d-7b31-4fd1-99d4-0d8191a62b0c None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:25.868459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af93e3-9a41-4fd2-8e1a-8210d6d0283b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:25.869128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af93e3-9a41-4fd2-8e1a-8210d6d0283b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:25.869403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af93e3-9a41-4fd2-8e1a-8210d6d0283b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:25.869675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af93e3-9a41-4fd2-8e1a-8210d6d0283b None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:25.870415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af93e3-9a41-4fd2-8e1a-8210d6d0283b None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:25.870716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af93e3-9a41-4fd2-8e1a-8210d6d0283b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:25.872318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39af93e3-9a41-4fd2-8e1a-8210d6d0283b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:25.880838 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 128/247] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:25.886829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af93e3-9a41-4fd2-8e1a-8210d6d0283b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:25.894061 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 120/248] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:25.899279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d94bc-0855-417d-85d6-5e358725bc20 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:26.004151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d94bc-0855-417d-85d6-5e358725bc20 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:26.007885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af93e3-9a41-4fd2-8e1a-8210d6d0283b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:26.050104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7985cac-6b88-40f0-ac1a-855bbf81851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:26.050986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985cac-6b88-40f0-ac1a-855bbf81851a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.051266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985cac-6b88-40f0-ac1a-855bbf81851a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.051591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7985cac-6b88-40f0-ac1a-855bbf81851a None admin] PATH_INFO: `/v3/users/de54fa5ac4fe455fbbc5ea375d446c8a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.057309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7985cac-6b88-40f0-ac1a-855bbf81851a None admin] RBAC: Authorizing `identity:get_user(user_id=de54fa5ac4fe455fbbc5ea375d446c8a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:26.058781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7985cac-6b88-40f0-ac1a-855bbf81851a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:26.060470 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 129/249] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:25 2022] GET /identity/v3/users/de54fa5ac4fe455fbbc5ea375d446c8a => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:26.063932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b150-56e8-4770-b9c9-8a86c6cd39a4 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.064251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b150-56e8-4770-b9c9-8a86c6cd39a4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.064530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f368b150-56e8-4770-b9c9-8a86c6cd39a4 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.068702 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 130/250] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:26.069313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b150-56e8-4770-b9c9-8a86c6cd39a4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:26.072999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7554e-3ee2-4099-b9f4-225238d42352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:26.073869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7554e-3ee2-4099-b9f4-225238d42352 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.074143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7554e-3ee2-4099-b9f4-225238d42352 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.074413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7554e-3ee2-4099-b9f4-225238d42352 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.077026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7554e-3ee2-4099-b9f4-225238d42352 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:26.078498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7554e-3ee2-4099-b9f4-225238d42352 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:26.080199 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 121/251] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:25 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:26.087770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4657857-59d3-4cae-9544-e46f32e2d270 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.088134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4657857-59d3-4cae-9544-e46f32e2d270 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.088405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4657857-59d3-4cae-9544-e46f32e2d270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.112541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f4657857-59d3-4cae-9544-e46f32e2d270 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:26.113722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f4657857-59d3-4cae-9544-e46f32e2d270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:26.220020 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 122/252] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:26.220955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4657857-59d3-4cae-9544-e46f32e2d270 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:26.233090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f368b150-56e8-4770-b9c9-8a86c6cd39a4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:26.270953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c9f260-642f-4090-862c-e6483af431ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:26.272176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9f260-642f-4090-862c-e6483af431ae None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.272654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9f260-642f-4090-862c-e6483af431ae None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.273116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9f260-642f-4090-862c-e6483af431ae None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.274994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9f260-642f-4090-862c-e6483af431ae None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:26.277353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c9f260-642f-4090-862c-e6483af431ae None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:26.280165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 131/253] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:26 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:26.281298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9303-1f77-42ef-935c-def8b8f05aaf None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.281586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9303-1f77-42ef-935c-def8b8f05aaf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.281862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b9303-1f77-42ef-935c-def8b8f05aaf None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.284359 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 132/254] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:26.285075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9303-1f77-42ef-935c-def8b8f05aaf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:26.335895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4657857-59d3-4cae-9544-e46f32e2d270 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:26.370556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c713f6-8f96-4d7a-b2b4-da0078bfb565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:26.371519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c713f6-8f96-4d7a-b2b4-da0078bfb565 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.372046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c713f6-8f96-4d7a-b2b4-da0078bfb565 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.372537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c713f6-8f96-4d7a-b2b4-da0078bfb565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.373552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c713f6-8f96-4d7a-b2b4-da0078bfb565 None admin] RBAC: Adding query filter params (role.id=650bb9543cc549219855a68f47ec7e75, scope.project.id=c562afec45df41a7843efc9f64c6e8ed, user.id=1ac90d8bac874ec6a7f868c69f2ebc86) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:26.374055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c713f6-8f96-4d7a-b2b4-da0078bfb565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:26.375685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c713f6-8f96-4d7a-b2b4-da0078bfb565 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:26.381268 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 123/255] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:26 2022] GET /identity/v3/role_assignments?user.id=1ac90d8bac874ec6a7f868c69f2ebc86&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=650bb9543cc549219855a68f47ec7e75 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:26.382236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c713f6-8f96-4d7a-b2b4-da0078bfb565 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:26.412722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b9303-1f77-42ef-935c-def8b8f05aaf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:26.473388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df71f5-36a8-4bec-a0dc-d66da9eb134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:26.474362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df71f5-36a8-4bec-a0dc-d66da9eb134d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.474470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df71f5-36a8-4bec-a0dc-d66da9eb134d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.474721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df71f5-36a8-4bec-a0dc-d66da9eb134d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.492262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df71f5-36a8-4bec-a0dc-d66da9eb134d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:26.501429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c713f6-8f96-4d7a-b2b4-da0078bfb565 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:26.507981 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-b6df71f5-36a8-4bec-a0dc-d66da9eb134d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:33:26.509707 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 133/256] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:33:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:26.511005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f9414-29f1-43fd-81f6-28fdd017026c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.511293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f9414-29f1-43fd-81f6-28fdd017026c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.511587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f9414-29f1-43fd-81f6-28fdd017026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.541523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-270f9414-29f1-43fd-81f6-28fdd017026c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:26.542917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-270f9414-29f1-43fd-81f6-28fdd017026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:26.544582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d1325-52b0-4420-a286-a1e61e010f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:26.545746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d1325-52b0-4420-a286-a1e61e010f3a None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.546223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d1325-52b0-4420-a286-a1e61e010f3a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.546685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d1325-52b0-4420-a286-a1e61e010f3a None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed/users/de54fa5ac4fe455fbbc5ea375d446c8a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.549025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d1325-52b0-4420-a286-a1e61e010f3a None admin] RBAC: Authorizing `identity:create_grant(project_id=c562afec45df41a7843efc9f64c6e8ed, user_id=de54fa5ac4fe455fbbc5ea375d446c8a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:26.550812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d1325-52b0-4420-a286-a1e61e010f3a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:26.572153 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 124/257] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:33:26 2022] PUT /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed/users/de54fa5ac4fe455fbbc5ea375d446c8a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:26.574271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d1325-52b0-4420-a286-a1e61e010f3a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:26.682973 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 134/258] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:26.715666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f9414-29f1-43fd-81f6-28fdd017026c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:26.740321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d1325-52b0-4420-a286-a1e61e010f3a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:26.897844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f361e7-0af3-4adb-b035-f12b9f4a0aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:26.899810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f361e7-0af3-4adb-b035-f12b9f4a0aab None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:26.900133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f361e7-0af3-4adb-b035-f12b9f4a0aab None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:26.900412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f361e7-0af3-4adb-b035-f12b9f4a0aab None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:26.901174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f361e7-0af3-4adb-b035-f12b9f4a0aab None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:26.901488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f361e7-0af3-4adb-b035-f12b9f4a0aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:26.902902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f361e7-0af3-4adb-b035-f12b9f4a0aab None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:26.912825 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 125/259] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:26.919902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f361e7-0af3-4adb-b035-f12b9f4a0aab None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:26.952812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f9414-29f1-43fd-81f6-28fdd017026c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.009235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e71131-07a7-40c4-8c1a-e7deaa4dea60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.010048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e71131-07a7-40c4-8c1a-e7deaa4dea60 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.010332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e71131-07a7-40c4-8c1a-e7deaa4dea60 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.010607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e71131-07a7-40c4-8c1a-e7deaa4dea60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.024078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e71131-07a7-40c4-8c1a-e7deaa4dea60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:27.028650 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-e8e71131-07a7-40c4-8c1a-e7deaa4dea60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:27.030160 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 135/260] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:27.035759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e71131-07a7-40c4-8c1a-e7deaa4dea60 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:27.065168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f361e7-0af3-4adb-b035-f12b9f4a0aab None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.125548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0ee6a-9a38-485f-bded-3db934a9cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.126858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0ee6a-9a38-485f-bded-3db934a9cf36 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.127381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0ee6a-9a38-485f-bded-3db934a9cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.127845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd0ee6a-9a38-485f-bded-3db934a9cf36 None admin] PATH_INFO: `/v3/users/943478fc7cbf418e9d9a7d7d055b6fba` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.132637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0ee6a-9a38-485f-bded-3db934a9cf36 None admin] RBAC: Authorizing `identity:get_user(user_id=943478fc7cbf418e9d9a7d7d055b6fba)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:27.134861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd0ee6a-9a38-485f-bded-3db934a9cf36 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:27.137006 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 126/261] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:26 2022] GET /identity/v3/users/943478fc7cbf418e9d9a7d7d055b6fba => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:27.138037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e71131-07a7-40c4-8c1a-e7deaa4dea60 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.154923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0ee6a-9a38-485f-bded-3db934a9cf36 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:27.177047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541381a8-5f1b-4ceb-ab4f-927a3ddc6175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.177713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541381a8-5f1b-4ceb-ab4f-927a3ddc6175 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.177996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541381a8-5f1b-4ceb-ab4f-927a3ddc6175 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.178261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541381a8-5f1b-4ceb-ab4f-927a3ddc6175 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.179028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541381a8-5f1b-4ceb-ab4f-927a3ddc6175 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:27.179312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541381a8-5f1b-4ceb-ab4f-927a3ddc6175 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:27.180918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541381a8-5f1b-4ceb-ab4f-927a3ddc6175 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:27.191940 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 136/262] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:27.195190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541381a8-5f1b-4ceb-ab4f-927a3ddc6175 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:27.282755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd0ee6a-9a38-485f-bded-3db934a9cf36 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.310250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541381a8-5f1b-4ceb-ab4f-927a3ddc6175 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.321813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63356f80-db51-4fea-b0c6-fc54681b7f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.322781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63356f80-db51-4fea-b0c6-fc54681b7f86 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.323255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63356f80-db51-4fea-b0c6-fc54681b7f86 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.323719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63356f80-db51-4fea-b0c6-fc54681b7f86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.346386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567956-ddc0-4dea-bcd3-103e0f23b2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.347861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567956-ddc0-4dea-bcd3-103e0f23b2a5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.347861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567956-ddc0-4dea-bcd3-103e0f23b2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.348050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5567956-ddc0-4dea-bcd3-103e0f23b2a5 None admin] PATH_INFO: `/v3/users/943478fc7cbf418e9d9a7d7d055b6fba` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.349261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5567956-ddc0-4dea-bcd3-103e0f23b2a5 None admin] RBAC: Authorizing `identity:get_user(user_id=943478fc7cbf418e9d9a7d7d055b6fba)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:27.350764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5567956-ddc0-4dea-bcd3-103e0f23b2a5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:27.352451 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 137/263] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:27 2022] GET /identity/v3/users/943478fc7cbf418e9d9a7d7d055b6fba => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:27.358346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567956-ddc0-4dea-bcd3-103e0f23b2a5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:27.396557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63356f80-db51-4fea-b0c6-fc54681b7f86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:27.398445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63356f80-db51-4fea-b0c6-fc54681b7f86 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:27.457864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5567956-ddc0-4dea-bcd3-103e0f23b2a5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.492296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b999297-65dc-4d8f-ba9b-29308e7ce171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.492995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b999297-65dc-4d8f-ba9b-29308e7ce171 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.493279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b999297-65dc-4d8f-ba9b-29308e7ce171 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.493657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b999297-65dc-4d8f-ba9b-29308e7ce171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.502013 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 127/264] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:27.521740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63356f80-db51-4fea-b0c6-fc54681b7f86 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:27.567501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b999297-65dc-4d8f-ba9b-29308e7ce171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:27.569013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b999297-65dc-4d8f-ba9b-29308e7ce171 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:27.658453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63356f80-db51-4fea-b0c6-fc54681b7f86 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.667249 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 138/265] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 26 20:33:27.672687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b999297-65dc-4d8f-ba9b-29308e7ce171 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:27.693314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3762c-807c-4970-ad13-62a097b1e479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.694485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3762c-807c-4970-ad13-62a097b1e479 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.694961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3762c-807c-4970-ad13-62a097b1e479 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.695464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca3762c-807c-4970-ad13-62a097b1e479 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.696908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3762c-807c-4970-ad13-62a097b1e479 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:27.698558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca3762c-807c-4970-ad13-62a097b1e479 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:27.701015 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 128/266] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:27 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:27.707490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3762c-807c-4970-ad13-62a097b1e479 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:27.770993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b999297-65dc-4d8f-ba9b-29308e7ce171 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.805614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9538070-297c-411f-80cb-e187a12842a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.806754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538070-297c-411f-80cb-e187a12842a0 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.806754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538070-297c-411f-80cb-e187a12842a0 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.807025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538070-297c-411f-80cb-e187a12842a0 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.808241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9538070-297c-411f-80cb-e187a12842a0 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:27.809702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9538070-297c-411f-80cb-e187a12842a0 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:27.811408 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 139/267] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:27 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:27.813467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca3762c-807c-4970-ad13-62a097b1e479 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.816992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9538070-297c-411f-80cb-e187a12842a0 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:27.849665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98aa65f-65f2-41f1-a903-a8ca69c3cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.850659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aa65f-65f2-41f1-a903-a8ca69c3cf63 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.851144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aa65f-65f2-41f1-a903-a8ca69c3cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.851617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aa65f-65f2-41f1-a903-a8ca69c3cf63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.852706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98aa65f-65f2-41f1-a903-a8ca69c3cf63 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=c562afec45df41a7843efc9f64c6e8ed, user.id=943478fc7cbf418e9d9a7d7d055b6fba) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:27.853262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98aa65f-65f2-41f1-a903-a8ca69c3cf63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:27.854915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98aa65f-65f2-41f1-a903-a8ca69c3cf63 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:27.861433 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 129/268] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:27 2022] GET /identity/v3/role_assignments?user.id=943478fc7cbf418e9d9a7d7d055b6fba&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:27.921547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9538070-297c-411f-80cb-e187a12842a0 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:27.958733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d35f4-f7e2-4bd8-8664-0f32c411edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:27.959394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d35f4-f7e2-4bd8-8664-0f32c411edea None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:27.959676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d35f4-f7e2-4bd8-8664-0f32c411edea None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:27.959950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d35f4-f7e2-4bd8-8664-0f32c411edea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:27.960795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d35f4-f7e2-4bd8-8664-0f32c411edea None admin] RBAC: Adding query filter params (role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=c562afec45df41a7843efc9f64c6e8ed, user.id=943478fc7cbf418e9d9a7d7d055b6fba) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:27.961102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d35f4-f7e2-4bd8-8664-0f32c411edea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:27.962630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145d35f4-f7e2-4bd8-8664-0f32c411edea None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:27.969524 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 140/269] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:27 2022] GET /identity/v3/role_assignments?user.id=943478fc7cbf418e9d9a7d7d055b6fba&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:28.920415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0235f4-7dd0-4443-8800-d1d9185b5649 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:28.920935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0235f4-7dd0-4443-8800-d1d9185b5649 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:28.920935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0235f4-7dd0-4443-8800-d1d9185b5649 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:28.923111 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 130/270] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:28.929680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cd658-abff-41ef-8e48-ceb62bef5c23 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:28.930786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cd658-abff-41ef-8e48-ceb62bef5c23 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:28.930786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cd658-abff-41ef-8e48-ceb62bef5c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:28.947546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-290cd658-abff-41ef-8e48-ceb62bef5c23 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:28.949037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-290cd658-abff-41ef-8e48-ceb62bef5c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:29.001259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928067-8fb5-4b9d-bd96-08eb543d2c87 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.001585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928067-8fb5-4b9d-bd96-08eb543d2c87 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.001812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81928067-8fb5-4b9d-bd96-08eb543d2c87 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.008695 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 131/271] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:33:29.010403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ee83-d043-4eb2-aec4-077844f3fb3a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.010691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ee83-d043-4eb2-aec4-077844f3fb3a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.010972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336ee83-d043-4eb2-aec4-077844f3fb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.020338 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 141/272] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:29.035292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2336ee83-d043-4eb2-aec4-077844f3fb3a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:29.036751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2336ee83-d043-4eb2-aec4-077844f3fb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:29.048620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cd658-abff-41ef-8e48-ceb62bef5c23 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:29.126867 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 132/273] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:29.148107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ee83-d043-4eb2-aec4-077844f3fb3a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:29.151517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cd658-abff-41ef-8e48-ceb62bef5c23 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:29.187782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818dfe7-5874-4fe4-bdbf-00d5edb96cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:29.188645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818dfe7-5874-4fe4-bdbf-00d5edb96cc3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.188924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818dfe7-5874-4fe4-bdbf-00d5edb96cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.189195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818dfe7-5874-4fe4-bdbf-00d5edb96cc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.201757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818dfe7-5874-4fe4-bdbf-00d5edb96cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:29.212189 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-0818dfe7-5874-4fe4-bdbf-00d5edb96cc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:29.218634 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 142/274] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:29.220172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818dfe7-5874-4fe4-bdbf-00d5edb96cc3 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:29.268013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336ee83-d043-4eb2-aec4-077844f3fb3a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:29.309408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62651872-e865-4a96-8289-f4878ffc9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:29.311313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62651872-e865-4a96-8289-f4878ffc9105 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.311823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62651872-e865-4a96-8289-f4878ffc9105 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.312322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62651872-e865-4a96-8289-f4878ffc9105 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.313703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62651872-e865-4a96-8289-f4878ffc9105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:29.315791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62651872-e865-4a96-8289-f4878ffc9105 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:29.318039 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 133/275] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:29.324173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62651872-e865-4a96-8289-f4878ffc9105 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:29.343667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818dfe7-5874-4fe4-bdbf-00d5edb96cc3 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:29.377474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f515d-2380-4b08-baa8-3bb25206a870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:29.378566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f515d-2380-4b08-baa8-3bb25206a870 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.379041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f515d-2380-4b08-baa8-3bb25206a870 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.379526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f515d-2380-4b08-baa8-3bb25206a870 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.380498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f515d-2380-4b08-baa8-3bb25206a870 None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:29.381030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f515d-2380-4b08-baa8-3bb25206a870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:29.382663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f515d-2380-4b08-baa8-3bb25206a870 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:29.396010 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 143/276] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:29.397802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f515d-2380-4b08-baa8-3bb25206a870 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:29.424287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62651872-e865-4a96-8289-f4878ffc9105 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:29.459523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c5ac-31ba-434b-ae95-1587b2b32036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:29.460157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c5ac-31ba-434b-ae95-1587b2b32036 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.460417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c5ac-31ba-434b-ae95-1587b2b32036 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.460697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c5ac-31ba-434b-ae95-1587b2b32036 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.461996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67c5ac-31ba-434b-ae95-1587b2b32036 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:29.463515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67c5ac-31ba-434b-ae95-1587b2b32036 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:29.492112 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 134/277] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:29 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:33:29.506425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f515d-2380-4b08-baa8-3bb25206a870 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:29.544558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e2e7a-bbce-4ca8-8f5e-a45e62b8e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:29.545816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e2e7a-bbce-4ca8-8f5e-a45e62b8e8fc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.546296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e2e7a-bbce-4ca8-8f5e-a45e62b8e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.546762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e2e7a-bbce-4ca8-8f5e-a45e62b8e8fc None admin] PATH_INFO: `/v3/users/c26d118a82d04afe9c7c9e9846d6f0e7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.562671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e2e7a-bbce-4ca8-8f5e-a45e62b8e8fc None admin] RBAC: Authorizing `identity:get_user(user_id=c26d118a82d04afe9c7c9e9846d6f0e7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:29.564560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e2e7a-bbce-4ca8-8f5e-a45e62b8e8fc None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:29.566501 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 144/278] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:29 2022] GET /identity/v3/users/c26d118a82d04afe9c7c9e9846d6f0e7 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:29.573168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c5ac-31ba-434b-ae95-1587b2b32036 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:29.626293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785705ef-2b5d-4186-a0e1-6cf10b8d6be9 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.626632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785705ef-2b5d-4186-a0e1-6cf10b8d6be9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.626882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785705ef-2b5d-4186-a0e1-6cf10b8d6be9 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.630262 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 145/279] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:29.637698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9193729-e188-402d-b6e2-79e70e2d0847 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.637990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9193729-e188-402d-b6e2-79e70e2d0847 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.638246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9193729-e188-402d-b6e2-79e70e2d0847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.660758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c9193729-e188-402d-b6e2-79e70e2d0847 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:29.662352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c9193729-e188-402d-b6e2-79e70e2d0847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:29.686640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c5ac-31ba-434b-ae95-1587b2b32036 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:29.727500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94c4e8-7097-446b-9a9a-24bd5149e918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:29.728174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94c4e8-7097-446b-9a9a-24bd5149e918 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.728461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94c4e8-7097-446b-9a9a-24bd5149e918 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.728837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94c4e8-7097-446b-9a9a-24bd5149e918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.729673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94c4e8-7097-446b-9a9a-24bd5149e918 None admin] RBAC: Adding query filter params (role.id=c7e02bca0ee343c0a8cb78d837b5ad30, user.id=c26d118a82d04afe9c7c9e9846d6f0e7, scope.system=all) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:29.729993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94c4e8-7097-446b-9a9a-24bd5149e918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:29.731453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94c4e8-7097-446b-9a9a-24bd5149e918 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:29.737603 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 135/280] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Mar 26 20:33:29 2022] GET /identity/v3/role_assignments?user.id=c26d118a82d04afe9c7c9e9846d6f0e7&scope.system=all&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:29.746712 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 146/281] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:29.771714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94c4e8-7097-446b-9a9a-24bd5149e918 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:29.855106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf5e3f-592a-494f-91ec-e59ae45be44e None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.855424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf5e3f-592a-494f-91ec-e59ae45be44e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.855724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf5e3f-592a-494f-91ec-e59ae45be44e None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.858042 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 147/282] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:33:29.868855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876100-63c3-4e55-8884-59f7c557cad3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.869283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876100-63c3-4e55-8884-59f7c557cad3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.869662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce876100-63c3-4e55-8884-59f7c557cad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.893686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ce876100-63c3-4e55-8884-59f7c557cad3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:29.895433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce876100-63c3-4e55-8884-59f7c557cad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:29.899095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94c4e8-7097-446b-9a9a-24bd5149e918 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:29.945219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ee1fd-563f-4a7a-8aea-aa191754a468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:29.950823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ee1fd-563f-4a7a-8aea-aa191754a468 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:29.951389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ee1fd-563f-4a7a-8aea-aa191754a468 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:29.951868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ee1fd-563f-4a7a-8aea-aa191754a468 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:29.963351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000ee1fd-563f-4a7a-8aea-aa191754a468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:29.970656 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-000ee1fd-563f-4a7a-8aea-aa191754a468 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 26 20:33:29.972778 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 136/283] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:29.979279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ee1fd-563f-4a7a-8aea-aa191754a468 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:30.026165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 148/284] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:30.062659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce876100-63c3-4e55-8884-59f7c557cad3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:30.084105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ee1fd-563f-4a7a-8aea-aa191754a468 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:30.120699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f65d2-de52-43f8-9c68-d3278d3ac0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:30.121362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f65d2-de52-43f8-9c68-d3278d3ac0cd None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:30.121640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f65d2-de52-43f8-9c68-d3278d3ac0cd None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:30.121912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f65d2-de52-43f8-9c68-d3278d3ac0cd None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:30.122652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f65d2-de52-43f8-9c68-d3278d3ac0cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:30.122950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f65d2-de52-43f8-9c68-d3278d3ac0cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:30.125822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359f65d2-de52-43f8-9c68-d3278d3ac0cd None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:30.147028 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 137/285] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:30.154089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f65d2-de52-43f8-9c68-d3278d3ac0cd None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:30.235184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce876100-63c3-4e55-8884-59f7c557cad3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:30.277693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8358a-824d-4629-b5ed-62292d2cad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:30.278483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8358a-824d-4629-b5ed-62292d2cad0f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:30.278769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8358a-824d-4629-b5ed-62292d2cad0f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:30.279039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8358a-824d-4629-b5ed-62292d2cad0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:30.298403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8358a-824d-4629-b5ed-62292d2cad0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:30.305269 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-16c8358a-824d-4629-b5ed-62292d2cad0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:30.311448 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 149/286] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:30.315776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8358a-824d-4629-b5ed-62292d2cad0f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:30.349398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f65d2-de52-43f8-9c68-d3278d3ac0cd None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:30.402886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0a9d6-cc55-481e-ab02-7e8dc22aafef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:30.404116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0a9d6-cc55-481e-ab02-7e8dc22aafef None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:30.404601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0a9d6-cc55-481e-ab02-7e8dc22aafef None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:30.405093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0a9d6-cc55-481e-ab02-7e8dc22aafef None admin] PATH_INFO: `/v3/users/1ac90d8bac874ec6a7f868c69f2ebc86` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:30.406478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0a9d6-cc55-481e-ab02-7e8dc22aafef None admin] RBAC: Authorizing `identity:get_user(user_id=1ac90d8bac874ec6a7f868c69f2ebc86)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:30.408168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0a9d6-cc55-481e-ab02-7e8dc22aafef None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:30.410338 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 138/287] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:30 2022] GET /identity/v3/users/1ac90d8bac874ec6a7f868c69f2ebc86 => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:30.416212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0a9d6-cc55-481e-ab02-7e8dc22aafef None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:30.494826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8358a-824d-4629-b5ed-62292d2cad0f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:30.554059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f28d1-64ef-4a57-a5a2-521ab89f423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:30.555113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f28d1-64ef-4a57-a5a2-521ab89f423a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:30.555621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f28d1-64ef-4a57-a5a2-521ab89f423a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:30.556135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f28d1-64ef-4a57-a5a2-521ab89f423a None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:30.557089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f28d1-64ef-4a57-a5a2-521ab89f423a None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:30.558741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f28d1-64ef-4a57-a5a2-521ab89f423a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:30.560389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f28d1-64ef-4a57-a5a2-521ab89f423a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:30.575368 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 150/288] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:30.576964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0a9d6-cc55-481e-ab02-7e8dc22aafef None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:30.583947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f28d1-64ef-4a57-a5a2-521ab89f423a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:30.640425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c49df-2b53-40de-a361-7d1b3799c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:30.641286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c49df-2b53-40de-a361-7d1b3799c382 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:30.641564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c49df-2b53-40de-a361-7d1b3799c382 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:30.641837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c49df-2b53-40de-a361-7d1b3799c382 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:30.644112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c49df-2b53-40de-a361-7d1b3799c382 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:30.645566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c49df-2b53-40de-a361-7d1b3799c382 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:30.648404 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 139/289] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:30 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:30.654364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c49df-2b53-40de-a361-7d1b3799c382 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:30.747617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f28d1-64ef-4a57-a5a2-521ab89f423a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:30.802780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c49df-2b53-40de-a361-7d1b3799c382 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:30.813501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374c4b-1ccc-47a3-8717-52c01316d0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:30.814383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374c4b-1ccc-47a3-8717-52c01316d0f5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:30.814663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374c4b-1ccc-47a3-8717-52c01316d0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:30.814932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b374c4b-1ccc-47a3-8717-52c01316d0f5 None admin] PATH_INFO: `/v3/users/de54fa5ac4fe455fbbc5ea375d446c8a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:30.816173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b374c4b-1ccc-47a3-8717-52c01316d0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=de54fa5ac4fe455fbbc5ea375d446c8a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:30.818082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b374c4b-1ccc-47a3-8717-52c01316d0f5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:30.820027 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 151/290] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:30 2022] GET /identity/v3/users/de54fa5ac4fe455fbbc5ea375d446c8a => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:30.826041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374c4b-1ccc-47a3-8717-52c01316d0f5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:30.873471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbf96d-cdb7-42bd-ba83-87229925a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:30.874364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf96d-cdb7-42bd-ba83-87229925a452 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:30.875771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf96d-cdb7-42bd-ba83-87229925a452 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:30.876088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcbf96d-cdb7-42bd-ba83-87229925a452 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed/users/1ac90d8bac874ec6a7f868c69f2ebc86/roles/650bb9543cc549219855a68f47ec7e75` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:30.879122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbf96d-cdb7-42bd-ba83-87229925a452 None admin] RBAC: Authorizing `identity:create_grant(project_id=c562afec45df41a7843efc9f64c6e8ed, user_id=1ac90d8bac874ec6a7f868c69f2ebc86, role_id=650bb9543cc549219855a68f47ec7e75)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:30.880806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcbf96d-cdb7-42bd-ba83-87229925a452 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:30.905547 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 140/291] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:33:30 2022] PUT /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed/users/1ac90d8bac874ec6a7f868c69f2ebc86/roles/650bb9543cc549219855a68f47ec7e75 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:30.963362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b374c4b-1ccc-47a3-8717-52c01316d0f5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:30.998067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46ac7f-e481-4ffc-b991-b0b6b4ca3009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:30.998642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ac7f-e481-4ffc-b991-b0b6b4ca3009 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:30.998971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ac7f-e481-4ffc-b991-b0b6b4ca3009 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:30.999258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46ac7f-e481-4ffc-b991-b0b6b4ca3009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:31.099403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46ac7f-e481-4ffc-b991-b0b6b4ca3009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:31.100922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46ac7f-e481-4ffc-b991-b0b6b4ca3009 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:31.237482 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 152/292] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:31.243160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbf96d-cdb7-42bd-ba83-87229925a452 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:31.349762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcbf96d-cdb7-42bd-ba83-87229925a452 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:31.382129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0186e-e185-4c6a-a0a1-2c11f1c79e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:31.383242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0186e-e185-4c6a-a0a1-2c11f1c79e88 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:31.383718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0186e-e185-4c6a-a0a1-2c11f1c79e88 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:31.384161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0186e-e185-4c6a-a0a1-2c11f1c79e88 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:31.385489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0186e-e185-4c6a-a0a1-2c11f1c79e88 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:31.387169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0186e-e185-4c6a-a0a1-2c11f1c79e88 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:31.389635 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 141/293] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:31 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:31.396980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46ac7f-e481-4ffc-b991-b0b6b4ca3009 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:31.510421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46ac7f-e481-4ffc-b991-b0b6b4ca3009 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:31.561931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb1e64-e162-4e3b-a64d-44ac3542219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:31.562863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb1e64-e162-4e3b-a64d-44ac3542219f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:31.563287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb1e64-e162-4e3b-a64d-44ac3542219f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:31.563700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb1e64-e162-4e3b-a64d-44ac3542219f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:31.564686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb1e64-e162-4e3b-a64d-44ac3542219f None admin] RBAC: Adding query filter params (role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=c562afec45df41a7843efc9f64c6e8ed, user.id=de54fa5ac4fe455fbbc5ea375d446c8a) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:31.565137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb1e64-e162-4e3b-a64d-44ac3542219f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:31.566743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb1e64-e162-4e3b-a64d-44ac3542219f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:31.576195 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 153/294] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:31 2022] GET /identity/v3/role_assignments?user.id=de54fa5ac4fe455fbbc5ea375d446c8a&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:32.306855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504022fb-bfd6-4381-923b-37460ac88df9 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:32.307761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504022fb-bfd6-4381-923b-37460ac88df9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:32.308066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504022fb-bfd6-4381-923b-37460ac88df9 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:32.310114 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 142/295] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:32.317237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a8407-fde4-4603-a940-b9f9c3deb4e4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:32.317764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a8407-fde4-4603-a940-b9f9c3deb4e4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:32.317764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a8407-fde4-4603-a940-b9f9c3deb4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:32.337019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f06a8407-fde4-4603-a940-b9f9c3deb4e4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:32.338201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f06a8407-fde4-4603-a940-b9f9c3deb4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:32.409387 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 154/296] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:32.435145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504022fb-bfd6-4381-923b-37460ac88df9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:32.544800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504022fb-bfd6-4381-923b-37460ac88df9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:32.578181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3018ca-22ce-494b-ada1-7dc2789d72dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:32.578889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3018ca-22ce-494b-ada1-7dc2789d72dc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:32.579166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3018ca-22ce-494b-ada1-7dc2789d72dc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:32.579435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3018ca-22ce-494b-ada1-7dc2789d72dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:32.589584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3018ca-22ce-494b-ada1-7dc2789d72dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:32.596383 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0d3018ca-22ce-494b-ada1-7dc2789d72dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:32.598211 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 143/297] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:32.600903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f45aa4-624c-44be-9d8e-a3d203d6aa07 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:32.601187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f45aa4-624c-44be-9d8e-a3d203d6aa07 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:32.601458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f45aa4-624c-44be-9d8e-a3d203d6aa07 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:32.603987 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 155/298] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:32.604853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3018ca-22ce-494b-ada1-7dc2789d72dc None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:32.606829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2daab-8542-45a0-97d5-ee27be1237c9 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:32.607108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2daab-8542-45a0-97d5-ee27be1237c9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:32.607383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2daab-8542-45a0-97d5-ee27be1237c9 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:32.608986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 156/299] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:33:32.611808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1fb2f-237c-4d0d-9e38-55d6d317abb0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:32.612376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1fb2f-237c-4d0d-9e38-55d6d317abb0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:32.612844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1fb2f-237c-4d0d-9e38-55d6d317abb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:32.707899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3018ca-22ce-494b-ada1-7dc2789d72dc None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:32.743033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b385ef2-7acd-40f6-a378-7165303f8f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:32.743709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385ef2-7acd-40f6-a378-7165303f8f6a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:32.744019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385ef2-7acd-40f6-a378-7165303f8f6a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:32.744293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b385ef2-7acd-40f6-a378-7165303f8f6a None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:32.745043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b385ef2-7acd-40f6-a378-7165303f8f6a None admin] RBAC: Adding query filter params (name=member) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:32.745344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b385ef2-7acd-40f6-a378-7165303f8f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:32.746742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b385ef2-7acd-40f6-a378-7165303f8f6a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:32.760263 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 144/300] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:32.760263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f4f9d-be24-40d5-9d49-a05afe91d544 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:32.760263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f4f9d-be24-40d5-9d49-a05afe91d544 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:32.760263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f4f9d-be24-40d5-9d49-a05afe91d544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:32.767713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8ab1fb2f-237c-4d0d-9e38-55d6d317abb0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:32.768927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8ab1fb2f-237c-4d0d-9e38-55d6d317abb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:32.776273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-721f4f9d-be24-40d5-9d49-a05afe91d544 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:32.777399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-721f4f9d-be24-40d5-9d49-a05afe91d544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:32.832956 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 157/301] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:32.837434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1fb2f-237c-4d0d-9e38-55d6d317abb0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:32.845187 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 145/302] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:32.860867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f4f9d-be24-40d5-9d49-a05afe91d544 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:32.934939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1fb2f-237c-4d0d-9e38-55d6d317abb0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:32.962964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f4f9d-be24-40d5-9d49-a05afe91d544 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:32.967237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf0a41-ff84-4640-bdd3-e1842011e65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:32.968112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf0a41-ff84-4640-bdd3-e1842011e65b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:32.968389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf0a41-ff84-4640-bdd3-e1842011e65b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:32.968656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf0a41-ff84-4640-bdd3-e1842011e65b None admin] PATH_INFO: `/v3/users/c26d118a82d04afe9c7c9e9846d6f0e7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:32.969835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf0a41-ff84-4640-bdd3-e1842011e65b None admin] RBAC: Authorizing `identity:get_user(user_id=c26d118a82d04afe9c7c9e9846d6f0e7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:32.971281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf0a41-ff84-4640-bdd3-e1842011e65b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:32.973340 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 158/303] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:32 2022] GET /identity/v3/users/c26d118a82d04afe9c7c9e9846d6f0e7 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:32.973930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf0a41-ff84-4640-bdd3-e1842011e65b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:33.002370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40108-2785-4f60-ae54-2a2c86523c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:33.003154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40108-2785-4f60-ae54-2a2c86523c2a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.003434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40108-2785-4f60-ae54-2a2c86523c2a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.003714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40108-2785-4f60-ae54-2a2c86523c2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.016291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd40108-2785-4f60-ae54-2a2c86523c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:33.024172 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-fcd40108-2785-4f60-ae54-2a2c86523c2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 26 20:33:33.025146 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 146/304] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:33.025681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40108-2785-4f60-ae54-2a2c86523c2a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:33.083171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf0a41-ff84-4640-bdd3-e1842011e65b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:33.117089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb331-800e-4656-9853-cf8dd608cef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:33.117903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb331-800e-4656-9853-cf8dd608cef2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.118409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb331-800e-4656-9853-cf8dd608cef2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.118515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4eb331-800e-4656-9853-cf8dd608cef2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.119577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb331-800e-4656-9853-cf8dd608cef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:33.121103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4eb331-800e-4656-9853-cf8dd608cef2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:33.122809 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 159/305] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:33.123621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40108-2785-4f60-ae54-2a2c86523c2a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:33.127840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb331-800e-4656-9853-cf8dd608cef2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:33.156613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1ff07-d4d5-4f5c-b1de-4cdc69afaa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:33.157469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1ff07-d4d5-4f5c-b1de-4cdc69afaa9a None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.157749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1ff07-d4d5-4f5c-b1de-4cdc69afaa9a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.158027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1ff07-d4d5-4f5c-b1de-4cdc69afaa9a None admin] PATH_INFO: `/v3/system/users/c26d118a82d04afe9c7c9e9846d6f0e7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.159502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1ff07-d4d5-4f5c-b1de-4cdc69afaa9a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c26d118a82d04afe9c7c9e9846d6f0e7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:33.160933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1ff07-d4d5-4f5c-b1de-4cdc69afaa9a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:33.169672 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 147/306] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Mar 26 20:33:33 2022] PUT /identity/v3/system/users/c26d118a82d04afe9c7c9e9846d6f0e7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:33.170903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1ff07-d4d5-4f5c-b1de-4cdc69afaa9a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:33.251155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4eb331-800e-4656-9853-cf8dd608cef2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:33.289262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f2781-7a17-4f0b-b92e-8f55e49df102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:33.290465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f2781-7a17-4f0b-b92e-8f55e49df102 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.290972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f2781-7a17-4f0b-b92e-8f55e49df102 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.291461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f2781-7a17-4f0b-b92e-8f55e49df102 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.292479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f2781-7a17-4f0b-b92e-8f55e49df102 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:33.292998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f2781-7a17-4f0b-b92e-8f55e49df102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:33.294685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f2781-7a17-4f0b-b92e-8f55e49df102 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:33.299169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1ff07-d4d5-4f5c-b1de-4cdc69afaa9a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:33.305898 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 160/307] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:33.315992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f2781-7a17-4f0b-b92e-8f55e49df102 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:33.346878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbadd-5756-4b6a-96bc-fcbad72a5233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:33.347518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbadd-5756-4b6a-96bc-fcbad72a5233 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.347789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbadd-5756-4b6a-96bc-fcbad72a5233 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.348175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbadd-5756-4b6a-96bc-fcbad72a5233 None admin] PATH_INFO: `/v3/groups` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.348818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bbadd-5756-4b6a-96bc-fcbad72a5233 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:33.350320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bbadd-5756-4b6a-96bc-fcbad72a5233 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:33.368597 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 148/308] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Mar 26 20:33:33 2022] POST /identity/v3/groups => generated 229 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:33.442175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f2781-7a17-4f0b-b92e-8f55e49df102 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:33.480686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65705e-baf7-4b64-8594-e415d09a8298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:33.481670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65705e-baf7-4b64-8594-e415d09a8298 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.481954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65705e-baf7-4b64-8594-e415d09a8298 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.482226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65705e-baf7-4b64-8594-e415d09a8298 None admin] PATH_INFO: `/v3/users/3478efb17e084c6c88aecffcb715da07` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.498423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65705e-baf7-4b64-8594-e415d09a8298 None admin] RBAC: Authorizing `identity:get_user(user_id=3478efb17e084c6c88aecffcb715da07)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:33.499959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65705e-baf7-4b64-8594-e415d09a8298 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:33.502168 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 161/309] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:33 2022] GET /identity/v3/users/3478efb17e084c6c88aecffcb715da07 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:33.509646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbadd-5756-4b6a-96bc-fcbad72a5233 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:33.612760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbadd-5756-4b6a-96bc-fcbad72a5233 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:33.647803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00aa20a-2e53-4ee1-acf7-b0750ad24be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:33.648900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00aa20a-2e53-4ee1-acf7-b0750ad24be9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.649380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00aa20a-2e53-4ee1-acf7-b0750ad24be9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.649849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00aa20a-2e53-4ee1-acf7-b0750ad24be9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.650920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00aa20a-2e53-4ee1-acf7-b0750ad24be9 None admin] RBAC: Adding query filter params (role.id=650bb9543cc549219855a68f47ec7e75, user.id=3478efb17e084c6c88aecffcb715da07, scope.system=all) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:33.651423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00aa20a-2e53-4ee1-acf7-b0750ad24be9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:33.653109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00aa20a-2e53-4ee1-acf7-b0750ad24be9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:33.658722 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 149/310] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Mar 26 20:33:33 2022] GET /identity/v3/role_assignments?user.id=3478efb17e084c6c88aecffcb715da07&scope.system=all&role.id=650bb9543cc549219855a68f47ec7e75 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:33.692241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fb964-c090-41c9-a6de-1372475d3bd3 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.692544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fb964-c090-41c9-a6de-1372475d3bd3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.692807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fb964-c090-41c9-a6de-1372475d3bd3 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.694904 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 162/311] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:33.702618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe1f7-2e8d-4ee1-8806-0e04a0245032 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.702933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe1f7-2e8d-4ee1-8806-0e04a0245032 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.703189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffe1f7-2e8d-4ee1-8806-0e04a0245032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.721245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fbffe1f7-2e8d-4ee1-8806-0e04a0245032 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:33.722721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fbffe1f7-2e8d-4ee1-8806-0e04a0245032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:33.800605 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 150/312] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:33.825367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fb964-c090-41c9-a6de-1372475d3bd3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:33.931887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fb964-c090-41c9-a6de-1372475d3bd3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:33.964874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73197629-ab58-4654-bba6-77c8c8754fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:33.965920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73197629-ab58-4654-bba6-77c8c8754fce None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:33.966347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73197629-ab58-4654-bba6-77c8c8754fce None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:33.966818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73197629-ab58-4654-bba6-77c8c8754fce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:33.979324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73197629-ab58-4654-bba6-77c8c8754fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:33.986632 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-73197629-ab58-4654-bba6-77c8c8754fce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 26 20:33:33.988367 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 163/313] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:33.994845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffe1f7-2e8d-4ee1-8806-0e04a0245032 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:34.095968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffe1f7-2e8d-4ee1-8806-0e04a0245032 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:34.131553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827b26d-46a3-4fa7-a199-6377fc257865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:34.132249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827b26d-46a3-4fa7-a199-6377fc257865 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:34.132529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827b26d-46a3-4fa7-a199-6377fc257865 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:34.132800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827b26d-46a3-4fa7-a199-6377fc257865 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:34.133564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827b26d-46a3-4fa7-a199-6377fc257865 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:34.133866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827b26d-46a3-4fa7-a199-6377fc257865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:34.135244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827b26d-46a3-4fa7-a199-6377fc257865 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:34.143346 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 151/314] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:34.149086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73197629-ab58-4654-bba6-77c8c8754fce None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:34.252919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73197629-ab58-4654-bba6-77c8c8754fce None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:34.285290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ad68b-c2fd-4552-a0de-beea842dc039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:34.286156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ad68b-c2fd-4552-a0de-beea842dc039 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:34.286435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ad68b-c2fd-4552-a0de-beea842dc039 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:34.286709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ad68b-c2fd-4552-a0de-beea842dc039 None admin] PATH_INFO: `/v3/users/1ac90d8bac874ec6a7f868c69f2ebc86` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:34.288011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ad68b-c2fd-4552-a0de-beea842dc039 None admin] RBAC: Authorizing `identity:get_user(user_id=1ac90d8bac874ec6a7f868c69f2ebc86)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:34.290030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ad68b-c2fd-4552-a0de-beea842dc039 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:34.291663 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 164/315] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:34 2022] GET /identity/v3/users/1ac90d8bac874ec6a7f868c69f2ebc86 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:34.301005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827b26d-46a3-4fa7-a199-6377fc257865 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:34.412374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827b26d-46a3-4fa7-a199-6377fc257865 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:34.445942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709dfce-cab0-4b1d-9c37-f13dcb39a420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:34.446593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709dfce-cab0-4b1d-9c37-f13dcb39a420 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:34.446878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709dfce-cab0-4b1d-9c37-f13dcb39a420 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:34.447449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709dfce-cab0-4b1d-9c37-f13dcb39a420 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:34.518534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709dfce-cab0-4b1d-9c37-f13dcb39a420 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:34.519952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709dfce-cab0-4b1d-9c37-f13dcb39a420 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:34.620481 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 152/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:34.626321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ad68b-c2fd-4552-a0de-beea842dc039 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:34.726568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ad68b-c2fd-4552-a0de-beea842dc039 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:34.760498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fdc9c-59ae-4d3a-8d9d-2763e3c158d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:34.761578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fdc9c-59ae-4d3a-8d9d-2763e3c158d9 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:34.762027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fdc9c-59ae-4d3a-8d9d-2763e3c158d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:34.762441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fdc9c-59ae-4d3a-8d9d-2763e3c158d9 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:34.763752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fdc9c-59ae-4d3a-8d9d-2763e3c158d9 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:34.765362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fdc9c-59ae-4d3a-8d9d-2763e3c158d9 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:34.767166 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 165/317] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:34 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:34.774926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709dfce-cab0-4b1d-9c37-f13dcb39a420 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:34.872074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709dfce-cab0-4b1d-9c37-f13dcb39a420 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:34.912247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4dd791-8a8b-4526-bd07-3d7a42e6889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:34.912928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dd791-8a8b-4526-bd07-3d7a42e6889b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:34.913212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dd791-8a8b-4526-bd07-3d7a42e6889b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:34.913491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4dd791-8a8b-4526-bd07-3d7a42e6889b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:34.914484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dd791-8a8b-4526-bd07-3d7a42e6889b None admin] RBAC: Adding query filter params (role.id=650bb9543cc549219855a68f47ec7e75, scope.project.id=c562afec45df41a7843efc9f64c6e8ed, user.id=1ac90d8bac874ec6a7f868c69f2ebc86) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:34.914801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dd791-8a8b-4526-bd07-3d7a42e6889b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:34.916333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4dd791-8a8b-4526-bd07-3d7a42e6889b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:34.923326 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 153/318] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:33:34 2022] GET /identity/v3/role_assignments?user.id=1ac90d8bac874ec6a7f868c69f2ebc86&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=650bb9543cc549219855a68f47ec7e75 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:35.681884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152bcab-853b-4fce-84c5-62ab4d3d4113 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:35.682403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152bcab-853b-4fce-84c5-62ab4d3d4113 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:35.682499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152bcab-853b-4fce-84c5-62ab4d3d4113 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:35.684376 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 166/319] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:35.690675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0bd1-fbcd-48a5-a64d-e2e766fcbab7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:35.691097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0bd1-fbcd-48a5-a64d-e2e766fcbab7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:35.691274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0bd1-fbcd-48a5-a64d-e2e766fcbab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:35.708672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a1de0bd1-fbcd-48a5-a64d-e2e766fcbab7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:35.709884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a1de0bd1-fbcd-48a5-a64d-e2e766fcbab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:35.778730 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 154/320] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:35.802798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152bcab-853b-4fce-84c5-62ab4d3d4113 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:35.826985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feb66c-7bf9-49a8-a297-2a775a73a747 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:35.827280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feb66c-7bf9-49a8-a297-2a775a73a747 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:35.827552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1feb66c-7bf9-49a8-a297-2a775a73a747 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:35.829464 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 155/321] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:33:35.835275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b390a9-ce4d-41f9-a518-42e3585a7545 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:35.835559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b390a9-ce4d-41f9-a518-42e3585a7545 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:35.835832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b390a9-ce4d-41f9-a518-42e3585a7545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:35.851885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-33b390a9-ce4d-41f9-a518-42e3585a7545 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:35.853079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-33b390a9-ce4d-41f9-a518-42e3585a7545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:35.906796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152bcab-853b-4fce-84c5-62ab4d3d4113 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:35.916848 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 156/322] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:35.939612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c069421-89d2-4249-b356-7a5ca0dd6387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:35.940254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b390a9-ce4d-41f9-a518-42e3585a7545 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:35.940375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069421-89d2-4249-b356-7a5ca0dd6387 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:35.940660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069421-89d2-4249-b356-7a5ca0dd6387 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:35.940938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c069421-89d2-4249-b356-7a5ca0dd6387 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:35.952383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c069421-89d2-4249-b356-7a5ca0dd6387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:35.959273 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2c069421-89d2-4249-b356-7a5ca0dd6387 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:35.960659 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 167/323] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:35.966624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c069421-89d2-4249-b356-7a5ca0dd6387 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:36.049049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b390a9-ce4d-41f9-a518-42e3585a7545 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:36.068312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c069421-89d2-4249-b356-7a5ca0dd6387 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:36.085336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a5d40-3f9a-4a58-8f30-de90aedd8fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:36.086678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a5d40-3f9a-4a58-8f30-de90aedd8fe7 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.086961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a5d40-3f9a-4a58-8f30-de90aedd8fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.087231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a5d40-3f9a-4a58-8f30-de90aedd8fe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.088822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a5d40-3f9a-4a58-8f30-de90aedd8fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:36.090721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a5d40-3f9a-4a58-8f30-de90aedd8fe7 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:36.097660 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 157/324] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:36.098678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a5d40-3f9a-4a58-8f30-de90aedd8fe7 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:36.101852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3407389-2ceb-4e38-88a3-65124b5152c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:36.102534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3407389-2ceb-4e38-88a3-65124b5152c4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.102810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3407389-2ceb-4e38-88a3-65124b5152c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.103078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3407389-2ceb-4e38-88a3-65124b5152c4 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.103807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3407389-2ceb-4e38-88a3-65124b5152c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:36.104140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3407389-2ceb-4e38-88a3-65124b5152c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:36.105498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3407389-2ceb-4e38-88a3-65124b5152c4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:36.113404 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 168/325] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:36.114582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cd0eb-b2f3-47ac-9e4a-b094923ad7b2 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.114863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cd0eb-b2f3-47ac-9e4a-b094923ad7b2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.115137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cd0eb-b2f3-47ac-9e4a-b094923ad7b2 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.116873 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 169/326] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:36.118766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cd0eb-b2f3-47ac-9e4a-b094923ad7b2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:36.194641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a5d40-3f9a-4a58-8f30-de90aedd8fe7 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:36.215514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cd0eb-b2f3-47ac-9e4a-b094923ad7b2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:36.228219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b1885-71ac-42d9-8ef9-bd6af943b9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:36.228876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b1885-71ac-42d9-8ef9-bd6af943b9c3 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.229152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b1885-71ac-42d9-8ef9-bd6af943b9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.229435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b1885-71ac-42d9-8ef9-bd6af943b9c3 None admin] PATH_INFO: `/v3/groups` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.230116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b1885-71ac-42d9-8ef9-bd6af943b9c3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:36.231565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b1885-71ac-42d9-8ef9-bd6af943b9c3 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:36.244973 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 158/327] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Mar 26 20:33:36 2022] POST /identity/v3/groups => generated 226 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:33:36.249302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543e752-5f5e-46a6-9763-739551229f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:36.250181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543e752-5f5e-46a6-9763-739551229f5a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.250464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543e752-5f5e-46a6-9763-739551229f5a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.250742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543e752-5f5e-46a6-9763-739551229f5a None admin] PATH_INFO: `/v3/users/c26d118a82d04afe9c7c9e9846d6f0e7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.252031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543e752-5f5e-46a6-9763-739551229f5a None admin] RBAC: Authorizing `identity:get_user(user_id=c26d118a82d04afe9c7c9e9846d6f0e7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:36.253517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543e752-5f5e-46a6-9763-739551229f5a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:36.253795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992f1d7-c58a-4a42-b657-c57b0b2574d3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.254085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992f1d7-c58a-4a42-b657-c57b0b2574d3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.254362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992f1d7-c58a-4a42-b657-c57b0b2574d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.256085 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 170/328] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:36 2022] GET /identity/v3/users/c26d118a82d04afe9c7c9e9846d6f0e7 => generated 293 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:36.261418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543e752-5f5e-46a6-9763-739551229f5a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:36.272472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2992f1d7-c58a-4a42-b657-c57b0b2574d3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:36.273802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2992f1d7-c58a-4a42-b657-c57b0b2574d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:36.343790 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 159/329] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:36.365339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543e752-5f5e-46a6-9763-739551229f5a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:36.369393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992f1d7-c58a-4a42-b657-c57b0b2574d3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:36.405402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4674669-72b5-43f1-aef0-321c22274aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:36.406069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4674669-72b5-43f1-aef0-321c22274aba None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.406354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4674669-72b5-43f1-aef0-321c22274aba None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.406634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4674669-72b5-43f1-aef0-321c22274aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.407475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4674669-72b5-43f1-aef0-321c22274aba None admin] RBAC: Adding query filter params (role.id=c7e02bca0ee343c0a8cb78d837b5ad30, user.id=c26d118a82d04afe9c7c9e9846d6f0e7, scope.system=all) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:36.407785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4674669-72b5-43f1-aef0-321c22274aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:36.409359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4674669-72b5-43f1-aef0-321c22274aba None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:36.422921 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 171/330] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Mar 26 20:33:36 2022] GET /identity/v3/role_assignments?user.id=c26d118a82d04afe9c7c9e9846d6f0e7&scope.system=all&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 510 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:36.495950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992f1d7-c58a-4a42-b657-c57b0b2574d3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:36.535136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8b345-c464-4556-adb5-4d42f6298018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:36.535989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8b345-c464-4556-adb5-4d42f6298018 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.536273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8b345-c464-4556-adb5-4d42f6298018 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.536549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f8b345-c464-4556-adb5-4d42f6298018 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.549116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f8b345-c464-4556-adb5-4d42f6298018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:36.556595 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-69f8b345-c464-4556-adb5-4d42f6298018 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 26 20:33:36.562890 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 160/331] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:36.564420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4674669-72b5-43f1-aef0-321c22274aba None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:36.676498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4674669-72b5-43f1-aef0-321c22274aba None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:36.713204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f7ae0-0ce5-484e-ba40-8f95ed4be012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:36.713967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f7ae0-0ce5-484e-ba40-8f95ed4be012 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.714204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f7ae0-0ce5-484e-ba40-8f95ed4be012 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.714489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f7ae0-0ce5-484e-ba40-8f95ed4be012 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.715240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f7ae0-0ce5-484e-ba40-8f95ed4be012 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:36.715550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f7ae0-0ce5-484e-ba40-8f95ed4be012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:36.716980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982f7ae0-0ce5-484e-ba40-8f95ed4be012 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:36.726295 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 172/332] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:36.732563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8b345-c464-4556-adb5-4d42f6298018 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:36.835605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f8b345-c464-4556-adb5-4d42f6298018 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:36.869598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b5c29-3f23-4ec0-bc34-36cf3a169ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:36.870789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5c29-3f23-4ec0-bc34-36cf3a169ba0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:36.871249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5c29-3f23-4ec0-bc34-36cf3a169ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:36.871702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b5c29-3f23-4ec0-bc34-36cf3a169ba0 None admin] PATH_INFO: `/v3/users/3478efb17e084c6c88aecffcb715da07` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:36.873125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b5c29-3f23-4ec0-bc34-36cf3a169ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=3478efb17e084c6c88aecffcb715da07)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:36.874763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505b5c29-3f23-4ec0-bc34-36cf3a169ba0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:36.876949 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 161/333] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:36 2022] GET /identity/v3/users/3478efb17e084c6c88aecffcb715da07 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:36.882618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f7ae0-0ce5-484e-ba40-8f95ed4be012 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:36.987693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f7ae0-0ce5-484e-ba40-8f95ed4be012 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:37.027217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194d156-d9ee-4dbe-81d4-a43248cea5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:37.028123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d156-d9ee-4dbe-81d4-a43248cea5cf None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:37.028408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d156-d9ee-4dbe-81d4-a43248cea5cf None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:37.028685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d156-d9ee-4dbe-81d4-a43248cea5cf None admin] PATH_INFO: `/v3/system/users/3478efb17e084c6c88aecffcb715da07/roles/650bb9543cc549219855a68f47ec7e75` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:37.030192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194d156-d9ee-4dbe-81d4-a43248cea5cf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3478efb17e084c6c88aecffcb715da07, role_id=650bb9543cc549219855a68f47ec7e75)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:37.031581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194d156-d9ee-4dbe-81d4-a43248cea5cf None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:37.042353 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 173/334] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Mar 26 20:33:36 2022] PUT /identity/v3/system/users/3478efb17e084c6c88aecffcb715da07/roles/650bb9543cc549219855a68f47ec7e75 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:33:39.837331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3097-e3ed-4b7a-8c95-a89e8e5bb9a0 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:39.837942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3097-e3ed-4b7a-8c95-a89e8e5bb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:39.837942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3097-e3ed-4b7a-8c95-a89e8e5bb9a0 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:39.839931 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 162/335] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:39.846686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b67ac9-3f73-46b7-a234-112eea2ac359 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:39.847165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b67ac9-3f73-46b7-a234-112eea2ac359 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:39.847249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b67ac9-3f73-46b7-a234-112eea2ac359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:39.868936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-22b67ac9-3f73-46b7-a234-112eea2ac359 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:39.870135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-22b67ac9-3f73-46b7-a234-112eea2ac359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:39.949800 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 174/336] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:39.994058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c3097-e3ed-4b7a-8c95-a89e8e5bb9a0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:40.038408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cedbd-23d3-494d-8cda-9eaafd2d214b None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.038851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cedbd-23d3-494d-8cda-9eaafd2d214b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.039043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598cedbd-23d3-494d-8cda-9eaafd2d214b None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.040984 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 175/337] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:33:40.047412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30598-44ca-4aee-912e-7edd02695b10 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.047704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30598-44ca-4aee-912e-7edd02695b10 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.048004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30598-44ca-4aee-912e-7edd02695b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.080986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-64b30598-44ca-4aee-912e-7edd02695b10 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:40.082192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-64b30598-44ca-4aee-912e-7edd02695b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:40.166175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c3097-e3ed-4b7a-8c95-a89e8e5bb9a0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:40.190458 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 176/338] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:40.191779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872b34f-7fc9-44be-b5e1-f94794a31fbf None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.192112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872b34f-7fc9-44be-b5e1-f94794a31fbf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.195706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872b34f-7fc9-44be-b5e1-f94794a31fbf None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.198446 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 177/339] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:40.207511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6637ea7-0790-4f1b-a0bd-cabddadd41cd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.207800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6637ea7-0790-4f1b-a0bd-cabddadd41cd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.208095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6637ea7-0790-4f1b-a0bd-cabddadd41cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.226186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e6637ea7-0790-4f1b-a0bd-cabddadd41cd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:40.227453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e6637ea7-0790-4f1b-a0bd-cabddadd41cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:40.229177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f10b-5a48-4df3-9c50-93673a0a8aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:40.230007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f10b-5a48-4df3-9c50-93673a0a8aba None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.230290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f10b-5a48-4df3-9c50-93673a0a8aba None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.230562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f10b-5a48-4df3-9c50-93673a0a8aba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.252492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65f10b-5a48-4df3-9c50-93673a0a8aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:40.265686 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2e65f10b-5a48-4df3-9c50-93673a0a8aba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:40.273702 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 163/340] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:40.275075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f10b-5a48-4df3-9c50-93673a0a8aba None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:40.323985 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 178/341] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:40.323985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6637ea7-0790-4f1b-a0bd-cabddadd41cd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:40.408689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f10b-5a48-4df3-9c50-93673a0a8aba None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:40.450196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6637ea7-0790-4f1b-a0bd-cabddadd41cd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:40.451852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394bb10-2c71-4970-854f-46c55431edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:40.453688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394bb10-2c71-4970-854f-46c55431edf0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.454140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394bb10-2c71-4970-854f-46c55431edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.454568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394bb10-2c71-4970-854f-46c55431edf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.466925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394bb10-2c71-4970-854f-46c55431edf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:40.476587 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-6394bb10-2c71-4970-854f-46c55431edf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:40.478699 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 164/342] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:40.480714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9b8f9-d58e-404e-aeb8-b2855ae9dc16 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.481172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9b8f9-d58e-404e-aeb8-b2855ae9dc16 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.481769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9b8f9-d58e-404e-aeb8-b2855ae9dc16 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.485184 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 165/343] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:40.486103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9b8f9-d58e-404e-aeb8-b2855ae9dc16 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:40.493823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf9bb8-9243-40a3-b4bc-7187fec4b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:40.495439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9bb8-9243-40a3-b4bc-7187fec4b224 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.495439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9bb8-9243-40a3-b4bc-7187fec4b224 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.495439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf9bb8-9243-40a3-b4bc-7187fec4b224 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.495778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf9bb8-9243-40a3-b4bc-7187fec4b224 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:40.496133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf9bb8-9243-40a3-b4bc-7187fec4b224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:40.497521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf9bb8-9243-40a3-b4bc-7187fec4b224 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:40.507365 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 179/344] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:40.509925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298318e1-38e5-47cb-a19e-acc5c11838b0 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.509925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298318e1-38e5-47cb-a19e-acc5c11838b0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.509925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298318e1-38e5-47cb-a19e-acc5c11838b0 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.511534 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 180/345] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:40.513252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298318e1-38e5-47cb-a19e-acc5c11838b0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:40.612105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9b8f9-d58e-404e-aeb8-b2855ae9dc16 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:40.633329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298318e1-38e5-47cb-a19e-acc5c11838b0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:40.652261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a7728-d89b-4773-9601-2c34aa7ff67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:40.653357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7728-d89b-4773-9601-2c34aa7ff67a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.653720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7728-d89b-4773-9601-2c34aa7ff67a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.654070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a7728-d89b-4773-9601-2c34aa7ff67a None admin] PATH_INFO: `/v3/roles/member` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.674178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a7728-d89b-4773-9601-2c34aa7ff67a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:40.681859 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-268a7728-d89b-4773-9601-2c34aa7ff67a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:40.683079 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 166/346] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:40.684346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eb1d0-ee0f-4595-81a5-2fe77e6210e4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.686998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eb1d0-ee0f-4595-81a5-2fe77e6210e4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.686998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75eb1d0-ee0f-4595-81a5-2fe77e6210e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.693829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c7520-323e-4e9c-93f5-a01ed61f114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:40.694510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c7520-323e-4e9c-93f5-a01ed61f114a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.694794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c7520-323e-4e9c-93f5-a01ed61f114a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.695122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c7520-323e-4e9c-93f5-a01ed61f114a None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.695874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c7520-323e-4e9c-93f5-a01ed61f114a None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:40.696215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c7520-323e-4e9c-93f5-a01ed61f114a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:40.697616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c7520-323e-4e9c-93f5-a01ed61f114a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:40.708808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c75eb1d0-ee0f-4595-81a5-2fe77e6210e4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:40.715049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c75eb1d0-ee0f-4595-81a5-2fe77e6210e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:40.716324 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 181/347] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:40.719735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c7520-323e-4e9c-93f5-a01ed61f114a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:40.808762 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 167/348] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:40.810490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f311b-0b15-4547-97fa-6e3f199a76ba None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.810848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f311b-0b15-4547-97fa-6e3f199a76ba None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.811059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f311b-0b15-4547-97fa-6e3f199a76ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.843375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3c2f311b-0b15-4547-97fa-6e3f199a76ba None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:40.844638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3c2f311b-0b15-4547-97fa-6e3f199a76ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:40.858787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c7520-323e-4e9c-93f5-a01ed61f114a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:40.896900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92729567-0fcf-484c-ab00-ed7985840b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:40.896900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92729567-0fcf-484c-ab00-ed7985840b33 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:40.897184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92729567-0fcf-484c-ab00-ed7985840b33 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:40.897397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92729567-0fcf-484c-ab00-ed7985840b33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:40.915632 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 168/349] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:40.916859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f311b-0b15-4547-97fa-6e3f199a76ba None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:40.989613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92729567-0fcf-484c-ab00-ed7985840b33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:40.991003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92729567-0fcf-484c-ab00-ed7985840b33 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:41.033612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f311b-0b15-4547-97fa-6e3f199a76ba None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:41.077201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c50c6e-dbf4-415f-9ecb-dafab6533db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:41.077888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c50c6e-dbf4-415f-9ecb-dafab6533db8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.078178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c50c6e-dbf4-415f-9ecb-dafab6533db8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.078459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c50c6e-dbf4-415f-9ecb-dafab6533db8 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.079219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c50c6e-dbf4-415f-9ecb-dafab6533db8 None admin] RBAC: Adding query filter params (name=member) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:41.079528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c50c6e-dbf4-415f-9ecb-dafab6533db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:41.081358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c50c6e-dbf4-415f-9ecb-dafab6533db8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:41.090341 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 169/350] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:41.092036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c50c6e-dbf4-415f-9ecb-dafab6533db8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:41.123794 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 182/351] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:41.125098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92729567-0fcf-484c-ab00-ed7985840b33 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:41.221982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c50c6e-dbf4-415f-9ecb-dafab6533db8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:41.254120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92729567-0fcf-484c-ab00-ed7985840b33 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:41.260909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25932561-d3b0-41ab-8fb0-f87e316457d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:41.261566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25932561-d3b0-41ab-8fb0-f87e316457d0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.261852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25932561-d3b0-41ab-8fb0-f87e316457d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.262132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25932561-d3b0-41ab-8fb0-f87e316457d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.298791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52d379-3b9d-409e-870c-c7173425f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:41.299852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52d379-3b9d-409e-870c-c7173425f92a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.300325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52d379-3b9d-409e-870c-c7173425f92a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.300601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52d379-3b9d-409e-870c-c7173425f92a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.313537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52d379-3b9d-409e-870c-c7173425f92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:41.322079 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-3f52d379-3b9d-409e-870c-c7173425f92a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:41.322735 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 183/352] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:41.323644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52d379-3b9d-409e-870c-c7173425f92a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:41.335074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25932561-d3b0-41ab-8fb0-f87e316457d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:41.337241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25932561-d3b0-41ab-8fb0-f87e316457d0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:41.432835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52d379-3b9d-409e-870c-c7173425f92a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:41.448628 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 170/353] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:41.449483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25932561-d3b0-41ab-8fb0-f87e316457d0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:41.472134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f81a-e361-4221-9c21-19c2be2f174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:41.472926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f81a-e361-4221-9c21-19c2be2f174f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.473206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f81a-e361-4221-9c21-19c2be2f174f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.473485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f81a-e361-4221-9c21-19c2be2f174f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.485752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2f81a-e361-4221-9c21-19c2be2f174f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:41.492889 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d0d2f81a-e361-4221-9c21-19c2be2f174f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 26 20:33:41.494267 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 184/354] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:41.494849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f81a-e361-4221-9c21-19c2be2f174f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:41.564912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25932561-d3b0-41ab-8fb0-f87e316457d0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:41.604558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f81a-e361-4221-9c21-19c2be2f174f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:41.612007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04fa91-0944-43eb-8b2b-9c4c46771d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:41.612655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04fa91-0944-43eb-8b2b-9c4c46771d58 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.613358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04fa91-0944-43eb-8b2b-9c4c46771d58 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.613642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04fa91-0944-43eb-8b2b-9c4c46771d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.642750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc3fd0-edee-494c-bf05-7cf5dcfaa324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:41.643608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc3fd0-edee-494c-bf05-7cf5dcfaa324 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.643892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc3fd0-edee-494c-bf05-7cf5dcfaa324 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.644216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc3fd0-edee-494c-bf05-7cf5dcfaa324 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.645495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc3fd0-edee-494c-bf05-7cf5dcfaa324 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:41.647541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc3fd0-edee-494c-bf05-7cf5dcfaa324 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:41.649300 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 185/355] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:41 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:41.650491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c73936-a679-4e46-8545-e59ef26f2b59 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.650792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c73936-a679-4e46-8545-e59ef26f2b59 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.651054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c73936-a679-4e46-8545-e59ef26f2b59 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.652772 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 186/356] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:41.659157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c73936-a679-4e46-8545-e59ef26f2b59 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:41.694084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04fa91-0944-43eb-8b2b-9c4c46771d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:41.696172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04fa91-0944-43eb-8b2b-9c4c46771d58 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:41.775256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c73936-a679-4e46-8545-e59ef26f2b59 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:41.813394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0a60e-b99f-4345-9b93-4070a8a611e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:41.814047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a60e-b99f-4345-9b93-4070a8a611e2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.814327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a60e-b99f-4345-9b93-4070a8a611e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.815683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0a60e-b99f-4345-9b93-4070a8a611e2 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.815799 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 171/357] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:41.815877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0a60e-b99f-4345-9b93-4070a8a611e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:41.815877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0a60e-b99f-4345-9b93-4070a8a611e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:41.816059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04fa91-0944-43eb-8b2b-9c4c46771d58 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:41.817098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0a60e-b99f-4345-9b93-4070a8a611e2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:41.827033 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 187/358] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:41.827690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0a60e-b99f-4345-9b93-4070a8a611e2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:41.920908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04fa91-0944-43eb-8b2b-9c4c46771d58 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:41.938862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0a60e-b99f-4345-9b93-4070a8a611e2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:41.958121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166c7e-dc58-4903-9cdc-268896c3e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:41.958121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166c7e-dc58-4903-9cdc-268896c3e398 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.958378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166c7e-dc58-4903-9cdc-268896c3e398 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.958542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166c7e-dc58-4903-9cdc-268896c3e398 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.960939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c166c7e-dc58-4903-9cdc-268896c3e398 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:41.961337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c166c7e-dc58-4903-9cdc-268896c3e398 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:41.963034 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 172/359] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:41 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:41.963792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166c7e-dc58-4903-9cdc-268896c3e398 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:41.975872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e0eea-2b13-44d4-b9b2-58387590cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:41.976608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0eea-2b13-44d4-b9b2-58387590cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.976891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0eea-2b13-44d4-b9b2-58387590cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.977169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e0eea-2b13-44d4-b9b2-58387590cfe5 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:41.977912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0eea-2b13-44d4-b9b2-58387590cfe5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:41.978218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0eea-2b13-44d4-b9b2-58387590cfe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:41.979596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652e0eea-2b13-44d4-b9b2-58387590cfe5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:41.989214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 188/360] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:41.990297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784d0f0-6820-46cc-930f-96f9eb0af040 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:41.990587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784d0f0-6820-46cc-930f-96f9eb0af040 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:41.990951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784d0f0-6820-46cc-930f-96f9eb0af040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.010137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c784d0f0-6820-46cc-930f-96f9eb0af040 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:42.011678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c784d0f0-6820-46cc-930f-96f9eb0af040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:42.061660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166c7e-dc58-4903-9cdc-268896c3e398 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.076158 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 189/361] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:42.076925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784d0f0-6820-46cc-930f-96f9eb0af040 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.097583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc7fb4-0ddc-43d6-aa05-d95bba5445e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.098439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc7fb4-0ddc-43d6-aa05-d95bba5445e5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.098717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc7fb4-0ddc-43d6-aa05-d95bba5445e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.098991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc7fb4-0ddc-43d6-aa05-d95bba5445e5 None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.105644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc7fb4-0ddc-43d6-aa05-d95bba5445e5 None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.107092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc7fb4-0ddc-43d6-aa05-d95bba5445e5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.108742 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 173/362] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:41 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:42.109489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc7fb4-0ddc-43d6-aa05-d95bba5445e5 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.185872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784d0f0-6820-46cc-930f-96f9eb0af040 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.200743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc7fb4-0ddc-43d6-aa05-d95bba5445e5 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.218153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096ea84-f0a9-490a-bbbb-68e554efcf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.218998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096ea84-f0a9-490a-bbbb-68e554efcf30 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.219281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096ea84-f0a9-490a-bbbb-68e554efcf30 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.219555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096ea84-f0a9-490a-bbbb-68e554efcf30 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.220757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096ea84-f0a9-490a-bbbb-68e554efcf30 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.222461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096ea84-f0a9-490a-bbbb-68e554efcf30 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.224155 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 190/363] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:42.224905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096ea84-f0a9-490a-bbbb-68e554efcf30 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.232772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a25a-31f8-4d64-9a3d-56e0928e1a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.233416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a25a-31f8-4d64-9a3d-56e0928e1a4a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.233697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a25a-31f8-4d64-9a3d-56e0928e1a4a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.233971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a25a-31f8-4d64-9a3d-56e0928e1a4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.296936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231a25a-31f8-4d64-9a3d-56e0928e1a4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.298386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231a25a-31f8-4d64-9a3d-56e0928e1a4a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.317808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096ea84-f0a9-490a-bbbb-68e554efcf30 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.350203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f214dd-1681-47d6-80e4-26a1ad890aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.350968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f214dd-1681-47d6-80e4-26a1ad890aee None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.351280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f214dd-1681-47d6-80e4-26a1ad890aee None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.351548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f214dd-1681-47d6-80e4-26a1ad890aee None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.352742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f214dd-1681-47d6-80e4-26a1ad890aee None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.354159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f214dd-1681-47d6-80e4-26a1ad890aee None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.355731 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 191/364] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:42.356507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f214dd-1681-47d6-80e4-26a1ad890aee None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.390711 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 174/365] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:42.392841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a25a-31f8-4d64-9a3d-56e0928e1a4a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.450721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f214dd-1681-47d6-80e4-26a1ad890aee None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.483171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53254209-c616-4029-87a3-4e665ed6c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.484176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53254209-c616-4029-87a3-4e665ed6c12f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.484460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53254209-c616-4029-87a3-4e665ed6c12f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.484738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53254209-c616-4029-87a3-4e665ed6c12f None admin] PATH_INFO: `/v3/users/3478efb17e084c6c88aecffcb715da07` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.485932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53254209-c616-4029-87a3-4e665ed6c12f None admin] RBAC: Authorizing `identity:get_user(user_id=3478efb17e084c6c88aecffcb715da07)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.486711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a25a-31f8-4d64-9a3d-56e0928e1a4a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.487371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53254209-c616-4029-87a3-4e665ed6c12f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.489373 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 192/366] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/users/3478efb17e084c6c88aecffcb715da07 => generated 293 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:42.489733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53254209-c616-4029-87a3-4e665ed6c12f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.518653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec729a-2943-4b8b-a2bb-e51f2245bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.519432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec729a-2943-4b8b-a2bb-e51f2245bd2a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.519719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec729a-2943-4b8b-a2bb-e51f2245bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.520029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec729a-2943-4b8b-a2bb-e51f2245bd2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.530070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec729a-2943-4b8b-a2bb-e51f2245bd2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:42.536924 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-52ec729a-2943-4b8b-a2bb-e51f2245bd2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:33:42.538092 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 175/367] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:42.539396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec729a-2943-4b8b-a2bb-e51f2245bd2a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.583449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53254209-c616-4029-87a3-4e665ed6c12f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.617233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24137d-695c-4f43-9bb7-33a5cee0708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.617808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24137d-695c-4f43-9bb7-33a5cee0708a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.618089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24137d-695c-4f43-9bb7-33a5cee0708a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.618361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24137d-695c-4f43-9bb7-33a5cee0708a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.619177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24137d-695c-4f43-9bb7-33a5cee0708a None admin] RBAC: Adding query filter params (group.id=406f28705dea4f81a38dfed5be9dd78d, role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=a2d411ec96874463bba5e37d88810748) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:42.619482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24137d-695c-4f43-9bb7-33a5cee0708a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.620941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24137d-695c-4f43-9bb7-33a5cee0708a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.626165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 193/368] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/role_assignments?group.id=406f28705dea4f81a38dfed5be9dd78d&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 260 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:42.626925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24137d-695c-4f43-9bb7-33a5cee0708a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.636696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec729a-2943-4b8b-a2bb-e51f2245bd2a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.673693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dd47c-c313-48c7-b154-143a1f8b9a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.674556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dd47c-c313-48c7-b154-143a1f8b9a4c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.674842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dd47c-c313-48c7-b154-143a1f8b9a4c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.675121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dd47c-c313-48c7-b154-143a1f8b9a4c None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.676436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dd47c-c313-48c7-b154-143a1f8b9a4c None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.677941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55dd47c-c313-48c7-b154-143a1f8b9a4c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.684532 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 176/369] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:42.684532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dd47c-c313-48c7-b154-143a1f8b9a4c None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.731191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24137d-695c-4f43-9bb7-33a5cee0708a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.765739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943968-ea16-43dd-bc88-730d2ad3450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.766405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943968-ea16-43dd-bc88-730d2ad3450b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.766697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943968-ea16-43dd-bc88-730d2ad3450b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.766969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed943968-ea16-43dd-bc88-730d2ad3450b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.767807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed943968-ea16-43dd-bc88-730d2ad3450b None admin] RBAC: Adding query filter params (group.id=406f28705dea4f81a38dfed5be9dd78d, role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=a2d411ec96874463bba5e37d88810748) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:42.768153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed943968-ea16-43dd-bc88-730d2ad3450b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.769619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed943968-ea16-43dd-bc88-730d2ad3450b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.783963 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 194/370] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/role_assignments?group.id=406f28705dea4f81a38dfed5be9dd78d&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 260 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:42.783963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943968-ea16-43dd-bc88-730d2ad3450b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.803406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55dd47c-c313-48c7-b154-143a1f8b9a4c None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.861036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea04cb2-104e-4995-9e59-ca0d6d69eedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.861989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea04cb2-104e-4995-9e59-ca0d6d69eedf None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.862319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea04cb2-104e-4995-9e59-ca0d6d69eedf None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.862601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea04cb2-104e-4995-9e59-ca0d6d69eedf None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.863943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea04cb2-104e-4995-9e59-ca0d6d69eedf None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.865482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea04cb2-104e-4995-9e59-ca0d6d69eedf None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.872012 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 177/371] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:42.872894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea04cb2-104e-4995-9e59-ca0d6d69eedf None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.887582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed943968-ea16-43dd-bc88-730d2ad3450b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:42.924349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43741a76-6594-4dbc-a0ee-11a1115860b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:42.925019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43741a76-6594-4dbc-a0ee-11a1115860b4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:42.925305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43741a76-6594-4dbc-a0ee-11a1115860b4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:42.925584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43741a76-6594-4dbc-a0ee-11a1115860b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:42.926471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43741a76-6594-4dbc-a0ee-11a1115860b4 None admin] RBAC: Adding query filter params (role.id=650bb9543cc549219855a68f47ec7e75, user.id=3478efb17e084c6c88aecffcb715da07, scope.system=all) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:42.926793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43741a76-6594-4dbc-a0ee-11a1115860b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:42.928316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43741a76-6594-4dbc-a0ee-11a1115860b4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:42.941298 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 195/372] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/role_assignments?user.id=3478efb17e084c6c88aecffcb715da07&scope.system=all&role.id=650bb9543cc549219855a68f47ec7e75 => generated 510 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:42.942157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43741a76-6594-4dbc-a0ee-11a1115860b4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:42.982717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea04cb2-104e-4995-9e59-ca0d6d69eedf None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:43.029341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870839ad-c0b1-4c68-b111-75eb92f3128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:43.030890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870839ad-c0b1-4c68-b111-75eb92f3128d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:43.031392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870839ad-c0b1-4c68-b111-75eb92f3128d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:43.032226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870839ad-c0b1-4c68-b111-75eb92f3128d None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:43.033513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870839ad-c0b1-4c68-b111-75eb92f3128d None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:43.034059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870839ad-c0b1-4c68-b111-75eb92f3128d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:43.036684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870839ad-c0b1-4c68-b111-75eb92f3128d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:43.050011 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 178/373] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:43.051363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870839ad-c0b1-4c68-b111-75eb92f3128d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:43.065040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43741a76-6594-4dbc-a0ee-11a1115860b4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:43.115852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ff37e-f187-4aa0-87f1-14ed96dfc470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:43.117376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff37e-f187-4aa0-87f1-14ed96dfc470 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:43.117666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff37e-f187-4aa0-87f1-14ed96dfc470 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:43.117944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ff37e-f187-4aa0-87f1-14ed96dfc470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:43.118789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ff37e-f187-4aa0-87f1-14ed96dfc470 None admin] RBAC: Adding query filter params (group.id=406f28705dea4f81a38dfed5be9dd78d, role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=c562afec45df41a7843efc9f64c6e8ed) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:43.119098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ff37e-f187-4aa0-87f1-14ed96dfc470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:43.122294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7ff37e-f187-4aa0-87f1-14ed96dfc470 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:43.135221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 196/374] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:42 2022] GET /identity/v3/role_assignments?group.id=406f28705dea4f81a38dfed5be9dd78d&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:43.138869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ff37e-f187-4aa0-87f1-14ed96dfc470 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:43.222175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870839ad-c0b1-4c68-b111-75eb92f3128d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:43.296173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ff37e-f187-4aa0-87f1-14ed96dfc470 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:43.308472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9e990-1bc1-41da-baf0-7e9aa8e1eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:43.309341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9e990-1bc1-41da-baf0-7e9aa8e1eabf None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:43.309618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9e990-1bc1-41da-baf0-7e9aa8e1eabf None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:43.309889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9e990-1bc1-41da-baf0-7e9aa8e1eabf None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:43.311073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9e990-1bc1-41da-baf0-7e9aa8e1eabf None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:43.312559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9e990-1bc1-41da-baf0-7e9aa8e1eabf None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:43.314186 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 179/375] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:43 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:43.320512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9e990-1bc1-41da-baf0-7e9aa8e1eabf None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:43.345342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f545a8-32f3-4263-b32e-802eae522404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:43.346628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f545a8-32f3-4263-b32e-802eae522404 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:43.347116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f545a8-32f3-4263-b32e-802eae522404 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:43.347709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f545a8-32f3-4263-b32e-802eae522404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:43.452134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f545a8-32f3-4263-b32e-802eae522404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:43.454090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f545a8-32f3-4263-b32e-802eae522404 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:43.529610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9e990-1bc1-41da-baf0-7e9aa8e1eabf None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:43.559356 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 197/376] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:43.566236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f545a8-32f3-4263-b32e-802eae522404 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:43.621518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d0ba2-0047-4039-a856-76b65c28a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:43.622183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d0ba2-0047-4039-a856-76b65c28a847 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:43.622465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d0ba2-0047-4039-a856-76b65c28a847 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:43.622740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d0ba2-0047-4039-a856-76b65c28a847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:43.623565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d0ba2-0047-4039-a856-76b65c28a847 None admin] RBAC: Adding query filter params (group.id=406f28705dea4f81a38dfed5be9dd78d, role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=c562afec45df41a7843efc9f64c6e8ed) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:43.623873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d0ba2-0047-4039-a856-76b65c28a847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:43.625350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d0ba2-0047-4039-a856-76b65c28a847 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:43.642203 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 180/377] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:43 2022] GET /identity/v3/role_assignments?group.id=406f28705dea4f81a38dfed5be9dd78d&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 260 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:43.672345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f545a8-32f3-4263-b32e-802eae522404 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:43.709206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510a7c9-80dc-436b-9e9a-bf6864078596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:43.709996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510a7c9-80dc-436b-9e9a-bf6864078596 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:43.710281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510a7c9-80dc-436b-9e9a-bf6864078596 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:43.710610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510a7c9-80dc-436b-9e9a-bf6864078596 None admin] PATH_INFO: `/v3/projects/3c773729259f41fda13a8dbc3d1e265c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:43.711817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510a7c9-80dc-436b-9e9a-bf6864078596 None admin] RBAC: Authorizing `identity:get_project(project_id=3c773729259f41fda13a8dbc3d1e265c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:43.713328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510a7c9-80dc-436b-9e9a-bf6864078596 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:43.715519 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 198/378] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:43 2022] GET /identity/v3/projects/3c773729259f41fda13a8dbc3d1e265c => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:43.721528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d0ba2-0047-4039-a856-76b65c28a847 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:43.834739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d0ba2-0047-4039-a856-76b65c28a847 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:43.872149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edd0bd-c923-4285-84a5-c569be033250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:43.873024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edd0bd-c923-4285-84a5-c569be033250 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:43.873314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edd0bd-c923-4285-84a5-c569be033250 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:43.873594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edd0bd-c923-4285-84a5-c569be033250 None admin] PATH_INFO: `/v3/groups/2ecc5442acbc4f90bcf843c65d427354` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:43.879148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edd0bd-c923-4285-84a5-c569be033250 None admin] RBAC: Authorizing `identity:get_group(group_id=2ecc5442acbc4f90bcf843c65d427354)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:43.880677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edd0bd-c923-4285-84a5-c569be033250 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:43.882761 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 181/379] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:43 2022] GET /identity/v3/groups/2ecc5442acbc4f90bcf843c65d427354 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:43.888526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510a7c9-80dc-436b-9e9a-bf6864078596 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:43.994265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510a7c9-80dc-436b-9e9a-bf6864078596 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:44.029866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e695204-9274-4443-b4db-953aff194382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:44.030528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e695204-9274-4443-b4db-953aff194382 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:44.030814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e695204-9274-4443-b4db-953aff194382 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:44.031089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e695204-9274-4443-b4db-953aff194382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:44.031929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e695204-9274-4443-b4db-953aff194382 None admin] RBAC: Adding query filter params (group.id=2ecc5442acbc4f90bcf843c65d427354, role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=3c773729259f41fda13a8dbc3d1e265c) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:44.032255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e695204-9274-4443-b4db-953aff194382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:44.033698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e695204-9274-4443-b4db-953aff194382 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:44.040151 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 199/380] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:43 2022] GET /identity/v3/role_assignments?group.id=2ecc5442acbc4f90bcf843c65d427354&scope.project.id=3c773729259f41fda13a8dbc3d1e265c&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 260 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:45.533780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a754a99-dc73-4ada-84f3-c5b20e6ebc72 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:45.534822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a754a99-dc73-4ada-84f3-c5b20e6ebc72 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:45.535350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a754a99-dc73-4ada-84f3-c5b20e6ebc72 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:45.537390 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 182/381] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:45.545145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376e0b9-c062-491e-82f8-c99fd9fb61db None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:45.546025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376e0b9-c062-491e-82f8-c99fd9fb61db None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:45.546513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376e0b9-c062-491e-82f8-c99fd9fb61db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:45.563687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2376e0b9-c062-491e-82f8-c99fd9fb61db None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:45.565199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2376e0b9-c062-491e-82f8-c99fd9fb61db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:45.633292 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 200/382] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:45.657589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a754a99-dc73-4ada-84f3-c5b20e6ebc72 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:45.768632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a754a99-dc73-4ada-84f3-c5b20e6ebc72 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:45.803622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ce0e5-afc3-4525-bd2e-183f8f130a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:45.804839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ce0e5-afc3-4525-bd2e-183f8f130a84 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:45.805350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ce0e5-afc3-4525-bd2e-183f8f130a84 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:45.805825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ce0e5-afc3-4525-bd2e-183f8f130a84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:45.821214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ce0e5-afc3-4525-bd2e-183f8f130a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:45.831790 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0b5ce0e5-afc3-4525-bd2e-183f8f130a84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:45.833228 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 183/383] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:45.839647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376e0b9-c062-491e-82f8-c99fd9fb61db None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:45.955579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376e0b9-c062-491e-82f8-c99fd9fb61db None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:45.990793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d02a0-db8d-47b9-9372-40dc13d0a3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:45.992427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d02a0-db8d-47b9-9372-40dc13d0a3c3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:45.992917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d02a0-db8d-47b9-9372-40dc13d0a3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:45.993392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d02a0-db8d-47b9-9372-40dc13d0a3c3 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:45.994326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d02a0-db8d-47b9-9372-40dc13d0a3c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:45.994831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d02a0-db8d-47b9-9372-40dc13d0a3c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:45.996442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d02a0-db8d-47b9-9372-40dc13d0a3c3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:46.005092 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 201/384] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:46.016206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ce0e5-afc3-4525-bd2e-183f8f130a84 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:46.102055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a18e17-9e35-4b3e-aeb8-faddd23feb7d None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.102728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a18e17-9e35-4b3e-aeb8-faddd23feb7d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.103210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a18e17-9e35-4b3e-aeb8-faddd23feb7d None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.105430 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 202/385] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:46.112073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c496f8-cfbb-4411-8214-ea1b1d7fa108 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.112604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c496f8-cfbb-4411-8214-ea1b1d7fa108 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.113106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c496f8-cfbb-4411-8214-ea1b1d7fa108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.133733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ce0e5-afc3-4525-bd2e-183f8f130a84 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:46.156326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-10c496f8-cfbb-4411-8214-ea1b1d7fa108 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:46.157871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-10c496f8-cfbb-4411-8214-ea1b1d7fa108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:46.177537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332bb62-7f2a-431b-8960-e9c544051f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:46.178398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332bb62-7f2a-431b-8960-e9c544051f16 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.178679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332bb62-7f2a-431b-8960-e9c544051f16 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.178957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332bb62-7f2a-431b-8960-e9c544051f16 None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.181074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332bb62-7f2a-431b-8960-e9c544051f16 None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:46.182179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f332bb62-7f2a-431b-8960-e9c544051f16 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:46.188087 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 184/386] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:46 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:46.198367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332bb62-7f2a-431b-8960-e9c544051f16 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:46.249553 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 203/387] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:46.251509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb547545-073a-4e68-875e-339e5f6e46ba None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.252477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb547545-073a-4e68-875e-339e5f6e46ba None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.253007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb547545-073a-4e68-875e-339e5f6e46ba None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.255691 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 204/388] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:46.263051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417c87e-9192-49b9-9742-d1bc619e8cf8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.263604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417c87e-9192-49b9-9742-d1bc619e8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.264207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417c87e-9192-49b9-9742-d1bc619e8cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.293114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0417c87e-9192-49b9-9742-d1bc619e8cf8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:46.295158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0417c87e-9192-49b9-9742-d1bc619e8cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:46.353982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332bb62-7f2a-431b-8960-e9c544051f16 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:46.366040 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 205/389] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:46.367836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417c87e-9192-49b9-9742-d1bc619e8cf8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:46.406004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03fd1f-4e16-4abc-8478-865b0a40f0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:46.407190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03fd1f-4e16-4abc-8478-865b0a40f0f1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.407651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03fd1f-4e16-4abc-8478-865b0a40f0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.408104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa03fd1f-4e16-4abc-8478-865b0a40f0f1 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.409550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03fd1f-4e16-4abc-8478-865b0a40f0f1 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:46.411201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa03fd1f-4e16-4abc-8478-865b0a40f0f1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:46.413550 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 185/390] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:46 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:46.414642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03fd1f-4e16-4abc-8478-865b0a40f0f1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:46.476611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417c87e-9192-49b9-9742-d1bc619e8cf8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:46.519347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7d4d9-d8d7-4161-8fcc-44d14fa9c1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:46.520175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7d4d9-d8d7-4161-8fcc-44d14fa9c1bc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.520465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7d4d9-d8d7-4161-8fcc-44d14fa9c1bc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.520740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7d4d9-d8d7-4161-8fcc-44d14fa9c1bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.523447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa03fd1f-4e16-4abc-8478-865b0a40f0f1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:46.531422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7d4d9-d8d7-4161-8fcc-44d14fa9c1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:46.539053 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-66f7d4d9-d8d7-4161-8fcc-44d14fa9c1bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:46.540593 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 206/391] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:46.541427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7d4d9-d8d7-4161-8fcc-44d14fa9c1bc None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:46.561264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7702a8-0871-406f-b3e4-acf8f5c7a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:46.562814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7702a8-0871-406f-b3e4-acf8f5c7a4f3 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.563339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7702a8-0871-406f-b3e4-acf8f5c7a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.563815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7702a8-0871-406f-b3e4-acf8f5c7a4f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.576232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7702a8-0871-406f-b3e4-acf8f5c7a4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:46.583712 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0d7702a8-0871-406f-b3e4-acf8f5c7a4f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:46.585626 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 186/392] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:46.586769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7702a8-0871-406f-b3e4-acf8f5c7a4f3 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:46.646817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7d4d9-d8d7-4161-8fcc-44d14fa9c1bc None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:46.682631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b588f-9aae-418a-8771-685109dc1617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:46.683509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b588f-9aae-418a-8771-685109dc1617 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.683793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b588f-9aae-418a-8771-685109dc1617 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.684104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b588f-9aae-418a-8771-685109dc1617 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748/groups/406f28705dea4f81a38dfed5be9dd78d/roles/e875b4dda15a40c6aa7d8d75c96b3597` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.686383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b588f-9aae-418a-8771-685109dc1617 None admin] RBAC: Authorizing `identity:create_grant(project_id=a2d411ec96874463bba5e37d88810748, group_id=406f28705dea4f81a38dfed5be9dd78d, role_id=e875b4dda15a40c6aa7d8d75c96b3597)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:46.688132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b588f-9aae-418a-8771-685109dc1617 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:46.691672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7702a8-0871-406f-b3e4-acf8f5c7a4f3 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:46.705055 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 207/393] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Mar 26 20:33:46 2022] PUT /identity/v3/projects/a2d411ec96874463bba5e37d88810748/groups/406f28705dea4f81a38dfed5be9dd78d/roles/e875b4dda15a40c6aa7d8d75c96b3597 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:46.705954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b588f-9aae-418a-8771-685109dc1617 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:46.735983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77c609-3394-4b6c-a4d4-a32fdbbe67a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:46.737226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77c609-3394-4b6c-a4d4-a32fdbbe67a4 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.738115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77c609-3394-4b6c-a4d4-a32fdbbe67a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.738896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77c609-3394-4b6c-a4d4-a32fdbbe67a4 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.740167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77c609-3394-4b6c-a4d4-a32fdbbe67a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:46.741013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77c609-3394-4b6c-a4d4-a32fdbbe67a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:46.743601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77c609-3394-4b6c-a4d4-a32fdbbe67a4 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:46.755997 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 187/394] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:46.761269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77c609-3394-4b6c-a4d4-a32fdbbe67a4 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:46.886745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77c609-3394-4b6c-a4d4-a32fdbbe67a4 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:46.888588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b588f-9aae-418a-8771-685109dc1617 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:46.924560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83762b2d-8a23-446d-b361-7bab1374201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:46.924928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83762b2d-8a23-446d-b361-7bab1374201a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.925170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83762b2d-8a23-446d-b361-7bab1374201a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.925447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83762b2d-8a23-446d-b361-7bab1374201a None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.926238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83762b2d-8a23-446d-b361-7bab1374201a None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:46.926533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83762b2d-8a23-446d-b361-7bab1374201a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:46.927973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83762b2d-8a23-446d-b361-7bab1374201a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:46.936262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db0edc-5c6e-441b-8f05-29d66f64a892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:46.937923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0edc-5c6e-441b-8f05-29d66f64a892 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.938493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0edc-5c6e-441b-8f05-29d66f64a892 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.939215 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 208/395] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:46.939457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db0edc-5c6e-441b-8f05-29d66f64a892 None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.941125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db0edc-5c6e-441b-8f05-29d66f64a892 None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:46.942923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db0edc-5c6e-441b-8f05-29d66f64a892 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:46.944810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83762b2d-8a23-446d-b361-7bab1374201a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:46.945753 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 188/396] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:46 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:46.949923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a231ba3-edb5-4e81-ab91-b8e54fbcb3da None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:46.950157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a231ba3-edb5-4e81-ab91-b8e54fbcb3da None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:46.950420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a231ba3-edb5-4e81-ab91-b8e54fbcb3da None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:46.956486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 189/397] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:33:46.957344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a231ba3-edb5-4e81-ab91-b8e54fbcb3da None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:47.057296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83762b2d-8a23-446d-b361-7bab1374201a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:47.091213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfe1be-e89c-424c-b3fa-42a3d94c5bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:47.092106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe1be-e89c-424c-b3fa-42a3d94c5bc0 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.092388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe1be-e89c-424c-b3fa-42a3d94c5bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.092661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe1be-e89c-424c-b3fa-42a3d94c5bc0 None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.093847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfe1be-e89c-424c-b3fa-42a3d94c5bc0 None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:47.095422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a231ba3-edb5-4e81-ab91-b8e54fbcb3da None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:47.095610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfe1be-e89c-424c-b3fa-42a3d94c5bc0 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:47.097868 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 209/398] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:46 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:47.099020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691ba05-1ad7-41ca-95b3-fbff1d72e565 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.099302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691ba05-1ad7-41ca-95b3-fbff1d72e565 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.099577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e691ba05-1ad7-41ca-95b3-fbff1d72e565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.117448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e691ba05-1ad7-41ca-95b3-fbff1d72e565 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:47.118622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e691ba05-1ad7-41ca-95b3-fbff1d72e565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:47.144209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6fc63-b0c1-4943-9d27-9da187e294f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:47.145380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6fc63-b0c1-4943-9d27-9da187e294f4 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.145665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6fc63-b0c1-4943-9d27-9da187e294f4 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.145940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6fc63-b0c1-4943-9d27-9da187e294f4 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.147357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6fc63-b0c1-4943-9d27-9da187e294f4 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:47.149763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6fc63-b0c1-4943-9d27-9da187e294f4 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:47.152232 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 190/399] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:46 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:47.153006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6fc63-b0c1-4943-9d27-9da187e294f4 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:47.202010 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 210/400] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:47.203266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691ba05-1ad7-41ca-95b3-fbff1d72e565 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:47.274877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6fc63-b0c1-4943-9d27-9da187e294f4 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:47.310379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a76b1-3605-4ceb-800d-58e0aa1a5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:47.311664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a76b1-3605-4ceb-800d-58e0aa1a5bc7 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.312213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a76b1-3605-4ceb-800d-58e0aa1a5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.312712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a76b1-3605-4ceb-800d-58e0aa1a5bc7 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.314098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a76b1-3605-4ceb-800d-58e0aa1a5bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:47.315779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a76b1-3605-4ceb-800d-58e0aa1a5bc7 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:47.317759 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 191/401] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:47 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:47.320700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e691ba05-1ad7-41ca-95b3-fbff1d72e565 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:47.323549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a76b1-3605-4ceb-800d-58e0aa1a5bc7 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:47.362162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300c38-506a-4da8-b923-cdcd116aa5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:47.363053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300c38-506a-4da8-b923-cdcd116aa5ef None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.363336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300c38-506a-4da8-b923-cdcd116aa5ef None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.363615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f300c38-506a-4da8-b923-cdcd116aa5ef None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748/groups/406f28705dea4f81a38dfed5be9dd78d/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.365609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f300c38-506a-4da8-b923-cdcd116aa5ef None admin] RBAC: Authorizing `identity:create_grant(project_id=a2d411ec96874463bba5e37d88810748, group_id=406f28705dea4f81a38dfed5be9dd78d, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:47.367090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f300c38-506a-4da8-b923-cdcd116aa5ef None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:47.379378 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 211/402] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Mar 26 20:33:47 2022] PUT /identity/v3/projects/a2d411ec96874463bba5e37d88810748/groups/406f28705dea4f81a38dfed5be9dd78d/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:47.380155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300c38-506a-4da8-b923-cdcd116aa5ef None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:47.443137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a76b1-3605-4ceb-800d-58e0aa1a5bc7 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:47.481973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe105cd-9059-4ec6-9baa-419880ba0114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:47.482782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe105cd-9059-4ec6-9baa-419880ba0114 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.483125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe105cd-9059-4ec6-9baa-419880ba0114 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.483406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe105cd-9059-4ec6-9baa-419880ba0114 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.495872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe105cd-9059-4ec6-9baa-419880ba0114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:47.503942 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-fbe105cd-9059-4ec6-9baa-419880ba0114 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:47.505251 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 192/403] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:47.510830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391028cb-505b-4a13-87f7-307949ce7c2f None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.511123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391028cb-505b-4a13-87f7-307949ce7c2f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.511463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391028cb-505b-4a13-87f7-307949ce7c2f None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.512851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f300c38-506a-4da8-b923-cdcd116aa5ef None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:47.518889 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 193/404] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:47.518889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391028cb-505b-4a13-87f7-307949ce7c2f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:47.567086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2794757-5f80-408b-b575-860ed7968966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:47.568770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794757-5f80-408b-b575-860ed7968966 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.568770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794757-5f80-408b-b575-860ed7968966 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.568971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2794757-5f80-408b-b575-860ed7968966 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed/groups/406f28705dea4f81a38dfed5be9dd78d/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.571234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794757-5f80-408b-b575-860ed7968966 None admin] RBAC: Authorizing `identity:create_grant(project_id=c562afec45df41a7843efc9f64c6e8ed, group_id=406f28705dea4f81a38dfed5be9dd78d, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:47.572732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2794757-5f80-408b-b575-860ed7968966 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:47.594808 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 212/405] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Mar 26 20:33:47 2022] PUT /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed/groups/406f28705dea4f81a38dfed5be9dd78d/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:47.597532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f32c-3ee8-4e69-8491-7fae25972c8b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.598898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f32c-3ee8-4e69-8491-7fae25972c8b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.599421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0f32c-3ee8-4e69-8491-7fae25972c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.622889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-94f0f32c-3ee8-4e69-8491-7fae25972c8b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:47.624819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-94f0f32c-3ee8-4e69-8491-7fae25972c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:47.640038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391028cb-505b-4a13-87f7-307949ce7c2f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:47.689059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767a24-ad35-47f5-8674-0a8a9c25586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:47.690409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767a24-ad35-47f5-8674-0a8a9c25586d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.691119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767a24-ad35-47f5-8674-0a8a9c25586d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.691577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2767a24-ad35-47f5-8674-0a8a9c25586d None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.693008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767a24-ad35-47f5-8674-0a8a9c25586d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:47.693523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767a24-ad35-47f5-8674-0a8a9c25586d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:47.695554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2767a24-ad35-47f5-8674-0a8a9c25586d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:47.702864 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 213/406] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:47.707075 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 194/407] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:47.713379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f32c-3ee8-4e69-8491-7fae25972c8b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:47.744220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767a24-ad35-47f5-8674-0a8a9c25586d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:47.830129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0f32c-3ee8-4e69-8491-7fae25972c8b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:47.875678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056ee8-f06b-4425-a394-7f09710eb122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:47.876596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056ee8-f06b-4425-a394-7f09710eb122 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.876883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056ee8-f06b-4425-a394-7f09710eb122 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.877163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056ee8-f06b-4425-a394-7f09710eb122 None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.878363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056ee8-f06b-4425-a394-7f09710eb122 None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:47.880292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056ee8-f06b-4425-a394-7f09710eb122 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:47.882500 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 214/408] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:47 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:47.887809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056ee8-f06b-4425-a394-7f09710eb122 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:47.916331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2767a24-ad35-47f5-8674-0a8a9c25586d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:47.956940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62283c9-f40f-4cf9-b61f-38033c64fbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:47.957990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62283c9-f40f-4cf9-b61f-38033c64fbbd None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:47.958268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62283c9-f40f-4cf9-b61f-38033c64fbbd None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:47.958541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62283c9-f40f-4cf9-b61f-38033c64fbbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:47.977686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62283c9-f40f-4cf9-b61f-38033c64fbbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:47.992880 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-c62283c9-f40f-4cf9-b61f-38033c64fbbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:33:47.994112 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 195/409] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:48.001186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62283c9-f40f-4cf9-b61f-38033c64fbbd None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:48.056386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056ee8-f06b-4425-a394-7f09710eb122 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:48.133431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7cc4c-4720-4dd1-9365-a524308372e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:48.134302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7cc4c-4720-4dd1-9365-a524308372e5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:48.134586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7cc4c-4720-4dd1-9365-a524308372e5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:48.134865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7cc4c-4720-4dd1-9365-a524308372e5 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:48.136095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7cc4c-4720-4dd1-9365-a524308372e5 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:48.137543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7cc4c-4720-4dd1-9365-a524308372e5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:48.144703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62283c9-f40f-4cf9-b61f-38033c64fbbd None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:48.146948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 215/410] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:47 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:48.147878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7cc4c-4720-4dd1-9365-a524308372e5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:48.178378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeb8e9-85f9-4a88-86dc-987aa88ee6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:48.179588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeb8e9-85f9-4a88-86dc-987aa88ee6f2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:48.179882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeb8e9-85f9-4a88-86dc-987aa88ee6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:48.180206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adeb8e9-85f9-4a88-86dc-987aa88ee6f2 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:48.180945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeb8e9-85f9-4a88-86dc-987aa88ee6f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:48.181250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeb8e9-85f9-4a88-86dc-987aa88ee6f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:48.182632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adeb8e9-85f9-4a88-86dc-987aa88ee6f2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:48.191108 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 196/411] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:48.196475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeb8e9-85f9-4a88-86dc-987aa88ee6f2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:48.296847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7cc4c-4720-4dd1-9365-a524308372e5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:48.310465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adeb8e9-85f9-4a88-86dc-987aa88ee6f2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:48.349626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eddb4b-7a0b-4860-abf4-572d08858514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:48.352037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eddb4b-7a0b-4860-abf4-572d08858514 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:48.352037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eddb4b-7a0b-4860-abf4-572d08858514 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:48.352037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eddb4b-7a0b-4860-abf4-572d08858514 None admin] PATH_INFO: `/v3/groups/2ecc5442acbc4f90bcf843c65d427354` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:48.352730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eddb4b-7a0b-4860-abf4-572d08858514 None admin] RBAC: Authorizing `identity:get_group(group_id=2ecc5442acbc4f90bcf843c65d427354)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:48.354188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eddb4b-7a0b-4860-abf4-572d08858514 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:48.355788 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 197/412] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:48 2022] GET /identity/v3/groups/2ecc5442acbc4f90bcf843c65d427354 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:48.361593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eddb4b-7a0b-4860-abf4-572d08858514 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:48.369234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec27e49-abe3-4af8-9c07-93e739758d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:48.370121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec27e49-abe3-4af8-9c07-93e739758d42 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:48.370401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec27e49-abe3-4af8-9c07-93e739758d42 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:48.370678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec27e49-abe3-4af8-9c07-93e739758d42 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed/groups/406f28705dea4f81a38dfed5be9dd78d/roles/e875b4dda15a40c6aa7d8d75c96b3597` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:48.378128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec27e49-abe3-4af8-9c07-93e739758d42 None admin] RBAC: Authorizing `identity:create_grant(project_id=c562afec45df41a7843efc9f64c6e8ed, group_id=406f28705dea4f81a38dfed5be9dd78d, role_id=e875b4dda15a40c6aa7d8d75c96b3597)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:48.379581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec27e49-abe3-4af8-9c07-93e739758d42 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:48.405101 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 216/413] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Mar 26 20:33:48 2022] PUT /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed/groups/406f28705dea4f81a38dfed5be9dd78d/roles/e875b4dda15a40c6aa7d8d75c96b3597 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:33:48.487179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eddb4b-7a0b-4860-abf4-572d08858514 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:48.524294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29beecd7-a6c3-4640-b4cf-dd82cc52abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:48.525167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beecd7-a6c3-4640-b4cf-dd82cc52abdc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:48.525450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beecd7-a6c3-4640-b4cf-dd82cc52abdc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:48.525729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29beecd7-a6c3-4640-b4cf-dd82cc52abdc None admin] PATH_INFO: `/v3/projects/3c773729259f41fda13a8dbc3d1e265c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:48.527065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29beecd7-a6c3-4640-b4cf-dd82cc52abdc None admin] RBAC: Authorizing `identity:get_project(project_id=3c773729259f41fda13a8dbc3d1e265c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:48.528584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29beecd7-a6c3-4640-b4cf-dd82cc52abdc None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:48.530645 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 198/414] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:48 2022] GET /identity/v3/projects/3c773729259f41fda13a8dbc3d1e265c => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:48.536281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec27e49-abe3-4af8-9c07-93e739758d42 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:48.667330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec27e49-abe3-4af8-9c07-93e739758d42 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:48.705664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb7091-f87f-47e7-8705-26c4e0c27aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:48.707356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7091-f87f-47e7-8705-26c4e0c27aae None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:48.707833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7091-f87f-47e7-8705-26c4e0c27aae None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:48.708347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb7091-f87f-47e7-8705-26c4e0c27aae None admin] PATH_INFO: `/v3/projects/3c773729259f41fda13a8dbc3d1e265c/groups/2ecc5442acbc4f90bcf843c65d427354/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:48.710554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb7091-f87f-47e7-8705-26c4e0c27aae None admin] RBAC: Authorizing `identity:create_grant(project_id=3c773729259f41fda13a8dbc3d1e265c, group_id=2ecc5442acbc4f90bcf843c65d427354, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:48.712223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb7091-f87f-47e7-8705-26c4e0c27aae None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:48.731415 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 217/415] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Mar 26 20:33:48 2022] PUT /identity/v3/projects/3c773729259f41fda13a8dbc3d1e265c/groups/2ecc5442acbc4f90bcf843c65d427354/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:33:49.284442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05d408-3189-4f5b-9b1e-334a97eafa50 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:49.284927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05d408-3189-4f5b-9b1e-334a97eafa50 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:49.284927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05d408-3189-4f5b-9b1e-334a97eafa50 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:49.287003 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 199/416] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:49.293715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92660d-e7ef-496c-a633-a2d8204a8917 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:49.294013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92660d-e7ef-496c-a633-a2d8204a8917 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:49.294298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92660d-e7ef-496c-a633-a2d8204a8917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:49.320549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cb92660d-e7ef-496c-a633-a2d8204a8917 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:49.321744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cb92660d-e7ef-496c-a633-a2d8204a8917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:49.416151 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 218/417] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:49.461954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05d408-3189-4f5b-9b1e-334a97eafa50 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:49.565431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05d408-3189-4f5b-9b1e-334a97eafa50 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:49.598545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe0e7b-05fd-4439-a1c3-c3cf7044af35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:49.599361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe0e7b-05fd-4439-a1c3-c3cf7044af35 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:49.599660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe0e7b-05fd-4439-a1c3-c3cf7044af35 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:49.599937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe0e7b-05fd-4439-a1c3-c3cf7044af35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:49.610662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe0e7b-05fd-4439-a1c3-c3cf7044af35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:49.618447 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-f1fe0e7b-05fd-4439-a1c3-c3cf7044af35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:49.620004 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 200/418] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:49.625580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92660d-e7ef-496c-a633-a2d8204a8917 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:49.723258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92660d-e7ef-496c-a633-a2d8204a8917 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:49.756492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eaf6f-f624-4e5b-aa06-663ebcebd941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:49.757682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eaf6f-f624-4e5b-aa06-663ebcebd941 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:49.757963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eaf6f-f624-4e5b-aa06-663ebcebd941 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:49.758237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eaf6f-f624-4e5b-aa06-663ebcebd941 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:49.758976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eaf6f-f624-4e5b-aa06-663ebcebd941 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:49.759282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eaf6f-f624-4e5b-aa06-663ebcebd941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:49.760685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eaf6f-f624-4e5b-aa06-663ebcebd941 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:49.768966 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 219/419] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:49.775225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe0e7b-05fd-4439-a1c3-c3cf7044af35 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:49.877252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe0e7b-05fd-4439-a1c3-c3cf7044af35 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:49.910893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27b42-e9c6-4a64-ac30-4b6d6ec4e80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:49.911535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27b42-e9c6-4a64-ac30-4b6d6ec4e80a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:49.911823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27b42-e9c6-4a64-ac30-4b6d6ec4e80a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:49.912126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb27b42-e9c6-4a64-ac30-4b6d6ec4e80a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:49.981883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27b42-e9c6-4a64-ac30-4b6d6ec4e80a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:49.983365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb27b42-e9c6-4a64-ac30-4b6d6ec4e80a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:50.121266 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 201/420] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:50.126864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eaf6f-f624-4e5b-aa06-663ebcebd941 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:50.255468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eaf6f-f624-4e5b-aa06-663ebcebd941 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:50.301160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1780b8-cfba-41f9-a8b4-7ed5d2044801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:50.302078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1780b8-cfba-41f9-a8b4-7ed5d2044801 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:50.302374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1780b8-cfba-41f9-a8b4-7ed5d2044801 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:50.302653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1780b8-cfba-41f9-a8b4-7ed5d2044801 None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:50.303935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1780b8-cfba-41f9-a8b4-7ed5d2044801 None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:50.305879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1780b8-cfba-41f9-a8b4-7ed5d2044801 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:50.307854 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 220/421] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:50 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:50.313006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27b42-e9c6-4a64-ac30-4b6d6ec4e80a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:50.443472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb27b42-e9c6-4a64-ac30-4b6d6ec4e80a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:50.478248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a83ce2-9762-449c-84d6-c77a6584ebaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:50.479095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a83ce2-9762-449c-84d6-c77a6584ebaf None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:50.479376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a83ce2-9762-449c-84d6-c77a6584ebaf None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:50.479652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a83ce2-9762-449c-84d6-c77a6584ebaf None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:50.480863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a83ce2-9762-449c-84d6-c77a6584ebaf None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:50.482464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a83ce2-9762-449c-84d6-c77a6584ebaf None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:50.484406 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 202/422] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:50 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:50.489761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1780b8-cfba-41f9-a8b4-7ed5d2044801 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:50.645319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1780b8-cfba-41f9-a8b4-7ed5d2044801 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:50.657667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2e34e-79fe-4aba-b7af-23c214e62efd None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:50.657667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2e34e-79fe-4aba-b7af-23c214e62efd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:50.657667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2e34e-79fe-4aba-b7af-23c214e62efd None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:50.658257 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 203/423] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:50.667579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ef1f1-0d31-4cd1-9023-3a4a2fcb7e13 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:50.668166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ef1f1-0d31-4cd1-9023-3a4a2fcb7e13 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:50.668683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ef1f1-0d31-4cd1-9023-3a4a2fcb7e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:50.686951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3eb5ca-6ccf-48e0-8ee9-9950ee413766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:50.687605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eb5ca-6ccf-48e0-8ee9-9950ee413766 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:50.687889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eb5ca-6ccf-48e0-8ee9-9950ee413766 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:50.688202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3eb5ca-6ccf-48e0-8ee9-9950ee413766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:50.688475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5d2ef1f1-0d31-4cd1-9023-3a4a2fcb7e13 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:50.689029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3eb5ca-6ccf-48e0-8ee9-9950ee413766 None admin] RBAC: Adding query filter params (group.id=406f28705dea4f81a38dfed5be9dd78d, role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=a2d411ec96874463bba5e37d88810748) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:50.689341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3eb5ca-6ccf-48e0-8ee9-9950ee413766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:50.690268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5d2ef1f1-0d31-4cd1-9023-3a4a2fcb7e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:50.690787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3eb5ca-6ccf-48e0-8ee9-9950ee413766 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:50.697059 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 221/424] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:50 2022] GET /identity/v3/role_assignments?group.id=406f28705dea4f81a38dfed5be9dd78d&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 611 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:50.698369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9abb95-abc7-4f32-87fd-724335fa4913 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:50.698658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9abb95-abc7-4f32-87fd-724335fa4913 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:50.699266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9abb95-abc7-4f32-87fd-724335fa4913 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:50.700890 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 222/425] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:50.707964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b6837-9a01-4493-b559-cd43e17a0548 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:50.708273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b6837-9a01-4493-b559-cd43e17a0548 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:50.708535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b6837-9a01-4493-b559-cd43e17a0548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:50.749304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3e6b6837-9a01-4493-b559-cd43e17a0548 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:50.750652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3e6b6837-9a01-4493-b559-cd43e17a0548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:50.789940 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 204/426] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:50.815463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ef1f1-0d31-4cd1-9023-3a4a2fcb7e13 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:50.823583 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 223/427] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Mar 26 20:33:50.861327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b6837-9a01-4493-b559-cd43e17a0548 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:50.940223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ef1f1-0d31-4cd1-9023-3a4a2fcb7e13 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:50.981203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28c84e-e3c7-458e-adb5-7abd8892b2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:50.982114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28c84e-e3c7-458e-adb5-7abd8892b2ed None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:50.982467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28c84e-e3c7-458e-adb5-7abd8892b2ed None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:50.982815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28c84e-e3c7-458e-adb5-7abd8892b2ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:50.997524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28c84e-e3c7-458e-adb5-7abd8892b2ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:51.006386 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-4f28c84e-e3c7-458e-adb5-7abd8892b2ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:51.008069 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 205/428] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:51.019011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28c84e-e3c7-458e-adb5-7abd8892b2ed None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.090952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b6837-9a01-4493-b559-cd43e17a0548 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.131448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a9464-6a80-4cca-bc80-e2bcfe7caec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.132831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9464-6a80-4cca-bc80-e2bcfe7caec5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.133116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9464-6a80-4cca-bc80-e2bcfe7caec5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.133391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9464-6a80-4cca-bc80-e2bcfe7caec5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.134958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28c84e-e3c7-458e-adb5-7abd8892b2ed None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.149312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a9464-6a80-4cca-bc80-e2bcfe7caec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:51.157032 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-1e0a9464-6a80-4cca-bc80-e2bcfe7caec5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 26 20:33:51.158542 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 224/429] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:51.164564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a9464-6a80-4cca-bc80-e2bcfe7caec5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.172089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4c9b-8fa5-4cc7-8024-9ff86e0ce4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.172898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4c9b-8fa5-4cc7-8024-9ff86e0ce4ce None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.173135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4c9b-8fa5-4cc7-8024-9ff86e0ce4ce None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.173411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a4c9b-8fa5-4cc7-8024-9ff86e0ce4ce None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.174156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4c9b-8fa5-4cc7-8024-9ff86e0ce4ce None admin] RBAC: Adding query filter params (name=member) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:51.174464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4c9b-8fa5-4cc7-8024-9ff86e0ce4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:51.175864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a4c9b-8fa5-4cc7-8024-9ff86e0ce4ce None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:51.185065 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 206/430] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:51.190846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4c9b-8fa5-4cc7-8024-9ff86e0ce4ce None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.269639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a9464-6a80-4cca-bc80-e2bcfe7caec5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.291642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a4c9b-8fa5-4cc7-8024-9ff86e0ce4ce None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.303495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29360648-bcfa-4bbd-8c97-5c5cd5c91019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.304758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29360648-bcfa-4bbd-8c97-5c5cd5c91019 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.305044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29360648-bcfa-4bbd-8c97-5c5cd5c91019 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.305325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29360648-bcfa-4bbd-8c97-5c5cd5c91019 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.306069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29360648-bcfa-4bbd-8c97-5c5cd5c91019 None admin] RBAC: Adding query filter params (name=member) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:51.306376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29360648-bcfa-4bbd-8c97-5c5cd5c91019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:51.307760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29360648-bcfa-4bbd-8c97-5c5cd5c91019 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:51.316422 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 225/431] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:51.321929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29360648-bcfa-4bbd-8c97-5c5cd5c91019 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.325486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e5384-b924-4c70-a0a4-c9e7e14de688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.326138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5384-b924-4c70-a0a4-c9e7e14de688 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.326422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5384-b924-4c70-a0a4-c9e7e14de688 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.326701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e5384-b924-4c70-a0a4-c9e7e14de688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.395868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e5384-b924-4c70-a0a4-c9e7e14de688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:51.397369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e5384-b924-4c70-a0a4-c9e7e14de688 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:51.422415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29360648-bcfa-4bbd-8c97-5c5cd5c91019 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.457455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d3dcd-afd5-4ac1-bacd-9bbfe948fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.458042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d3dcd-afd5-4ac1-bacd-9bbfe948fd80 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.458327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d3dcd-afd5-4ac1-bacd-9bbfe948fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.458607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d3dcd-afd5-4ac1-bacd-9bbfe948fd80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.507558 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 207/432] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 26 20:33:51.508918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4ad83-ba77-414f-9dda-87ef6aee1621 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.509208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4ad83-ba77-414f-9dda-87ef6aee1621 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.509483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4ad83-ba77-414f-9dda-87ef6aee1621 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.511213 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 208/433] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:51.517118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4ad83-ba77-414f-9dda-87ef6aee1621 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.536185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d3dcd-afd5-4ac1-bacd-9bbfe948fd80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:51.537640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d3dcd-afd5-4ac1-bacd-9bbfe948fd80 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:51.618491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4ad83-ba77-414f-9dda-87ef6aee1621 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.637340 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 226/434] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:51.637340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf3fd0-e321-4c2d-9709-7cc2c8eeac4b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.637340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf3fd0-e321-4c2d-9709-7cc2c8eeac4b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.637340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf3fd0-e321-4c2d-9709-7cc2c8eeac4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.651244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8bcf3fd0-e321-4c2d-9709-7cc2c8eeac4b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:51.652435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8bcf3fd0-e321-4c2d-9709-7cc2c8eeac4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:51.656554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e89fab-7ed2-4757-a171-54aca4b4c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.657405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e89fab-7ed2-4757-a171-54aca4b4c06c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.657693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e89fab-7ed2-4757-a171-54aca4b4c06c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.657967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e89fab-7ed2-4757-a171-54aca4b4c06c None admin] PATH_INFO: `/v3/projects/a2d411ec96874463bba5e37d88810748` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.659141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e89fab-7ed2-4757-a171-54aca4b4c06c None admin] RBAC: Authorizing `identity:get_project(project_id=a2d411ec96874463bba5e37d88810748)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:51.660644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e89fab-7ed2-4757-a171-54aca4b4c06c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:51.667682 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 209/435] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/projects/a2d411ec96874463bba5e37d88810748 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:51.667682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e89fab-7ed2-4757-a171-54aca4b4c06c None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.732023 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 227/436] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:51.732023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf3fd0-e321-4c2d-9709-7cc2c8eeac4b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.775617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e89fab-7ed2-4757-a171-54aca4b4c06c None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.809058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5552297-fb3f-42cc-a4ac-6794ad7cbde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.809921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5552297-fb3f-42cc-a4ac-6794ad7cbde2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.810202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5552297-fb3f-42cc-a4ac-6794ad7cbde2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.810475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5552297-fb3f-42cc-a4ac-6794ad7cbde2 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.811658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5552297-fb3f-42cc-a4ac-6794ad7cbde2 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:51.813153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5552297-fb3f-42cc-a4ac-6794ad7cbde2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:51.819036 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 210/437] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:51.819036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5552297-fb3f-42cc-a4ac-6794ad7cbde2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.819223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf3fd0-e321-4c2d-9709-7cc2c8eeac4b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.849895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c576-977d-48a6-896e-83d1f802cbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.850766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c576-977d-48a6-896e-83d1f802cbf1 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.851037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c576-977d-48a6-896e-83d1f802cbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.851303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c576-977d-48a6-896e-83d1f802cbf1 None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.852488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c576-977d-48a6-896e-83d1f802cbf1 None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:51.853917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c576-977d-48a6-896e-83d1f802cbf1 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:51.855488 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 228/438] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:51.856244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c576-977d-48a6-896e-83d1f802cbf1 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.914110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5552297-fb3f-42cc-a4ac-6794ad7cbde2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.946462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2e9bd-3e00-4173-9187-df403ad06063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.947258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2e9bd-3e00-4173-9187-df403ad06063 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.947413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c576-977d-48a6-896e-83d1f802cbf1 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:51.947544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2e9bd-3e00-4173-9187-df403ad06063 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.947818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2e9bd-3e00-4173-9187-df403ad06063 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.957842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2e9bd-3e00-4173-9187-df403ad06063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:51.965830 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b2a2e9bd-3e00-4173-9187-df403ad06063 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:51.967041 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 211/439] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:51.968231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d2f6-a21a-4a33-996e-a7495ee6841b None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.968551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d2f6-a21a-4a33-996e-a7495ee6841b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.968867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d2f6-a21a-4a33-996e-a7495ee6841b None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.970529 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 212/440] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:51.971484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d2f6-a21a-4a33-996e-a7495ee6841b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:51.983555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0965f-cc5e-4114-9ddf-a1beef1397a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:51.984349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0965f-cc5e-4114-9ddf-a1beef1397a9 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:51.984625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0965f-cc5e-4114-9ddf-a1beef1397a9 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:51.984899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0965f-cc5e-4114-9ddf-a1beef1397a9 None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:51.986051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0965f-cc5e-4114-9ddf-a1beef1397a9 None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:51.987522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0965f-cc5e-4114-9ddf-a1beef1397a9 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:51.989273 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 229/441] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:51.989931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0965f-cc5e-4114-9ddf-a1beef1397a9 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:52.072079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d2f6-a21a-4a33-996e-a7495ee6841b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:52.084128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0965f-cc5e-4114-9ddf-a1beef1397a9 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:52.103980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7ac1a-233d-4fc5-8672-eaf93514e96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:52.104633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ac1a-233d-4fc5-8672-eaf93514e96c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.104916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ac1a-233d-4fc5-8672-eaf93514e96c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.105191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7ac1a-233d-4fc5-8672-eaf93514e96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.106006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ac1a-233d-4fc5-8672-eaf93514e96c None admin] RBAC: Adding query filter params (group.id=406f28705dea4f81a38dfed5be9dd78d, role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=a2d411ec96874463bba5e37d88810748) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:52.106318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ac1a-233d-4fc5-8672-eaf93514e96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:52.107764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7ac1a-233d-4fc5-8672-eaf93514e96c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:52.113279 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 213/442] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/role_assignments?group.id=406f28705dea4f81a38dfed5be9dd78d&scope.project.id=a2d411ec96874463bba5e37d88810748&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:52.114417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3964d-ec56-4003-9f5b-a65f6c0489a5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.114706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3964d-ec56-4003-9f5b-a65f6c0489a5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.114986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3964d-ec56-4003-9f5b-a65f6c0489a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.122663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52173b7a-b8da-48c7-b08e-e589e5b2b680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:52.123357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173b7a-b8da-48c7-b08e-e589e5b2b680 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.123646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173b7a-b8da-48c7-b08e-e589e5b2b680 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.123956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52173b7a-b8da-48c7-b08e-e589e5b2b680 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.124718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52173b7a-b8da-48c7-b08e-e589e5b2b680 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:52.125028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52173b7a-b8da-48c7-b08e-e589e5b2b680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:52.126457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52173b7a-b8da-48c7-b08e-e589e5b2b680 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:52.136266 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 230/443] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:52.137382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52173b7a-b8da-48c7-b08e-e589e5b2b680 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:52.145792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e6a3964d-ec56-4003-9f5b-a65f6c0489a5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:52.147014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e6a3964d-ec56-4003-9f5b-a65f6c0489a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:52.219800 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 214/444] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:52.220716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3964d-ec56-4003-9f5b-a65f6c0489a5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:52.257775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52173b7a-b8da-48c7-b08e-e589e5b2b680 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:52.293089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd9c1-9837-4d7e-85fb-4fd603f53188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:52.293774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd9c1-9837-4d7e-85fb-4fd603f53188 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.294064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd9c1-9837-4d7e-85fb-4fd603f53188 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.294482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadd9c1-9837-4d7e-85fb-4fd603f53188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.295486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadd9c1-9837-4d7e-85fb-4fd603f53188 None admin] RBAC: Adding query filter params (group.id=406f28705dea4f81a38dfed5be9dd78d, role.id=c7e02bca0ee343c0a8cb78d837b5ad30, scope.project.id=c562afec45df41a7843efc9f64c6e8ed) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:52.295663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadd9c1-9837-4d7e-85fb-4fd603f53188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:52.297100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadd9c1-9837-4d7e-85fb-4fd603f53188 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:52.303143 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 231/445] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:52 2022] GET /identity/v3/role_assignments?group.id=406f28705dea4f81a38dfed5be9dd78d&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=c7e02bca0ee343c0a8cb78d837b5ad30 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:52.304629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd9c1-9837-4d7e-85fb-4fd603f53188 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:52.345667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3964d-ec56-4003-9f5b-a65f6c0489a5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:52.385397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40b796-fe6c-4250-9243-62eb663e4fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:52.386406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40b796-fe6c-4250-9243-62eb663e4fe9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.386839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40b796-fe6c-4250-9243-62eb663e4fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.387262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40b796-fe6c-4250-9243-62eb663e4fe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.424034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadd9c1-9837-4d7e-85fb-4fd603f53188 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:52.466712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40b796-fe6c-4250-9243-62eb663e4fe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:52.473110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40b796-fe6c-4250-9243-62eb663e4fe9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:52.474541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378536-ed09-41e9-a9c0-c3b919bf63f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:52.475345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378536-ed09-41e9-a9c0-c3b919bf63f5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.475677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378536-ed09-41e9-a9c0-c3b919bf63f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.476042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5378536-ed09-41e9-a9c0-c3b919bf63f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.496412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5378536-ed09-41e9-a9c0-c3b919bf63f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:52.504038 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f5378536-ed09-41e9-a9c0-c3b919bf63f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:33:52.505366 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 232/446] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:52.512029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378536-ed09-41e9-a9c0-c3b919bf63f5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:52.599517 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 215/447] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:33:52.605633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40b796-fe6c-4250-9243-62eb663e4fe9 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:52.631472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5378536-ed09-41e9-a9c0-c3b919bf63f5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:52.667166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8adcd-fd96-45c0-a060-6382fd592124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:52.667839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8adcd-fd96-45c0-a060-6382fd592124 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.668159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8adcd-fd96-45c0-a060-6382fd592124 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.668436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8adcd-fd96-45c0-a060-6382fd592124 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.669184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8adcd-fd96-45c0-a060-6382fd592124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:52.669494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8adcd-fd96-45c0-a060-6382fd592124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:52.670879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8adcd-fd96-45c0-a060-6382fd592124 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:52.680315 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 233/448] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:52.685791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8adcd-fd96-45c0-a060-6382fd592124 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:52.711976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40b796-fe6c-4250-9243-62eb663e4fe9 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:52.751639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34a43f-1936-4813-90a3-fe9ed1f681d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:52.752557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34a43f-1936-4813-90a3-fe9ed1f681d5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.752886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34a43f-1936-4813-90a3-fe9ed1f681d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.753111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34a43f-1936-4813-90a3-fe9ed1f681d5 None admin] PATH_INFO: `/v3/projects/c562afec45df41a7843efc9f64c6e8ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.754321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34a43f-1936-4813-90a3-fe9ed1f681d5 None admin] RBAC: Authorizing `identity:get_project(project_id=c562afec45df41a7843efc9f64c6e8ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:52.755820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34a43f-1936-4813-90a3-fe9ed1f681d5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:52.758845 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 216/449] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:52 2022] GET /identity/v3/projects/c562afec45df41a7843efc9f64c6e8ed => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:52.763388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34a43f-1936-4813-90a3-fe9ed1f681d5 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:52.785529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8adcd-fd96-45c0-a060-6382fd592124 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:52.820205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06797acd-73c2-4321-b76c-ecbc0085276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:52.820844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06797acd-73c2-4321-b76c-ecbc0085276e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.821129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06797acd-73c2-4321-b76c-ecbc0085276e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.821407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06797acd-73c2-4321-b76c-ecbc0085276e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.870680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34a43f-1936-4813-90a3-fe9ed1f681d5 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:52.890528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06797acd-73c2-4321-b76c-ecbc0085276e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:52.892018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06797acd-73c2-4321-b76c-ecbc0085276e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:52.904897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef0273-e7f2-42f8-9be8-f600c7523f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:52.905750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef0273-e7f2-42f8-9be8-f600c7523f54 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:52.906035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef0273-e7f2-42f8-9be8-f600c7523f54 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:52.906318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef0273-e7f2-42f8-9be8-f600c7523f54 None admin] PATH_INFO: `/v3/groups/406f28705dea4f81a38dfed5be9dd78d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:52.907493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef0273-e7f2-42f8-9be8-f600c7523f54 None admin] RBAC: Authorizing `identity:get_group(group_id=406f28705dea4f81a38dfed5be9dd78d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:52.909009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef0273-e7f2-42f8-9be8-f600c7523f54 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:52.910816 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 217/450] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:52 2022] GET /identity/v3/groups/406f28705dea4f81a38dfed5be9dd78d => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:52.916774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef0273-e7f2-42f8-9be8-f600c7523f54 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:52.986231 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 234/451] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:33:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 26 20:33:52.991738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06797acd-73c2-4321-b76c-ecbc0085276e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:53.010086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef0273-e7f2-42f8-9be8-f600c7523f54 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:53.043174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5262e-ca0b-4358-84bc-2c21c3db3ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:53.043824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5262e-ca0b-4358-84bc-2c21c3db3ee8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:53.044149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5262e-ca0b-4358-84bc-2c21c3db3ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:53.044437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5262e-ca0b-4358-84bc-2c21c3db3ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:53.045262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5262e-ca0b-4358-84bc-2c21c3db3ee8 None admin] RBAC: Adding query filter params (group.id=406f28705dea4f81a38dfed5be9dd78d, role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=c562afec45df41a7843efc9f64c6e8ed) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:53.045570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5262e-ca0b-4358-84bc-2c21c3db3ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:53.047027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5262e-ca0b-4358-84bc-2c21c3db3ee8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:53.052730 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 218/452] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:52 2022] GET /identity/v3/role_assignments?group.id=406f28705dea4f81a38dfed5be9dd78d&scope.project.id=c562afec45df41a7843efc9f64c6e8ed&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:53.087592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06797acd-73c2-4321-b76c-ecbc0085276e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:53.122823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2964cc3-9882-4a80-8a3d-22e46c707c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:53.123681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2964cc3-9882-4a80-8a3d-22e46c707c2f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:53.123991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2964cc3-9882-4a80-8a3d-22e46c707c2f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:53.124269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2964cc3-9882-4a80-8a3d-22e46c707c2f None admin] PATH_INFO: `/v3/projects/3c773729259f41fda13a8dbc3d1e265c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:53.125476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2964cc3-9882-4a80-8a3d-22e46c707c2f None admin] RBAC: Authorizing `identity:get_project(project_id=3c773729259f41fda13a8dbc3d1e265c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:53.126974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2964cc3-9882-4a80-8a3d-22e46c707c2f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:53.128761 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 235/453] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:33:52 2022] GET /identity/v3/projects/3c773729259f41fda13a8dbc3d1e265c => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:33:53.134380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5262e-ca0b-4358-84bc-2c21c3db3ee8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:53.234547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5262e-ca0b-4358-84bc-2c21c3db3ee8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:53.266335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cc08d-c4f0-4004-a6af-825a6088e389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:53.267178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cc08d-c4f0-4004-a6af-825a6088e389 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:53.267481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cc08d-c4f0-4004-a6af-825a6088e389 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:53.267753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cc08d-c4f0-4004-a6af-825a6088e389 None admin] PATH_INFO: `/v3/groups/2ecc5442acbc4f90bcf843c65d427354` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:53.269015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cc08d-c4f0-4004-a6af-825a6088e389 None admin] RBAC: Authorizing `identity:get_group(group_id=2ecc5442acbc4f90bcf843c65d427354)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:53.270466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696cc08d-c4f0-4004-a6af-825a6088e389 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:53.272134 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 219/454] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Mar 26 20:33:53 2022] GET /identity/v3/groups/2ecc5442acbc4f90bcf843c65d427354 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:53.278496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2964cc3-9882-4a80-8a3d-22e46c707c2f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:53.372595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2964cc3-9882-4a80-8a3d-22e46c707c2f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:53.405805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0569228-2170-4078-ba24-13c1691207ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:53.406454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0569228-2170-4078-ba24-13c1691207ba None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:53.406737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0569228-2170-4078-ba24-13c1691207ba None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:53.407015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0569228-2170-4078-ba24-13c1691207ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:53.407833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0569228-2170-4078-ba24-13c1691207ba None admin] RBAC: Adding query filter params (group.id=2ecc5442acbc4f90bcf843c65d427354, role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=3c773729259f41fda13a8dbc3d1e265c) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:53.408176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0569228-2170-4078-ba24-13c1691207ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:53.409619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0569228-2170-4078-ba24-13c1691207ba None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:53.415667 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 236/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Mar 26 20:33:53 2022] GET /identity/v3/role_assignments?group.id=2ecc5442acbc4f90bcf843c65d427354&scope.project.id=3c773729259f41fda13a8dbc3d1e265c&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:56.333678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de304bd-af01-4dc8-ab99-2cec223a1887 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:56.334190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de304bd-af01-4dc8-ab99-2cec223a1887 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:56.334190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de304bd-af01-4dc8-ab99-2cec223a1887 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:56.336204 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 220/456] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:56.343126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66832-1e84-4164-98b9-e94fbece1456 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:56.343556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66832-1e84-4164-98b9-e94fbece1456 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:56.343752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad66832-1e84-4164-98b9-e94fbece1456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:56.368909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dad66832-1e84-4164-98b9-e94fbece1456 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:56.370086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dad66832-1e84-4164-98b9-e94fbece1456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:56.459283 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 237/457] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:33:56.501482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de304bd-af01-4dc8-ab99-2cec223a1887 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:56.610122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965454-5f35-400d-8376-f387b39d87a8 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:56.610308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965454-5f35-400d-8376-f387b39d87a8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:56.610589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5965454-5f35-400d-8376-f387b39d87a8 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:56.612604 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 238/458] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:56.633380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de304bd-af01-4dc8-ab99-2cec223a1887 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:56.634087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac680cca-4eea-44e6-8f5f-bd7aeb324962 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:56.634572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac680cca-4eea-44e6-8f5f-bd7aeb324962 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:56.635032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac680cca-4eea-44e6-8f5f-bd7aeb324962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:56.656780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ac680cca-4eea-44e6-8f5f-bd7aeb324962 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:56.658181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ac680cca-4eea-44e6-8f5f-bd7aeb324962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:56.679644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88753b-0d49-4f3e-870d-f6361bff2cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:56.680410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88753b-0d49-4f3e-870d-f6361bff2cad None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:56.680697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88753b-0d49-4f3e-870d-f6361bff2cad None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:56.680977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88753b-0d49-4f3e-870d-f6361bff2cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:56.694088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88753b-0d49-4f3e-870d-f6361bff2cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:56.695585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88753b-0d49-4f3e-870d-f6361bff2cad None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:56.730962 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-1c88753b-0d49-4f3e-870d-f6361bff2cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:33:56.731231 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 239/459] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:56.732450 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 221/460] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:56.737977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac680cca-4eea-44e6-8f5f-bd7aeb324962 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:56.787529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88753b-0d49-4f3e-870d-f6361bff2cad None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:56.846951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac680cca-4eea-44e6-8f5f-bd7aeb324962 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:56.880359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ab64e-a52a-42a8-b50e-5db507a1be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:56.881233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ab64e-a52a-42a8-b50e-5db507a1be51 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:56.882301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ab64e-a52a-42a8-b50e-5db507a1be51 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:56.882721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ab64e-a52a-42a8-b50e-5db507a1be51 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:56.883594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ab64e-a52a-42a8-b50e-5db507a1be51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:56.884060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ab64e-a52a-42a8-b50e-5db507a1be51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:56.885582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ab64e-a52a-42a8-b50e-5db507a1be51 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:56.898917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88753b-0d49-4f3e-870d-f6361bff2cad None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:56.901514 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 240/461] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:56.903074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810751e-dcfe-49b9-bdce-3f70f7f5af9e None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:56.903503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810751e-dcfe-49b9-bdce-3f70f7f5af9e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:56.903935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810751e-dcfe-49b9-bdce-3f70f7f5af9e None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:56.906113 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 241/462] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:56.906936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810751e-dcfe-49b9-bdce-3f70f7f5af9e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:56.934696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23e757-164f-41f9-80ca-2f7e29272b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:56.935486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23e757-164f-41f9-80ca-2f7e29272b49 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:56.935769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23e757-164f-41f9-80ca-2f7e29272b49 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:56.936080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23e757-164f-41f9-80ca-2f7e29272b49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:56.948974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23e757-164f-41f9-80ca-2f7e29272b49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:56.950666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23e757-164f-41f9-80ca-2f7e29272b49 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:56.967367 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-db23e757-164f-41f9-80ca-2f7e29272b49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:33:56.968723 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 222/463] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:56.969934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38478d3-99d0-4bf9-8c3c-0450431cadff None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:56.970220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38478d3-99d0-4bf9-8c3c-0450431cadff None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:56.970494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38478d3-99d0-4bf9-8c3c-0450431cadff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:56.986738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c38478d3-99d0-4bf9-8c3c-0450431cadff None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:56.987888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c38478d3-99d0-4bf9-8c3c-0450431cadff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:57.020148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810751e-dcfe-49b9-bdce-3f70f7f5af9e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:57.053010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189c3c9-217e-4030-93ad-9bd631baf014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:57.054210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189c3c9-217e-4030-93ad-9bd631baf014 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.054491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189c3c9-217e-4030-93ad-9bd631baf014 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.054770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189c3c9-217e-4030-93ad-9bd631baf014 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.055458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189c3c9-217e-4030-93ad-9bd631baf014 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:57.064214 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 223/464] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:57.064366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189c3c9-217e-4030-93ad-9bd631baf014 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:57.064443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd74c-82ba-40ad-a94f-209146a0b9dc None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.064443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd74c-82ba-40ad-a94f-209146a0b9dc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.064443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dd74c-82ba-40ad-a94f-209146a0b9dc None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.064443 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 224/465] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:57.064443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd74c-82ba-40ad-a94f-209146a0b9dc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:57.086297 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 242/466] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:56 2022] POST /identity/v3/users => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:57.087953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5f095-f161-49df-8e72-c4ae45bf5125 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.088407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5f095-f161-49df-8e72-c4ae45bf5125 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.088826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5f095-f161-49df-8e72-c4ae45bf5125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.107134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-08c5f095-f161-49df-8e72-c4ae45bf5125 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:57.108668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-08c5f095-f161-49df-8e72-c4ae45bf5125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:57.185897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 243/467] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:57.187168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5f095-f161-49df-8e72-c4ae45bf5125 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:57.218514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dd74c-82ba-40ad-a94f-209146a0b9dc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:57.258508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc452a7-5a8f-4d46-877e-4708b70ea350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:57.259708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc452a7-5a8f-4d46-877e-4708b70ea350 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.260395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc452a7-5a8f-4d46-877e-4708b70ea350 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.261064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc452a7-5a8f-4d46-877e-4708b70ea350 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.262071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc452a7-5a8f-4d46-877e-4708b70ea350 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:57.262559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc452a7-5a8f-4d46-877e-4708b70ea350 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:57.264176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc452a7-5a8f-4d46-877e-4708b70ea350 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:57.282581 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 225/468] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:57.284034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc452a7-5a8f-4d46-877e-4708b70ea350 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:57.323725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5f095-f161-49df-8e72-c4ae45bf5125 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:57.366365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c84175-42d2-41b3-b6ef-5b56f9079e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:57.368061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c84175-42d2-41b3-b6ef-5b56f9079e82 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.368575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c84175-42d2-41b3-b6ef-5b56f9079e82 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.368860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c84175-42d2-41b3-b6ef-5b56f9079e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.380154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c84175-42d2-41b3-b6ef-5b56f9079e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:57.382176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c84175-42d2-41b3-b6ef-5b56f9079e82 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:57.400321 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-59c84175-42d2-41b3-b6ef-5b56f9079e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:33:57.401836 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 244/469] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:57.402649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c84175-42d2-41b3-b6ef-5b56f9079e82 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:57.405900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc452a7-5a8f-4d46-877e-4708b70ea350 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:57.440455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf97c09-c353-4a04-b6d7-de33997ced6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:57.441160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf97c09-c353-4a04-b6d7-de33997ced6e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.441439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf97c09-c353-4a04-b6d7-de33997ced6e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.441710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf97c09-c353-4a04-b6d7-de33997ced6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.452477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf97c09-c353-4a04-b6d7-de33997ced6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:57.453962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf97c09-c353-4a04-b6d7-de33997ced6e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:57.471185 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-3bf97c09-c353-4a04-b6d7-de33997ced6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:33:57.472551 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 226/470] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:33:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:57.473240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf97c09-c353-4a04-b6d7-de33997ced6e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:57.507937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c84175-42d2-41b3-b6ef-5b56f9079e82 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:57.543090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21250f8a-82e4-41ac-84cd-2c1af6ddb133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:57.543759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21250f8a-82e4-41ac-84cd-2c1af6ddb133 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.544080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21250f8a-82e4-41ac-84cd-2c1af6ddb133 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.544363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21250f8a-82e4-41ac-84cd-2c1af6ddb133 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.545056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21250f8a-82e4-41ac-84cd-2c1af6ddb133 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:57.546505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21250f8a-82e4-41ac-84cd-2c1af6ddb133 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:57.572006 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 245/471] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:57 2022] POST /identity/v3/users => generated 248 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:57.572935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21250f8a-82e4-41ac-84cd-2c1af6ddb133 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:57.580354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf97c09-c353-4a04-b6d7-de33997ced6e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:57.657099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fca6e-7ac5-4f33-ba1c-e1d7c7d9a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:57.657773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fca6e-7ac5-4f33-ba1c-e1d7c7d9a311 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.658054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fca6e-7ac5-4f33-ba1c-e1d7c7d9a311 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.658326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fca6e-7ac5-4f33-ba1c-e1d7c7d9a311 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.659054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fca6e-7ac5-4f33-ba1c-e1d7c7d9a311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:57.659358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fca6e-7ac5-4f33-ba1c-e1d7c7d9a311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:57.660838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fca6e-7ac5-4f33-ba1c-e1d7c7d9a311 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:57.688599 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 227/472] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:57.693559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fca6e-7ac5-4f33-ba1c-e1d7c7d9a311 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:57.754954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21250f8a-82e4-41ac-84cd-2c1af6ddb133 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:57.796251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa233c-07ce-447a-b54d-c119790e4753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:57.797283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa233c-07ce-447a-b54d-c119790e4753 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.797849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa233c-07ce-447a-b54d-c119790e4753 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.798129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa233c-07ce-447a-b54d-c119790e4753 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.798850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa233c-07ce-447a-b54d-c119790e4753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:57.799154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa233c-07ce-447a-b54d-c119790e4753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:57.800626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa233c-07ce-447a-b54d-c119790e4753 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:57.804768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fca6e-7ac5-4f33-ba1c-e1d7c7d9a311 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:57.815420 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 246/473] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:33:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:57.817403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a49eb-b360-4734-86fd-ca59cafdf498 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.817904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a49eb-b360-4734-86fd-ca59cafdf498 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.818672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a49eb-b360-4734-86fd-ca59cafdf498 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.820760 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 247/474] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:57.822402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a49eb-b360-4734-86fd-ca59cafdf498 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:57.848427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16b9cd0-72cb-4d7a-9999-e2868c225569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:57.849450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b9cd0-72cb-4d7a-9999-e2868c225569 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.849979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b9cd0-72cb-4d7a-9999-e2868c225569 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.850968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16b9cd0-72cb-4d7a-9999-e2868c225569 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.851863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b9cd0-72cb-4d7a-9999-e2868c225569 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:57.853572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16b9cd0-72cb-4d7a-9999-e2868c225569 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:57.877491 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 228/475] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:57 2022] POST /identity/v3/users => generated 249 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:57.879602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b129c-7ad5-4111-b854-2477e35432f1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.879896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b129c-7ad5-4111-b854-2477e35432f1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.880189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b129c-7ad5-4111-b854-2477e35432f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.898949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-de2b129c-7ad5-4111-b854-2477e35432f1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:57.900371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-de2b129c-7ad5-4111-b854-2477e35432f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:57.952952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a49eb-b360-4734-86fd-ca59cafdf498 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:57.993377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da3db3-d917-43b2-8bb1-bb49f60fb1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:57.994392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da3db3-d917-43b2-8bb1-bb49f60fb1d8 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:57.994884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da3db3-d917-43b2-8bb1-bb49f60fb1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:57.995339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64da3db3-d917-43b2-8bb1-bb49f60fb1d8 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:57.996350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da3db3-d917-43b2-8bb1-bb49f60fb1d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:57.998036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64da3db3-d917-43b2-8bb1-bb49f60fb1d8 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:58.002193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 229/476] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:58.029645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b129c-7ad5-4111-b854-2477e35432f1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:58.044792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 248/477] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:33:57 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:33:58.162902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b129c-7ad5-4111-b854-2477e35432f1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:58.208819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:58.209434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:58.209775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:58.210052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:58.210823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:58.212353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:58.225666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.sql.core [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 26 20:33:58.225666 ncdv-master-1 devstack@keystone.service[97203]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 26 20:33:58.225666 ncdv-master-1 devstack@keystone.service[97203]: [parameters: {'id': '5da8187bdc6b4c91bc8752fc66fe1bd8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 26 20:33:58.225666 ncdv-master-1 devstack@keystone.service[97203]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97203) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 26 20:33:58.241740 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 26 20:33:58.243510 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 230/478] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Mar 26 20:33:58 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:33:58.250445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da3db3-d917-43b2-8bb1-bb49f60fb1d8 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:58.376605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64da3db3-d917-43b2-8bb1-bb49f60fb1d8 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:58.421323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea83caa-d6f5-4f92-8b75-4409a0dc00ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:58.422137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83caa-d6f5-4f92-8b75-4409a0dc00ae None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:58.422423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83caa-d6f5-4f92-8b75-4409a0dc00ae None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:58.422700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea83caa-d6f5-4f92-8b75-4409a0dc00ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:58.433845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea83caa-d6f5-4f92-8b75-4409a0dc00ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:33:58.441120 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-bea83caa-d6f5-4f92-8b75-4409a0dc00ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 26 20:33:58.443658 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 249/479] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:33:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:33:58.449682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:33:58.561298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13236ec1-f75b-4e66-818c-0e572bd52dd6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:33:58.598445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d4d477-7c4a-4149-9ecf-d5f68e2f718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:33:58.599119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4d477-7c4a-4149-9ecf-d5f68e2f718c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:58.599406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4d477-7c4a-4149-9ecf-d5f68e2f718c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:58.599685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d4d477-7c4a-4149-9ecf-d5f68e2f718c None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:58.600499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4d477-7c4a-4149-9ecf-d5f68e2f718c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:33:58.600807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4d477-7c4a-4149-9ecf-d5f68e2f718c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:33:58.602217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d4d477-7c4a-4149-9ecf-d5f68e2f718c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:33:58.611770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 231/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:33:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:33:59.781393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aab63-d826-49e1-8428-dc03930d29b5 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:59.781914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aab63-d826-49e1-8428-dc03930d29b5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:59.781914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aab63-d826-49e1-8428-dc03930d29b5 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:59.783944 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 250/481] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:33:59.791225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1623e5-2e6e-44d9-975f-16b61ee1106d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:33:59.791656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1623e5-2e6e-44d9-975f-16b61ee1106d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:33:59.791759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1623e5-2e6e-44d9-975f-16b61ee1106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:33:59.816826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2e1623e5-2e6e-44d9-975f-16b61ee1106d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:33:59.817997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e1623e5-2e6e-44d9-975f-16b61ee1106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:33:59.907966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 232/482] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:33:59.949322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aab63-d826-49e1-8428-dc03930d29b5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:00.094340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aab63-d826-49e1-8428-dc03930d29b5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:00.141536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e324e-5d99-49c3-8d0d-e9bd21f7a390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:00.142331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e324e-5d99-49c3-8d0d-e9bd21f7a390 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:00.142606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e324e-5d99-49c3-8d0d-e9bd21f7a390 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:00.142875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e324e-5d99-49c3-8d0d-e9bd21f7a390 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:00.157867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e324e-5d99-49c3-8d0d-e9bd21f7a390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:00.164799 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-a39e324e-5d99-49c3-8d0d-e9bd21f7a390 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:00.166007 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 251/483] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:00.171911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1623e5-2e6e-44d9-975f-16b61ee1106d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:00.283474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1623e5-2e6e-44d9-975f-16b61ee1106d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:00.318214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c93848-d119-4c38-ba38-c19072f21661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:00.318902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93848-d119-4c38-ba38-c19072f21661 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:00.319180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93848-d119-4c38-ba38-c19072f21661 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:00.319450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c93848-d119-4c38-ba38-c19072f21661 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:00.320220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c93848-d119-4c38-ba38-c19072f21661 None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:00.320522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c93848-d119-4c38-ba38-c19072f21661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:00.321917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c93848-d119-4c38-ba38-c19072f21661 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:00.334577 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 233/484] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:00.335895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e324e-5d99-49c3-8d0d-e9bd21f7a390 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:00.437670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e324e-5d99-49c3-8d0d-e9bd21f7a390 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:00.484454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18182359-d8cc-402e-a0f7-a6540b7cd7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:00.485243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18182359-d8cc-402e-a0f7-a6540b7cd7e3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:00.485522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18182359-d8cc-402e-a0f7-a6540b7cd7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:00.485795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18182359-d8cc-402e-a0f7-a6540b7cd7e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:00.504960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18182359-d8cc-402e-a0f7-a6540b7cd7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:00.506451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18182359-d8cc-402e-a0f7-a6540b7cd7e3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:00.526477 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-18182359-d8cc-402e-a0f7-a6540b7cd7e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:00.532214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 252/485] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:00.534025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c93848-d119-4c38-ba38-c19072f21661 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:00.637624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c93848-d119-4c38-ba38-c19072f21661 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:00.673373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a312f-1b45-4649-83e9-caaed04fc82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:00.674030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a312f-1b45-4649-83e9-caaed04fc82f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:00.674310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a312f-1b45-4649-83e9-caaed04fc82f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:00.674584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a312f-1b45-4649-83e9-caaed04fc82f None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:00.675295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a312f-1b45-4649-83e9-caaed04fc82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:00.675597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a312f-1b45-4649-83e9-caaed04fc82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:00.677021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a312f-1b45-4649-83e9-caaed04fc82f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:00.693283 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 234/486] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:00.694590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18182359-d8cc-402e-a0f7-a6540b7cd7e3 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:00.817558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18182359-d8cc-402e-a0f7-a6540b7cd7e3 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:00.832239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cdd99-cefc-409b-a3aa-a7e660b21880 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:00.833144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cdd99-cefc-409b-a3aa-a7e660b21880 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:00.833621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729cdd99-cefc-409b-a3aa-a7e660b21880 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:00.836535 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 235/487] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:00.843142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e7aed-d1e2-4d4a-9526-5081891208b7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:00.843677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e7aed-d1e2-4d4a-9526-5081891208b7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:00.844202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e7aed-d1e2-4d4a-9526-5081891208b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:00.859285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b1a0a-c520-493f-bdef-d79c9b1ccdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:00.860093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1a0a-c520-493f-bdef-d79c9b1ccdfa None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:00.860379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1a0a-c520-493f-bdef-d79c9b1ccdfa None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:00.860659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b1a0a-c520-493f-bdef-d79c9b1ccdfa None admin] PATH_INFO: `/v3/users/nova` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:00.862151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b54e7aed-d1e2-4d4a-9526-5081891208b7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:00.863528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b54e7aed-d1e2-4d4a-9526-5081891208b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:00.871280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b1a0a-c520-493f-bdef-d79c9b1ccdfa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:00.872550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b1a0a-c520-493f-bdef-d79c9b1ccdfa None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:00.901980 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f18b1a0a-c520-493f-bdef-d79c9b1ccdfa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 26 20:34:00.903512 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 253/488] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Mar 26 20:34:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:00.908889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b1a0a-c520-493f-bdef-d79c9b1ccdfa None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:00.933904 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 236/489] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:34:00.961892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e7aed-d1e2-4d4a-9526-5081891208b7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.044485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b1a0a-c520-493f-bdef-d79c9b1ccdfa None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:01.082019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f15b60-74b7-4456-9ccf-1a8490eeb1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:01.082701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f15b60-74b7-4456-9ccf-1a8490eeb1c3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.082970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f15b60-74b7-4456-9ccf-1a8490eeb1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.083241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f15b60-74b7-4456-9ccf-1a8490eeb1c3 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.084098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f15b60-74b7-4456-9ccf-1a8490eeb1c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:01.084440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f15b60-74b7-4456-9ccf-1a8490eeb1c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:01.086410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f15b60-74b7-4456-9ccf-1a8490eeb1c3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:01.156110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 254/490] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Mar 26 20:34:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:01.158198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a71845-5043-4c9f-ad3b-faa455a1ae18 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.159013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a71845-5043-4c9f-ad3b-faa455a1ae18 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.159769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a71845-5043-4c9f-ad3b-faa455a1ae18 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.161628 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 255/491] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:01.162916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f738dc-6d35-445f-8a56-92b8ec98d452 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.163201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f738dc-6d35-445f-8a56-92b8ec98d452 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.163480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f738dc-6d35-445f-8a56-92b8ec98d452 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.165095 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 256/492] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:01.165799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f738dc-6d35-445f-8a56-92b8ec98d452 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.166726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e7aed-d1e2-4d4a-9526-5081891208b7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:01.201355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b332a8-ce17-4f01-bb8e-2854331e35b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:01.202137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b332a8-ce17-4f01-bb8e-2854331e35b8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.202418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b332a8-ce17-4f01-bb8e-2854331e35b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.202695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b332a8-ce17-4f01-bb8e-2854331e35b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.212866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b332a8-ce17-4f01-bb8e-2854331e35b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:01.219817 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-37b332a8-ce17-4f01-bb8e-2854331e35b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:01.221673 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 237/493] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:01.223172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23178125-e333-4aaf-8462-aba1442fc63a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.223296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23178125-e333-4aaf-8462-aba1442fc63a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.223522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23178125-e333-4aaf-8462-aba1442fc63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.240186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-23178125-e333-4aaf-8462-aba1442fc63a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:01.241892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-23178125-e333-4aaf-8462-aba1442fc63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:01.272293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f738dc-6d35-445f-8a56-92b8ec98d452 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:01.307692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7a2c7-ff9d-4af0-ba6a-eceec2f3b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:01.308362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a2c7-ff9d-4af0-ba6a-eceec2f3b287 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.308642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a2c7-ff9d-4af0-ba6a-eceec2f3b287 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.308916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7a2c7-ff9d-4af0-ba6a-eceec2f3b287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.312286 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 238/494] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:01.313693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165b7ee-69d2-4b9c-8e23-b9473870bd7f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.314123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165b7ee-69d2-4b9c-8e23-b9473870bd7f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.314559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165b7ee-69d2-4b9c-8e23-b9473870bd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.331349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8165b7ee-69d2-4b9c-8e23-b9473870bd7f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:01.332741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8165b7ee-69d2-4b9c-8e23-b9473870bd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:01.386911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7a2c7-ff9d-4af0-ba6a-eceec2f3b287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:01.388414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7a2c7-ff9d-4af0-ba6a-eceec2f3b287 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:01.420044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 239/495] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:01.420044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165b7ee-69d2-4b9c-8e23-b9473870bd7f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.498858 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 257/496] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:01.500139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7a2c7-ff9d-4af0-ba6a-eceec2f3b287 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.524648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165b7ee-69d2-4b9c-8e23-b9473870bd7f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:01.557972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000c930-4a64-4512-9519-ca13f44ecaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:01.558747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000c930-4a64-4512-9519-ca13f44ecaf5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.559036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000c930-4a64-4512-9519-ca13f44ecaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.559313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9000c930-4a64-4512-9519-ca13f44ecaf5 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.560094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000c930-4a64-4512-9519-ca13f44ecaf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:01.560404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000c930-4a64-4512-9519-ca13f44ecaf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:01.561800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9000c930-4a64-4512-9519-ca13f44ecaf5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:01.570115 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 240/497] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:01.570906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000c930-4a64-4512-9519-ca13f44ecaf5 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.604453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7a2c7-ff9d-4af0-ba6a-eceec2f3b287 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:01.636562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ab0d9-17ff-4cbf-9c0a-ff5a3d421799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:01.637342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ab0d9-17ff-4cbf-9c0a-ff5a3d421799 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.637620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ab0d9-17ff-4cbf-9c0a-ff5a3d421799 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.637896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ab0d9-17ff-4cbf-9c0a-ff5a3d421799 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.648599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ab0d9-17ff-4cbf-9c0a-ff5a3d421799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:01.655401 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-657ab0d9-17ff-4cbf-9c0a-ff5a3d421799 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:01.661490 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 258/498] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:01.661490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ab0d9-17ff-4cbf-9c0a-ff5a3d421799 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.674310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9000c930-4a64-4512-9519-ca13f44ecaf5 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:01.707708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c79c1b-ed6e-4db5-bd3c-4a485abfd621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:01.708534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c79c1b-ed6e-4db5-bd3c-4a485abfd621 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.708814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c79c1b-ed6e-4db5-bd3c-4a485abfd621 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.709093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c79c1b-ed6e-4db5-bd3c-4a485abfd621 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.719306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c79c1b-ed6e-4db5-bd3c-4a485abfd621 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:01.726986 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-25c79c1b-ed6e-4db5-bd3c-4a485abfd621 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:01.731966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 241/499] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:01.731966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c79c1b-ed6e-4db5-bd3c-4a485abfd621 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.763209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ab0d9-17ff-4cbf-9c0a-ff5a3d421799 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:01.795598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974e12-a72b-48be-8419-f75d57f7cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:01.796407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974e12-a72b-48be-8419-f75d57f7cd61 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.796686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974e12-a72b-48be-8419-f75d57f7cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.796956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0974e12-a72b-48be-8419-f75d57f7cd61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.807935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974e12-a72b-48be-8419-f75d57f7cd61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:01.809410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0974e12-a72b-48be-8419-f75d57f7cd61 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:01.825532 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d0974e12-a72b-48be-8419-f75d57f7cd61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:01.826702 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 259/500] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:01.827237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c79c1b-ed6e-4db5-bd3c-4a485abfd621 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:01.827465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974e12-a72b-48be-8419-f75d57f7cd61 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.860309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba229-cf5e-43bf-869f-9e27ffb13681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:01.861087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba229-cf5e-43bf-869f-9e27ffb13681 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.861365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba229-cf5e-43bf-869f-9e27ffb13681 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.861637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba229-cf5e-43bf-869f-9e27ffb13681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.872294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba229-cf5e-43bf-869f-9e27ffb13681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:01.873800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba229-cf5e-43bf-869f-9e27ffb13681 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:01.890160 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2c0ba229-cf5e-43bf-869f-9e27ffb13681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:01.891314 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 242/501] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:01.892104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba229-cf5e-43bf-869f-9e27ffb13681 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.921381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0974e12-a72b-48be-8419-f75d57f7cd61 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:01.953396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d79e20-4176-4e40-9be2-37f043ffbefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:01.954049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d79e20-4176-4e40-9be2-37f043ffbefb None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.954332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d79e20-4176-4e40-9be2-37f043ffbefb None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.954611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d79e20-4176-4e40-9be2-37f043ffbefb None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.955338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d79e20-4176-4e40-9be2-37f043ffbefb None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:01.955642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d79e20-4176-4e40-9be2-37f043ffbefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:01.957048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d79e20-4176-4e40-9be2-37f043ffbefb None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:01.964562 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 260/502] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:01.965737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae2b5c-bc86-415f-9af2-e3d801b7ad87 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:01.966023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae2b5c-bc86-415f-9af2-e3d801b7ad87 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:01.966494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae2b5c-bc86-415f-9af2-e3d801b7ad87 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:01.969147 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 261/503] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:01.969934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae2b5c-bc86-415f-9af2-e3d801b7ad87 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:01.987290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba229-cf5e-43bf-869f-9e27ffb13681 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.020411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4571bdf-6f45-4803-9eea-5009177bdf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.020991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4571bdf-6f45-4803-9eea-5009177bdf1d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.021275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4571bdf-6f45-4803-9eea-5009177bdf1d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.021555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4571bdf-6f45-4803-9eea-5009177bdf1d None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.022337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4571bdf-6f45-4803-9eea-5009177bdf1d None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:02.022646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4571bdf-6f45-4803-9eea-5009177bdf1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.024055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4571bdf-6f45-4803-9eea-5009177bdf1d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.031910 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 243/504] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:02.032710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4571bdf-6f45-4803-9eea-5009177bdf1d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.066126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae2b5c-bc86-415f-9af2-e3d801b7ad87 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.097856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc62ade-10f0-4323-9c4b-e07241a3b316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.098500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62ade-10f0-4323-9c4b-e07241a3b316 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.098780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62ade-10f0-4323-9c4b-e07241a3b316 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.099054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62ade-10f0-4323-9c4b-e07241a3b316 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.099760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc62ade-10f0-4323-9c4b-e07241a3b316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:02.100123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc62ade-10f0-4323-9c4b-e07241a3b316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.101495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc62ade-10f0-4323-9c4b-e07241a3b316 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.112125 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 262/505] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:02.112889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc62ade-10f0-4323-9c4b-e07241a3b316 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.126452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4571bdf-6f45-4803-9eea-5009177bdf1d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.157907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce194d6-1e7d-4e66-a14d-b581a01e4b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.158568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce194d6-1e7d-4e66-a14d-b581a01e4b93 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.158835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce194d6-1e7d-4e66-a14d-b581a01e4b93 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.159106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce194d6-1e7d-4e66-a14d-b581a01e4b93 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.159815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce194d6-1e7d-4e66-a14d-b581a01e4b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:02.160155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce194d6-1e7d-4e66-a14d-b581a01e4b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.161544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce194d6-1e7d-4e66-a14d-b581a01e4b93 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.173514 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 244/506] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:02.174658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9797a-b979-4d93-b403-c0b7e0b288b4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.174948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9797a-b979-4d93-b403-c0b7e0b288b4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.175223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9797a-b979-4d93-b403-c0b7e0b288b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.191267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-90e9797a-b979-4d93-b403-c0b7e0b288b4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:02.192493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-90e9797a-b979-4d93-b403-c0b7e0b288b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:02.211456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc62ade-10f0-4323-9c4b-e07241a3b316 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.242637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ca41-4563-4bcc-b565-65aa0c03b071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.243407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ca41-4563-4bcc-b565-65aa0c03b071 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.243685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ca41-4563-4bcc-b565-65aa0c03b071 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.243981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72ca41-4563-4bcc-b565-65aa0c03b071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.254429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ca41-4563-4bcc-b565-65aa0c03b071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.254690 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 245/507] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:02.255495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9797a-b979-4d93-b403-c0b7e0b288b4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.255893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72ca41-4563-4bcc-b565-65aa0c03b071 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.272900 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-7a72ca41-4563-4bcc-b565-65aa0c03b071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:02.274010 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 263/508] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:02.274768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ca41-4563-4bcc-b565-65aa0c03b071 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.348816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9797a-b979-4d93-b403-c0b7e0b288b4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.370674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72ca41-4563-4bcc-b565-65aa0c03b071 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.381890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66515-f017-47f3-b7fa-4675d4ed6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.382668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66515-f017-47f3-b7fa-4675d4ed6f6f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.382949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66515-f017-47f3-b7fa-4675d4ed6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.383276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66515-f017-47f3-b7fa-4675d4ed6f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.392831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66515-f017-47f3-b7fa-4675d4ed6f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.394291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66515-f017-47f3-b7fa-4675d4ed6f6f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.402893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81a048-58be-4755-b9da-f5669c1ae006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.403664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81a048-58be-4755-b9da-f5669c1ae006 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.403976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81a048-58be-4755-b9da-f5669c1ae006 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.404257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81a048-58be-4755-b9da-f5669c1ae006 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.410330 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-49b66515-f017-47f3-b7fa-4675d4ed6f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:02.410741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81a048-58be-4755-b9da-f5669c1ae006 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.411464 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 246/509] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:02.412218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81a048-58be-4755-b9da-f5669c1ae006 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.412312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66515-f017-47f3-b7fa-4675d4ed6f6f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.426077 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-9c81a048-58be-4755-b9da-f5669c1ae006 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:02.427221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 264/510] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:02.427998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81a048-58be-4755-b9da-f5669c1ae006 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.507383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66515-f017-47f3-b7fa-4675d4ed6f6f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.521267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81a048-58be-4755-b9da-f5669c1ae006 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.539439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa76486-37e2-440b-9bc5-ca4b242d9754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.540178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa76486-37e2-440b-9bc5-ca4b242d9754 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.540462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa76486-37e2-440b-9bc5-ca4b242d9754 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.540735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa76486-37e2-440b-9bc5-ca4b242d9754 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.547475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa76486-37e2-440b-9bc5-ca4b242d9754 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.548952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa76486-37e2-440b-9bc5-ca4b242d9754 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.554027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110c9c-1af4-4be8-8048-fc67068e259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.554674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110c9c-1af4-4be8-8048-fc67068e259d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.554960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110c9c-1af4-4be8-8048-fc67068e259d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.555241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d110c9c-1af4-4be8-8048-fc67068e259d None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.555997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110c9c-1af4-4be8-8048-fc67068e259d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:02.556309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110c9c-1af4-4be8-8048-fc67068e259d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.557664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d110c9c-1af4-4be8-8048-fc67068e259d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.562779 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2aa76486-37e2-440b-9bc5-ca4b242d9754 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 26 20:34:02.563948 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 247/511] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:02.564696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa76486-37e2-440b-9bc5-ca4b242d9754 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.573205 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 265/512] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:02.573205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110c9c-1af4-4be8-8048-fc67068e259d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.657403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa76486-37e2-440b-9bc5-ca4b242d9754 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.661450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d110c9c-1af4-4be8-8048-fc67068e259d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.689789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef0e2a-01c3-4802-a7e8-2ece08e772c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.690552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0e2a-01c3-4802-a7e8-2ece08e772c1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.690835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0e2a-01c3-4802-a7e8-2ece08e772c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.691111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0e2a-01c3-4802-a7e8-2ece08e772c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.692960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dff97-250b-4d87-bbf1-51182dbfba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.693597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dff97-250b-4d87-bbf1-51182dbfba69 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.693907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dff97-250b-4d87-bbf1-51182dbfba69 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.694180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622dff97-250b-4d87-bbf1-51182dbfba69 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.694883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dff97-250b-4d87-bbf1-51182dbfba69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:02.695185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dff97-250b-4d87-bbf1-51182dbfba69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.696599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622dff97-250b-4d87-bbf1-51182dbfba69 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.700722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef0e2a-01c3-4802-a7e8-2ece08e772c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.702181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef0e2a-01c3-4802-a7e8-2ece08e772c1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.707674 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 266/513] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:02.708490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dff97-250b-4d87-bbf1-51182dbfba69 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.719434 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-7aef0e2a-01c3-4802-a7e8-2ece08e772c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:02.724193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 248/514] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:02.724193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef0e2a-01c3-4802-a7e8-2ece08e772c1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.803928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622dff97-250b-4d87-bbf1-51182dbfba69 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.817916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef0e2a-01c3-4802-a7e8-2ece08e772c1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.835255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3402-8518-4783-bc50-0e9187e46345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.835889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3402-8518-4783-bc50-0e9187e46345 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.836198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3402-8518-4783-bc50-0e9187e46345 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.836474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd3402-8518-4783-bc50-0e9187e46345 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.837250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3402-8518-4783-bc50-0e9187e46345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:02.837565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3402-8518-4783-bc50-0e9187e46345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.838998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd3402-8518-4783-bc50-0e9187e46345 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.850587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f777aa-11cf-402e-96b3-4ec7ae1ffec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.851238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f777aa-11cf-402e-96b3-4ec7ae1ffec5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.851521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f777aa-11cf-402e-96b3-4ec7ae1ffec5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.851797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f777aa-11cf-402e-96b3-4ec7ae1ffec5 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.852658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f777aa-11cf-402e-96b3-4ec7ae1ffec5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:02.852972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f777aa-11cf-402e-96b3-4ec7ae1ffec5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.854413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f777aa-11cf-402e-96b3-4ec7ae1ffec5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:02.856856 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 267/515] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:02.857642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3402-8518-4783-bc50-0e9187e46345 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.889109 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 249/516] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:02.889925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f777aa-11cf-402e-96b3-4ec7ae1ffec5 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:02.950279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd3402-8518-4783-bc50-0e9187e46345 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.981989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a6a6d-286f-41e0-8656-1ff82e273530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:02.982312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f777aa-11cf-402e-96b3-4ec7ae1ffec5 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:02.982764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a6a6d-286f-41e0-8656-1ff82e273530 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:02.983045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a6a6d-286f-41e0-8656-1ff82e273530 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:02.983317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a6a6d-286f-41e0-8656-1ff82e273530 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:02.990486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a6a6d-286f-41e0-8656-1ff82e273530 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:02.991996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a6a6d-286f-41e0-8656-1ff82e273530 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.005590 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-311a6a6d-286f-41e0-8656-1ff82e273530 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 26 20:34:03.011405 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 268/517] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:03.011405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a6a6d-286f-41e0-8656-1ff82e273530 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.015279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dae96-1b90-4c43-9ef8-02dc067a6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.016120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dae96-1b90-4c43-9ef8-02dc067a6bff None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.016382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dae96-1b90-4c43-9ef8-02dc067a6bff None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.016654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dae96-1b90-4c43-9ef8-02dc067a6bff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.024384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dae96-1b90-4c43-9ef8-02dc067a6bff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.025855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850dae96-1b90-4c43-9ef8-02dc067a6bff None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.039547 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-850dae96-1b90-4c43-9ef8-02dc067a6bff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 26 20:34:03.040713 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 250/518] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:03.041470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dae96-1b90-4c43-9ef8-02dc067a6bff None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.105964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a6a6d-286f-41e0-8656-1ff82e273530 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.133244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850dae96-1b90-4c43-9ef8-02dc067a6bff None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.137455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbbaab-b9a9-46f3-a5e9-aa4f5ed3fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.138106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbbaab-b9a9-46f3-a5e9-aa4f5ed3fc3e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.138390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbbaab-b9a9-46f3-a5e9-aa4f5ed3fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.138669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbbaab-b9a9-46f3-a5e9-aa4f5ed3fc3e None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.139382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbbaab-b9a9-46f3-a5e9-aa4f5ed3fc3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:03.139687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbbaab-b9a9-46f3-a5e9-aa4f5ed3fc3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.141104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbbaab-b9a9-46f3-a5e9-aa4f5ed3fc3e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.152873 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 269/519] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:03.154058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbbaab-b9a9-46f3-a5e9-aa4f5ed3fc3e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.165929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba1756-af8f-454b-9fe3-975b9dcdea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.166578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba1756-af8f-454b-9fe3-975b9dcdea7b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.166859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba1756-af8f-454b-9fe3-975b9dcdea7b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.167133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba1756-af8f-454b-9fe3-975b9dcdea7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.167982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba1756-af8f-454b-9fe3-975b9dcdea7b None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=07e77369a94844529947de0f46a54edd) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:03.168296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba1756-af8f-454b-9fe3-975b9dcdea7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.169762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba1756-af8f-454b-9fe3-975b9dcdea7b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.175059 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 251/520] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/role_assignments?user.id=07e77369a94844529947de0f46a54edd&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:03.175678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba1756-af8f-454b-9fe3-975b9dcdea7b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.257822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbbaab-b9a9-46f3-a5e9-aa4f5ed3fc3e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.281565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba1756-af8f-454b-9fe3-975b9dcdea7b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.294575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb7042-2a15-4fc8-aa32-267cda3ef29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.295705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb7042-2a15-4fc8-aa32-267cda3ef29b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.296255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb7042-2a15-4fc8-aa32-267cda3ef29b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.296596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffb7042-2a15-4fc8-aa32-267cda3ef29b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.316536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd7be5-0469-4fb2-a639-60fc41ede180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.317217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7be5-0469-4fb2-a639-60fc41ede180 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.317505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7be5-0469-4fb2-a639-60fc41ede180 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.317784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd7be5-0469-4fb2-a639-60fc41ede180 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.318633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd7be5-0469-4fb2-a639-60fc41ede180 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:03.319858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd7be5-0469-4fb2-a639-60fc41ede180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.320991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd7be5-0469-4fb2-a639-60fc41ede180 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.340180 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 252/521] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:03.341058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd7be5-0469-4fb2-a639-60fc41ede180 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.372659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb7042-2a15-4fc8-aa32-267cda3ef29b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.372659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffb7042-2a15-4fc8-aa32-267cda3ef29b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.447436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd7be5-0469-4fb2-a639-60fc41ede180 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.466989 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 270/522] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:03.468092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb7042-2a15-4fc8-aa32-267cda3ef29b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.485602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d656a62-0b3f-47fc-aacf-76adbe92d523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.486287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d656a62-0b3f-47fc-aacf-76adbe92d523 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.486630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d656a62-0b3f-47fc-aacf-76adbe92d523 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.486904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d656a62-0b3f-47fc-aacf-76adbe92d523 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.487726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d656a62-0b3f-47fc-aacf-76adbe92d523 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:03.488068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d656a62-0b3f-47fc-aacf-76adbe92d523 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.489503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d656a62-0b3f-47fc-aacf-76adbe92d523 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.511616 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 253/523] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:03.512291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d656a62-0b3f-47fc-aacf-76adbe92d523 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.568103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffb7042-2a15-4fc8-aa32-267cda3ef29b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.603231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854789e-de7d-48fa-ba1a-f5aeb2d03253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.604156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854789e-de7d-48fa-ba1a-f5aeb2d03253 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.604440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854789e-de7d-48fa-ba1a-f5aeb2d03253 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.604718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854789e-de7d-48fa-ba1a-f5aeb2d03253 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.605412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854789e-de7d-48fa-ba1a-f5aeb2d03253 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.606848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854789e-de7d-48fa-ba1a-f5aeb2d03253 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.611146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d656a62-0b3f-47fc-aacf-76adbe92d523 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.636101 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 271/524] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:34:03 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:03.636101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854789e-de7d-48fa-ba1a-f5aeb2d03253 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.646540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9276a88-3894-412c-a8d1-a3ed626a5da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.647752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9276a88-3894-412c-a8d1-a3ed626a5da6 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.648075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9276a88-3894-412c-a8d1-a3ed626a5da6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.648357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9276a88-3894-412c-a8d1-a3ed626a5da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.721380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9276a88-3894-412c-a8d1-a3ed626a5da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.722913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9276a88-3894-412c-a8d1-a3ed626a5da6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.745262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854789e-de7d-48fa-ba1a-f5aeb2d03253 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.780867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0d80a-d29f-44dc-96d0-8b89953d125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.781663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0d80a-d29f-44dc-96d0-8b89953d125d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.781944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0d80a-d29f-44dc-96d0-8b89953d125d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.782219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0d80a-d29f-44dc-96d0-8b89953d125d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.794901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0d80a-d29f-44dc-96d0-8b89953d125d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.796437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0d80a-d29f-44dc-96d0-8b89953d125d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.814270 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-4dd0d80a-d29f-44dc-96d0-8b89953d125d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:03.815549 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 272/525] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:03.816182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0d80a-d29f-44dc-96d0-8b89953d125d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.828442 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 254/526] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:03.829298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9276a88-3894-412c-a8d1-a3ed626a5da6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:03.922097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0d80a-d29f-44dc-96d0-8b89953d125d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.930393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9276a88-3894-412c-a8d1-a3ed626a5da6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:03.956302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd45b9f-01a3-4f1a-8b52-4a54d5aa64d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.957054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd45b9f-01a3-4f1a-8b52-4a54d5aa64d4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.957340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd45b9f-01a3-4f1a-8b52-4a54d5aa64d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.957621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd45b9f-01a3-4f1a-8b52-4a54d5aa64d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.965608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c754-eca8-43cc-b5f4-4ab2f6eaa89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:03.966268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c754-eca8-43cc-b5f4-4ab2f6eaa89f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:03.966552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c754-eca8-43cc-b5f4-4ab2f6eaa89f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:03.966832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c754-eca8-43cc-b5f4-4ab2f6eaa89f None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:03.967561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465c754-eca8-43cc-b5f4-4ab2f6eaa89f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:03.967874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465c754-eca8-43cc-b5f4-4ab2f6eaa89f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:03.969326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465c754-eca8-43cc-b5f4-4ab2f6eaa89f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:03.981427 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 255/527] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:03.982275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c754-eca8-43cc-b5f4-4ab2f6eaa89f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.036044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd45b9f-01a3-4f1a-8b52-4a54d5aa64d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.037593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd45b9f-01a3-4f1a-8b52-4a54d5aa64d4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.082921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c754-eca8-43cc-b5f4-4ab2f6eaa89f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.117771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0865b96-1439-4f30-a834-88fc71eebf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:04.118566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0865b96-1439-4f30-a834-88fc71eebf0e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:04.118852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0865b96-1439-4f30-a834-88fc71eebf0e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:04.119132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0865b96-1439-4f30-a834-88fc71eebf0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:04.130374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0865b96-1439-4f30-a834-88fc71eebf0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.132432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0865b96-1439-4f30-a834-88fc71eebf0e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.140714 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 273/528] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:04.141563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd45b9f-01a3-4f1a-8b52-4a54d5aa64d4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.153584 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-f0865b96-1439-4f30-a834-88fc71eebf0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:04.155142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 256/529] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:04.155994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0865b96-1439-4f30-a834-88fc71eebf0e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.240221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd45b9f-01a3-4f1a-8b52-4a54d5aa64d4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.253510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0865b96-1439-4f30-a834-88fc71eebf0e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.274186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e8ec2-55aa-4090-915e-f94398470a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:04.274981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e8ec2-55aa-4090-915e-f94398470a2e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:04.275266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e8ec2-55aa-4090-915e-f94398470a2e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:04.275540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e8ec2-55aa-4090-915e-f94398470a2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:04.282341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e8ec2-55aa-4090-915e-f94398470a2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.284045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e8ec2-55aa-4090-915e-f94398470a2e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.286531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd3458-3224-4a22-b8df-3011f82ff206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:04.287323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd3458-3224-4a22-b8df-3011f82ff206 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:04.287633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd3458-3224-4a22-b8df-3011f82ff206 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:04.287905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd3458-3224-4a22-b8df-3011f82ff206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:04.297860 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-844e8ec2-55aa-4090-915e-f94398470a2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:04.298566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd3458-3224-4a22-b8df-3011f82ff206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.299213 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 274/530] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:04.299814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e8ec2-55aa-4090-915e-f94398470a2e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.300139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd3458-3224-4a22-b8df-3011f82ff206 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.321574 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-12bd3458-3224-4a22-b8df-3011f82ff206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:04.323095 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 257/531] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:04.324034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd3458-3224-4a22-b8df-3011f82ff206 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.419202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e8ec2-55aa-4090-915e-f94398470a2e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.447043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd3458-3224-4a22-b8df-3011f82ff206 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.457260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3560d-8e7a-46ce-93d4-8c5ee31d7285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:04.458189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3560d-8e7a-46ce-93d4-8c5ee31d7285 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:04.458480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3560d-8e7a-46ce-93d4-8c5ee31d7285 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:04.458760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3560d-8e7a-46ce-93d4-8c5ee31d7285 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:04.459513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3560d-8e7a-46ce-93d4-8c5ee31d7285 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:04.460022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3560d-8e7a-46ce-93d4-8c5ee31d7285 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.462067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d3560d-8e7a-46ce-93d4-8c5ee31d7285 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.478114 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 275/532] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:04.479134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3560d-8e7a-46ce-93d4-8c5ee31d7285 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.480483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeb8dc-3edb-418d-954e-ae89a43641ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:04.481129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb8dc-3edb-418d-954e-ae89a43641ac None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:04.481409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb8dc-3edb-418d-954e-ae89a43641ac None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:04.481680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb8dc-3edb-418d-954e-ae89a43641ac None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:04.482457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeb8dc-3edb-418d-954e-ae89a43641ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:04.482759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeb8dc-3edb-418d-954e-ae89a43641ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.484392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeb8dc-3edb-418d-954e-ae89a43641ac None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.503454 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 258/533] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:04.504260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeb8dc-3edb-418d-954e-ae89a43641ac None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.596817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3560d-8e7a-46ce-93d4-8c5ee31d7285 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.607235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeb8dc-3edb-418d-954e-ae89a43641ac None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.631110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f834d15-4e83-448e-bc99-005688bec7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:04.631770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f834d15-4e83-448e-bc99-005688bec7af None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:04.632079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f834d15-4e83-448e-bc99-005688bec7af None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:04.632359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f834d15-4e83-448e-bc99-005688bec7af None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:04.633074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f834d15-4e83-448e-bc99-005688bec7af None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:04.633380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f834d15-4e83-448e-bc99-005688bec7af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.634761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f834d15-4e83-448e-bc99-005688bec7af None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.640687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbf073-c807-425a-bfa8-61142e9dd424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:04.641463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf073-c807-425a-bfa8-61142e9dd424 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:04.641739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf073-c807-425a-bfa8-61142e9dd424 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:04.642008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcbf073-c807-425a-bfa8-61142e9dd424 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:04.647464 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 276/534] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:04.648323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f834d15-4e83-448e-bc99-005688bec7af None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.649165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbf073-c807-425a-bfa8-61142e9dd424 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.650655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcbf073-c807-425a-bfa8-61142e9dd424 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.666489 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2fcbf073-c807-425a-bfa8-61142e9dd424 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:04.672283 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 259/535] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:04.672283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbf073-c807-425a-bfa8-61142e9dd424 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.768265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcbf073-c807-425a-bfa8-61142e9dd424 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.777763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f834d15-4e83-448e-bc99-005688bec7af None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.802487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a049d-722d-40ee-a69e-11f098ed27d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:04.803643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a049d-722d-40ee-a69e-11f098ed27d6 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:04.803943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a049d-722d-40ee-a69e-11f098ed27d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:04.804247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a049d-722d-40ee-a69e-11f098ed27d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:04.810956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a049d-722d-40ee-a69e-11f098ed27d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.812490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a049d-722d-40ee-a69e-11f098ed27d6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.819395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904748f-3a6e-4a95-9396-4aa420481e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:04.820348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904748f-3a6e-4a95-9396-4aa420481e70 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:04.820832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904748f-3a6e-4a95-9396-4aa420481e70 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:04.821307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904748f-3a6e-4a95-9396-4aa420481e70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:04.822341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904748f-3a6e-4a95-9396-4aa420481e70 None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=82c1da5e55da4bf380e86064d66e638b) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:04.822848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904748f-3a6e-4a95-9396-4aa420481e70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:04.824503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9904748f-3a6e-4a95-9396-4aa420481e70 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:04.826190 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-188a049d-722d-40ee-a69e-11f098ed27d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:04.828041 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 260/536] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:04.828513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a049d-722d-40ee-a69e-11f098ed27d6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.831350 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 277/537] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/role_assignments?user.id=82c1da5e55da4bf380e86064d66e638b&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:04.832762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904748f-3a6e-4a95-9396-4aa420481e70 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:04.982403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904748f-3a6e-4a95-9396-4aa420481e70 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:04.990234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a049d-722d-40ee-a69e-11f098ed27d6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:05.027043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a002-7058-45ae-a485-78bfde629895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:05.027811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a002-7058-45ae-a485-78bfde629895 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:05.028014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a002-7058-45ae-a485-78bfde629895 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:05.028297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a002-7058-45ae-a485-78bfde629895 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:05.029115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836a002-7058-45ae-a485-78bfde629895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:05.029412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836a002-7058-45ae-a485-78bfde629895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:05.030880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836a002-7058-45ae-a485-78bfde629895 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:05.033025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88d239-4b46-4e7a-bbeb-0ec79f03eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:05.033920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d239-4b46-4e7a-bbeb-0ec79f03eca5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:05.034450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d239-4b46-4e7a-bbeb-0ec79f03eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:05.034930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88d239-4b46-4e7a-bbeb-0ec79f03eca5 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:05.035945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88d239-4b46-4e7a-bbeb-0ec79f03eca5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:05.036460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88d239-4b46-4e7a-bbeb-0ec79f03eca5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:05.038753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88d239-4b46-4e7a-bbeb-0ec79f03eca5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:05.056060 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 261/538] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:05.057454 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 278/539] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:05.059905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a002-7058-45ae-a485-78bfde629895 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:05.064960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88d239-4b46-4e7a-bbeb-0ec79f03eca5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:05.171963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a002-7058-45ae-a485-78bfde629895 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:05.202347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88d239-4b46-4e7a-bbeb-0ec79f03eca5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:05.206012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868366a-35cd-4a45-9a56-be23e6174ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:05.206793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868366a-35cd-4a45-9a56-be23e6174ad7 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:05.207174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868366a-35cd-4a45-9a56-be23e6174ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:05.207550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868366a-35cd-4a45-9a56-be23e6174ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:05.208520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868366a-35cd-4a45-9a56-be23e6174ad7 None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=71808360397a42cab9196c51547e33e0) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:05.208933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868366a-35cd-4a45-9a56-be23e6174ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:05.211034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868366a-35cd-4a45-9a56-be23e6174ad7 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:05.217157 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 262/540] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:05 2022] GET /identity/v3/role_assignments?user.id=71808360397a42cab9196c51547e33e0&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:05.267481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cd6dc-72d1-4179-ae81-bfa7ef158a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:05.268454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd6dc-72d1-4179-ae81-bfa7ef158a43 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:05.268881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd6dc-72d1-4179-ae81-bfa7ef158a43 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:05.269301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cd6dc-72d1-4179-ae81-bfa7ef158a43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:05.270275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cd6dc-72d1-4179-ae81-bfa7ef158a43 None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=416ac158078b4b678c236e0ad811acad) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:05.270868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cd6dc-72d1-4179-ae81-bfa7ef158a43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:05.273065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cd6dc-72d1-4179-ae81-bfa7ef158a43 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:05.283254 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 279/541] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:05 2022] GET /identity/v3/role_assignments?user.id=416ac158078b4b678c236e0ad811acad&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:05.846353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e641-0376-422c-8a5f-88bc67aa62c9 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:05.846865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e641-0376-422c-8a5f-88bc67aa62c9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:05.847257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3e641-0376-422c-8a5f-88bc67aa62c9 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:05.849444 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 263/542] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:05.856592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fb5b5-709a-4849-a4f4-840a4902d228 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:05.856999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fb5b5-709a-4849-a4f4-840a4902d228 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:05.857384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0fb5b5-709a-4849-a4f4-840a4902d228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:05.874570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4b0fb5b5-709a-4849-a4f4-840a4902d228 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:05.875894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4b0fb5b5-709a-4849-a4f4-840a4902d228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:05.944557 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 280/543] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:05.969225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e641-0376-422c-8a5f-88bc67aa62c9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:06.128868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3e641-0376-422c-8a5f-88bc67aa62c9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:06.171620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb57ada-930d-4710-ab04-cea1ff4155bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:06.172490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57ada-930d-4710-ab04-cea1ff4155bc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:06.172780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57ada-930d-4710-ab04-cea1ff4155bc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:06.173056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb57ada-930d-4710-ab04-cea1ff4155bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:06.189008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb57ada-930d-4710-ab04-cea1ff4155bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:06.200269 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2eb57ada-930d-4710-ab04-cea1ff4155bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:06.201485 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 264/544] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:06.214995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fb5b5-709a-4849-a4f4-840a4902d228 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:06.329442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0fb5b5-709a-4849-a4f4-840a4902d228 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:06.371392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c6c79-e513-449a-85f7-5a33d74d3e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:06.372477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c6c79-e513-449a-85f7-5a33d74d3e90 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:06.373065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c6c79-e513-449a-85f7-5a33d74d3e90 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:06.373566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c6c79-e513-449a-85f7-5a33d74d3e90 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:06.374511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c6c79-e513-449a-85f7-5a33d74d3e90 None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:06.375048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c6c79-e513-449a-85f7-5a33d74d3e90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:06.376676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c6c79-e513-449a-85f7-5a33d74d3e90 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:06.386491 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 281/545] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:06.397592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb57ada-930d-4710-ab04-cea1ff4155bc None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:06.529423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb57ada-930d-4710-ab04-cea1ff4155bc None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:06.562846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74e224-5ca6-423f-8b1d-e0d77572d016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:06.563630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74e224-5ca6-423f-8b1d-e0d77572d016 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:06.563907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74e224-5ca6-423f-8b1d-e0d77572d016 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:06.564219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74e224-5ca6-423f-8b1d-e0d77572d016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:06.575203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74e224-5ca6-423f-8b1d-e0d77572d016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:06.576707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f74e224-5ca6-423f-8b1d-e0d77572d016 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:06.592997 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-8f74e224-5ca6-423f-8b1d-e0d77572d016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:06.594494 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 265/546] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:06.600280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c6c79-e513-449a-85f7-5a33d74d3e90 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:06.628789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fcecc-98e3-4712-8e1c-f894b8705e52 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:06.629118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fcecc-98e3-4712-8e1c-f894b8705e52 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:06.629348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fcecc-98e3-4712-8e1c-f894b8705e52 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:06.631899 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 266/547] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:06.638664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fbb91-28d0-4a0b-95b1-b3731487420f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:06.638898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fbb91-28d0-4a0b-95b1-b3731487420f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:06.639232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fbb91-28d0-4a0b-95b1-b3731487420f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:06.659636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5d7fbb91-28d0-4a0b-95b1-b3731487420f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:06.660873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5d7fbb91-28d0-4a0b-95b1-b3731487420f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:06.715355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c6c79-e513-449a-85f7-5a33d74d3e90 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:06.754044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 267/548] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:34:06.760516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35129c32-630a-465b-937d-a2b294d7d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:06.761195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35129c32-630a-465b-937d-a2b294d7d23e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:06.761477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35129c32-630a-465b-937d-a2b294d7d23e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:06.761814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35129c32-630a-465b-937d-a2b294d7d23e None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:06.762593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35129c32-630a-465b-937d-a2b294d7d23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:06.762902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35129c32-630a-465b-937d-a2b294d7d23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:06.764313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35129c32-630a-465b-937d-a2b294d7d23e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:06.780883 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 282/549] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:06.786274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fbb91-28d0-4a0b-95b1-b3731487420f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:06.843842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35129c32-630a-465b-937d-a2b294d7d23e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:06.953796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fbb91-28d0-4a0b-95b1-b3731487420f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:07.016493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35129c32-630a-465b-937d-a2b294d7d23e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:07.030132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91a1f3-a2b8-4572-a122-ee911a7f91f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:07.030618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91a1f3-a2b8-4572-a122-ee911a7f91f5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.030826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91a1f3-a2b8-4572-a122-ee911a7f91f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.031151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91a1f3-a2b8-4572-a122-ee911a7f91f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.051862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91a1f3-a2b8-4572-a122-ee911a7f91f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:07.055255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91a1f3-a2b8-4572-a122-ee911a7f91f5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:07.058862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011d878-9fe0-4dfd-a5d0-cc6a31eb0e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:07.059906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011d878-9fe0-4dfd-a5d0-cc6a31eb0e1f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.060429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011d878-9fe0-4dfd-a5d0-cc6a31eb0e1f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.060905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011d878-9fe0-4dfd-a5d0-cc6a31eb0e1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.082806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011d878-9fe0-4dfd-a5d0-cc6a31eb0e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:07.090047 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2011d878-9fe0-4dfd-a5d0-cc6a31eb0e1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:07.090793 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-4a91a1f3-a2b8-4572-a122-ee911a7f91f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 26 20:34:07.092283 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 268/550] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Mar 26 20:34:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:07.094024 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 283/551] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:07.100210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91a1f3-a2b8-4572-a122-ee911a7f91f5 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:07.104818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011d878-9fe0-4dfd-a5d0-cc6a31eb0e1f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:07.231441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011d878-9fe0-4dfd-a5d0-cc6a31eb0e1f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:07.272679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ada1-73dd-4d40-868d-7ecc92d06bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:07.273750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ada1-73dd-4d40-868d-7ecc92d06bff None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.274257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ada1-73dd-4d40-868d-7ecc92d06bff None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.274736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859ada1-73dd-4d40-868d-7ecc92d06bff None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.275721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859ada1-73dd-4d40-868d-7ecc92d06bff None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:07.276292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859ada1-73dd-4d40-868d-7ecc92d06bff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:07.277957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859ada1-73dd-4d40-868d-7ecc92d06bff None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:07.295954 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 284/552] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:07.297742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ada1-73dd-4d40-868d-7ecc92d06bff None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:07.303756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91a1f3-a2b8-4572-a122-ee911a7f91f5 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:07.370539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c619a9-cfe8-403c-be7c-9fb43da99f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:07.371657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c619a9-cfe8-403c-be7c-9fb43da99f18 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.372173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c619a9-cfe8-403c-be7c-9fb43da99f18 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.372696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c619a9-cfe8-403c-be7c-9fb43da99f18 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.373731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c619a9-cfe8-403c-be7c-9fb43da99f18 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:07.374259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c619a9-cfe8-403c-be7c-9fb43da99f18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:07.376302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c619a9-cfe8-403c-be7c-9fb43da99f18 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:07.404034 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 269/553] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Mar 26 20:34:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:07.408454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c619a9-cfe8-403c-be7c-9fb43da99f18 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:07.510689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859ada1-73dd-4d40-868d-7ecc92d06bff None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:07.571152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c619a9-cfe8-403c-be7c-9fb43da99f18 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:07.576630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8456a-414d-44cd-8f03-c018b4cdf576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:07.577434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8456a-414d-44cd-8f03-c018b4cdf576 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.577721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8456a-414d-44cd-8f03-c018b4cdf576 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.578000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8456a-414d-44cd-8f03-c018b4cdf576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.598322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8456a-414d-44cd-8f03-c018b4cdf576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:07.599837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8456a-414d-44cd-8f03-c018b4cdf576 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:07.611019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c5bf-fe31-49ea-9d41-763f8bfbabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:07.611839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c5bf-fe31-49ea-9d41-763f8bfbabfb None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.612114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c5bf-fe31-49ea-9d41-763f8bfbabfb None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.612383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c5bf-fe31-49ea-9d41-763f8bfbabfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.626025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9c5bf-fe31-49ea-9d41-763f8bfbabfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:07.627527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9c5bf-fe31-49ea-9d41-763f8bfbabfb None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:07.635961 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-18e8456a-414d-44cd-8f03-c018b4cdf576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:07.637519 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 285/554] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:07.643120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8456a-414d-44cd-8f03-c018b4cdf576 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:07.647316 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-8cf9c5bf-fe31-49ea-9d41-763f8bfbabfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:07.653137 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 270/555] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:07.654473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c5bf-fe31-49ea-9d41-763f8bfbabfb None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:07.778084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c5bf-fe31-49ea-9d41-763f8bfbabfb None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:07.800611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8456a-414d-44cd-8f03-c018b4cdf576 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:07.819955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86400128-a26b-4a44-bdc2-3fa0940e3d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:07.821036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86400128-a26b-4a44-bdc2-3fa0940e3d5f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.821419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86400128-a26b-4a44-bdc2-3fa0940e3d5f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.821769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86400128-a26b-4a44-bdc2-3fa0940e3d5f None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.822565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86400128-a26b-4a44-bdc2-3fa0940e3d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:07.822941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86400128-a26b-4a44-bdc2-3fa0940e3d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:07.824887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86400128-a26b-4a44-bdc2-3fa0940e3d5f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:07.842447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c9f74-08c1-47c2-8d96-1465f0200b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:07.843496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c9f74-08c1-47c2-8d96-1465f0200b62 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.843989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c9f74-08c1-47c2-8d96-1465f0200b62 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.844453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c9f74-08c1-47c2-8d96-1465f0200b62 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.849232 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 271/556] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:07.849232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21065b0-7f27-43b8-b847-e7c1eb8382f0 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.849232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21065b0-7f27-43b8-b847-e7c1eb8382f0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.849232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21065b0-7f27-43b8-b847-e7c1eb8382f0 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.850833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c9f74-08c1-47c2-8d96-1465f0200b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:07.851357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c9f74-08c1-47c2-8d96-1465f0200b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:07.852437 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 272/557] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:07.853428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c9f74-08c1-47c2-8d96-1465f0200b62 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:07.854221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21065b0-7f27-43b8-b847-e7c1eb8382f0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:07.869332 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 286/558] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:07.871017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b801fe-6e0c-4cc5-ae97-6c8e1580ce56 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:07.871528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b801fe-6e0c-4cc5-ae97-6c8e1580ce56 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:07.872069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b801fe-6e0c-4cc5-ae97-6c8e1580ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:07.891626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-84b801fe-6e0c-4cc5-ae97-6c8e1580ce56 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:07.893458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-84b801fe-6e0c-4cc5-ae97-6c8e1580ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:07.972370 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 287/559] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:07.974020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b801fe-6e0c-4cc5-ae97-6c8e1580ce56 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.048931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21065b0-7f27-43b8-b847-e7c1eb8382f0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.084628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fabfc2-0a4c-4fa2-b11f-32aced1742b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.085803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fabfc2-0a4c-4fa2-b11f-32aced1742b7 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.086287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fabfc2-0a4c-4fa2-b11f-32aced1742b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.086912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fabfc2-0a4c-4fa2-b11f-32aced1742b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.094180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fabfc2-0a4c-4fa2-b11f-32aced1742b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:08.094660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b801fe-6e0c-4cc5-ae97-6c8e1580ce56 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.096440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fabfc2-0a4c-4fa2-b11f-32aced1742b7 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:08.110735 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d9fabfc2-0a4c-4fa2-b11f-32aced1742b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:08.112169 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 273/560] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:08.116777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fabfc2-0a4c-4fa2-b11f-32aced1742b7 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.128811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4822f84-19c3-4671-880c-e465c2b3c936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.129596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4822f84-19c3-4671-880c-e465c2b3c936 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.129875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4822f84-19c3-4671-880c-e465c2b3c936 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.130145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4822f84-19c3-4671-880c-e465c2b3c936 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.137264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4822f84-19c3-4671-880c-e465c2b3c936 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:08.138714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4822f84-19c3-4671-880c-e465c2b3c936 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:08.152527 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-a4822f84-19c3-4671-880c-e465c2b3c936 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 26 20:34:08.153830 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 288/561] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:08.154850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896963-4145-412d-876e-c506cdd2c5d5 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.155137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896963-4145-412d-876e-c506cdd2c5d5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.155418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91896963-4145-412d-876e-c506cdd2c5d5 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.157109 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 289/562] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:08.157803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91896963-4145-412d-876e-c506cdd2c5d5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.213600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fabfc2-0a4c-4fa2-b11f-32aced1742b7 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.245693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a6f103-8f67-41b9-ac3d-0fba946a286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.246551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6f103-8f67-41b9-ac3d-0fba946a286b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.246895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6f103-8f67-41b9-ac3d-0fba946a286b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.247174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6f103-8f67-41b9-ac3d-0fba946a286b None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.252721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91896963-4145-412d-876e-c506cdd2c5d5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.256927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a6f103-8f67-41b9-ac3d-0fba946a286b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:08.263772 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-22a6f103-8f67-41b9-ac3d-0fba946a286b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:08.265129 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 274/563] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:08.266128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afeaae-1133-49f9-8fd3-f4e1137b5e60 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.266409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afeaae-1133-49f9-8fd3-f4e1137b5e60 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.266687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afeaae-1133-49f9-8fd3-f4e1137b5e60 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.268359 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 275/564] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:08.269063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afeaae-1133-49f9-8fd3-f4e1137b5e60 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.290041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cab9688-a7a7-4249-9a21-a01cb8b4bdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.290691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab9688-a7a7-4249-9a21-a01cb8b4bdb5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.290973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab9688-a7a7-4249-9a21-a01cb8b4bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.291247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cab9688-a7a7-4249-9a21-a01cb8b4bdb5 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.292073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab9688-a7a7-4249-9a21-a01cb8b4bdb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:08.292384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab9688-a7a7-4249-9a21-a01cb8b4bdb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:08.293821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cab9688-a7a7-4249-9a21-a01cb8b4bdb5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:08.304764 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 290/565] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:08.305836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e5b86-7a5a-4c60-9a03-2fab3447a588 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.306121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e5b86-7a5a-4c60-9a03-2fab3447a588 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.306392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e5b86-7a5a-4c60-9a03-2fab3447a588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.322292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fa3e5b86-7a5a-4c60-9a03-2fab3447a588 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:08.323493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fa3e5b86-7a5a-4c60-9a03-2fab3447a588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:08.367251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afeaae-1133-49f9-8fd3-f4e1137b5e60 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.391755 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 291/566] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:08.392623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e5b86-7a5a-4c60-9a03-2fab3447a588 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.402980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2195e-5afe-4e93-82bf-0026542a7819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.403644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2195e-5afe-4e93-82bf-0026542a7819 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.403946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2195e-5afe-4e93-82bf-0026542a7819 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.404311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2195e-5afe-4e93-82bf-0026542a7819 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.405138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2195e-5afe-4e93-82bf-0026542a7819 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:08.405452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2195e-5afe-4e93-82bf-0026542a7819 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:08.407007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2195e-5afe-4e93-82bf-0026542a7819 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:08.424464 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 276/567] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Mar 26 20:34:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:08.425748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f72e-da0d-4072-8a84-0c5b5203877e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.426045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f72e-da0d-4072-8a84-0c5b5203877e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.426377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770f72e-da0d-4072-8a84-0c5b5203877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.442811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3770f72e-da0d-4072-8a84-0c5b5203877e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:08.444069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3770f72e-da0d-4072-8a84-0c5b5203877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:08.487158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e5b86-7a5a-4c60-9a03-2fab3447a588 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.507839 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 277/568] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:08.508859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770f72e-da0d-4072-8a84-0c5b5203877e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.526006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8fc9-c64e-4160-a79a-dd1407fc77e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.526670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8fc9-c64e-4160-a79a-dd1407fc77e3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.526954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8fc9-c64e-4160-a79a-dd1407fc77e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.527238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8fc9-c64e-4160-a79a-dd1407fc77e3 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.528008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8fc9-c64e-4160-a79a-dd1407fc77e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:08.528318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8fc9-c64e-4160-a79a-dd1407fc77e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:08.529708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8fc9-c64e-4160-a79a-dd1407fc77e3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:08.537610 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 292/569] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:08.538387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8fc9-c64e-4160-a79a-dd1407fc77e3 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.602680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770f72e-da0d-4072-8a84-0c5b5203877e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.631408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8fc9-c64e-4160-a79a-dd1407fc77e3 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.634125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168009eb-de6d-40d4-9b92-57b71c0ba7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.634996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168009eb-de6d-40d4-9b92-57b71c0ba7ec None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.635273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168009eb-de6d-40d4-9b92-57b71c0ba7ec None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.635543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168009eb-de6d-40d4-9b92-57b71c0ba7ec None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/07e77369a94844529947de0f46a54edd/roles/1d095fda854f45db887c85e1d6d5ac09` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.649490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168009eb-de6d-40d4-9b92-57b71c0ba7ec None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=07e77369a94844529947de0f46a54edd, role_id=1d095fda854f45db887c85e1d6d5ac09)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:08.650929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168009eb-de6d-40d4-9b92-57b71c0ba7ec None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:08.662663 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 278/570] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:34:08 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/07e77369a94844529947de0f46a54edd/roles/1d095fda854f45db887c85e1d6d5ac09 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:34:08.663430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168009eb-de6d-40d4-9b92-57b71c0ba7ec None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.668945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01de80a-e5ee-4a95-bf27-4312bd18a433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.669761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01de80a-e5ee-4a95-bf27-4312bd18a433 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.670109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01de80a-e5ee-4a95-bf27-4312bd18a433 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.670389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01de80a-e5ee-4a95-bf27-4312bd18a433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.683135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01de80a-e5ee-4a95-bf27-4312bd18a433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:08.690413 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f01de80a-e5ee-4a95-bf27-4312bd18a433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:08.691671 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 293/571] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:08.692670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01de80a-e5ee-4a95-bf27-4312bd18a433 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.780269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168009eb-de6d-40d4-9b92-57b71c0ba7ec None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.807626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01de80a-e5ee-4a95-bf27-4312bd18a433 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.816678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a29a6-40ac-4dd7-a282-1645ed748e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.817344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a29a6-40ac-4dd7-a282-1645ed748e7a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.817625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a29a6-40ac-4dd7-a282-1645ed748e7a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.817899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a29a6-40ac-4dd7-a282-1645ed748e7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.843125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593989cc-32a5-42e3-96b7-430e39bc7c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:08.844261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593989cc-32a5-42e3-96b7-430e39bc7c56 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:08.844738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593989cc-32a5-42e3-96b7-430e39bc7c56 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:08.846076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593989cc-32a5-42e3-96b7-430e39bc7c56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:08.860317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593989cc-32a5-42e3-96b7-430e39bc7c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:08.867771 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-593989cc-32a5-42e3-96b7-430e39bc7c56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:08.869247 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 294/572] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:08.869841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593989cc-32a5-42e3-96b7-430e39bc7c56 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:08.894964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a29a6-40ac-4dd7-a282-1645ed748e7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:08.896997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a29a6-40ac-4dd7-a282-1645ed748e7a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:08.967165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593989cc-32a5-42e3-96b7-430e39bc7c56 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:08.998583 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 279/573] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:08.998583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a29a6-40ac-4dd7-a282-1645ed748e7a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.003271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20715143-e105-434c-95c9-4a37f11d3fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.004099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20715143-e105-434c-95c9-4a37f11d3fe8 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.004384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20715143-e105-434c-95c9-4a37f11d3fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.004658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20715143-e105-434c-95c9-4a37f11d3fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.015656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20715143-e105-434c-95c9-4a37f11d3fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.017152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20715143-e105-434c-95c9-4a37f11d3fe8 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.034351 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-20715143-e105-434c-95c9-4a37f11d3fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:09.040188 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 295/574] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:09.040188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20715143-e105-434c-95c9-4a37f11d3fe8 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.093557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a29a6-40ac-4dd7-a282-1645ed748e7a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.127607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c9583-a117-4c2a-bc9f-228617dd62ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.128193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c9583-a117-4c2a-bc9f-228617dd62ab None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.128480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c9583-a117-4c2a-bc9f-228617dd62ab None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.128758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c9583-a117-4c2a-bc9f-228617dd62ab None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.129550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c9583-a117-4c2a-bc9f-228617dd62ab None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:09.129866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c9583-a117-4c2a-bc9f-228617dd62ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.131813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152c9583-a117-4c2a-bc9f-228617dd62ab None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.138783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20715143-e105-434c-95c9-4a37f11d3fe8 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.144044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 280/575] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:09.144044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c9583-a117-4c2a-bc9f-228617dd62ab None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.172828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78709b-f1fc-4f35-bdec-1cbbe499212d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.173484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78709b-f1fc-4f35-bdec-1cbbe499212d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.173778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78709b-f1fc-4f35-bdec-1cbbe499212d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.174084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78709b-f1fc-4f35-bdec-1cbbe499212d None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.174830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78709b-f1fc-4f35-bdec-1cbbe499212d None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:09.175140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78709b-f1fc-4f35-bdec-1cbbe499212d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.176592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78709b-f1fc-4f35-bdec-1cbbe499212d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.184711 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 296/576] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:09.185301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78709b-f1fc-4f35-bdec-1cbbe499212d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.243509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c9583-a117-4c2a-bc9f-228617dd62ab None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.276443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72b3d4-6000-42bd-b384-8b4d7c732aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.277272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72b3d4-6000-42bd-b384-8b4d7c732aee None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.277463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72b3d4-6000-42bd-b384-8b4d7c732aee None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.277688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72b3d4-6000-42bd-b384-8b4d7c732aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.282862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78709b-f1fc-4f35-bdec-1cbbe499212d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.287851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72b3d4-6000-42bd-b384-8b4d7c732aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.289359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72b3d4-6000-42bd-b384-8b4d7c732aee None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.305371 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-4f72b3d4-6000-42bd-b384-8b4d7c732aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:09.306664 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 281/577] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:09.307298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72b3d4-6000-42bd-b384-8b4d7c732aee None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.317295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993517fc-8cab-49d0-b096-3e6ed0dd43d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.318020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993517fc-8cab-49d0-b096-3e6ed0dd43d8 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.318868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993517fc-8cab-49d0-b096-3e6ed0dd43d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.319219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993517fc-8cab-49d0-b096-3e6ed0dd43d8 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.320136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993517fc-8cab-49d0-b096-3e6ed0dd43d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:09.320421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993517fc-8cab-49d0-b096-3e6ed0dd43d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.321878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993517fc-8cab-49d0-b096-3e6ed0dd43d8 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.333435 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 297/578] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:09.335035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993517fc-8cab-49d0-b096-3e6ed0dd43d8 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.416125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72b3d4-6000-42bd-b384-8b4d7c732aee None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.432109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993517fc-8cab-49d0-b096-3e6ed0dd43d8 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.449617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f23c3-5a0c-4359-855d-04aa3e3e8dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.450488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f23c3-5a0c-4359-855d-04aa3e3e8dc2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.450839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f23c3-5a0c-4359-855d-04aa3e3e8dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.451179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f23c3-5a0c-4359-855d-04aa3e3e8dc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.462195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f23c3-5a0c-4359-855d-04aa3e3e8dc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.463747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f23c3-5a0c-4359-855d-04aa3e3e8dc2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.465888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2be22-8d04-4286-ab53-967322630730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.466751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2be22-8d04-4286-ab53-967322630730 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.467101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2be22-8d04-4286-ab53-967322630730 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.467448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2be22-8d04-4286-ab53-967322630730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.477891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2be22-8d04-4286-ab53-967322630730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.479412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2be22-8d04-4286-ab53-967322630730 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.480203 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-485f23c3-5a0c-4359-855d-04aa3e3e8dc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:09.485935 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 282/579] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:09.485935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f23c3-5a0c-4359-855d-04aa3e3e8dc2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.502717 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-dbb2be22-8d04-4286-ab53-967322630730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:09.509518 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 298/580] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:09.510434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2be22-8d04-4286-ab53-967322630730 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.580492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f23c3-5a0c-4359-855d-04aa3e3e8dc2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.614342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e25bc6-12e5-4532-86d4-3278d7db3995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.615001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e25bc6-12e5-4532-86d4-3278d7db3995 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.615343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e25bc6-12e5-4532-86d4-3278d7db3995 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.615624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e25bc6-12e5-4532-86d4-3278d7db3995 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.616382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e25bc6-12e5-4532-86d4-3278d7db3995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:09.616600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2be22-8d04-4286-ab53-967322630730 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.616711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e25bc6-12e5-4532-86d4-3278d7db3995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.618054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e25bc6-12e5-4532-86d4-3278d7db3995 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.634015 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 283/581] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:09.634882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e25bc6-12e5-4532-86d4-3278d7db3995 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.649420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847a358-732c-4780-8f2f-aeaf3a0d49cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.650294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847a358-732c-4780-8f2f-aeaf3a0d49cc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.650648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847a358-732c-4780-8f2f-aeaf3a0d49cc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.650997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847a358-732c-4780-8f2f-aeaf3a0d49cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.658379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847a358-732c-4780-8f2f-aeaf3a0d49cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.659894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847a358-732c-4780-8f2f-aeaf3a0d49cc None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.673825 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-6847a358-732c-4780-8f2f-aeaf3a0d49cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 26 20:34:09.675087 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 299/582] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:09.675894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847a358-732c-4780-8f2f-aeaf3a0d49cc None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.748587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e25bc6-12e5-4532-86d4-3278d7db3995 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.774994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847a358-732c-4780-8f2f-aeaf3a0d49cc None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.781846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050e95-39e5-42a5-a46d-4fb5a1dfe0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.782513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050e95-39e5-42a5-a46d-4fb5a1dfe0b8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.782797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050e95-39e5-42a5-a46d-4fb5a1dfe0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.783073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62050e95-39e5-42a5-a46d-4fb5a1dfe0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.783792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62050e95-39e5-42a5-a46d-4fb5a1dfe0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:09.784128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62050e95-39e5-42a5-a46d-4fb5a1dfe0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.785519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62050e95-39e5-42a5-a46d-4fb5a1dfe0b8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.797386 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 284/583] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:09.798226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050e95-39e5-42a5-a46d-4fb5a1dfe0b8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.822050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d961b4-e336-41ad-978a-17a285ce40ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.823479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d961b4-e336-41ad-978a-17a285ce40ac None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.823971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d961b4-e336-41ad-978a-17a285ce40ac None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.824545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d961b4-e336-41ad-978a-17a285ce40ac None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.825703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d961b4-e336-41ad-978a-17a285ce40ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:09.826157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d961b4-e336-41ad-978a-17a285ce40ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.827688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d961b4-e336-41ad-978a-17a285ce40ac None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.839693 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 300/584] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:09.840807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d961b4-e336-41ad-978a-17a285ce40ac None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.900803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62050e95-39e5-42a5-a46d-4fb5a1dfe0b8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.933941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63af4-5771-4355-a2ae-a84f8a6873ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.934740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63af4-5771-4355-a2ae-a84f8a6873ac None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.935032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63af4-5771-4355-a2ae-a84f8a6873ac None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.935304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63af4-5771-4355-a2ae-a84f8a6873ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.942080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea63af4-5771-4355-a2ae-a84f8a6873ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.943542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d961b4-e336-41ad-978a-17a285ce40ac None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:09.943657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea63af4-5771-4355-a2ae-a84f8a6873ac None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:09.957090 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-eea63af4-5771-4355-a2ae-a84f8a6873ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:09.963218 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 285/585] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:09.963218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63af4-5771-4355-a2ae-a84f8a6873ac None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:09.978307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5eb58-3dfa-4077-a832-bfb0a9aff30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:09.979122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5eb58-3dfa-4077-a832-bfb0a9aff30f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:09.979501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5eb58-3dfa-4077-a832-bfb0a9aff30f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:09.979877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5eb58-3dfa-4077-a832-bfb0a9aff30f None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:09.981907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5eb58-3dfa-4077-a832-bfb0a9aff30f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:09.981907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5eb58-3dfa-4077-a832-bfb0a9aff30f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:09.983384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5eb58-3dfa-4077-a832-bfb0a9aff30f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.001249 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 301/586] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:10.002354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5eb58-3dfa-4077-a832-bfb0a9aff30f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.059730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63af4-5771-4355-a2ae-a84f8a6873ac None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.092958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7508d2-6b90-4543-9e13-019c02a8b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.093775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7508d2-6b90-4543-9e13-019c02a8b4df None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.094059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7508d2-6b90-4543-9e13-019c02a8b4df None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.094333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7508d2-6b90-4543-9e13-019c02a8b4df None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.101471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7508d2-6b90-4543-9e13-019c02a8b4df None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.102931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7508d2-6b90-4543-9e13-019c02a8b4df None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.105540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5eb58-3dfa-4077-a832-bfb0a9aff30f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.116383 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-bd7508d2-6b90-4543-9e13-019c02a8b4df None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 26 20:34:10.122100 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 286/587] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:10.122100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7508d2-6b90-4543-9e13-019c02a8b4df None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.138431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60663-1df6-4515-8651-5c60aa08192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.139216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60663-1df6-4515-8651-5c60aa08192d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.139500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60663-1df6-4515-8651-5c60aa08192d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.139780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd60663-1df6-4515-8651-5c60aa08192d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.147289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd60663-1df6-4515-8651-5c60aa08192d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.148832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd60663-1df6-4515-8651-5c60aa08192d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.162314 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-5cd60663-1df6-4515-8651-5c60aa08192d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 26 20:34:10.163460 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 302/588] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:10.168173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60663-1df6-4515-8651-5c60aa08192d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.219017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7508d2-6b90-4543-9e13-019c02a8b4df None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.257198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c617d6e-dcbe-40ad-8a00-444a66398822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.257855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617d6e-dcbe-40ad-8a00-444a66398822 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.258136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617d6e-dcbe-40ad-8a00-444a66398822 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.258411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c617d6e-dcbe-40ad-8a00-444a66398822 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.259185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c617d6e-dcbe-40ad-8a00-444a66398822 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:10.259491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c617d6e-dcbe-40ad-8a00-444a66398822 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.260962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c617d6e-dcbe-40ad-8a00-444a66398822 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.267037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd60663-1df6-4515-8651-5c60aa08192d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.272166 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 287/589] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:10.272967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c617d6e-dcbe-40ad-8a00-444a66398822 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.300861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e06da0-8080-4de2-8a24-0e94daaba35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.301680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06da0-8080-4de2-8a24-0e94daaba35f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.301959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06da0-8080-4de2-8a24-0e94daaba35f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.302240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06da0-8080-4de2-8a24-0e94daaba35f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.313224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e06da0-8080-4de2-8a24-0e94daaba35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.314665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e06da0-8080-4de2-8a24-0e94daaba35f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.331595 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d6e06da0-8080-4de2-8a24-0e94daaba35f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:10.332800 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 303/590] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:10.337411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e06da0-8080-4de2-8a24-0e94daaba35f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.384972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c617d6e-dcbe-40ad-8a00-444a66398822 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.417380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96c092-c5bb-4515-83b3-a5fc20c98fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.418050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96c092-c5bb-4515-83b3-a5fc20c98fb6 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.418320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96c092-c5bb-4515-83b3-a5fc20c98fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.418599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96c092-c5bb-4515-83b3-a5fc20c98fb6 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.419573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96c092-c5bb-4515-83b3-a5fc20c98fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:10.419890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96c092-c5bb-4515-83b3-a5fc20c98fb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.421376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96c092-c5bb-4515-83b3-a5fc20c98fb6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.438668 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 288/591] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:10.439303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96c092-c5bb-4515-83b3-a5fc20c98fb6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.448520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e06da0-8080-4de2-8a24-0e94daaba35f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.481694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e54361-a75f-4a8b-b604-e72f710fa27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.482297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e54361-a75f-4a8b-b604-e72f710fa27b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.482585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e54361-a75f-4a8b-b604-e72f710fa27b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.482872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e54361-a75f-4a8b-b604-e72f710fa27b None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.483689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e54361-a75f-4a8b-b604-e72f710fa27b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:10.484036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e54361-a75f-4a8b-b604-e72f710fa27b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.485466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e54361-a75f-4a8b-b604-e72f710fa27b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.503408 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 304/592] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:10.504278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e54361-a75f-4a8b-b604-e72f710fa27b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.541571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96c092-c5bb-4515-83b3-a5fc20c98fb6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.573653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c925e34-e4bf-4947-90c6-6e2e4698710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.574299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c925e34-e4bf-4947-90c6-6e2e4698710e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.574576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c925e34-e4bf-4947-90c6-6e2e4698710e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.574844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c925e34-e4bf-4947-90c6-6e2e4698710e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.575660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c925e34-e4bf-4947-90c6-6e2e4698710e None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=08d764c8ff5f48a092bd69030c5e1b47) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:10.575989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c925e34-e4bf-4947-90c6-6e2e4698710e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.577460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c925e34-e4bf-4947-90c6-6e2e4698710e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.591951 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 289/593] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/role_assignments?user.id=08d764c8ff5f48a092bd69030c5e1b47&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:10.591951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c925e34-e4bf-4947-90c6-6e2e4698710e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.616318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e54361-a75f-4a8b-b604-e72f710fa27b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.665887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debe6e-bad0-4579-bc91-eba4818d6d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.666675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debe6e-bad0-4579-bc91-eba4818d6d99 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.667203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debe6e-bad0-4579-bc91-eba4818d6d99 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.667553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debe6e-bad0-4579-bc91-eba4818d6d99 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.668866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debe6e-bad0-4579-bc91-eba4818d6d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:10.669449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debe6e-bad0-4579-bc91-eba4818d6d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.671264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debe6e-bad0-4579-bc91-eba4818d6d99 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.692108 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 305/594] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:10.693071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debe6e-bad0-4579-bc91-eba4818d6d99 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.730466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c925e34-e4bf-4947-90c6-6e2e4698710e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.776980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f995c-2ac2-466e-89ff-84ac14ae42ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.778485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f995c-2ac2-466e-89ff-84ac14ae42ec None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.779129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f995c-2ac2-466e-89ff-84ac14ae42ec None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.779129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f995c-2ac2-466e-89ff-84ac14ae42ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.790222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f995c-2ac2-466e-89ff-84ac14ae42ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.791692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f995c-2ac2-466e-89ff-84ac14ae42ec None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.804507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debe6e-bad0-4579-bc91-eba4818d6d99 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.812498 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-3a4f995c-2ac2-466e-89ff-84ac14ae42ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:10.814370 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 290/595] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:10.815215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f995c-2ac2-466e-89ff-84ac14ae42ec None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.843975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53194a60-0448-4222-b2fb-c28b88bba422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.844772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53194a60-0448-4222-b2fb-c28b88bba422 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.845301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53194a60-0448-4222-b2fb-c28b88bba422 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.845590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53194a60-0448-4222-b2fb-c28b88bba422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.856431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53194a60-0448-4222-b2fb-c28b88bba422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.857951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53194a60-0448-4222-b2fb-c28b88bba422 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.874949 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-53194a60-0448-4222-b2fb-c28b88bba422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:10.876493 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 306/596] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:10.877305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53194a60-0448-4222-b2fb-c28b88bba422 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:10.922610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f995c-2ac2-466e-89ff-84ac14ae42ec None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.956912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0151d-0ec5-4d4d-a815-37eedeed41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:10.957703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0151d-0ec5-4d4d-a815-37eedeed41d0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:10.957983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0151d-0ec5-4d4d-a815-37eedeed41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:10.958258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0151d-0ec5-4d4d-a815-37eedeed41d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:10.965767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0151d-0ec5-4d4d-a815-37eedeed41d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:10.967243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0151d-0ec5-4d4d-a815-37eedeed41d0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:10.980404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53194a60-0448-4222-b2fb-c28b88bba422 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:10.980745 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d1c0151d-0ec5-4d4d-a815-37eedeed41d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:10.982098 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 291/597] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:10.982692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0151d-0ec5-4d4d-a815-37eedeed41d0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.024616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361741b-7911-4c6f-b87e-7359f80ac4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.025461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361741b-7911-4c6f-b87e-7359f80ac4bc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.025894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361741b-7911-4c6f-b87e-7359f80ac4bc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.026315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361741b-7911-4c6f-b87e-7359f80ac4bc None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.027294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361741b-7911-4c6f-b87e-7359f80ac4bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:11.027810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361741b-7911-4c6f-b87e-7359f80ac4bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:11.029420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361741b-7911-4c6f-b87e-7359f80ac4bc None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:11.042813 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 307/598] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:11.043837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361741b-7911-4c6f-b87e-7359f80ac4bc None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.089393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0151d-0ec5-4d4d-a815-37eedeed41d0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:11.121737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6435d-9239-4832-9705-74cf0426bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.122389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6435d-9239-4832-9705-74cf0426bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.122664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6435d-9239-4832-9705-74cf0426bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.122939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6435d-9239-4832-9705-74cf0426bdd6 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.123650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6435d-9239-4832-9705-74cf0426bdd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:11.124000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6435d-9239-4832-9705-74cf0426bdd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:11.125375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6435d-9239-4832-9705-74cf0426bdd6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:11.141760 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 292/599] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:11.141760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6435d-9239-4832-9705-74cf0426bdd6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.150109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361741b-7911-4c6f-b87e-7359f80ac4bc None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:11.183384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e009d5-c674-4e26-a010-21824920bb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.184071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e009d5-c674-4e26-a010-21824920bb04 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.184336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e009d5-c674-4e26-a010-21824920bb04 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.184613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e009d5-c674-4e26-a010-21824920bb04 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.185383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e009d5-c674-4e26-a010-21824920bb04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:11.185686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e009d5-c674-4e26-a010-21824920bb04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:11.187218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e009d5-c674-4e26-a010-21824920bb04 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:11.202813 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 308/600] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:11.202813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383cf67-fc17-4f88-9bf4-62b347e55aa0 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.202813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383cf67-fc17-4f88-9bf4-62b347e55aa0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.202813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383cf67-fc17-4f88-9bf4-62b347e55aa0 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.202813 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 309/601] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:11.202813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383cf67-fc17-4f88-9bf4-62b347e55aa0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.244433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6435d-9239-4832-9705-74cf0426bdd6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:11.277161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba8512-cef0-42ae-87ab-fcf5c9f72e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.278265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba8512-cef0-42ae-87ab-fcf5c9f72e0f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.278691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba8512-cef0-42ae-87ab-fcf5c9f72e0f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.279239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba8512-cef0-42ae-87ab-fcf5c9f72e0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.287623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba8512-cef0-42ae-87ab-fcf5c9f72e0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:11.288541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba8512-cef0-42ae-87ab-fcf5c9f72e0f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:11.301364 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b0ba8512-cef0-42ae-87ab-fcf5c9f72e0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:11.301655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383cf67-fc17-4f88-9bf4-62b347e55aa0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:11.307180 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 293/602] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:11.307180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba8512-cef0-42ae-87ab-fcf5c9f72e0f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.336607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b78e7a3-611a-4a2c-aa53-a2bb2469860f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.337393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78e7a3-611a-4a2c-aa53-a2bb2469860f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.337675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78e7a3-611a-4a2c-aa53-a2bb2469860f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.337953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b78e7a3-611a-4a2c-aa53-a2bb2469860f None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.344624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78e7a3-611a-4a2c-aa53-a2bb2469860f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:11.346343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b78e7a3-611a-4a2c-aa53-a2bb2469860f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:11.360064 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-6b78e7a3-611a-4a2c-aa53-a2bb2469860f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:11.366706 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 310/603] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:11.366706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba798d71-c01d-4727-bc70-d769678647be None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.366706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba798d71-c01d-4727-bc70-d769678647be None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.366706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba798d71-c01d-4727-bc70-d769678647be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.381430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ba798d71-c01d-4727-bc70-d769678647be None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:11.382711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ba798d71-c01d-4727-bc70-d769678647be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:11.408523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba8512-cef0-42ae-87ab-fcf5c9f72e0f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:11.442813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3576aff-9a29-48b2-91b3-6e04907cd896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.443745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576aff-9a29-48b2-91b3-6e04907cd896 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.444059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576aff-9a29-48b2-91b3-6e04907cd896 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.444332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3576aff-9a29-48b2-91b3-6e04907cd896 None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/82c1da5e55da4bf380e86064d66e638b/roles/1d095fda854f45db887c85e1d6d5ac09` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.459518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3576aff-9a29-48b2-91b3-6e04907cd896 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=82c1da5e55da4bf380e86064d66e638b, role_id=1d095fda854f45db887c85e1d6d5ac09)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:11.461028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3576aff-9a29-48b2-91b3-6e04907cd896 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:11.463307 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 311/604] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:11.472520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba798d71-c01d-4727-bc70-d769678647be None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.478415 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 294/605] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:34:11 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/82c1da5e55da4bf380e86064d66e638b/roles/1d095fda854f45db887c85e1d6d5ac09 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:34:11.479042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3576aff-9a29-48b2-91b3-6e04907cd896 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.603247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3576aff-9a29-48b2-91b3-6e04907cd896 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:11.638875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4707f5-edcf-49c3-beb4-ad5f6aaf11ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.639572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4707f5-edcf-49c3-beb4-ad5f6aaf11ba None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.639861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4707f5-edcf-49c3-beb4-ad5f6aaf11ba None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.640298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4707f5-edcf-49c3-beb4-ad5f6aaf11ba None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.641091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4707f5-edcf-49c3-beb4-ad5f6aaf11ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:11.641400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4707f5-edcf-49c3-beb4-ad5f6aaf11ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:11.642870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4707f5-edcf-49c3-beb4-ad5f6aaf11ba None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:11.656130 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 295/606] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:11.657104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4707f5-edcf-49c3-beb4-ad5f6aaf11ba None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.665666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba798d71-c01d-4727-bc70-d769678647be None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:11.708331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc335f8-c90f-4775-a73e-4e157f72fddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.709044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc335f8-c90f-4775-a73e-4e157f72fddf None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.709325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc335f8-c90f-4775-a73e-4e157f72fddf None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.709602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc335f8-c90f-4775-a73e-4e157f72fddf None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.710388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc335f8-c90f-4775-a73e-4e157f72fddf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:11.710700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc335f8-c90f-4775-a73e-4e157f72fddf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:11.712173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc335f8-c90f-4775-a73e-4e157f72fddf None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:11.724674 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 312/607] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:11.725477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc335f8-c90f-4775-a73e-4e157f72fddf None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.761769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4707f5-edcf-49c3-beb4-ad5f6aaf11ba None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:11.795403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4fb59-658a-43f4-a44c-50eeb030ea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.796229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4fb59-658a-43f4-a44c-50eeb030ea41 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.796509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4fb59-658a-43f4-a44c-50eeb030ea41 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.796784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4fb59-658a-43f4-a44c-50eeb030ea41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.807759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4fb59-658a-43f4-a44c-50eeb030ea41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:11.814711 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d1e4fb59-658a-43f4-a44c-50eeb030ea41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:11.821245 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 296/608] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:11.822075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4fb59-658a-43f4-a44c-50eeb030ea41 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.830467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc335f8-c90f-4775-a73e-4e157f72fddf None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:11.866767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a24d4-2281-43ec-9266-e836ba20c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:11.867572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a24d4-2281-43ec-9266-e836ba20c779 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:11.867857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a24d4-2281-43ec-9266-e836ba20c779 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:11.868172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a24d4-2281-43ec-9266-e836ba20c779 None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/416ac158078b4b678c236e0ad811acad/roles/1d095fda854f45db887c85e1d6d5ac09` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:11.893207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a24d4-2281-43ec-9266-e836ba20c779 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=416ac158078b4b678c236e0ad811acad, role_id=1d095fda854f45db887c85e1d6d5ac09)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:11.894680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a24d4-2281-43ec-9266-e836ba20c779 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:11.913959 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 313/609] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:34:11 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/416ac158078b4b678c236e0ad811acad/roles/1d095fda854f45db887c85e1d6d5ac09 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:34:11.916527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a24d4-2281-43ec-9266-e836ba20c779 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:11.952831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4fb59-658a-43f4-a44c-50eeb030ea41 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:12.032437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33503206-7292-4e8c-abef-6070c703af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:12.033402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33503206-7292-4e8c-abef-6070c703af52 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:12.033726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33503206-7292-4e8c-abef-6070c703af52 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:12.033999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33503206-7292-4e8c-abef-6070c703af52 None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/71808360397a42cab9196c51547e33e0/roles/1d095fda854f45db887c85e1d6d5ac09` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:12.066310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33503206-7292-4e8c-abef-6070c703af52 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=71808360397a42cab9196c51547e33e0, role_id=1d095fda854f45db887c85e1d6d5ac09)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:12.067813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33503206-7292-4e8c-abef-6070c703af52 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:12.098873 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 297/610] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:34:11 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/71808360397a42cab9196c51547e33e0/roles/1d095fda854f45db887c85e1d6d5ac09 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:34:12.115624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a24d4-2281-43ec-9266-e836ba20c779 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:12.153696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e3d00-15af-4d0e-a69e-a19c7c7583b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:12.154285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e3d00-15af-4d0e-a69e-a19c7c7583b3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:12.154568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e3d00-15af-4d0e-a69e-a19c7c7583b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:12.154843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e3d00-15af-4d0e-a69e-a19c7c7583b3 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:12.155578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e3d00-15af-4d0e-a69e-a19c7c7583b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:12.155947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e3d00-15af-4d0e-a69e-a19c7c7583b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:12.157343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e3d00-15af-4d0e-a69e-a19c7c7583b3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:12.170300 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 314/611] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:12.176322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33503206-7292-4e8c-abef-6070c703af52 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:12.296723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33503206-7292-4e8c-abef-6070c703af52 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:12.331673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c16f9-561f-4086-a739-54effdc9cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:12.332568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c16f9-561f-4086-a739-54effdc9cfee None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:12.332845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c16f9-561f-4086-a739-54effdc9cfee None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:12.333169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c16f9-561f-4086-a739-54effdc9cfee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:12.349971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c16f9-561f-4086-a739-54effdc9cfee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:12.351455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c16f9-561f-4086-a739-54effdc9cfee None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:12.372539 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-916c16f9-561f-4086-a739-54effdc9cfee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:12.375020 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 298/612] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:12.379646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e3d00-15af-4d0e-a69e-a19c7c7583b3 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:12.493548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e3d00-15af-4d0e-a69e-a19c7c7583b3 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:12.540551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef265d7-ad81-4db8-92c3-622463383125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:12.541578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef265d7-ad81-4db8-92c3-622463383125 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:12.542103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef265d7-ad81-4db8-92c3-622463383125 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:12.542576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef265d7-ad81-4db8-92c3-622463383125 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:12.543488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef265d7-ad81-4db8-92c3-622463383125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:12.544022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef265d7-ad81-4db8-92c3-622463383125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:12.545586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef265d7-ad81-4db8-92c3-622463383125 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:12.563318 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 315/613] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:12.568926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c16f9-561f-4086-a739-54effdc9cfee None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:12.715887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c16f9-561f-4086-a739-54effdc9cfee None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:12.761566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86644-e358-4a09-828d-55c2fa86ae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:12.762276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86644-e358-4a09-828d-55c2fa86ae12 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:12.762556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86644-e358-4a09-828d-55c2fa86ae12 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:12.762831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f86644-e358-4a09-828d-55c2fa86ae12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:12.773917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86644-e358-4a09-828d-55c2fa86ae12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:12.775371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f86644-e358-4a09-828d-55c2fa86ae12 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:12.792626 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-c8f86644-e358-4a09-828d-55c2fa86ae12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 26 20:34:12.794150 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 299/614] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Mar 26 20:34:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:12.799702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef265d7-ad81-4db8-92c3-622463383125 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:12.942465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef265d7-ad81-4db8-92c3-622463383125 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:12.992604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aaced-1d7f-4bc4-8cd4-a717c7c2b243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:12.993278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aaced-1d7f-4bc4-8cd4-a717c7c2b243 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:12.993563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aaced-1d7f-4bc4-8cd4-a717c7c2b243 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:12.993840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aaced-1d7f-4bc4-8cd4-a717c7c2b243 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:12.994669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aaced-1d7f-4bc4-8cd4-a717c7c2b243 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:12.994978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aaced-1d7f-4bc4-8cd4-a717c7c2b243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:12.996447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8aaced-1d7f-4bc4-8cd4-a717c7c2b243 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:13.019384 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 316/615] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Mar 26 20:34:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:13.029156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86644-e358-4a09-828d-55c2fa86ae12 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:13.158639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f86644-e358-4a09-828d-55c2fa86ae12 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:13.204344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635d2ac-68ad-49b0-84c8-3dcd3ca8b1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:13.204991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635d2ac-68ad-49b0-84c8-3dcd3ca8b1fd None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:13.205275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635d2ac-68ad-49b0-84c8-3dcd3ca8b1fd None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:13.205553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635d2ac-68ad-49b0-84c8-3dcd3ca8b1fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:13.226275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01cd38-98ce-480c-b404-0fdf714deb67 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:13.226882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01cd38-98ce-480c-b404-0fdf714deb67 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:13.227366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01cd38-98ce-480c-b404-0fdf714deb67 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:13.229611 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 317/616] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:13.236525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105525b2-f275-4220-9b6e-fc4e61d73931 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:13.236811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105525b2-f275-4220-9b6e-fc4e61d73931 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:13.237089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105525b2-f275-4220-9b6e-fc4e61d73931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:13.268586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-105525b2-f275-4220-9b6e-fc4e61d73931 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:13.269823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-105525b2-f275-4220-9b6e-fc4e61d73931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:13.312468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635d2ac-68ad-49b0-84c8-3dcd3ca8b1fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:13.313949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635d2ac-68ad-49b0-84c8-3dcd3ca8b1fd None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:13.392585 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 318/617] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:13.467654 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 300/618] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:13.473231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105525b2-f275-4220-9b6e-fc4e61d73931 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:13.488538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635d2ac-68ad-49b0-84c8-3dcd3ca8b1fd None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:13.582788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105525b2-f275-4220-9b6e-fc4e61d73931 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:13.592838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635d2ac-68ad-49b0-84c8-3dcd3ca8b1fd None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:13.624920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf010d-f2bc-44b0-accc-1f62501958eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:13.625713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf010d-f2bc-44b0-accc-1f62501958eb None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:13.625996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf010d-f2bc-44b0-accc-1f62501958eb None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:13.626271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf010d-f2bc-44b0-accc-1f62501958eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:13.636943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c40305-c04d-40e6-aff0-24d04da26e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:13.637739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c40305-c04d-40e6-aff0-24d04da26e8c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:13.638015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c40305-c04d-40e6-aff0-24d04da26e8c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:13.638283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c40305-c04d-40e6-aff0-24d04da26e8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:13.642791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf010d-f2bc-44b0-accc-1f62501958eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:13.644285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf010d-f2bc-44b0-accc-1f62501958eb None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:13.658516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c40305-c04d-40e6-aff0-24d04da26e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:13.666000 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-71c40305-c04d-40e6-aff0-24d04da26e8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:13.667191 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 301/619] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:13.676860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c40305-c04d-40e6-aff0-24d04da26e8c None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:13.685851 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-c3bf010d-f2bc-44b0-accc-1f62501958eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:13.687486 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 319/620] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:13.695667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf010d-f2bc-44b0-accc-1f62501958eb None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:13.808880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c40305-c04d-40e6-aff0-24d04da26e8c None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:13.852190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa6ed-0297-404d-9c5c-5916c4e0d975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:13.852780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa6ed-0297-404d-9c5c-5916c4e0d975 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:13.853105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa6ed-0297-404d-9c5c-5916c4e0d975 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:13.853384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030aa6ed-0297-404d-9c5c-5916c4e0d975 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:13.854130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030aa6ed-0297-404d-9c5c-5916c4e0d975 None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:13.854434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030aa6ed-0297-404d-9c5c-5916c4e0d975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:13.855837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030aa6ed-0297-404d-9c5c-5916c4e0d975 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:13.872027 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 302/621] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:13.873974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa6ed-0297-404d-9c5c-5916c4e0d975 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:13.910048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf010d-f2bc-44b0-accc-1f62501958eb None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:13.976918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff77e9-b061-44e4-a757-7824e285a02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:13.978156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff77e9-b061-44e4-a757-7824e285a02b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:13.978756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff77e9-b061-44e4-a757-7824e285a02b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:13.980157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff77e9-b061-44e4-a757-7824e285a02b None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:13.981639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff77e9-b061-44e4-a757-7824e285a02b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:13.982367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff77e9-b061-44e4-a757-7824e285a02b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:13.984523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff77e9-b061-44e4-a757-7824e285a02b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:14.002808 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 320/622] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:14.008396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff77e9-b061-44e4-a757-7824e285a02b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:14.076420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030aa6ed-0297-404d-9c5c-5916c4e0d975 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.139331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebb7e7-f7f8-4768-938a-7357de87ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.140827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebb7e7-f7f8-4768-938a-7357de87ded6 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.141275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebb7e7-f7f8-4768-938a-7357de87ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.141689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebb7e7-f7f8-4768-938a-7357de87ded6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.154308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebb7e7-f7f8-4768-938a-7357de87ded6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:14.155995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebb7e7-f7f8-4768-938a-7357de87ded6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:14.174883 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-edebb7e7-f7f8-4768-938a-7357de87ded6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:14.180171 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 303/623] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:14.182806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebb7e7-f7f8-4768-938a-7357de87ded6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:14.213913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff77e9-b061-44e4-a757-7824e285a02b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.249135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c5176-dbf7-4f3a-a36f-87a79a1356cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.250311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c5176-dbf7-4f3a-a36f-87a79a1356cb None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.250793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c5176-dbf7-4f3a-a36f-87a79a1356cb None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.251264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c5176-dbf7-4f3a-a36f-87a79a1356cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.258412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c5176-dbf7-4f3a-a36f-87a79a1356cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:14.260122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c5176-dbf7-4f3a-a36f-87a79a1356cb None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:14.273860 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-ed3c5176-dbf7-4f3a-a36f-87a79a1356cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:14.275683 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 321/624] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:14.277176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9cb81-7e71-4351-9c97-e64d7b9b0676 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.277666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9cb81-7e71-4351-9c97-e64d7b9b0676 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.278141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9cb81-7e71-4351-9c97-e64d7b9b0676 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.280512 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 322/625] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:14.281427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9cb81-7e71-4351-9c97-e64d7b9b0676 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:14.285018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebb7e7-f7f8-4768-938a-7357de87ded6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.320558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af8cd-7b52-4e8b-bd72-40d7916b48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.321217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af8cd-7b52-4e8b-bd72-40d7916b48bc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.321496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af8cd-7b52-4e8b-bd72-40d7916b48bc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.321825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af8cd-7b52-4e8b-bd72-40d7916b48bc None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.322539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af8cd-7b52-4e8b-bd72-40d7916b48bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:14.322891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af8cd-7b52-4e8b-bd72-40d7916b48bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:14.324333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af8cd-7b52-4e8b-bd72-40d7916b48bc None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:14.341665 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 304/626] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:14.343239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a358ed-1ad7-4ac8-9ede-1b291dd43958 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.343674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a358ed-1ad7-4ac8-9ede-1b291dd43958 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.344549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a358ed-1ad7-4ac8-9ede-1b291dd43958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.363832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b3a358ed-1ad7-4ac8-9ede-1b291dd43958 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:14.366032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b3a358ed-1ad7-4ac8-9ede-1b291dd43958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:14.391363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9cb81-7e71-4351-9c97-e64d7b9b0676 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.426243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68d3df-3abf-4515-848a-7de3500ae2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.428280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68d3df-3abf-4515-848a-7de3500ae2f3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.428785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68d3df-3abf-4515-848a-7de3500ae2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.429254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68d3df-3abf-4515-848a-7de3500ae2f3 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.430249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68d3df-3abf-4515-848a-7de3500ae2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:14.430753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68d3df-3abf-4515-848a-7de3500ae2f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:14.432446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68d3df-3abf-4515-848a-7de3500ae2f3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:14.437918 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 305/627] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:14.439057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a358ed-1ad7-4ac8-9ede-1b291dd43958 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:14.446314 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 323/628] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:14.457166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68d3df-3abf-4515-848a-7de3500ae2f3 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:14.549047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a358ed-1ad7-4ac8-9ede-1b291dd43958 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.557557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68d3df-3abf-4515-848a-7de3500ae2f3 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.582676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72902ffd-21b0-4b9a-9157-6c65a172a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.584413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902ffd-21b0-4b9a-9157-6c65a172a341 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.584839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902ffd-21b0-4b9a-9157-6c65a172a341 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.585289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72902ffd-21b0-4b9a-9157-6c65a172a341 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.592458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588fddf-25d8-4a1d-aa13-ab1fbd63aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.593103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588fddf-25d8-4a1d-aa13-ab1fbd63aa5d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.593382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588fddf-25d8-4a1d-aa13-ab1fbd63aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.593679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588fddf-25d8-4a1d-aa13-ab1fbd63aa5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.594481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588fddf-25d8-4a1d-aa13-ab1fbd63aa5d None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=07e77369a94844529947de0f46a54edd) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:14.594792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588fddf-25d8-4a1d-aa13-ab1fbd63aa5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:14.595255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72902ffd-21b0-4b9a-9157-6c65a172a341 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:14.596525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588fddf-25d8-4a1d-aa13-ab1fbd63aa5d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:14.597475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72902ffd-21b0-4b9a-9157-6c65a172a341 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:14.603095 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 324/629] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:14 2022] GET /identity/v3/role_assignments?user.id=07e77369a94844529947de0f46a54edd&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:14.603909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588fddf-25d8-4a1d-aa13-ab1fbd63aa5d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:14.612672 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-72902ffd-21b0-4b9a-9157-6c65a172a341 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 26 20:34:14.618871 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 306/630] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:14.620370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72902ffd-21b0-4b9a-9157-6c65a172a341 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:14.708171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588fddf-25d8-4a1d-aa13-ab1fbd63aa5d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.727528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72902ffd-21b0-4b9a-9157-6c65a172a341 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.744173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0527e-1f6d-485a-9bf6-512317e22e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.744980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0527e-1f6d-485a-9bf6-512317e22e07 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.745264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0527e-1f6d-485a-9bf6-512317e22e07 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.745542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f0527e-1f6d-485a-9bf6-512317e22e07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.757461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f0527e-1f6d-485a-9bf6-512317e22e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:14.765158 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-91f0527e-1f6d-485a-9bf6-512317e22e07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:14.766285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd8d83-c53c-4a3f-ab27-0266ada3038d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.766778 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 325/631] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:14.767526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8d83-c53c-4a3f-ab27-0266ada3038d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.767815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8d83-c53c-4a3f-ab27-0266ada3038d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.768125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8d83-c53c-4a3f-ab27-0266ada3038d None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.768957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd8d83-c53c-4a3f-ab27-0266ada3038d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:14.769263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd8d83-c53c-4a3f-ab27-0266ada3038d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:14.770703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd8d83-c53c-4a3f-ab27-0266ada3038d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:14.771999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0527e-1f6d-485a-9bf6-512317e22e07 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:14.795259 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 307/632] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Mar 26 20:34:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:14.796853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e987c-7eb8-442d-bebb-6ae8ae226a95 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.797143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e987c-7eb8-442d-bebb-6ae8ae226a95 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.797416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e987c-7eb8-442d-bebb-6ae8ae226a95 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.800185 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 308/633] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:14.800741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e987c-7eb8-442d-bebb-6ae8ae226a95 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:14.895659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f0527e-1f6d-485a-9bf6-512317e22e07 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.924502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e987c-7eb8-442d-bebb-6ae8ae226a95 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:14.933585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92558e7-60bf-4ccb-84c4-a04dc81eccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.934264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92558e7-60bf-4ccb-84c4-a04dc81eccc3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.934550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92558e7-60bf-4ccb-84c4-a04dc81eccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.934830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92558e7-60bf-4ccb-84c4-a04dc81eccc3 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.935568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92558e7-60bf-4ccb-84c4-a04dc81eccc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:14.936123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92558e7-60bf-4ccb-84c4-a04dc81eccc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:14.937475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92558e7-60bf-4ccb-84c4-a04dc81eccc3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:14.948682 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 326/634] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:14.950388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4bcf-4247-4bdd-961b-36c49b319d81 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.950694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4bcf-4247-4bdd-961b-36c49b319d81 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.950974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c4bcf-4247-4bdd-961b-36c49b319d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.966630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae55d6-01f3-4e98-b423-cd0b2664aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:14.967409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae55d6-01f3-4e98-b423-cd0b2664aa17 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:14.967697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae55d6-01f3-4e98-b423-cd0b2664aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:14.968017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae55d6-01f3-4e98-b423-cd0b2664aa17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:14.968248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-637c4bcf-4247-4bdd-961b-36c49b319d81 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:14.969413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-637c4bcf-4247-4bdd-961b-36c49b319d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:14.981997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae55d6-01f3-4e98-b423-cd0b2664aa17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:14.983703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae55d6-01f3-4e98-b423-cd0b2664aa17 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:15.003138 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-74ae55d6-01f3-4e98-b423-cd0b2664aa17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:15.004683 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 309/635] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:15.005503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae55d6-01f3-4e98-b423-cd0b2664aa17 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.049420 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 327/636] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:15.050109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4bcf-4247-4bdd-961b-36c49b319d81 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.129016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae55d6-01f3-4e98-b423-cd0b2664aa17 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.159709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c4bcf-4247-4bdd-961b-36c49b319d81 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.166296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079af7d-b606-46f4-9ad0-ed6469937d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.167369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079af7d-b606-46f4-9ad0-ed6469937d01 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.167860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079af7d-b606-46f4-9ad0-ed6469937d01 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.168361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079af7d-b606-46f4-9ad0-ed6469937d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.179102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079af7d-b606-46f4-9ad0-ed6469937d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:15.180912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079af7d-b606-46f4-9ad0-ed6469937d01 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:15.194506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea704ed-8274-489a-a0b3-8ecdc1c11922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.195164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea704ed-8274-489a-a0b3-8ecdc1c11922 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.195443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea704ed-8274-489a-a0b3-8ecdc1c11922 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.195772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea704ed-8274-489a-a0b3-8ecdc1c11922 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.196525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea704ed-8274-489a-a0b3-8ecdc1c11922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:15.196833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea704ed-8274-489a-a0b3-8ecdc1c11922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:15.198215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea704ed-8274-489a-a0b3-8ecdc1c11922 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:15.201921 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0079af7d-b606-46f4-9ad0-ed6469937d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:15.203639 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 310/637] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:15.209674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079af7d-b606-46f4-9ad0-ed6469937d01 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.211129 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 328/638] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:15.212042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea704ed-8274-489a-a0b3-8ecdc1c11922 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.307332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079af7d-b606-46f4-9ad0-ed6469937d01 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.315259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea704ed-8274-489a-a0b3-8ecdc1c11922 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.340964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c7a10-b374-416a-a7ae-be74559a3173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.341756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c7a10-b374-416a-a7ae-be74559a3173 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.342038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c7a10-b374-416a-a7ae-be74559a3173 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.342317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c7a10-b374-416a-a7ae-be74559a3173 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.349744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290b5b2-d2dd-403e-9e63-5da4c03b3919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.350399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290b5b2-d2dd-403e-9e63-5da4c03b3919 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.350681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290b5b2-d2dd-403e-9e63-5da4c03b3919 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.350955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290b5b2-d2dd-403e-9e63-5da4c03b3919 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.351664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290b5b2-d2dd-403e-9e63-5da4c03b3919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:15.351994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290b5b2-d2dd-403e-9e63-5da4c03b3919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:15.353368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290b5b2-d2dd-403e-9e63-5da4c03b3919 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:15.354124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c7a10-b374-416a-a7ae-be74559a3173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:15.361152 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-806c7a10-b374-416a-a7ae-be74559a3173 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:15.370914 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 311/639] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:15.371094 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 329/640] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:15.371189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c7a10-b374-416a-a7ae-be74559a3173 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.371286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20cb2b-7e2d-4205-a357-ea474b84c12b None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.371286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20cb2b-7e2d-4205-a357-ea474b84c12b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.371286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20cb2b-7e2d-4205-a357-ea474b84c12b None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.371286 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 330/641] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:15.372494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20cb2b-7e2d-4205-a357-ea474b84c12b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.476638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c7a10-b374-416a-a7ae-be74559a3173 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.481646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20cb2b-7e2d-4205-a357-ea474b84c12b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.510805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9ff04-08e2-4abd-ab84-d8f1424dbe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.511591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9ff04-08e2-4abd-ab84-d8f1424dbe7b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.511882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9ff04-08e2-4abd-ab84-d8f1424dbe7b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.512193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9ff04-08e2-4abd-ab84-d8f1424dbe7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.515932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d4596-04de-4c01-ad56-c8f981b86a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.516724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d4596-04de-4c01-ad56-c8f981b86a77 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.517004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d4596-04de-4c01-ad56-c8f981b86a77 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.517279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d4596-04de-4c01-ad56-c8f981b86a77 None admin] PATH_INFO: `/v3/users/glance` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.518820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9ff04-08e2-4abd-ab84-d8f1424dbe7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:15.520317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9ff04-08e2-4abd-ab84-d8f1424dbe7b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:15.524324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d4596-04de-4c01-ad56-c8f981b86a77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:15.525750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d4596-04de-4c01-ad56-c8f981b86a77 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:15.533569 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-a9a9ff04-08e2-4abd-ab84-d8f1424dbe7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:15.538945 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d14d4596-04de-4c01-ad56-c8f981b86a77 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 26 20:34:15.539547 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 312/642] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:15.544331 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 331/643] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:15.544460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9ff04-08e2-4abd-ab84-d8f1424dbe7b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.544547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5855ab-e1e3-4a3d-b8ba-def51162fa56 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.544547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5855ab-e1e3-4a3d-b8ba-def51162fa56 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.544547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5855ab-e1e3-4a3d-b8ba-def51162fa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.559299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8b5855ab-e1e3-4a3d-b8ba-def51162fa56 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:15.560441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8b5855ab-e1e3-4a3d-b8ba-def51162fa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:15.624451 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 332/644] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:15.625096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5855ab-e1e3-4a3d-b8ba-def51162fa56 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.650849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9ff04-08e2-4abd-ab84-d8f1424dbe7b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.684549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f20636-42b7-4f82-b094-ef097b3be999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.685212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f20636-42b7-4f82-b094-ef097b3be999 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.685499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f20636-42b7-4f82-b094-ef097b3be999 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.685769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f20636-42b7-4f82-b094-ef097b3be999 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.686516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f20636-42b7-4f82-b094-ef097b3be999 None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:15.686826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f20636-42b7-4f82-b094-ef097b3be999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:15.688303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f20636-42b7-4f82-b094-ef097b3be999 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:15.701032 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 313/645] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:15.701032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f20636-42b7-4f82-b094-ef097b3be999 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.725841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5855ab-e1e3-4a3d-b8ba-def51162fa56 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.765094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078876f-2e9f-422b-b6c2-56dc2400d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.765745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078876f-2e9f-422b-b6c2-56dc2400d14d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.766187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078876f-2e9f-422b-b6c2-56dc2400d14d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.766464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078876f-2e9f-422b-b6c2-56dc2400d14d None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.767713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078876f-2e9f-422b-b6c2-56dc2400d14d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:15.768051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078876f-2e9f-422b-b6c2-56dc2400d14d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:15.769906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0078876f-2e9f-422b-b6c2-56dc2400d14d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:15.789331 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 333/646] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:15.789331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078876f-2e9f-422b-b6c2-56dc2400d14d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.799557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f20636-42b7-4f82-b094-ef097b3be999 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.832446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b637-0986-4946-b19d-27076cc27c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.833045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b637-0986-4946-b19d-27076cc27c79 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.833324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b637-0986-4946-b19d-27076cc27c79 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.833630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b637-0986-4946-b19d-27076cc27c79 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.834456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313b637-0986-4946-b19d-27076cc27c79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:15.834772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313b637-0986-4946-b19d-27076cc27c79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:15.836242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313b637-0986-4946-b19d-27076cc27c79 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:15.855266 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 314/647] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:15.856294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b637-0986-4946-b19d-27076cc27c79 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.897630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078876f-2e9f-422b-b6c2-56dc2400d14d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.930176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fd797-40eb-4905-a094-244ce79774ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.930967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fd797-40eb-4905-a094-244ce79774ab None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.931250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fd797-40eb-4905-a094-244ce79774ab None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.931524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fd797-40eb-4905-a094-244ce79774ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:15.941489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fd797-40eb-4905-a094-244ce79774ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:15.948865 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-ad0fd797-40eb-4905-a094-244ce79774ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:15.950038 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 334/648] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:15.950774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fd797-40eb-4905-a094-244ce79774ab None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:15.957649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b637-0986-4946-b19d-27076cc27c79 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:15.992198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7257924-943e-4aad-a92f-04ace68592c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:15.993278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7257924-943e-4aad-a92f-04ace68592c2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:15.993726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7257924-943e-4aad-a92f-04ace68592c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:15.994170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7257924-943e-4aad-a92f-04ace68592c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.004487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7257924-943e-4aad-a92f-04ace68592c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.007378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7257924-943e-4aad-a92f-04ace68592c2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.025573 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-a7257924-943e-4aad-a92f-04ace68592c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:16.031512 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 315/649] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:16.031512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7257924-943e-4aad-a92f-04ace68592c2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.062360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fd797-40eb-4905-a094-244ce79774ab None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.097515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1845f63-935c-41d2-b6e1-e4bbbba22958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.098311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1845f63-935c-41d2-b6e1-e4bbbba22958 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.098588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1845f63-935c-41d2-b6e1-e4bbbba22958 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:16.098857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1845f63-935c-41d2-b6e1-e4bbbba22958 None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/08d764c8ff5f48a092bd69030c5e1b47/roles/1d095fda854f45db887c85e1d6d5ac09` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.112906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1845f63-935c-41d2-b6e1-e4bbbba22958 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=08d764c8ff5f48a092bd69030c5e1b47, role_id=1d095fda854f45db887c85e1d6d5ac09)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.114366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1845f63-935c-41d2-b6e1-e4bbbba22958 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.131963 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 335/650] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:34:15 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/08d764c8ff5f48a092bd69030c5e1b47/roles/1d095fda854f45db887c85e1d6d5ac09 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:34:16.131963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1845f63-935c-41d2-b6e1-e4bbbba22958 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.132261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7257924-943e-4aad-a92f-04ace68592c2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.171489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd31bb-f367-4060-b17d-e34ff9f48e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.172283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd31bb-f367-4060-b17d-e34ff9f48e31 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.172627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd31bb-f367-4060-b17d-e34ff9f48e31 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:16.172967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd31bb-f367-4060-b17d-e34ff9f48e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.250628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd31bb-f367-4060-b17d-e34ff9f48e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.252348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd31bb-f367-4060-b17d-e34ff9f48e31 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.263654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1845f63-935c-41d2-b6e1-e4bbbba22958 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.310748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbab32-0265-4c78-8901-ea386069627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.311439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbab32-0265-4c78-8901-ea386069627e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.312088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbab32-0265-4c78-8901-ea386069627e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:16.312375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbab32-0265-4c78-8901-ea386069627e None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.313133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbab32-0265-4c78-8901-ea386069627e None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:16.313440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbab32-0265-4c78-8901-ea386069627e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.315300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbab32-0265-4c78-8901-ea386069627e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.327572 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 336/651] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:16.329040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbab32-0265-4c78-8901-ea386069627e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.383061 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 316/652] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:16.384247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd31bb-f367-4060-b17d-e34ff9f48e31 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.455446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbab32-0265-4c78-8901-ea386069627e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.491639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8f3fa-5c26-49f5-99d5-7b287735e10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.492472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd31bb-f367-4060-b17d-e34ff9f48e31 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.493495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f3fa-5c26-49f5-99d5-7b287735e10d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.493998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f3fa-5c26-49f5-99d5-7b287735e10d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:16.494463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f3fa-5c26-49f5-99d5-7b287735e10d None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.495372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8f3fa-5c26-49f5-99d5-7b287735e10d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:16.495867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8f3fa-5c26-49f5-99d5-7b287735e10d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.497528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8f3fa-5c26-49f5-99d5-7b287735e10d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.511910 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 337/653] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:16.513128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8f3fa-5c26-49f5-99d5-7b287735e10d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.528619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c877e-5da8-4c39-891e-e7dba4b68cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.529484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c877e-5da8-4c39-891e-e7dba4b68cff None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.529740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c877e-5da8-4c39-891e-e7dba4b68cff None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:16.530067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c877e-5da8-4c39-891e-e7dba4b68cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.540938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c877e-5da8-4c39-891e-e7dba4b68cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.542411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c877e-5da8-4c39-891e-e7dba4b68cff None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.560230 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-006c877e-5da8-4c39-891e-e7dba4b68cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:16.566009 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 317/654] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:16.566009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c877e-5da8-4c39-891e-e7dba4b68cff None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.626254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8f3fa-5c26-49f5-99d5-7b287735e10d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.660266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c076625-ac06-4dfe-ae02-750887c3da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.661407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c076625-ac06-4dfe-ae02-750887c3da98 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.662422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c076625-ac06-4dfe-ae02-750887c3da98 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:16.662890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c076625-ac06-4dfe-ae02-750887c3da98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.665734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c877e-5da8-4c39-891e-e7dba4b68cff None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.675233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c076625-ac06-4dfe-ae02-750887c3da98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.676975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c076625-ac06-4dfe-ae02-750887c3da98 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.694439 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2c076625-ac06-4dfe-ae02-750887c3da98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:16.696198 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 338/655] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:16.697151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c076625-ac06-4dfe-ae02-750887c3da98 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.705616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3a91e-eb22-4daf-9034-140f549ddd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.706462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a91e-eb22-4daf-9034-140f549ddd02 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.706747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a91e-eb22-4daf-9034-140f549ddd02 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:16.707023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3a91e-eb22-4daf-9034-140f549ddd02 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.714575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3a91e-eb22-4daf-9034-140f549ddd02 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.716127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3a91e-eb22-4daf-9034-140f549ddd02 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.730877 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d8d3a91e-eb22-4daf-9034-140f549ddd02 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 26 20:34:16.732403 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 318/656] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:16.733329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3a91e-eb22-4daf-9034-140f549ddd02 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.799318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c076625-ac06-4dfe-ae02-750887c3da98 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.832609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3a91e-eb22-4daf-9034-140f549ddd02 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.833268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693d8bf-5dbf-4690-a6c1-2ad9e8c239b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.834794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693d8bf-5dbf-4690-a6c1-2ad9e8c239b2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.835269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693d8bf-5dbf-4690-a6c1-2ad9e8c239b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:16.835736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4693d8bf-5dbf-4690-a6c1-2ad9e8c239b2 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.836655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693d8bf-5dbf-4690-a6c1-2ad9e8c239b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:16.837162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693d8bf-5dbf-4690-a6c1-2ad9e8c239b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.838745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4693d8bf-5dbf-4690-a6c1-2ad9e8c239b2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.855349 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 339/657] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:16.856607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693d8bf-5dbf-4690-a6c1-2ad9e8c239b2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.868018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb1e55-95cc-447e-94c1-c1cd0223f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.868745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb1e55-95cc-447e-94c1-c1cd0223f5a8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.869030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb1e55-95cc-447e-94c1-c1cd0223f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:16.869301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb1e55-95cc-447e-94c1-c1cd0223f5a8 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:16.870299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb1e55-95cc-447e-94c1-c1cd0223f5a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:16.870406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb1e55-95cc-447e-94c1-c1cd0223f5a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:16.871801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb1e55-95cc-447e-94c1-c1cd0223f5a8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:16.889060 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 319/658] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:16.890002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb1e55-95cc-447e-94c1-c1cd0223f5a8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:16.964011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4693d8bf-5dbf-4690-a6c1-2ad9e8c239b2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.993992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb1e55-95cc-447e-94c1-c1cd0223f5a8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:16.998237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc8e2-8ae8-4bbf-b6ec-e2f4754a5d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:16.999152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc8e2-8ae8-4bbf-b6ec-e2f4754a5d83 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:16.999626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc8e2-8ae8-4bbf-b6ec-e2f4754a5d83 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.000117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbc8e2-8ae8-4bbf-b6ec-e2f4754a5d83 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.001140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbc8e2-8ae8-4bbf-b6ec-e2f4754a5d83 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:17.001638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbc8e2-8ae8-4bbf-b6ec-e2f4754a5d83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.003324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbc8e2-8ae8-4bbf-b6ec-e2f4754a5d83 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.024821 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 340/659] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:17.026076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc8e2-8ae8-4bbf-b6ec-e2f4754a5d83 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:17.028307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2011228-6ad9-4851-b2c7-7cbf470767de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:17.029534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2011228-6ad9-4851-b2c7-7cbf470767de None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.029817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2011228-6ad9-4851-b2c7-7cbf470767de None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.030090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2011228-6ad9-4851-b2c7-7cbf470767de None admin] PATH_INFO: `/v3/users/neutron` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.039401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2011228-6ad9-4851-b2c7-7cbf470767de None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.040686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2011228-6ad9-4851-b2c7-7cbf470767de None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.055027 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d2011228-6ad9-4851-b2c7-7cbf470767de None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 26 20:34:17.060795 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 320/660] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:17.060795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2011228-6ad9-4851-b2c7-7cbf470767de None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:17.143215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbc8e2-8ae8-4bbf-b6ec-e2f4754a5d83 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:17.164740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2011228-6ad9-4851-b2c7-7cbf470767de None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:17.185138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926767-a8bd-4879-a12e-9740695b2978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:17.186417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926767-a8bd-4879-a12e-9740695b2978 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.186913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926767-a8bd-4879-a12e-9740695b2978 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.187312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926767-a8bd-4879-a12e-9740695b2978 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.197136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02926767-a8bd-4879-a12e-9740695b2978 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.198585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02926767-a8bd-4879-a12e-9740695b2978 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.200550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc36f5-9eac-4754-bea1-c411015d05d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:17.201310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc36f5-9eac-4754-bea1-c411015d05d4 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.201699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc36f5-9eac-4754-bea1-c411015d05d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.202096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc36f5-9eac-4754-bea1-c411015d05d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.214144 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-02926767-a8bd-4879-a12e-9740695b2978 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:17.220462 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 341/661] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:17.221362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926767-a8bd-4879-a12e-9740695b2978 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:17.272698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc36f5-9eac-4754-bea1-c411015d05d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.274344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cc36f5-9eac-4754-bea1-c411015d05d4 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.326396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926767-a8bd-4879-a12e-9740695b2978 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:17.360252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e3e2c0-bed1-4a79-89b8-27d30f00c080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:17.360918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e2c0-bed1-4a79-89b8-27d30f00c080 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.361204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e2c0-bed1-4a79-89b8-27d30f00c080 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.361477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e3e2c0-bed1-4a79-89b8-27d30f00c080 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.362309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3e2c0-bed1-4a79-89b8-27d30f00c080 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:17.362618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3e2c0-bed1-4a79-89b8-27d30f00c080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.364173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e3e2c0-bed1-4a79-89b8-27d30f00c080 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.384131 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 321/662] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:17.384131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc36f5-9eac-4754-bea1-c411015d05d4 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:17.385812 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 342/663] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Mar 26 20:34:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:17.387308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af5a25-c142-47eb-be61-e21938f7f031 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.387607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af5a25-c142-47eb-be61-e21938f7f031 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.387890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af5a25-c142-47eb-be61-e21938f7f031 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.392072 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 343/664] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:17.392072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af5a25-c142-47eb-be61-e21938f7f031 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:17.484743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cc36f5-9eac-4754-bea1-c411015d05d4 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:17.501354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af5a25-c142-47eb-be61-e21938f7f031 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:17.518168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e1425-af0d-4796-a4b2-e1d8a65431e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:17.518828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e1425-af0d-4796-a4b2-e1d8a65431e0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.519113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e1425-af0d-4796-a4b2-e1d8a65431e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.519394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e1425-af0d-4796-a4b2-e1d8a65431e0 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.520206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e1425-af0d-4796-a4b2-e1d8a65431e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:17.520527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e1425-af0d-4796-a4b2-e1d8a65431e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.522007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e1425-af0d-4796-a4b2-e1d8a65431e0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.533506 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 322/665] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:17.533995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530341f-a728-4276-8b39-b9efd877217a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:17.534310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e1425-af0d-4796-a4b2-e1d8a65431e0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:17.535204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530341f-a728-4276-8b39-b9efd877217a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.535544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530341f-a728-4276-8b39-b9efd877217a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.535906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530341f-a728-4276-8b39-b9efd877217a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.548568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530341f-a728-4276-8b39-b9efd877217a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.550230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530341f-a728-4276-8b39-b9efd877217a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.567163 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-b530341f-a728-4276-8b39-b9efd877217a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:17.568644 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 344/666] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:17.569986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d418a-9d5a-49b2-bc02-12e2bc7c11dd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.570434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d418a-9d5a-49b2-bc02-12e2bc7c11dd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.570887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d418a-9d5a-49b2-bc02-12e2bc7c11dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.587297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ed3d418a-9d5a-49b2-bc02-12e2bc7c11dd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:17.588526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ed3d418a-9d5a-49b2-bc02-12e2bc7c11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:17.637005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e1425-af0d-4796-a4b2-e1d8a65431e0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:17.654106 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 345/667] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:17.654921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d418a-9d5a-49b2-bc02-12e2bc7c11dd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:17.670276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a241278-f75a-4bfb-955d-14b70569cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:17.671507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241278-f75a-4bfb-955d-14b70569cea1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.672415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241278-f75a-4bfb-955d-14b70569cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.672898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a241278-f75a-4bfb-955d-14b70569cea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.741930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a241278-f75a-4bfb-955d-14b70569cea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.743403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a241278-f75a-4bfb-955d-14b70569cea1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.761555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d418a-9d5a-49b2-bc02-12e2bc7c11dd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:17.795934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8848e-d80d-4d6b-bbb5-03a6500d38c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:17.796612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8848e-d80d-4d6b-bbb5-03a6500d38c3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.796897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8848e-d80d-4d6b-bbb5-03a6500d38c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.797172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8848e-d80d-4d6b-bbb5-03a6500d38c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.797984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8848e-d80d-4d6b-bbb5-03a6500d38c3 None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=82c1da5e55da4bf380e86064d66e638b) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:17.798292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8848e-d80d-4d6b-bbb5-03a6500d38c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.799736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8848e-d80d-4d6b-bbb5-03a6500d38c3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.806115 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 346/668] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:17 2022] GET /identity/v3/role_assignments?user.id=82c1da5e55da4bf380e86064d66e638b&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:17.806876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8848e-d80d-4d6b-bbb5-03a6500d38c3 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:17.871716 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 323/669] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:17.871716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a241278-f75a-4bfb-955d-14b70569cea1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:17.940505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8848e-d80d-4d6b-bbb5-03a6500d38c3 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:17.981290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30dddd-724d-4063-8cd5-bc5fe89df37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:17.982295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30dddd-724d-4063-8cd5-bc5fe89df37f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:17.982785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30dddd-724d-4063-8cd5-bc5fe89df37f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:17.983248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30dddd-724d-4063-8cd5-bc5fe89df37f None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:17.984722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30dddd-724d-4063-8cd5-bc5fe89df37f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:17.985242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30dddd-724d-4063-8cd5-bc5fe89df37f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:17.986972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30dddd-724d-4063-8cd5-bc5fe89df37f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:17.999593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a241278-f75a-4bfb-955d-14b70569cea1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.003077 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 347/670] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:18.004193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30dddd-724d-4063-8cd5-bc5fe89df37f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.047799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc4139-f2ce-4b33-9ae9-87e2ce44947e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.048627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc4139-f2ce-4b33-9ae9-87e2ce44947e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.048912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc4139-f2ce-4b33-9ae9-87e2ce44947e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.049190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc4139-f2ce-4b33-9ae9-87e2ce44947e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.060380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc4139-f2ce-4b33-9ae9-87e2ce44947e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:18.067205 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-e8bc4139-f2ce-4b33-9ae9-87e2ce44947e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:34:18.069403 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 324/671] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:18.070188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc4139-f2ce-4b33-9ae9-87e2ce44947e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.124433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30dddd-724d-4063-8cd5-bc5fe89df37f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.159498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64183ae3-7be7-4196-885e-4ae82b1bc022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.160475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64183ae3-7be7-4196-885e-4ae82b1bc022 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.161115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64183ae3-7be7-4196-885e-4ae82b1bc022 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.161397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64183ae3-7be7-4196-885e-4ae82b1bc022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.178718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64183ae3-7be7-4196-885e-4ae82b1bc022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.178891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc4139-f2ce-4b33-9ae9-87e2ce44947e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.180388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64183ae3-7be7-4196-885e-4ae82b1bc022 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.202391 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-64183ae3-7be7-4196-885e-4ae82b1bc022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:18.204468 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 348/672] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:18.205528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64183ae3-7be7-4196-885e-4ae82b1bc022 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.216641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2d4c6-9c6d-4b48-b7a0-a61331f40404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.217440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2d4c6-9c6d-4b48-b7a0-a61331f40404 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.217722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2d4c6-9c6d-4b48-b7a0-a61331f40404 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.217993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2d4c6-9c6d-4b48-b7a0-a61331f40404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.225290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2d4c6-9c6d-4b48-b7a0-a61331f40404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.226752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2d4c6-9c6d-4b48-b7a0-a61331f40404 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.240978 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-acb2d4c6-9c6d-4b48-b7a0-a61331f40404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:18.241717 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 325/673] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:18.242569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2d4c6-9c6d-4b48-b7a0-a61331f40404 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.332298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64183ae3-7be7-4196-885e-4ae82b1bc022 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.362626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2d4c6-9c6d-4b48-b7a0-a61331f40404 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.366823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750dcf-8a24-41a6-8b4c-23bcf0fcdb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.367540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750dcf-8a24-41a6-8b4c-23bcf0fcdb20 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.367828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750dcf-8a24-41a6-8b4c-23bcf0fcdb20 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.368134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750dcf-8a24-41a6-8b4c-23bcf0fcdb20 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.368916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750dcf-8a24-41a6-8b4c-23bcf0fcdb20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:18.369223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750dcf-8a24-41a6-8b4c-23bcf0fcdb20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.370610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750dcf-8a24-41a6-8b4c-23bcf0fcdb20 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.378970 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 349/674] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:18.379933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750dcf-8a24-41a6-8b4c-23bcf0fcdb20 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.402637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74fc7-6974-42c9-a12c-441444e6f173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.403310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74fc7-6974-42c9-a12c-441444e6f173 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.403866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74fc7-6974-42c9-a12c-441444e6f173 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.404185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d74fc7-6974-42c9-a12c-441444e6f173 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.405072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d74fc7-6974-42c9-a12c-441444e6f173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:18.405377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d74fc7-6974-42c9-a12c-441444e6f173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.407328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d74fc7-6974-42c9-a12c-441444e6f173 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.421908 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 326/675] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:18.422743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74fc7-6974-42c9-a12c-441444e6f173 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.496649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750dcf-8a24-41a6-8b4c-23bcf0fcdb20 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.527160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d74fc7-6974-42c9-a12c-441444e6f173 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.532714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe41a40-b9e6-411e-be82-345b4da0c4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.533376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe41a40-b9e6-411e-be82-345b4da0c4dd None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.533665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe41a40-b9e6-411e-be82-345b4da0c4dd None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.533941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe41a40-b9e6-411e-be82-345b4da0c4dd None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.534720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe41a40-b9e6-411e-be82-345b4da0c4dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:18.535029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe41a40-b9e6-411e-be82-345b4da0c4dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.536502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe41a40-b9e6-411e-be82-345b4da0c4dd None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.548657 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 350/676] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:18.549412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe41a40-b9e6-411e-be82-345b4da0c4dd None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.569077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65152c-7067-4bdf-a642-229771a8b9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.569910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65152c-7067-4bdf-a642-229771a8b9e0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.570197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65152c-7067-4bdf-a642-229771a8b9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.570526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e65152c-7067-4bdf-a642-229771a8b9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.581353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65152c-7067-4bdf-a642-229771a8b9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.582948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e65152c-7067-4bdf-a642-229771a8b9e0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.599879 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-6e65152c-7067-4bdf-a642-229771a8b9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:18.601489 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 327/677] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:18.602381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65152c-7067-4bdf-a642-229771a8b9e0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.662741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe41a40-b9e6-411e-be82-345b4da0c4dd None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.697109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c9d8d-99f7-4cda-8360-c4e3386dc82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.697887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9d8d-99f7-4cda-8360-c4e3386dc82b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.698163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9d8d-99f7-4cda-8360-c4e3386dc82b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.698431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37c9d8d-99f7-4cda-8360-c4e3386dc82b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.701350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e65152c-7067-4bdf-a642-229771a8b9e0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.705250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c9d8d-99f7-4cda-8360-c4e3386dc82b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.706696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37c9d8d-99f7-4cda-8360-c4e3386dc82b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.719215 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-e37c9d8d-99f7-4cda-8360-c4e3386dc82b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:18.725203 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 351/678] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:18.725203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c9d8d-99f7-4cda-8360-c4e3386dc82b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.741432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7ee05-cbbc-40c7-83ed-1d2c9a9288ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.742091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7ee05-cbbc-40c7-83ed-1d2c9a9288ad None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.742374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7ee05-cbbc-40c7-83ed-1d2c9a9288ad None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.742650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7ee05-cbbc-40c7-83ed-1d2c9a9288ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.743470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7ee05-cbbc-40c7-83ed-1d2c9a9288ad None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=416ac158078b4b678c236e0ad811acad) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:18.743792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7ee05-cbbc-40c7-83ed-1d2c9a9288ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.745253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7ee05-cbbc-40c7-83ed-1d2c9a9288ad None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.751146 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 328/679] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/role_assignments?user.id=416ac158078b4b678c236e0ad811acad&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:18.752454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44726cb-7657-4d4d-84e6-adfcc9d5ef9c None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.752747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44726cb-7657-4d4d-84e6-adfcc9d5ef9c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.753025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44726cb-7657-4d4d-84e6-adfcc9d5ef9c None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.759985 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 329/680] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:18.759985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44726cb-7657-4d4d-84e6-adfcc9d5ef9c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:18.849866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37c9d8d-99f7-4cda-8360-c4e3386dc82b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.894853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2795fe-aa23-4032-a016-de271ab4cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.895780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2795fe-aa23-4032-a016-de271ab4cdd1 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.896314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2795fe-aa23-4032-a016-de271ab4cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.896763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2795fe-aa23-4032-a016-de271ab4cdd1 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.897465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44726cb-7657-4d4d-84e6-adfcc9d5ef9c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:18.897809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2795fe-aa23-4032-a016-de271ab4cdd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:18.898365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2795fe-aa23-4032-a016-de271ab4cdd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.899967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2795fe-aa23-4032-a016-de271ab4cdd1 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.913953 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 352/681] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:18.915814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a87e-2360-4a53-9a37-db1a87681e22 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.916294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a87e-2360-4a53-9a37-db1a87681e22 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.916721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871a87e-2360-4a53-9a37-db1a87681e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.935469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a871a87e-2360-4a53-9a37-db1a87681e22 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:18.937000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a871a87e-2360-4a53-9a37-db1a87681e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:18.939006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec81ff6-72ee-41f1-a27e-df4e9e7072e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:18.939889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81ff6-72ee-41f1-a27e-df4e9e7072e3 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:18.940194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81ff6-72ee-41f1-a27e-df4e9e7072e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:18.940469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec81ff6-72ee-41f1-a27e-df4e9e7072e3 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:18.942202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81ff6-72ee-41f1-a27e-df4e9e7072e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:18.942516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81ff6-72ee-41f1-a27e-df4e9e7072e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:18.944053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec81ff6-72ee-41f1-a27e-df4e9e7072e3 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:18.959818 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 330/682] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:18.960682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec81ff6-72ee-41f1-a27e-df4e9e7072e3 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:19.020923 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 353/683] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:19.021890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a87e-2360-4a53-9a37-db1a87681e22 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:19.103124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec81ff6-72ee-41f1-a27e-df4e9e7072e3 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:19.131031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871a87e-2360-4a53-9a37-db1a87681e22 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:19.144211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8650d0d-7897-4c92-969f-1e041702888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:19.145081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650d0d-7897-4c92-969f-1e041702888d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:19.145431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650d0d-7897-4c92-969f-1e041702888d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:19.145774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8650d0d-7897-4c92-969f-1e041702888d None admin] PATH_INFO: `/v3/users/nova` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:19.154007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8650d0d-7897-4c92-969f-1e041702888d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:19.155571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8650d0d-7897-4c92-969f-1e041702888d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:19.171463 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-f8650d0d-7897-4c92-969f-1e041702888d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 26 20:34:19.172157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a396067-fb37-40f0-b63a-03e61e6852d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:19.173002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a396067-fb37-40f0-b63a-03e61e6852d9 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:19.173217 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 331/684] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Mar 26 20:34:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:19.173690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a396067-fb37-40f0-b63a-03e61e6852d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:19.174199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8650d0d-7897-4c92-969f-1e041702888d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:19.174373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a396067-fb37-40f0-b63a-03e61e6852d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:19.175357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a396067-fb37-40f0-b63a-03e61e6852d9 None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=71808360397a42cab9196c51547e33e0) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:19.175840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a396067-fb37-40f0-b63a-03e61e6852d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:19.178421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a396067-fb37-40f0-b63a-03e61e6852d9 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:19.186648 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 354/685] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:19 2022] GET /identity/v3/role_assignments?user.id=71808360397a42cab9196c51547e33e0&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:19.187713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a396067-fb37-40f0-b63a-03e61e6852d9 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:19.367365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a396067-fb37-40f0-b63a-03e61e6852d9 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:19.410662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb719-50c5-4606-a076-77cb9620f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:19.411723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb719-50c5-4606-a076-77cb9620f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:19.412774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb719-50c5-4606-a076-77cb9620f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:19.414584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb719-50c5-4606-a076-77cb9620f5d0 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:19.415602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb719-50c5-4606-a076-77cb9620f5d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:19.416122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb719-50c5-4606-a076-77cb9620f5d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:19.416323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8650d0d-7897-4c92-969f-1e041702888d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:19.421535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb719-50c5-4606-a076-77cb9620f5d0 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:19.441514 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 355/686] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Mar 26 20:34:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:19.447254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb719-50c5-4606-a076-77cb9620f5d0 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:19.468537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc708d-6870-46b1-9830-2758521887ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:19.469322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc708d-6870-46b1-9830-2758521887ea None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:19.469600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc708d-6870-46b1-9830-2758521887ea None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:19.470126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc708d-6870-46b1-9830-2758521887ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:19.484229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc708d-6870-46b1-9830-2758521887ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:19.493907 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-83fc708d-6870-46b1-9830-2758521887ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:19.497469 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 332/687] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:19.506969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc708d-6870-46b1-9830-2758521887ea None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:19.567085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb719-50c5-4606-a076-77cb9620f5d0 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:19.635473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edef1f-dba9-4c2d-8680-a26ccf87f533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:19.636104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edef1f-dba9-4c2d-8680-a26ccf87f533 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:19.636385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edef1f-dba9-4c2d-8680-a26ccf87f533 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:19.636654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33edef1f-dba9-4c2d-8680-a26ccf87f533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:19.644851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc708d-6870-46b1-9830-2758521887ea None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:19.714962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9272b71-5e17-4081-a1ee-4f0819631603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:19.715737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9272b71-5e17-4081-a1ee-4f0819631603 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:19.715983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9272b71-5e17-4081-a1ee-4f0819631603 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:19.716263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9272b71-5e17-4081-a1ee-4f0819631603 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:19.717002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9272b71-5e17-4081-a1ee-4f0819631603 None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:19.717306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9272b71-5e17-4081-a1ee-4f0819631603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:19.718700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9272b71-5e17-4081-a1ee-4f0819631603 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:19.738000 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 333/688] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:19.746581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9272b71-5e17-4081-a1ee-4f0819631603 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:19.759051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edef1f-dba9-4c2d-8680-a26ccf87f533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:19.760532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33edef1f-dba9-4c2d-8680-a26ccf87f533 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:19.858591 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 356/689] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:19.864266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edef1f-dba9-4c2d-8680-a26ccf87f533 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:19.970701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33edef1f-dba9-4c2d-8680-a26ccf87f533 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:19.998074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9272b71-5e17-4081-a1ee-4f0819631603 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:20.009002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aea6e8-8526-4a7a-b49c-95f35601190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:20.009841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aea6e8-8526-4a7a-b49c-95f35601190f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.010121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aea6e8-8526-4a7a-b49c-95f35601190f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.010391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aea6e8-8526-4a7a-b49c-95f35601190f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.032758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aea6e8-8526-4a7a-b49c-95f35601190f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:20.034233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aea6e8-8526-4a7a-b49c-95f35601190f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:20.066193 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d1aea6e8-8526-4a7a-b49c-95f35601190f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:20.067372 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 357/690] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:20.070889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d7ee1-8942-4968-be73-e9718cf763be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:20.071673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d7ee1-8942-4968-be73-e9718cf763be None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.071977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d7ee1-8942-4968-be73-e9718cf763be None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.072252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d7ee1-8942-4968-be73-e9718cf763be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.078088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aea6e8-8526-4a7a-b49c-95f35601190f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:20.096936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d7ee1-8942-4968-be73-e9718cf763be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:20.098888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d7ee1-8942-4968-be73-e9718cf763be None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:20.132155 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-372d7ee1-8942-4968-be73-e9718cf763be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:20.134036 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 334/691] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:20.140738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d7ee1-8942-4968-be73-e9718cf763be None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:20.198031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aea6e8-8526-4a7a-b49c-95f35601190f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:20.235880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf480-aaa3-4df7-8236-956ce77cfa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:20.236485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf480-aaa3-4df7-8236-956ce77cfa51 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.236762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf480-aaa3-4df7-8236-956ce77cfa51 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.237033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bf480-aaa3-4df7-8236-956ce77cfa51 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.239943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf480-aaa3-4df7-8236-956ce77cfa51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:20.239943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf480-aaa3-4df7-8236-956ce77cfa51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:20.239943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3bf480-aaa3-4df7-8236-956ce77cfa51 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:20.252584 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 358/692] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:20.262629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf480-aaa3-4df7-8236-956ce77cfa51 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:20.351108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d7ee1-8942-4968-be73-e9718cf763be None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:20.401307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bad05-6b41-4217-91da-0fec32405b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:20.402147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bad05-6b41-4217-91da-0fec32405b0b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.402773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bad05-6b41-4217-91da-0fec32405b0b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.403052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bad05-6b41-4217-91da-0fec32405b0b None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.403771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bad05-6b41-4217-91da-0fec32405b0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:20.404518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bad05-6b41-4217-91da-0fec32405b0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:20.406201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bad05-6b41-4217-91da-0fec32405b0b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:20.419322 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 335/693] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:20.424631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bad05-6b41-4217-91da-0fec32405b0b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:20.460577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bf480-aaa3-4df7-8236-956ce77cfa51 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:20.519157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81307dc-6dda-4484-8582-16093e9b7771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:20.520351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81307dc-6dda-4484-8582-16093e9b7771 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.521391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81307dc-6dda-4484-8582-16093e9b7771 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.521869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81307dc-6dda-4484-8582-16093e9b7771 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.528937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81307dc-6dda-4484-8582-16093e9b7771 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:20.530615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81307dc-6dda-4484-8582-16093e9b7771 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:20.535585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bad05-6b41-4217-91da-0fec32405b0b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:20.544446 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-b81307dc-6dda-4484-8582-16093e9b7771 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:20.550718 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 359/694] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:20.552298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d38c5-d8b1-4827-8204-30913f642509 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.552795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d38c5-d8b1-4827-8204-30913f642509 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.553278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d38c5-d8b1-4827-8204-30913f642509 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.555516 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 360/695] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:20.556455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d38c5-d8b1-4827-8204-30913f642509 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:20.572005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f65d-1f50-476f-ac7a-83fa2bbe19c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:20.572799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f65d-1f50-476f-ac7a-83fa2bbe19c3 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.573076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f65d-1f50-476f-ac7a-83fa2bbe19c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.573405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f65d-1f50-476f-ac7a-83fa2bbe19c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.582997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f65d-1f50-476f-ac7a-83fa2bbe19c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:20.585045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f65d-1f50-476f-ac7a-83fa2bbe19c3 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:20.603206 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-4388f65d-1f50-476f-ac7a-83fa2bbe19c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 26 20:34:20.604755 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 336/696] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:20.609156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf33e58-9cc3-40c1-aa9f-bf9222f0b718 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.609667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf33e58-9cc3-40c1-aa9f-bf9222f0b718 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.611758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf33e58-9cc3-40c1-aa9f-bf9222f0b718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.632112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1cf33e58-9cc3-40c1-aa9f-bf9222f0b718 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:20.633303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1cf33e58-9cc3-40c1-aa9f-bf9222f0b718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:20.673955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d38c5-d8b1-4827-8204-30913f642509 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:20.708466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1fcdc-1440-4d6f-8cab-c9f8f97878ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:20.709120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1fcdc-1440-4d6f-8cab-c9f8f97878ad None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.709399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1fcdc-1440-4d6f-8cab-c9f8f97878ad None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.709667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1fcdc-1440-4d6f-8cab-c9f8f97878ad None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.710441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1fcdc-1440-4d6f-8cab-c9f8f97878ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:20.710744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1fcdc-1440-4d6f-8cab-c9f8f97878ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:20.712188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1fcdc-1440-4d6f-8cab-c9f8f97878ad None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:20.716005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 337/697] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:20.717744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf33e58-9cc3-40c1-aa9f-bf9222f0b718 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:20.736793 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 361/698] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:20.745348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1fcdc-1440-4d6f-8cab-c9f8f97878ad None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:20.850656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1fcdc-1440-4d6f-8cab-c9f8f97878ad None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:20.856525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf33e58-9cc3-40c1-aa9f-bf9222f0b718 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:20.889961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e441d-4c98-4e42-b080-35f93b29ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:20.890605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e441d-4c98-4e42-b080-35f93b29ac49 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.890908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e441d-4c98-4e42-b080-35f93b29ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.891151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e441d-4c98-4e42-b080-35f93b29ac49 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.891990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e441d-4c98-4e42-b080-35f93b29ac49 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:20.892300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e441d-4c98-4e42-b080-35f93b29ac49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:20.892528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45146-25d1-4195-adfc-061d2111706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:20.893180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45146-25d1-4195-adfc-061d2111706d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:20.893468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45146-25d1-4195-adfc-061d2111706d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:20.893735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e441d-4c98-4e42-b080-35f93b29ac49 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:20.893845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f45146-25d1-4195-adfc-061d2111706d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:20.894621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f45146-25d1-4195-adfc-061d2111706d None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=07e77369a94844529947de0f46a54edd) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:20.894938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f45146-25d1-4195-adfc-061d2111706d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:20.897417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f45146-25d1-4195-adfc-061d2111706d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:20.908111 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 362/699] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:20 2022] GET /identity/v3/role_assignments?user.id=07e77369a94844529947de0f46a54edd&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:20.909025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45146-25d1-4195-adfc-061d2111706d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:20.917573 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 338/700] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Mar 26 20:34:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:20.923484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e441d-4c98-4e42-b080-35f93b29ac49 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:21.109075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f45146-25d1-4195-adfc-061d2111706d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:21.113391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e441d-4c98-4e42-b080-35f93b29ac49 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:21.167988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb928c5-6b43-4357-96f8-37f84c8d8c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:21.168781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb928c5-6b43-4357-96f8-37f84c8d8c30 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:21.169058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb928c5-6b43-4357-96f8-37f84c8d8c30 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:21.169330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb928c5-6b43-4357-96f8-37f84c8d8c30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:21.172570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5eb70-db06-4974-b3f4-fc5a04e799f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:21.173229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5eb70-db06-4974-b3f4-fc5a04e799f5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:21.173515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5eb70-db06-4974-b3f4-fc5a04e799f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:21.173788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5eb70-db06-4974-b3f4-fc5a04e799f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:21.183311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb928c5-6b43-4357-96f8-37f84c8d8c30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:21.185223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb928c5-6b43-4357-96f8-37f84c8d8c30 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:21.207417 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2bb928c5-6b43-4357-96f8-37f84c8d8c30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:21.212921 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 363/701] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:21.218443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb928c5-6b43-4357-96f8-37f84c8d8c30 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:21.291636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5eb70-db06-4974-b3f4-fc5a04e799f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:21.293310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5eb70-db06-4974-b3f4-fc5a04e799f5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:21.391879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb928c5-6b43-4357-96f8-37f84c8d8c30 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:21.446649 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 339/702] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 26 20:34:21.449087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da49c6-efb6-4b2e-a0af-11413ae9cbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:21.449749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da49c6-efb6-4b2e-a0af-11413ae9cbe5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:21.450031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da49c6-efb6-4b2e-a0af-11413ae9cbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:21.450311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da49c6-efb6-4b2e-a0af-11413ae9cbe5 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:21.451029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da49c6-efb6-4b2e-a0af-11413ae9cbe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:21.451336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da49c6-efb6-4b2e-a0af-11413ae9cbe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:21.453089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5eb70-db06-4974-b3f4-fc5a04e799f5 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:21.455794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da49c6-efb6-4b2e-a0af-11413ae9cbe5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:21.470168 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 364/703] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:21.473170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575d353-cfdd-4462-ac86-3ff7e93769f1 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:21.473660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575d353-cfdd-4462-ac86-3ff7e93769f1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:21.474163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575d353-cfdd-4462-ac86-3ff7e93769f1 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:21.477577 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 365/704] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:21.479757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575d353-cfdd-4462-ac86-3ff7e93769f1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:21.574844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5eb70-db06-4974-b3f4-fc5a04e799f5 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:21.593933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575d353-cfdd-4462-ac86-3ff7e93769f1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:21.620539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b7391-633a-4643-a0b0-3c2341e441e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:21.621337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b7391-633a-4643-a0b0-3c2341e441e1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:21.621618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b7391-633a-4643-a0b0-3c2341e441e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:21.622075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b7391-633a-4643-a0b0-3c2341e441e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:21.634446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29583a-a752-4226-9299-cc71f0b1edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:21.635418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29583a-a752-4226-9299-cc71f0b1edba None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:21.635731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b7391-633a-4643-a0b0-3c2341e441e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:21.636237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29583a-a752-4226-9299-cc71f0b1edba None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:21.636754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29583a-a752-4226-9299-cc71f0b1edba None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:21.637269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b7391-633a-4643-a0b0-3c2341e441e1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:21.638040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29583a-a752-4226-9299-cc71f0b1edba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:21.639707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29583a-a752-4226-9299-cc71f0b1edba None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:21.656241 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-084b7391-633a-4643-a0b0-3c2341e441e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:21.660029 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 340/705] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:21.660029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdf33a-5309-442f-ae89-789fa5535269 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:21.660029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdf33a-5309-442f-ae89-789fa5535269 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:21.660029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdf33a-5309-442f-ae89-789fa5535269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:21.663960 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 366/706] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:34:21 2022] POST /identity/v3/users => generated 254 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:21.672626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29583a-a752-4226-9299-cc71f0b1edba None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:21.704700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-eabdf33a-5309-442f-ae89-789fa5535269 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:21.705574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eabdf33a-5309-442f-ae89-789fa5535269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:21.798363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29583a-a752-4226-9299-cc71f0b1edba None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:21.836707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487574b-0a5c-45f8-9b39-2689fcd7b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:21.837743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487574b-0a5c-45f8-9b39-2689fcd7b25d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:21.838218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487574b-0a5c-45f8-9b39-2689fcd7b25d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:21.838687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487574b-0a5c-45f8-9b39-2689fcd7b25d None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:21.839650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487574b-0a5c-45f8-9b39-2689fcd7b25d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:21.840178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487574b-0a5c-45f8-9b39-2689fcd7b25d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:21.841776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487574b-0a5c-45f8-9b39-2689fcd7b25d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:21.856279 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 367/707] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:21.861925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487574b-0a5c-45f8-9b39-2689fcd7b25d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:21.883898 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 341/708] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:21.917595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdf33a-5309-442f-ae89-789fa5535269 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:21.976855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487574b-0a5c-45f8-9b39-2689fcd7b25d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:22.012952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d9e07c-d3dd-4f69-8434-f1d20065f451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:22.013758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9e07c-d3dd-4f69-8434-f1d20065f451 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.014035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9e07c-d3dd-4f69-8434-f1d20065f451 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.014402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d9e07c-d3dd-4f69-8434-f1d20065f451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.022436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9e07c-d3dd-4f69-8434-f1d20065f451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:22.024050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d9e07c-d3dd-4f69-8434-f1d20065f451 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:22.024158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdf33a-5309-442f-ae89-789fa5535269 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:22.038366 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f5d9e07c-d3dd-4f69-8434-f1d20065f451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:22.040023 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 368/709] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:22.041328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096575f1-7c9e-4472-9b36-3a30873b1f42 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.041616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096575f1-7c9e-4472-9b36-3a30873b1f42 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.041905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096575f1-7c9e-4472-9b36-3a30873b1f42 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.043629 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 369/710] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:22.047653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096575f1-7c9e-4472-9b36-3a30873b1f42 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:22.065780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1807a-b8e4-47da-b5fe-b4317104a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:22.066302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1807a-b8e4-47da-b5fe-b4317104a65a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.067189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1807a-b8e4-47da-b5fe-b4317104a65a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.067189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1807a-b8e4-47da-b5fe-b4317104a65a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.067483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1807a-b8e4-47da-b5fe-b4317104a65a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:22.069522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1807a-b8e4-47da-b5fe-b4317104a65a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:22.085974 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-19f1807a-b8e4-47da-b5fe-b4317104a65a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 26 20:34:22.087364 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 342/711] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Mar 26 20:34:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:22.089589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ab90-a009-4d2e-a037-22b5fbea9319 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.090384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ab90-a009-4d2e-a037-22b5fbea9319 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.090998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4ab90-a009-4d2e-a037-22b5fbea9319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.112173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-44b4ab90-a009-4d2e-a037-22b5fbea9319 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:22.113521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-44b4ab90-a009-4d2e-a037-22b5fbea9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:22.162780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096575f1-7c9e-4472-9b36-3a30873b1f42 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:22.197236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a60be-3dde-4b88-86ef-b1365dd2697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:22.198268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a60be-3dde-4b88-86ef-b1365dd2697a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.198744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a60be-3dde-4b88-86ef-b1365dd2697a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.199210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a60be-3dde-4b88-86ef-b1365dd2697a None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.199717 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 343/712] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:22.200448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a60be-3dde-4b88-86ef-b1365dd2697a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:22.200622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4ab90-a009-4d2e-a037-22b5fbea9319 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:22.201103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a60be-3dde-4b88-86ef-b1365dd2697a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:22.202736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a60be-3dde-4b88-86ef-b1365dd2697a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:22.217872 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 370/713] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:22.224143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a60be-3dde-4b88-86ef-b1365dd2697a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:22.330812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a60be-3dde-4b88-86ef-b1365dd2697a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:22.331005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4ab90-a009-4d2e-a037-22b5fbea9319 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:22.369994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde1af6-017f-4ffa-a055-717627d09d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:22.370651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1af6-017f-4ffa-a055-717627d09d7c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.370931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1af6-017f-4ffa-a055-717627d09d7c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.371184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54828450-9b56-4ab9-bf4f-9acc252b1391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:22.371298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde1af6-017f-4ffa-a055-717627d09d7c None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.371884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde1af6-017f-4ffa-a055-717627d09d7c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:22.372216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde1af6-017f-4ffa-a055-717627d09d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:22.372578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54828450-9b56-4ab9-bf4f-9acc252b1391 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.373043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54828450-9b56-4ab9-bf4f-9acc252b1391 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.373516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54828450-9b56-4ab9-bf4f-9acc252b1391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.373692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde1af6-017f-4ffa-a055-717627d09d7c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:22.375046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54828450-9b56-4ab9-bf4f-9acc252b1391 None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=08d764c8ff5f48a092bd69030c5e1b47) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:22.375833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54828450-9b56-4ab9-bf4f-9acc252b1391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:22.377796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54828450-9b56-4ab9-bf4f-9acc252b1391 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:22.378347 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 344/714] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Mar 26 20:34:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:22.379188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde1af6-017f-4ffa-a055-717627d09d7c None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:22.392449 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 371/715] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:22 2022] GET /identity/v3/role_assignments?user.id=08d764c8ff5f48a092bd69030c5e1b47&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:22.395061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54828450-9b56-4ab9-bf4f-9acc252b1391 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:22.578788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54828450-9b56-4ab9-bf4f-9acc252b1391 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:22.601734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde1af6-017f-4ffa-a055-717627d09d7c None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:22.620745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf3a1f-36cf-40ce-88a2-a3e312655556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:22.621420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf3a1f-36cf-40ce-88a2-a3e312655556 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.621701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf3a1f-36cf-40ce-88a2-a3e312655556 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.621974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf3a1f-36cf-40ce-88a2-a3e312655556 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.622677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf3a1f-36cf-40ce-88a2-a3e312655556 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:22.622980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf3a1f-36cf-40ce-88a2-a3e312655556 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:22.624399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf3a1f-36cf-40ce-88a2-a3e312655556 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:22.631526 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 372/716] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Mar 26 20:34:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:22.652846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb0e63-c4b3-4ce2-97d9-98398d277b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:22.653944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb0e63-c4b3-4ce2-97d9-98398d277b64 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.654514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb0e63-c4b3-4ce2-97d9-98398d277b64 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.654955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb0e63-c4b3-4ce2-97d9-98398d277b64 None admin] PATH_INFO: `/v3/services/network` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.655781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb0e63-c4b3-4ce2-97d9-98398d277b64 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:22.657442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bb0e63-c4b3-4ce2-97d9-98398d277b64 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:22.669459 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b0bb0e63-c4b3-4ce2-97d9-98398d277b64 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 26 20:34:22.671359 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 345/717] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:22 2022] GET /identity/v3/services/network => generated 88 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:22.677244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf3a1f-36cf-40ce-88a2-a3e312655556 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:22.791889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf3a1f-36cf-40ce-88a2-a3e312655556 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:22.829598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e114a6-78fb-4178-ae28-e95aead75c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:22.830191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e114a6-78fb-4178-ae28-e95aead75c07 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.830449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e114a6-78fb-4178-ae28-e95aead75c07 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.830725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e114a6-78fb-4178-ae28-e95aead75c07 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.831434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e114a6-78fb-4178-ae28-e95aead75c07 None admin] RBAC: Adding query filter params (name=network) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:22.831741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e114a6-78fb-4178-ae28-e95aead75c07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:22.833275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e114a6-78fb-4178-ae28-e95aead75c07 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:22.839594 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 373/718] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:22.845993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb0e63-c4b3-4ce2-97d9-98398d277b64 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:22.954146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bb0e63-c4b3-4ce2-97d9-98398d277b64 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:22.987059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c5e79-a2c3-498b-87d5-73ef7c0066e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:22.987737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5e79-a2c3-498b-87d5-73ef7c0066e2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:22.988051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5e79-a2c3-498b-87d5-73ef7c0066e2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:22.988335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c5e79-a2c3-498b-87d5-73ef7c0066e2 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:22.989038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c5e79-a2c3-498b-87d5-73ef7c0066e2 None admin] RBAC: Adding query filter params (type=network) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:22.989347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c5e79-a2c3-498b-87d5-73ef7c0066e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:22.991268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c5e79-a2c3-498b-87d5-73ef7c0066e2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:22.997345 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 346/719] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:23.680395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c85c44-42cd-48a0-9519-28816235795a None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:23.680801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c85c44-42cd-48a0-9519-28816235795a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:23.680999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c85c44-42cd-48a0-9519-28816235795a None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:23.682979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 374/720] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:23.695139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e9c3-2744-4114-80a6-cf74549a658d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:23.695436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e9c3-2744-4114-80a6-cf74549a658d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:23.695723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959e9c3-2744-4114-80a6-cf74549a658d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:23.717143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5959e9c3-2744-4114-80a6-cf74549a658d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:23.718390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5959e9c3-2744-4114-80a6-cf74549a658d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:23.803035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 347/721] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:23.829440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c85c44-42cd-48a0-9519-28816235795a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:23.937649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c85c44-42cd-48a0-9519-28816235795a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:23.981782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898f30-b4f5-488d-b51a-de130c5e026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:23.982568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898f30-b4f5-488d-b51a-de130c5e026c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:23.982849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898f30-b4f5-488d-b51a-de130c5e026c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:23.983124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898f30-b4f5-488d-b51a-de130c5e026c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:23.998256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23898f30-b4f5-488d-b51a-de130c5e026c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:24.005773 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-23898f30-b4f5-488d-b51a-de130c5e026c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:34:24.007491 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 375/722] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:24.018981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e9c3-2744-4114-80a6-cf74549a658d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:24.124354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959e9c3-2744-4114-80a6-cf74549a658d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:24.169388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602c59c-9367-4011-90f2-cf5506ac7366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:24.170062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602c59c-9367-4011-90f2-cf5506ac7366 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:24.170348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602c59c-9367-4011-90f2-cf5506ac7366 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:24.170625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602c59c-9367-4011-90f2-cf5506ac7366 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:24.171377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602c59c-9367-4011-90f2-cf5506ac7366 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:24.171736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602c59c-9367-4011-90f2-cf5506ac7366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:24.173215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602c59c-9367-4011-90f2-cf5506ac7366 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:24.187726 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 348/723] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:24.193280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898f30-b4f5-488d-b51a-de130c5e026c None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:24.359323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898f30-b4f5-488d-b51a-de130c5e026c None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:24.409950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce96a6-a611-4e8a-b66c-20c6c5f699a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:24.410738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce96a6-a611-4e8a-b66c-20c6c5f699a4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:24.411014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce96a6-a611-4e8a-b66c-20c6c5f699a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:24.411885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce96a6-a611-4e8a-b66c-20c6c5f699a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:24.425900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce96a6-a611-4e8a-b66c-20c6c5f699a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:24.428030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce96a6-a611-4e8a-b66c-20c6c5f699a4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:24.450156 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-ebce96a6-a611-4e8a-b66c-20c6c5f699a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:24.451623 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 376/724] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:24.461005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602c59c-9367-4011-90f2-cf5506ac7366 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:24.520521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780b51-19d4-488f-a0ee-35e22ea1acb4 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:24.521411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780b51-19d4-488f-a0ee-35e22ea1acb4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:24.521603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6780b51-19d4-488f-a0ee-35e22ea1acb4 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:24.523694 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 377/725] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:24.530093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2946db5-fe48-4613-9917-43c0c1e54699 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:24.530373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2946db5-fe48-4613-9917-43c0c1e54699 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:24.530699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2946db5-fe48-4613-9917-43c0c1e54699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:24.549620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c2946db5-fe48-4613-9917-43c0c1e54699 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:24.551463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c2946db5-fe48-4613-9917-43c0c1e54699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:24.645319 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 378/726] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 26 20:34:24.670075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602c59c-9367-4011-90f2-cf5506ac7366 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:24.675939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2946db5-fe48-4613-9917-43c0c1e54699 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:24.732841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d7139-9688-4253-938e-c6b149501a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:24.733424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d7139-9688-4253-938e-c6b149501a45 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:24.733702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d7139-9688-4253-938e-c6b149501a45 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:24.733973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d7139-9688-4253-938e-c6b149501a45 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:24.734738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d7139-9688-4253-938e-c6b149501a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:24.735090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d7139-9688-4253-938e-c6b149501a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:24.736505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d7139-9688-4253-938e-c6b149501a45 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:24.759667 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 349/727] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:24.765954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d7139-9688-4253-938e-c6b149501a45 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:24.804451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2946db5-fe48-4613-9917-43c0c1e54699 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:24.840291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdef84-2298-420c-b9b9-ed6215f34f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:24.841473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdef84-2298-420c-b9b9-ed6215f34f64 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:24.841957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdef84-2298-420c-b9b9-ed6215f34f64 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:24.842450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdef84-2298-420c-b9b9-ed6215f34f64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:24.866802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fdef84-2298-420c-b9b9-ed6215f34f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:24.875000 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-23fdef84-2298-420c-b9b9-ed6215f34f64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:24.882764 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 379/728] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:24.891945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdef84-2298-420c-b9b9-ed6215f34f64 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:24.971843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d7139-9688-4253-938e-c6b149501a45 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:24.987948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdef84-2298-420c-b9b9-ed6215f34f64 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.021611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd19e-c8ee-4c6e-b5f5-2d7a090d50fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.022288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd19e-c8ee-4c6e-b5f5-2d7a090d50fc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.022681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd19e-c8ee-4c6e-b5f5-2d7a090d50fc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.022960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd19e-c8ee-4c6e-b5f5-2d7a090d50fc None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.023705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bd19e-c8ee-4c6e-b5f5-2d7a090d50fc None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:25.024059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bd19e-c8ee-4c6e-b5f5-2d7a090d50fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:25.031941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bd19e-c8ee-4c6e-b5f5-2d7a090d50fc None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:25.034110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 380/729] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:25.039879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd19e-c8ee-4c6e-b5f5-2d7a090d50fc None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:25.062471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cd01a-9b52-4c24-a7b8-f22f589056d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.063998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cd01a-9b52-4c24-a7b8-f22f589056d6 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.064505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cd01a-9b52-4c24-a7b8-f22f589056d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.064980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cd01a-9b52-4c24-a7b8-f22f589056d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.073118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cd01a-9b52-4c24-a7b8-f22f589056d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:25.074826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cd01a-9b52-4c24-a7b8-f22f589056d6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:25.090372 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-072cd01a-9b52-4c24-a7b8-f22f589056d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 26 20:34:25.096250 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 350/730] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Mar 26 20:34:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:25.098051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cd01a-9b52-4c24-a7b8-f22f589056d6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:25.147950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd19e-c8ee-4c6e-b5f5-2d7a090d50fc None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.176378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cec49a-0062-4a1a-bc9c-896848d19364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.177820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cec49a-0062-4a1a-bc9c-896848d19364 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.178500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cec49a-0062-4a1a-bc9c-896848d19364 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.178500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cec49a-0062-4a1a-bc9c-896848d19364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.189132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cec49a-0062-4a1a-bc9c-896848d19364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:25.190578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cec49a-0062-4a1a-bc9c-896848d19364 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:25.207625 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-58cec49a-0062-4a1a-bc9c-896848d19364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:25.209186 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 381/731] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:25.214580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cec49a-0062-4a1a-bc9c-896848d19364 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:25.239791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cd01a-9b52-4c24-a7b8-f22f589056d6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.313225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cec49a-0062-4a1a-bc9c-896848d19364 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.315155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b1f65-7278-4f37-834f-360160e2ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.316092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1f65-7278-4f37-834f-360160e2ae53 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.316639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1f65-7278-4f37-834f-360160e2ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.317127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b1f65-7278-4f37-834f-360160e2ae53 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.318752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b1f65-7278-4f37-834f-360160e2ae53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:25.319275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b1f65-7278-4f37-834f-360160e2ae53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:25.321246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5b1f65-7278-4f37-834f-360160e2ae53 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:25.347797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81a6c9-6dee-4f39-bb32-1b0064b3d7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.347797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81a6c9-6dee-4f39-bb32-1b0064b3d7c7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.348274 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 351/732] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Mar 26 20:34:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:25.348382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81a6c9-6dee-4f39-bb32-1b0064b3d7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.348382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81a6c9-6dee-4f39-bb32-1b0064b3d7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.349203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81a6c9-6dee-4f39-bb32-1b0064b3d7c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:25.349508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81a6c9-6dee-4f39-bb32-1b0064b3d7c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:25.350891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81a6c9-6dee-4f39-bb32-1b0064b3d7c7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:25.353590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b1f65-7278-4f37-834f-360160e2ae53 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:25.365440 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 382/733] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:25.371607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81a6c9-6dee-4f39-bb32-1b0064b3d7c7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:25.483264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81a6c9-6dee-4f39-bb32-1b0064b3d7c7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.517656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbe5f-3f21-4714-94fb-ba70843b2f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.518382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbe5f-3f21-4714-94fb-ba70843b2f3c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.518661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbe5f-3f21-4714-94fb-ba70843b2f3c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.518933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafbe5f-3f21-4714-94fb-ba70843b2f3c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.526541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafbe5f-3f21-4714-94fb-ba70843b2f3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:25.528007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dafbe5f-3f21-4714-94fb-ba70843b2f3c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:25.542764 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-7dafbe5f-3f21-4714-94fb-ba70843b2f3c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 26 20:34:25.544269 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 383/734] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:34:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:25.547031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b1f65-7278-4f37-834f-360160e2ae53 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.551076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbe5f-3f21-4714-94fb-ba70843b2f3c None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:25.608433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5a8dc-77bc-4532-91ec-33c9cbfea9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.609391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5a8dc-77bc-4532-91ec-33c9cbfea9f8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.609678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5a8dc-77bc-4532-91ec-33c9cbfea9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.610421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5a8dc-77bc-4532-91ec-33c9cbfea9f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.623726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5a8dc-77bc-4532-91ec-33c9cbfea9f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:25.625623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5a8dc-77bc-4532-91ec-33c9cbfea9f8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:25.646257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafbe5f-3f21-4714-94fb-ba70843b2f3c None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.647487 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-fda5a8dc-77bc-4532-91ec-33c9cbfea9f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:25.649981 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 352/735] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:25.651231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db04c86-1ab1-4861-be36-b5f6c4045c25 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.651516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db04c86-1ab1-4861-be36-b5f6c4045c25 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.651793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db04c86-1ab1-4861-be36-b5f6c4045c25 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.654158 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 353/736] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:25.654875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db04c86-1ab1-4861-be36-b5f6c4045c25 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:25.686243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c4a9d-b296-4168-b9b9-27a5ed8dd52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.686907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c4a9d-b296-4168-b9b9-27a5ed8dd52e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.687187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c4a9d-b296-4168-b9b9-27a5ed8dd52e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.687460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c4a9d-b296-4168-b9b9-27a5ed8dd52e None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.688387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c4a9d-b296-4168-b9b9-27a5ed8dd52e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:25.688694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c4a9d-b296-4168-b9b9-27a5ed8dd52e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:25.690175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c4a9d-b296-4168-b9b9-27a5ed8dd52e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:25.712379 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 384/737] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Mar 26 20:34:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:25.713707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4a801-4a8f-4743-b383-57d942e34291 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.713991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4a801-4a8f-4743-b383-57d942e34291 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.714261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4a801-4a8f-4743-b383-57d942e34291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.732235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-83c4a801-4a8f-4743-b383-57d942e34291 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:25.733393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-83c4a801-4a8f-4743-b383-57d942e34291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:25.764926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db04c86-1ab1-4861-be36-b5f6c4045c25 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.799787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8545bd2-6ac3-41ce-bd8e-492a463f448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.800185 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 385/738] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:25.800401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545bd2-6ac3-41ce-bd8e-492a463f448b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.800686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545bd2-6ac3-41ce-bd8e-492a463f448b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.800961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8545bd2-6ac3-41ce-bd8e-492a463f448b None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.801063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4a801-4a8f-4743-b383-57d942e34291 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:25.801682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8545bd2-6ac3-41ce-bd8e-492a463f448b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:25.802547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8545bd2-6ac3-41ce-bd8e-492a463f448b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:25.812086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8545bd2-6ac3-41ce-bd8e-492a463f448b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:25.829447 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 354/739] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:25.830685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb8e03-0522-4334-996d-67793505d43d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.830944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb8e03-0522-4334-996d-67793505d43d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.836017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfb8e03-0522-4334-996d-67793505d43d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.838628 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 355/740] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:25.839681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb8e03-0522-4334-996d-67793505d43d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:25.903228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4a801-4a8f-4743-b383-57d942e34291 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.937016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0520a-1042-4ce4-8bd9-ef28701fa2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.937655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0520a-1042-4ce4-8bd9-ef28701fa2cf None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.937930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0520a-1042-4ce4-8bd9-ef28701fa2cf None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.938199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0520a-1042-4ce4-8bd9-ef28701fa2cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.950940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfb8e03-0522-4334-996d-67793505d43d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:25.991304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9a285-b957-4ffd-9abc-5f83f2b3d856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:25.992142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9a285-b957-4ffd-9abc-5f83f2b3d856 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:25.992425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9a285-b957-4ffd-9abc-5f83f2b3d856 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:25.992696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9a285-b957-4ffd-9abc-5f83f2b3d856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:25.999283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9a285-b957-4ffd-9abc-5f83f2b3d856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.000756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9a285-b957-4ffd-9abc-5f83f2b3d856 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.012836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0520a-1042-4ce4-8bd9-ef28701fa2cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.014362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0520a-1042-4ce4-8bd9-ef28701fa2cf None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.016340 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-39f9a285-b957-4ffd-9abc-5f83f2b3d856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:26.025044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 356/741] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:26.025044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9a285-b957-4ffd-9abc-5f83f2b3d856 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.119964 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 386/742] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 20:34:26.121414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a45e4e-3dbf-4d88-8e59-2f01541b888f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.121792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9a285-b957-4ffd-9abc-5f83f2b3d856 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:26.122231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a45e4e-3dbf-4d88-8e59-2f01541b888f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.122231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a45e4e-3dbf-4d88-8e59-2f01541b888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.139721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-87a45e4e-3dbf-4d88-8e59-2f01541b888f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:26.140924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-87a45e4e-3dbf-4d88-8e59-2f01541b888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:26.155467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaa0eb-27db-44b2-b829-a9880cf7b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:26.156280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaa0eb-27db-44b2-b829-a9880cf7b09d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.156560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaa0eb-27db-44b2-b829-a9880cf7b09d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.156832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaaa0eb-27db-44b2-b829-a9880cf7b09d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.168075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaaa0eb-27db-44b2-b829-a9880cf7b09d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:26.176565 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-caaaa0eb-27db-44b2-b829-a9880cf7b09d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:34:26.182969 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 357/743] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:26.182969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaa0eb-27db-44b2-b829-a9880cf7b09d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.205980 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 387/744] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:26.206810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a45e4e-3dbf-4d88-8e59-2f01541b888f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.279350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaaa0eb-27db-44b2-b829-a9880cf7b09d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:26.303681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a45e4e-3dbf-4d88-8e59-2f01541b888f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:26.312238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e80728-ba27-4a36-88a5-e3357ef4fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:26.312892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e80728-ba27-4a36-88a5-e3357ef4fac0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.313272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e80728-ba27-4a36-88a5-e3357ef4fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.313452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e80728-ba27-4a36-88a5-e3357ef4fac0 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.314233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e80728-ba27-4a36-88a5-e3357ef4fac0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:26.314542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e80728-ba27-4a36-88a5-e3357ef4fac0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.316014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e80728-ba27-4a36-88a5-e3357ef4fac0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.327615 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 358/745] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:26.328434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e80728-ba27-4a36-88a5-e3357ef4fac0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.338511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467eafd-0027-4c20-8619-32eae61547c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:26.339296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467eafd-0027-4c20-8619-32eae61547c2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.339578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467eafd-0027-4c20-8619-32eae61547c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.339852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467eafd-0027-4c20-8619-32eae61547c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.350293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467eafd-0027-4c20-8619-32eae61547c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.351727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467eafd-0027-4c20-8619-32eae61547c2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.368428 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f467eafd-0027-4c20-8619-32eae61547c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:26.369575 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 388/746] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:26.370875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356f890-f4d4-4c1e-891b-c7bad257ddb2 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.371106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356f890-f4d4-4c1e-891b-c7bad257ddb2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.371382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356f890-f4d4-4c1e-891b-c7bad257ddb2 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.373346 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 389/747] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:26.374412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356f890-f4d4-4c1e-891b-c7bad257ddb2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.423148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e80728-ba27-4a36-88a5-e3357ef4fac0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:26.455128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab35c2d-edc4-4fb5-88ba-29760b96ebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:26.455780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab35c2d-edc4-4fb5-88ba-29760b96ebd0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.456104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab35c2d-edc4-4fb5-88ba-29760b96ebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.456384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab35c2d-edc4-4fb5-88ba-29760b96ebd0 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.457143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab35c2d-edc4-4fb5-88ba-29760b96ebd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:26.457452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab35c2d-edc4-4fb5-88ba-29760b96ebd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.459423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab35c2d-edc4-4fb5-88ba-29760b96ebd0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.467110 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 359/748] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:26.467861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab35c2d-edc4-4fb5-88ba-29760b96ebd0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.473327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356f890-f4d4-4c1e-891b-c7bad257ddb2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:26.505513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a9e0-9249-47fa-a33c-287473031dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:26.506047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a9e0-9249-47fa-a33c-287473031dae None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.506326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a9e0-9249-47fa-a33c-287473031dae None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.506600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a9e0-9249-47fa-a33c-287473031dae None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.507306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a9e0-9249-47fa-a33c-287473031dae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.508708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a9e0-9249-47fa-a33c-287473031dae None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.522418 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 390/749] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:34:26 2022] POST /identity/v3/services => generated 251 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:26.523193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a9e0-9249-47fa-a33c-287473031dae None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.568587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab35c2d-edc4-4fb5-88ba-29760b96ebd0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:26.611972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0491d7-834d-4698-88ef-d12fba7d55ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:26.613089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0491d7-834d-4698-88ef-d12fba7d55ee None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.613308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0491d7-834d-4698-88ef-d12fba7d55ee None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.613654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0491d7-834d-4698-88ef-d12fba7d55ee None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/07e77369a94844529947de0f46a54edd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.615880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0491d7-834d-4698-88ef-d12fba7d55ee None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=07e77369a94844529947de0f46a54edd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.617479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0491d7-834d-4698-88ef-d12fba7d55ee None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.632999 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 360/750] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:34:26 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/07e77369a94844529947de0f46a54edd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:34:26.640250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a9e0-9249-47fa-a33c-287473031dae None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:26.646058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7159b-6766-4087-92da-2048be5b88c9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.646425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7159b-6766-4087-92da-2048be5b88c9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.646632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7159b-6766-4087-92da-2048be5b88c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.673691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9bc7159b-6766-4087-92da-2048be5b88c9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:26.676197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9bc7159b-6766-4087-92da-2048be5b88c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:26.685340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616860c-ad30-47bd-8ba5-f87ee84a3673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:26.686017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616860c-ad30-47bd-8ba5-f87ee84a3673 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.686331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616860c-ad30-47bd-8ba5-f87ee84a3673 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.686603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616860c-ad30-47bd-8ba5-f87ee84a3673 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.687388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616860c-ad30-47bd-8ba5-f87ee84a3673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:26.687746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616860c-ad30-47bd-8ba5-f87ee84a3673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.689438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616860c-ad30-47bd-8ba5-f87ee84a3673 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.702944 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 391/751] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:26.703898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616860c-ad30-47bd-8ba5-f87ee84a3673 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.759897 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 361/752] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 20:34:26.760603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7159b-6766-4087-92da-2048be5b88c9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.815364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616860c-ad30-47bd-8ba5-f87ee84a3673 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:26.851661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa5ffe-ad9d-49fc-bad2-682293b4347c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:26.852885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa5ffe-ad9d-49fc-bad2-682293b4347c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.853375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa5ffe-ad9d-49fc-bad2-682293b4347c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.853855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa5ffe-ad9d-49fc-bad2-682293b4347c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.865218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa5ffe-ad9d-49fc-bad2-682293b4347c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.867027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa5ffe-ad9d-49fc-bad2-682293b4347c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.884193 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-71aa5ffe-ad9d-49fc-bad2-682293b4347c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:26.885983 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 392/753] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:26.887014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7159b-6766-4087-92da-2048be5b88c9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:26.887146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa5ffe-ad9d-49fc-bad2-682293b4347c None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.925358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7a63-1d64-4db3-9056-5a1084c4fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:26.926279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7a63-1d64-4db3-9056-5a1084c4fe94 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:26.926559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7a63-1d64-4db3-9056-5a1084c4fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:26.927462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7a63-1d64-4db3-9056-5a1084c4fe94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:26.934974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7a63-1d64-4db3-9056-5a1084c4fe94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:26.936713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7a63-1d64-4db3-9056-5a1084c4fe94 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:26.954269 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-6c9e7a63-1d64-4db3-9056-5a1084c4fe94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:26.956752 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 362/754] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:26.962025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7a63-1d64-4db3-9056-5a1084c4fe94 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:26.997434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa5ffe-ad9d-49fc-bad2-682293b4347c None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:27.041025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbdd27-f54c-4353-8f61-4a2b2b160b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:27.041766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbdd27-f54c-4353-8f61-4a2b2b160b16 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:27.041970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbdd27-f54c-4353-8f61-4a2b2b160b16 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:27.042244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbdd27-f54c-4353-8f61-4a2b2b160b16 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:27.042956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbdd27-f54c-4353-8f61-4a2b2b160b16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:27.044361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbdd27-f54c-4353-8f61-4a2b2b160b16 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:27.062395 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 393/755] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:34:26 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:27.063388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbdd27-f54c-4353-8f61-4a2b2b160b16 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:27.093274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7a63-1d64-4db3-9056-5a1084c4fe94 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:27.138915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a54fd9-a95f-43d5-a010-c5d2687bdd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:27.140493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a54fd9-a95f-43d5-a010-c5d2687bdd64 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:27.141027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a54fd9-a95f-43d5-a010-c5d2687bdd64 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:27.141510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a54fd9-a95f-43d5-a010-c5d2687bdd64 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:27.142469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a54fd9-a95f-43d5-a010-c5d2687bdd64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:27.143054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a54fd9-a95f-43d5-a010-c5d2687bdd64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:27.144758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a54fd9-a95f-43d5-a010-c5d2687bdd64 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:27.162892 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 363/756] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:27.168966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a54fd9-a95f-43d5-a010-c5d2687bdd64 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:27.190615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbdd27-f54c-4353-8f61-4a2b2b160b16 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:27.227053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90c93f-925a-4218-aa58-6f8aed5cc84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:27.228160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90c93f-925a-4218-aa58-6f8aed5cc84e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:27.228654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90c93f-925a-4218-aa58-6f8aed5cc84e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:27.229135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90c93f-925a-4218-aa58-6f8aed5cc84e None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:27.230175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90c93f-925a-4218-aa58-6f8aed5cc84e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:27.230736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90c93f-925a-4218-aa58-6f8aed5cc84e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:27.232446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90c93f-925a-4218-aa58-6f8aed5cc84e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:27.248519 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 394/757] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:27.255399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90c93f-925a-4218-aa58-6f8aed5cc84e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:27.304743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a54fd9-a95f-43d5-a010-c5d2687bdd64 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:27.346562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22aa6-3ee5-461c-b408-e3717b1ddc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:27.347385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22aa6-3ee5-461c-b408-e3717b1ddc53 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:27.347678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22aa6-3ee5-461c-b408-e3717b1ddc53 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:27.348003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b22aa6-3ee5-461c-b408-e3717b1ddc53 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:27.356273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b22aa6-3ee5-461c-b408-e3717b1ddc53 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:27.357826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b22aa6-3ee5-461c-b408-e3717b1ddc53 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:27.368198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90c93f-925a-4218-aa58-6f8aed5cc84e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:27.372463 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-64b22aa6-3ee5-461c-b408-e3717b1ddc53 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 26 20:34:27.374144 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 364/758] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:27.381428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22aa6-3ee5-461c-b408-e3717b1ddc53 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:27.407158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c29795-6f7b-4d39-98eb-ee4d0d06b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:27.408215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c29795-6f7b-4d39-98eb-ee4d0d06b549 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:27.408736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c29795-6f7b-4d39-98eb-ee4d0d06b549 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:27.409227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c29795-6f7b-4d39-98eb-ee4d0d06b549 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:27.410328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c29795-6f7b-4d39-98eb-ee4d0d06b549 None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=0df218115be74b8692728293c326be08) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:27.410846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c29795-6f7b-4d39-98eb-ee4d0d06b549 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:27.413102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c29795-6f7b-4d39-98eb-ee4d0d06b549 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:27.419483 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 395/759] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:27 2022] GET /identity/v3/role_assignments?user.id=0df218115be74b8692728293c326be08&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:27.497924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b22aa6-3ee5-461c-b408-e3717b1ddc53 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:27.538011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0dc2-4536-4bed-a9b9-c9e6c1257f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:27.539121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0dc2-4536-4bed-a9b9-c9e6c1257f5a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:27.539613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0dc2-4536-4bed-a9b9-c9e6c1257f5a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:27.540206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e0dc2-4536-4bed-a9b9-c9e6c1257f5a None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:27.541294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e0dc2-4536-4bed-a9b9-c9e6c1257f5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:27.541852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e0dc2-4536-4bed-a9b9-c9e6c1257f5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:27.543548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e0dc2-4536-4bed-a9b9-c9e6c1257f5a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:27.564290 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 365/760] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Mar 26 20:34:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:27.569996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c29795-6f7b-4d39-98eb-ee4d0d06b549 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:27.683989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c29795-6f7b-4d39-98eb-ee4d0d06b549 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:27.722808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12be342-d8fd-4fe7-a36c-9f3c79477cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:27.723447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12be342-d8fd-4fe7-a36c-9f3c79477cb5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:27.723757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12be342-d8fd-4fe7-a36c-9f3c79477cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:27.724056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12be342-d8fd-4fe7-a36c-9f3c79477cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:27.811345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12be342-d8fd-4fe7-a36c-9f3c79477cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:27.812835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12be342-d8fd-4fe7-a36c-9f3c79477cb5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:27.948709 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 396/761] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 26 20:34:27.953705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0dc2-4536-4bed-a9b9-c9e6c1257f5a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:28.117092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e0dc2-4536-4bed-a9b9-c9e6c1257f5a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:28.169502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c27b3-7527-4713-bc3b-6527a402ebec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:28.170330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c27b3-7527-4713-bc3b-6527a402ebec None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:28.170579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c27b3-7527-4713-bc3b-6527a402ebec None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:28.170852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c27b3-7527-4713-bc3b-6527a402ebec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:28.181147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c27b3-7527-4713-bc3b-6527a402ebec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:28.182616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c27b3-7527-4713-bc3b-6527a402ebec None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:28.200120 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-8d7c27b3-7527-4713-bc3b-6527a402ebec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:28.201498 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 366/762] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:28.206964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12be342-d8fd-4fe7-a36c-9f3c79477cb5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:28.389743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12be342-d8fd-4fe7-a36c-9f3c79477cb5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:28.437543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66a0fd-de34-4fff-b6c8-18da8e421f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:28.438214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a0fd-de34-4fff-b6c8-18da8e421f19 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:28.438495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a0fd-de34-4fff-b6c8-18da8e421f19 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:28.438767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66a0fd-de34-4fff-b6c8-18da8e421f19 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:28.439485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66a0fd-de34-4fff-b6c8-18da8e421f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:28.439787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66a0fd-de34-4fff-b6c8-18da8e421f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:28.441179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66a0fd-de34-4fff-b6c8-18da8e421f19 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:28.453197 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 397/763] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:28.458574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c27b3-7527-4713-bc3b-6527a402ebec None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:28.558294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c27b3-7527-4713-bc3b-6527a402ebec None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:28.600700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c23c8-c1e4-49ad-8793-4cc736e5d576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:28.601499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c23c8-c1e4-49ad-8793-4cc736e5d576 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:28.601780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c23c8-c1e4-49ad-8793-4cc736e5d576 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:28.602146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c23c8-c1e4-49ad-8793-4cc736e5d576 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:28.613221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c23c8-c1e4-49ad-8793-4cc736e5d576 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:28.614787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c23c8-c1e4-49ad-8793-4cc736e5d576 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:28.629307 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0d5c23c8-c1e4-49ad-8793-4cc736e5d576 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:28.631034 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 367/764] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:28.636654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66a0fd-de34-4fff-b6c8-18da8e421f19 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:28.755956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66a0fd-de34-4fff-b6c8-18da8e421f19 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:28.790430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e665c7-7158-4f0e-9cd3-04cb4c1ab89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:28.791081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e665c7-7158-4f0e-9cd3-04cb4c1ab89e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:28.791364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e665c7-7158-4f0e-9cd3-04cb4c1ab89e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:28.791639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e665c7-7158-4f0e-9cd3-04cb4c1ab89e None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:28.792452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e665c7-7158-4f0e-9cd3-04cb4c1ab89e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:28.792758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e665c7-7158-4f0e-9cd3-04cb4c1ab89e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:28.794187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e665c7-7158-4f0e-9cd3-04cb4c1ab89e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:28.806770 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 398/765] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:28.817682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c23c8-c1e4-49ad-8793-4cc736e5d576 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:28.963825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c23c8-c1e4-49ad-8793-4cc736e5d576 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:29.005313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649fb29-4992-4ca7-a294-5ddc32701823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:29.006078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fb29-4992-4ca7-a294-5ddc32701823 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:29.006301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fb29-4992-4ca7-a294-5ddc32701823 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:29.006576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fb29-4992-4ca7-a294-5ddc32701823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:29.007434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649fb29-4992-4ca7-a294-5ddc32701823 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=08d764c8ff5f48a092bd69030c5e1b47) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:29.007746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649fb29-4992-4ca7-a294-5ddc32701823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:29.009276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649fb29-4992-4ca7-a294-5ddc32701823 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:29.015949 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 368/766] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:28 2022] GET /identity/v3/role_assignments?user.id=08d764c8ff5f48a092bd69030c5e1b47&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:29.397247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14f4aa-c6f4-4040-a2af-86c006ac3baa None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:29.397910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14f4aa-c6f4-4040-a2af-86c006ac3baa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:29.397910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14f4aa-c6f4-4040-a2af-86c006ac3baa None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:29.399766 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 399/767] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:29.406848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64571c86-2fc1-4595-931c-c6d5b892ae08 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:29.407418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64571c86-2fc1-4595-931c-c6d5b892ae08 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:29.407418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64571c86-2fc1-4595-931c-c6d5b892ae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:29.424359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-64571c86-2fc1-4595-931c-c6d5b892ae08 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:29.425531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-64571c86-2fc1-4595-931c-c6d5b892ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:29.506037 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 369/768] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:29.546641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14f4aa-c6f4-4040-a2af-86c006ac3baa None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:29.587043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9783e33-a3e0-4122-beee-3a5d17ddb05d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:29.587043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9783e33-a3e0-4122-beee-3a5d17ddb05d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:29.587043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9783e33-a3e0-4122-beee-3a5d17ddb05d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:29.587860 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 370/769] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:29.594636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fa3b6-38e0-42be-b2fd-7cf8aabe61f8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:29.595208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fa3b6-38e0-42be-b2fd-7cf8aabe61f8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:29.595689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fa3b6-38e0-42be-b2fd-7cf8aabe61f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:29.613323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-974fa3b6-38e0-42be-b2fd-7cf8aabe61f8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:29.615522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-974fa3b6-38e0-42be-b2fd-7cf8aabe61f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:29.713643 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 371/770] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:29.719945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14f4aa-c6f4-4040-a2af-86c006ac3baa None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:29.755543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528701-a55f-4c68-847e-2ad0b41c77a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:29.756366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528701-a55f-4c68-847e-2ad0b41c77a6 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:29.756631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528701-a55f-4c68-847e-2ad0b41c77a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:29.756906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528701-a55f-4c68-847e-2ad0b41c77a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:29.757268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fa3b6-38e0-42be-b2fd-7cf8aabe61f8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:29.757542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528701-a55f-4c68-847e-2ad0b41c77a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:29.758924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528701-a55f-4c68-847e-2ad0b41c77a6 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:29.772446 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-39528701-a55f-4c68-847e-2ad0b41c77a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 26 20:34:29.773932 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 400/771] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Mar 26 20:34:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:29.783399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528701-a55f-4c68-847e-2ad0b41c77a6 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:29.897442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528701-a55f-4c68-847e-2ad0b41c77a6 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:29.916035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fa3b6-38e0-42be-b2fd-7cf8aabe61f8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:29.939111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063f4e8-0d6b-4a9b-bf2e-98f26a217bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:29.939780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063f4e8-0d6b-4a9b-bf2e-98f26a217bcc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:29.940090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063f4e8-0d6b-4a9b-bf2e-98f26a217bcc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:29.940360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063f4e8-0d6b-4a9b-bf2e-98f26a217bcc None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:29.941392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063f4e8-0d6b-4a9b-bf2e-98f26a217bcc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:29.941700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063f4e8-0d6b-4a9b-bf2e-98f26a217bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:29.947181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5063f4e8-0d6b-4a9b-bf2e-98f26a217bcc None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:29.949049 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 401/772] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Mar 26 20:34:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:29.960323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063f4e8-0d6b-4a9b-bf2e-98f26a217bcc None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:29.979675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb186291-7261-4b29-8f2b-196f7ed3ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:29.982538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb186291-7261-4b29-8f2b-196f7ed3ac12 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:29.984211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb186291-7261-4b29-8f2b-196f7ed3ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:29.985361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb186291-7261-4b29-8f2b-196f7ed3ac12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.008195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb186291-7261-4b29-8f2b-196f7ed3ac12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:30.018256 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-cb186291-7261-4b29-8f2b-196f7ed3ac12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:34:30.024169 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 372/773] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:30.026756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb186291-7261-4b29-8f2b-196f7ed3ac12 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:30.130697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb186291-7261-4b29-8f2b-196f7ed3ac12 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:30.166870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a76d5c-48e6-45fc-92c9-ca3e8ac3f5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:30.167899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a76d5c-48e6-45fc-92c9-ca3e8ac3f5d3 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.168436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a76d5c-48e6-45fc-92c9-ca3e8ac3f5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.168929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a76d5c-48e6-45fc-92c9-ca3e8ac3f5d3 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.169877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a76d5c-48e6-45fc-92c9-ca3e8ac3f5d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:30.170397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a76d5c-48e6-45fc-92c9-ca3e8ac3f5d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:30.172052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a76d5c-48e6-45fc-92c9-ca3e8ac3f5d3 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:30.176285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063f4e8-0d6b-4a9b-bf2e-98f26a217bcc None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:30.182428 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 373/774] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:30.188450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a76d5c-48e6-45fc-92c9-ca3e8ac3f5d3 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:30.240708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1441842-f3d1-4cbd-aa78-1ae3b6bc8790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:30.241304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1441842-f3d1-4cbd-aa78-1ae3b6bc8790 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.241633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1441842-f3d1-4cbd-aa78-1ae3b6bc8790 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.241843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1441842-f3d1-4cbd-aa78-1ae3b6bc8790 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.242546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1441842-f3d1-4cbd-aa78-1ae3b6bc8790 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:30.242855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1441842-f3d1-4cbd-aa78-1ae3b6bc8790 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:30.244262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1441842-f3d1-4cbd-aa78-1ae3b6bc8790 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:30.249636 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 402/775] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Mar 26 20:34:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:30.255181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1441842-f3d1-4cbd-aa78-1ae3b6bc8790 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:30.294282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a76d5c-48e6-45fc-92c9-ca3e8ac3f5d3 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:30.328817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cfb8e-9b80-471d-897b-4573d4e5d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:30.329981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cfb8e-9b80-471d-897b-4573d4e5d83b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.330497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cfb8e-9b80-471d-897b-4573d4e5d83b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.330978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132cfb8e-9b80-471d-897b-4573d4e5d83b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.351271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cfb8e-9b80-471d-897b-4573d4e5d83b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:30.357420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132cfb8e-9b80-471d-897b-4573d4e5d83b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:30.382245 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-132cfb8e-9b80-471d-897b-4573d4e5d83b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:30.383444 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 374/776] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:30.390387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cfb8e-9b80-471d-897b-4573d4e5d83b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:30.419674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1441842-f3d1-4cbd-aa78-1ae3b6bc8790 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:30.466701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688066cb-099b-4b1b-a13c-cd4ef658416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:30.467869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688066cb-099b-4b1b-a13c-cd4ef658416e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.468351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688066cb-099b-4b1b-a13c-cd4ef658416e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.468776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688066cb-099b-4b1b-a13c-cd4ef658416e None admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.469967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688066cb-099b-4b1b-a13c-cd4ef658416e None admin] RBAC: Adding query filter params (interface=public, service_id=0bab9fd5e27d4b369eefed5423b01ade, region_id=RegionOne) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:30.470427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688066cb-099b-4b1b-a13c-cd4ef658416e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:30.472402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688066cb-099b-4b1b-a13c-cd4ef658416e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:30.484349 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 403/777] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Mar 26 20:34:30 2022] GET /identity/v3/endpoints?service_id=0bab9fd5e27d4b369eefed5423b01ade&interface=public®ion_id=RegionOne => generated 194 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:30.486114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48c38-d3c5-4ccf-a122-155f09a2d096 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.486690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48c38-d3c5-4ccf-a122-155f09a2d096 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.487467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48c38-d3c5-4ccf-a122-155f09a2d096 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.495598 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 404/778] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:30.495598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48c38-d3c5-4ccf-a122-155f09a2d096 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:30.501660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132cfb8e-9b80-471d-897b-4573d4e5d83b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:30.537771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dec0c4-0340-497d-aa17-4d23273fd4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:30.538440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec0c4-0340-497d-aa17-4d23273fd4c7 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.538724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec0c4-0340-497d-aa17-4d23273fd4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.539010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dec0c4-0340-497d-aa17-4d23273fd4c7 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.539726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dec0c4-0340-497d-aa17-4d23273fd4c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:30.540064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dec0c4-0340-497d-aa17-4d23273fd4c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:30.541457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dec0c4-0340-497d-aa17-4d23273fd4c7 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:30.553729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 375/779] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:30.555075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b71b-1bef-44cf-843c-edc85df514de None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.555367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b71b-1bef-44cf-843c-edc85df514de None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.555643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95b71b-1bef-44cf-843c-edc85df514de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.572323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8b95b71b-1bef-44cf-843c-edc85df514de None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:30.573494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8b95b71b-1bef-44cf-843c-edc85df514de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:30.599665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48c38-d3c5-4ccf-a122-155f09a2d096 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:30.633354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da1221-a1b8-4414-a543-184bb5974f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:30.634008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da1221-a1b8-4414-a543-184bb5974f32 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.634286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da1221-a1b8-4414-a543-184bb5974f32 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.634555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da1221-a1b8-4414-a543-184bb5974f32 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.635221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da1221-a1b8-4414-a543-184bb5974f32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:30.636632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da1221-a1b8-4414-a543-184bb5974f32 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:30.641491 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 405/780] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Mar 26 20:34:30 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:30.642250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da1221-a1b8-4414-a543-184bb5974f32 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:30.643420 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 376/781] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:30.645038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5614e-34e5-4a8f-82e9-cb2f3f81819c None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.645861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5614e-34e5-4a8f-82e9-cb2f3f81819c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.646136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5614e-34e5-4a8f-82e9-cb2f3f81819c None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.648074 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 377/782] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:30.669393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ad238-8b03-4a64-bacc-c15b6ce9d44d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.669738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ad238-8b03-4a64-bacc-c15b6ce9d44d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.669952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ad238-8b03-4a64-bacc-c15b6ce9d44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.699388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-419ad238-8b03-4a64-bacc-c15b6ce9d44d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:30.704096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-419ad238-8b03-4a64-bacc-c15b6ce9d44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:30.758849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da1221-a1b8-4414-a543-184bb5974f32 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:30.779461 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 378/783] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:30.780804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ad238-8b03-4a64-bacc-c15b6ce9d44d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:30.813278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e28fb-7898-4043-bf82-8808e134e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:30.814127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e28fb-7898-4043-bf82-8808e134e393 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.814435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e28fb-7898-4043-bf82-8808e134e393 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.814681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e28fb-7898-4043-bf82-8808e134e393 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.828286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e28fb-7898-4043-bf82-8808e134e393 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:30.829804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e28fb-7898-4043-bf82-8808e134e393 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:30.847422 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-890e28fb-7898-4043-bf82-8808e134e393 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 26 20:34:30.848817 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 406/784] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Mar 26 20:34:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:30.849690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e28fb-7898-4043-bf82-8808e134e393 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:30.889941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ad238-8b03-4a64-bacc-c15b6ce9d44d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:30.929382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6445af-debc-489d-971b-eea793b278af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:30.930572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6445af-debc-489d-971b-eea793b278af None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:30.931038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6445af-debc-489d-971b-eea793b278af None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:30.931493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6445af-debc-489d-971b-eea793b278af None admin] PATH_INFO: `/v3/services/network` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:30.932542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6445af-debc-489d-971b-eea793b278af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:30.934915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6445af-debc-489d-971b-eea793b278af None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:30.949637 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-5e6445af-debc-489d-971b-eea793b278af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 26 20:34:30.951475 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 379/785] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:30 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:30.952871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6445af-debc-489d-971b-eea793b278af None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:30.967513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e28fb-7898-4043-bf82-8808e134e393 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.001494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3dd09-261c-44fc-b66a-0b5162e6927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.002420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3dd09-261c-44fc-b66a-0b5162e6927b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.002761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3dd09-261c-44fc-b66a-0b5162e6927b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.003099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d3dd09-261c-44fc-b66a-0b5162e6927b None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.027881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d3dd09-261c-44fc-b66a-0b5162e6927b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:31.034826 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-89d3dd09-261c-44fc-b66a-0b5162e6927b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:31.038482 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 407/786] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:31.038482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3dd09-261c-44fc-b66a-0b5162e6927b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.080780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6445af-debc-489d-971b-eea793b278af None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.117137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2ae3-3055-4c9f-8333-219c6e4a6376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.118051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2ae3-3055-4c9f-8333-219c6e4a6376 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.118480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2ae3-3055-4c9f-8333-219c6e4a6376 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.118920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a2ae3-3055-4c9f-8333-219c6e4a6376 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.120105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2ae3-3055-4c9f-8333-219c6e4a6376 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:31.121038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2ae3-3055-4c9f-8333-219c6e4a6376 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:31.122977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a2ae3-3055-4c9f-8333-219c6e4a6376 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:31.145233 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 380/787] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Mar 26 20:34:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:31.146919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2ae3-3055-4c9f-8333-219c6e4a6376 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.158858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d3dd09-261c-44fc-b66a-0b5162e6927b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.196761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7e00-59d1-4666-90b1-a101f487edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.197680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7e00-59d1-4666-90b1-a101f487edab None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.198412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7e00-59d1-4666-90b1-a101f487edab None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.199225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7e00-59d1-4666-90b1-a101f487edab None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.200426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c7e00-59d1-4666-90b1-a101f487edab None admin] RBAC: Adding query filter params (name=network) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:31.200881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c7e00-59d1-4666-90b1-a101f487edab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:31.203076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c7e00-59d1-4666-90b1-a101f487edab None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:31.209678 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 408/788] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:31.210744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7e00-59d1-4666-90b1-a101f487edab None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.268631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a2ae3-3055-4c9f-8333-219c6e4a6376 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.304318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e7e00-eed9-4c5c-ae2b-48288da88b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.305061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e7e00-eed9-4c5c-ae2b-48288da88b68 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.305508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e7e00-eed9-4c5c-ae2b-48288da88b68 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.305931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e7e00-eed9-4c5c-ae2b-48288da88b68 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.306882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e7e00-eed9-4c5c-ae2b-48288da88b68 None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:31.307307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e7e00-eed9-4c5c-ae2b-48288da88b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:31.309057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e7e00-eed9-4c5c-ae2b-48288da88b68 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:31.322333 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 381/789] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:31.323429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e7e00-eed9-4c5c-ae2b-48288da88b68 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.325380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7e00-59d1-4666-90b1-a101f487edab None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.367239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98aca-64b0-4eae-8c2a-37b9bbff02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.368218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98aca-64b0-4eae-8c2a-37b9bbff02c4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.369051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98aca-64b0-4eae-8c2a-37b9bbff02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.369505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98aca-64b0-4eae-8c2a-37b9bbff02c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.433449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e7e00-eed9-4c5c-ae2b-48288da88b68 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.456201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd98aca-64b0-4eae-8c2a-37b9bbff02c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:31.458524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd98aca-64b0-4eae-8c2a-37b9bbff02c4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:31.471326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632efa-192e-4c8d-8d85-14dcd70d844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.472015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632efa-192e-4c8d-8d85-14dcd70d844a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.472301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632efa-192e-4c8d-8d85-14dcd70d844a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.472576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0632efa-192e-4c8d-8d85-14dcd70d844a None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.473475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632efa-192e-4c8d-8d85-14dcd70d844a None admin] RBAC: Adding query filter params (type=network) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:31.473672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632efa-192e-4c8d-8d85-14dcd70d844a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:31.475003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0632efa-192e-4c8d-8d85-14dcd70d844a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:31.480743 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 382/790] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:31.481651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632efa-192e-4c8d-8d85-14dcd70d844a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.569558 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 409/791] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:34:31.570710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98aca-64b0-4eae-8c2a-37b9bbff02c4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.612312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0632efa-192e-4c8d-8d85-14dcd70d844a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.646636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01747db-b57c-4f90-9c33-3d40bffc204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.647829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01747db-b57c-4f90-9c33-3d40bffc204e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.648359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01747db-b57c-4f90-9c33-3d40bffc204e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.648886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01747db-b57c-4f90-9c33-3d40bffc204e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.659583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01747db-b57c-4f90-9c33-3d40bffc204e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:31.661440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01747db-b57c-4f90-9c33-3d40bffc204e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:31.678134 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b01747db-b57c-4f90-9c33-3d40bffc204e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:31.679966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 383/792] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:31.680983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01747db-b57c-4f90-9c33-3d40bffc204e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.688374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98aca-64b0-4eae-8c2a-37b9bbff02c4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.737201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e4eaa-7646-4f58-aa5b-654dcf2751c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.737885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e4eaa-7646-4f58-aa5b-654dcf2751c2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.738170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e4eaa-7646-4f58-aa5b-654dcf2751c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.738450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e4eaa-7646-4f58-aa5b-654dcf2751c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.739425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e4eaa-7646-4f58-aa5b-654dcf2751c2 None admin] RBAC: Adding query filter params (interface=public, service_id=f25d8d0588f64cb99398ac541972670e, region_id=RegionOne) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:31.740067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e4eaa-7646-4f58-aa5b-654dcf2751c2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:31.741749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e4eaa-7646-4f58-aa5b-654dcf2751c2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:31.748653 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 410/793] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/endpoints?service_id=f25d8d0588f64cb99398ac541972670e&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:31.749731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e4eaa-7646-4f58-aa5b-654dcf2751c2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.789952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01747db-b57c-4f90-9c33-3d40bffc204e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.824636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d78912-ef3e-43f3-af20-96ce63da4fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.825350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d78912-ef3e-43f3-af20-96ce63da4fa0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.825632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d78912-ef3e-43f3-af20-96ce63da4fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.825909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d78912-ef3e-43f3-af20-96ce63da4fa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.836836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d78912-ef3e-43f3-af20-96ce63da4fa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:31.838324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d78912-ef3e-43f3-af20-96ce63da4fa0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:31.854700 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-20d78912-ef3e-43f3-af20-96ce63da4fa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:31.859969 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 384/794] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:31.859969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d78912-ef3e-43f3-af20-96ce63da4fa0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.860514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e4eaa-7646-4f58-aa5b-654dcf2751c2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:31.891882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ffa973-4853-420f-aa57-03c7e97c03a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:31.892720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffa973-4853-420f-aa57-03c7e97c03a3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.893068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffa973-4853-420f-aa57-03c7e97c03a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.893346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffa973-4853-420f-aa57-03c7e97c03a3 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.894087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffa973-4853-420f-aa57-03c7e97c03a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:31.894397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffa973-4853-420f-aa57-03c7e97c03a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:31.896391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ffa973-4853-420f-aa57-03c7e97c03a3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:31.907953 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 411/795] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:31.908980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c5dc5-825e-4c23-8625-0bbdfb010838 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:31.909267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c5dc5-825e-4c23-8625-0bbdfb010838 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:31.909544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c5dc5-825e-4c23-8625-0bbdfb010838 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:31.916067 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 412/796] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:31.916067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c5dc5-825e-4c23-8625-0bbdfb010838 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:31.965215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d78912-ef3e-43f3-af20-96ce63da4fa0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.003026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4722b3-44e7-40ff-b718-984992d80f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.003687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4722b3-44e7-40ff-b718-984992d80f0b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.003996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4722b3-44e7-40ff-b718-984992d80f0b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.004278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4722b3-44e7-40ff-b718-984992d80f0b None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.005614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4722b3-44e7-40ff-b718-984992d80f0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.008097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4722b3-44e7-40ff-b718-984992d80f0b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.020389 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 385/797] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:32.021226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4722b3-44e7-40ff-b718-984992d80f0b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.023946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c5dc5-825e-4c23-8625-0bbdfb010838 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.059864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f5148-3b98-406e-b178-5e6c64d9d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.060605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5148-3b98-406e-b178-5e6c64d9d2cc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.060882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5148-3b98-406e-b178-5e6c64d9d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.061152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5148-3b98-406e-b178-5e6c64d9d2cc None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.061863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f5148-3b98-406e-b178-5e6c64d9d2cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:32.062164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f5148-3b98-406e-b178-5e6c64d9d2cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.063563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f5148-3b98-406e-b178-5e6c64d9d2cc None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.076565 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 413/798] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:32.082326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717716-fa49-4f3a-b4e3-f5e5c8f29e29 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.082664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717716-fa49-4f3a-b4e3-f5e5c8f29e29 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.082951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0717716-fa49-4f3a-b4e3-f5e5c8f29e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.100791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e0717716-fa49-4f3a-b4e3-f5e5c8f29e29 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:32.101993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e0717716-fa49-4f3a-b4e3-f5e5c8f29e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:32.150248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4722b3-44e7-40ff-b718-984992d80f0b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.172173 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 414/799] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:32.173114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717716-fa49-4f3a-b4e3-f5e5c8f29e29 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.209699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54474-fd3d-4df0-8548-957eafa05a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.210522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54474-fd3d-4df0-8548-957eafa05a09 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.210802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54474-fd3d-4df0-8548-957eafa05a09 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.211075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a54474-fd3d-4df0-8548-957eafa05a09 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.226321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a54474-fd3d-4df0-8548-957eafa05a09 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.227105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a54474-fd3d-4df0-8548-957eafa05a09 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.246242 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d1a54474-fd3d-4df0-8548-957eafa05a09 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 26 20:34:32.248770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 386/800] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:32.249580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54474-fd3d-4df0-8548-957eafa05a09 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.290160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0717716-fa49-4f3a-b4e3-f5e5c8f29e29 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.334089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7626f9-5f85-4c8b-bcad-ae4f852822d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.335502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7626f9-5f85-4c8b-bcad-ae4f852822d2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.336145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7626f9-5f85-4c8b-bcad-ae4f852822d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.336929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7626f9-5f85-4c8b-bcad-ae4f852822d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.346933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7626f9-5f85-4c8b-bcad-ae4f852822d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.349700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7626f9-5f85-4c8b-bcad-ae4f852822d2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.352198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a54474-fd3d-4df0-8548-957eafa05a09 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.367298 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-4c7626f9-5f85-4c8b-bcad-ae4f852822d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:32.369418 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 415/801] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:32.370661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7626f9-5f85-4c8b-bcad-ae4f852822d2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.387837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df3b5-e801-4a2f-9d01-7c54aa03d1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.388718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df3b5-e801-4a2f-9d01-7c54aa03d1cc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.389002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df3b5-e801-4a2f-9d01-7c54aa03d1cc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.389331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5df3b5-e801-4a2f-9d01-7c54aa03d1cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.400364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5df3b5-e801-4a2f-9d01-7c54aa03d1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:32.407487 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0b5df3b5-e801-4a2f-9d01-7c54aa03d1cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:34:32.409106 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 387/802] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:32.409989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df3b5-e801-4a2f-9d01-7c54aa03d1cc None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.474939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7626f9-5f85-4c8b-bcad-ae4f852822d2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.515614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d931645-5796-4932-bd29-0e78f60401b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.516816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d931645-5796-4932-bd29-0e78f60401b1 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.516939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5df3b5-e801-4a2f-9d01-7c54aa03d1cc None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.517417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d931645-5796-4932-bd29-0e78f60401b1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.517931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d931645-5796-4932-bd29-0e78f60401b1 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.518956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d931645-5796-4932-bd29-0e78f60401b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:32.519475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d931645-5796-4932-bd29-0e78f60401b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.521325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d931645-5796-4932-bd29-0e78f60401b1 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.541225 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 416/803] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:32.542384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d931645-5796-4932-bd29-0e78f60401b1 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.561162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b265d95-715c-4bd7-a099-f079c5c857f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.562317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265d95-715c-4bd7-a099-f079c5c857f0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.562803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265d95-715c-4bd7-a099-f079c5c857f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.563417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b265d95-715c-4bd7-a099-f079c5c857f0 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.564829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b265d95-715c-4bd7-a099-f079c5c857f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:32.565606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b265d95-715c-4bd7-a099-f079c5c857f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.567756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b265d95-715c-4bd7-a099-f079c5c857f0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.583443 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 388/804] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:32.585505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b265d95-715c-4bd7-a099-f079c5c857f0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.656273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d931645-5796-4932-bd29-0e78f60401b1 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.691085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f6d76-5301-4830-ace9-9719ccc43ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.691744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f6d76-5301-4830-ace9-9719ccc43ada None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.692163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f6d76-5301-4830-ace9-9719ccc43ada None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.692442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f6d76-5301-4830-ace9-9719ccc43ada None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.693238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f6d76-5301-4830-ace9-9719ccc43ada None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:32.693541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f6d76-5301-4830-ace9-9719ccc43ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.695274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f6d76-5301-4830-ace9-9719ccc43ada None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.703434 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 417/805] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:32.704349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f6d76-5301-4830-ace9-9719ccc43ada None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.708441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b265d95-715c-4bd7-a099-f079c5c857f0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.743636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000c27-46d0-4254-a22f-2171a48ec8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.744935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000c27-46d0-4254-a22f-2171a48ec8c8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.745425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000c27-46d0-4254-a22f-2171a48ec8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.745908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45000c27-46d0-4254-a22f-2171a48ec8c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.757736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45000c27-46d0-4254-a22f-2171a48ec8c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.759707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45000c27-46d0-4254-a22f-2171a48ec8c8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.778392 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-45000c27-46d0-4254-a22f-2171a48ec8c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:32.780290 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 389/806] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:32.781271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000c27-46d0-4254-a22f-2171a48ec8c8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.808411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f6d76-5301-4830-ace9-9719ccc43ada None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.842976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142d9dc-950c-465b-9a89-592a06a24268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.843550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142d9dc-950c-465b-9a89-592a06a24268 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.843870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142d9dc-950c-465b-9a89-592a06a24268 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.844425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142d9dc-950c-465b-9a89-592a06a24268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.845245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142d9dc-950c-465b-9a89-592a06a24268 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=07e77369a94844529947de0f46a54edd) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:32.845553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142d9dc-950c-465b-9a89-592a06a24268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.846981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1142d9dc-950c-465b-9a89-592a06a24268 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.853897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 418/807] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/role_assignments?user.id=07e77369a94844529947de0f46a54edd&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:32.855260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142d9dc-950c-465b-9a89-592a06a24268 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.886175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45000c27-46d0-4254-a22f-2171a48ec8c8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.923358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bcab3-4f94-49f3-8ab1-4c4ed48e1209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.924512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bcab3-4f94-49f3-8ab1-4c4ed48e1209 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.925006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bcab3-4f94-49f3-8ab1-4c4ed48e1209 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.925497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bcab3-4f94-49f3-8ab1-4c4ed48e1209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.936426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bcab3-4f94-49f3-8ab1-4c4ed48e1209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:32.938280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bcab3-4f94-49f3-8ab1-4c4ed48e1209 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:32.956024 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-519bcab3-4f94-49f3-8ab1-4c4ed48e1209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:32.958457 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 390/808] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:32.959626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142d9dc-950c-465b-9a89-592a06a24268 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:32.969086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bcab3-4f94-49f3-8ab1-4c4ed48e1209 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:32.997754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e6aef-a2bd-41c2-9fe2-88880834304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:32.998523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e6aef-a2bd-41c2-9fe2-88880834304b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:32.998758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e6aef-a2bd-41c2-9fe2-88880834304b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:32.999086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e6aef-a2bd-41c2-9fe2-88880834304b None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:32.999822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e6aef-a2bd-41c2-9fe2-88880834304b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:33.000172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e6aef-a2bd-41c2-9fe2-88880834304b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:33.001686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e6aef-a2bd-41c2-9fe2-88880834304b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:33.027514 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 419/809] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:33.032791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e6aef-a2bd-41c2-9fe2-88880834304b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:33.104514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bcab3-4f94-49f3-8ab1-4c4ed48e1209 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:33.140682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e6aef-a2bd-41c2-9fe2-88880834304b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:33.153109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a0100-a27f-4ac1-84f0-0a7dee03978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:33.154026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a0100-a27f-4ac1-84f0-0a7dee03978c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.154521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a0100-a27f-4ac1-84f0-0a7dee03978c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.155016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a0100-a27f-4ac1-84f0-0a7dee03978c None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.155948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a0100-a27f-4ac1-84f0-0a7dee03978c None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:33.156455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a0100-a27f-4ac1-84f0-0a7dee03978c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:33.158035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a0100-a27f-4ac1-84f0-0a7dee03978c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:33.170223 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 391/810] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:33.175224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a0100-a27f-4ac1-84f0-0a7dee03978c None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:33.182293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaca58-1bcb-4e20-8cee-65e6314c9be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:33.183380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaca58-1bcb-4e20-8cee-65e6314c9be4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.183880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaca58-1bcb-4e20-8cee-65e6314c9be4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.184390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceaca58-1bcb-4e20-8cee-65e6314c9be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.191896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaca58-1bcb-4e20-8cee-65e6314c9be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:33.193903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceaca58-1bcb-4e20-8cee-65e6314c9be4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:33.209305 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-0ceaca58-1bcb-4e20-8cee-65e6314c9be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:33.210813 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 420/811] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:33.219780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaca58-1bcb-4e20-8cee-65e6314c9be4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:33.314512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a0100-a27f-4ac1-84f0-0a7dee03978c None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:33.349657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceaca58-1bcb-4e20-8cee-65e6314c9be4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:33.352383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01224ad5-0749-42f1-a26a-4b0c297d35e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:33.353255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01224ad5-0749-42f1-a26a-4b0c297d35e6 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.353542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01224ad5-0749-42f1-a26a-4b0c297d35e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.353816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01224ad5-0749-42f1-a26a-4b0c297d35e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.361959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01224ad5-0749-42f1-a26a-4b0c297d35e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:33.363374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01224ad5-0749-42f1-a26a-4b0c297d35e6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:33.376851 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-01224ad5-0749-42f1-a26a-4b0c297d35e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 26 20:34:33.378428 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 392/812] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:33.380287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234583ca-865c-4be6-a253-f6915c1b876d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.380577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234583ca-865c-4be6-a253-f6915c1b876d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.380853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234583ca-865c-4be6-a253-f6915c1b876d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.382757 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 393/813] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:33.384204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234583ca-865c-4be6-a253-f6915c1b876d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:33.391622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fcfda-7e7e-4666-b9da-6f3c878e2916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:33.392342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fcfda-7e7e-4666-b9da-6f3c878e2916 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.392628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fcfda-7e7e-4666-b9da-6f3c878e2916 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.392907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fcfda-7e7e-4666-b9da-6f3c878e2916 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.393707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fcfda-7e7e-4666-b9da-6f3c878e2916 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:33.394018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fcfda-7e7e-4666-b9da-6f3c878e2916 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:33.396132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fcfda-7e7e-4666-b9da-6f3c878e2916 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:33.409739 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 421/814] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:33.411718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717b7bd-4ccd-4d21-8a16-2102df78a67b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.412006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717b7bd-4ccd-4d21-8a16-2102df78a67b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.412285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717b7bd-4ccd-4d21-8a16-2102df78a67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.431675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8717b7bd-4ccd-4d21-8a16-2102df78a67b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:33.433282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8717b7bd-4ccd-4d21-8a16-2102df78a67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:33.505096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 422/815] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:33.506774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717b7bd-4ccd-4d21-8a16-2102df78a67b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:33.524115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234583ca-865c-4be6-a253-f6915c1b876d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:33.567871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cadef3-4a83-4c33-aff9-d81ed919c470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:33.568823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cadef3-4a83-4c33-aff9-d81ed919c470 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.569110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cadef3-4a83-4c33-aff9-d81ed919c470 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.569386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cadef3-4a83-4c33-aff9-d81ed919c470 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.570641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cadef3-4a83-4c33-aff9-d81ed919c470 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:33.570957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cadef3-4a83-4c33-aff9-d81ed919c470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:33.572726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cadef3-4a83-4c33-aff9-d81ed919c470 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:33.595936 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 394/816] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Mar 26 20:34:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:33.596772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cadef3-4a83-4c33-aff9-d81ed919c470 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:33.627452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717b7bd-4ccd-4d21-8a16-2102df78a67b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:33.662310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf58db-e7c8-490b-bdb5-ed748ba29c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:33.663514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf58db-e7c8-490b-bdb5-ed748ba29c07 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.664056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf58db-e7c8-490b-bdb5-ed748ba29c07 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.664535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf58db-e7c8-490b-bdb5-ed748ba29c07 None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/0df218115be74b8692728293c326be08/roles/1d095fda854f45db887c85e1d6d5ac09` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.679198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf58db-e7c8-490b-bdb5-ed748ba29c07 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=0df218115be74b8692728293c326be08, role_id=1d095fda854f45db887c85e1d6d5ac09)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:33.680947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf58db-e7c8-490b-bdb5-ed748ba29c07 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:33.702320 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 423/817] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:34:33 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/0df218115be74b8692728293c326be08/roles/1d095fda854f45db887c85e1d6d5ac09 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:34:33.702320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf58db-e7c8-490b-bdb5-ed748ba29c07 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:33.725254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cadef3-4a83-4c33-aff9-d81ed919c470 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:33.797485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339db32-c3c6-4b36-8a24-00af349b82d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:33.798412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339db32-c3c6-4b36-8a24-00af349b82d9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.798699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339db32-c3c6-4b36-8a24-00af349b82d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.799333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7339db32-c3c6-4b36-8a24-00af349b82d9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.800019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339db32-c3c6-4b36-8a24-00af349b82d9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:33.802403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7339db32-c3c6-4b36-8a24-00af349b82d9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:33.821557 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-7339db32-c3c6-4b36-8a24-00af349b82d9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 26 20:34:33.831165 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 395/818] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Mar 26 20:34:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:33.834892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339db32-c3c6-4b36-8a24-00af349b82d9 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:33.876427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf58db-e7c8-490b-bdb5-ed748ba29c07 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:33.916850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd79ecd-096c-4885-b2a1-d3c83f5a6130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:33.917615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd79ecd-096c-4885-b2a1-d3c83f5a6130 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:33.917893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd79ecd-096c-4885-b2a1-d3c83f5a6130 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:33.918216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd79ecd-096c-4885-b2a1-d3c83f5a6130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:33.931811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd79ecd-096c-4885-b2a1-d3c83f5a6130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:33.933638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd79ecd-096c-4885-b2a1-d3c83f5a6130 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:33.954520 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-bdd79ecd-096c-4885-b2a1-d3c83f5a6130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:33.956127 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 424/819] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:33.961890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd79ecd-096c-4885-b2a1-d3c83f5a6130 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:34.006650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7339db32-c3c6-4b36-8a24-00af349b82d9 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:34.048478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff39eb6-4f64-4fbe-bfae-9d5e97edf9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:34.049624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff39eb6-4f64-4fbe-bfae-9d5e97edf9af None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:34.050119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff39eb6-4f64-4fbe-bfae-9d5e97edf9af None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:34.050622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff39eb6-4f64-4fbe-bfae-9d5e97edf9af None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:34.052356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff39eb6-4f64-4fbe-bfae-9d5e97edf9af None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:34.052669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff39eb6-4f64-4fbe-bfae-9d5e97edf9af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:34.054055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff39eb6-4f64-4fbe-bfae-9d5e97edf9af None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:34.060407 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 396/820] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Mar 26 20:34:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:34.065880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff39eb6-4f64-4fbe-bfae-9d5e97edf9af None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:34.129096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd79ecd-096c-4885-b2a1-d3c83f5a6130 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:34.181804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634de033-5b28-4381-96b0-2656a47fa965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:34.182468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634de033-5b28-4381-96b0-2656a47fa965 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:34.182748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634de033-5b28-4381-96b0-2656a47fa965 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:34.183019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634de033-5b28-4381-96b0-2656a47fa965 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:34.183729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634de033-5b28-4381-96b0-2656a47fa965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:34.184062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634de033-5b28-4381-96b0-2656a47fa965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:34.185750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634de033-5b28-4381-96b0-2656a47fa965 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:34.203319 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 425/821] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:34.204904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634de033-5b28-4381-96b0-2656a47fa965 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:34.225071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff39eb6-4f64-4fbe-bfae-9d5e97edf9af None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:34.292397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d476f5-4349-45e9-a840-86aebb60007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:34.293066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d476f5-4349-45e9-a840-86aebb60007d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:34.293346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d476f5-4349-45e9-a840-86aebb60007d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:34.293619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d476f5-4349-45e9-a840-86aebb60007d None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:34.294324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d476f5-4349-45e9-a840-86aebb60007d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:34.294630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d476f5-4349-45e9-a840-86aebb60007d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:34.296038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d476f5-4349-45e9-a840-86aebb60007d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:34.304487 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 397/822] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Mar 26 20:34:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:34.312636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d476f5-4349-45e9-a840-86aebb60007d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:34.381297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634de033-5b28-4381-96b0-2656a47fa965 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:34.428735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9828d-ab1a-49ca-af2e-6cef2fcc2d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:34.429552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9828d-ab1a-49ca-af2e-6cef2fcc2d47 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:34.429832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9828d-ab1a-49ca-af2e-6cef2fcc2d47 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:34.430107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9828d-ab1a-49ca-af2e-6cef2fcc2d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:34.437666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9828d-ab1a-49ca-af2e-6cef2fcc2d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:34.439080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9828d-ab1a-49ca-af2e-6cef2fcc2d47 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:34.468227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d476f5-4349-45e9-a840-86aebb60007d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:34.471767 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-60e9828d-ab1a-49ca-af2e-6cef2fcc2d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:34.473790 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 426/823] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:34.483163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9828d-ab1a-49ca-af2e-6cef2fcc2d47 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:34.543456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175c1a6-9372-49e5-b3b5-6ae7aee1c6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:34.544141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175c1a6-9372-49e5-b3b5-6ae7aee1c6ca None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:34.544423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175c1a6-9372-49e5-b3b5-6ae7aee1c6ca None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:34.544696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175c1a6-9372-49e5-b3b5-6ae7aee1c6ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:34.545433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175c1a6-9372-49e5-b3b5-6ae7aee1c6ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:34.546790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175c1a6-9372-49e5-b3b5-6ae7aee1c6ca None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:34.583560 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 398/824] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Mar 26 20:34:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:34.638687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9828d-ab1a-49ca-af2e-6cef2fcc2d47 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:34.687438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4badb7-2c33-45c0-ac53-08265293577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:34.688324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4badb7-2c33-45c0-ac53-08265293577f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:34.688553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4badb7-2c33-45c0-ac53-08265293577f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:34.688819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4badb7-2c33-45c0-ac53-08265293577f None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:34.689588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4badb7-2c33-45c0-ac53-08265293577f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:34.689890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4badb7-2c33-45c0-ac53-08265293577f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:34.691358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4badb7-2c33-45c0-ac53-08265293577f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:34.708379 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 427/825] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:34.712253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175c1a6-9372-49e5-b3b5-6ae7aee1c6ca None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:34.733168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37dc05-d03c-4429-a3a6-844339b78fe2 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:34.733505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37dc05-d03c-4429-a3a6-844339b78fe2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:34.733730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37dc05-d03c-4429-a3a6-844339b78fe2 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:34.736575 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 428/826] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:34.745007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06c045-7791-4a8b-9883-4ccb260109fa None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:34.745312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06c045-7791-4a8b-9883-4ccb260109fa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:34.745571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06c045-7791-4a8b-9883-4ccb260109fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:34.766781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6a06c045-7791-4a8b-9883-4ccb260109fa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:34.768412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6a06c045-7791-4a8b-9883-4ccb260109fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:34.852017 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 429/827] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:34.880800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06c045-7791-4a8b-9883-4ccb260109fa None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:34.903244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175c1a6-9372-49e5-b3b5-6ae7aee1c6ca None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:34.947324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994e2f8-76e1-4a33-8bd7-7abd17d34cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:34.948335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994e2f8-76e1-4a33-8bd7-7abd17d34cc6 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:34.948623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994e2f8-76e1-4a33-8bd7-7abd17d34cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:34.949216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994e2f8-76e1-4a33-8bd7-7abd17d34cc6 None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/08d764c8ff5f48a092bd69030c5e1b47/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:34.951500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994e2f8-76e1-4a33-8bd7-7abd17d34cc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=08d764c8ff5f48a092bd69030c5e1b47, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:34.953155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994e2f8-76e1-4a33-8bd7-7abd17d34cc6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:34.976016 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 399/828] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:34:34 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/08d764c8ff5f48a092bd69030c5e1b47/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:34:34.996244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06c045-7791-4a8b-9883-4ccb260109fa None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:35.053095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e6461-e3e7-4ee2-916b-b0dc8156836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:35.054233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6461-e3e7-4ee2-916b-b0dc8156836a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:35.054655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6461-e3e7-4ee2-916b-b0dc8156836a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:35.055070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e6461-e3e7-4ee2-916b-b0dc8156836a None admin] PATH_INFO: `/v3/services/network` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:35.056039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e6461-e3e7-4ee2-916b-b0dc8156836a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:35.057604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e6461-e3e7-4ee2-916b-b0dc8156836a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:35.070276 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-996e6461-e3e7-4ee2-916b-b0dc8156836a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 26 20:34:35.076071 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 430/829] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:34 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:35.078702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994e2f8-76e1-4a33-8bd7-7abd17d34cc6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:35.187676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994e2f8-76e1-4a33-8bd7-7abd17d34cc6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:35.230165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91077e-aa5f-4bdd-ad59-2a4c9cfdb2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:35.231069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91077e-aa5f-4bdd-ad59-2a4c9cfdb2fc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:35.231497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91077e-aa5f-4bdd-ad59-2a4c9cfdb2fc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:35.231933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91077e-aa5f-4bdd-ad59-2a4c9cfdb2fc None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:35.232834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91077e-aa5f-4bdd-ad59-2a4c9cfdb2fc None admin] RBAC: Adding query filter params (name=network) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:35.233301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91077e-aa5f-4bdd-ad59-2a4c9cfdb2fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:35.234839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91077e-aa5f-4bdd-ad59-2a4c9cfdb2fc None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:35.241849 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 400/830] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:35.246938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e6461-e3e7-4ee2-916b-b0dc8156836a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:35.356972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e6461-e3e7-4ee2-916b-b0dc8156836a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:35.393081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c371507-8f79-4206-9de7-4e251184cb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:35.393978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c371507-8f79-4206-9de7-4e251184cb66 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:35.394402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c371507-8f79-4206-9de7-4e251184cb66 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:35.394818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c371507-8f79-4206-9de7-4e251184cb66 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:35.395685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c371507-8f79-4206-9de7-4e251184cb66 None admin] RBAC: Adding query filter params (type=network) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:35.396183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c371507-8f79-4206-9de7-4e251184cb66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:35.397707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c371507-8f79-4206-9de7-4e251184cb66 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:35.407336 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 431/831] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:35.408853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91077e-aa5f-4bdd-ad59-2a4c9cfdb2fc None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:35.509687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91077e-aa5f-4bdd-ad59-2a4c9cfdb2fc None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:35.543379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f9e9b-6118-490f-8a34-c3d6208ef579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:35.544286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f9e9b-6118-490f-8a34-c3d6208ef579 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:35.544710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f9e9b-6118-490f-8a34-c3d6208ef579 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:35.545124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f9e9b-6118-490f-8a34-c3d6208ef579 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:35.546015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f9e9b-6118-490f-8a34-c3d6208ef579 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:35.547529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f9e9b-6118-490f-8a34-c3d6208ef579 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:35.572076 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 401/832] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Mar 26 20:34:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:35.774200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e169b5-59a6-49c4-87f5-96820c93d413 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:35.774711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e169b5-59a6-49c4-87f5-96820c93d413 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:35.774711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e169b5-59a6-49c4-87f5-96820c93d413 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:35.776783 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 432/833] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:35.783570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb3cad-0c81-4ee0-9a2a-39a4799acc61 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:35.783872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb3cad-0c81-4ee0-9a2a-39a4799acc61 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:35.784189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb3cad-0c81-4ee0-9a2a-39a4799acc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:35.802430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-09eb3cad-0c81-4ee0-9a2a-39a4799acc61 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:35.803625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-09eb3cad-0c81-4ee0-9a2a-39a4799acc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:35.878714 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 402/834] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:35.902954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e169b5-59a6-49c4-87f5-96820c93d413 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:36.008913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e169b5-59a6-49c4-87f5-96820c93d413 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:36.053411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc25a6d-846e-4093-bc34-6338b7ee29a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:36.054276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25a6d-846e-4093-bc34-6338b7ee29a2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:36.054569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25a6d-846e-4093-bc34-6338b7ee29a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:36.054852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc25a6d-846e-4093-bc34-6338b7ee29a2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:36.055510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc25a6d-846e-4093-bc34-6338b7ee29a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:36.056960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc25a6d-846e-4093-bc34-6338b7ee29a2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:36.069375 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-3dc25a6d-846e-4093-bc34-6338b7ee29a2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 26 20:34:36.075541 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 433/835] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Mar 26 20:34:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:36.076512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb3cad-0c81-4ee0-9a2a-39a4799acc61 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:36.190911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb3cad-0c81-4ee0-9a2a-39a4799acc61 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:36.230575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db959c-3b92-4e05-9cb6-be1c3ea46dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:36.231235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db959c-3b92-4e05-9cb6-be1c3ea46dea None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:36.231510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db959c-3b92-4e05-9cb6-be1c3ea46dea None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:36.231780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db959c-3b92-4e05-9cb6-be1c3ea46dea None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:36.232509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db959c-3b92-4e05-9cb6-be1c3ea46dea None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:36.232813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db959c-3b92-4e05-9cb6-be1c3ea46dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:36.234268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db959c-3b92-4e05-9cb6-be1c3ea46dea None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:36.239035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 403/836] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:36.244589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc25a6d-846e-4093-bc34-6338b7ee29a2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:36.354411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc25a6d-846e-4093-bc34-6338b7ee29a2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:36.392294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5eb80a-cf24-4447-8915-186a57bcbef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:36.392950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb80a-cf24-4447-8915-186a57bcbef5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:36.393229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb80a-cf24-4447-8915-186a57bcbef5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:36.393503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5eb80a-cf24-4447-8915-186a57bcbef5 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:36.394197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb80a-cf24-4447-8915-186a57bcbef5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:36.394568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb80a-cf24-4447-8915-186a57bcbef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:36.396542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5eb80a-cf24-4447-8915-186a57bcbef5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:36.401389 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 434/837] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:36 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:36.653117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a272e-9829-475b-9e50-97c4c9067117 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:36.653776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a272e-9829-475b-9e50-97c4c9067117 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:36.654405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a272e-9829-475b-9e50-97c4c9067117 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:36.656764 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 404/838] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:36.664188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598dd4e-0d8b-4780-a92c-031557a1c830 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:36.664837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598dd4e-0d8b-4780-a92c-031557a1c830 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:36.665313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598dd4e-0d8b-4780-a92c-031557a1c830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:36.683425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d598dd4e-0d8b-4780-a92c-031557a1c830 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:36.684992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d598dd4e-0d8b-4780-a92c-031557a1c830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:36.752463 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 435/839] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:36.777099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a272e-9829-475b-9e50-97c4c9067117 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:36.876793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a272e-9829-475b-9e50-97c4c9067117 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:36.909761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28155956-6972-4ef8-8e2c-9aa664f7abbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:36.911391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28155956-6972-4ef8-8e2c-9aa664f7abbc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:36.911876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28155956-6972-4ef8-8e2c-9aa664f7abbc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:36.912429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28155956-6972-4ef8-8e2c-9aa664f7abbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:36.925092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28155956-6972-4ef8-8e2c-9aa664f7abbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:36.932678 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-28155956-6972-4ef8-8e2c-9aa664f7abbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:34:36.934193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 405/840] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:34:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:36.939728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598dd4e-0d8b-4780-a92c-031557a1c830 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:37.043340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d598dd4e-0d8b-4780-a92c-031557a1c830 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:37.078447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4af3fe-c691-4028-937c-d829adb239d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:37.079128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af3fe-c691-4028-937c-d829adb239d4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.079407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af3fe-c691-4028-937c-d829adb239d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.079681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af3fe-c691-4028-937c-d829adb239d4 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.080557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4af3fe-c691-4028-937c-d829adb239d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:37.080859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4af3fe-c691-4028-937c-d829adb239d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:37.082283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4af3fe-c691-4028-937c-d829adb239d4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:37.092959 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 436/841] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:34:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:37.099280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28155956-6972-4ef8-8e2c-9aa664f7abbc None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:37.199109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28155956-6972-4ef8-8e2c-9aa664f7abbc None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:37.235493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baffa7-be53-4f78-88f7-82aa37c9e1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:37.236321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baffa7-be53-4f78-88f7-82aa37c9e1ea None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.236603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baffa7-be53-4f78-88f7-82aa37c9e1ea None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.236875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5baffa7-be53-4f78-88f7-82aa37c9e1ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.249291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baffa7-be53-4f78-88f7-82aa37c9e1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:37.250764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5baffa7-be53-4f78-88f7-82aa37c9e1ea None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:37.267587 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d5baffa7-be53-4f78-88f7-82aa37c9e1ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:37.270166 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 406/842] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:37.277278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4af3fe-c691-4028-937c-d829adb239d4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:37.378147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4af3fe-c691-4028-937c-d829adb239d4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:37.411480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a3df6-13fe-42f6-8af3-95e30e51878e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:37.412165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3df6-13fe-42f6-8af3-95e30e51878e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.412449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3df6-13fe-42f6-8af3-95e30e51878e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.412725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a3df6-13fe-42f6-8af3-95e30e51878e None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.413444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3df6-13fe-42f6-8af3-95e30e51878e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:37.413748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3df6-13fe-42f6-8af3-95e30e51878e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:37.415130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a3df6-13fe-42f6-8af3-95e30e51878e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:37.427472 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 437/843] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:37.433058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baffa7-be53-4f78-88f7-82aa37c9e1ea None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:37.467891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7f00-8a4c-420f-ab7d-4a14eda83837 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.468126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7f00-8a4c-420f-ab7d-4a14eda83837 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.468590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7f00-8a4c-420f-ab7d-4a14eda83837 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.470974 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 438/844] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:37.478262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0b9c6-25ef-4533-a18d-93c738b636af None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.478729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0b9c6-25ef-4533-a18d-93c738b636af None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.479143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0b9c6-25ef-4533-a18d-93c738b636af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.499733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-42b0b9c6-25ef-4533-a18d-93c738b636af None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:37.501689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-42b0b9c6-25ef-4533-a18d-93c738b636af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:37.543649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5baffa7-be53-4f78-88f7-82aa37c9e1ea None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:37.578056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70206-dbcc-47c0-8127-b5edaf1d88d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:37.579201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70206-dbcc-47c0-8127-b5edaf1d88d2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.579480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70206-dbcc-47c0-8127-b5edaf1d88d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.579911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f70206-dbcc-47c0-8127-b5edaf1d88d2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.588723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70206-dbcc-47c0-8127-b5edaf1d88d2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:37.590352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f70206-dbcc-47c0-8127-b5edaf1d88d2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:37.596081 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 439/845] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:37.608717 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-e0f70206-dbcc-47c0-8127-b5edaf1d88d2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 26 20:34:37.610449 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 407/846] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:34:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:37.616030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0b9c6-25ef-4533-a18d-93c738b636af None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:37.617002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70206-dbcc-47c0-8127-b5edaf1d88d2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:37.715869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0b9c6-25ef-4533-a18d-93c738b636af None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:37.721931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f70206-dbcc-47c0-8127-b5edaf1d88d2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:37.750860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16a0a-5f02-4071-aa35-fc6d6b578835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:37.751980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16a0a-5f02-4071-aa35-fc6d6b578835 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.752432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16a0a-5f02-4071-aa35-fc6d6b578835 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.752871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c16a0a-5f02-4071-aa35-fc6d6b578835 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.753705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c16a0a-5f02-4071-aa35-fc6d6b578835 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:37.755777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c16a0a-5f02-4071-aa35-fc6d6b578835 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:37.757617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeff3a0-64b7-4e28-9604-093bbfeafdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:37.758346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeff3a0-64b7-4e28-9604-093bbfeafdc0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.758686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeff3a0-64b7-4e28-9604-093bbfeafdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.759198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeff3a0-64b7-4e28-9604-093bbfeafdc0 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.760250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeff3a0-64b7-4e28-9604-093bbfeafdc0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:37.760767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeff3a0-64b7-4e28-9604-093bbfeafdc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:37.762405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeff3a0-64b7-4e28-9604-093bbfeafdc0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:37.767130 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-08c16a0a-5f02-4071-aa35-fc6d6b578835 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 26 20:34:37.773858 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 440/847] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:34:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:37.774853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16a0a-5f02-4071-aa35-fc6d6b578835 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:37.788612 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 408/848] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Mar 26 20:34:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:37.794246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeff3a0-64b7-4e28-9604-093bbfeafdc0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:37.890140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c16a0a-5f02-4071-aa35-fc6d6b578835 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:37.902128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeff3a0-64b7-4e28-9604-093bbfeafdc0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:37.924660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad687-0487-450a-983d-363261a88b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:37.925325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad687-0487-450a-983d-363261a88b8c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.925608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad687-0487-450a-983d-363261a88b8c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.925890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad687-0487-450a-983d-363261a88b8c None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.927085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad687-0487-450a-983d-363261a88b8c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:37.927389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad687-0487-450a-983d-363261a88b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:37.928792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad687-0487-450a-983d-363261a88b8c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:37.933307 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 441/849] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:34:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:37.934554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb3d2f-985f-495e-9e15-e490a9280d47 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.935079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb3d2f-985f-495e-9e15-e490a9280d47 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.935560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb3d2f-985f-495e-9e15-e490a9280d47 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:37.937945 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 442/850] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:37.938676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb3d2f-985f-495e-9e15-e490a9280d47 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:37.944728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c2f9a-4de6-4e3d-95b0-d2da3aed8fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:37.945385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c2f9a-4de6-4e3d-95b0-d2da3aed8fad None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:37.945668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c2f9a-4de6-4e3d-95b0-d2da3aed8fad None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:37.945942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c2f9a-4de6-4e3d-95b0-d2da3aed8fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.015707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c2f9a-4de6-4e3d-95b0-d2da3aed8fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:38.019840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c2f9a-4de6-4e3d-95b0-d2da3aed8fad None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:38.040692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb3d2f-985f-495e-9e15-e490a9280d47 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:38.073745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d137b0-1f78-47d1-9fca-9d2716ec0471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:38.074405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d137b0-1f78-47d1-9fca-9d2716ec0471 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.074690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d137b0-1f78-47d1-9fca-9d2716ec0471 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.074973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d137b0-1f78-47d1-9fca-9d2716ec0471 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.075665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d137b0-1f78-47d1-9fca-9d2716ec0471 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:38.076003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d137b0-1f78-47d1-9fca-9d2716ec0471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:38.077370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d137b0-1f78-47d1-9fca-9d2716ec0471 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:38.091949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 443/851] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:34:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:38.091949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8746-25d1-4325-b5de-960e8703f8b9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.091949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8746-25d1-4325-b5de-960e8703f8b9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.091949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd8746-25d1-4325-b5de-960e8703f8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.101892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-58fd8746-25d1-4325-b5de-960e8703f8b9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:38.103123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-58fd8746-25d1-4325-b5de-960e8703f8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:38.136443 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 409/852] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:34:38.141780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c2f9a-4de6-4e3d-95b0-d2da3aed8fad None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:38.208829 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 444/853] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:38.233735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd8746-25d1-4325-b5de-960e8703f8b9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:38.270822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c2f9a-4de6-4e3d-95b0-d2da3aed8fad None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:38.310589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fe636-a7fc-4b33-9278-df161705b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:38.311627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fe636-a7fc-4b33-9278-df161705b25a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.312110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fe636-a7fc-4b33-9278-df161705b25a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.312535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fe636-a7fc-4b33-9278-df161705b25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.322894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fe636-a7fc-4b33-9278-df161705b25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:38.324688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fe636-a7fc-4b33-9278-df161705b25a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:38.341968 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-923fe636-a7fc-4b33-9278-df161705b25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:38.343734 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 410/854] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:38.349389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fe636-a7fc-4b33-9278-df161705b25a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:38.351219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd8746-25d1-4325-b5de-960e8703f8b9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:38.393974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c205d86-ca89-4a6b-a52d-8e4f72fe0ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:38.394939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205d86-ca89-4a6b-a52d-8e4f72fe0ca5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.395290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205d86-ca89-4a6b-a52d-8e4f72fe0ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.395638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205d86-ca89-4a6b-a52d-8e4f72fe0ca5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.409283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c205d86-ca89-4a6b-a52d-8e4f72fe0ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:38.418952 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2c205d86-ca89-4a6b-a52d-8e4f72fe0ca5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:34:38.420822 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 445/855] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:38.426630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c205d86-ca89-4a6b-a52d-8e4f72fe0ca5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:38.460830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fe636-a7fc-4b33-9278-df161705b25a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:38.497721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8a1ad-b645-49c8-a05c-4d2a70fd752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:38.498846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8a1ad-b645-49c8-a05c-4d2a70fd752f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.499378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8a1ad-b645-49c8-a05c-4d2a70fd752f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.499856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8a1ad-b645-49c8-a05c-4d2a70fd752f None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.500818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8a1ad-b645-49c8-a05c-4d2a70fd752f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:38.501326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8a1ad-b645-49c8-a05c-4d2a70fd752f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:38.502930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8a1ad-b645-49c8-a05c-4d2a70fd752f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:38.515595 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 411/856] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:38.521891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8a1ad-b645-49c8-a05c-4d2a70fd752f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:38.566658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c205d86-ca89-4a6b-a52d-8e4f72fe0ca5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:38.601904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8f65e-6723-4409-9aae-746a490eadd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:38.602999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8f65e-6723-4409-9aae-746a490eadd6 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.603483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8f65e-6723-4409-9aae-746a490eadd6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.604025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8f65e-6723-4409-9aae-746a490eadd6 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.604964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8f65e-6723-4409-9aae-746a490eadd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:38.605473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8f65e-6723-4409-9aae-746a490eadd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:38.607111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8f65e-6723-4409-9aae-746a490eadd6 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:38.616669 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 446/857] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:38.622770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8f65e-6723-4409-9aae-746a490eadd6 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:38.651388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8a1ad-b645-49c8-a05c-4d2a70fd752f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:38.686238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745cba2-02d1-421f-a150-acd25ae75f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:38.687508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745cba2-02d1-421f-a150-acd25ae75f74 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.688021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745cba2-02d1-421f-a150-acd25ae75f74 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.688511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745cba2-02d1-421f-a150-acd25ae75f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.695543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745cba2-02d1-421f-a150-acd25ae75f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:38.697314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745cba2-02d1-421f-a150-acd25ae75f74 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:38.711505 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b745cba2-02d1-421f-a150-acd25ae75f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:38.713296 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 412/858] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:38.719805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745cba2-02d1-421f-a150-acd25ae75f74 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:38.725491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8f65e-6723-4409-9aae-746a490eadd6 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:38.765926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6eb4a-8f4b-489d-9f77-a436a8f7aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:38.766750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6eb4a-8f4b-489d-9f77-a436a8f7aeef None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.767035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6eb4a-8f4b-489d-9f77-a436a8f7aeef None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.767306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6eb4a-8f4b-489d-9f77-a436a8f7aeef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.783830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6eb4a-8f4b-489d-9f77-a436a8f7aeef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:38.786459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6eb4a-8f4b-489d-9f77-a436a8f7aeef None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:38.809078 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-72d6eb4a-8f4b-489d-9f77-a436a8f7aeef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:38.814921 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 447/859] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:38.816901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6eb4a-8f4b-489d-9f77-a436a8f7aeef None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:38.837822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745cba2-02d1-421f-a150-acd25ae75f74 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:38.874171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3ac3c-69a9-4484-9e3b-64f1f3565118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:38.874831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3ac3c-69a9-4484-9e3b-64f1f3565118 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.875110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3ac3c-69a9-4484-9e3b-64f1f3565118 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.875385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3ac3c-69a9-4484-9e3b-64f1f3565118 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.876360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3ac3c-69a9-4484-9e3b-64f1f3565118 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:38.876673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3ac3c-69a9-4484-9e3b-64f1f3565118 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:38.878377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3ac3c-69a9-4484-9e3b-64f1f3565118 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:38.891063 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 413/860] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:38.899065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3ac3c-69a9-4484-9e3b-64f1f3565118 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:38.924204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6eb4a-8f4b-489d-9f77-a436a8f7aeef None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:38.957688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bced7ae-7584-4458-ba22-f4b0318bdbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:38.958346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced7ae-7584-4458-ba22-f4b0318bdbe9 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.958629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced7ae-7584-4458-ba22-f4b0318bdbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.958903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bced7ae-7584-4458-ba22-f4b0318bdbe9 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.959607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced7ae-7584-4458-ba22-f4b0318bdbe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:38.959933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced7ae-7584-4458-ba22-f4b0318bdbe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:38.961301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bced7ae-7584-4458-ba22-f4b0318bdbe9 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:38.977402 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 448/861] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:38.977402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3a186-4126-460a-8590-295182f5b0d3 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:38.977402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3a186-4126-460a-8590-295182f5b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:38.977402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3a186-4126-460a-8590-295182f5b0d3 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:38.977402 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 449/862] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:38.983647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3a186-4126-460a-8590-295182f5b0d3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:39.002645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3ac3c-69a9-4484-9e3b-64f1f3565118 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:39.039576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700414-d809-47c2-a1c1-928e265a1e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:39.040196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700414-d809-47c2-a1c1-928e265a1e5f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:39.040479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700414-d809-47c2-a1c1-928e265a1e5f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:39.040754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700414-d809-47c2-a1c1-928e265a1e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:39.041563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700414-d809-47c2-a1c1-928e265a1e5f None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=0df218115be74b8692728293c326be08) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:39.041872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700414-d809-47c2-a1c1-928e265a1e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:39.043322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700414-d809-47c2-a1c1-928e265a1e5f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:39.056747 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 414/863] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/role_assignments?user.id=0df218115be74b8692728293c326be08&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:39.056747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbeac-d94a-4d2a-a910-4b3cfd6b5334 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:39.056747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbeac-d94a-4d2a-a910-4b3cfd6b5334 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:39.056747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbbeac-d94a-4d2a-a910-4b3cfd6b5334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:39.072194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-83cbbeac-d94a-4d2a-a910-4b3cfd6b5334 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:39.073468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-83cbbeac-d94a-4d2a-a910-4b3cfd6b5334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:39.107884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3a186-4126-460a-8590-295182f5b0d3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:39.152126 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 415/864] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:39.161728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2981597-4497-49f3-8820-a04e71925054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:39.162983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2981597-4497-49f3-8820-a04e71925054 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:39.163544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2981597-4497-49f3-8820-a04e71925054 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:39.164061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2981597-4497-49f3-8820-a04e71925054 None admin] PATH_INFO: `/v3/users/swift` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:39.172191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbbeac-d94a-4d2a-a910-4b3cfd6b5334 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:39.183977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2981597-4497-49f3-8820-a04e71925054 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:39.183977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2981597-4497-49f3-8820-a04e71925054 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:39.198614 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f2981597-4497-49f3-8820-a04e71925054 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 26 20:34:39.200188 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 450/865] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:34:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:39.209227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2981597-4497-49f3-8820-a04e71925054 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:39.297893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbbeac-d94a-4d2a-a910-4b3cfd6b5334 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:39.345432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b2a5-1d81-4670-a7b3-7433b7c14c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:39.346101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b2a5-1d81-4670-a7b3-7433b7c14c8b None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:39.346380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b2a5-1d81-4670-a7b3-7433b7c14c8b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:39.346651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b2a5-1d81-4670-a7b3-7433b7c14c8b None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:39.347239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2981597-4497-49f3-8820-a04e71925054 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:39.347361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210b2a5-1d81-4670-a7b3-7433b7c14c8b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:39.349331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210b2a5-1d81-4670-a7b3-7433b7c14c8b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:39.367853 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 416/866] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:34:39 2022] POST /identity/v3/services => generated 269 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:34:39.404984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db14db2-f5f6-48b5-a2ca-340886254f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:39.405685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db14db2-f5f6-48b5-a2ca-340886254f5e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:39.406080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db14db2-f5f6-48b5-a2ca-340886254f5e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:39.406361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db14db2-f5f6-48b5-a2ca-340886254f5e None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:39.407217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db14db2-f5f6-48b5-a2ca-340886254f5e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:39.407520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db14db2-f5f6-48b5-a2ca-340886254f5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:39.409062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db14db2-f5f6-48b5-a2ca-340886254f5e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:39.430742 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 451/867] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Mar 26 20:34:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:39.437182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b2a5-1d81-4670-a7b3-7433b7c14c8b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:39.549061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b2a5-1d81-4670-a7b3-7433b7c14c8b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:39.583343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f525-db4c-475c-b448-49fd6a646ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:39.584741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f525-db4c-475c-b448-49fd6a646ac8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:39.584741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f525-db4c-475c-b448-49fd6a646ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:39.584741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05f525-db4c-475c-b448-49fd6a646ac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:39.654367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05f525-db4c-475c-b448-49fd6a646ac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:39.655836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05f525-db4c-475c-b448-49fd6a646ac8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:39.760928 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 417/868] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:39 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:34:39.764547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db14db2-f5f6-48b5-a2ca-340886254f5e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:39.864278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db14db2-f5f6-48b5-a2ca-340886254f5e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:39.897415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4a801-cf46-4ac0-9ece-19034d4af9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:39.898194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4a801-cf46-4ac0-9ece-19034d4af9f5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:39.898470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4a801-cf46-4ac0-9ece-19034d4af9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:39.898739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4a801-cf46-4ac0-9ece-19034d4af9f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:39.908621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4a801-cf46-4ac0-9ece-19034d4af9f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:39.910059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4a801-cf46-4ac0-9ece-19034d4af9f5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:39.927834 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-cce4a801-cf46-4ac0-9ece-19034d4af9f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:39.929380 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 452/869] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:39.935000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f525-db4c-475c-b448-49fd6a646ac8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:40.037157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05f525-db4c-475c-b448-49fd6a646ac8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:40.072015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6f4b3-2f3a-41e5-9610-51cba9160935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:40.073018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6f4b3-2f3a-41e5-9610-51cba9160935 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:40.073517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6f4b3-2f3a-41e5-9610-51cba9160935 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:40.073984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6f4b3-2f3a-41e5-9610-51cba9160935 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:40.074960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6f4b3-2f3a-41e5-9610-51cba9160935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:40.075460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6f4b3-2f3a-41e5-9610-51cba9160935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:40.077149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6f4b3-2f3a-41e5-9610-51cba9160935 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:40.094767 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 418/870] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:40.096405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4a801-cf46-4ac0-9ece-19034d4af9f5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:40.204322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4a801-cf46-4ac0-9ece-19034d4af9f5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:40.239408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a7d78-a518-46b2-9d20-fc7bf7739dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:40.240628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a7d78-a518-46b2-9d20-fc7bf7739dc5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:40.241137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a7d78-a518-46b2-9d20-fc7bf7739dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:40.241639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a7d78-a518-46b2-9d20-fc7bf7739dc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:40.248576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a7d78-a518-46b2-9d20-fc7bf7739dc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:40.250212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a7d78-a518-46b2-9d20-fc7bf7739dc5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:40.264168 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2a2a7d78-a518-46b2-9d20-fc7bf7739dc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:40.270533 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 453/871] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:40.272246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6f4b3-2f3a-41e5-9610-51cba9160935 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:40.376265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6f4b3-2f3a-41e5-9610-51cba9160935 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:40.412131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81576d5-ada1-4fc7-aaf8-a192afca0b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:40.413137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81576d5-ada1-4fc7-aaf8-a192afca0b32 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:40.413651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81576d5-ada1-4fc7-aaf8-a192afca0b32 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:40.414119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81576d5-ada1-4fc7-aaf8-a192afca0b32 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:40.415090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81576d5-ada1-4fc7-aaf8-a192afca0b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:40.415596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81576d5-ada1-4fc7-aaf8-a192afca0b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:40.417547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81576d5-ada1-4fc7-aaf8-a192afca0b32 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:40.434951 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 419/872] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:40.437966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a7d78-a518-46b2-9d20-fc7bf7739dc5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:40.512849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ab4b6-3b26-42e9-ba2a-d4864d55d257 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:40.513539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ab4b6-3b26-42e9-ba2a-d4864d55d257 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:40.514014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ab4b6-3b26-42e9-ba2a-d4864d55d257 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:40.516486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 420/873] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:40.524594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffd8d0-99d2-4b27-8527-3a4e736f5a2f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:40.525148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffd8d0-99d2-4b27-8527-3a4e736f5a2f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:40.525615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ffd8d0-99d2-4b27-8527-3a4e736f5a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:40.543406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-44ffd8d0-99d2-4b27-8527-3a4e736f5a2f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:40.544515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a7d78-a518-46b2-9d20-fc7bf7739dc5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:40.545173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-44ffd8d0-99d2-4b27-8527-3a4e736f5a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:40.578055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1e756-d572-4584-89b5-bd6619989a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:40.578706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1e756-d572-4584-89b5-bd6619989a77 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:40.578987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1e756-d572-4584-89b5-bd6619989a77 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:40.579268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1e756-d572-4584-89b5-bd6619989a77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:40.580098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1e756-d572-4584-89b5-bd6619989a77 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=08d764c8ff5f48a092bd69030c5e1b47) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:40.580406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1e756-d572-4584-89b5-bd6619989a77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:40.581840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1e756-d572-4584-89b5-bd6619989a77 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:40.591972 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 454/874] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:40 2022] GET /identity/v3/role_assignments?user.id=08d764c8ff5f48a092bd69030c5e1b47&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:40.621441 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 421/875] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:40 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:40.645744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1e756-d572-4584-89b5-bd6619989a77 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:40.755477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1e756-d572-4584-89b5-bd6619989a77 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:40.791443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a700193-d4c1-4121-8fb5-45da04628955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:40.792064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700193-d4c1-4121-8fb5-45da04628955 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:40.792347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700193-d4c1-4121-8fb5-45da04628955 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:40.792624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a700193-d4c1-4121-8fb5-45da04628955 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:40.793353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a700193-d4c1-4121-8fb5-45da04628955 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:40.794719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a700193-d4c1-4121-8fb5-45da04628955 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:40.811723 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 455/876] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:34:40 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:41.645325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857adf-8b32-4762-b941-c589260e52cf None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:41.645883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857adf-8b32-4762-b941-c589260e52cf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:41.645883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857adf-8b32-4762-b941-c589260e52cf None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:41.647882 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 422/877] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:41.654257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db2866-a9bf-49a7-a928-574d9b4f799c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:41.654680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db2866-a9bf-49a7-a928-574d9b4f799c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:41.654857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db2866-a9bf-49a7-a928-574d9b4f799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:41.673038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-78db2866-a9bf-49a7-a928-574d9b4f799c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:41.674228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-78db2866-a9bf-49a7-a928-574d9b4f799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:41.746823 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 456/878] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:41.773013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63857adf-8b32-4762-b941-c589260e52cf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:41.864047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77415068-f6b5-4ed0-aeea-a0dd1dbba9b8 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:41.864485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77415068-f6b5-4ed0-aeea-a0dd1dbba9b8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:41.864905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77415068-f6b5-4ed0-aeea-a0dd1dbba9b8 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:41.867629 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 457/879] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:41.876591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a30a8-fdc2-4a80-820b-712b67325194 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:41.876904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a30a8-fdc2-4a80-820b-712b67325194 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:41.877146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a30a8-fdc2-4a80-820b-712b67325194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:41.884453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63857adf-8b32-4762-b941-c589260e52cf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:41.894006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-286a30a8-fdc2-4a80-820b-712b67325194 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:41.895775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-286a30a8-fdc2-4a80-820b-712b67325194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:41.927049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d82a8-7c8f-4f79-81e1-20eeb7dc300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:41.927807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d82a8-7c8f-4f79-81e1-20eeb7dc300f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:41.928118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d82a8-7c8f-4f79-81e1-20eeb7dc300f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:41.928396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d82a8-7c8f-4f79-81e1-20eeb7dc300f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:41.940801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d82a8-7c8f-4f79-81e1-20eeb7dc300f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:41.950119 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-f97d82a8-7c8f-4f79-81e1-20eeb7dc300f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 26 20:34:41.956064 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 423/880] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Mar 26 20:34:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:41.958397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d82a8-7c8f-4f79-81e1-20eeb7dc300f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:41.970090 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 458/881] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:41.994728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a30a8-fdc2-4a80-820b-712b67325194 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:42.080322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d82a8-7c8f-4f79-81e1-20eeb7dc300f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.114647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fbea-850d-4f9a-be31-2d57d00eb4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.115445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fbea-850d-4f9a-be31-2d57d00eb4bb None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.115798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fbea-850d-4f9a-be31-2d57d00eb4bb None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.116193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14fbea-850d-4f9a-be31-2d57d00eb4bb None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.116755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a30a8-fdc2-4a80-820b-712b67325194 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.117052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14fbea-850d-4f9a-be31-2d57d00eb4bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:42.117444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14fbea-850d-4f9a-be31-2d57d00eb4bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.118895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14fbea-850d-4f9a-be31-2d57d00eb4bb None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.135750 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 424/882] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Mar 26 20:34:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:42.136786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fbea-850d-4f9a-be31-2d57d00eb4bb None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:42.161651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d609e-d1c5-41e8-9b1e-a5533dea6a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.163257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d609e-d1c5-41e8-9b1e-a5533dea6a6e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.163680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d609e-d1c5-41e8-9b1e-a5533dea6a6e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.164118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d609e-d1c5-41e8-9b1e-a5533dea6a6e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.165065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d609e-d1c5-41e8-9b1e-a5533dea6a6e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.167157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d609e-d1c5-41e8-9b1e-a5533dea6a6e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.181684 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-ea4d609e-d1c5-41e8-9b1e-a5533dea6a6e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 26 20:34:42.183980 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 459/883] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Mar 26 20:34:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:42.189924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d609e-d1c5-41e8-9b1e-a5533dea6a6e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:42.252010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14fbea-850d-4f9a-be31-2d57d00eb4bb None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.287717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd72ad7-23be-4c5e-bc34-5027b8a7f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.288890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd72ad7-23be-4c5e-bc34-5027b8a7f093 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.289525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd72ad7-23be-4c5e-bc34-5027b8a7f093 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.290037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd72ad7-23be-4c5e-bc34-5027b8a7f093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.297384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d609e-d1c5-41e8-9b1e-a5533dea6a6e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.304950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd72ad7-23be-4c5e-bc34-5027b8a7f093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.306474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd72ad7-23be-4c5e-bc34-5027b8a7f093 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.323398 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-1cd72ad7-23be-4c5e-bc34-5027b8a7f093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:42.329208 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 425/884] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:42.330162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd72ad7-23be-4c5e-bc34-5027b8a7f093 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:42.333992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86541-fc85-456e-9219-c57b362f1b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.335691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86541-fc85-456e-9219-c57b362f1b05 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.336237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86541-fc85-456e-9219-c57b362f1b05 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.336718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86541-fc85-456e-9219-c57b362f1b05 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.337627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86541-fc85-456e-9219-c57b362f1b05 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:42.338136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86541-fc85-456e-9219-c57b362f1b05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.340159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e86541-fc85-456e-9219-c57b362f1b05 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.351787 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 460/885] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:42.352861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86541-fc85-456e-9219-c57b362f1b05 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:42.438806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd72ad7-23be-4c5e-bc34-5027b8a7f093 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.454283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e86541-fc85-456e-9219-c57b362f1b05 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.475302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69117ee-54a5-4566-860e-9aed2301c2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.476376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69117ee-54a5-4566-860e-9aed2301c2db None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.476868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69117ee-54a5-4566-860e-9aed2301c2db None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.477399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69117ee-54a5-4566-860e-9aed2301c2db None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.478334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69117ee-54a5-4566-860e-9aed2301c2db None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:42.479071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69117ee-54a5-4566-860e-9aed2301c2db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.480773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69117ee-54a5-4566-860e-9aed2301c2db None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.495808 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 426/886] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:42.501118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948bcfd-4d5f-4b97-aa9a-06c0e7c20fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.501491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69117ee-54a5-4566-860e-9aed2301c2db None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:42.502290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948bcfd-4d5f-4b97-aa9a-06c0e7c20fe2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.502796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948bcfd-4d5f-4b97-aa9a-06c0e7c20fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.503287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948bcfd-4d5f-4b97-aa9a-06c0e7c20fe2 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.504521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948bcfd-4d5f-4b97-aa9a-06c0e7c20fe2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:42.505940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948bcfd-4d5f-4b97-aa9a-06c0e7c20fe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.507572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948bcfd-4d5f-4b97-aa9a-06c0e7c20fe2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.518871 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 461/887] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:42.520980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948bcfd-4d5f-4b97-aa9a-06c0e7c20fe2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:42.630748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948bcfd-4d5f-4b97-aa9a-06c0e7c20fe2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.631519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69117ee-54a5-4566-860e-9aed2301c2db None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.665153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0950c-7001-438c-b78e-1da545f8dc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.665826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0950c-7001-438c-b78e-1da545f8dc4a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.666142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0950c-7001-438c-b78e-1da545f8dc4a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.666421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e0950c-7001-438c-b78e-1da545f8dc4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.667397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0950c-7001-438c-b78e-1da545f8dc4a None admin] RBAC: Adding query filter params (interface=public, service_id=549b1d1e6ee544df8fee366da06edc2b, region_id=RegionOne) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:42.667707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0950c-7001-438c-b78e-1da545f8dc4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.669064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094acdc3-d717-426e-82a8-ee7dbc23a785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.669462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e0950c-7001-438c-b78e-1da545f8dc4a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.670473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094acdc3-d717-426e-82a8-ee7dbc23a785 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.670955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094acdc3-d717-426e-82a8-ee7dbc23a785 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.671446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094acdc3-d717-426e-82a8-ee7dbc23a785 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.679551 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 462/888] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Mar 26 20:34:42 2022] GET /identity/v3/endpoints?service_id=549b1d1e6ee544df8fee366da06edc2b&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:42.680267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094acdc3-d717-426e-82a8-ee7dbc23a785 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.680585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0950c-7001-438c-b78e-1da545f8dc4a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:42.682170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094acdc3-d717-426e-82a8-ee7dbc23a785 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.698415 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-094acdc3-d717-426e-82a8-ee7dbc23a785 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 26 20:34:42.700066 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 427/889] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:34:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:42.706826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094acdc3-d717-426e-82a8-ee7dbc23a785 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:42.806604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e0950c-7001-438c-b78e-1da545f8dc4a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.828664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094acdc3-d717-426e-82a8-ee7dbc23a785 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:42.845864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6aa5-2b33-4b5a-8f9b-0cbe510e39a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.846546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6aa5-2b33-4b5a-8f9b-0cbe510e39a4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.846823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6aa5-2b33-4b5a-8f9b-0cbe510e39a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.847104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec6aa5-2b33-4b5a-8f9b-0cbe510e39a4 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.848567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6aa5-2b33-4b5a-8f9b-0cbe510e39a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.850964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec6aa5-2b33-4b5a-8f9b-0cbe510e39a4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.859299 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 463/890] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Mar 26 20:34:42 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:34:42.886767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565554f4-7098-463d-a6d0-67624dbce266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:42.887877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565554f4-7098-463d-a6d0-67624dbce266 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:42.888384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565554f4-7098-463d-a6d0-67624dbce266 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:42.888895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565554f4-7098-463d-a6d0-67624dbce266 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:42.889989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565554f4-7098-463d-a6d0-67624dbce266 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:42.890551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565554f4-7098-463d-a6d0-67624dbce266 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:42.892432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565554f4-7098-463d-a6d0-67624dbce266 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:42.913295 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 428/891] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Mar 26 20:34:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:42.919332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6aa5-2b33-4b5a-8f9b-0cbe510e39a4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.030153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec6aa5-2b33-4b5a-8f9b-0cbe510e39a4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:43.066698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648d4f4-da28-44a7-8869-6548db254826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:43.067348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648d4f4-da28-44a7-8869-6548db254826 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.067626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648d4f4-da28-44a7-8869-6548db254826 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.067900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648d4f4-da28-44a7-8869-6548db254826 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.092752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee5707-1b8d-402e-a967-cf49e48968a5 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.093050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee5707-1b8d-402e-a967-cf49e48968a5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.093321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee5707-1b8d-402e-a967-cf49e48968a5 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.095609 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 429/892] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:43.103331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba28d55-7512-4def-91bd-686c6d48dfc8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.103623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba28d55-7512-4def-91bd-686c6d48dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.103901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba28d55-7512-4def-91bd-686c6d48dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.123698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cba28d55-7512-4def-91bd-686c6d48dfc8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:43.125118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cba28d55-7512-4def-91bd-686c6d48dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:43.137064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648d4f4-da28-44a7-8869-6548db254826 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:43.138525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648d4f4-da28-44a7-8869-6548db254826 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:43.205437 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 430/893] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:43.230062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba28d55-7512-4def-91bd-686c6d48dfc8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.245641 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 464/894] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:42 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:34:43.250722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648d4f4-da28-44a7-8869-6548db254826 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.338573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba28d55-7512-4def-91bd-686c6d48dfc8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:43.357511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648d4f4-da28-44a7-8869-6548db254826 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:43.372489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed8ece5-7704-4c80-8e6f-f363a577b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:43.373283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8ece5-7704-4c80-8e6f-f363a577b30f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.373571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8ece5-7704-4c80-8e6f-f363a577b30f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.373850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed8ece5-7704-4c80-8e6f-f363a577b30f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.374490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8ece5-7704-4c80-8e6f-f363a577b30f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:43.375880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed8ece5-7704-4c80-8e6f-f363a577b30f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:43.387695 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-fed8ece5-7704-4c80-8e6f-f363a577b30f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 26 20:34:43.393840 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 431/895] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:43.393840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ec5e-1da9-4ca3-b4c0-2ebd38380772 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.393840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ec5e-1da9-4ca3-b4c0-2ebd38380772 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.393840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ec5e-1da9-4ca3-b4c0-2ebd38380772 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.393840 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 432/896] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:43.395604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d8a4d-9836-42e9-95b7-07344cbf6934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:43.396425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8a4d-9836-42e9-95b7-07344cbf6934 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.396706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8a4d-9836-42e9-95b7-07344cbf6934 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.396975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d8a4d-9836-42e9-95b7-07344cbf6934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.398957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ec5e-1da9-4ca3-b4c0-2ebd38380772 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.407140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8a4d-9836-42e9-95b7-07344cbf6934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:43.408617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d8a4d-9836-42e9-95b7-07344cbf6934 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:43.425604 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2a7d8a4d-9836-42e9-95b7-07344cbf6934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:43.426908 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 465/897] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:43.427991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b6fb-6f2c-4575-8d1f-a592e3f3ab75 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.428280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b6fb-6f2c-4575-8d1f-a592e3f3ab75 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.428557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53b6fb-6f2c-4575-8d1f-a592e3f3ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.444486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ca53b6fb-6f2c-4575-8d1f-a592e3f3ab75 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:43.445675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ca53b6fb-6f2c-4575-8d1f-a592e3f3ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:43.519946 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 466/898] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:43.519946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53b6fb-6f2c-4575-8d1f-a592e3f3ab75 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.535817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ec5e-1da9-4ca3-b4c0-2ebd38380772 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:43.575424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175097b3-4c84-4921-bccb-6c2a229570d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:43.576102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175097b3-4c84-4921-bccb-6c2a229570d4 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.576383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175097b3-4c84-4921-bccb-6c2a229570d4 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.576657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175097b3-4c84-4921-bccb-6c2a229570d4 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.577348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175097b3-4c84-4921-bccb-6c2a229570d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:43.577650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175097b3-4c84-4921-bccb-6c2a229570d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:43.579014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175097b3-4c84-4921-bccb-6c2a229570d4 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:43.583969 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 433/899] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:43.584740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175097b3-4c84-4921-bccb-6c2a229570d4 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.614001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53b6fb-6f2c-4575-8d1f-a592e3f3ab75 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:43.646152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56250f1d-fc2d-4bca-b6b8-935e2d509bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:43.646807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56250f1d-fc2d-4bca-b6b8-935e2d509bc1 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.647084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56250f1d-fc2d-4bca-b6b8-935e2d509bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.647356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56250f1d-fc2d-4bca-b6b8-935e2d509bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.648095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56250f1d-fc2d-4bca-b6b8-935e2d509bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:43.648400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56250f1d-fc2d-4bca-b6b8-935e2d509bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:43.649810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56250f1d-fc2d-4bca-b6b8-935e2d509bc1 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:43.665662 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 467/900] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:43.665662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56250f1d-fc2d-4bca-b6b8-935e2d509bc1 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.684488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175097b3-4c84-4921-bccb-6c2a229570d4 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:43.716563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef178fb-f521-49ba-af35-5da8315a2ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:43.717346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef178fb-f521-49ba-af35-5da8315a2ba9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.717626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef178fb-f521-49ba-af35-5da8315a2ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.717899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef178fb-f521-49ba-af35-5da8315a2ba9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.718528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef178fb-f521-49ba-af35-5da8315a2ba9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:43.720171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef178fb-f521-49ba-af35-5da8315a2ba9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:43.731279 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-fef178fb-f521-49ba-af35-5da8315a2ba9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 26 20:34:43.732609 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 434/901] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:43.737972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef178fb-f521-49ba-af35-5da8315a2ba9 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.763861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56250f1d-fc2d-4bca-b6b8-935e2d509bc1 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:43.797367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908852-f261-4709-92d3-7f5e2c74f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:43.798019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908852-f261-4709-92d3-7f5e2c74f482 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.798298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908852-f261-4709-92d3-7f5e2c74f482 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.798567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908852-f261-4709-92d3-7f5e2c74f482 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.799256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908852-f261-4709-92d3-7f5e2c74f482 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:43.799552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908852-f261-4709-92d3-7f5e2c74f482 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:43.801610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908852-f261-4709-92d3-7f5e2c74f482 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:43.816303 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 468/902] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:43.816303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908852-f261-4709-92d3-7f5e2c74f482 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.839074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef178fb-f521-49ba-af35-5da8315a2ba9 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:43.877059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bf973-e868-4735-8461-436679fe691a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:43.878057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bf973-e868-4735-8461-436679fe691a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.878547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bf973-e868-4735-8461-436679fe691a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.879055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bf973-e868-4735-8461-436679fe691a None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.887196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bf973-e868-4735-8461-436679fe691a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:43.889329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bf973-e868-4735-8461-436679fe691a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:43.904236 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-5e2bf973-e868-4735-8461-436679fe691a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:43.905807 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 435/903] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:43.911901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bf973-e868-4735-8461-436679fe691a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:43.924159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908852-f261-4709-92d3-7f5e2c74f482 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:43.961055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de365eb2-d1d6-48f2-a349-2ed7849a3bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:43.962107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de365eb2-d1d6-48f2-a349-2ed7849a3bf7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:43.962628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de365eb2-d1d6-48f2-a349-2ed7849a3bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:43.963130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de365eb2-d1d6-48f2-a349-2ed7849a3bf7 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:43.964098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de365eb2-d1d6-48f2-a349-2ed7849a3bf7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:43.964627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de365eb2-d1d6-48f2-a349-2ed7849a3bf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:43.966256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de365eb2-d1d6-48f2-a349-2ed7849a3bf7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:43.972596 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 469/904] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:43.981908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de365eb2-d1d6-48f2-a349-2ed7849a3bf7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:44.036775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bf973-e868-4735-8461-436679fe691a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:44.071221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a3192-a6b6-4c2b-80da-8e92cb5ef609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:44.071886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a3192-a6b6-4c2b-80da-8e92cb5ef609 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:44.072205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a3192-a6b6-4c2b-80da-8e92cb5ef609 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:44.072481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a3192-a6b6-4c2b-80da-8e92cb5ef609 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:44.073256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a3192-a6b6-4c2b-80da-8e92cb5ef609 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:44.073567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a3192-a6b6-4c2b-80da-8e92cb5ef609 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:44.075012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a3192-a6b6-4c2b-80da-8e92cb5ef609 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:44.087020 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 436/905] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:44.092777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a3192-a6b6-4c2b-80da-8e92cb5ef609 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:44.110746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de365eb2-d1d6-48f2-a349-2ed7849a3bf7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:44.155775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74511d46-e8b6-4def-a0cc-b79c07be5397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:44.157330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74511d46-e8b6-4def-a0cc-b79c07be5397 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:44.157759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74511d46-e8b6-4def-a0cc-b79c07be5397 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:44.158174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74511d46-e8b6-4def-a0cc-b79c07be5397 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:44.159020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74511d46-e8b6-4def-a0cc-b79c07be5397 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:44.159474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74511d46-e8b6-4def-a0cc-b79c07be5397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:44.161725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74511d46-e8b6-4def-a0cc-b79c07be5397 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:44.173062 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 470/906] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:34:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:44.173643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74511d46-e8b6-4def-a0cc-b79c07be5397 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:44.202261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a3192-a6b6-4c2b-80da-8e92cb5ef609 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:44.236071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506b58f-4126-47a9-bc82-d20e579f24ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:44.236725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506b58f-4126-47a9-bc82-d20e579f24ca None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:44.237008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506b58f-4126-47a9-bc82-d20e579f24ca None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:44.237482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506b58f-4126-47a9-bc82-d20e579f24ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:44.238095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506b58f-4126-47a9-bc82-d20e579f24ca None admin] RBAC: Adding query filter params (role.id=f5afc4377efb41fa95dbb0a452a07110, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=0df218115be74b8692728293c326be08) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:44.238941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506b58f-4126-47a9-bc82-d20e579f24ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:44.240417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506b58f-4126-47a9-bc82-d20e579f24ca None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:44.250976 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 437/907] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:44 2022] GET /identity/v3/role_assignments?user.id=0df218115be74b8692728293c326be08&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=f5afc4377efb41fa95dbb0a452a07110 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:44.293426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74511d46-e8b6-4def-a0cc-b79c07be5397 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:44.330331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489f483-f666-4652-b1d5-f78994a213a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:44.331361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489f483-f666-4652-b1d5-f78994a213a1 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:44.331859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489f483-f666-4652-b1d5-f78994a213a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:44.332992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489f483-f666-4652-b1d5-f78994a213a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:44.333987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489f483-f666-4652-b1d5-f78994a213a1 None admin] RBAC: Adding query filter params (interface=public, service_id=d4c8ef4dcb7b4d6fbe1355deab9e6355, region_id=RegionOne) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:44.334500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489f483-f666-4652-b1d5-f78994a213a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:44.336121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489f483-f666-4652-b1d5-f78994a213a1 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:44.342515 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 471/908] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Mar 26 20:34:44 2022] GET /identity/v3/endpoints?service_id=d4c8ef4dcb7b4d6fbe1355deab9e6355&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:44.348724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506b58f-4126-47a9-bc82-d20e579f24ca None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:44.459756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506b58f-4126-47a9-bc82-d20e579f24ca None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:44.493762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6441-e597-432c-9006-7897ffad74ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:44.494475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6441-e597-432c-9006-7897ffad74ff None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:44.494756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6441-e597-432c-9006-7897ffad74ff None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:44.495078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6441-e597-432c-9006-7897ffad74ff None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:44.495801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f6441-e597-432c-9006-7897ffad74ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:44.497299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f6441-e597-432c-9006-7897ffad74ff None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:44.503316 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 438/909] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Mar 26 20:34:44 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:34:45.382609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd1447-647d-4230-8462-3873aa8fe250 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:45.383076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd1447-647d-4230-8462-3873aa8fe250 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:45.383165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd1447-647d-4230-8462-3873aa8fe250 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:45.385159 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 472/910] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:45.393600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761615cb-7253-4882-8fd6-ea61ec76ea30 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:45.393600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761615cb-7253-4882-8fd6-ea61ec76ea30 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:45.393600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761615cb-7253-4882-8fd6-ea61ec76ea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:45.412441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-761615cb-7253-4882-8fd6-ea61ec76ea30 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:45.414659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-761615cb-7253-4882-8fd6-ea61ec76ea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:45.494730 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 439/911] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:45 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:45.518112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd1447-647d-4230-8462-3873aa8fe250 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:45.621932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd1447-647d-4230-8462-3873aa8fe250 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:45.657213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8a887-e44a-4450-b4fa-87f2f6f22551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:45.658359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8a887-e44a-4450-b4fa-87f2f6f22551 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:45.658866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8a887-e44a-4450-b4fa-87f2f6f22551 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:45.659351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8a887-e44a-4450-b4fa-87f2f6f22551 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:45.660855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8a887-e44a-4450-b4fa-87f2f6f22551 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:45.662448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8a887-e44a-4450-b4fa-87f2f6f22551 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:45.674271 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-eac8a887-e44a-4450-b4fa-87f2f6f22551 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 26 20:34:45.680016 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 473/912] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Mar 26 20:34:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:45.682271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761615cb-7253-4882-8fd6-ea61ec76ea30 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:45.785702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761615cb-7253-4882-8fd6-ea61ec76ea30 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:45.822651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67583774-4de9-4bdf-a7f5-2c8715b2f90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:45.823365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67583774-4de9-4bdf-a7f5-2c8715b2f90a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:45.823647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67583774-4de9-4bdf-a7f5-2c8715b2f90a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:45.823998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67583774-4de9-4bdf-a7f5-2c8715b2f90a None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:45.824702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67583774-4de9-4bdf-a7f5-2c8715b2f90a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:45.825008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67583774-4de9-4bdf-a7f5-2c8715b2f90a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:45.826401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67583774-4de9-4bdf-a7f5-2c8715b2f90a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:45.831399 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 440/913] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:45.837032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8a887-e44a-4450-b4fa-87f2f6f22551 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:45.940904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8a887-e44a-4450-b4fa-87f2f6f22551 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:45.976557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c209612-b7e9-43f5-a039-e36e74b6b903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:45.977563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c209612-b7e9-43f5-a039-e36e74b6b903 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:45.978095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c209612-b7e9-43f5-a039-e36e74b6b903 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:45.978580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c209612-b7e9-43f5-a039-e36e74b6b903 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:45.979478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c209612-b7e9-43f5-a039-e36e74b6b903 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:45.980009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c209612-b7e9-43f5-a039-e36e74b6b903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:45.981608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c209612-b7e9-43f5-a039-e36e74b6b903 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:45.986809 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 474/914] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:45.993473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67583774-4de9-4bdf-a7f5-2c8715b2f90a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:46.096888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67583774-4de9-4bdf-a7f5-2c8715b2f90a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:46.130226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c971e-d9fe-43e8-afb5-1062c4dc63a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:46.130879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c971e-d9fe-43e8-afb5-1062c4dc63a5 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:46.131165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c971e-d9fe-43e8-afb5-1062c4dc63a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:46.131442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c971e-d9fe-43e8-afb5-1062c4dc63a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:46.132205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c971e-d9fe-43e8-afb5-1062c4dc63a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:46.133588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c971e-d9fe-43e8-afb5-1062c4dc63a5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:46.160180 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 441/915] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Mar 26 20:34:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:46.328944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb005bca-ddcd-4f57-bb1e-3023bd40ff73 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:46.329281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb005bca-ddcd-4f57-bb1e-3023bd40ff73 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:46.329457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb005bca-ddcd-4f57-bb1e-3023bd40ff73 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:46.331361 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 475/916] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:46.339699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b8ac-93e5-421b-bd73-199e6942d59c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:46.340035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b8ac-93e5-421b-bd73-199e6942d59c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:46.340314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3b8ac-93e5-421b-bd73-199e6942d59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:46.357448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c1a3b8ac-93e5-421b-bd73-199e6942d59c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:46.358639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c1a3b8ac-93e5-421b-bd73-199e6942d59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:46.435379 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 442/917] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:46.459900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb005bca-ddcd-4f57-bb1e-3023bd40ff73 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:46.565967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb005bca-ddcd-4f57-bb1e-3023bd40ff73 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:46.601902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1b088-51e1-4b0c-8b58-faa6d5cca17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:46.602787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b088-51e1-4b0c-8b58-faa6d5cca17f None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:46.603243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b088-51e1-4b0c-8b58-faa6d5cca17f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:46.603666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b088-51e1-4b0c-8b58-faa6d5cca17f None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:46.604574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1b088-51e1-4b0c-8b58-faa6d5cca17f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:46.606095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1b088-51e1-4b0c-8b58-faa6d5cca17f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:46.624078 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 476/918] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:34:46 2022] POST /identity/v3/services => generated 241 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:46.826038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7095c-f53b-40e9-9989-3b1d801a378b None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:46.826400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7095c-f53b-40e9-9989-3b1d801a378b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:46.826607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7095c-f53b-40e9-9989-3b1d801a378b None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:46.828536 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 443/919] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:46.835092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c77b1-8e06-4b38-922d-372119905a0c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:46.835612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c77b1-8e06-4b38-922d-372119905a0c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:46.836152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c77b1-8e06-4b38-922d-372119905a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:46.853760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a22c77b1-8e06-4b38-922d-372119905a0c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:46.855261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a22c77b1-8e06-4b38-922d-372119905a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:46.927477 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 477/920] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:46.951368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7095c-f53b-40e9-9989-3b1d801a378b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.054013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7095c-f53b-40e9-9989-3b1d801a378b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:47.070179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e27a7b-3ead-4ecf-83bc-fd8a3ec9b0dc None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.070698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e27a7b-3ead-4ecf-83bc-fd8a3ec9b0dc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.071198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e27a7b-3ead-4ecf-83bc-fd8a3ec9b0dc None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.073375 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 478/921] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:47.080062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b7fd6-bb0e-4154-a871-ca94c7431ea2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.080422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b7fd6-bb0e-4154-a871-ca94c7431ea2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.080943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b7fd6-bb0e-4154-a871-ca94c7431ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.088353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100dfdd-55ee-4624-9066-ac836152f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:47.089161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100dfdd-55ee-4624-9066-ac836152f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.089440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100dfdd-55ee-4624-9066-ac836152f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.089710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100dfdd-55ee-4624-9066-ac836152f6f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.099955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-af6b7fd6-bb0e-4154-a871-ca94c7431ea2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:47.100361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100dfdd-55ee-4624-9066-ac836152f6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:47.101812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af6b7fd6-bb0e-4154-a871-ca94c7431ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:47.107573 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-e100dfdd-55ee-4624-9066-ac836152f6f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 26 20:34:47.109162 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 444/922] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Mar 26 20:34:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:47.115311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100dfdd-55ee-4624-9066-ac836152f6f0 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.181274 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 479/923] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:47.207970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b7fd6-bb0e-4154-a871-ca94c7431ea2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.239603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100dfdd-55ee-4624-9066-ac836152f6f0 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:47.287036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e3fc7-f558-45b4-af3e-1aa3085243c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:47.288571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e3fc7-f558-45b4-af3e-1aa3085243c9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.289064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e3fc7-f558-45b4-af3e-1aa3085243c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.289778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e3fc7-f558-45b4-af3e-1aa3085243c9 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.290855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e3fc7-f558-45b4-af3e-1aa3085243c9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:47.291339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e3fc7-f558-45b4-af3e-1aa3085243c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:47.293215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e3fc7-f558-45b4-af3e-1aa3085243c9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:47.304949 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 445/924] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Mar 26 20:34:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:47.309298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b7fd6-bb0e-4154-a871-ca94c7431ea2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:47.311090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e3fc7-f558-45b4-af3e-1aa3085243c9 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.353663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182c180-ce37-4895-aa6c-783f03dde88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:47.354468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182c180-ce37-4895-aa6c-783f03dde88c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.354750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182c180-ce37-4895-aa6c-783f03dde88c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.355024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182c180-ce37-4895-aa6c-783f03dde88c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.355698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182c180-ce37-4895-aa6c-783f03dde88c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:47.357802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182c180-ce37-4895-aa6c-783f03dde88c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:47.371743 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-5182c180-ce37-4895-aa6c-783f03dde88c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 26 20:34:47.379602 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 480/925] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:34:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:47.381062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182c180-ce37-4895-aa6c-783f03dde88c None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.441904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e3fc7-f558-45b4-af3e-1aa3085243c9 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:47.480531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9da0-0918-4c15-af7e-b529ac830642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:47.481719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9da0-0918-4c15-af7e-b529ac830642 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.482210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9da0-0918-4c15-af7e-b529ac830642 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.482705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b9da0-0918-4c15-af7e-b529ac830642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.492643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182c180-ce37-4895-aa6c-783f03dde88c None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:47.495670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b9da0-0918-4c15-af7e-b529ac830642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:47.497561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b9da0-0918-4c15-af7e-b529ac830642 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:47.515535 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-473b9da0-0918-4c15-af7e-b529ac830642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:47.522110 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 446/926] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:47.523317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9da0-0918-4c15-af7e-b529ac830642 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.531301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327be46-38ba-42fd-bfc3-b54c734ec654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:47.531989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327be46-38ba-42fd-bfc3-b54c734ec654 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.532279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327be46-38ba-42fd-bfc3-b54c734ec654 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.532560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327be46-38ba-42fd-bfc3-b54c734ec654 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.533276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327be46-38ba-42fd-bfc3-b54c734ec654 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:47.533585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327be46-38ba-42fd-bfc3-b54c734ec654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:47.535995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327be46-38ba-42fd-bfc3-b54c734ec654 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:47.547084 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 481/927] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:34:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:47.548078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327be46-38ba-42fd-bfc3-b54c734ec654 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.661819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b9da0-0918-4c15-af7e-b529ac830642 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:47.673388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327be46-38ba-42fd-bfc3-b54c734ec654 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:47.704612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba174188-a1ce-42c7-ba40-32278838959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:47.705269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174188-a1ce-42c7-ba40-32278838959b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.705554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174188-a1ce-42c7-ba40-32278838959b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.705832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba174188-a1ce-42c7-ba40-32278838959b None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.706548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba174188-a1ce-42c7-ba40-32278838959b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:47.707745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba174188-a1ce-42c7-ba40-32278838959b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:47.708924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fa709-30e3-47f2-9276-1186b01ef0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:47.709160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba174188-a1ce-42c7-ba40-32278838959b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:47.709989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fa709-30e3-47f2-9276-1186b01ef0c7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.710459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fa709-30e3-47f2-9276-1186b01ef0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.710931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fa709-30e3-47f2-9276-1186b01ef0c7 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.711806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fa709-30e3-47f2-9276-1186b01ef0c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:47.712339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fa709-30e3-47f2-9276-1186b01ef0c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:47.713941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fa709-30e3-47f2-9276-1186b01ef0c7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:47.719653 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 482/928] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Mar 26 20:34:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:47.725384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fa709-30e3-47f2-9276-1186b01ef0c7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.732102 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 447/929] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:47.733955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba174188-a1ce-42c7-ba40-32278838959b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.841855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba174188-a1ce-42c7-ba40-32278838959b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:47.849107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fa709-30e3-47f2-9276-1186b01ef0c7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:47.876005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4b7bc-90a3-4e41-91a2-b1a5da3b9e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:47.877126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4b7bc-90a3-4e41-91a2-b1a5da3b9e32 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.877584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4b7bc-90a3-4e41-91a2-b1a5da3b9e32 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.878032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4b7bc-90a3-4e41-91a2-b1a5da3b9e32 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.887275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4b7bc-90a3-4e41-91a2-b1a5da3b9e32 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:47.889159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4b7bc-90a3-4e41-91a2-b1a5da3b9e32 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:47.893350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f1d2f-ef37-464e-976c-6e4c03dcdc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:47.894206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f1d2f-ef37-464e-976c-6e4c03dcdc2f None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:47.894590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f1d2f-ef37-464e-976c-6e4c03dcdc2f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:47.894941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f1d2f-ef37-464e-976c-6e4c03dcdc2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:47.895781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f1d2f-ef37-464e-976c-6e4c03dcdc2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:47.897389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f1d2f-ef37-464e-976c-6e4c03dcdc2f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:47.906228 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-93c4b7bc-90a3-4e41-91a2-b1a5da3b9e32 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 26 20:34:47.912317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 448/930] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:34:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:47.914264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4b7bc-90a3-4e41-91a2-b1a5da3b9e32 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:47.930510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 483/931] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Mar 26 20:34:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:34:48.034559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4b7bc-90a3-4e41-91a2-b1a5da3b9e32 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:48.079401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b9932-7c83-405c-b105-c435dc1ce668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:48.080111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b9932-7c83-405c-b105-c435dc1ce668 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:48.080392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b9932-7c83-405c-b105-c435dc1ce668 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:48.080666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b9932-7c83-405c-b105-c435dc1ce668 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:48.081496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b9932-7c83-405c-b105-c435dc1ce668 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:48.082364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b9932-7c83-405c-b105-c435dc1ce668 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:48.083848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b9932-7c83-405c-b105-c435dc1ce668 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:48.105282 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 449/932] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Mar 26 20:34:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:48.110860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f1d2f-ef37-464e-976c-6e4c03dcdc2f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:48.210183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f1d2f-ef37-464e-976c-6e4c03dcdc2f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:48.244449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbfb19-35ac-42ff-ab3c-9b984d146e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:48.245230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbfb19-35ac-42ff-ab3c-9b984d146e03 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:48.245507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbfb19-35ac-42ff-ab3c-9b984d146e03 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:48.245777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbfb19-35ac-42ff-ab3c-9b984d146e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:48.256388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbfb19-35ac-42ff-ab3c-9b984d146e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:48.257831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbfb19-35ac-42ff-ab3c-9b984d146e03 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:48.273822 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-48fbfb19-35ac-42ff-ab3c-9b984d146e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:48.275298 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 484/933] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:48.280821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b9932-7c83-405c-b105-c435dc1ce668 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:48.388134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b9932-7c83-405c-b105-c435dc1ce668 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:48.422662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef8153-2c47-433b-91e7-ec4793d16492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:48.423376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef8153-2c47-433b-91e7-ec4793d16492 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:48.423659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef8153-2c47-433b-91e7-ec4793d16492 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:48.423948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef8153-2c47-433b-91e7-ec4793d16492 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:48.424659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef8153-2c47-433b-91e7-ec4793d16492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:48.425020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef8153-2c47-433b-91e7-ec4793d16492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:48.426567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef8153-2c47-433b-91e7-ec4793d16492 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:48.438210 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 450/934] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:48.443700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbfb19-35ac-42ff-ab3c-9b984d146e03 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:48.547220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbfb19-35ac-42ff-ab3c-9b984d146e03 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:48.580816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8951535-1dba-4cf3-b357-9f837a4264a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:48.581610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8951535-1dba-4cf3-b357-9f837a4264a6 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:48.582415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8951535-1dba-4cf3-b357-9f837a4264a6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:48.582693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8951535-1dba-4cf3-b357-9f837a4264a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:48.589747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8951535-1dba-4cf3-b357-9f837a4264a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:48.591208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8951535-1dba-4cf3-b357-9f837a4264a6 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:48.605583 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-e8951535-1dba-4cf3-b357-9f837a4264a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:48.607066 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 485/935] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:48.612456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef8153-2c47-433b-91e7-ec4793d16492 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:48.686539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccd34d-cded-4a0b-a030-d3d1265a96c3 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:48.687060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccd34d-cded-4a0b-a030-d3d1265a96c3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:48.687487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccd34d-cded-4a0b-a030-d3d1265a96c3 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:48.692019 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 486/936] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:48.696264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4a65e-175d-4b7a-893d-05c2d47ee078 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:48.696734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4a65e-175d-4b7a-893d-05c2d47ee078 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:48.697173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4a65e-175d-4b7a-893d-05c2d47ee078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:48.714667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef8153-2c47-433b-91e7-ec4793d16492 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:48.718841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-59f4a65e-175d-4b7a-893d-05c2d47ee078 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:48.720208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-59f4a65e-175d-4b7a-893d-05c2d47ee078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:48.757095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730b274-2822-46f0-8e1f-5f534a039c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:48.758683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730b274-2822-46f0-8e1f-5f534a039c9a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:48.759185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730b274-2822-46f0-8e1f-5f534a039c9a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:48.759653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730b274-2822-46f0-8e1f-5f534a039c9a None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:48.760771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730b274-2822-46f0-8e1f-5f534a039c9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:48.761309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730b274-2822-46f0-8e1f-5f534a039c9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:48.765156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730b274-2822-46f0-8e1f-5f534a039c9a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:48.781159 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 451/937] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:48.787161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730b274-2822-46f0-8e1f-5f534a039c9a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:48.805275 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 487/938] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:48.828616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4a65e-175d-4b7a-893d-05c2d47ee078 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:48.913899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730b274-2822-46f0-8e1f-5f534a039c9a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:48.928001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4a65e-175d-4b7a-893d-05c2d47ee078 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:48.957405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910235f-06a0-4afb-bd9b-ef1089c312e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:48.958979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910235f-06a0-4afb-bd9b-ef1089c312e6 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:48.959679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910235f-06a0-4afb-bd9b-ef1089c312e6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:48.960157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910235f-06a0-4afb-bd9b-ef1089c312e6 None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/0df218115be74b8692728293c326be08/roles/f5afc4377efb41fa95dbb0a452a07110` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:48.962595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910235f-06a0-4afb-bd9b-ef1089c312e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=0df218115be74b8692728293c326be08, role_id=f5afc4377efb41fa95dbb0a452a07110)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:48.963792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ffa9c-f286-40e5-9048-8055bb80fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:48.964424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910235f-06a0-4afb-bd9b-ef1089c312e6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:48.964800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ffa9c-f286-40e5-9048-8055bb80fe1d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:48.965190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ffa9c-f286-40e5-9048-8055bb80fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:48.965559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ffa9c-f286-40e5-9048-8055bb80fe1d None admin] PATH_INFO: `/v3/services/compute` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:48.966302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ffa9c-f286-40e5-9048-8055bb80fe1d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:48.967763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ffa9c-f286-40e5-9048-8055bb80fe1d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:48.981062 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-954ffa9c-f286-40e5-9048-8055bb80fe1d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 26 20:34:48.983780 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 452/939] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:34:48 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/0df218115be74b8692728293c326be08/roles/f5afc4377efb41fa95dbb0a452a07110 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:34:48.988349 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 488/940] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:48.988527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910235f-06a0-4afb-bd9b-ef1089c312e6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:49.104979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910235f-06a0-4afb-bd9b-ef1089c312e6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:49.121198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1329c18-5b38-4a56-b485-b0bc4b65fa83 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:49.121522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1329c18-5b38-4a56-b485-b0bc4b65fa83 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:49.122210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1329c18-5b38-4a56-b485-b0bc4b65fa83 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:49.124760 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 489/941] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:49.131374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cdd8f-ea7b-4785-b9b5-82d22f664e90 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:49.131670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cdd8f-ea7b-4785-b9b5-82d22f664e90 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:49.131943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cdd8f-ea7b-4785-b9b5-82d22f664e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:49.147757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a83668-79c0-49b6-b3a2-fb10873af70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:49.148482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83668-79c0-49b6-b3a2-fb10873af70f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:49.148769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83668-79c0-49b6-b3a2-fb10873af70f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:49.149049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a83668-79c0-49b6-b3a2-fb10873af70f None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:49.149766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83668-79c0-49b6-b3a2-fb10873af70f None admin] RBAC: Adding query filter params (name=compute) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:49.150075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83668-79c0-49b6-b3a2-fb10873af70f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:49.151234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f08cdd8f-ea7b-4785-b9b5-82d22f664e90 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:49.151504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a83668-79c0-49b6-b3a2-fb10873af70f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:49.152488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f08cdd8f-ea7b-4785-b9b5-82d22f664e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:49.158227 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 453/942] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:49.165968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a83668-79c0-49b6-b3a2-fb10873af70f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:49.240990 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 490/943] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:49.269641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cdd8f-ea7b-4785-b9b5-82d22f664e90 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:49.282437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a83668-79c0-49b6-b3a2-fb10873af70f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:49.317498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ba2f8-f950-4c62-8323-e3c0cfb546f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:49.318168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ba2f8-f950-4c62-8323-e3c0cfb546f1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:49.318454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ba2f8-f950-4c62-8323-e3c0cfb546f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:49.318734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931ba2f8-f950-4c62-8323-e3c0cfb546f1 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:49.319442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ba2f8-f950-4c62-8323-e3c0cfb546f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:49.319753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ba2f8-f950-4c62-8323-e3c0cfb546f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:49.321197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931ba2f8-f950-4c62-8323-e3c0cfb546f1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:49.326254 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 454/944] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:49.382260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cdd8f-ea7b-4785-b9b5-82d22f664e90 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:49.425046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80d14-f316-42f0-82d6-6404b1febc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:49.426524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80d14-f316-42f0-82d6-6404b1febc49 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:49.426811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80d14-f316-42f0-82d6-6404b1febc49 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:49.427089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80d14-f316-42f0-82d6-6404b1febc49 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:49.427750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db80d14-f316-42f0-82d6-6404b1febc49 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:49.429198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db80d14-f316-42f0-82d6-6404b1febc49 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:49.441662 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-5db80d14-f316-42f0-82d6-6404b1febc49 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 26 20:34:49.443275 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 491/945] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:49.450310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ba2f8-f950-4c62-8323-e3c0cfb546f1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:49.559094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931ba2f8-f950-4c62-8323-e3c0cfb546f1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:49.596039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30a5de-085e-433f-863d-66d1d410cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:49.597042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30a5de-085e-433f-863d-66d1d410cd6f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:49.597555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30a5de-085e-433f-863d-66d1d410cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:49.598047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30a5de-085e-433f-863d-66d1d410cd6f None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:49.598994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30a5de-085e-433f-863d-66d1d410cd6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:49.599499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30a5de-085e-433f-863d-66d1d410cd6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:49.601225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30a5de-085e-433f-863d-66d1d410cd6f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:49.606386 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 455/946] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:49.612330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80d14-f316-42f0-82d6-6404b1febc49 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:49.718113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80d14-f316-42f0-82d6-6404b1febc49 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:49.751285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce70b86-c180-4e11-af9a-ccb5b00552cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:49.751966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce70b86-c180-4e11-af9a-ccb5b00552cf None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:49.752256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce70b86-c180-4e11-af9a-ccb5b00552cf None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:49.752535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce70b86-c180-4e11-af9a-ccb5b00552cf None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:49.753293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce70b86-c180-4e11-af9a-ccb5b00552cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:49.754133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce70b86-c180-4e11-af9a-ccb5b00552cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:49.755546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce70b86-c180-4e11-af9a-ccb5b00552cf None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:49.760832 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 492/947] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:49.766511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30a5de-085e-433f-863d-66d1d410cd6f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:49.866777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30a5de-085e-433f-863d-66d1d410cd6f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:49.900247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e0023-9525-403a-8071-6d97eeb394d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:49.900900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0023-9525-403a-8071-6d97eeb394d9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:49.901180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0023-9525-403a-8071-6d97eeb394d9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:49.901452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e0023-9525-403a-8071-6d97eeb394d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:49.902228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e0023-9525-403a-8071-6d97eeb394d9 None admin] RBAC: Adding query filter params (interface=public, service_id=72e8b4477aa44c659c068b0910862f01, region_id=RegionOne) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:49.902538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e0023-9525-403a-8071-6d97eeb394d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:49.903901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e0023-9525-403a-8071-6d97eeb394d9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:49.912329 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 456/948] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Mar 26 20:34:49 2022] GET /identity/v3/endpoints?service_id=72e8b4477aa44c659c068b0910862f01&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:49.918101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce70b86-c180-4e11-af9a-ccb5b00552cf None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:50.021105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce70b86-c180-4e11-af9a-ccb5b00552cf None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:50.054305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220f34f-64e1-4410-9ec6-105c49fb7f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:50.054969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f34f-64e1-4410-9ec6-105c49fb7f62 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:50.055253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f34f-64e1-4410-9ec6-105c49fb7f62 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:50.055533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f34f-64e1-4410-9ec6-105c49fb7f62 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:50.056242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220f34f-64e1-4410-9ec6-105c49fb7f62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:50.057614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220f34f-64e1-4410-9ec6-105c49fb7f62 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:50.063822 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 493/949] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Mar 26 20:34:49 2022] GET /identity/v3/services => generated 1497 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:34:50.481959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b398d1-df0a-4ab8-97b1-796156a898b9 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:50.482246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b398d1-df0a-4ab8-97b1-796156a898b9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:50.482830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b398d1-df0a-4ab8-97b1-796156a898b9 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:50.485148 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 457/950] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:50.492283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904e81c-dc90-4c00-850d-6c88d7bf20b0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:50.492853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904e81c-dc90-4c00-850d-6c88d7bf20b0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:50.493363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904e81c-dc90-4c00-850d-6c88d7bf20b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:50.513503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8904e81c-dc90-4c00-850d-6c88d7bf20b0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:50.515013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8904e81c-dc90-4c00-850d-6c88d7bf20b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:50.582794 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 494/951] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:50.607598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b398d1-df0a-4ab8-97b1-796156a898b9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:50.717207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b398d1-df0a-4ab8-97b1-796156a898b9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:50.751414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:50.752440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:50.752931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:50.753459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:50.754382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:50.756085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:50.757653 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.common [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 26 20:34:50.777016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.sql.core [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 26 20:34:50.777016 ncdv-master-1 devstack@keystone.service[97203]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 26 20:34:50.777016 ncdv-master-1 devstack@keystone.service[97203]: [parameters: {'id': '79d97d5cefff47a09c95d85dfb0d804e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 26 20:34:50.777016 ncdv-master-1 devstack@keystone.service[97203]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97203) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 26 20:34:50.786030 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 79d97d5cefff47a09c95d85dfb0d804e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 79d97d5cefff47a09c95d85dfb0d804e. Mar 26 20:34:50.792055 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 458/952] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Mar 26 20:34:50 2022] POST /identity/v3/projects => generated 262 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:50.794269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904e81c-dc90-4c00-850d-6c88d7bf20b0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:50.892714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904e81c-dc90-4c00-850d-6c88d7bf20b0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:50.932913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d250564-7e5e-4c6c-a027-5400a635833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:50.934106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d250564-7e5e-4c6c-a027-5400a635833c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:50.934592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d250564-7e5e-4c6c-a027-5400a635833c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:50.935099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d250564-7e5e-4c6c-a027-5400a635833c None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:50.942528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d250564-7e5e-4c6c-a027-5400a635833c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:50.944257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d250564-7e5e-4c6c-a027-5400a635833c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:50.958317 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-3d250564-7e5e-4c6c-a027-5400a635833c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:50.963982 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 495/953] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:50.966267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:51.072125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4567c1e-ef67-4335-85b3-468f936808b6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:51.106953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bb903-b75d-45d1-8e9f-10bec98773d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:51.107616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb903-b75d-45d1-8e9f-10bec98773d2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:51.107900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb903-b75d-45d1-8e9f-10bec98773d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:51.108230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb903-b75d-45d1-8e9f-10bec98773d2 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:51.108980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bb903-b75d-45d1-8e9f-10bec98773d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:51.109291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bb903-b75d-45d1-8e9f-10bec98773d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:51.110951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bb903-b75d-45d1-8e9f-10bec98773d2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:51.136053 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 459/954] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:51.546447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c9550-2da2-4e3a-af29-1447d4a231b3 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:51.547723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c9550-2da2-4e3a-af29-1447d4a231b3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:51.548255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c9550-2da2-4e3a-af29-1447d4a231b3 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:51.555000 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 496/955] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:51.564267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534f3b-4a4a-4990-8b11-ae9bf53fd64b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:51.564782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534f3b-4a4a-4990-8b11-ae9bf53fd64b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:51.565339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5534f3b-4a4a-4990-8b11-ae9bf53fd64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:51.584287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a5534f3b-4a4a-4990-8b11-ae9bf53fd64b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:51.585800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a5534f3b-4a4a-4990-8b11-ae9bf53fd64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:51.654105 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 460/956] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:51.679054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c9550-2da2-4e3a-af29-1447d4a231b3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:51.781950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c9550-2da2-4e3a-af29-1447d4a231b3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:51.816467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5779a-af9b-4d79-b4b9-d372456bd1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:51.817213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5779a-af9b-4d79-b4b9-d372456bd1e8 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:51.817474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5779a-af9b-4d79-b4b9-d372456bd1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:51.817751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5779a-af9b-4d79-b4b9-d372456bd1e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:51.828124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5779a-af9b-4d79-b4b9-d372456bd1e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:34:51.835495 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-34d5779a-af9b-4d79-b4b9-d372456bd1e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 26 20:34:51.837057 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 497/957] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Mar 26 20:34:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:51.842552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534f3b-4a4a-4990-8b11-ae9bf53fd64b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:51.896572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1190e-873e-4508-b1c5-220fe5154935 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:51.896859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1190e-873e-4508-b1c5-220fe5154935 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:51.897131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1190e-873e-4508-b1c5-220fe5154935 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:51.899115 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 498/958] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:51.905207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe18dd-7dee-4a11-8912-8d80edda6f66 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:51.905486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe18dd-7dee-4a11-8912-8d80edda6f66 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:51.905760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe18dd-7dee-4a11-8912-8d80edda6f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:51.927067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d1fe18dd-7dee-4a11-8912-8d80edda6f66 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:51.928571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d1fe18dd-7dee-4a11-8912-8d80edda6f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:51.944507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5534f3b-4a4a-4990-8b11-ae9bf53fd64b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:51.982951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b69a4c-3759-4071-8512-354af4d52d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:51.983613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b69a4c-3759-4071-8512-354af4d52d2c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:51.983892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b69a4c-3759-4071-8512-354af4d52d2c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:51.984191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b69a4c-3759-4071-8512-354af4d52d2c None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:51.984978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b69a4c-3759-4071-8512-354af4d52d2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:51.985286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b69a4c-3759-4071-8512-354af4d52d2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:51.986869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b69a4c-3759-4071-8512-354af4d52d2c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:52.000399 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 461/959] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Mar 26 20:34:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:52.001436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b69a4c-3759-4071-8512-354af4d52d2c None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:52.018283 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 499/960] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:52.045881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe18dd-7dee-4a11-8912-8d80edda6f66 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:52.114393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b69a4c-3759-4071-8512-354af4d52d2c None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:52.150436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25884fd7-bb62-4650-9f33-1fa053799720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:52.151631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884fd7-bb62-4650-9f33-1fa053799720 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.152157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884fd7-bb62-4650-9f33-1fa053799720 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.152650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884fd7-bb62-4650-9f33-1fa053799720 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.160906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe18dd-7dee-4a11-8912-8d80edda6f66 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:52.166175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25884fd7-bb62-4650-9f33-1fa053799720 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:52.168116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25884fd7-bb62-4650-9f33-1fa053799720 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:52.185495 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-25884fd7-bb62-4650-9f33-1fa053799720 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:52.187501 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 462/961] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:52.192804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25884fd7-bb62-4650-9f33-1fa053799720 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:52.206117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f62cd-1b45-42ee-9006-09cd073e2719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:52.207571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f62cd-1b45-42ee-9006-09cd073e2719 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.207869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f62cd-1b45-42ee-9006-09cd073e2719 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.208184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f62cd-1b45-42ee-9006-09cd073e2719 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.208900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f62cd-1b45-42ee-9006-09cd073e2719 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:52.210471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f62cd-1b45-42ee-9006-09cd073e2719 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:52.235941 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 500/962] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:34:52 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:34:52.310456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25884fd7-bb62-4650-9f33-1fa053799720 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:52.355770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c3e18-6ed7-4f32-a3ec-ec9cf3bc974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:52.356471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3e18-6ed7-4f32-a3ec-ec9cf3bc974b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.356753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3e18-6ed7-4f32-a3ec-ec9cf3bc974b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.357032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3e18-6ed7-4f32-a3ec-ec9cf3bc974b None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.357813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c3e18-6ed7-4f32-a3ec-ec9cf3bc974b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:52.358126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c3e18-6ed7-4f32-a3ec-ec9cf3bc974b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:52.359521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c3e18-6ed7-4f32-a3ec-ec9cf3bc974b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:52.374244 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 463/963] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:52.379937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f62cd-1b45-42ee-9006-09cd073e2719 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:52.492660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f62cd-1b45-42ee-9006-09cd073e2719 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:52.530595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e20291-4dd8-47c9-8d01-7c2eba868269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:52.531773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e20291-4dd8-47c9-8d01-7c2eba868269 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.532334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e20291-4dd8-47c9-8d01-7c2eba868269 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.532802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e20291-4dd8-47c9-8d01-7c2eba868269 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.538378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af3cd-6991-4648-9e2b-3b680a1a8238 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.538700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af3cd-6991-4648-9e2b-3b680a1a8238 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.538948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878af3cd-6991-4648-9e2b-3b680a1a8238 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.540742 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 464/964] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:52.541947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e20291-4dd8-47c9-8d01-7c2eba868269 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:52.543657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e20291-4dd8-47c9-8d01-7c2eba868269 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:52.547329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e052a-3a1d-4a00-b36d-504196f7386e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.547617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e052a-3a1d-4a00-b36d-504196f7386e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.547895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e052a-3a1d-4a00-b36d-504196f7386e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.558797 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-68e20291-4dd8-47c9-8d01-7c2eba868269 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 26 20:34:52.560605 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 501/965] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:34:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:52.564813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5e6e052a-3a1d-4a00-b36d-504196f7386e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:52.566470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e20291-4dd8-47c9-8d01-7c2eba868269 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:52.566663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5e6e052a-3a1d-4a00-b36d-504196f7386e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:52.634927 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 465/966] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:52.658608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e052a-3a1d-4a00-b36d-504196f7386e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:52.668312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e20291-4dd8-47c9-8d01-7c2eba868269 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:52.702138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606069d-2358-451e-9a14-11ede390fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:52.703145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606069d-2358-451e-9a14-11ede390fa5f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.703619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606069d-2358-451e-9a14-11ede390fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.704120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606069d-2358-451e-9a14-11ede390fa5f None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.705177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606069d-2358-451e-9a14-11ede390fa5f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:52.705685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606069d-2358-451e-9a14-11ede390fa5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:52.707359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606069d-2358-451e-9a14-11ede390fa5f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:52.725562 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 502/967] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Mar 26 20:34:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:52.732043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606069d-2358-451e-9a14-11ede390fa5f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:52.763137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e052a-3a1d-4a00-b36d-504196f7386e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:52.797651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90705c-fd31-49e0-adb1-1855329473a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:52.798454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90705c-fd31-49e0-adb1-1855329473a4 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.798783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90705c-fd31-49e0-adb1-1855329473a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.799065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90705c-fd31-49e0-adb1-1855329473a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.799715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90705c-fd31-49e0-adb1-1855329473a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:52.801212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90705c-fd31-49e0-adb1-1855329473a4 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:52.812606 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-ff90705c-fd31-49e0-adb1-1855329473a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 26 20:34:52.819309 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 466/968] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:52.820463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90705c-fd31-49e0-adb1-1855329473a4 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:52.852348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606069d-2358-451e-9a14-11ede390fa5f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:52.886394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b34cdd-5896-4c22-a627-04d857f0497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:52.887820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b34cdd-5896-4c22-a627-04d857f0497c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.887954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b34cdd-5896-4c22-a627-04d857f0497c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.888298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b34cdd-5896-4c22-a627-04d857f0497c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.921541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90705c-fd31-49e0-adb1-1855329473a4 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:52.955812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b34cdd-5896-4c22-a627-04d857f0497c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:52.956885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ac391-7cb7-40e7-b8cd-807b4efd2cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:52.957789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac391-7cb7-40e7-b8cd-807b4efd2cd8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:52.957904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b34cdd-5896-4c22-a627-04d857f0497c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:52.958388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac391-7cb7-40e7-b8cd-807b4efd2cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:52.958883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ac391-7cb7-40e7-b8cd-807b4efd2cd8 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:52.959775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ac391-7cb7-40e7-b8cd-807b4efd2cd8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:52.960298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ac391-7cb7-40e7-b8cd-807b4efd2cd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:52.961854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ac391-7cb7-40e7-b8cd-807b4efd2cd8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:52.967277 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 467/969] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:52.973081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ac391-7cb7-40e7-b8cd-807b4efd2cd8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:53.072413 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 503/970] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:34:52 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 26 20:34:53.077900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b34cdd-5896-4c22-a627-04d857f0497c None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:53.097564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ac391-7cb7-40e7-b8cd-807b4efd2cd8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:53.132183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66612c-9be3-48ed-8c10-40d3802653fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:53.132845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66612c-9be3-48ed-8c10-40d3802653fb None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:53.133128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66612c-9be3-48ed-8c10-40d3802653fb None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:53.133402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66612c-9be3-48ed-8c10-40d3802653fb None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:53.134098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66612c-9be3-48ed-8c10-40d3802653fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:53.134402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66612c-9be3-48ed-8c10-40d3802653fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:53.135798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f66612c-9be3-48ed-8c10-40d3802653fb None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:53.141152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 468/971] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:53.146708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66612c-9be3-48ed-8c10-40d3802653fb None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:53.197881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b34cdd-5896-4c22-a627-04d857f0497c None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:53.243145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2357a24-9f87-440b-91ab-bf7853cadbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:53.244285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2357a24-9f87-440b-91ab-bf7853cadbba None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:53.244572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2357a24-9f87-440b-91ab-bf7853cadbba None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:53.245018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2357a24-9f87-440b-91ab-bf7853cadbba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:53.259173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2357a24-9f87-440b-91ab-bf7853cadbba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:53.259907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66612c-9be3-48ed-8c10-40d3802653fb None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:53.260659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2357a24-9f87-440b-91ab-bf7853cadbba None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:53.281884 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-b2357a24-9f87-440b-91ab-bf7853cadbba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:34:53.283963 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 504/972] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:34:53.291288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2357a24-9f87-440b-91ab-bf7853cadbba None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:53.302670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cd4dd-8fdd-4d23-a6c2-868b482834ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:53.303352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cd4dd-8fdd-4d23-a6c2-868b482834ed None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:53.303635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cd4dd-8fdd-4d23-a6c2-868b482834ed None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:53.303930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00cd4dd-8fdd-4d23-a6c2-868b482834ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:53.304710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cd4dd-8fdd-4d23-a6c2-868b482834ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:53.306845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00cd4dd-8fdd-4d23-a6c2-868b482834ed None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:53.343955 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 469/973] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Mar 26 20:34:53 2022] POST /identity/v3/endpoints => generated 349 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:34:53.417217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2357a24-9f87-440b-91ab-bf7853cadbba None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:53.470505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcb6a5-b034-4c23-a4ea-b0d981bbd291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:53.471577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcb6a5-b034-4c23-a4ea-b0d981bbd291 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:53.472149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcb6a5-b034-4c23-a4ea-b0d981bbd291 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:53.472626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dcb6a5-b034-4c23-a4ea-b0d981bbd291 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:53.473555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcb6a5-b034-4c23-a4ea-b0d981bbd291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:53.474075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcb6a5-b034-4c23-a4ea-b0d981bbd291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:53.475712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dcb6a5-b034-4c23-a4ea-b0d981bbd291 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:53.489405 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 505/974] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:53.495528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cd4dd-8fdd-4d23-a6c2-868b482834ed None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:53.606363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00cd4dd-8fdd-4d23-a6c2-868b482834ed None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:53.640657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71426589-7420-4e2e-8813-0bdc72766fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:53.641876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71426589-7420-4e2e-8813-0bdc72766fbb None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:53.642358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71426589-7420-4e2e-8813-0bdc72766fbb None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:53.642871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71426589-7420-4e2e-8813-0bdc72766fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:53.650797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71426589-7420-4e2e-8813-0bdc72766fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:53.652566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71426589-7420-4e2e-8813-0bdc72766fbb None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:53.666424 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-71426589-7420-4e2e-8813-0bdc72766fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:34:53.668268 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 470/975] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:53.674559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcb6a5-b034-4c23-a4ea-b0d981bbd291 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:53.697163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665b43a-7141-4b7e-ba56-bcc809637262 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:53.697476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665b43a-7141-4b7e-ba56-bcc809637262 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:53.697728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665b43a-7141-4b7e-ba56-bcc809637262 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:53.699781 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 471/976] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:53.706261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81264af1-2d0b-42f4-9727-7548e53b7be3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:53.706638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81264af1-2d0b-42f4-9727-7548e53b7be3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:53.706915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81264af1-2d0b-42f4-9727-7548e53b7be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:53.724068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-81264af1-2d0b-42f4-9727-7548e53b7be3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:53.725185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-81264af1-2d0b-42f4-9727-7548e53b7be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:53.794093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dcb6a5-b034-4c23-a4ea-b0d981bbd291 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:53.796079 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 472/977] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:53.819123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81264af1-2d0b-42f4-9727-7548e53b7be3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:53.830958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa71e6-0213-493b-ae54-05522fc217c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:53.832745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa71e6-0213-493b-ae54-05522fc217c3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:53.833230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa71e6-0213-493b-ae54-05522fc217c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:53.833908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa71e6-0213-493b-ae54-05522fc217c3 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:53.835540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa71e6-0213-493b-ae54-05522fc217c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:53.836168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa71e6-0213-493b-ae54-05522fc217c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:53.838312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa71e6-0213-493b-ae54-05522fc217c3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:53.855865 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 506/978] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:53.862261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa71e6-0213-493b-ae54-05522fc217c3 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:53.922153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81264af1-2d0b-42f4-9727-7548e53b7be3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:53.958574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:53.959240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:53.959524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:53.959797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:53.960553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:53.962002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:53.977578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.sql.core [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 26 20:34:53.977578 ncdv-master-1 devstack@keystone.service[97203]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 26 20:34:53.977578 ncdv-master-1 devstack@keystone.service[97203]: [parameters: {'user_id': '8de99cd4d1a746c7b15e853d1394cf2b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 26 20:34:53.977578 ncdv-master-1 devstack@keystone.service[97203]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97203) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 26 20:34:53.984681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa71e6-0213-493b-ae54-05522fc217c3 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:53.986015 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 26 20:34:53.989410 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 473/979] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Mar 26 20:34:53 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:53.998288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:54.037453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59d58b-ef4c-4a47-984a-7292e3785349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:54.038111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59d58b-ef4c-4a47-984a-7292e3785349 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:54.038390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59d58b-ef4c-4a47-984a-7292e3785349 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:54.038664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59d58b-ef4c-4a47-984a-7292e3785349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:54.039484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59d58b-ef4c-4a47-984a-7292e3785349 None admin] RBAC: Adding query filter params (role.id=f5afc4377efb41fa95dbb0a452a07110, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=0df218115be74b8692728293c326be08) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:54.039847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59d58b-ef4c-4a47-984a-7292e3785349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:54.041312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59d58b-ef4c-4a47-984a-7292e3785349 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:54.047962 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 507/980] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:34:53 2022] GET /identity/v3/role_assignments?user.id=0df218115be74b8692728293c326be08&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=f5afc4377efb41fa95dbb0a452a07110 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:54.131932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90d6f9-48b8-47f2-a61c-5e0929889461 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:54.169918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e78652-6076-4792-8469-f53c6a1749ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:54.171079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e78652-6076-4792-8469-f53c6a1749ca None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:54.171565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e78652-6076-4792-8469-f53c6a1749ca None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:54.172017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e78652-6076-4792-8469-f53c6a1749ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:54.181736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e78652-6076-4792-8469-f53c6a1749ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:54.183775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e78652-6076-4792-8469-f53c6a1749ca None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:54.199303 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b2e78652-6076-4792-8469-f53c6a1749ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 26 20:34:54.201219 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 474/981] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:34:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:54.209094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59d58b-ef4c-4a47-984a-7292e3785349 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:54.318187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59d58b-ef4c-4a47-984a-7292e3785349 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:54.356160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecc5e7-d1d7-40f0-a1d5-962e412940c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:54.357191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc5e7-d1d7-40f0-a1d5-962e412940c9 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:54.357626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc5e7-d1d7-40f0-a1d5-962e412940c9 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:54.358062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc5e7-d1d7-40f0-a1d5-962e412940c9 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:54.359015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecc5e7-d1d7-40f0-a1d5-962e412940c9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:54.359480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecc5e7-d1d7-40f0-a1d5-962e412940c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:54.361102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecc5e7-d1d7-40f0-a1d5-962e412940c9 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:54.397527 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 508/982] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Mar 26 20:34:54 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:54.728219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc406b-ba1d-4fa4-979b-770501c910a3 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:54.728596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc406b-ba1d-4fa4-979b-770501c910a3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:54.728775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc406b-ba1d-4fa4-979b-770501c910a3 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:54.733447 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 475/983] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:54.739811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d6afd-84aa-4041-b8b2-c5f5efdc3f42 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:54.740143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d6afd-84aa-4041-b8b2-c5f5efdc3f42 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:54.740419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d6afd-84aa-4041-b8b2-c5f5efdc3f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:54.756713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8b9d6afd-84aa-4041-b8b2-c5f5efdc3f42 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:54.757888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8b9d6afd-84aa-4041-b8b2-c5f5efdc3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:54.821753 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 509/984] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:54.846664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc406b-ba1d-4fa4-979b-770501c910a3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:54.943486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc406b-ba1d-4fa4-979b-770501c910a3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:54.975603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caf0a8-d471-4534-9138-3c16c04a3234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:54.976415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf0a8-d471-4534-9138-3c16c04a3234 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:54.976695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf0a8-d471-4534-9138-3c16c04a3234 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:54.977266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15caf0a8-d471-4534-9138-3c16c04a3234 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:54.977879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15caf0a8-d471-4534-9138-3c16c04a3234 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:54.979306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15caf0a8-d471-4534-9138-3c16c04a3234 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:54.989931 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-15caf0a8-d471-4534-9138-3c16c04a3234 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 26 20:34:54.991278 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 476/985] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:54.997097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d6afd-84aa-4041-b8b2-c5f5efdc3f42 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:55.098403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d6afd-84aa-4041-b8b2-c5f5efdc3f42 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:55.130315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346072aa-130c-4fd3-96b4-868fa30a8330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:55.130968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346072aa-130c-4fd3-96b4-868fa30a8330 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:55.131250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346072aa-130c-4fd3-96b4-868fa30a8330 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:55.131523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346072aa-130c-4fd3-96b4-868fa30a8330 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:55.132249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346072aa-130c-4fd3-96b4-868fa30a8330 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:55.132553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346072aa-130c-4fd3-96b4-868fa30a8330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:55.133932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346072aa-130c-4fd3-96b4-868fa30a8330 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:55.142954 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 510/986] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:55.145080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caf0a8-d471-4534-9138-3c16c04a3234 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:55.240986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15caf0a8-d471-4534-9138-3c16c04a3234 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:55.273711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c17c1e-7203-442a-bb87-653863ad71fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:55.274374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c17c1e-7203-442a-bb87-653863ad71fc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:55.274659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c17c1e-7203-442a-bb87-653863ad71fc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:55.274937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c17c1e-7203-442a-bb87-653863ad71fc None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:55.275640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c17c1e-7203-442a-bb87-653863ad71fc None admin] RBAC: Adding query filter params (type=compute) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:55.275970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c17c1e-7203-442a-bb87-653863ad71fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:55.277358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c17c1e-7203-442a-bb87-653863ad71fc None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:55.282319 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 477/987] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:55.288094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346072aa-130c-4fd3-96b4-868fa30a8330 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:55.393748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346072aa-130c-4fd3-96b4-868fa30a8330 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:55.429624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e236bb-6f5e-431e-8641-20006215b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:55.430277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e236bb-6f5e-431e-8641-20006215b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:55.430560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e236bb-6f5e-431e-8641-20006215b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:55.430837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e236bb-6f5e-431e-8641-20006215b2a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:55.431614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e236bb-6f5e-431e-8641-20006215b2a4 None admin] RBAC: Adding query filter params (interface=public, service_id=cb62418abdd649f897a2d767b8e766ce, region_id=RegionOne) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:55.431953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e236bb-6f5e-431e-8641-20006215b2a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:55.433321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e236bb-6f5e-431e-8641-20006215b2a4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:55.443325 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 511/988] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Mar 26 20:34:55 2022] GET /identity/v3/endpoints?service_id=cb62418abdd649f897a2d767b8e766ce&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:55.444542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c17c1e-7203-442a-bb87-653863ad71fc None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:55.542043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c17c1e-7203-442a-bb87-653863ad71fc None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:55.573791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5ae62-be23-4f53-8ccd-38039e8513fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:55.574499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5ae62-be23-4f53-8ccd-38039e8513fe None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:55.574786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5ae62-be23-4f53-8ccd-38039e8513fe None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:55.575063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5ae62-be23-4f53-8ccd-38039e8513fe None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:55.575727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5ae62-be23-4f53-8ccd-38039e8513fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:55.577135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5ae62-be23-4f53-8ccd-38039e8513fe None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:55.583376 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 478/989] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Mar 26 20:34:55 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:34:55.771846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2a0ee-a6db-46d5-9bd3-ef8ef795347e None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:55.772249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2a0ee-a6db-46d5-9bd3-ef8ef795347e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:55.772445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2a0ee-a6db-46d5-9bd3-ef8ef795347e None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:55.774226 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 512/990] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:55.781305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b655066-2547-494d-bf42-351f44bcbd74 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:55.781606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b655066-2547-494d-bf42-351f44bcbd74 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:55.781887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b655066-2547-494d-bf42-351f44bcbd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:55.799867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5b655066-2547-494d-bf42-351f44bcbd74 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:55.802059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5b655066-2547-494d-bf42-351f44bcbd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:55.867040 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 479/991] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:55.891038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2a0ee-a6db-46d5-9bd3-ef8ef795347e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:55.997038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2a0ee-a6db-46d5-9bd3-ef8ef795347e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:56.031876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1168f1e-2368-4c07-aec3-d4a361b69bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:56.032769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1168f1e-2368-4c07-aec3-d4a361b69bfa None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:56.033052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1168f1e-2368-4c07-aec3-d4a361b69bfa None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:56.033325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1168f1e-2368-4c07-aec3-d4a361b69bfa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:56.033971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1168f1e-2368-4c07-aec3-d4a361b69bfa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:56.036093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1168f1e-2368-4c07-aec3-d4a361b69bfa None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:56.047694 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-e1168f1e-2368-4c07-aec3-d4a361b69bfa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 26 20:34:56.049136 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 513/992] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:56.055042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b655066-2547-494d-bf42-351f44bcbd74 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:56.154852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b655066-2547-494d-bf42-351f44bcbd74 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:56.188169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff145c6-5db1-42b7-97f2-f2bf76be6fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:56.188831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff145c6-5db1-42b7-97f2-f2bf76be6fb8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:56.189115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff145c6-5db1-42b7-97f2-f2bf76be6fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:56.189390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff145c6-5db1-42b7-97f2-f2bf76be6fb8 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:56.190085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff145c6-5db1-42b7-97f2-f2bf76be6fb8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:56.190391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff145c6-5db1-42b7-97f2-f2bf76be6fb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:56.191822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff145c6-5db1-42b7-97f2-f2bf76be6fb8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:56.196757 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 480/993] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:56.202395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1168f1e-2368-4c07-aec3-d4a361b69bfa None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:56.297610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1168f1e-2368-4c07-aec3-d4a361b69bfa None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:56.329430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7c448-d41d-450a-999e-0dca794182f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:56.330022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7c448-d41d-450a-999e-0dca794182f3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:56.330309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7c448-d41d-450a-999e-0dca794182f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:56.330590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b7c448-d41d-450a-999e-0dca794182f3 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:56.331858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7c448-d41d-450a-999e-0dca794182f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:56.332200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7c448-d41d-450a-999e-0dca794182f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:56.333587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b7c448-d41d-450a-999e-0dca794182f3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:56.343483 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 514/994] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:56.344715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff145c6-5db1-42b7-97f2-f2bf76be6fb8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:56.446475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff145c6-5db1-42b7-97f2-f2bf76be6fb8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:56.480421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578d8da-c637-4afb-a48a-b804cda50afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:56.481075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578d8da-c637-4afb-a48a-b804cda50afe None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:56.481358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578d8da-c637-4afb-a48a-b804cda50afe None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:56.481634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578d8da-c637-4afb-a48a-b804cda50afe None admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:56.482420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578d8da-c637-4afb-a48a-b804cda50afe None admin] RBAC: Adding query filter params (interface=admin, service_id=72e8b4477aa44c659c068b0910862f01, region_id=RegionOne) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:56.482732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578d8da-c637-4afb-a48a-b804cda50afe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:56.484137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578d8da-c637-4afb-a48a-b804cda50afe None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:56.492078 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 481/995] 10.222.0.16 () {56 vars in 1249 bytes} [Sat Mar 26 20:34:56 2022] GET /identity/v3/endpoints?service_id=72e8b4477aa44c659c068b0910862f01&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:56.495325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7c448-d41d-450a-999e-0dca794182f3 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:56.510399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f20f-ad87-4015-920b-be72c8bbe309 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:56.510872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f20f-ad87-4015-920b-be72c8bbe309 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:56.511276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203f20f-ad87-4015-920b-be72c8bbe309 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:56.513175 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 482/996] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:56.519869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536aef0-aa0c-418d-a1be-4d8b0a78375a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:56.520195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536aef0-aa0c-418d-a1be-4d8b0a78375a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:56.520462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536aef0-aa0c-418d-a1be-4d8b0a78375a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:56.537084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6536aef0-aa0c-418d-a1be-4d8b0a78375a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:56.538255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6536aef0-aa0c-418d-a1be-4d8b0a78375a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:56.595703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b7c448-d41d-450a-999e-0dca794182f3 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:56.603949 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 483/997] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:34:56.628230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536aef0-aa0c-418d-a1be-4d8b0a78375a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:56.629061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d98134-e86f-4dc5-9b33-7e8a2d0652d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:56.629731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98134-e86f-4dc5-9b33-7e8a2d0652d7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:56.630015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98134-e86f-4dc5-9b33-7e8a2d0652d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:56.630295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d98134-e86f-4dc5-9b33-7e8a2d0652d7 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:56.630968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d98134-e86f-4dc5-9b33-7e8a2d0652d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:56.632390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d98134-e86f-4dc5-9b33-7e8a2d0652d7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:56.647948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 515/998] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Mar 26 20:34:56 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:34:56.731702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536aef0-aa0c-418d-a1be-4d8b0a78375a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:56.766702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bc2d6-50e2-43bd-936e-0d2eeb0989a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:56.767578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bc2d6-50e2-43bd-936e-0d2eeb0989a1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:56.767865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bc2d6-50e2-43bd-936e-0d2eeb0989a1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:56.768179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bc2d6-50e2-43bd-936e-0d2eeb0989a1 None admin] PATH_INFO: `/v3/services/image` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:56.769389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bc2d6-50e2-43bd-936e-0d2eeb0989a1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:56.770931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940bc2d6-50e2-43bd-936e-0d2eeb0989a1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:56.782858 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-940bc2d6-50e2-43bd-936e-0d2eeb0989a1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 26 20:34:56.789885 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 484/999] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Mar 26 20:34:56 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:56.791574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d98134-e86f-4dc5-9b33-7e8a2d0652d7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:56.891359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d98134-e86f-4dc5-9b33-7e8a2d0652d7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:56.924028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca42c6-2473-4738-9d54-8dc0a5ae488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:56.924688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca42c6-2473-4738-9d54-8dc0a5ae488a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:56.925391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca42c6-2473-4738-9d54-8dc0a5ae488a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:56.925674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca42c6-2473-4738-9d54-8dc0a5ae488a None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:56.926372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca42c6-2473-4738-9d54-8dc0a5ae488a None admin] RBAC: Adding query filter params (name=image) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:56.926679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca42c6-2473-4738-9d54-8dc0a5ae488a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:56.928086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca42c6-2473-4738-9d54-8dc0a5ae488a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:56.932834 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 516/1000] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:56.938227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bc2d6-50e2-43bd-936e-0d2eeb0989a1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:57.040615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bc2d6-50e2-43bd-936e-0d2eeb0989a1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:57.072949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102bccc-6198-482b-97bf-95dc86e648e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:57.073651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102bccc-6198-482b-97bf-95dc86e648e0 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:57.073884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102bccc-6198-482b-97bf-95dc86e648e0 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:57.074159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102bccc-6198-482b-97bf-95dc86e648e0 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:57.074860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102bccc-6198-482b-97bf-95dc86e648e0 None admin] RBAC: Adding query filter params (type=image) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:57.075168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102bccc-6198-482b-97bf-95dc86e648e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:57.076589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102bccc-6198-482b-97bf-95dc86e648e0 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:57.081121 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 485/1001] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:34:56 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:57.960322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183134b-5faf-4879-aa48-c471f1f0a3e0 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:57.960852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183134b-5faf-4879-aa48-c471f1f0a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:57.960852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183134b-5faf-4879-aa48-c471f1f0a3e0 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:57.962848 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 517/1002] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:57.969458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04633141-afaa-449b-beea-9a4121b27369 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:57.969744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04633141-afaa-449b-beea-9a4121b27369 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:57.970014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04633141-afaa-449b-beea-9a4121b27369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:57.986335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-04633141-afaa-449b-beea-9a4121b27369 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:57.987525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-04633141-afaa-449b-beea-9a4121b27369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:58.056262 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 486/1003] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:58.080511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183134b-5faf-4879-aa48-c471f1f0a3e0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:58.178228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183134b-5faf-4879-aa48-c471f1f0a3e0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:58.211061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede178-0458-49a0-8ae7-0a54982121d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:58.211771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede178-0458-49a0-8ae7-0a54982121d5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:58.212090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede178-0458-49a0-8ae7-0a54982121d5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:58.212362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dede178-0458-49a0-8ae7-0a54982121d5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:58.213000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dede178-0458-49a0-8ae7-0a54982121d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:58.214366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dede178-0458-49a0-8ae7-0a54982121d5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:58.225341 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-8dede178-0458-49a0-8ae7-0a54982121d5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 26 20:34:58.226648 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 518/1004] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:34:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:58.232427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04633141-afaa-449b-beea-9a4121b27369 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:58.329702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04633141-afaa-449b-beea-9a4121b27369 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:58.362804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5c0e2-26a2-4abc-9878-9dea4eb9c7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:58.363461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5c0e2-26a2-4abc-9878-9dea4eb9c7c2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:58.363740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5c0e2-26a2-4abc-9878-9dea4eb9c7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:58.364045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5c0e2-26a2-4abc-9878-9dea4eb9c7c2 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:58.364741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5c0e2-26a2-4abc-9878-9dea4eb9c7c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:58.365047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5c0e2-26a2-4abc-9878-9dea4eb9c7c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:58.366428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d5c0e2-26a2-4abc-9878-9dea4eb9c7c2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:58.371150 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 487/1005] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:58.376708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede178-0458-49a0-8ae7-0a54982121d5 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:58.473154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dede178-0458-49a0-8ae7-0a54982121d5 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:58.504196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a94f-15c2-4ae5-bc65-39682b7db4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:58.504850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a94f-15c2-4ae5-bc65-39682b7db4b7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:58.505132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a94f-15c2-4ae5-bc65-39682b7db4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:58.505408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a94f-15c2-4ae5-bc65-39682b7db4b7 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:58.506104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a94f-15c2-4ae5-bc65-39682b7db4b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:58.506407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a94f-15c2-4ae5-bc65-39682b7db4b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:58.507774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a94f-15c2-4ae5-bc65-39682b7db4b7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:58.513037 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 519/1006] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Mar 26 20:34:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:58.518524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5c0e2-26a2-4abc-9878-9dea4eb9c7c2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:58.614326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5c0e2-26a2-4abc-9878-9dea4eb9c7c2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:58.646852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d51c0-fae8-472b-94d9-7846e326b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:58.647524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d51c0-fae8-472b-94d9-7846e326b4d8 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:58.647800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d51c0-fae8-472b-94d9-7846e326b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:58.648107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d51c0-fae8-472b-94d9-7846e326b4d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:58.648870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d51c0-fae8-472b-94d9-7846e326b4d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:58.650298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d51c0-fae8-472b-94d9-7846e326b4d8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:58.670363 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 488/1007] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Mar 26 20:34:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:34:59.042527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc929bf-b552-4dcd-a0b6-7919b7358f77 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:59.043073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc929bf-b552-4dcd-a0b6-7919b7358f77 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:59.043073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc929bf-b552-4dcd-a0b6-7919b7358f77 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:59.045020 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 520/1008] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:34:59.052103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50988a2-349c-4ef2-a62b-1e386e3ab933 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:59.052406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50988a2-349c-4ef2-a62b-1e386e3ab933 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:59.052685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50988a2-349c-4ef2-a62b-1e386e3ab933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:59.070868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c50988a2-349c-4ef2-a62b-1e386e3ab933 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:59.072180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c50988a2-349c-4ef2-a62b-1e386e3ab933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:59.145532 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 489/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:59 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:59.169251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc929bf-b552-4dcd-a0b6-7919b7358f77 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:59.266218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc929bf-b552-4dcd-a0b6-7919b7358f77 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:59.300558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba455a85-b5d4-4ef3-ae93-ccb2f80ddf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:59.301283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455a85-b5d4-4ef3-ae93-ccb2f80ddf27 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:59.301566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455a85-b5d4-4ef3-ae93-ccb2f80ddf27 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:59.301843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba455a85-b5d4-4ef3-ae93-ccb2f80ddf27 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:59.302484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba455a85-b5d4-4ef3-ae93-ccb2f80ddf27 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:59.303850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba455a85-b5d4-4ef3-ae93-ccb2f80ddf27 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:59.315355 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-ba455a85-b5d4-4ef3-ae93-ccb2f80ddf27 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 26 20:34:59.316786 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 521/1010] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Mar 26 20:34:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:34:59.322645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50988a2-349c-4ef2-a62b-1e386e3ab933 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:59.423738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50988a2-349c-4ef2-a62b-1e386e3ab933 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:59.458527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba7d27-5a2b-4bcb-ad97-3ead7213fd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:59.459110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eadb4-3b51-4f4c-a935-b48c8a7ea92a None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:59.459220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba7d27-5a2b-4bcb-ad97-3ead7213fd9a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:59.459474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba7d27-5a2b-4bcb-ad97-3ead7213fd9a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:59.459603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eadb4-3b51-4f4c-a935-b48c8a7ea92a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:59.459815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fba7d27-5a2b-4bcb-ad97-3ead7213fd9a None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:59.459935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eadb4-3b51-4f4c-a935-b48c8a7ea92a None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:59.460495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba7d27-5a2b-4bcb-ad97-3ead7213fd9a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:59.460807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba7d27-5a2b-4bcb-ad97-3ead7213fd9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:59.461772 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 522/1011] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:34:59.462203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fba7d27-5a2b-4bcb-ad97-3ead7213fd9a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:59.467232 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 490/1012] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:34:59.468847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a119-5670-4b1d-b43c-1de832b40076 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:59.469200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a119-5670-4b1d-b43c-1de832b40076 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:59.469547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a119-5670-4b1d-b43c-1de832b40076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:59.473619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba7d27-5a2b-4bcb-ad97-3ead7213fd9a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:59.487367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3be2a119-5670-4b1d-b43c-1de832b40076 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:34:59.489232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3be2a119-5670-4b1d-b43c-1de832b40076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:34:59.554971 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 523/1013] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:34:59 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:34:59.572764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fba7d27-5a2b-4bcb-ad97-3ead7213fd9a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:59.579045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a119-5670-4b1d-b43c-1de832b40076 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:59.607421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd3368-ce45-4e8a-a430-88280d073342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:59.608135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd3368-ce45-4e8a-a430-88280d073342 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:59.608424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd3368-ce45-4e8a-a430-88280d073342 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:59.608699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd3368-ce45-4e8a-a430-88280d073342 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:59.609399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd3368-ce45-4e8a-a430-88280d073342 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:34:59.609705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd3368-ce45-4e8a-a430-88280d073342 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:59.611079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd3368-ce45-4e8a-a430-88280d073342 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:59.617716 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 491/1014] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Mar 26 20:34:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:34:59.623055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd3368-ce45-4e8a-a430-88280d073342 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:34:59.675996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a119-5670-4b1d-b43c-1de832b40076 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:59.709371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab69391-9d1d-435c-9f76-912bafd4ebf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:59.710124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69391-9d1d-435c-9f76-912bafd4ebf3 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:59.710412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69391-9d1d-435c-9f76-912bafd4ebf3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:59.710684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab69391-9d1d-435c-9f76-912bafd4ebf3 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:59.711398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab69391-9d1d-435c-9f76-912bafd4ebf3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:59.712975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab69391-9d1d-435c-9f76-912bafd4ebf3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:59.723239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd3368-ce45-4e8a-a430-88280d073342 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:34:59.739947 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 524/1015] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:34:59 2022] POST /identity/v3/services => generated 242 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:34:59.766358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ac9e8-8c84-4e88-9a63-b8d0126a02e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:34:59.767028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ac9e8-8c84-4e88-9a63-b8d0126a02e8 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:34:59.767325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ac9e8-8c84-4e88-9a63-b8d0126a02e8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:34:59.767604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ac9e8-8c84-4e88-9a63-b8d0126a02e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:34:59.768462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ac9e8-8c84-4e88-9a63-b8d0126a02e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:34:59.769908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ac9e8-8c84-4e88-9a63-b8d0126a02e8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:34:59.786933 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 492/1016] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Mar 26 20:34:59 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:35:01.141510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d51a-bfe4-459d-b85e-d99fb012cf83 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:01.142062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d51a-bfe4-459d-b85e-d99fb012cf83 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:01.142062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3d51a-bfe4-459d-b85e-d99fb012cf83 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:01.144586 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 525/1017] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:01.150756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b7174-8593-4174-b68d-b33e215e9fe2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:01.151138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b7174-8593-4174-b68d-b33e215e9fe2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:01.151304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b7174-8593-4174-b68d-b33e215e9fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:01.168630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7d1b7174-8593-4174-b68d-b33e215e9fe2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:01.169799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d1b7174-8593-4174-b68d-b33e215e9fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:01.240135 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 493/1018] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:01.264720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d51a-bfe4-459d-b85e-d99fb012cf83 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:01.362658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3d51a-bfe4-459d-b85e-d99fb012cf83 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:01.400139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dba95-9a04-4ffb-aa12-465ffcef2a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:01.401184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dba95-9a04-4ffb-aa12-465ffcef2a6c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:01.401687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dba95-9a04-4ffb-aa12-465ffcef2a6c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:01.402138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dba95-9a04-4ffb-aa12-465ffcef2a6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:01.412915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96dba95-9a04-4ffb-aa12-465ffcef2a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:01.421152 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f96dba95-9a04-4ffb-aa12-465ffcef2a6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 26 20:35:01.422629 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 526/1019] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Mar 26 20:35:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:01.429165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b7174-8593-4174-b68d-b33e215e9fe2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:01.525748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b7174-8593-4174-b68d-b33e215e9fe2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:01.558838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789ab7-3c87-43b2-a061-be83246cbe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:01.559512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789ab7-3c87-43b2-a061-be83246cbe1d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:01.559852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789ab7-3c87-43b2-a061-be83246cbe1d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:01.560181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34789ab7-3c87-43b2-a061-be83246cbe1d None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:01.560951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34789ab7-3c87-43b2-a061-be83246cbe1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:01.561262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34789ab7-3c87-43b2-a061-be83246cbe1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:01.562666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34789ab7-3c87-43b2-a061-be83246cbe1d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:01.575180 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 494/1020] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Mar 26 20:35:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:01.576640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dba95-9a04-4ffb-aa12-465ffcef2a6c None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:01.675592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dba95-9a04-4ffb-aa12-465ffcef2a6c None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:01.706420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd58056-1d86-47dc-9ffc-7f1ddcae6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:01.707201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd58056-1d86-47dc-9ffc-7f1ddcae6ef7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:01.707482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd58056-1d86-47dc-9ffc-7f1ddcae6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:01.707755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd58056-1d86-47dc-9ffc-7f1ddcae6ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:01.718833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd58056-1d86-47dc-9ffc-7f1ddcae6ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:01.720398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd58056-1d86-47dc-9ffc-7f1ddcae6ef7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:01.739071 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-ffd58056-1d86-47dc-9ffc-7f1ddcae6ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:35:01.740549 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 527/1021] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:01.746483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789ab7-3c87-43b2-a061-be83246cbe1d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:01.848162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34789ab7-3c87-43b2-a061-be83246cbe1d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:01.880613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af873ff4-1142-4b87-90e6-917d704e080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:01.881274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af873ff4-1142-4b87-90e6-917d704e080d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:01.881561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af873ff4-1142-4b87-90e6-917d704e080d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:01.881838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af873ff4-1142-4b87-90e6-917d704e080d None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:01.882552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af873ff4-1142-4b87-90e6-917d704e080d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:01.882859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af873ff4-1142-4b87-90e6-917d704e080d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:01.884266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af873ff4-1142-4b87-90e6-917d704e080d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:01.899981 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 495/1022] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:01.901793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd58056-1d86-47dc-9ffc-7f1ddcae6ef7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:01.998734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd58056-1d86-47dc-9ffc-7f1ddcae6ef7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.033325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f611caf4-7e7a-4902-94f8-d482ea59a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.034666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611caf4-7e7a-4902-94f8-d482ea59a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.034955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611caf4-7e7a-4902-94f8-d482ea59a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.035233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f611caf4-7e7a-4902-94f8-d482ea59a7d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.042840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611caf4-7e7a-4902-94f8-d482ea59a7d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.044318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f611caf4-7e7a-4902-94f8-d482ea59a7d3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.057439 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f611caf4-7e7a-4902-94f8-d482ea59a7d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 26 20:35:02.058777 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 528/1023] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Mar 26 20:35:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:02.064272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af873ff4-1142-4b87-90e6-917d704e080d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.106300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74e78e-bd03-4fcf-b5aa-e3ffa57b22e1 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.106632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74e78e-bd03-4fcf-b5aa-e3ffa57b22e1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.106861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74e78e-bd03-4fcf-b5aa-e3ffa57b22e1 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.108688 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 529/1024] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:35:02.115102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84df90-2f9a-46c7-a026-ec1face41de3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.115390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84df90-2f9a-46c7-a026-ec1face41de3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.115667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84df90-2f9a-46c7-a026-ec1face41de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.132018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1a84df90-2f9a-46c7-a026-ec1face41de3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:02.133188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1a84df90-2f9a-46c7-a026-ec1face41de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:02.162907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af873ff4-1142-4b87-90e6-917d704e080d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.196589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e7f70-bd31-4ee3-8b5c-6e8d7ec788a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.197263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e7f70-bd31-4ee3-8b5c-6e8d7ec788a8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.197549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e7f70-bd31-4ee3-8b5c-6e8d7ec788a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.197722 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 530/1025] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:35:02.198149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e7f70-bd31-4ee3-8b5c-6e8d7ec788a8 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.198651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e7f70-bd31-4ee3-8b5c-6e8d7ec788a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:02.198963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e7f70-bd31-4ee3-8b5c-6e8d7ec788a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.199061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f475747-7519-49b9-bf1c-0e6e6e1e0dae None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.199303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f475747-7519-49b9-bf1c-0e6e6e1e0dae None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.199580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f475747-7519-49b9-bf1c-0e6e6e1e0dae None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.200543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e7f70-bd31-4ee3-8b5c-6e8d7ec788a8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.201445 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 531/1026] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:02.208421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e55a-4a3e-437a-92c6-43187e5eb8e0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.208708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e55a-4a3e-437a-92c6-43187e5eb8e0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.208995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67e55a-4a3e-437a-92c6-43187e5eb8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.218555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 496/1027] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:02.222852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e7f70-bd31-4ee3-8b5c-6e8d7ec788a8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.227030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1b67e55a-4a3e-437a-92c6-43187e5eb8e0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:02.228243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b67e55a-4a3e-437a-92c6-43187e5eb8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:02.291546 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 532/1028] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:35:02.292231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e55a-4a3e-437a-92c6-43187e5eb8e0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.314943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e7f70-bd31-4ee3-8b5c-6e8d7ec788a8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.347806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d35b5-3c4f-48a0-b99d-4a5d861704e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.348615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d35b5-3c4f-48a0-b99d-4a5d861704e1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.348901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d35b5-3c4f-48a0-b99d-4a5d861704e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.349179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d35b5-3c4f-48a0-b99d-4a5d861704e1 None admin] PATH_INFO: `/v3/services/image` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.349819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d35b5-3c4f-48a0-b99d-4a5d861704e1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.351212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d35b5-3c4f-48a0-b99d-4a5d861704e1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.362110 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-395d35b5-3c4f-48a0-b99d-4a5d861704e1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 26 20:35:02.363296 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 497/1029] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/services/image => generated 86 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:35:02.364077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d35b5-3c4f-48a0-b99d-4a5d861704e1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.385557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67e55a-4a3e-437a-92c6-43187e5eb8e0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.417509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf926-d733-4c53-b8aa-413486ab5002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.418139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf926-d733-4c53-b8aa-413486ab5002 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.418420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf926-d733-4c53-b8aa-413486ab5002 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.418697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14edf926-d733-4c53-b8aa-413486ab5002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.460397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d35b5-3c4f-48a0-b99d-4a5d861704e1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.483586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf926-d733-4c53-b8aa-413486ab5002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.485074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14edf926-d733-4c53-b8aa-413486ab5002 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.492069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf024ef-88b3-43e0-a21e-386fec8e08f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.492855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf024ef-88b3-43e0-a21e-386fec8e08f1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.493139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf024ef-88b3-43e0-a21e-386fec8e08f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.493415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf024ef-88b3-43e0-a21e-386fec8e08f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.494586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf024ef-88b3-43e0-a21e-386fec8e08f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.496052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf024ef-88b3-43e0-a21e-386fec8e08f1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.497808 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 498/1030] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:02.498405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf024ef-88b3-43e0-a21e-386fec8e08f1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.579276 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 533/1031] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:02.580036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf926-d733-4c53-b8aa-413486ab5002 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.593477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf024ef-88b3-43e0-a21e-386fec8e08f1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.624700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619b91a-4a7d-4f4c-bb89-01ab05ec78c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.625350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619b91a-4a7d-4f4c-bb89-01ab05ec78c1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.625634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619b91a-4a7d-4f4c-bb89-01ab05ec78c1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.625914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619b91a-4a7d-4f4c-bb89-01ab05ec78c1 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.626600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619b91a-4a7d-4f4c-bb89-01ab05ec78c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:02.626906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619b91a-4a7d-4f4c-bb89-01ab05ec78c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.628825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619b91a-4a7d-4f4c-bb89-01ab05ec78c1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.633452 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 499/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:02.634209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619b91a-4a7d-4f4c-bb89-01ab05ec78c1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.674331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14edf926-d733-4c53-b8aa-413486ab5002 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.706743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa19dde-41dd-49f6-97e0-76ddeb5e3d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.707389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa19dde-41dd-49f6-97e0-76ddeb5e3d7e None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.707674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa19dde-41dd-49f6-97e0-76ddeb5e3d7e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.707981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa19dde-41dd-49f6-97e0-76ddeb5e3d7e None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.708675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa19dde-41dd-49f6-97e0-76ddeb5e3d7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.710102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa19dde-41dd-49f6-97e0-76ddeb5e3d7e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.726507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619b91a-4a7d-4f4c-bb89-01ab05ec78c1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.733941 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 534/1033] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:35:02 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:35:02.734570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa19dde-41dd-49f6-97e0-76ddeb5e3d7e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.762540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474695c-c226-4f18-baac-639ebd0d52df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.763352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474695c-c226-4f18-baac-639ebd0d52df None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.763637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474695c-c226-4f18-baac-639ebd0d52df None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.763911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474695c-c226-4f18-baac-639ebd0d52df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.775980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474695c-c226-4f18-baac-639ebd0d52df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.777500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474695c-c226-4f18-baac-639ebd0d52df None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.795112 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-5474695c-c226-4f18-baac-639ebd0d52df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:35:02.801860 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 500/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:02.802998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474695c-c226-4f18-baac-639ebd0d52df None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.840566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa19dde-41dd-49f6-97e0-76ddeb5e3d7e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.875538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2f13b-6989-4049-8260-9d18ef3e79e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.876240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2f13b-6989-4049-8260-9d18ef3e79e4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.876523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2f13b-6989-4049-8260-9d18ef3e79e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.876801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2f13b-6989-4049-8260-9d18ef3e79e4 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.877517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2f13b-6989-4049-8260-9d18ef3e79e4 None admin] RBAC: Adding query filter params (type=image) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:02.878392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2f13b-6989-4049-8260-9d18ef3e79e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.879810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca2f13b-6989-4049-8260-9d18ef3e79e4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.885363 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 535/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:02.891245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2f13b-6989-4049-8260-9d18ef3e79e4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.908393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474695c-c226-4f18-baac-639ebd0d52df None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:02.948904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5896-e209-4573-b681-aaa55892d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:02.949568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5896-e209-4573-b681-aaa55892d717 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:02.949856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5896-e209-4573-b681-aaa55892d717 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:02.950135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa5896-e209-4573-b681-aaa55892d717 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:02.950857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5896-e209-4573-b681-aaa55892d717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:02.951157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5896-e209-4573-b681-aaa55892d717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:02.952617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa5896-e209-4573-b681-aaa55892d717 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:02.966006 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 501/1036] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:02.972090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5896-e209-4573-b681-aaa55892d717 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:02.992912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2f13b-6989-4049-8260-9d18ef3e79e4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:03.032744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ec858-a2a7-401e-8a57-86a7bf8f94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:03.033392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ec858-a2a7-401e-8a57-86a7bf8f94c7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:03.033671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ec858-a2a7-401e-8a57-86a7bf8f94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:03.034477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ec858-a2a7-401e-8a57-86a7bf8f94c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:03.035291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ec858-a2a7-401e-8a57-86a7bf8f94c7 None admin] RBAC: Adding query filter params (interface=public, service_id=a17ef22263154cb1a8dda5d223d1b659, region_id=RegionOne) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:03.035604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ec858-a2a7-401e-8a57-86a7bf8f94c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:03.037020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ec858-a2a7-401e-8a57-86a7bf8f94c7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:03.041958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 536/1037] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/endpoints?service_id=a17ef22263154cb1a8dda5d223d1b659&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:03.047395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ec858-a2a7-401e-8a57-86a7bf8f94c7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:03.072741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa5896-e209-4573-b681-aaa55892d717 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:03.106942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970a0c2-7fe9-4f7b-ac9a-0de72af379b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:03.107752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970a0c2-7fe9-4f7b-ac9a-0de72af379b8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:03.108128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970a0c2-7fe9-4f7b-ac9a-0de72af379b8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:03.108472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970a0c2-7fe9-4f7b-ac9a-0de72af379b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:03.115805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970a0c2-7fe9-4f7b-ac9a-0de72af379b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:03.117411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970a0c2-7fe9-4f7b-ac9a-0de72af379b8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:03.131316 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b970a0c2-7fe9-4f7b-ac9a-0de72af379b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:35:03.132743 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 502/1038] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:35:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:35:03.138118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970a0c2-7fe9-4f7b-ac9a-0de72af379b8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:03.147679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ec858-a2a7-401e-8a57-86a7bf8f94c7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:03.179815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfc4e9-f9d3-4b18-abda-8d8ce3df7c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:03.180507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfc4e9-f9d3-4b18-abda-8d8ce3df7c1c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:03.180792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfc4e9-f9d3-4b18-abda-8d8ce3df7c1c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:03.181069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfc4e9-f9d3-4b18-abda-8d8ce3df7c1c None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:03.181744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfc4e9-f9d3-4b18-abda-8d8ce3df7c1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:03.183133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfc4e9-f9d3-4b18-abda-8d8ce3df7c1c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:03.189509 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 537/1039] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Mar 26 20:35:03 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:35:03.240319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970a0c2-7fe9-4f7b-ac9a-0de72af379b8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:03.276371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994a28e-16f2-45e8-97c0-e0458470b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:03.277038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994a28e-16f2-45e8-97c0-e0458470b88a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:03.277320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994a28e-16f2-45e8-97c0-e0458470b88a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:03.277595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994a28e-16f2-45e8-97c0-e0458470b88a None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:03.278382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994a28e-16f2-45e8-97c0-e0458470b88a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:03.278690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994a28e-16f2-45e8-97c0-e0458470b88a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:03.280203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994a28e-16f2-45e8-97c0-e0458470b88a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:03.298108 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 503/1040] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:03.299484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfc4e9-f9d3-4b18-abda-8d8ce3df7c1c None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:03.402014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfc4e9-f9d3-4b18-abda-8d8ce3df7c1c None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:03.438673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c4811-6df0-470b-a740-bfe7885dbf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:03.439319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4811-6df0-470b-a740-bfe7885dbf87 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:03.439596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4811-6df0-470b-a740-bfe7885dbf87 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:03.439865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4811-6df0-470b-a740-bfe7885dbf87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:03.440726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c4811-6df0-470b-a740-bfe7885dbf87 None admin] RBAC: Adding query filter params (role.id=f5afc4377efb41fa95dbb0a452a07110, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=07e77369a94844529947de0f46a54edd) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:03.441029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c4811-6df0-470b-a740-bfe7885dbf87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:03.442462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c4811-6df0-470b-a740-bfe7885dbf87 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:03.448207 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 538/1041] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:35:03 2022] GET /identity/v3/role_assignments?user.id=07e77369a94844529947de0f46a54edd&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=f5afc4377efb41fa95dbb0a452a07110 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:05.148447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031eeb0-ac28-4627-94af-eb8911f16b75 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:05.148987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031eeb0-ac28-4627-94af-eb8911f16b75 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:05.148987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031eeb0-ac28-4627-94af-eb8911f16b75 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:05.150909 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 504/1042] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:05.157257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e166-ad09-4441-b059-c49b715541c5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:05.157659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e166-ad09-4441-b059-c49b715541c5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:05.157819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf1e166-ad09-4441-b059-c49b715541c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:05.174197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4cf1e166-ad09-4441-b059-c49b715541c5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:05.175897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4cf1e166-ad09-4441-b059-c49b715541c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:05.243376 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 539/1043] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:05.269272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031eeb0-ac28-4627-94af-eb8911f16b75 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:05.367480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031eeb0-ac28-4627-94af-eb8911f16b75 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:05.399584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314419e-fc42-4575-b82a-db882c2de138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:05.400404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314419e-fc42-4575-b82a-db882c2de138 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:05.400688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314419e-fc42-4575-b82a-db882c2de138 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:05.400960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314419e-fc42-4575-b82a-db882c2de138 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:05.402130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314419e-fc42-4575-b82a-db882c2de138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:05.403591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b314419e-fc42-4575-b82a-db882c2de138 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:05.405422 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 505/1044] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:05.411633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1e166-ad09-4441-b059-c49b715541c5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:05.520907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf1e166-ad09-4441-b059-c49b715541c5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:05.557941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93bef0-2842-40aa-8f5a-cee0dbc380e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:05.558982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93bef0-2842-40aa-8f5a-cee0dbc380e3 None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:05.559461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93bef0-2842-40aa-8f5a-cee0dbc380e3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:05.559970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93bef0-2842-40aa-8f5a-cee0dbc380e3 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:05.560870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93bef0-2842-40aa-8f5a-cee0dbc380e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:05.562503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93bef0-2842-40aa-8f5a-cee0dbc380e3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:05.583287 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 540/1045] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:35:05 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:35:05.598561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c00e38-2c4f-4db0-99f5-9af9c23294fb None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:05.598917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c00e38-2c4f-4db0-99f5-9af9c23294fb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:05.599120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c00e38-2c4f-4db0-99f5-9af9c23294fb None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:05.601187 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 506/1046] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:05.608501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b0b86-278b-4fb3-8313-2b0d6fb1609f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:05.608930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b0b86-278b-4fb3-8313-2b0d6fb1609f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:05.609331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b0b86-278b-4fb3-8313-2b0d6fb1609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:05.627398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bd0b0b86-278b-4fb3-8313-2b0d6fb1609f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:05.629236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bd0b0b86-278b-4fb3-8313-2b0d6fb1609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:05.699956 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 541/1047] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:35:05.725645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c00e38-2c4f-4db0-99f5-9af9c23294fb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:05.807833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f95c2-50ce-48a8-b1e5-f9c8340a5769 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:05.808153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f95c2-50ce-48a8-b1e5-f9c8340a5769 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:05.808429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f95c2-50ce-48a8-b1e5-f9c8340a5769 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:05.810160 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 542/1048] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:35:05.817271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce551c-ea80-4e7b-aacd-66bf5721bd6c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:05.817560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce551c-ea80-4e7b-aacd-66bf5721bd6c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:05.817837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce551c-ea80-4e7b-aacd-66bf5721bd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:05.835510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4bce551c-ea80-4e7b-aacd-66bf5721bd6c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:05.836878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4bce551c-ea80-4e7b-aacd-66bf5721bd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:05.837352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c00e38-2c4f-4db0-99f5-9af9c23294fb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:05.870957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ce359-2413-4803-9d64-0be0e07b6a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:05.871805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ce359-2413-4803-9d64-0be0e07b6a22 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:05.872116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ce359-2413-4803-9d64-0be0e07b6a22 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:05.872506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ce359-2413-4803-9d64-0be0e07b6a22 None admin] PATH_INFO: `/v3/services/image` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:05.873146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ce359-2413-4803-9d64-0be0e07b6a22 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:05.874514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ce359-2413-4803-9d64-0be0e07b6a22 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:05.885748 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-661ce359-2413-4803-9d64-0be0e07b6a22 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 26 20:35:05.887013 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 507/1049] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Mar 26 20:35:05 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:05.892741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ce359-2413-4803-9d64-0be0e07b6a22 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:05.902463 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 543/1050] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:35:05.928016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce551c-ea80-4e7b-aacd-66bf5721bd6c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:05.990366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ce359-2413-4803-9d64-0be0e07b6a22 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:06.027871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce551c-ea80-4e7b-aacd-66bf5721bd6c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:06.029107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13661cfd-d2f5-4859-9aec-19099162e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:06.029767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13661cfd-d2f5-4859-9aec-19099162e9ed None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:06.030049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13661cfd-d2f5-4859-9aec-19099162e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:06.030323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13661cfd-d2f5-4859-9aec-19099162e9ed None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:06.031123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13661cfd-d2f5-4859-9aec-19099162e9ed None admin] RBAC: Adding query filter params (name=image) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:06.031433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13661cfd-d2f5-4859-9aec-19099162e9ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:06.032846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13661cfd-d2f5-4859-9aec-19099162e9ed None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:06.042823 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 508/1051] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:06.043608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13661cfd-d2f5-4859-9aec-19099162e9ed None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:06.062460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7af51-5b40-47a0-9412-c90916ffebd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:06.063352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7af51-5b40-47a0-9412-c90916ffebd1 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:06.063637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7af51-5b40-47a0-9412-c90916ffebd1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:06.063911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7af51-5b40-47a0-9412-c90916ffebd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:06.075229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7af51-5b40-47a0-9412-c90916ffebd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:06.083365 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-94a7af51-5b40-47a0-9412-c90916ffebd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 26 20:35:06.084733 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 544/1052] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Mar 26 20:35:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:06.090453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7af51-5b40-47a0-9412-c90916ffebd1 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:06.142515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13661cfd-d2f5-4859-9aec-19099162e9ed None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:06.175109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86911d0f-5b18-4332-bdba-755a9974c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:06.175817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911d0f-5b18-4332-bdba-755a9974c271 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:06.176078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911d0f-5b18-4332-bdba-755a9974c271 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:06.176358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86911d0f-5b18-4332-bdba-755a9974c271 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:06.177055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911d0f-5b18-4332-bdba-755a9974c271 None admin] RBAC: Adding query filter params (type=image) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:06.177365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911d0f-5b18-4332-bdba-755a9974c271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:06.178742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86911d0f-5b18-4332-bdba-755a9974c271 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:06.183353 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 509/1053] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:06.188857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86911d0f-5b18-4332-bdba-755a9974c271 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:06.195174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7af51-5b40-47a0-9412-c90916ffebd1 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:06.227843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891007f-ef4b-49d9-afc7-73f5b6841383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:06.228532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891007f-ef4b-49d9-afc7-73f5b6841383 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:06.228816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891007f-ef4b-49d9-afc7-73f5b6841383 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:06.229095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891007f-ef4b-49d9-afc7-73f5b6841383 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:06.229826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891007f-ef4b-49d9-afc7-73f5b6841383 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:06.230134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891007f-ef4b-49d9-afc7-73f5b6841383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:06.231502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891007f-ef4b-49d9-afc7-73f5b6841383 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:06.239853 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 545/1054] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Mar 26 20:35:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:06.245430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891007f-ef4b-49d9-afc7-73f5b6841383 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:06.287330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86911d0f-5b18-4332-bdba-755a9974c271 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:06.321772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b559e9-e4e8-4356-8b89-84c1a295670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:06.322297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b559e9-e4e8-4356-8b89-84c1a295670a None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:06.322576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b559e9-e4e8-4356-8b89-84c1a295670a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:06.322847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b559e9-e4e8-4356-8b89-84c1a295670a None admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:06.323576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b559e9-e4e8-4356-8b89-84c1a295670a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:06.324990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b559e9-e4e8-4356-8b89-84c1a295670a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:06.340858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891007f-ef4b-49d9-afc7-73f5b6841383 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:06.355944 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 510/1055] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Mar 26 20:35:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:35:06.384166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5afddf-5c99-4b64-bf21-a48ebd6fb79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:06.384979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afddf-5c99-4b64-bf21-a48ebd6fb79d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:06.385264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afddf-5c99-4b64-bf21-a48ebd6fb79d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:06.385542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afddf-5c99-4b64-bf21-a48ebd6fb79d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:06.398413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5afddf-5c99-4b64-bf21-a48ebd6fb79d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:06.400043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5afddf-5c99-4b64-bf21-a48ebd6fb79d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:06.418513 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2d5afddf-5c99-4b64-bf21-a48ebd6fb79d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:35:06.419997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 546/1056] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:35:06.426339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b559e9-e4e8-4356-8b89-84c1a295670a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:06.534792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b559e9-e4e8-4356-8b89-84c1a295670a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:06.568266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5707747-d6dc-4154-a638-6474385d0975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:06.568926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5707747-d6dc-4154-a638-6474385d0975 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:06.569215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5707747-d6dc-4154-a638-6474385d0975 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:06.569469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5707747-d6dc-4154-a638-6474385d0975 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:06.570171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5707747-d6dc-4154-a638-6474385d0975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:06.570470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5707747-d6dc-4154-a638-6474385d0975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:06.571832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5707747-d6dc-4154-a638-6474385d0975 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:06.584359 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 511/1057] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:06.590136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5afddf-5c99-4b64-bf21-a48ebd6fb79d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:06.687737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5afddf-5c99-4b64-bf21-a48ebd6fb79d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:06.719889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e93c3-3a54-458b-b434-e52eb0743f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:06.720702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e93c3-3a54-458b-b434-e52eb0743f1e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:06.720985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e93c3-3a54-458b-b434-e52eb0743f1e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:06.721888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e93c3-3a54-458b-b434-e52eb0743f1e None admin] PATH_INFO: `/v3/users/nova` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:06.729279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e93c3-3a54-458b-b434-e52eb0743f1e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:06.730720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e93c3-3a54-458b-b434-e52eb0743f1e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:06.743566 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f81e93c3-3a54-458b-b434-e52eb0743f1e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 26 20:35:06.744919 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 547/1058] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Mar 26 20:35:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:06.750534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5707747-d6dc-4154-a638-6474385d0975 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:06.847401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5707747-d6dc-4154-a638-6474385d0975 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:06.880325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d080-cf84-4ed0-b82b-c6d973574924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:06.880990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d080-cf84-4ed0-b82b-c6d973574924 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:06.881268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d080-cf84-4ed0-b82b-c6d973574924 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:06.881538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d080-cf84-4ed0-b82b-c6d973574924 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:06.882359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d080-cf84-4ed0-b82b-c6d973574924 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:06.882666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d080-cf84-4ed0-b82b-c6d973574924 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:06.884126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d080-cf84-4ed0-b82b-c6d973574924 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:06.905778 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 512/1059] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Mar 26 20:35:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:06.906906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e93c3-3a54-458b-b434-e52eb0743f1e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:06.999547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e93c3-3a54-458b-b434-e52eb0743f1e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:07.032305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f824f-4d3d-44cb-9796-a36b7c1ae381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:07.033119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f824f-4d3d-44cb-9796-a36b7c1ae381 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:07.033401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f824f-4d3d-44cb-9796-a36b7c1ae381 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:07.033702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f824f-4d3d-44cb-9796-a36b7c1ae381 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:07.044372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f824f-4d3d-44cb-9796-a36b7c1ae381 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:07.045833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f824f-4d3d-44cb-9796-a36b7c1ae381 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:07.061585 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-8f2f824f-4d3d-44cb-9796-a36b7c1ae381 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:35:07.062917 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 548/1060] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:35:07.068812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d080-cf84-4ed0-b82b-c6d973574924 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:07.164196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d080-cf84-4ed0-b82b-c6d973574924 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:07.197521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520d9e-8bc5-46a1-ab36-7ce3ed478960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:07.198168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520d9e-8bc5-46a1-ab36-7ce3ed478960 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:07.198458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520d9e-8bc5-46a1-ab36-7ce3ed478960 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:07.198736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520d9e-8bc5-46a1-ab36-7ce3ed478960 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:07.199448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520d9e-8bc5-46a1-ab36-7ce3ed478960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:07.199755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520d9e-8bc5-46a1-ab36-7ce3ed478960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:07.201189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a520d9e-8bc5-46a1-ab36-7ce3ed478960 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:07.212368 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 513/1061] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:07.218071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f824f-4d3d-44cb-9796-a36b7c1ae381 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:07.437747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f824f-4d3d-44cb-9796-a36b7c1ae381 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:07.471978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db2427-21c4-4457-ba56-09fb98252536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:07.472761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db2427-21c4-4457-ba56-09fb98252536 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:07.473037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db2427-21c4-4457-ba56-09fb98252536 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:07.473302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db2427-21c4-4457-ba56-09fb98252536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:07.480267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db2427-21c4-4457-ba56-09fb98252536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:07.481701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db2427-21c4-4457-ba56-09fb98252536 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:07.494797 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-44db2427-21c4-4457-ba56-09fb98252536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:35:07.496213 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 549/1062] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:35:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:07.501679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520d9e-8bc5-46a1-ab36-7ce3ed478960 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:07.601163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a520d9e-8bc5-46a1-ab36-7ce3ed478960 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:07.633332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47e122-6179-4305-aa4d-1c3eb065c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:07.634008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47e122-6179-4305-aa4d-1c3eb065c454 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:07.634287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47e122-6179-4305-aa4d-1c3eb065c454 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:07.634548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47e122-6179-4305-aa4d-1c3eb065c454 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:07.635347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47e122-6179-4305-aa4d-1c3eb065c454 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:07.635656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47e122-6179-4305-aa4d-1c3eb065c454 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:07.637201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47e122-6179-4305-aa4d-1c3eb065c454 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:07.650827 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 514/1063] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:35:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:07.656923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db2427-21c4-4457-ba56-09fb98252536 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:07.758417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db2427-21c4-4457-ba56-09fb98252536 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:07.792403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efe479-5338-4789-b4f9-98059c4758d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:07.793574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe479-5338-4789-b4f9-98059c4758d6 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:07.794056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe479-5338-4789-b4f9-98059c4758d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:07.794564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe479-5338-4789-b4f9-98059c4758d6 None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/07e77369a94844529947de0f46a54edd/roles/f5afc4377efb41fa95dbb0a452a07110` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:07.797018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efe479-5338-4789-b4f9-98059c4758d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=07e77369a94844529947de0f46a54edd, role_id=f5afc4377efb41fa95dbb0a452a07110)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:07.798697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efe479-5338-4789-b4f9-98059c4758d6 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:07.812701 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 550/1064] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:35:07 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/07e77369a94844529947de0f46a54edd/roles/f5afc4377efb41fa95dbb0a452a07110 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:35:08.023952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96660ba3-2c81-4def-a1cb-38754f8f24d6 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:08.024260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96660ba3-2c81-4def-a1cb-38754f8f24d6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:08.024539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96660ba3-2c81-4def-a1cb-38754f8f24d6 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:08.026495 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 515/1065] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:08.032964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0736d-ca98-4dd7-85fc-c11c297b53c7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:08.033252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0736d-ca98-4dd7-85fc-c11c297b53c7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:08.033527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0736d-ca98-4dd7-85fc-c11c297b53c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:08.050903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-31a0736d-ca98-4dd7-85fc-c11c297b53c7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:08.052107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-31a0736d-ca98-4dd7-85fc-c11c297b53c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:08.115463 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 551/1066] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:08.140302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96660ba3-2c81-4def-a1cb-38754f8f24d6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:08.238041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96660ba3-2c81-4def-a1cb-38754f8f24d6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:08.270657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6633e1-a831-4f19-bab4-577213edad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:08.271441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6633e1-a831-4f19-bab4-577213edad04 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:08.271721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6633e1-a831-4f19-bab4-577213edad04 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:08.272020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6633e1-a831-4f19-bab4-577213edad04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:08.281832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6633e1-a831-4f19-bab4-577213edad04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:08.289071 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-bf6633e1-a831-4f19-bab4-577213edad04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:35:08.290448 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 516/1067] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:08.296132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0736d-ca98-4dd7-85fc-c11c297b53c7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:08.394031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0736d-ca98-4dd7-85fc-c11c297b53c7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:08.426424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608b3ef-eba1-45e8-97d5-dec6d31302d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:08.427084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608b3ef-eba1-45e8-97d5-dec6d31302d7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:08.427363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608b3ef-eba1-45e8-97d5-dec6d31302d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:08.427634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608b3ef-eba1-45e8-97d5-dec6d31302d7 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:08.428413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608b3ef-eba1-45e8-97d5-dec6d31302d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:08.428715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608b3ef-eba1-45e8-97d5-dec6d31302d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:08.430077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608b3ef-eba1-45e8-97d5-dec6d31302d7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:08.437916 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 552/1068] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:35:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:08.444143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6633e1-a831-4f19-bab4-577213edad04 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:08.545097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6633e1-a831-4f19-bab4-577213edad04 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:08.577227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036dac1a-978b-41b6-bb2f-1af171816b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:08.578093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dac1a-978b-41b6-bb2f-1af171816b2b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:08.578386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dac1a-978b-41b6-bb2f-1af171816b2b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:08.578663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036dac1a-978b-41b6-bb2f-1af171816b2b None admin] PATH_INFO: `/v3/users/669a2e83382247bdbde5eeb74b7333c7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:08.593478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dac1a-978b-41b6-bb2f-1af171816b2b None admin] RBAC: Authorizing `identity:get_user(user_id=669a2e83382247bdbde5eeb74b7333c7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:08.594957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036dac1a-978b-41b6-bb2f-1af171816b2b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:08.599948 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 517/1069] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:08 2022] GET /identity/v3/users/669a2e83382247bdbde5eeb74b7333c7 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:08.602564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608b3ef-eba1-45e8-97d5-dec6d31302d7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:08.699352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608b3ef-eba1-45e8-97d5-dec6d31302d7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:08.730821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fde16-dc91-437e-9631-212f8d814b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:08.731470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fde16-dc91-437e-9631-212f8d814b52 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:08.731752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fde16-dc91-437e-9631-212f8d814b52 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:08.732068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fde16-dc91-437e-9631-212f8d814b52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:08.741489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc83a32-a49a-44b1-b96b-630c7570e694 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:08.741773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc83a32-a49a-44b1-b96b-630c7570e694 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:08.742059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc83a32-a49a-44b1-b96b-630c7570e694 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:08.743877 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 518/1070] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:35:08.750271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cbe95-fbcb-492f-94d4-8c085f6ce035 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:08.750557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cbe95-fbcb-492f-94d4-8c085f6ce035 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:08.750834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94cbe95-fbcb-492f-94d4-8c085f6ce035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:08.767536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d94cbe95-fbcb-492f-94d4-8c085f6ce035 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:08.768747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d94cbe95-fbcb-492f-94d4-8c085f6ce035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:08.798488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fde16-dc91-437e-9631-212f8d814b52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:08.800767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fde16-dc91-437e-9631-212f8d814b52 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:08.834089 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 519/1071] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:35:08.857565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cbe95-fbcb-492f-94d4-8c085f6ce035 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:08.897423 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 553/1072] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:08.902957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fde16-dc91-437e-9631-212f8d814b52 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:08.956470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94cbe95-fbcb-492f-94d4-8c085f6ce035 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:08.990861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749f397-27c9-41b0-bc42-b5f1f89e0e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:08.991530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f397-27c9-41b0-bc42-b5f1f89e0e3d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:08.991812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f397-27c9-41b0-bc42-b5f1f89e0e3d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:08.992121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f397-27c9-41b0-bc42-b5f1f89e0e3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:09.000878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fde16-dc91-437e-9631-212f8d814b52 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:09.035942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b4130-42b9-46c8-99a1-16067d6a3314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:09.037043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b4130-42b9-46c8-99a1-16067d6a3314 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:09.037523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b4130-42b9-46c8-99a1-16067d6a3314 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:09.037977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b4130-42b9-46c8-99a1-16067d6a3314 None admin] PATH_INFO: `/v3/projects/fde392c5248b4def8bf5442d93c2b694` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:09.039336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b4130-42b9-46c8-99a1-16067d6a3314 None admin] RBAC: Authorizing `identity:get_project(project_id=fde392c5248b4def8bf5442d93c2b694)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:09.040995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b4130-42b9-46c8-99a1-16067d6a3314 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:09.042848 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 554/1073] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:08 2022] GET /identity/v3/projects/fde392c5248b4def8bf5442d93c2b694 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:09.048760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b4130-42b9-46c8-99a1-16067d6a3314 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:09.067189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749f397-27c9-41b0-bc42-b5f1f89e0e3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:09.068680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749f397-27c9-41b0-bc42-b5f1f89e0e3d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:09.145562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b4130-42b9-46c8-99a1-16067d6a3314 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:09.167131 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 520/1074] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 26 20:35:09.168324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749f397-27c9-41b0-bc42-b5f1f89e0e3d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:09.177201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96143b3e-292f-4403-ba72-29d3a44fe654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:09.177836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143b3e-292f-4403-ba72-29d3a44fe654 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:09.178113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143b3e-292f-4403-ba72-29d3a44fe654 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:09.178385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143b3e-292f-4403-ba72-29d3a44fe654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:09.179183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96143b3e-292f-4403-ba72-29d3a44fe654 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=fde392c5248b4def8bf5442d93c2b694, user.id=669a2e83382247bdbde5eeb74b7333c7) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:09.179490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96143b3e-292f-4403-ba72-29d3a44fe654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:09.180931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96143b3e-292f-4403-ba72-29d3a44fe654 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:09.196184 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 555/1075] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:35:09 2022] GET /identity/v3/role_assignments?user.id=669a2e83382247bdbde5eeb74b7333c7&scope.project.id=fde392c5248b4def8bf5442d93c2b694&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:09.269395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749f397-27c9-41b0-bc42-b5f1f89e0e3d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:09.306618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d09f5d-b30e-4a68-b8cc-f928618c4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:09.307338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d09f5d-b30e-4a68-b8cc-f928618c4d88 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:09.307619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d09f5d-b30e-4a68-b8cc-f928618c4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:09.307890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d09f5d-b30e-4a68-b8cc-f928618c4d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:09.319304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d09f5d-b30e-4a68-b8cc-f928618c4d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:09.320846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d09f5d-b30e-4a68-b8cc-f928618c4d88 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:09.339298 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-15d09f5d-b30e-4a68-b8cc-f928618c4d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:35:09.346288 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 521/1076] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:35:09.348024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96143b3e-292f-4403-ba72-29d3a44fe654 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:09.445381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96143b3e-292f-4403-ba72-29d3a44fe654 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:09.478780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05545b86-5a87-4fd9-9a6b-c32867e3d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:09.479525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05545b86-5a87-4fd9-9a6b-c32867e3d4fe None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:09.479814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05545b86-5a87-4fd9-9a6b-c32867e3d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:09.480120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05545b86-5a87-4fd9-9a6b-c32867e3d4fe None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:09.480833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05545b86-5a87-4fd9-9a6b-c32867e3d4fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:09.481149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05545b86-5a87-4fd9-9a6b-c32867e3d4fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:09.482503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05545b86-5a87-4fd9-9a6b-c32867e3d4fe None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:09.494287 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 556/1077] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:10.196104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324e3f-9728-42c3-9b89-8ecea1eaf393 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:10.196391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324e3f-9728-42c3-9b89-8ecea1eaf393 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:10.196670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a324e3f-9728-42c3-9b89-8ecea1eaf393 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:10.198454 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 522/1078] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:10.204890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a108d4-8ce4-498b-927e-54a05139b55b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:10.205186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a108d4-8ce4-498b-927e-54a05139b55b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:10.205962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a108d4-8ce4-498b-927e-54a05139b55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:10.223817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b9a108d4-8ce4-498b-927e-54a05139b55b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:10.225020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b9a108d4-8ce4-498b-927e-54a05139b55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:10.288569 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 557/1079] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:10.313384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324e3f-9728-42c3-9b89-8ecea1eaf393 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:10.411366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a324e3f-9728-42c3-9b89-8ecea1eaf393 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:10.443436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0b605-f6e7-4266-ad30-8897e5a7402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:10.444265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0b605-f6e7-4266-ad30-8897e5a7402a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:10.444547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0b605-f6e7-4266-ad30-8897e5a7402a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:10.444820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0b605-f6e7-4266-ad30-8897e5a7402a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:10.454385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0b605-f6e7-4266-ad30-8897e5a7402a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:10.462187 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-a5e0b605-f6e7-4266-ad30-8897e5a7402a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 26 20:35:10.463355 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 523/1080] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Mar 26 20:35:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:10.469657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a108d4-8ce4-498b-927e-54a05139b55b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:10.562129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a108d4-8ce4-498b-927e-54a05139b55b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:10.594259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30dbeb-e779-4dae-b044-e1de2b27b705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:10.594916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30dbeb-e779-4dae-b044-e1de2b27b705 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:10.595198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30dbeb-e779-4dae-b044-e1de2b27b705 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:10.595473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30dbeb-e779-4dae-b044-e1de2b27b705 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:10.596285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30dbeb-e779-4dae-b044-e1de2b27b705 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:10.596588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30dbeb-e779-4dae-b044-e1de2b27b705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:10.597948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30dbeb-e779-4dae-b044-e1de2b27b705 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:10.605432 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 558/1081] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Mar 26 20:35:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:10.611023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0b605-f6e7-4266-ad30-8897e5a7402a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:10.706370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0b605-f6e7-4266-ad30-8897e5a7402a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:10.737882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668c04e-fed6-46b8-867b-c56d4561c071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:10.738657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668c04e-fed6-46b8-867b-c56d4561c071 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:10.738945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668c04e-fed6-46b8-867b-c56d4561c071 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:10.739215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c668c04e-fed6-46b8-867b-c56d4561c071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:10.749362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668c04e-fed6-46b8-867b-c56d4561c071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:10.750809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c668c04e-fed6-46b8-867b-c56d4561c071 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:10.767069 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-c668c04e-fed6-46b8-867b-c56d4561c071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:35:10.768870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 524/1082] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:35:10.774443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30dbeb-e779-4dae-b044-e1de2b27b705 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:10.868269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30dbeb-e779-4dae-b044-e1de2b27b705 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:10.900104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60b395-4242-4a5d-9c2f-3e0d871b73d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:10.900757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60b395-4242-4a5d-9c2f-3e0d871b73d6 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:10.901039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60b395-4242-4a5d-9c2f-3e0d871b73d6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:10.901313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e60b395-4242-4a5d-9c2f-3e0d871b73d6 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:10.902019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60b395-4242-4a5d-9c2f-3e0d871b73d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:10.902323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60b395-4242-4a5d-9c2f-3e0d871b73d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:10.903689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e60b395-4242-4a5d-9c2f-3e0d871b73d6 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:10.914910 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 559/1083] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:35:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:10.920527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668c04e-fed6-46b8-867b-c56d4561c071 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:11.016307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c668c04e-fed6-46b8-867b-c56d4561c071 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:11.049213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f3a83-cc27-4eef-82eb-dbd374517fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:11.050002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f3a83-cc27-4eef-82eb-dbd374517fff None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.050283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f3a83-cc27-4eef-82eb-dbd374517fff None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.050557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f3a83-cc27-4eef-82eb-dbd374517fff None admin] PATH_INFO: `/v3/users/nova` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.057839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f3a83-cc27-4eef-82eb-dbd374517fff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:11.059289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944f3a83-cc27-4eef-82eb-dbd374517fff None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:11.072021 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-944f3a83-cc27-4eef-82eb-dbd374517fff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 26 20:35:11.073175 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 525/1084] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Mar 26 20:35:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:11.078842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60b395-4242-4a5d-9c2f-3e0d871b73d6 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:11.177288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e60b395-4242-4a5d-9c2f-3e0d871b73d6 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:11.209667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f181abd-5f07-466c-89fe-d75635fd0b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:11.210326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f181abd-5f07-466c-89fe-d75635fd0b35 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.210609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f181abd-5f07-466c-89fe-d75635fd0b35 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.210884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f181abd-5f07-466c-89fe-d75635fd0b35 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.211703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f181abd-5f07-466c-89fe-d75635fd0b35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:11.212051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f181abd-5f07-466c-89fe-d75635fd0b35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:11.213475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f181abd-5f07-466c-89fe-d75635fd0b35 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:11.230605 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 560/1085] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Mar 26 20:35:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:11.236285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f3a83-cc27-4eef-82eb-dbd374517fff None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:11.332247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f3a83-cc27-4eef-82eb-dbd374517fff None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:11.367312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d85979-fa63-4bde-906f-619c0d5c683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:11.367981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d85979-fa63-4bde-906f-619c0d5c683b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.368274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d85979-fa63-4bde-906f-619c0d5c683b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.368553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d85979-fa63-4bde-906f-619c0d5c683b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.437207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d85979-fa63-4bde-906f-619c0d5c683b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:11.438601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d85979-fa63-4bde-906f-619c0d5c683b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:11.506568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683016e-edc6-4b81-8635-4d6581e224db None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.507117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683016e-edc6-4b81-8635-4d6581e224db None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.507117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683016e-edc6-4b81-8635-4d6581e224db None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.508880 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 561/1086] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:35:11.515481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65926cc2-1cd1-41db-93e5-c3fd6b50ef38 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.515763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65926cc2-1cd1-41db-93e5-c3fd6b50ef38 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.516075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65926cc2-1cd1-41db-93e5-c3fd6b50ef38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.532505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-65926cc2-1cd1-41db-93e5-c3fd6b50ef38 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:11.533684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65926cc2-1cd1-41db-93e5-c3fd6b50ef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:11.533911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 526/1087] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:11.539414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d85979-fa63-4bde-906f-619c0d5c683b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:11.597296 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 562/1088] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:11.620988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65926cc2-1cd1-41db-93e5-c3fd6b50ef38 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:11.632076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d85979-fa63-4bde-906f-619c0d5c683b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:11.663836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1052ee1-73ba-498f-82b4-9b02184221eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:11.664639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052ee1-73ba-498f-82b4-9b02184221eb None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.664918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052ee1-73ba-498f-82b4-9b02184221eb None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.665191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1052ee1-73ba-498f-82b4-9b02184221eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.675082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052ee1-73ba-498f-82b4-9b02184221eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:11.676573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1052ee1-73ba-498f-82b4-9b02184221eb None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:11.693416 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-f1052ee1-73ba-498f-82b4-9b02184221eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:35:11.694516 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 527/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:35:11.700039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1052ee1-73ba-498f-82b4-9b02184221eb None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:11.713913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65926cc2-1cd1-41db-93e5-c3fd6b50ef38 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:11.745851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6103e-b36a-4511-87e3-1fa24a4f0737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:11.746622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6103e-b36a-4511-87e3-1fa24a4f0737 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.746898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6103e-b36a-4511-87e3-1fa24a4f0737 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.747170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6103e-b36a-4511-87e3-1fa24a4f0737 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.757374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6103e-b36a-4511-87e3-1fa24a4f0737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:11.764135 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-5fb6103e-b36a-4511-87e3-1fa24a4f0737 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:35:11.765284 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 563/1090] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:35:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:35:11.771145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6103e-b36a-4511-87e3-1fa24a4f0737 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:11.792816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1052ee1-73ba-498f-82b4-9b02184221eb None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:11.825887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04929dd-fb5b-4476-8987-d4877f64013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:11.826520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04929dd-fb5b-4476-8987-d4877f64013a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.826806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04929dd-fb5b-4476-8987-d4877f64013a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.827083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04929dd-fb5b-4476-8987-d4877f64013a None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.827795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04929dd-fb5b-4476-8987-d4877f64013a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:11.828135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04929dd-fb5b-4476-8987-d4877f64013a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:11.829509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04929dd-fb5b-4476-8987-d4877f64013a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:11.840199 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 528/1091] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:11.845812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04929dd-fb5b-4476-8987-d4877f64013a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:11.863053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6103e-b36a-4511-87e3-1fa24a4f0737 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:11.894470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b8810-de50-425f-8833-63f01bb5b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:11.895122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b8810-de50-425f-8833-63f01bb5b887 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.895405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b8810-de50-425f-8833-63f01bb5b887 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.895681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b8810-de50-425f-8833-63f01bb5b887 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.896449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b8810-de50-425f-8833-63f01bb5b887 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:11.896754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b8810-de50-425f-8833-63f01bb5b887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:11.898111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b8810-de50-425f-8833-63f01bb5b887 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:11.905790 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 564/1092] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:35:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:11.911546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b8810-de50-425f-8833-63f01bb5b887 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:11.939130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04929dd-fb5b-4476-8987-d4877f64013a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:11.971668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a66e6-a2a1-48cf-a185-bfb54158996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:11.972416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a66e6-a2a1-48cf-a185-bfb54158996d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:11.972702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a66e6-a2a1-48cf-a185-bfb54158996d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:11.972977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a66e6-a2a1-48cf-a185-bfb54158996d None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:11.979501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a66e6-a2a1-48cf-a185-bfb54158996d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:11.981006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a66e6-a2a1-48cf-a185-bfb54158996d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:11.994395 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-6b1a66e6-a2a1-48cf-a185-bfb54158996d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:35:11.995541 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 529/1093] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:35:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:35:12.001084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a66e6-a2a1-48cf-a185-bfb54158996d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:12.004361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b8810-de50-425f-8833-63f01bb5b887 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:12.037309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945320f0-3a05-4bd0-88da-ac9c0fedaa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:12.038166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945320f0-3a05-4bd0-88da-ac9c0fedaa71 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:12.038447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945320f0-3a05-4bd0-88da-ac9c0fedaa71 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:12.038723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945320f0-3a05-4bd0-88da-ac9c0fedaa71 None admin] PATH_INFO: `/v3/users/669a2e83382247bdbde5eeb74b7333c7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:12.039901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945320f0-3a05-4bd0-88da-ac9c0fedaa71 None admin] RBAC: Authorizing `identity:get_user(user_id=669a2e83382247bdbde5eeb74b7333c7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:12.041363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945320f0-3a05-4bd0-88da-ac9c0fedaa71 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:12.042958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 565/1094] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:11 2022] GET /identity/v3/users/669a2e83382247bdbde5eeb74b7333c7 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:12.048716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945320f0-3a05-4bd0-88da-ac9c0fedaa71 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:12.095631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a66e6-a2a1-48cf-a185-bfb54158996d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:12.128095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da50953-7d4e-4d48-a6c4-7283dc57a0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:12.128739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da50953-7d4e-4d48-a6c4-7283dc57a0ef None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:12.129051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da50953-7d4e-4d48-a6c4-7283dc57a0ef None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:12.129326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da50953-7d4e-4d48-a6c4-7283dc57a0ef None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:12.130099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da50953-7d4e-4d48-a6c4-7283dc57a0ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:12.130407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da50953-7d4e-4d48-a6c4-7283dc57a0ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:12.131851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da50953-7d4e-4d48-a6c4-7283dc57a0ef None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:12.141065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945320f0-3a05-4bd0-88da-ac9c0fedaa71 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:12.142704 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 530/1095] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:12.148583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da50953-7d4e-4d48-a6c4-7283dc57a0ef None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:12.173102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d18493-8164-4444-82ff-aaf6bf7b84b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:12.173949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d18493-8164-4444-82ff-aaf6bf7b84b6 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:12.174780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d18493-8164-4444-82ff-aaf6bf7b84b6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:12.175059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d18493-8164-4444-82ff-aaf6bf7b84b6 None admin] PATH_INFO: `/v3/projects/fde392c5248b4def8bf5442d93c2b694` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:12.176257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d18493-8164-4444-82ff-aaf6bf7b84b6 None admin] RBAC: Authorizing `identity:get_project(project_id=fde392c5248b4def8bf5442d93c2b694)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:12.177681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d18493-8164-4444-82ff-aaf6bf7b84b6 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:12.179314 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 566/1096] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:12 2022] GET /identity/v3/projects/fde392c5248b4def8bf5442d93c2b694 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:12.185066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d18493-8164-4444-82ff-aaf6bf7b84b6 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:12.241612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da50953-7d4e-4d48-a6c4-7283dc57a0ef None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:12.272372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c8197-3542-4339-8b14-24681f58f866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:12.273001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c8197-3542-4339-8b14-24681f58f866 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:12.273287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c8197-3542-4339-8b14-24681f58f866 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:12.273558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c8197-3542-4339-8b14-24681f58f866 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:12.274369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c8197-3542-4339-8b14-24681f58f866 None admin] RBAC: Adding query filter params (role.id=f5afc4377efb41fa95dbb0a452a07110, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=07e77369a94844529947de0f46a54edd) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:12.274677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c8197-3542-4339-8b14-24681f58f866 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:12.276120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c8197-3542-4339-8b14-24681f58f866 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:12.276643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d18493-8164-4444-82ff-aaf6bf7b84b6 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:12.281788 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 531/1097] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:35:12 2022] GET /identity/v3/role_assignments?user.id=07e77369a94844529947de0f46a54edd&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=f5afc4377efb41fa95dbb0a452a07110 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:12.310813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19620f-e941-4dc3-88c9-4df9e5f8b3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:12.311716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19620f-e941-4dc3-88c9-4df9e5f8b3e1 None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:12.312035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19620f-e941-4dc3-88c9-4df9e5f8b3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:12.312315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19620f-e941-4dc3-88c9-4df9e5f8b3e1 None admin] PATH_INFO: `/v3/projects/fde392c5248b4def8bf5442d93c2b694/users/669a2e83382247bdbde5eeb74b7333c7/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:12.314403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19620f-e941-4dc3-88c9-4df9e5f8b3e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=fde392c5248b4def8bf5442d93c2b694, user_id=669a2e83382247bdbde5eeb74b7333c7, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:12.315991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19620f-e941-4dc3-88c9-4df9e5f8b3e1 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:12.329686 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 567/1098] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:35:12 2022] PUT /identity/v3/projects/fde392c5248b4def8bf5442d93c2b694/users/669a2e83382247bdbde5eeb74b7333c7/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:35:14.654854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416996da-3604-4781-b2fd-e47dcf9d0e9c None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:14.655406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416996da-3604-4781-b2fd-e47dcf9d0e9c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:14.655406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416996da-3604-4781-b2fd-e47dcf9d0e9c None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:14.657221 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 532/1099] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:14.663527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52df6-42f9-46fb-be6d-7a4997ed3e06 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:14.663987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52df6-42f9-46fb-be6d-7a4997ed3e06 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:14.664118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb52df6-42f9-46fb-be6d-7a4997ed3e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:14.680807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bcb52df6-42f9-46fb-be6d-7a4997ed3e06 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:14.681974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bcb52df6-42f9-46fb-be6d-7a4997ed3e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:14.743939 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 568/1100] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:14.768580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416996da-3604-4781-b2fd-e47dcf9d0e9c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:14.864446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416996da-3604-4781-b2fd-e47dcf9d0e9c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:14.895888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41244394-eac4-44bd-a97b-a491664da614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:14.896694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41244394-eac4-44bd-a97b-a491664da614 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:14.896977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41244394-eac4-44bd-a97b-a491664da614 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:14.897252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41244394-eac4-44bd-a97b-a491664da614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:14.907319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41244394-eac4-44bd-a97b-a491664da614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:14.914081 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-41244394-eac4-44bd-a97b-a491664da614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:35:14.915233 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 533/1101] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:14.921150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52df6-42f9-46fb-be6d-7a4997ed3e06 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:15.014037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb52df6-42f9-46fb-be6d-7a4997ed3e06 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:15.046390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed3ab3-2dcc-411a-a9a7-5a30b8ab8f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:15.047032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3ab3-2dcc-411a-a9a7-5a30b8ab8f87 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:15.047310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3ab3-2dcc-411a-a9a7-5a30b8ab8f87 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:15.047582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3ab3-2dcc-411a-a9a7-5a30b8ab8f87 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:15.048343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed3ab3-2dcc-411a-a9a7-5a30b8ab8f87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:15.048644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed3ab3-2dcc-411a-a9a7-5a30b8ab8f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:15.050027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed3ab3-2dcc-411a-a9a7-5a30b8ab8f87 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:15.057831 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 569/1102] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:15.063582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41244394-eac4-44bd-a97b-a491664da614 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:15.156960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41244394-eac4-44bd-a97b-a491664da614 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:15.188083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad325cd-7234-4eb6-b2d1-68217cda09b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:15.188959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad325cd-7234-4eb6-b2d1-68217cda09b9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:15.189245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad325cd-7234-4eb6-b2d1-68217cda09b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:15.190010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad325cd-7234-4eb6-b2d1-68217cda09b9 None admin] PATH_INFO: `/v3/users/669a2e83382247bdbde5eeb74b7333c7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:15.191186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad325cd-7234-4eb6-b2d1-68217cda09b9 None admin] RBAC: Authorizing `identity:get_user(user_id=669a2e83382247bdbde5eeb74b7333c7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:15.192669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad325cd-7234-4eb6-b2d1-68217cda09b9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:15.194253 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 534/1103] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:15 2022] GET /identity/v3/users/669a2e83382247bdbde5eeb74b7333c7 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:15.199691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed3ab3-2dcc-411a-a9a7-5a30b8ab8f87 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:15.292285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed3ab3-2dcc-411a-a9a7-5a30b8ab8f87 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:15.323130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e6b7b-435d-4aee-9e4e-0a193003ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:15.323745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6b7b-435d-4aee-9e4e-0a193003ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:15.324056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6b7b-435d-4aee-9e4e-0a193003ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:15.324332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e6b7b-435d-4aee-9e4e-0a193003ccb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:15.387120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e6b7b-435d-4aee-9e4e-0a193003ccb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:15.388577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e6b7b-435d-4aee-9e4e-0a193003ccb4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:15.481278 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 570/1104] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:15.487048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad325cd-7234-4eb6-b2d1-68217cda09b9 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:15.579100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad325cd-7234-4eb6-b2d1-68217cda09b9 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:15.611055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb8bef-c89c-4736-b490-c9f13657df65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:15.611909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb8bef-c89c-4736-b490-c9f13657df65 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:15.612216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb8bef-c89c-4736-b490-c9f13657df65 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:15.612490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb8bef-c89c-4736-b490-c9f13657df65 None admin] PATH_INFO: `/v3/projects/fde392c5248b4def8bf5442d93c2b694` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:15.613635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb8bef-c89c-4736-b490-c9f13657df65 None admin] RBAC: Authorizing `identity:get_project(project_id=fde392c5248b4def8bf5442d93c2b694)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:15.615061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb8bef-c89c-4736-b490-c9f13657df65 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:15.616725 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 535/1105] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:15 2022] GET /identity/v3/projects/fde392c5248b4def8bf5442d93c2b694 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:15.622751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e6b7b-435d-4aee-9e4e-0a193003ccb4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:15.714158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e6b7b-435d-4aee-9e4e-0a193003ccb4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:15.746092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35fb4c-0e5f-49f4-ab1e-7ffa6bdf01ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:15.746663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fb4c-0e5f-49f4-ab1e-7ffa6bdf01ee None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:15.746943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fb4c-0e5f-49f4-ab1e-7ffa6bdf01ee None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:15.747215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35fb4c-0e5f-49f4-ab1e-7ffa6bdf01ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:15.748051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35fb4c-0e5f-49f4-ab1e-7ffa6bdf01ee None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=fde392c5248b4def8bf5442d93c2b694, user.id=669a2e83382247bdbde5eeb74b7333c7) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:15.748359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35fb4c-0e5f-49f4-ab1e-7ffa6bdf01ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:15.749769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35fb4c-0e5f-49f4-ab1e-7ffa6bdf01ee None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:15.755253 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 571/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:35:15 2022] GET /identity/v3/role_assignments?user.id=669a2e83382247bdbde5eeb74b7333c7&scope.project.id=fde392c5248b4def8bf5442d93c2b694&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:18.123161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d879522-4f4f-4440-a39d-8dd64f70345e None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:18.123668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d879522-4f4f-4440-a39d-8dd64f70345e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:18.123780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d879522-4f4f-4440-a39d-8dd64f70345e None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:18.125502 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 536/1107] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:18.132357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6029f6-44cb-4d4d-822c-188979b8eeb1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:18.132861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6029f6-44cb-4d4d-822c-188979b8eeb1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:18.132963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6029f6-44cb-4d4d-822c-188979b8eeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:18.149700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ce6029f6-44cb-4d4d-822c-188979b8eeb1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:18.150868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce6029f6-44cb-4d4d-822c-188979b8eeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:18.212259 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 572/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:18.237430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d879522-4f4f-4440-a39d-8dd64f70345e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:18.334029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d879522-4f4f-4440-a39d-8dd64f70345e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:18.365880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c6dc7-207b-49de-83ca-f9aac277d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:18.366634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6dc7-207b-49de-83ca-f9aac277d15e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:18.366912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6dc7-207b-49de-83ca-f9aac277d15e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:18.367179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c6dc7-207b-49de-83ca-f9aac277d15e None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:18.368343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c6dc7-207b-49de-83ca-f9aac277d15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:18.369765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c6dc7-207b-49de-83ca-f9aac277d15e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:18.371308 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 537/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:18.377376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6029f6-44cb-4d4d-822c-188979b8eeb1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:18.470486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6029f6-44cb-4d4d-822c-188979b8eeb1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:18.503551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88e483-c3b2-4878-a614-22b88252d96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:18.504224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e483-c3b2-4878-a614-22b88252d96a None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:18.504508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e483-c3b2-4878-a614-22b88252d96a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:18.504784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88e483-c3b2-4878-a614-22b88252d96a None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:18.505473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88e483-c3b2-4878-a614-22b88252d96a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:18.506904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88e483-c3b2-4878-a614-22b88252d96a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:18.525444 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 573/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:35:18 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:35:20.872390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7a2a5-7fe1-43dd-8b5e-ce29649c05e6 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:20.872952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7a2a5-7fe1-43dd-8b5e-ce29649c05e6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:20.872952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7a2a5-7fe1-43dd-8b5e-ce29649c05e6 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:20.874701 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 538/1111] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:20.881493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ab438-2f5c-4b86-976e-7de3a11f08de None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:20.881890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ab438-2f5c-4b86-976e-7de3a11f08de None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:20.882037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ab438-2f5c-4b86-976e-7de3a11f08de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:20.898096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ba4ab438-2f5c-4b86-976e-7de3a11f08de None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:20.899248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ba4ab438-2f5c-4b86-976e-7de3a11f08de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:20.959908 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 574/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:20.983804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7a2a5-7fe1-43dd-8b5e-ce29649c05e6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:21.080971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7a2a5-7fe1-43dd-8b5e-ce29649c05e6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:21.112091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9ade6-f9da-4afa-862d-cce96c1a50c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:21.112916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ade6-f9da-4afa-862d-cce96c1a50c5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:21.113193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ade6-f9da-4afa-862d-cce96c1a50c5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:21.113460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9ade6-f9da-4afa-862d-cce96c1a50c5 None admin] PATH_INFO: `/v3/roles/e875b4dda15a40c6aa7d8d75c96b3597` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:21.114893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9ade6-f9da-4afa-862d-cce96c1a50c5 None admin] RBAC: Authorizing `identity:get_role(role_id=e875b4dda15a40c6aa7d8d75c96b3597)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:21.116298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9ade6-f9da-4afa-862d-cce96c1a50c5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:21.117627 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 539/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:20 2022] GET /identity/v3/roles/e875b4dda15a40c6aa7d8d75c96b3597 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:21.123398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ab438-2f5c-4b86-976e-7de3a11f08de None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:21.215605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ab438-2f5c-4b86-976e-7de3a11f08de None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:21.247810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38f82-a9d3-4765-97d9-b28d8f7e8b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:21.248678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38f82-a9d3-4765-97d9-b28d8f7e8b5d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:21.248959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38f82-a9d3-4765-97d9-b28d8f7e8b5d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:21.249233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b38f82-a9d3-4765-97d9-b28d8f7e8b5d None admin] PATH_INFO: `/v3/users/c14ee5658cc44001b3ec926d0c7d08f8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:21.261280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b38f82-a9d3-4765-97d9-b28d8f7e8b5d None admin] RBAC: Authorizing `identity:get_user(user_id=c14ee5658cc44001b3ec926d0c7d08f8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:21.262709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b38f82-a9d3-4765-97d9-b28d8f7e8b5d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:21.264315 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 575/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:21 2022] GET /identity/v3/users/c14ee5658cc44001b3ec926d0c7d08f8 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:21.269698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9ade6-f9da-4afa-862d-cce96c1a50c5 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:21.362218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9ade6-f9da-4afa-862d-cce96c1a50c5 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:21.393420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d44c-1c9e-4bff-9bf8-d64a15b8d943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:21.393965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d44c-1c9e-4bff-9bf8-d64a15b8d943 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:21.394247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d44c-1c9e-4bff-9bf8-d64a15b8d943 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:21.394521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7d44c-1c9e-4bff-9bf8-d64a15b8d943 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:21.458460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7d44c-1c9e-4bff-9bf8-d64a15b8d943 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:21.459907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7d44c-1c9e-4bff-9bf8-d64a15b8d943 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:21.551380 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 540/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:21.557177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38f82-a9d3-4765-97d9-b28d8f7e8b5d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:21.650499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b38f82-a9d3-4765-97d9-b28d8f7e8b5d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:21.682203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d92457-6e34-4d37-b682-99910d1f66d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:21.683035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d92457-6e34-4d37-b682-99910d1f66d7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:21.683319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d92457-6e34-4d37-b682-99910d1f66d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:21.683596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d92457-6e34-4d37-b682-99910d1f66d7 None admin] PATH_INFO: `/v3/projects/fde392c5248b4def8bf5442d93c2b694` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:21.684781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d92457-6e34-4d37-b682-99910d1f66d7 None admin] RBAC: Authorizing `identity:get_project(project_id=fde392c5248b4def8bf5442d93c2b694)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:21.686201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d92457-6e34-4d37-b682-99910d1f66d7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:21.687823 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 576/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:21 2022] GET /identity/v3/projects/fde392c5248b4def8bf5442d93c2b694 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:21.693913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d44c-1c9e-4bff-9bf8-d64a15b8d943 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:21.786424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7d44c-1c9e-4bff-9bf8-d64a15b8d943 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:21.818317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324318d1-01b7-4861-a401-afcc22d723c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:21.818949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324318d1-01b7-4861-a401-afcc22d723c3 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:21.819233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324318d1-01b7-4861-a401-afcc22d723c3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:21.819511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324318d1-01b7-4861-a401-afcc22d723c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:21.820347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324318d1-01b7-4861-a401-afcc22d723c3 None admin] RBAC: Adding query filter params (role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=fde392c5248b4def8bf5442d93c2b694, user.id=c14ee5658cc44001b3ec926d0c7d08f8) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:21.820659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324318d1-01b7-4861-a401-afcc22d723c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:21.822078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324318d1-01b7-4861-a401-afcc22d723c3 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:21.827161 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 541/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:35:21 2022] GET /identity/v3/role_assignments?user.id=c14ee5658cc44001b3ec926d0c7d08f8&scope.project.id=fde392c5248b4def8bf5442d93c2b694&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:24.127531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b6d7c-759c-44a6-91a9-86bd7b8eeee5 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:24.128063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b6d7c-759c-44a6-91a9-86bd7b8eeee5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:24.128169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b6d7c-759c-44a6-91a9-86bd7b8eeee5 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:24.129859 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 577/1118] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:24.136010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106aad-01e3-4ad6-ad84-4f74e46555cf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:24.136442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106aad-01e3-4ad6-ad84-4f74e46555cf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:24.136568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98106aad-01e3-4ad6-ad84-4f74e46555cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:24.153662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-98106aad-01e3-4ad6-ad84-4f74e46555cf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:24.154836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-98106aad-01e3-4ad6-ad84-4f74e46555cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:24.216484 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 542/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:24.241148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b6d7c-759c-44a6-91a9-86bd7b8eeee5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:24.333675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b6d7c-759c-44a6-91a9-86bd7b8eeee5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:24.365519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db6741-0e54-40c5-a8ff-d2d7035ddc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:24.366338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db6741-0e54-40c5-a8ff-d2d7035ddc84 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:24.366612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db6741-0e54-40c5-a8ff-d2d7035ddc84 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:24.366877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db6741-0e54-40c5-a8ff-d2d7035ddc84 None admin] PATH_INFO: `/v3/roles/e875b4dda15a40c6aa7d8d75c96b3597` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:24.368337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db6741-0e54-40c5-a8ff-d2d7035ddc84 None admin] RBAC: Authorizing `identity:get_role(role_id=e875b4dda15a40c6aa7d8d75c96b3597)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:24.369696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db6741-0e54-40c5-a8ff-d2d7035ddc84 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:24.370986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 578/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:24 2022] GET /identity/v3/roles/e875b4dda15a40c6aa7d8d75c96b3597 => generated 223 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:24.376703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98106aad-01e3-4ad6-ad84-4f74e46555cf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:24.471142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98106aad-01e3-4ad6-ad84-4f74e46555cf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:24.502630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0196ea-e685-48a8-af21-ceee3b1e1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:24.503482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0196ea-e685-48a8-af21-ceee3b1e1f91 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:24.503765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0196ea-e685-48a8-af21-ceee3b1e1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:24.504075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0196ea-e685-48a8-af21-ceee3b1e1f91 None admin] PATH_INFO: `/v3/users/c14ee5658cc44001b3ec926d0c7d08f8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:24.505253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0196ea-e685-48a8-af21-ceee3b1e1f91 None admin] RBAC: Authorizing `identity:get_user(user_id=c14ee5658cc44001b3ec926d0c7d08f8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:24.506731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0196ea-e685-48a8-af21-ceee3b1e1f91 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:24.508375 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 543/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:24 2022] GET /identity/v3/users/c14ee5658cc44001b3ec926d0c7d08f8 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:24.514022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db6741-0e54-40c5-a8ff-d2d7035ddc84 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:24.606887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db6741-0e54-40c5-a8ff-d2d7035ddc84 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:24.637551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51e2e8-1845-4ac3-b27c-cf5690390c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:24.638372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51e2e8-1845-4ac3-b27c-cf5690390c4b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:24.638650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51e2e8-1845-4ac3-b27c-cf5690390c4b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:24.638921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51e2e8-1845-4ac3-b27c-cf5690390c4b None admin] PATH_INFO: `/v3/projects/fde392c5248b4def8bf5442d93c2b694` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:24.640087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51e2e8-1845-4ac3-b27c-cf5690390c4b None admin] RBAC: Authorizing `identity:get_project(project_id=fde392c5248b4def8bf5442d93c2b694)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:24.641501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51e2e8-1845-4ac3-b27c-cf5690390c4b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:24.643637 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 579/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:24 2022] GET /identity/v3/projects/fde392c5248b4def8bf5442d93c2b694 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:24.649323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0196ea-e685-48a8-af21-ceee3b1e1f91 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:24.742648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0196ea-e685-48a8-af21-ceee3b1e1f91 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:24.773980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e8257-c2f1-44e2-81b5-e21cd37486cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:24.774838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8257-c2f1-44e2-81b5-e21cd37486cb None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:24.775116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8257-c2f1-44e2-81b5-e21cd37486cb None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:24.775390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8257-c2f1-44e2-81b5-e21cd37486cb None admin] PATH_INFO: `/v3/projects/fde392c5248b4def8bf5442d93c2b694/users/c14ee5658cc44001b3ec926d0c7d08f8/roles/e875b4dda15a40c6aa7d8d75c96b3597` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:24.777536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e8257-c2f1-44e2-81b5-e21cd37486cb None admin] RBAC: Authorizing `identity:create_grant(project_id=fde392c5248b4def8bf5442d93c2b694, user_id=c14ee5658cc44001b3ec926d0c7d08f8, role_id=e875b4dda15a40c6aa7d8d75c96b3597)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:24.778957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e8257-c2f1-44e2-81b5-e21cd37486cb None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:24.791575 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 544/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:35:24 2022] PUT /identity/v3/projects/fde392c5248b4def8bf5442d93c2b694/users/c14ee5658cc44001b3ec926d0c7d08f8/roles/e875b4dda15a40c6aa7d8d75c96b3597 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:35:27.087553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2a826-2d82-4d75-821f-8a001e3ed0d8 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:27.088075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2a826-2d82-4d75-821f-8a001e3ed0d8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:27.088180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2a826-2d82-4d75-821f-8a001e3ed0d8 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:27.089867 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 580/1124] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:27.096757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4251fff-cfdf-49f8-af8b-98f3b70c4181 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:27.097345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4251fff-cfdf-49f8-af8b-98f3b70c4181 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:27.097630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4251fff-cfdf-49f8-af8b-98f3b70c4181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:27.114593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f4251fff-cfdf-49f8-af8b-98f3b70c4181 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:27.115809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f4251fff-cfdf-49f8-af8b-98f3b70c4181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:27.177548 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 545/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:27.202188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2a826-2d82-4d75-821f-8a001e3ed0d8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:27.296424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2a826-2d82-4d75-821f-8a001e3ed0d8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:27.327501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f782616-6725-48c3-b828-0ac489860f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:27.328343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f782616-6725-48c3-b828-0ac489860f5e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:27.328620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f782616-6725-48c3-b828-0ac489860f5e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:27.328889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f782616-6725-48c3-b828-0ac489860f5e None admin] PATH_INFO: `/v3/roles/e875b4dda15a40c6aa7d8d75c96b3597` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:27.330831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f782616-6725-48c3-b828-0ac489860f5e None admin] RBAC: Authorizing `identity:get_role(role_id=e875b4dda15a40c6aa7d8d75c96b3597)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:27.332213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f782616-6725-48c3-b828-0ac489860f5e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:27.333502 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 581/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:27 2022] GET /identity/v3/roles/e875b4dda15a40c6aa7d8d75c96b3597 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:27.339009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4251fff-cfdf-49f8-af8b-98f3b70c4181 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:27.434515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4251fff-cfdf-49f8-af8b-98f3b70c4181 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:27.467210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aacbe1-ef05-4f84-a633-6ed4894fb182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:27.468096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aacbe1-ef05-4f84-a633-6ed4894fb182 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:27.468379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aacbe1-ef05-4f84-a633-6ed4894fb182 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:27.468656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aacbe1-ef05-4f84-a633-6ed4894fb182 None admin] PATH_INFO: `/v3/users/c14ee5658cc44001b3ec926d0c7d08f8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:27.469829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aacbe1-ef05-4f84-a633-6ed4894fb182 None admin] RBAC: Authorizing `identity:get_user(user_id=c14ee5658cc44001b3ec926d0c7d08f8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:27.471839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aacbe1-ef05-4f84-a633-6ed4894fb182 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:27.473468 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 546/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:27 2022] GET /identity/v3/users/c14ee5658cc44001b3ec926d0c7d08f8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:27.479269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f782616-6725-48c3-b828-0ac489860f5e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:27.569438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f782616-6725-48c3-b828-0ac489860f5e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:27.601756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3a8b8-f122-420c-9e9c-a7a38648c1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:27.602378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3a8b8-f122-420c-9e9c-a7a38648c1f2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:27.602661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3a8b8-f122-420c-9e9c-a7a38648c1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:27.602940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3a8b8-f122-420c-9e9c-a7a38648c1f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:27.664654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3a8b8-f122-420c-9e9c-a7a38648c1f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:27.666084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3a8b8-f122-420c-9e9c-a7a38648c1f2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:27.757687 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 582/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:27.763504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aacbe1-ef05-4f84-a633-6ed4894fb182 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:27.857127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aacbe1-ef05-4f84-a633-6ed4894fb182 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:27.888743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82336b-0025-4a8b-9845-346af2e5e1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:27.889576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82336b-0025-4a8b-9845-346af2e5e1a4 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:27.889857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82336b-0025-4a8b-9845-346af2e5e1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:27.890138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82336b-0025-4a8b-9845-346af2e5e1a4 None admin] PATH_INFO: `/v3/projects/fde392c5248b4def8bf5442d93c2b694` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:27.891292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82336b-0025-4a8b-9845-346af2e5e1a4 None admin] RBAC: Authorizing `identity:get_project(project_id=fde392c5248b4def8bf5442d93c2b694)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:27.892785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82336b-0025-4a8b-9845-346af2e5e1a4 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:27.894427 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 547/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:27 2022] GET /identity/v3/projects/fde392c5248b4def8bf5442d93c2b694 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:27.900280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3a8b8-f122-420c-9e9c-a7a38648c1f2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:27.992064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3a8b8-f122-420c-9e9c-a7a38648c1f2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:28.024024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35083449-a08b-431c-9bbb-e72bfeaf0110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:28.024664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35083449-a08b-431c-9bbb-e72bfeaf0110 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:28.024942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35083449-a08b-431c-9bbb-e72bfeaf0110 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:28.025216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35083449-a08b-431c-9bbb-e72bfeaf0110 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:28.026015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35083449-a08b-431c-9bbb-e72bfeaf0110 None admin] RBAC: Adding query filter params (role.id=e875b4dda15a40c6aa7d8d75c96b3597, scope.project.id=fde392c5248b4def8bf5442d93c2b694, user.id=c14ee5658cc44001b3ec926d0c7d08f8) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:28.026319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35083449-a08b-431c-9bbb-e72bfeaf0110 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:28.027742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35083449-a08b-431c-9bbb-e72bfeaf0110 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:28.033784 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 583/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:35:27 2022] GET /identity/v3/role_assignments?user.id=c14ee5658cc44001b3ec926d0c7d08f8&scope.project.id=fde392c5248b4def8bf5442d93c2b694&role.id=e875b4dda15a40c6aa7d8d75c96b3597 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:30.385753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b953-164b-4034-9f8d-6f47fb3dd0d5 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:30.386255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b953-164b-4034-9f8d-6f47fb3dd0d5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:30.386255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b953-164b-4034-9f8d-6f47fb3dd0d5 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:30.388042 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 548/1131] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:30.394329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f296a-4731-4fca-83bb-7507a2c2a635 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:30.394753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f296a-4731-4fca-83bb-7507a2c2a635 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:30.394880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f296a-4731-4fca-83bb-7507a2c2a635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:30.411639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-123f296a-4731-4fca-83bb-7507a2c2a635 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:30.412830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-123f296a-4731-4fca-83bb-7507a2c2a635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:30.476676 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 584/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:30.501361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59b953-164b-4034-9f8d-6f47fb3dd0d5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:30.597270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59b953-164b-4034-9f8d-6f47fb3dd0d5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:30.628570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f471d5c-35a9-4902-96e4-9c563ba35c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:30.629332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471d5c-35a9-4902-96e4-9c563ba35c72 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:30.629614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471d5c-35a9-4902-96e4-9c563ba35c72 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:30.629888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f471d5c-35a9-4902-96e4-9c563ba35c72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:30.631046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f471d5c-35a9-4902-96e4-9c563ba35c72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:30.632507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f471d5c-35a9-4902-96e4-9c563ba35c72 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:30.634069 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 549/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:30.639717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f296a-4731-4fca-83bb-7507a2c2a635 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:30.730720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f296a-4731-4fca-83bb-7507a2c2a635 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:30.762236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac7347-6776-494c-9245-57c9a89cda7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:30.762870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac7347-6776-494c-9245-57c9a89cda7f None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:30.763148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac7347-6776-494c-9245-57c9a89cda7f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:30.763447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac7347-6776-494c-9245-57c9a89cda7f None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:30.764165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac7347-6776-494c-9245-57c9a89cda7f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:30.765581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac7347-6776-494c-9245-57c9a89cda7f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:30.790340 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 585/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:35:30 2022] POST /identity/v3/projects => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:35:33.153365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1c84-164b-4bad-ab03-c4706b334a33 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:33.153913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1c84-164b-4bad-ab03-c4706b334a33 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:33.153913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1c84-164b-4bad-ab03-c4706b334a33 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:33.155691 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 550/1135] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:33.162666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ca31d-053e-4495-8e8b-6b845a85f018 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:33.163052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ca31d-053e-4495-8e8b-6b845a85f018 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:33.163217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ca31d-053e-4495-8e8b-6b845a85f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:33.180105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-de9ca31d-053e-4495-8e8b-6b845a85f018 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:33.181260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-de9ca31d-053e-4495-8e8b-6b845a85f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:33.243296 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 586/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:35:33.269598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1c84-164b-4bad-ab03-c4706b334a33 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:33.365364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1c84-164b-4bad-ab03-c4706b334a33 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:33.400946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733348be-7dc8-4007-b159-c8e8f33cbfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:33.401720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733348be-7dc8-4007-b159-c8e8f33cbfa5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:33.402002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733348be-7dc8-4007-b159-c8e8f33cbfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:33.402280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733348be-7dc8-4007-b159-c8e8f33cbfa5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:33.403435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733348be-7dc8-4007-b159-c8e8f33cbfa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:33.404923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733348be-7dc8-4007-b159-c8e8f33cbfa5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:33.406513 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 551/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:35:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:33.412202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ca31d-053e-4495-8e8b-6b845a85f018 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:33.505893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ca31d-053e-4495-8e8b-6b845a85f018 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:33.537448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9f094-b593-436d-81a4-22e747881d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:33.538094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9f094-b593-436d-81a4-22e747881d1e None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:33.538370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9f094-b593-436d-81a4-22e747881d1e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:33.538641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9f094-b593-436d-81a4-22e747881d1e None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:33.539332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9f094-b593-436d-81a4-22e747881d1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:33.540786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb9f094-b593-436d-81a4-22e747881d1e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:33.559221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 587/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:35:33 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:35:35.925840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93138e-7403-4f6c-bf0f-0e72191767d5 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:35.926393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93138e-7403-4f6c-bf0f-0e72191767d5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:35.926393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93138e-7403-4f6c-bf0f-0e72191767d5 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:35.928188 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 552/1139] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:35.934530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4c177-d1b6-4cda-a0ac-94b37e3c9c23 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:35.934928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4c177-d1b6-4cda-a0ac-94b37e3c9c23 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:35.935083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4c177-d1b6-4cda-a0ac-94b37e3c9c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:35.951423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-22a4c177-d1b6-4cda-a0ac-94b37e3c9c23 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:35.952628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-22a4c177-d1b6-4cda-a0ac-94b37e3c9c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:36.014906 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 588/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:36.040111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93138e-7403-4f6c-bf0f-0e72191767d5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:36.134935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93138e-7403-4f6c-bf0f-0e72191767d5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:36.166624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307caa6-b1ef-4c08-aa63-e9c5b34f4f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:36.167389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307caa6-b1ef-4c08-aa63-e9c5b34f4f90 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:36.167671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307caa6-b1ef-4c08-aa63-e9c5b34f4f90 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:36.168074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307caa6-b1ef-4c08-aa63-e9c5b34f4f90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:36.177601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307caa6-b1ef-4c08-aa63-e9c5b34f4f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:36.184297 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d307caa6-b1ef-4c08-aa63-e9c5b34f4f90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:35:36.185432 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 553/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:36.191772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4c177-d1b6-4cda-a0ac-94b37e3c9c23 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:36.284408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4c177-d1b6-4cda-a0ac-94b37e3c9c23 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:36.316089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4e792-9953-4048-ad43-28da6dabf05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:36.316727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e792-9953-4048-ad43-28da6dabf05a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:36.317003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e792-9953-4048-ad43-28da6dabf05a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:36.317271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4e792-9953-4048-ad43-28da6dabf05a None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:36.317991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4e792-9953-4048-ad43-28da6dabf05a None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:36.318309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4e792-9953-4048-ad43-28da6dabf05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:36.319691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4e792-9953-4048-ad43-28da6dabf05a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:36.327158 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 589/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:36.333503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307caa6-b1ef-4c08-aa63-e9c5b34f4f90 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:36.427150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307caa6-b1ef-4c08-aa63-e9c5b34f4f90 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:36.459012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ad63-6dfe-4f04-8340-d93790d01bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:36.459814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ad63-6dfe-4f04-8340-d93790d01bff None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:36.460131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ad63-6dfe-4f04-8340-d93790d01bff None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:36.460404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ad63-6dfe-4f04-8340-d93790d01bff None admin] PATH_INFO: `/v3/users/60547adafd3344a584ca10758e3c6074` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:36.473160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51ad63-6dfe-4f04-8340-d93790d01bff None admin] RBAC: Authorizing `identity:get_user(user_id=60547adafd3344a584ca10758e3c6074)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:36.474616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51ad63-6dfe-4f04-8340-d93790d01bff None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:36.476269 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 554/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:36 2022] GET /identity/v3/users/60547adafd3344a584ca10758e3c6074 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:36.481975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4e792-9953-4048-ad43-28da6dabf05a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:36.576043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4e792-9953-4048-ad43-28da6dabf05a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:36.606825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91dbcb-9b07-4c4a-a1f8-d977598ce928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:36.607451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91dbcb-9b07-4c4a-a1f8-d977598ce928 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:36.607734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91dbcb-9b07-4c4a-a1f8-d977598ce928 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:36.608040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91dbcb-9b07-4c4a-a1f8-d977598ce928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:36.669907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91dbcb-9b07-4c4a-a1f8-d977598ce928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:36.671350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91dbcb-9b07-4c4a-a1f8-d977598ce928 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:36.763568 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 590/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:36.769570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ad63-6dfe-4f04-8340-d93790d01bff None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:36.864223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51ad63-6dfe-4f04-8340-d93790d01bff None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:36.895989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ea9a1-45f4-4d73-8257-ec39cf33641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:36.896829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ea9a1-45f4-4d73-8257-ec39cf33641f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:36.897119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ea9a1-45f4-4d73-8257-ec39cf33641f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:36.897393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ea9a1-45f4-4d73-8257-ec39cf33641f None admin] PATH_INFO: `/v3/projects/8a3def2723f948ad9d96912e465a42df` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:36.898563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ea9a1-45f4-4d73-8257-ec39cf33641f None admin] RBAC: Authorizing `identity:get_project(project_id=8a3def2723f948ad9d96912e465a42df)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:36.900043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ea9a1-45f4-4d73-8257-ec39cf33641f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:36.901687 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 555/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:36 2022] GET /identity/v3/projects/8a3def2723f948ad9d96912e465a42df => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:36.908091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91dbcb-9b07-4c4a-a1f8-d977598ce928 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:37.000338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91dbcb-9b07-4c4a-a1f8-d977598ce928 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:37.032604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5cf16a-581e-47d3-82f5-4278a5c9628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:37.033248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cf16a-581e-47d3-82f5-4278a5c9628c None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:37.033532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cf16a-581e-47d3-82f5-4278a5c9628c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:37.033811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5cf16a-581e-47d3-82f5-4278a5c9628c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:37.034621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cf16a-581e-47d3-82f5-4278a5c9628c None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=8a3def2723f948ad9d96912e465a42df, user.id=60547adafd3344a584ca10758e3c6074) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:37.034929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cf16a-581e-47d3-82f5-4278a5c9628c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:37.036390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5cf16a-581e-47d3-82f5-4278a5c9628c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:37.041589 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 591/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:35:36 2022] GET /identity/v3/role_assignments?user.id=60547adafd3344a584ca10758e3c6074&scope.project.id=8a3def2723f948ad9d96912e465a42df&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:39.339042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bc550-09c1-47a3-bbcc-1a9d6d76c902 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:39.339538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bc550-09c1-47a3-bbcc-1a9d6d76c902 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:39.339538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8bc550-09c1-47a3-bbcc-1a9d6d76c902 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:39.341335 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 556/1147] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:39.347757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5b625-1417-4429-92bb-dd5b38f8cf3d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:39.348177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5b625-1417-4429-92bb-dd5b38f8cf3d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:39.348351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5b625-1417-4429-92bb-dd5b38f8cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:39.364607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-23f5b625-1417-4429-92bb-dd5b38f8cf3d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:39.365763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-23f5b625-1417-4429-92bb-dd5b38f8cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:39.428162 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 592/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:39.452193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bc550-09c1-47a3-bbcc-1a9d6d76c902 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:39.547298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8bc550-09c1-47a3-bbcc-1a9d6d76c902 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:39.579054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149b1ea-ce57-446f-9e8d-11013af2ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:39.579822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b1ea-ce57-446f-9e8d-11013af2ea88 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:39.580128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b1ea-ce57-446f-9e8d-11013af2ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:39.580395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149b1ea-ce57-446f-9e8d-11013af2ea88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:39.589869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149b1ea-ce57-446f-9e8d-11013af2ea88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:39.596817 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-4149b1ea-ce57-446f-9e8d-11013af2ea88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:35:39.597958 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 557/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:35:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:39.603878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5b625-1417-4429-92bb-dd5b38f8cf3d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:39.695602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5b625-1417-4429-92bb-dd5b38f8cf3d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:39.726650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e9444-3ef6-47ec-b275-da77f9ef59b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:39.727289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9444-3ef6-47ec-b275-da77f9ef59b7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:39.727572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9444-3ef6-47ec-b275-da77f9ef59b7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:39.727847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9444-3ef6-47ec-b275-da77f9ef59b7 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:39.728601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9444-3ef6-47ec-b275-da77f9ef59b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:39.728906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9444-3ef6-47ec-b275-da77f9ef59b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:39.730271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e9444-3ef6-47ec-b275-da77f9ef59b7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:39.738272 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 593/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:35:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:39.743753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149b1ea-ce57-446f-9e8d-11013af2ea88 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:39.838478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149b1ea-ce57-446f-9e8d-11013af2ea88 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:39.869165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669fc3d-77fe-4bea-9ca4-b51a9f0f8912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:39.869934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669fc3d-77fe-4bea-9ca4-b51a9f0f8912 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:39.870209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669fc3d-77fe-4bea-9ca4-b51a9f0f8912 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:39.870477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669fc3d-77fe-4bea-9ca4-b51a9f0f8912 None admin] PATH_INFO: `/v3/users/60547adafd3344a584ca10758e3c6074` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:39.871626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669fc3d-77fe-4bea-9ca4-b51a9f0f8912 None admin] RBAC: Authorizing `identity:get_user(user_id=60547adafd3344a584ca10758e3c6074)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:39.873098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669fc3d-77fe-4bea-9ca4-b51a9f0f8912 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:39.875005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 558/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:39 2022] GET /identity/v3/users/60547adafd3344a584ca10758e3c6074 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:39.881019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e9444-3ef6-47ec-b275-da77f9ef59b7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:39.974261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e9444-3ef6-47ec-b275-da77f9ef59b7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:40.007468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a77469-b3a1-4f48-ba99-0545bc245d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:40.008348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a77469-b3a1-4f48-ba99-0545bc245d72 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:40.008627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a77469-b3a1-4f48-ba99-0545bc245d72 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:40.008901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a77469-b3a1-4f48-ba99-0545bc245d72 None admin] PATH_INFO: `/v3/projects/8a3def2723f948ad9d96912e465a42df` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:40.010074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a77469-b3a1-4f48-ba99-0545bc245d72 None admin] RBAC: Authorizing `identity:get_project(project_id=8a3def2723f948ad9d96912e465a42df)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:40.011521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a77469-b3a1-4f48-ba99-0545bc245d72 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:40.013209 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 594/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:39 2022] GET /identity/v3/projects/8a3def2723f948ad9d96912e465a42df => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:40.019654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669fc3d-77fe-4bea-9ca4-b51a9f0f8912 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:40.237001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669fc3d-77fe-4bea-9ca4-b51a9f0f8912 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:40.268122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52603c8-feb5-44a1-afe4-94e3938db3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:40.268974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52603c8-feb5-44a1-afe4-94e3938db3a7 None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:40.269251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52603c8-feb5-44a1-afe4-94e3938db3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:40.269522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52603c8-feb5-44a1-afe4-94e3938db3a7 None admin] PATH_INFO: `/v3/projects/8a3def2723f948ad9d96912e465a42df/users/60547adafd3344a584ca10758e3c6074/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:40.271418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52603c8-feb5-44a1-afe4-94e3938db3a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a3def2723f948ad9d96912e465a42df, user_id=60547adafd3344a584ca10758e3c6074, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:40.272862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52603c8-feb5-44a1-afe4-94e3938db3a7 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:40.285148 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 559/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:35:40 2022] PUT /identity/v3/projects/8a3def2723f948ad9d96912e465a42df/users/60547adafd3344a584ca10758e3c6074/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:35:42.606072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e08f-363e-467a-a825-e4331a8f1a15 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:42.606619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e08f-363e-467a-a825-e4331a8f1a15 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:42.606619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961e08f-363e-467a-a825-e4331a8f1a15 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:42.608417 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 595/1154] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:42.614737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c37c-574b-47f0-b990-4e032235edb8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:42.615176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c37c-574b-47f0-b990-4e032235edb8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:42.615276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861c37c-574b-47f0-b990-4e032235edb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:42.631796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7861c37c-574b-47f0-b990-4e032235edb8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:42.632997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7861c37c-574b-47f0-b990-4e032235edb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:42.694860 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 560/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:42.720731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961e08f-363e-467a-a825-e4331a8f1a15 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:42.815327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961e08f-363e-467a-a825-e4331a8f1a15 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:42.847987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16255da-f639-458f-8803-57495b91affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:42.848752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16255da-f639-458f-8803-57495b91affc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:42.849031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16255da-f639-458f-8803-57495b91affc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:42.849303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16255da-f639-458f-8803-57495b91affc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:42.859097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16255da-f639-458f-8803-57495b91affc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:42.865703 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-b16255da-f639-458f-8803-57495b91affc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:35:42.866837 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 596/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:42.872760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861c37c-574b-47f0-b990-4e032235edb8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:42.965863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861c37c-574b-47f0-b990-4e032235edb8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:42.997183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751934be-7ade-45bd-85b6-1bcf0284448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:42.997829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751934be-7ade-45bd-85b6-1bcf0284448f None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:42.998111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751934be-7ade-45bd-85b6-1bcf0284448f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:42.998381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751934be-7ade-45bd-85b6-1bcf0284448f None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:42.999110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751934be-7ade-45bd-85b6-1bcf0284448f None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:42.999417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751934be-7ade-45bd-85b6-1bcf0284448f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:43.001353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751934be-7ade-45bd-85b6-1bcf0284448f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:43.009007 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 561/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:43.014690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16255da-f639-458f-8803-57495b91affc None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:43.109037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16255da-f639-458f-8803-57495b91affc None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:43.140189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071460-7db9-46f2-bcae-5e377007dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:43.141577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071460-7db9-46f2-bcae-5e377007dd4b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:43.141865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071460-7db9-46f2-bcae-5e377007dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:43.142139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8071460-7db9-46f2-bcae-5e377007dd4b None admin] PATH_INFO: `/v3/users/60547adafd3344a584ca10758e3c6074` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:43.143361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8071460-7db9-46f2-bcae-5e377007dd4b None admin] RBAC: Authorizing `identity:get_user(user_id=60547adafd3344a584ca10758e3c6074)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:43.144824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8071460-7db9-46f2-bcae-5e377007dd4b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:43.146400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 597/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:43 2022] GET /identity/v3/users/60547adafd3344a584ca10758e3c6074 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:43.152102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751934be-7ade-45bd-85b6-1bcf0284448f None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:43.244943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751934be-7ade-45bd-85b6-1bcf0284448f None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:43.276569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792cfad-7e7d-41a0-9711-a54ecce18087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:43.277220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792cfad-7e7d-41a0-9711-a54ecce18087 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:43.277503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792cfad-7e7d-41a0-9711-a54ecce18087 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:43.277779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792cfad-7e7d-41a0-9711-a54ecce18087 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:43.340836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792cfad-7e7d-41a0-9711-a54ecce18087 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:43.342529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792cfad-7e7d-41a0-9711-a54ecce18087 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:43.433135 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 562/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:43.439596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071460-7db9-46f2-bcae-5e377007dd4b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:43.532136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8071460-7db9-46f2-bcae-5e377007dd4b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:43.562632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66715a91-4871-4635-8ced-1fc8d5fdbe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:43.563711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66715a91-4871-4635-8ced-1fc8d5fdbe9d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:43.564017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66715a91-4871-4635-8ced-1fc8d5fdbe9d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:43.564289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66715a91-4871-4635-8ced-1fc8d5fdbe9d None admin] PATH_INFO: `/v3/projects/8a3def2723f948ad9d96912e465a42df` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:43.565425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66715a91-4871-4635-8ced-1fc8d5fdbe9d None admin] RBAC: Authorizing `identity:get_project(project_id=8a3def2723f948ad9d96912e465a42df)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:43.566846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66715a91-4871-4635-8ced-1fc8d5fdbe9d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:43.568496 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 598/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:43 2022] GET /identity/v3/projects/8a3def2723f948ad9d96912e465a42df => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:43.574409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792cfad-7e7d-41a0-9711-a54ecce18087 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:43.666300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792cfad-7e7d-41a0-9711-a54ecce18087 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:43.697422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff16a0c-62d0-4eb6-be7e-2ce67ba5ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:43.697988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16a0c-62d0-4eb6-be7e-2ce67ba5ec30 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:43.698265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16a0c-62d0-4eb6-be7e-2ce67ba5ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:43.698536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16a0c-62d0-4eb6-be7e-2ce67ba5ec30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:43.699333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff16a0c-62d0-4eb6-be7e-2ce67ba5ec30 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=8a3def2723f948ad9d96912e465a42df, user.id=60547adafd3344a584ca10758e3c6074) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:43.699636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff16a0c-62d0-4eb6-be7e-2ce67ba5ec30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:43.701076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff16a0c-62d0-4eb6-be7e-2ce67ba5ec30 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:43.706557 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 563/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:35:43 2022] GET /identity/v3/role_assignments?user.id=60547adafd3344a584ca10758e3c6074&scope.project.id=8a3def2723f948ad9d96912e465a42df&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:35:46.061577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40afcc-0a64-489c-aa34-56d9c3e55432 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:46.062069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40afcc-0a64-489c-aa34-56d9c3e55432 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:46.062171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40afcc-0a64-489c-aa34-56d9c3e55432 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:46.064430 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 599/1162] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:46.070852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08866ad-1cf9-4b2b-bc6c-76372218bf3f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:46.071272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08866ad-1cf9-4b2b-bc6c-76372218bf3f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:46.071406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08866ad-1cf9-4b2b-bc6c-76372218bf3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:46.088110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e08866ad-1cf9-4b2b-bc6c-76372218bf3f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:46.089256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e08866ad-1cf9-4b2b-bc6c-76372218bf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:46.150194 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 564/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:46.174192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40afcc-0a64-489c-aa34-56d9c3e55432 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:46.269074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40afcc-0a64-489c-aa34-56d9c3e55432 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:46.300218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93094315-c458-490e-825f-0e4cb7eabe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:46.300777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93094315-c458-490e-825f-0e4cb7eabe2b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:46.301059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93094315-c458-490e-825f-0e4cb7eabe2b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:46.301335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93094315-c458-490e-825f-0e4cb7eabe2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:46.363033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93094315-c458-490e-825f-0e4cb7eabe2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:46.364497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93094315-c458-490e-825f-0e4cb7eabe2b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:46.455356 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 600/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:46.461203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08866ad-1cf9-4b2b-bc6c-76372218bf3f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:46.552979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08866ad-1cf9-4b2b-bc6c-76372218bf3f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:46.583605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170823b-b4bb-46eb-a449-4be08d7b7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:46.584403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170823b-b4bb-46eb-a449-4be08d7b7578 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:46.584680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170823b-b4bb-46eb-a449-4be08d7b7578 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:46.584952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170823b-b4bb-46eb-a449-4be08d7b7578 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:46.591519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170823b-b4bb-46eb-a449-4be08d7b7578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:46.592977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170823b-b4bb-46eb-a449-4be08d7b7578 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:46.606131 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2170823b-b4bb-46eb-a449-4be08d7b7578 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 26 20:35:46.607235 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 565/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:35:46 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:46.613752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93094315-c458-490e-825f-0e4cb7eabe2b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:46.704905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93094315-c458-490e-825f-0e4cb7eabe2b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:46.737878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d177e23-ac83-4399-9db5-034a859c9aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:46.738506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d177e23-ac83-4399-9db5-034a859c9aec None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:46.738784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d177e23-ac83-4399-9db5-034a859c9aec None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:46.739055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d177e23-ac83-4399-9db5-034a859c9aec None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:46.739750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d177e23-ac83-4399-9db5-034a859c9aec None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:46.740191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d177e23-ac83-4399-9db5-034a859c9aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:46.741537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d177e23-ac83-4399-9db5-034a859c9aec None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:46.748350 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 601/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Mar 26 20:35:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:49.051721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7a41-a8fb-4b1f-b13f-39cf1c094f01 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:49.052201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7a41-a8fb-4b1f-b13f-39cf1c094f01 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:49.052313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad7a41-a8fb-4b1f-b13f-39cf1c094f01 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:49.054669 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 566/1167] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:49.060964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d25ad6-9fb0-4f31-9be4-6294e83aecbe None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:49.061356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d25ad6-9fb0-4f31-9be4-6294e83aecbe None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:49.061513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d25ad6-9fb0-4f31-9be4-6294e83aecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:49.078699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d3d25ad6-9fb0-4f31-9be4-6294e83aecbe None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:49.079877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d3d25ad6-9fb0-4f31-9be4-6294e83aecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:49.140208 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 602/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:49.164378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7a41-a8fb-4b1f-b13f-39cf1c094f01 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:49.259887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad7a41-a8fb-4b1f-b13f-39cf1c094f01 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:49.290942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab43d04-1e3b-4dbd-969b-23d30b38a510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:49.291524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab43d04-1e3b-4dbd-969b-23d30b38a510 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:49.291806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab43d04-1e3b-4dbd-969b-23d30b38a510 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:49.292109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab43d04-1e3b-4dbd-969b-23d30b38a510 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:49.292845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab43d04-1e3b-4dbd-969b-23d30b38a510 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:49.294215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab43d04-1e3b-4dbd-969b-23d30b38a510 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:49.308937 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 567/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Sat Mar 26 20:35:49 2022] POST /identity/v3/domains => generated 267 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:35:51.669570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966448db-534e-4080-ab18-63e21460f189 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:51.670130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966448db-534e-4080-ab18-63e21460f189 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:51.670130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966448db-534e-4080-ab18-63e21460f189 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:51.672418 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 603/1170] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:51.678679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e338-93a4-480d-ab38-a3fedc5c3061 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:51.679141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e338-93a4-480d-ab38-a3fedc5c3061 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:51.679234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e338-93a4-480d-ab38-a3fedc5c3061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:51.696106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c456e338-93a4-480d-ab38-a3fedc5c3061 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:51.697255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c456e338-93a4-480d-ab38-a3fedc5c3061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:51.759143 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 568/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:51.784223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966448db-534e-4080-ab18-63e21460f189 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:51.880145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966448db-534e-4080-ab18-63e21460f189 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:51.911536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e618d-119f-419d-81b6-d950c7f6892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:51.912396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e618d-119f-419d-81b6-d950c7f6892a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:51.912678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e618d-119f-419d-81b6-d950c7f6892a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:51.912950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e618d-119f-419d-81b6-d950c7f6892a None admin] PATH_INFO: `/v3/domains/ceefc838c56c4be491664846364e4f02` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:51.923458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e618d-119f-419d-81b6-d950c7f6892a None admin] RBAC: Authorizing `identity:get_domain(domain_id=ceefc838c56c4be491664846364e4f02)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:51.924866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e618d-119f-419d-81b6-d950c7f6892a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:51.926437 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 604/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Mar 26 20:35:51 2022] GET /identity/v3/domains/ceefc838c56c4be491664846364e4f02 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:51.932268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456e338-93a4-480d-ab38-a3fedc5c3061 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:52.024617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456e338-93a4-480d-ab38-a3fedc5c3061 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:52.057045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5861d-6619-4a46-8981-759eaf1c4e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:52.057691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5861d-6619-4a46-8981-759eaf1c4e00 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:52.057971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5861d-6619-4a46-8981-759eaf1c4e00 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:52.058243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5861d-6619-4a46-8981-759eaf1c4e00 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:52.058947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5861d-6619-4a46-8981-759eaf1c4e00 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:52.060422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5861d-6619-4a46-8981-759eaf1c4e00 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:52.084744 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 569/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:35:51 2022] POST /identity/v3/projects => generated 361 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:35:54.445021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a8da-7d06-4fb9-b65c-edd897a05b6f None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:54.445561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a8da-7d06-4fb9-b65c-edd897a05b6f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:54.445561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1a8da-7d06-4fb9-b65c-edd897a05b6f None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:54.447301 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 605/1174] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:54.454279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027da44f-f9a7-4747-98b1-8dcfce61a7a3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:54.454693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027da44f-f9a7-4747-98b1-8dcfce61a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:54.454845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027da44f-f9a7-4747-98b1-8dcfce61a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:54.471690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-027da44f-f9a7-4747-98b1-8dcfce61a7a3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:54.472875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-027da44f-f9a7-4747-98b1-8dcfce61a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:54.533786 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 570/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:54.559879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1a8da-7d06-4fb9-b65c-edd897a05b6f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:54.654506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1a8da-7d06-4fb9-b65c-edd897a05b6f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:54.685870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b13a5-004c-444d-859c-d9eda5ee0411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:54.686696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b13a5-004c-444d-859c-d9eda5ee0411 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:54.686971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b13a5-004c-444d-859c-d9eda5ee0411 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:54.687863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b13a5-004c-444d-859c-d9eda5ee0411 None admin] PATH_INFO: `/v3/domains/ceefc838c56c4be491664846364e4f02` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:54.689039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b13a5-004c-444d-859c-d9eda5ee0411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=ceefc838c56c4be491664846364e4f02)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:54.690455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110b13a5-004c-444d-859c-d9eda5ee0411 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:54.692006 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 606/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Mar 26 20:35:54 2022] GET /identity/v3/domains/ceefc838c56c4be491664846364e4f02 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:54.697519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027da44f-f9a7-4747-98b1-8dcfce61a7a3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:54.789464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027da44f-f9a7-4747-98b1-8dcfce61a7a3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:54.820878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1466ff1-ce50-43b6-870a-4368e2231ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:54.821516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1466ff1-ce50-43b6-870a-4368e2231ac2 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:54.821796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1466ff1-ce50-43b6-870a-4368e2231ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:54.822070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1466ff1-ce50-43b6-870a-4368e2231ac2 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:54.822765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1466ff1-ce50-43b6-870a-4368e2231ac2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:54.824210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1466ff1-ce50-43b6-870a-4368e2231ac2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:54.843038 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 571/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:35:54 2022] POST /identity/v3/users => generated 311 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:35:57.184763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fd2e3-e116-412f-962c-fb0f04e9558c None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:57.185303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fd2e3-e116-412f-962c-fb0f04e9558c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:57.185303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fd2e3-e116-412f-962c-fb0f04e9558c None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:57.187057 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 607/1178] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:35:57.193264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ac097-c5e6-436e-b450-c7341401e379 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:57.193654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ac097-c5e6-436e-b450-c7341401e379 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:57.193822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ac097-c5e6-436e-b450-c7341401e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:57.209971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-759ac097-c5e6-436e-b450-c7341401e379 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:35:57.211119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-759ac097-c5e6-436e-b450-c7341401e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:35:57.273183 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 572/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:35:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:35:57.298457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fd2e3-e116-412f-962c-fb0f04e9558c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:57.391834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fd2e3-e116-412f-962c-fb0f04e9558c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:57.423811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d9f0-5a28-4a51-970e-bc7fb645025d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:57.424613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d9f0-5a28-4a51-970e-bc7fb645025d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:57.424896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d9f0-5a28-4a51-970e-bc7fb645025d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:57.425170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d9f0-5a28-4a51-970e-bc7fb645025d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:57.434705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85d9f0-5a28-4a51-970e-bc7fb645025d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:35:57.441451 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-ba85d9f0-5a28-4a51-970e-bc7fb645025d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:35:57.442578 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 608/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:35:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:35:57.448331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ac097-c5e6-436e-b450-c7341401e379 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:57.541434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ac097-c5e6-436e-b450-c7341401e379 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:57.572176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98be9-1217-4813-b5cb-d6667145d36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:57.572816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98be9-1217-4813-b5cb-d6667145d36b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:57.573092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98be9-1217-4813-b5cb-d6667145d36b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:57.573361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf98be9-1217-4813-b5cb-d6667145d36b None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:57.574084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf98be9-1217-4813-b5cb-d6667145d36b None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:57.574390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf98be9-1217-4813-b5cb-d6667145d36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:57.575759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf98be9-1217-4813-b5cb-d6667145d36b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:57.583738 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 573/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:35:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:57.589474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d9f0-5a28-4a51-970e-bc7fb645025d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:57.682682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d9f0-5a28-4a51-970e-bc7fb645025d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:57.713650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c9250-c698-4588-b161-fa03ae47fc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:57.714482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c9250-c698-4588-b161-fa03ae47fc06 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:57.714763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c9250-c698-4588-b161-fa03ae47fc06 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:57.715037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c9250-c698-4588-b161-fa03ae47fc06 None admin] PATH_INFO: `/v3/users/07e78d8474f14d0faae57c5fddbc961e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:57.728695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c9250-c698-4588-b161-fa03ae47fc06 None admin] RBAC: Authorizing `identity:get_user(user_id=07e78d8474f14d0faae57c5fddbc961e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:57.730126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c9250-c698-4588-b161-fa03ae47fc06 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:57.731695 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 609/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:35:57 2022] GET /identity/v3/users/07e78d8474f14d0faae57c5fddbc961e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:57.737176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98be9-1217-4813-b5cb-d6667145d36b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:57.829766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf98be9-1217-4813-b5cb-d6667145d36b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:57.860445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9084b-1e49-49fc-9907-cdbf8c126988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:57.861066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9084b-1e49-49fc-9907-cdbf8c126988 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:57.861348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9084b-1e49-49fc-9907-cdbf8c126988 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:57.861621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9084b-1e49-49fc-9907-cdbf8c126988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:57.924066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9084b-1e49-49fc-9907-cdbf8c126988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:57.925499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9084b-1e49-49fc-9907-cdbf8c126988 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:58.015727 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 574/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:35:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:35:58.021564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c9250-c698-4588-b161-fa03ae47fc06 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:58.112983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c9250-c698-4588-b161-fa03ae47fc06 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:58.144973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dc493-b655-43ae-a6fe-10e52a2d4df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:58.145795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc493-b655-43ae-a6fe-10e52a2d4df3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:58.146073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc493-b655-43ae-a6fe-10e52a2d4df3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:58.146342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dc493-b655-43ae-a6fe-10e52a2d4df3 None admin] PATH_INFO: `/v3/projects/bed83ce98429439cae1270ccdd52da2d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:58.147486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dc493-b655-43ae-a6fe-10e52a2d4df3 None admin] RBAC: Authorizing `identity:get_project(project_id=bed83ce98429439cae1270ccdd52da2d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:58.149036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dc493-b655-43ae-a6fe-10e52a2d4df3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:58.150640 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 610/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:35:58 2022] GET /identity/v3/projects/bed83ce98429439cae1270ccdd52da2d => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:35:58.156512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9084b-1e49-49fc-9907-cdbf8c126988 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:35:58.248411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9084b-1e49-49fc-9907-cdbf8c126988 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:35:58.280285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490800d2-4165-498a-898a-9f356c08c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:35:58.280932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490800d2-4165-498a-898a-9f356c08c620 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:35:58.281214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490800d2-4165-498a-898a-9f356c08c620 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:35:58.281488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490800d2-4165-498a-898a-9f356c08c620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:35:58.282289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490800d2-4165-498a-898a-9f356c08c620 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=bed83ce98429439cae1270ccdd52da2d, user.id=07e78d8474f14d0faae57c5fddbc961e) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:35:58.282596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490800d2-4165-498a-898a-9f356c08c620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:35:58.284036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490800d2-4165-498a-898a-9f356c08c620 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:35:58.289184 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 575/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:35:58 2022] GET /identity/v3/role_assignments?user.id=07e78d8474f14d0faae57c5fddbc961e&scope.project.id=bed83ce98429439cae1270ccdd52da2d&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:36:00.617280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66f460-5828-49e8-a711-edd6a09b5c9f None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:00.617811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66f460-5828-49e8-a711-edd6a09b5c9f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:00.617811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66f460-5828-49e8-a711-edd6a09b5c9f None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:00.619554 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 611/1186] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:36:00.625935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce4169-829e-4a45-ae5c-74074a6cadbe None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:00.626339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce4169-829e-4a45-ae5c-74074a6cadbe None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:00.626485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce4169-829e-4a45-ae5c-74074a6cadbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:00.643251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-33ce4169-829e-4a45-ae5c-74074a6cadbe None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:36:00.644440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-33ce4169-829e-4a45-ae5c-74074a6cadbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:36:00.706178 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 576/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:36:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:36:00.730507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66f460-5828-49e8-a711-edd6a09b5c9f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:00.824200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66f460-5828-49e8-a711-edd6a09b5c9f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:00.855920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a0c0d-ef82-4f64-bbf5-df56d038389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:00.856700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a0c0d-ef82-4f64-bbf5-df56d038389e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:00.856980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a0c0d-ef82-4f64-bbf5-df56d038389e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:00.857255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a0c0d-ef82-4f64-bbf5-df56d038389e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:00.866763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a0c0d-ef82-4f64-bbf5-df56d038389e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:36:00.873503 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-8b7a0c0d-ef82-4f64-bbf5-df56d038389e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:36:00.875074 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 612/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:36:00.880778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce4169-829e-4a45-ae5c-74074a6cadbe None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:00.973054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce4169-829e-4a45-ae5c-74074a6cadbe None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:01.004712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47856d87-6c4d-4cf7-ba3a-7bb10a51c681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:01.005353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47856d87-6c4d-4cf7-ba3a-7bb10a51c681 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:01.005667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47856d87-6c4d-4cf7-ba3a-7bb10a51c681 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:01.005939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47856d87-6c4d-4cf7-ba3a-7bb10a51c681 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:01.006676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47856d87-6c4d-4cf7-ba3a-7bb10a51c681 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:36:01.006980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47856d87-6c4d-4cf7-ba3a-7bb10a51c681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:36:01.008409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47856d87-6c4d-4cf7-ba3a-7bb10a51c681 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:36:01.016967 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 577/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:36:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:36:01.023375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a0c0d-ef82-4f64-bbf5-df56d038389e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:01.116988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a0c0d-ef82-4f64-bbf5-df56d038389e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:01.148925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12d6a-9048-431e-9b04-be4fbab209be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:01.149711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12d6a-9048-431e-9b04-be4fbab209be None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:01.149990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12d6a-9048-431e-9b04-be4fbab209be None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:01.150267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d12d6a-9048-431e-9b04-be4fbab209be None admin] PATH_INFO: `/v3/users/07e78d8474f14d0faae57c5fddbc961e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:01.151432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12d6a-9048-431e-9b04-be4fbab209be None admin] RBAC: Authorizing `identity:get_user(user_id=07e78d8474f14d0faae57c5fddbc961e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:36:01.152893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d12d6a-9048-431e-9b04-be4fbab209be None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:36:01.154450 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 613/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:36:01 2022] GET /identity/v3/users/07e78d8474f14d0faae57c5fddbc961e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:36:01.159907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47856d87-6c4d-4cf7-ba3a-7bb10a51c681 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:01.261153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47856d87-6c4d-4cf7-ba3a-7bb10a51c681 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:01.292564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82470a76-37d9-4117-8fbb-d6ebd6793a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:01.293403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470a76-37d9-4117-8fbb-d6ebd6793a1c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:01.293680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470a76-37d9-4117-8fbb-d6ebd6793a1c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:01.293952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82470a76-37d9-4117-8fbb-d6ebd6793a1c None admin] PATH_INFO: `/v3/projects/bed83ce98429439cae1270ccdd52da2d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:01.295088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82470a76-37d9-4117-8fbb-d6ebd6793a1c None admin] RBAC: Authorizing `identity:get_project(project_id=bed83ce98429439cae1270ccdd52da2d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:36:01.297038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82470a76-37d9-4117-8fbb-d6ebd6793a1c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:36:01.298680 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 578/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:36:01 2022] GET /identity/v3/projects/bed83ce98429439cae1270ccdd52da2d => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:36:01.304564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12d6a-9048-431e-9b04-be4fbab209be None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:01.399661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d12d6a-9048-431e-9b04-be4fbab209be None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:01.431567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ea032-d3b3-4ebc-b6d8-219b7b38894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:01.432476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea032-d3b3-4ebc-b6d8-219b7b38894c None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:01.432759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea032-d3b3-4ebc-b6d8-219b7b38894c None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:01.433034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ea032-d3b3-4ebc-b6d8-219b7b38894c None admin] PATH_INFO: `/v3/projects/bed83ce98429439cae1270ccdd52da2d/users/07e78d8474f14d0faae57c5fddbc961e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:01.434976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ea032-d3b3-4ebc-b6d8-219b7b38894c None admin] RBAC: Authorizing `identity:create_grant(project_id=bed83ce98429439cae1270ccdd52da2d, user_id=07e78d8474f14d0faae57c5fddbc961e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:36:01.436585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ea032-d3b3-4ebc-b6d8-219b7b38894c None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:36:01.449414 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 614/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:36:01 2022] PUT /identity/v3/projects/bed83ce98429439cae1270ccdd52da2d/users/07e78d8474f14d0faae57c5fddbc961e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:36:03.786763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffd940-0b5c-4a92-b245-4e1d1b6209b9 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:03.787299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffd940-0b5c-4a92-b245-4e1d1b6209b9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:03.787299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ffd940-0b5c-4a92-b245-4e1d1b6209b9 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:03.789295 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 579/1193] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:36:03.795485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445cb4a-e6bf-41f8-ae09-8e4fcf394da8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:03.795904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445cb4a-e6bf-41f8-ae09-8e4fcf394da8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:03.796213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445cb4a-e6bf-41f8-ae09-8e4fcf394da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:03.813077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b445cb4a-e6bf-41f8-ae09-8e4fcf394da8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:36:03.814259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b445cb4a-e6bf-41f8-ae09-8e4fcf394da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:36:03.876289 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 615/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:36:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:36:03.900600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffd940-0b5c-4a92-b245-4e1d1b6209b9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:03.996240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ffd940-0b5c-4a92-b245-4e1d1b6209b9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:04.027365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d44e09-e9a1-478a-b46d-d082435ab7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:04.028174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d44e09-e9a1-478a-b46d-d082435ab7fc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:04.028457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d44e09-e9a1-478a-b46d-d082435ab7fc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:04.028729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d44e09-e9a1-478a-b46d-d082435ab7fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:04.039176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d44e09-e9a1-478a-b46d-d082435ab7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:36:04.045780 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b1d44e09-e9a1-478a-b46d-d082435ab7fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:36:04.047586 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 580/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:36:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:36:04.053593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445cb4a-e6bf-41f8-ae09-8e4fcf394da8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:04.145765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445cb4a-e6bf-41f8-ae09-8e4fcf394da8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:04.178405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d813e-52d2-4c7f-9a4e-e3759e04d7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:04.179044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d813e-52d2-4c7f-9a4e-e3759e04d7d7 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:04.179326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d813e-52d2-4c7f-9a4e-e3759e04d7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:04.179598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d813e-52d2-4c7f-9a4e-e3759e04d7d7 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:04.180359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d813e-52d2-4c7f-9a4e-e3759e04d7d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:36:04.180664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d813e-52d2-4c7f-9a4e-e3759e04d7d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:36:04.182026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d813e-52d2-4c7f-9a4e-e3759e04d7d7 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:36:04.189583 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 616/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:36:04.195215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d44e09-e9a1-478a-b46d-d082435ab7fc None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:04.287088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d44e09-e9a1-478a-b46d-d082435ab7fc None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:04.317670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f6f2-357d-4bfa-b9ad-fa1b0ee21ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:04.318446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f6f2-357d-4bfa-b9ad-fa1b0ee21ef8 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:04.318752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f6f2-357d-4bfa-b9ad-fa1b0ee21ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:04.319022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24f6f2-357d-4bfa-b9ad-fa1b0ee21ef8 None admin] PATH_INFO: `/v3/users/07e78d8474f14d0faae57c5fddbc961e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:04.320204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24f6f2-357d-4bfa-b9ad-fa1b0ee21ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=07e78d8474f14d0faae57c5fddbc961e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:36:04.321651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24f6f2-357d-4bfa-b9ad-fa1b0ee21ef8 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:36:04.323200 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 581/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Mar 26 20:36:04 2022] GET /identity/v3/users/07e78d8474f14d0faae57c5fddbc961e => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:36:04.329198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d813e-52d2-4c7f-9a4e-e3759e04d7d7 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:04.421597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d813e-52d2-4c7f-9a4e-e3759e04d7d7 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:04.452405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b83fe3-58a0-48e8-9ade-cceaf05d7b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:04.453516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b83fe3-58a0-48e8-9ade-cceaf05d7b61 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:04.453828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b83fe3-58a0-48e8-9ade-cceaf05d7b61 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:04.454150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b83fe3-58a0-48e8-9ade-cceaf05d7b61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:04.517333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b83fe3-58a0-48e8-9ade-cceaf05d7b61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:36:04.518801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b83fe3-58a0-48e8-9ade-cceaf05d7b61 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:36:04.609629 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 617/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:36:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:36:04.615444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f6f2-357d-4bfa-b9ad-fa1b0ee21ef8 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:04.708261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24f6f2-357d-4bfa-b9ad-fa1b0ee21ef8 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:04.739404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a86eb-d23c-44c1-8f5e-43d6789fd8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:04.740262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a86eb-d23c-44c1-8f5e-43d6789fd8a5 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:04.740544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a86eb-d23c-44c1-8f5e-43d6789fd8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:04.740820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a86eb-d23c-44c1-8f5e-43d6789fd8a5 None admin] PATH_INFO: `/v3/projects/bed83ce98429439cae1270ccdd52da2d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:04.741971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a86eb-d23c-44c1-8f5e-43d6789fd8a5 None admin] RBAC: Authorizing `identity:get_project(project_id=bed83ce98429439cae1270ccdd52da2d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:36:04.743408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a86eb-d23c-44c1-8f5e-43d6789fd8a5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:36:04.745087 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 582/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Mar 26 20:36:04 2022] GET /identity/v3/projects/bed83ce98429439cae1270ccdd52da2d => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:36:04.751628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b83fe3-58a0-48e8-9ade-cceaf05d7b61 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:36:04.847247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b83fe3-58a0-48e8-9ade-cceaf05d7b61 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:36:04.879489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edef74-5f77-4e2d-9f1f-f25f33c40d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:36:04.880103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edef74-5f77-4e2d-9f1f-f25f33c40d89 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:36:04.880383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edef74-5f77-4e2d-9f1f-f25f33c40d89 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:36:04.880656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edef74-5f77-4e2d-9f1f-f25f33c40d89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:36:04.881459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edef74-5f77-4e2d-9f1f-f25f33c40d89 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=bed83ce98429439cae1270ccdd52da2d, user.id=07e78d8474f14d0faae57c5fddbc961e) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:36:04.881765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edef74-5f77-4e2d-9f1f-f25f33c40d89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:36:04.883196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edef74-5f77-4e2d-9f1f-f25f33c40d89 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:36:04.888636 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 618/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:36:04 2022] GET /identity/v3/role_assignments?user.id=07e78d8474f14d0faae57c5fddbc961e&scope.project.id=bed83ce98429439cae1270ccdd52da2d&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:07.527142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aff813-911f-482d-8600-d7bf498e20e8 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:07.527142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aff813-911f-482d-8600-d7bf498e20e8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:07.527142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aff813-911f-482d-8600-d7bf498e20e8 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:07.527142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 583/1201] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:07.535544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661fbc-d164-4fe5-b55f-ea39c8af2527 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:07.536122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661fbc-d164-4fe5-b55f-ea39c8af2527 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:07.536213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80661fbc-d164-4fe5-b55f-ea39c8af2527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:07.555175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-80661fbc-d164-4fe5-b55f-ea39c8af2527 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:07.556995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-80661fbc-d164-4fe5-b55f-ea39c8af2527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:07.639990 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 619/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:07.661541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aff813-911f-482d-8600-d7bf498e20e8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:07.781265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aff813-911f-482d-8600-d7bf498e20e8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:07.820592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01f8f0-392d-43a4-ab91-29b75769e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:07.821377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01f8f0-392d-43a4-ab91-29b75769e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:07.821652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01f8f0-392d-43a4-ab91-29b75769e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:07.821924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01f8f0-392d-43a4-ab91-29b75769e7b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:07.833252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01f8f0-392d-43a4-ab91-29b75769e7b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:07.834732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01f8f0-392d-43a4-ab91-29b75769e7b9 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:07.854323 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0d01f8f0-392d-43a4-ab91-29b75769e7b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:07.855957 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 584/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:07.862245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80661fbc-d164-4fe5-b55f-ea39c8af2527 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:07.984145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80661fbc-d164-4fe5-b55f-ea39c8af2527 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:08.025132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d947b31-c530-4cd4-be93-8ca3e344c065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:08.026102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d947b31-c530-4cd4-be93-8ca3e344c065 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:08.026572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d947b31-c530-4cd4-be93-8ca3e344c065 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:08.027033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d947b31-c530-4cd4-be93-8ca3e344c065 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:08.028083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d947b31-c530-4cd4-be93-8ca3e344c065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:08.028624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d947b31-c530-4cd4-be93-8ca3e344c065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:08.030227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d947b31-c530-4cd4-be93-8ca3e344c065 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:08.044725 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 620/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:37:08.051370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01f8f0-392d-43a4-ab91-29b75769e7b9 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:08.171439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01f8f0-392d-43a4-ab91-29b75769e7b9 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:08.214654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad564e7-57b9-4853-95bc-0ed83b6fbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:08.215354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad564e7-57b9-4853-95bc-0ed83b6fbcb5 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:08.215682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad564e7-57b9-4853-95bc-0ed83b6fbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:08.216033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad564e7-57b9-4853-95bc-0ed83b6fbcb5 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:08.216953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad564e7-57b9-4853-95bc-0ed83b6fbcb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:08.218896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad564e7-57b9-4853-95bc-0ed83b6fbcb5 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:08.248008 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 585/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Mar 26 20:37:08 2022] POST /identity/v3/users => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:37:11.064803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ee852-a5f3-4fd5-9d72-73fecb8c96f4 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:11.065405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ee852-a5f3-4fd5-9d72-73fecb8c96f4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:11.065405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ee852-a5f3-4fd5-9d72-73fecb8c96f4 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:11.067338 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 621/1206] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:11.075953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c48e5-b58f-4f05-97b9-2d8280c1eecb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:11.075953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c48e5-b58f-4f05-97b9-2d8280c1eecb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:11.076543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c48e5-b58f-4f05-97b9-2d8280c1eecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:11.100222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-303c48e5-b58f-4f05-97b9-2d8280c1eecb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:11.101963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-303c48e5-b58f-4f05-97b9-2d8280c1eecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:11.180419 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 586/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:11.206362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ee852-a5f3-4fd5-9d72-73fecb8c96f4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:11.326163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ee852-a5f3-4fd5-9d72-73fecb8c96f4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:11.364485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7c8f1-3554-43a2-842f-0cfdc492b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:11.365365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7c8f1-3554-43a2-842f-0cfdc492b706 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:11.365684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7c8f1-3554-43a2-842f-0cfdc492b706 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:11.366125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7c8f1-3554-43a2-842f-0cfdc492b706 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:11.377422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7c8f1-3554-43a2-842f-0cfdc492b706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:37:11.385666 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-08e7c8f1-3554-43a2-842f-0cfdc492b706 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:37:11.387255 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 622/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:37:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:11.393701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c48e5-b58f-4f05-97b9-2d8280c1eecb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:11.498506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c48e5-b58f-4f05-97b9-2d8280c1eecb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:11.540153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a1525-99d6-4d0c-89fa-3bdce58c3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:11.541393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1525-99d6-4d0c-89fa-3bdce58c3102 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:11.541848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1525-99d6-4d0c-89fa-3bdce58c3102 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:11.542294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a1525-99d6-4d0c-89fa-3bdce58c3102 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:11.543256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a1525-99d6-4d0c-89fa-3bdce58c3102 None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:11.543565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a1525-99d6-4d0c-89fa-3bdce58c3102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:11.545292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a1525-99d6-4d0c-89fa-3bdce58c3102 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:11.555811 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 587/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:37:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:37:11.562225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7c8f1-3554-43a2-842f-0cfdc492b706 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:11.672115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7c8f1-3554-43a2-842f-0cfdc492b706 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:11.709413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964216d-2e26-47dc-8273-478e6bd41413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:11.710200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964216d-2e26-47dc-8273-478e6bd41413 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:11.710476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964216d-2e26-47dc-8273-478e6bd41413 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:11.710751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964216d-2e26-47dc-8273-478e6bd41413 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:11.722198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964216d-2e26-47dc-8273-478e6bd41413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:11.723651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964216d-2e26-47dc-8273-478e6bd41413 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:11.741161 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-2964216d-2e26-47dc-8273-478e6bd41413 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:11.747169 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 623/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:37:11.748202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a1525-99d6-4d0c-89fa-3bdce58c3102 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:11.861882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a1525-99d6-4d0c-89fa-3bdce58c3102 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:11.898323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df2c53-a0c1-42a5-a2d4-97eb53c45d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:11.899042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2c53-a0c1-42a5-a2d4-97eb53c45d00 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:11.899407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2c53-a0c1-42a5-a2d4-97eb53c45d00 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:11.899657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df2c53-a0c1-42a5-a2d4-97eb53c45d00 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:11.900610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df2c53-a0c1-42a5-a2d4-97eb53c45d00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:11.900943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df2c53-a0c1-42a5-a2d4-97eb53c45d00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:11.902441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df2c53-a0c1-42a5-a2d4-97eb53c45d00 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:11.920730 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 588/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:11.922046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964216d-2e26-47dc-8273-478e6bd41413 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:12.031480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964216d-2e26-47dc-8273-478e6bd41413 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:12.070186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194c33f-9afb-4727-a386-8ea4527f8ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:12.071172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194c33f-9afb-4727-a386-8ea4527f8ecc None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:12.071451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194c33f-9afb-4727-a386-8ea4527f8ecc None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:12.071819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194c33f-9afb-4727-a386-8ea4527f8ecc None admin] PATH_INFO: `/v3/users/placement` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:12.080677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194c33f-9afb-4727-a386-8ea4527f8ecc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:12.082170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5194c33f-9afb-4727-a386-8ea4527f8ecc None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:12.099354 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-5194c33f-9afb-4727-a386-8ea4527f8ecc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 26 20:37:12.101504 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 624/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:12.107338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df2c53-a0c1-42a5-a2d4-97eb53c45d00 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:12.222268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df2c53-a0c1-42a5-a2d4-97eb53c45d00 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:12.260516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d034-66ab-42db-ad57-4579dde6aa3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:12.261273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d034-66ab-42db-ad57-4579dde6aa3b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:12.261590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d034-66ab-42db-ad57-4579dde6aa3b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:12.261867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015d034-66ab-42db-ad57-4579dde6aa3b None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:12.262763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d034-66ab-42db-ad57-4579dde6aa3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:12.263099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d034-66ab-42db-ad57-4579dde6aa3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:12.264629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015d034-66ab-42db-ad57-4579dde6aa3b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:12.283217 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 589/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Mar 26 20:37:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:12.289124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194c33f-9afb-4727-a386-8ea4527f8ecc None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:12.407210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194c33f-9afb-4727-a386-8ea4527f8ecc None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:12.443805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819fbc2-d9c1-4ac1-b658-e44d3dcc385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:12.444478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819fbc2-d9c1-4ac1-b658-e44d3dcc385e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:12.444761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819fbc2-d9c1-4ac1-b658-e44d3dcc385e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:12.445037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819fbc2-d9c1-4ac1-b658-e44d3dcc385e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:12.521176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819fbc2-d9c1-4ac1-b658-e44d3dcc385e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:12.522671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819fbc2-d9c1-4ac1-b658-e44d3dcc385e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:12.644830 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 625/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:37:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:37:12.652346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d034-66ab-42db-ad57-4579dde6aa3b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:12.772311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015d034-66ab-42db-ad57-4579dde6aa3b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:12.808203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36054e0c-a073-45db-aa3f-7c73b97bccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:12.808912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054e0c-a073-45db-aa3f-7c73b97bccd2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:12.809191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054e0c-a073-45db-aa3f-7c73b97bccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:12.809489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36054e0c-a073-45db-aa3f-7c73b97bccd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:12.820709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36054e0c-a073-45db-aa3f-7c73b97bccd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:12.822285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36054e0c-a073-45db-aa3f-7c73b97bccd2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:12.841767 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-36054e0c-a073-45db-aa3f-7c73b97bccd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:12.843347 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 590/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:12.849229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819fbc2-d9c1-4ac1-b658-e44d3dcc385e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:12.956290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819fbc2-d9c1-4ac1-b658-e44d3dcc385e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:12.992551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d50df3-75a6-4398-abdf-e5cac3639e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:12.993216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d50df3-75a6-4398-abdf-e5cac3639e8f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:12.993495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d50df3-75a6-4398-abdf-e5cac3639e8f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:12.993767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d50df3-75a6-4398-abdf-e5cac3639e8f None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:12.994590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d50df3-75a6-4398-abdf-e5cac3639e8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:12.994940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d50df3-75a6-4398-abdf-e5cac3639e8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:12.996375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d50df3-75a6-4398-abdf-e5cac3639e8f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:13.012181 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 626/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:13.014526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36054e0c-a073-45db-aa3f-7c73b97bccd2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:13.151643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36054e0c-a073-45db-aa3f-7c73b97bccd2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:13.191051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1f8c7-18bb-4977-9c4e-0f48cc8b564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:13.191828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1f8c7-18bb-4977-9c4e-0f48cc8b564b None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:13.192140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1f8c7-18bb-4977-9c4e-0f48cc8b564b None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:13.192417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1f8c7-18bb-4977-9c4e-0f48cc8b564b None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:13.199836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1f8c7-18bb-4977-9c4e-0f48cc8b564b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:13.201655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1f8c7-18bb-4977-9c4e-0f48cc8b564b None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:13.216206 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b3d1f8c7-18bb-4977-9c4e-0f48cc8b564b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:37:13.217619 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 591/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:37:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:13.223700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d50df3-75a6-4398-abdf-e5cac3639e8f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:13.338614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d50df3-75a6-4398-abdf-e5cac3639e8f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:13.374836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21237edd-62f0-4200-9a73-72ee8455b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:13.375530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21237edd-62f0-4200-9a73-72ee8455b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:13.375875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21237edd-62f0-4200-9a73-72ee8455b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:13.376210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21237edd-62f0-4200-9a73-72ee8455b9a5 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:13.377669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21237edd-62f0-4200-9a73-72ee8455b9a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:13.378017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21237edd-62f0-4200-9a73-72ee8455b9a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:13.379624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21237edd-62f0-4200-9a73-72ee8455b9a5 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:13.392534 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 627/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:13.398527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1f8c7-18bb-4977-9c4e-0f48cc8b564b None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:13.500191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1f8c7-18bb-4977-9c4e-0f48cc8b564b None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:13.540281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ea336-a7fd-40e4-b6a2-9eeda07f2b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:13.540936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ea336-a7fd-40e4-b6a2-9eeda07f2b22 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:13.541211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ea336-a7fd-40e4-b6a2-9eeda07f2b22 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:13.541491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ea336-a7fd-40e4-b6a2-9eeda07f2b22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:13.542412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ea336-a7fd-40e4-b6a2-9eeda07f2b22 None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=de5b3a8b36da4df7b905b26aa3e680e2) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:13.542741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ea336-a7fd-40e4-b6a2-9eeda07f2b22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:13.544603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ea336-a7fd-40e4-b6a2-9eeda07f2b22 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:13.551818 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 592/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:37:13 2022] GET /identity/v3/role_assignments?user.id=de5b3a8b36da4df7b905b26aa3e680e2&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:16.035637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286219c-c75f-4128-a1c0-9a66601ab403 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:16.036169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286219c-c75f-4128-a1c0-9a66601ab403 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:16.036279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286219c-c75f-4128-a1c0-9a66601ab403 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:16.038247 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 628/1220] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:16.045561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681a1c-488d-4fc2-89c2-5102bec9532a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:16.046020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681a1c-488d-4fc2-89c2-5102bec9532a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:16.046192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681a1c-488d-4fc2-89c2-5102bec9532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:16.065904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-43681a1c-488d-4fc2-89c2-5102bec9532a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:16.067215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-43681a1c-488d-4fc2-89c2-5102bec9532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:16.141014 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 593/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:16.167482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286219c-c75f-4128-a1c0-9a66601ab403 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:16.277291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286219c-c75f-4128-a1c0-9a66601ab403 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:16.310611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38004091-19ae-462c-b545-648f87c290d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:16.311490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38004091-19ae-462c-b545-648f87c290d2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:16.311785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38004091-19ae-462c-b545-648f87c290d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:16.312117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38004091-19ae-462c-b545-648f87c290d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:16.324470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38004091-19ae-462c-b545-648f87c290d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:37:16.331951 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-38004091-19ae-462c-b545-648f87c290d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:37:16.333583 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 629/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:37:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:16.341222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681a1c-488d-4fc2-89c2-5102bec9532a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:16.443374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681a1c-488d-4fc2-89c2-5102bec9532a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:16.478243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb75d7-3248-45fd-a593-3f5357004f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:16.478893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb75d7-3248-45fd-a593-3f5357004f64 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:16.479170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb75d7-3248-45fd-a593-3f5357004f64 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:16.479438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb75d7-3248-45fd-a593-3f5357004f64 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:16.480194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb75d7-3248-45fd-a593-3f5357004f64 None admin] RBAC: Adding query filter params (name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:16.480497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb75d7-3248-45fd-a593-3f5357004f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:16.481904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb75d7-3248-45fd-a593-3f5357004f64 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:16.490492 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 594/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:37:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:16.496615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38004091-19ae-462c-b545-648f87c290d2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:16.609034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38004091-19ae-462c-b545-648f87c290d2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:16.645796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5585b-ab5f-43c6-b3f4-46ef2d7f593f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:16.646691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5585b-ab5f-43c6-b3f4-46ef2d7f593f None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:16.647005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5585b-ab5f-43c6-b3f4-46ef2d7f593f None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:16.647347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5585b-ab5f-43c6-b3f4-46ef2d7f593f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:16.659001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5585b-ab5f-43c6-b3f4-46ef2d7f593f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:16.660582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a5585b-ab5f-43c6-b3f4-46ef2d7f593f None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:16.677705 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-53a5585b-ab5f-43c6-b3f4-46ef2d7f593f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:16.678899 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 630/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:16.684899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb75d7-3248-45fd-a593-3f5357004f64 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:16.791332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb75d7-3248-45fd-a593-3f5357004f64 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:16.825075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f47a6-51fb-4cdc-8e9c-c0c0d77fb15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:16.825733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f47a6-51fb-4cdc-8e9c-c0c0d77fb15a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:16.826015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f47a6-51fb-4cdc-8e9c-c0c0d77fb15a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:16.826290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f47a6-51fb-4cdc-8e9c-c0c0d77fb15a None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:16.827003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f47a6-51fb-4cdc-8e9c-c0c0d77fb15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:16.827311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f47a6-51fb-4cdc-8e9c-c0c0d77fb15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:16.828729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61f47a6-51fb-4cdc-8e9c-c0c0d77fb15a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:16.841255 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 595/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:37:16.847191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5585b-ab5f-43c6-b3f4-46ef2d7f593f None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:16.952519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5585b-ab5f-43c6-b3f4-46ef2d7f593f None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:16.986358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6880ead-a5a6-4052-aaf2-8cfccfdada58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:16.987147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6880ead-a5a6-4052-aaf2-8cfccfdada58 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:16.987425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6880ead-a5a6-4052-aaf2-8cfccfdada58 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:16.987694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6880ead-a5a6-4052-aaf2-8cfccfdada58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:16.994902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6880ead-a5a6-4052-aaf2-8cfccfdada58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:16.996371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6880ead-a5a6-4052-aaf2-8cfccfdada58 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:17.010620 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-e6880ead-a5a6-4052-aaf2-8cfccfdada58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 26 20:37:17.011843 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 631/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:17.017903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f47a6-51fb-4cdc-8e9c-c0c0d77fb15a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:17.125241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f47a6-51fb-4cdc-8e9c-c0c0d77fb15a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:17.160945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d658756-3d4f-4403-9e75-447656b17244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:17.161975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d658756-3d4f-4403-9e75-447656b17244 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:17.162381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d658756-3d4f-4403-9e75-447656b17244 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:17.162811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d658756-3d4f-4403-9e75-447656b17244 None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:17.163949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d658756-3d4f-4403-9e75-447656b17244 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:17.164319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d658756-3d4f-4403-9e75-447656b17244 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:17.166233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d658756-3d4f-4403-9e75-447656b17244 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:17.192123 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 596/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Mar 26 20:37:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:17.193548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6880ead-a5a6-4052-aaf2-8cfccfdada58 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:17.304247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6880ead-a5a6-4052-aaf2-8cfccfdada58 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:17.339157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7635c7-8510-425b-8ce0-d5f0fcc79874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:17.339962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7635c7-8510-425b-8ce0-d5f0fcc79874 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:17.340279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7635c7-8510-425b-8ce0-d5f0fcc79874 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:17.340560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7635c7-8510-425b-8ce0-d5f0fcc79874 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:17.352405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7635c7-8510-425b-8ce0-d5f0fcc79874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:17.353865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7635c7-8510-425b-8ce0-d5f0fcc79874 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:17.370387 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-cf7635c7-8510-425b-8ce0-d5f0fcc79874 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:17.371603 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 632/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:17.377599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d658756-3d4f-4403-9e75-447656b17244 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:17.476697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d658756-3d4f-4403-9e75-447656b17244 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:17.512134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca66838-7638-440f-ac6d-76a9853c56f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:17.512908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca66838-7638-440f-ac6d-76a9853c56f1 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:17.513250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca66838-7638-440f-ac6d-76a9853c56f1 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:17.513689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca66838-7638-440f-ac6d-76a9853c56f1 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:17.514720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca66838-7638-440f-ac6d-76a9853c56f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:17.515124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca66838-7638-440f-ac6d-76a9853c56f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:17.516813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca66838-7638-440f-ac6d-76a9853c56f1 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:17.537334 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 597/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:37:17.538495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7635c7-8510-425b-8ce0-d5f0fcc79874 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:17.656586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7635c7-8510-425b-8ce0-d5f0fcc79874 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:17.690907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6653-0cc0-4f58-b3c8-8a59228cc9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:17.691645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6653-0cc0-4f58-b3c8-8a59228cc9b3 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:17.691994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6653-0cc0-4f58-b3c8-8a59228cc9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:17.692271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6653-0cc0-4f58-b3c8-8a59228cc9b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:17.699262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde6653-0cc0-4f58-b3c8-8a59228cc9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:17.700875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde6653-0cc0-4f58-b3c8-8a59228cc9b3 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:17.715460 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-1fde6653-0cc0-4f58-b3c8-8a59228cc9b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:37:17.716956 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 633/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:37:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:17.723707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca66838-7638-440f-ac6d-76a9853c56f1 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:17.834639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca66838-7638-440f-ac6d-76a9853c56f1 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:17.869085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44745427-b107-460c-b1b8-d53599fd34a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:17.869745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44745427-b107-460c-b1b8-d53599fd34a3 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:17.870028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44745427-b107-460c-b1b8-d53599fd34a3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:17.870308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44745427-b107-460c-b1b8-d53599fd34a3 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:17.871074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44745427-b107-460c-b1b8-d53599fd34a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:17.871378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44745427-b107-460c-b1b8-d53599fd34a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:17.872849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44745427-b107-460c-b1b8-d53599fd34a3 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:17.885681 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 598/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:37:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:17.892404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6653-0cc0-4f58-b3c8-8a59228cc9b3 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:17.995079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6653-0cc0-4f58-b3c8-8a59228cc9b3 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:18.029443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e755e0c-af96-4b18-8255-284ba126f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:18.030321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e755e0c-af96-4b18-8255-284ba126f96b None admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:18.030600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e755e0c-af96-4b18-8255-284ba126f96b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:18.030873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e755e0c-af96-4b18-8255-284ba126f96b None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/de5b3a8b36da4df7b905b26aa3e680e2/roles/1d095fda854f45db887c85e1d6d5ac09` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:18.048624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e755e0c-af96-4b18-8255-284ba126f96b None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=de5b3a8b36da4df7b905b26aa3e680e2, role_id=1d095fda854f45db887c85e1d6d5ac09)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:18.050294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e755e0c-af96-4b18-8255-284ba126f96b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:18.064424 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 634/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:37:17 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/de5b3a8b36da4df7b905b26aa3e680e2/roles/1d095fda854f45db887c85e1d6d5ac09 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:37:20.405890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3060a-c209-411a-8afe-74321cf2a949 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:20.406513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3060a-c209-411a-8afe-74321cf2a949 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:20.406513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3060a-c209-411a-8afe-74321cf2a949 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:20.408372 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 599/1233] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:20.414701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798bdf3-f5a1-480a-8327-a8fdfbe8c0cd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:20.415165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798bdf3-f5a1-480a-8327-a8fdfbe8c0cd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:20.415261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798bdf3-f5a1-480a-8327-a8fdfbe8c0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:20.432410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8798bdf3-f5a1-480a-8327-a8fdfbe8c0cd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:20.433665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8798bdf3-f5a1-480a-8327-a8fdfbe8c0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:20.500977 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 635/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:20.526610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3060a-c209-411a-8afe-74321cf2a949 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:20.641257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3060a-c209-411a-8afe-74321cf2a949 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:20.677835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304fcbf-3eec-461c-a1c1-10372ea8a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:20.678843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304fcbf-3eec-461c-a1c1-10372ea8a727 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:20.679226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304fcbf-3eec-461c-a1c1-10372ea8a727 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:20.679526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304fcbf-3eec-461c-a1c1-10372ea8a727 None admin] PATH_INFO: `/v3/roles/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:20.691947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304fcbf-3eec-461c-a1c1-10372ea8a727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:37:20.699531 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-8304fcbf-3eec-461c-a1c1-10372ea8a727 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 26 20:37:20.700743 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 600/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Mar 26 20:37:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:20.706789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798bdf3-f5a1-480a-8327-a8fdfbe8c0cd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:20.806334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798bdf3-f5a1-480a-8327-a8fdfbe8c0cd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:20.843105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc005c63-ac4f-4e8b-a4bb-d8676cbbbcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:20.843969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc005c63-ac4f-4e8b-a4bb-d8676cbbbcf6 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:20.844343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc005c63-ac4f-4e8b-a4bb-d8676cbbbcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:20.844646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc005c63-ac4f-4e8b-a4bb-d8676cbbbcf6 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:20.846103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc005c63-ac4f-4e8b-a4bb-d8676cbbbcf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:20.846415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc005c63-ac4f-4e8b-a4bb-d8676cbbbcf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:20.847786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc005c63-ac4f-4e8b-a4bb-d8676cbbbcf6 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:20.855720 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 636/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Mar 26 20:37:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:20.861442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304fcbf-3eec-461c-a1c1-10372ea8a727 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:20.973678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304fcbf-3eec-461c-a1c1-10372ea8a727 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:21.012578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126ecd-106b-45cb-9b5e-b4cf62b13698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:21.013378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126ecd-106b-45cb-9b5e-b4cf62b13698 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:21.013662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126ecd-106b-45cb-9b5e-b4cf62b13698 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:21.013941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126ecd-106b-45cb-9b5e-b4cf62b13698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:21.028231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84126ecd-106b-45cb-9b5e-b4cf62b13698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:21.029801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84126ecd-106b-45cb-9b5e-b4cf62b13698 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:21.048070 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-84126ecd-106b-45cb-9b5e-b4cf62b13698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:21.049445 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 601/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:21.055590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc005c63-ac4f-4e8b-a4bb-d8676cbbbcf6 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:21.167882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc005c63-ac4f-4e8b-a4bb-d8676cbbbcf6 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:21.203517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb0465-2cf3-4eb8-b60c-50ec77ba6582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:21.204201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb0465-2cf3-4eb8-b60c-50ec77ba6582 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:21.204481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb0465-2cf3-4eb8-b60c-50ec77ba6582 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:21.204752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffb0465-2cf3-4eb8-b60c-50ec77ba6582 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:21.205449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb0465-2cf3-4eb8-b60c-50ec77ba6582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:21.205752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb0465-2cf3-4eb8-b60c-50ec77ba6582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:21.208170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffb0465-2cf3-4eb8-b60c-50ec77ba6582 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:21.220896 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 637/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:37:21.226981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126ecd-106b-45cb-9b5e-b4cf62b13698 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:21.332113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126ecd-106b-45cb-9b5e-b4cf62b13698 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:21.370236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e7c8-975f-4e54-aca9-64ccd1102eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:21.371023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e7c8-975f-4e54-aca9-64ccd1102eec None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:21.371306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e7c8-975f-4e54-aca9-64ccd1102eec None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:21.371581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9e7c8-975f-4e54-aca9-64ccd1102eec None admin] PATH_INFO: `/v3/users/placement` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:21.380228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9e7c8-975f-4e54-aca9-64ccd1102eec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:21.381893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9e7c8-975f-4e54-aca9-64ccd1102eec None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:21.397335 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-02e9e7c8-975f-4e54-aca9-64ccd1102eec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 26 20:37:21.398534 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 602/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 26 20:37:21.404690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb0465-2cf3-4eb8-b60c-50ec77ba6582 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:21.512468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffb0465-2cf3-4eb8-b60c-50ec77ba6582 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:21.553948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2068e2a-60c0-4690-9211-e90f3369ba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:21.554680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2068e2a-60c0-4690-9211-e90f3369ba11 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:21.554993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2068e2a-60c0-4690-9211-e90f3369ba11 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:21.555276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2068e2a-60c0-4690-9211-e90f3369ba11 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:21.556582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2068e2a-60c0-4690-9211-e90f3369ba11 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:21.556691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2068e2a-60c0-4690-9211-e90f3369ba11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:21.558474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2068e2a-60c0-4690-9211-e90f3369ba11 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:21.581481 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 638/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Mar 26 20:37:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:21.587428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e7c8-975f-4e54-aca9-64ccd1102eec None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:21.694563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9e7c8-975f-4e54-aca9-64ccd1102eec None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:21.731117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722854b-5266-4bed-b5a2-abc0fd33fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:21.731839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722854b-5266-4bed-b5a2-abc0fd33fafe None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:21.732219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722854b-5266-4bed-b5a2-abc0fd33fafe None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:21.732572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722854b-5266-4bed-b5a2-abc0fd33fafe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:21.805431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722854b-5266-4bed-b5a2-abc0fd33fafe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:21.807102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722854b-5266-4bed-b5a2-abc0fd33fafe None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:21.911403 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 603/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:37:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 26 20:37:21.917422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2068e2a-60c0-4690-9211-e90f3369ba11 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:22.026161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2068e2a-60c0-4690-9211-e90f3369ba11 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:22.060207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4fb9-0979-4531-a9c6-f786695d6f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:22.061078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4fb9-0979-4531-a9c6-f786695d6f81 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:22.061388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4fb9-0979-4531-a9c6-f786695d6f81 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:22.061631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e4fb9-0979-4531-a9c6-f786695d6f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:22.072521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e4fb9-0979-4531-a9c6-f786695d6f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:22.073960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e4fb9-0979-4531-a9c6-f786695d6f81 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:22.092883 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-288e4fb9-0979-4531-a9c6-f786695d6f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:22.094287 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 639/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:22.100886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722854b-5266-4bed-b5a2-abc0fd33fafe None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:22.207042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722854b-5266-4bed-b5a2-abc0fd33fafe None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:22.244102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c237-e252-4b14-b712-b6ae7c539835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:22.244861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c237-e252-4b14-b712-b6ae7c539835 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:22.245217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c237-e252-4b14-b712-b6ae7c539835 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:22.245558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81c237-e252-4b14-b712-b6ae7c539835 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:22.246340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81c237-e252-4b14-b712-b6ae7c539835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:22.246674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81c237-e252-4b14-b712-b6ae7c539835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:22.248359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81c237-e252-4b14-b712-b6ae7c539835 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:22.261376 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 604/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:22.266847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4fb9-0979-4531-a9c6-f786695d6f81 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:22.377868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e4fb9-0979-4531-a9c6-f786695d6f81 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:22.419719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79783beb-c9b2-412d-b4a9-bc472b45162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:22.420535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79783beb-c9b2-412d-b4a9-bc472b45162e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:22.420825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79783beb-c9b2-412d-b4a9-bc472b45162e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:22.421120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79783beb-c9b2-412d-b4a9-bc472b45162e None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:22.428875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79783beb-c9b2-412d-b4a9-bc472b45162e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:22.430317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79783beb-c9b2-412d-b4a9-bc472b45162e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:22.443854 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-79783beb-c9b2-412d-b4a9-bc472b45162e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:37:22.445043 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 640/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:22.450947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c237-e252-4b14-b712-b6ae7c539835 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:22.559580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81c237-e252-4b14-b712-b6ae7c539835 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:22.599208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85346185-8fab-4915-bc49-20de0d9ab366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:22.599879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85346185-8fab-4915-bc49-20de0d9ab366 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:22.600162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85346185-8fab-4915-bc49-20de0d9ab366 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:22.600430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85346185-8fab-4915-bc49-20de0d9ab366 None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:22.601218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85346185-8fab-4915-bc49-20de0d9ab366 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:22.601527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85346185-8fab-4915-bc49-20de0d9ab366 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:22.602963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85346185-8fab-4915-bc49-20de0d9ab366 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:22.616389 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 605/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:22.622497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79783beb-c9b2-412d-b4a9-bc472b45162e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:22.732553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79783beb-c9b2-412d-b4a9-bc472b45162e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:22.769325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9b766-7197-46fe-9fd5-9c508bcc530d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:22.769981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9b766-7197-46fe-9fd5-9c508bcc530d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:22.770265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9b766-7197-46fe-9fd5-9c508bcc530d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:22.770561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9b766-7197-46fe-9fd5-9c508bcc530d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:22.771514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9b766-7197-46fe-9fd5-9c508bcc530d None admin] RBAC: Adding query filter params (role.id=1d095fda854f45db887c85e1d6d5ac09, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=de5b3a8b36da4df7b905b26aa3e680e2) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:22.771834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9b766-7197-46fe-9fd5-9c508bcc530d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:22.773589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9b766-7197-46fe-9fd5-9c508bcc530d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:22.779989 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 641/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:37:22 2022] GET /identity/v3/role_assignments?user.id=de5b3a8b36da4df7b905b26aa3e680e2&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=1d095fda854f45db887c85e1d6d5ac09 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:25.407374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c4f9-fb55-4863-9c46-6fd5fc47ec68 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:25.408030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c4f9-fb55-4863-9c46-6fd5fc47ec68 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:25.408030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc88c4f9-fb55-4863-9c46-6fd5fc47ec68 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:25.409904 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 606/1247] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:25.418009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053596e9-8634-43fd-9c0b-3d566f06b305 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:25.418465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053596e9-8634-43fd-9c0b-3d566f06b305 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:25.418577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053596e9-8634-43fd-9c0b-3d566f06b305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:25.436064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-053596e9-8634-43fd-9c0b-3d566f06b305 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:25.438474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-053596e9-8634-43fd-9c0b-3d566f06b305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:25.511008 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 642/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:25.538344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c4f9-fb55-4863-9c46-6fd5fc47ec68 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:25.652153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc88c4f9-fb55-4863-9c46-6fd5fc47ec68 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:25.687341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b658c83-f5b1-40da-85b8-86bdbaefc6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:25.688164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b658c83-f5b1-40da-85b8-86bdbaefc6cc None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:25.688445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b658c83-f5b1-40da-85b8-86bdbaefc6cc None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:25.688749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b658c83-f5b1-40da-85b8-86bdbaefc6cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:25.699827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b658c83-f5b1-40da-85b8-86bdbaefc6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:37:25.706993 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2b658c83-f5b1-40da-85b8-86bdbaefc6cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:37:25.708287 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 607/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:37:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:25.714457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053596e9-8634-43fd-9c0b-3d566f06b305 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:25.815279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053596e9-8634-43fd-9c0b-3d566f06b305 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:25.850275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562acf1-6b5a-49fb-b74a-e7f033c210e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:25.850937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562acf1-6b5a-49fb-b74a-e7f033c210e4 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:25.851216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562acf1-6b5a-49fb-b74a-e7f033c210e4 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:25.851487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562acf1-6b5a-49fb-b74a-e7f033c210e4 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:25.852285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562acf1-6b5a-49fb-b74a-e7f033c210e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:25.852588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562acf1-6b5a-49fb-b74a-e7f033c210e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:25.853987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6562acf1-6b5a-49fb-b74a-e7f033c210e4 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:25.862935 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 643/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:37:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:25.868742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b658c83-f5b1-40da-85b8-86bdbaefc6cc None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:25.966416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b658c83-f5b1-40da-85b8-86bdbaefc6cc None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:25.998986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9bac9-ad5a-4c36-8f81-ebf39c52f15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:25.999768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9bac9-ad5a-4c36-8f81-ebf39c52f15d None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:26.000077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9bac9-ad5a-4c36-8f81-ebf39c52f15d None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:26.000376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9bac9-ad5a-4c36-8f81-ebf39c52f15d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:26.011042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9bac9-ad5a-4c36-8f81-ebf39c52f15d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:26.012547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9bac9-ad5a-4c36-8f81-ebf39c52f15d None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:26.030682 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-a0c9bac9-ad5a-4c36-8f81-ebf39c52f15d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:26.031899 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 608/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:26.038216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562acf1-6b5a-49fb-b74a-e7f033c210e4 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:26.135235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562acf1-6b5a-49fb-b74a-e7f033c210e4 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:26.166886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22f1c9-7efc-4617-b617-ba307e6db95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:26.167527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22f1c9-7efc-4617-b617-ba307e6db95d None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:26.167808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22f1c9-7efc-4617-b617-ba307e6db95d None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:26.168119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22f1c9-7efc-4617-b617-ba307e6db95d None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:26.168821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22f1c9-7efc-4617-b617-ba307e6db95d None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:26.169123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22f1c9-7efc-4617-b617-ba307e6db95d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:26.170480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a22f1c9-7efc-4617-b617-ba307e6db95d None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:26.181556 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 644/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:26.187141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9bac9-ad5a-4c36-8f81-ebf39c52f15d None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:26.281014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9bac9-ad5a-4c36-8f81-ebf39c52f15d None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:26.311486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab6894-25bd-4fcf-80cc-83578cd74143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:26.312282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab6894-25bd-4fcf-80cc-83578cd74143 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:26.312565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab6894-25bd-4fcf-80cc-83578cd74143 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:26.312837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab6894-25bd-4fcf-80cc-83578cd74143 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:26.320416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab6894-25bd-4fcf-80cc-83578cd74143 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:26.321854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab6894-25bd-4fcf-80cc-83578cd74143 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:26.335274 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-52ab6894-25bd-4fcf-80cc-83578cd74143 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 26 20:37:26.336420 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 609/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:26.341900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22f1c9-7efc-4617-b617-ba307e6db95d None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:26.435310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a22f1c9-7efc-4617-b617-ba307e6db95d None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:26.466224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac0d22-3cb4-4bef-8e89-6cfd60daf33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:26.466869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac0d22-3cb4-4bef-8e89-6cfd60daf33a None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:26.467145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac0d22-3cb4-4bef-8e89-6cfd60daf33a None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:26.467680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac0d22-3cb4-4bef-8e89-6cfd60daf33a None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:26.468525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac0d22-3cb4-4bef-8e89-6cfd60daf33a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:26.468851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac0d22-3cb4-4bef-8e89-6cfd60daf33a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:26.470752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac0d22-3cb4-4bef-8e89-6cfd60daf33a None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:26.487237 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 645/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Mar 26 20:37:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:26.492888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab6894-25bd-4fcf-80cc-83578cd74143 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:26.599182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab6894-25bd-4fcf-80cc-83578cd74143 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:26.631018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3039b-1cbd-4bda-83a1-97c9bb2176ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:26.631646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3039b-1cbd-4bda-83a1-97c9bb2176ea None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:26.631955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3039b-1cbd-4bda-83a1-97c9bb2176ea None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:26.632233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3039b-1cbd-4bda-83a1-97c9bb2176ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:26.694647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3039b-1cbd-4bda-83a1-97c9bb2176ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:26.696135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3039b-1cbd-4bda-83a1-97c9bb2176ea None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:26.787555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 610/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:37:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:37:26.793354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac0d22-3cb4-4bef-8e89-6cfd60daf33a None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:26.883836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac0d22-3cb4-4bef-8e89-6cfd60daf33a None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:26.915432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638828e3-eeae-40a4-9c01-5ee00b03dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:26.916217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638828e3-eeae-40a4-9c01-5ee00b03dbfd None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:26.916495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638828e3-eeae-40a4-9c01-5ee00b03dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:26.916765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638828e3-eeae-40a4-9c01-5ee00b03dbfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:26.926172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638828e3-eeae-40a4-9c01-5ee00b03dbfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:26.927591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638828e3-eeae-40a4-9c01-5ee00b03dbfd None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:26.943484 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-638828e3-eeae-40a4-9c01-5ee00b03dbfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:26.944611 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 646/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:26.950164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3039b-1cbd-4bda-83a1-97c9bb2176ea None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:27.045681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3039b-1cbd-4bda-83a1-97c9bb2176ea None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:27.077649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f135487-fe4a-406b-9f32-7f4a35e5d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:27.078295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135487-fe4a-406b-9f32-7f4a35e5d633 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:27.078578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135487-fe4a-406b-9f32-7f4a35e5d633 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:27.078855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f135487-fe4a-406b-9f32-7f4a35e5d633 None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:27.080220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f135487-fe4a-406b-9f32-7f4a35e5d633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:27.080529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f135487-fe4a-406b-9f32-7f4a35e5d633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:27.081908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f135487-fe4a-406b-9f32-7f4a35e5d633 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:27.092817 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 611/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:27.098419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638828e3-eeae-40a4-9c01-5ee00b03dbfd None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:27.190626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638828e3-eeae-40a4-9c01-5ee00b03dbfd None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:27.222419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21c9c-7913-4fc2-b2a1-93c2ebdd58b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:27.223174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21c9c-7913-4fc2-b2a1-93c2ebdd58b2 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:27.223458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21c9c-7913-4fc2-b2a1-93c2ebdd58b2 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:27.223735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a21c9c-7913-4fc2-b2a1-93c2ebdd58b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:27.230099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21c9c-7913-4fc2-b2a1-93c2ebdd58b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:27.231524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a21c9c-7913-4fc2-b2a1-93c2ebdd58b2 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:27.243988 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d9a21c9c-7913-4fc2-b2a1-93c2ebdd58b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:37:27.245094 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 647/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:27.250673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f135487-fe4a-406b-9f32-7f4a35e5d633 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:27.344850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f135487-fe4a-406b-9f32-7f4a35e5d633 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:27.376905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656c3da-18cb-434f-b08e-4140fc4e262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:27.377611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656c3da-18cb-434f-b08e-4140fc4e262e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:27.377895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656c3da-18cb-434f-b08e-4140fc4e262e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:27.378172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656c3da-18cb-434f-b08e-4140fc4e262e None admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:27.378943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656c3da-18cb-434f-b08e-4140fc4e262e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:27.379250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656c3da-18cb-434f-b08e-4140fc4e262e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:27.380710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656c3da-18cb-434f-b08e-4140fc4e262e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:27.392561 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 612/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:27.398342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21c9c-7913-4fc2-b2a1-93c2ebdd58b2 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:27.490987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a21c9c-7913-4fc2-b2a1-93c2ebdd58b2 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:27.522226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80b802-2224-4842-91d2-14606661ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:27.522881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80b802-2224-4842-91d2-14606661ccc1 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:27.523171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80b802-2224-4842-91d2-14606661ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:27.523481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80b802-2224-4842-91d2-14606661ccc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:27.524432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80b802-2224-4842-91d2-14606661ccc1 None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=de5b3a8b36da4df7b905b26aa3e680e2) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:27.524860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80b802-2224-4842-91d2-14606661ccc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:27.526409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80b802-2224-4842-91d2-14606661ccc1 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:27.532438 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 648/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:37:27 2022] GET /identity/v3/role_assignments?user.id=de5b3a8b36da4df7b905b26aa3e680e2&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:29.823316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc6a0-4a6d-4611-9562-32388879afee None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:29.823872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc6a0-4a6d-4611-9562-32388879afee None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:29.823872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dcc6a0-4a6d-4611-9562-32388879afee None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:29.825650 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 613/1261] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:29.832000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b7c6-8bcb-42cc-a0bd-2aeb389e59cd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:29.832425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b7c6-8bcb-42cc-a0bd-2aeb389e59cd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:29.832563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa5b7c6-8bcb-42cc-a0bd-2aeb389e59cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:29.849159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-baa5b7c6-8bcb-42cc-a0bd-2aeb389e59cd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:29.850370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-baa5b7c6-8bcb-42cc-a0bd-2aeb389e59cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:29.918792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 649/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:29.943342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcc6a0-4a6d-4611-9562-32388879afee None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:30.038521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dcc6a0-4a6d-4611-9562-32388879afee None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:30.071750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d5484-7e48-4680-9cde-d44f262469be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:30.072559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d5484-7e48-4680-9cde-d44f262469be None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:30.072848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d5484-7e48-4680-9cde-d44f262469be None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:30.073125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d5484-7e48-4680-9cde-d44f262469be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:30.082698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d5484-7e48-4680-9cde-d44f262469be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:37:30.089381 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-f12d5484-7e48-4680-9cde-d44f262469be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:37:30.090533 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 614/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:37:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:30.097206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b7c6-8bcb-42cc-a0bd-2aeb389e59cd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:30.189402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa5b7c6-8bcb-42cc-a0bd-2aeb389e59cd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:30.221160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc64d5-2e66-481d-a800-207d640d5006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:30.221804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc64d5-2e66-481d-a800-207d640d5006 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:30.222087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc64d5-2e66-481d-a800-207d640d5006 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:30.222364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc64d5-2e66-481d-a800-207d640d5006 None admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:30.223091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc64d5-2e66-481d-a800-207d640d5006 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:30.223394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc64d5-2e66-481d-a800-207d640d5006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:30.224789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc64d5-2e66-481d-a800-207d640d5006 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:30.232378 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 650/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:30.238554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d5484-7e48-4680-9cde-d44f262469be None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:30.331174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d5484-7e48-4680-9cde-d44f262469be None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:30.363116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476efd6-43f8-481d-8330-b4dc06507db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:30.363813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476efd6-43f8-481d-8330-b4dc06507db6 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:30.364130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476efd6-43f8-481d-8330-b4dc06507db6 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:30.364412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2476efd6-43f8-481d-8330-b4dc06507db6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:30.374991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476efd6-43f8-481d-8330-b4dc06507db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:30.376512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2476efd6-43f8-481d-8330-b4dc06507db6 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:30.392388 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2476efd6-43f8-481d-8330-b4dc06507db6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:30.393493 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 615/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:30.398820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc64d5-2e66-481d-a800-207d640d5006 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:30.491193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc64d5-2e66-481d-a800-207d640d5006 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:30.522409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98033f-7214-4363-9eba-57cc43227888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:30.523043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98033f-7214-4363-9eba-57cc43227888 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:30.523328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98033f-7214-4363-9eba-57cc43227888 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:30.523636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98033f-7214-4363-9eba-57cc43227888 None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:30.524454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98033f-7214-4363-9eba-57cc43227888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:30.524779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98033f-7214-4363-9eba-57cc43227888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:30.526309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98033f-7214-4363-9eba-57cc43227888 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:30.539747 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 651/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:37:30.545741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476efd6-43f8-481d-8330-b4dc06507db6 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:30.649365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2476efd6-43f8-481d-8330-b4dc06507db6 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:30.680834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf1a27-9ef4-47a6-af5d-92d4c799e131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:30.681620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1a27-9ef4-47a6-af5d-92d4c799e131 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:30.681903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1a27-9ef4-47a6-af5d-92d4c799e131 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:30.682175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf1a27-9ef4-47a6-af5d-92d4c799e131 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:30.689308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf1a27-9ef4-47a6-af5d-92d4c799e131 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:30.690758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf1a27-9ef4-47a6-af5d-92d4c799e131 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:30.703712 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-99bf1a27-9ef4-47a6-af5d-92d4c799e131 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 26 20:37:30.705414 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 616/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:30.711381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98033f-7214-4363-9eba-57cc43227888 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:30.804789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98033f-7214-4363-9eba-57cc43227888 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:30.836719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27e44a-40df-4017-83c5-6da04d6e4750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:30.837361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27e44a-40df-4017-83c5-6da04d6e4750 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:30.837642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27e44a-40df-4017-83c5-6da04d6e4750 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:30.837918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27e44a-40df-4017-83c5-6da04d6e4750 None admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:30.838726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27e44a-40df-4017-83c5-6da04d6e4750 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:30.839030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27e44a-40df-4017-83c5-6da04d6e4750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:30.840479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27e44a-40df-4017-83c5-6da04d6e4750 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:30.856702 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 652/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Mar 26 20:37:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:30.862258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf1a27-9ef4-47a6-af5d-92d4c799e131 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:30.956949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf1a27-9ef4-47a6-af5d-92d4c799e131 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:30.988231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19b669-18dd-41bc-a2fd-11653e3c204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:30.988991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19b669-18dd-41bc-a2fd-11653e3c204a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:30.989273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19b669-18dd-41bc-a2fd-11653e3c204a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:30.989548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19b669-18dd-41bc-a2fd-11653e3c204a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:30.999504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19b669-18dd-41bc-a2fd-11653e3c204a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:31.000992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e19b669-18dd-41bc-a2fd-11653e3c204a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:31.017670 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0e19b669-18dd-41bc-a2fd-11653e3c204a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:31.018833 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 617/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:31.024344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27e44a-40df-4017-83c5-6da04d6e4750 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:31.117247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27e44a-40df-4017-83c5-6da04d6e4750 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:31.149219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db901558-c2e6-49be-a50d-08b555b93f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:31.149862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db901558-c2e6-49be-a50d-08b555b93f3e None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:31.150143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db901558-c2e6-49be-a50d-08b555b93f3e None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:31.150418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db901558-c2e6-49be-a50d-08b555b93f3e None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:31.151117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db901558-c2e6-49be-a50d-08b555b93f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:31.151421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db901558-c2e6-49be-a50d-08b555b93f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:31.152821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db901558-c2e6-49be-a50d-08b555b93f3e None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:31.163518 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 653/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:31.169057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19b669-18dd-41bc-a2fd-11653e3c204a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:31.263379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e19b669-18dd-41bc-a2fd-11653e3c204a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:31.294753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad424f37-a7d5-4d58-9622-aac6abf1398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:31.295531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad424f37-a7d5-4d58-9622-aac6abf1398e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:31.295816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad424f37-a7d5-4d58-9622-aac6abf1398e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:31.296133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad424f37-a7d5-4d58-9622-aac6abf1398e None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:31.303092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad424f37-a7d5-4d58-9622-aac6abf1398e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:31.304619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad424f37-a7d5-4d58-9622-aac6abf1398e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:31.318054 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-ad424f37-a7d5-4d58-9622-aac6abf1398e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:37:31.319165 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 618/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:31.324721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db901558-c2e6-49be-a50d-08b555b93f3e None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:31.417491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db901558-c2e6-49be-a50d-08b555b93f3e None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:31.448669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763db858-df02-486d-846f-243dfc15c35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:31.449307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763db858-df02-486d-846f-243dfc15c35b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:31.449591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763db858-df02-486d-846f-243dfc15c35b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:31.449869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763db858-df02-486d-846f-243dfc15c35b None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:31.450636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763db858-df02-486d-846f-243dfc15c35b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:31.450947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763db858-df02-486d-846f-243dfc15c35b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:31.452419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763db858-df02-486d-846f-243dfc15c35b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:31.465153 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 654/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:37:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:31.471632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad424f37-a7d5-4d58-9622-aac6abf1398e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:31.568345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad424f37-a7d5-4d58-9622-aac6abf1398e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:31.600717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd595f82-1c57-4cee-bdde-73ed75ffc34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:31.601588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd595f82-1c57-4cee-bdde-73ed75ffc34f None admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:31.601870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd595f82-1c57-4cee-bdde-73ed75ffc34f None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:31.602142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd595f82-1c57-4cee-bdde-73ed75ffc34f None admin] PATH_INFO: `/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/de5b3a8b36da4df7b905b26aa3e680e2/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:31.604138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd595f82-1c57-4cee-bdde-73ed75ffc34f None admin] RBAC: Authorizing `identity:create_grant(project_id=5d311a58db4c44ebbd88fbdf463fab47, user_id=de5b3a8b36da4df7b905b26aa3e680e2, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:31.605579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd595f82-1c57-4cee-bdde-73ed75ffc34f None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:31.617493 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 619/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Mar 26 20:37:31 2022] PUT /identity/v3/projects/5d311a58db4c44ebbd88fbdf463fab47/users/de5b3a8b36da4df7b905b26aa3e680e2/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:37:33.904154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6749-6717-4215-ad5c-2bb668b39546 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:33.904716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6749-6717-4215-ad5c-2bb668b39546 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:33.904716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc6749-6717-4215-ad5c-2bb668b39546 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:33.906429 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 655/1274] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:33.913226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d755-9913-441f-a104-3eb86b9d829e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:33.913635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d755-9913-441f-a104-3eb86b9d829e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:33.913778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0d755-9913-441f-a104-3eb86b9d829e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:33.931337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-11c0d755-9913-441f-a104-3eb86b9d829e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:33.932540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-11c0d755-9913-441f-a104-3eb86b9d829e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:33.995537 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 620/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:34.021177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6749-6717-4215-ad5c-2bb668b39546 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:34.116418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc6749-6717-4215-ad5c-2bb668b39546 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:34.147964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c2825-6df9-4bff-9abe-f59d44205ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:34.148739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2825-6df9-4bff-9abe-f59d44205ea8 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:34.149024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2825-6df9-4bff-9abe-f59d44205ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:34.149300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2825-6df9-4bff-9abe-f59d44205ea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:34.159510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c2825-6df9-4bff-9abe-f59d44205ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 20:37:34.166231 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-c23c2825-6df9-4bff-9abe-f59d44205ea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 26 20:37:34.167375 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 656/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Mar 26 20:37:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:34.173402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d755-9913-441f-a104-3eb86b9d829e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:34.265233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0d755-9913-441f-a104-3eb86b9d829e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:34.297266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b6170-4e6d-49d5-a71f-24feac9707d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:34.297907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b6170-4e6d-49d5-a71f-24feac9707d2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:34.298714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b6170-4e6d-49d5-a71f-24feac9707d2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:34.298987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b6170-4e6d-49d5-a71f-24feac9707d2 None admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:34.299711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b6170-4e6d-49d5-a71f-24feac9707d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:34.300045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b6170-4e6d-49d5-a71f-24feac9707d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:34.301411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b6170-4e6d-49d5-a71f-24feac9707d2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:34.308960 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 621/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Mar 26 20:37:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:34.314926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c2825-6df9-4bff-9abe-f59d44205ea8 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:34.406900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c2825-6df9-4bff-9abe-f59d44205ea8 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:34.437706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abef3d-1764-4757-bfee-c0eb7232d557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:34.438456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abef3d-1764-4757-bfee-c0eb7232d557 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:34.439300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abef3d-1764-4757-bfee-c0eb7232d557 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:34.439581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abef3d-1764-4757-bfee-c0eb7232d557 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:34.449463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abef3d-1764-4757-bfee-c0eb7232d557 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:34.450894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abef3d-1764-4757-bfee-c0eb7232d557 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:34.466287 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-55abef3d-1764-4757-bfee-c0eb7232d557 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:34.467385 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 657/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:34.473136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b6170-4e6d-49d5-a71f-24feac9707d2 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:34.575874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b6170-4e6d-49d5-a71f-24feac9707d2 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:34.609401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37ee2d-ac80-4553-81d5-6b3900f9f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:34.610070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37ee2d-ac80-4553-81d5-6b3900f9f24e None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:34.610349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37ee2d-ac80-4553-81d5-6b3900f9f24e None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:34.610689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37ee2d-ac80-4553-81d5-6b3900f9f24e None admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:34.611394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37ee2d-ac80-4553-81d5-6b3900f9f24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:34.611699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37ee2d-ac80-4553-81d5-6b3900f9f24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:34.613101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37ee2d-ac80-4553-81d5-6b3900f9f24e None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:34.624119 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 622/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:34.630343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abef3d-1764-4757-bfee-c0eb7232d557 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:34.724647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abef3d-1764-4757-bfee-c0eb7232d557 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:34.755686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125b172-e2ea-432e-9334-c5689d2ec058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:34.756478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125b172-e2ea-432e-9334-c5689d2ec058 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:34.756759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125b172-e2ea-432e-9334-c5689d2ec058 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:34.757031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125b172-e2ea-432e-9334-c5689d2ec058 None admin] PATH_INFO: `/v3/users/placement` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:34.764004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125b172-e2ea-432e-9334-c5689d2ec058 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:34.765432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125b172-e2ea-432e-9334-c5689d2ec058 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:34.778778 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-5125b172-e2ea-432e-9334-c5689d2ec058 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 26 20:37:34.779877 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 658/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:34.785452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37ee2d-ac80-4553-81d5-6b3900f9f24e None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:34.878400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37ee2d-ac80-4553-81d5-6b3900f9f24e None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:34.909832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2d3c6-118f-4263-aa8f-96e00b5b41ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:34.910482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d3c6-118f-4263-aa8f-96e00b5b41ba None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:34.910763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d3c6-118f-4263-aa8f-96e00b5b41ba None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:34.911036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2d3c6-118f-4263-aa8f-96e00b5b41ba None admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:34.911848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2d3c6-118f-4263-aa8f-96e00b5b41ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:34.912185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2d3c6-118f-4263-aa8f-96e00b5b41ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:34.913607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2d3c6-118f-4263-aa8f-96e00b5b41ba None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:34.930050 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 623/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Mar 26 20:37:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:34.935587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125b172-e2ea-432e-9334-c5689d2ec058 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:35.031446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125b172-e2ea-432e-9334-c5689d2ec058 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:35.063209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fde5d-bd3a-47ff-9b17-2c56842771a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:35.064502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fde5d-bd3a-47ff-9b17-2c56842771a8 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:35.064790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fde5d-bd3a-47ff-9b17-2c56842771a8 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:35.065071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182fde5d-bd3a-47ff-9b17-2c56842771a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:35.127737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fde5d-bd3a-47ff-9b17-2c56842771a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:35.129216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182fde5d-bd3a-47ff-9b17-2c56842771a8 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:35.220014 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 659/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Mar 26 20:37:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 26 20:37:35.225850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2d3c6-118f-4263-aa8f-96e00b5b41ba None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:35.318474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2d3c6-118f-4263-aa8f-96e00b5b41ba None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:35.350113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdfc18-3e86-44a1-9c1c-11bb05272811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:35.350873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdfc18-3e86-44a1-9c1c-11bb05272811 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:35.351152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdfc18-3e86-44a1-9c1c-11bb05272811 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:35.351421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bdfc18-3e86-44a1-9c1c-11bb05272811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:35.361452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdfc18-3e86-44a1-9c1c-11bb05272811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:35.362892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bdfc18-3e86-44a1-9c1c-11bb05272811 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:35.379693 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-97bdfc18-3e86-44a1-9c1c-11bb05272811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 26 20:37:35.380844 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 624/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:35.386184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fde5d-bd3a-47ff-9b17-2c56842771a8 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:35.477749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182fde5d-bd3a-47ff-9b17-2c56842771a8 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:35.509202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0698ca-0ef9-4fe0-8195-74febe04715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:35.509834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0698ca-0ef9-4fe0-8195-74febe04715b None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:35.510116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0698ca-0ef9-4fe0-8195-74febe04715b None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:35.510393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0698ca-0ef9-4fe0-8195-74febe04715b None admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:35.511086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0698ca-0ef9-4fe0-8195-74febe04715b None admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:35.511388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0698ca-0ef9-4fe0-8195-74febe04715b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:35.512775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0698ca-0ef9-4fe0-8195-74febe04715b None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:35.523286 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 660/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Mar 26 20:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:35.528938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdfc18-3e86-44a1-9c1c-11bb05272811 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:35.625148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bdfc18-3e86-44a1-9c1c-11bb05272811 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:35.656436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ff035-413c-487c-84f5-3354ff2ca35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:35.657197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ff035-413c-487c-84f5-3354ff2ca35a None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:35.658062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ff035-413c-487c-84f5-3354ff2ca35a None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:35.658337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ff035-413c-487c-84f5-3354ff2ca35a None admin] PATH_INFO: `/v3/projects/service` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:35.664616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ff035-413c-487c-84f5-3354ff2ca35a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:35.666059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ff035-413c-487c-84f5-3354ff2ca35a None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:35.678495 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-8e6ff035-413c-487c-84f5-3354ff2ca35a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 26 20:37:35.679634 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 625/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Mar 26 20:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:35.685356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0698ca-0ef9-4fe0-8195-74febe04715b None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:35.777145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0698ca-0ef9-4fe0-8195-74febe04715b None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:35.807787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d58f06-072e-4162-8c0c-dc5e1eac6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:35.808438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d58f06-072e-4162-8c0c-dc5e1eac6b18 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:35.808716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d58f06-072e-4162-8c0c-dc5e1eac6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:35.808988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d58f06-072e-4162-8c0c-dc5e1eac6b18 None admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:35.809740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d58f06-072e-4162-8c0c-dc5e1eac6b18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:35.810041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d58f06-072e-4162-8c0c-dc5e1eac6b18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:35.811450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d58f06-072e-4162-8c0c-dc5e1eac6b18 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:35.822658 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 661/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Mar 26 20:37:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:35.828332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ff035-413c-487c-84f5-3354ff2ca35a None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:35.922760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ff035-413c-487c-84f5-3354ff2ca35a None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:35.953789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34814a-12c3-44ce-a552-9f406a9374ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:35.954934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34814a-12c3-44ce-a552-9f406a9374ef None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:35.955213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34814a-12c3-44ce-a552-9f406a9374ef None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:35.955490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34814a-12c3-44ce-a552-9f406a9374ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:35.956326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34814a-12c3-44ce-a552-9f406a9374ef None admin] RBAC: Adding query filter params (role.id=8160adb3a8504dd3b239b60abf8bde28, scope.project.id=5d311a58db4c44ebbd88fbdf463fab47, user.id=de5b3a8b36da4df7b905b26aa3e680e2) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:35.956636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34814a-12c3-44ce-a552-9f406a9374ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:35.958067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34814a-12c3-44ce-a552-9f406a9374ef None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:35.963697 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 626/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Mar 26 20:37:35 2022] GET /identity/v3/role_assignments?user.id=de5b3a8b36da4df7b905b26aa3e680e2&scope.project.id=5d311a58db4c44ebbd88fbdf463fab47&role.id=8160adb3a8504dd3b239b60abf8bde28 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:38.320638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda7d74-02f5-4523-974e-d298fb46e959 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:38.321144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda7d74-02f5-4523-974e-d298fb46e959 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:38.321144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda7d74-02f5-4523-974e-d298fb46e959 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:38.322841 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 662/1288] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:38.329209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963893-e7f0-4613-8ba8-6cfe1c619d56 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:38.330157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963893-e7f0-4613-8ba8-6cfe1c619d56 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:38.330391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963893-e7f0-4613-8ba8-6cfe1c619d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:38.346935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-22963893-e7f0-4613-8ba8-6cfe1c619d56 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:38.348131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-22963893-e7f0-4613-8ba8-6cfe1c619d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:38.409692 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 627/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:38.432336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda7d74-02f5-4523-974e-d298fb46e959 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:38.527856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda7d74-02f5-4523-974e-d298fb46e959 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:38.563261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27bc9-63c1-48c3-8af4-97676cd19531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:38.564580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27bc9-63c1-48c3-8af4-97676cd19531 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:38.564862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27bc9-63c1-48c3-8af4-97676cd19531 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:38.565134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd27bc9-63c1-48c3-8af4-97676cd19531 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:38.565775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd27bc9-63c1-48c3-8af4-97676cd19531 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:38.567155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd27bc9-63c1-48c3-8af4-97676cd19531 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:38.578030 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-5cd27bc9-63c1-48c3-8af4-97676cd19531 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 26 20:37:38.579140 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 663/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:37:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:38.586508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963893-e7f0-4613-8ba8-6cfe1c619d56 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:38.680582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963893-e7f0-4613-8ba8-6cfe1c619d56 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:38.713225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee961b6-7804-42b0-bbc7-b5bbe159d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:38.713869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee961b6-7804-42b0-bbc7-b5bbe159d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:38.714148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee961b6-7804-42b0-bbc7-b5bbe159d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:38.714423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee961b6-7804-42b0-bbc7-b5bbe159d7a2 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:38.715113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee961b6-7804-42b0-bbc7-b5bbe159d7a2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:38.715416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee961b6-7804-42b0-bbc7-b5bbe159d7a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:38.716810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee961b6-7804-42b0-bbc7-b5bbe159d7a2 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:38.721772 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 628/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Mar 26 20:37:38 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:38.727566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27bc9-63c1-48c3-8af4-97676cd19531 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:38.820983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd27bc9-63c1-48c3-8af4-97676cd19531 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:38.851877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07c534-a4ac-4d88-9017-6faa666f5e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:38.852483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c534-a4ac-4d88-9017-6faa666f5e45 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:38.852765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c534-a4ac-4d88-9017-6faa666f5e45 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:38.853042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07c534-a4ac-4d88-9017-6faa666f5e45 None admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:38.853724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c534-a4ac-4d88-9017-6faa666f5e45 None admin] RBAC: Adding query filter params (type=placement) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:38.854027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c534-a4ac-4d88-9017-6faa666f5e45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:38.855381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07c534-a4ac-4d88-9017-6faa666f5e45 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:38.859673 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 664/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Mar 26 20:37:38 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:41.177389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840a17-b196-4c1f-90be-9e35ad3cc45a None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:41.177912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840a17-b196-4c1f-90be-9e35ad3cc45a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:41.178024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b840a17-b196-4c1f-90be-9e35ad3cc45a None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:41.179724 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 629/1293] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:41.186120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a26c30-4168-49c3-acf5-b77e8a20184f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:41.186522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a26c30-4168-49c3-acf5-b77e8a20184f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:41.186661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a26c30-4168-49c3-acf5-b77e8a20184f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:41.202860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-93a26c30-4168-49c3-acf5-b77e8a20184f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:41.204065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-93a26c30-4168-49c3-acf5-b77e8a20184f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:41.268823 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 665/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 26 20:37:41.291871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b840a17-b196-4c1f-90be-9e35ad3cc45a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:41.385556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b840a17-b196-4c1f-90be-9e35ad3cc45a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:41.416749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d1e54-f938-443b-b76d-5fea30cb58f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:41.417381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1e54-f938-443b-b76d-5fea30cb58f3 None admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:41.417657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1e54-f938-443b-b76d-5fea30cb58f3 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:41.417927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d1e54-f938-443b-b76d-5fea30cb58f3 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:41.418637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1e54-f938-443b-b76d-5fea30cb58f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:41.420026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d1e54-f938-443b-b76d-5fea30cb58f3 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:41.432381 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 630/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Mar 26 20:37:41 2022] POST /identity/v3/services => generated 246 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:37:43.799152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b749285-e1a7-40b2-82d2-a13422093d8b None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:43.799802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b749285-e1a7-40b2-82d2-a13422093d8b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:43.799802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b749285-e1a7-40b2-82d2-a13422093d8b None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:43.801677 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 666/1296] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:43.808868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c441852-ded2-437a-a253-4864e6c9b172 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:43.809300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c441852-ded2-437a-a253-4864e6c9b172 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:43.809427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c441852-ded2-437a-a253-4864e6c9b172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:43.825753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9c441852-ded2-437a-a253-4864e6c9b172 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:43.826922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9c441852-ded2-437a-a253-4864e6c9b172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:43.896783 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 631/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:43.920888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b749285-e1a7-40b2-82d2-a13422093d8b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:44.015707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b749285-e1a7-40b2-82d2-a13422093d8b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:44.048999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d04e87-4023-409e-a56b-785598390370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:44.049822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d04e87-4023-409e-a56b-785598390370 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:44.050053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d04e87-4023-409e-a56b-785598390370 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:44.050325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d04e87-4023-409e-a56b-785598390370 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:44.050962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d04e87-4023-409e-a56b-785598390370 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:44.052467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d04e87-4023-409e-a56b-785598390370 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:44.062904 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-63d04e87-4023-409e-a56b-785598390370 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 26 20:37:44.064046 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 667/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:37:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:44.070056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c441852-ded2-437a-a253-4864e6c9b172 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:44.161204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c441852-ded2-437a-a253-4864e6c9b172 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:44.191847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a9305-a2ff-4034-a0e2-f5428ff26722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:44.192510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a9305-a2ff-4034-a0e2-f5428ff26722 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:44.192789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a9305-a2ff-4034-a0e2-f5428ff26722 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:44.193058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a9305-a2ff-4034-a0e2-f5428ff26722 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:44.193748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a9305-a2ff-4034-a0e2-f5428ff26722 None admin] RBAC: Adding query filter params (name=placement) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:44.194054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a9305-a2ff-4034-a0e2-f5428ff26722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:44.195413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a9305-a2ff-4034-a0e2-f5428ff26722 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:44.200245 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 632/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Mar 26 20:37:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:44.206346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d04e87-4023-409e-a56b-785598390370 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:44.299770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d04e87-4023-409e-a56b-785598390370 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:44.330265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde1f01-1b77-4d36-91d8-966a9c2ad1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:44.330832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1f01-1b77-4d36-91d8-966a9c2ad1fa None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:44.331109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1f01-1b77-4d36-91d8-966a9c2ad1fa None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:44.331380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde1f01-1b77-4d36-91d8-966a9c2ad1fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:44.332170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde1f01-1b77-4d36-91d8-966a9c2ad1fa None admin] RBAC: Adding query filter params (interface=public, service_id=ff95b45ada004195a2f362760bff985c, region_id=RegionOne) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:44.332480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde1f01-1b77-4d36-91d8-966a9c2ad1fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:44.333831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde1f01-1b77-4d36-91d8-966a9c2ad1fa None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:44.338491 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 668/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Mar 26 20:37:44 2022] GET /identity/v3/endpoints?service_id=ff95b45ada004195a2f362760bff985c&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:44.344055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a9305-a2ff-4034-a0e2-f5428ff26722 None admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:44.436299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a9305-a2ff-4034-a0e2-f5428ff26722 None admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:44.467036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c93c37-11f1-4da6-b6bc-1a3ff25cdc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:44.467974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c93c37-11f1-4da6-b6bc-1a3ff25cdc44 None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:44.468259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c93c37-11f1-4da6-b6bc-1a3ff25cdc44 None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:44.468534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c93c37-11f1-4da6-b6bc-1a3ff25cdc44 None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:44.469194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c93c37-11f1-4da6-b6bc-1a3ff25cdc44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:44.471048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c93c37-11f1-4da6-b6bc-1a3ff25cdc44 None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:44.477571 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 633/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Mar 26 20:37:44 2022] GET /identity/v3/services => generated 2191 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:37:46.838560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaee03-75be-437a-9b6e-4a86bd131bca None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:46.839134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaee03-75be-437a-9b6e-4a86bd131bca None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:46.839134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaee03-75be-437a-9b6e-4a86bd131bca None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:46.840918 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 669/1302] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:37:46.847401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a204bb-3477-411f-a6d7-da68e6335310 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:46.847849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a204bb-3477-411f-a6d7-da68e6335310 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:46.847972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a204bb-3477-411f-a6d7-da68e6335310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:46.864190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-84a204bb-3477-411f-a6d7-da68e6335310 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:37:46.865340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-84a204bb-3477-411f-a6d7-da68e6335310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:37:46.927372 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 634/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:37:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 20:37:46.952217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaee03-75be-437a-9b6e-4a86bd131bca None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:47.047450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eaee03-75be-437a-9b6e-4a86bd131bca None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:47.079651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3792e-ee02-472b-ab33-4a7ba99b4302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:47.080484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3792e-ee02-472b-ab33-4a7ba99b4302 None admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:47.080766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3792e-ee02-472b-ab33-4a7ba99b4302 None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:47.081038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3792e-ee02-472b-ab33-4a7ba99b4302 None admin] PATH_INFO: `/v3/services/placement` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:47.081671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3792e-ee02-472b-ab33-4a7ba99b4302 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:47.083033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3792e-ee02-472b-ab33-4a7ba99b4302 None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:47.093796 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-84b3792e-ee02-472b-ab33-4a7ba99b4302 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 26 20:37:47.094924 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 670/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Mar 26 20:37:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:37:47.100912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a204bb-3477-411f-a6d7-da68e6335310 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:47.192026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a204bb-3477-411f-a6d7-da68e6335310 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:47.222971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f507dd5a-7277-4149-90b7-0b28727e241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:47.223604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507dd5a-7277-4149-90b7-0b28727e241c None admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:47.223893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507dd5a-7277-4149-90b7-0b28727e241c None admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:47.224190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507dd5a-7277-4149-90b7-0b28727e241c None admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:47.224873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507dd5a-7277-4149-90b7-0b28727e241c None admin] RBAC: Adding query filter params (name=placement) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:37:47.225173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507dd5a-7277-4149-90b7-0b28727e241c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:47.226539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f507dd5a-7277-4149-90b7-0b28727e241c None admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:47.231329 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 635/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Mar 26 20:37:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:37:47.237205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3792e-ee02-472b-ab33-4a7ba99b4302 None admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:37:47.329463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3792e-ee02-472b-ab33-4a7ba99b4302 None admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:37:47.360444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feebc8e-fc2f-411d-9c39-7b0ec0f851bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:37:47.361558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feebc8e-fc2f-411d-9c39-7b0ec0f851bd None admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:37:47.361838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feebc8e-fc2f-411d-9c39-7b0ec0f851bd None admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:37:47.362111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feebc8e-fc2f-411d-9c39-7b0ec0f851bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:37:47.362825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feebc8e-fc2f-411d-9c39-7b0ec0f851bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:37:47.364189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feebc8e-fc2f-411d-9c39-7b0ec0f851bd None admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:37:47.380897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 671/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Mar 26 20:37:47 2022] POST /identity/v3/endpoints => generated 331 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:38:58.088884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684f44-5a94-49b7-a4ab-251df7b18e4d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:38:58.090265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684f44-5a94-49b7-a4ab-251df7b18e4d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:38:58.090892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03684f44-5a94-49b7-a4ab-251df7b18e4d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:38:58.093542 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 636/1307] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:38:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:38:58.100389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011fcc8-284b-40a1-a00a-f659c772bb93 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:38:58.101214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011fcc8-284b-40a1-a00a-f659c772bb93 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:38:58.101656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011fcc8-284b-40a1-a00a-f659c772bb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:38:58.188585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1011fcc8-284b-40a1-a00a-f659c772bb93 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:38:58.190045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1011fcc8-284b-40a1-a00a-f659c772bb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:38:58.324491 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 672/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:38:58.365821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837ea7b-1656-4f91-8a0f-b3166b129584 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:38:58.366169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837ea7b-1656-4f91-8a0f-b3166b129584 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:38:58.366370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837ea7b-1656-4f91-8a0f-b3166b129584 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:38:58.368494 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 637/1309] 10.222.0.16 () {54 vars in 963 bytes} [Sat Mar 26 20:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:38:58.378439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad949d-6c69-407d-9336-b20c3d612719 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:38:58.378726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad949d-6c69-407d-9336-b20c3d612719 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:38:58.379000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad949d-6c69-407d-9336-b20c3d612719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:38:58.489727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bcad949d-6c69-407d-9336-b20c3d612719 None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:38:58.491234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bcad949d-6c69-407d-9336-b20c3d612719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:38:58.587037 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 673/1310] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Mar 26 20:38:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:38:58.598968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837ea7b-1656-4f91-8a0f-b3166b129584 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:38:58.601010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4837ea7b-1656-4f91-8a0f-b3166b129584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:38:58.725725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837ea7b-1656-4f91-8a0f-b3166b129584 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:38:58.801939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dfb8cb-b488-4a7d-828f-c3bce147833e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:38:58.802847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb8cb-b488-4a7d-828f-c3bce147833e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:38:58.803275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb8cb-b488-4a7d-828f-c3bce147833e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:38:58.803724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb8cb-b488-4a7d-828f-c3bce147833e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:38:58.805517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-11dfb8cb-b488-4a7d-828f-c3bce147833e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:38:58.919258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfb8cb-b488-4a7d-828f-c3bce147833e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:38:58.920957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dfb8cb-b488-4a7d-828f-c3bce147833e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:38:58.940931 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 638/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:01.664578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe110bb2-5ce3-4649-a33c-2ab9b4ef553e None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:01.665447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe110bb2-5ce3-4649-a33c-2ab9b4ef553e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:01.665735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe110bb2-5ce3-4649-a33c-2ab9b4ef553e None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:01.667510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 674/1312] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:01.674773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ee4eb-f029-44b0-8a98-304767f5561d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:01.675238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ee4eb-f029-44b0-8a98-304767f5561d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:01.675328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ee4eb-f029-44b0-8a98-304767f5561d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:01.746844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1e4ee4eb-f029-44b0-8a98-304767f5561d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:01.748080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1e4ee4eb-f029-44b0-8a98-304767f5561d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:01.842185 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 639/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:01.882122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe110bb2-5ce3-4649-a33c-2ab9b4ef553e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:01.883861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fe110bb2-5ce3-4649-a33c-2ab9b4ef553e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:01.988773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe110bb2-5ce3-4649-a33c-2ab9b4ef553e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:02.061014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c3cd6-0395-43d5-bf38-3d0e7b755f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:02.061657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c3cd6-0395-43d5-bf38-3d0e7b755f7d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:02.061941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c3cd6-0395-43d5-bf38-3d0e7b755f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:02.062217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c3cd6-0395-43d5-bf38-3d0e7b755f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:02.064415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9a2c3cd6-0395-43d5-bf38-3d0e7b755f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:02.167500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c3cd6-0395-43d5-bf38-3d0e7b755f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:02.168982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c3cd6-0395-43d5-bf38-3d0e7b755f7d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:02.187580 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 675/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:04.870654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3b8f-8921-4e19-9c10-b9598d3eec77 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:04.871189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3b8f-8921-4e19-9c10-b9598d3eec77 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:04.871284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a3b8f-8921-4e19-9c10-b9598d3eec77 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:04.873047 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 640/1315] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:04.879929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d611-ba4c-4163-ae70-f6c197c04061 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:04.880383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d611-ba4c-4163-ae70-f6c197c04061 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:04.880478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d611-ba4c-4163-ae70-f6c197c04061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:04.943817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0b66d611-ba4c-4163-ae70-f6c197c04061 None None] MFA Rules not processed for user `3928202b4ef24ba2bc9eb5d29b739b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:04.945019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0b66d611-ba4c-4163-ae70-f6c197c04061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:05.037013 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 676/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:05.093757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48faa-3588-4e61-823c-1cbeea9809d8 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:05.094044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48faa-3588-4e61-823c-1cbeea9809d8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:05.094330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db48faa-3588-4e61-823c-1cbeea9809d8 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:05.096169 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 641/1317] 10.222.0.16 () {54 vars in 963 bytes} [Sat Mar 26 20:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:05.101890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108d271-f57b-4bae-8513-b5704951130f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:05.102177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108d271-f57b-4bae-8513-b5704951130f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:05.102478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108d271-f57b-4bae-8513-b5704951130f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:05.173193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4108d271-f57b-4bae-8513-b5704951130f None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:05.174365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4108d271-f57b-4bae-8513-b5704951130f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:05.245704 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 677/1318] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Mar 26 20:39:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:05.255181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db48faa-3588-4e61-823c-1cbeea9809d8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:05.256774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7db48faa-3588-4e61-823c-1cbeea9809d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:05.354358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db48faa-3588-4e61-823c-1cbeea9809d8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:05.424842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322910a-d9aa-4a2f-b1b4-3278fac0ed3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:05.425414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322910a-d9aa-4a2f-b1b4-3278fac0ed3e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:05.425701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322910a-d9aa-4a2f-b1b4-3278fac0ed3e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:05.425981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322910a-d9aa-4a2f-b1b4-3278fac0ed3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:05.427584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e322910a-d9aa-4a2f-b1b4-3278fac0ed3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:05.530847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322910a-d9aa-4a2f-b1b4-3278fac0ed3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:05.532822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322910a-d9aa-4a2f-b1b4-3278fac0ed3e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:05.550909 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 642/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:08.792760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980afd9-4824-4083-9c42-581c604afdc2 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:08.793291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980afd9-4824-4083-9c42-581c604afdc2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:08.793410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980afd9-4824-4083-9c42-581c604afdc2 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:08.795082 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 678/1320] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:08.801626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e52e89-25aa-4824-8c2d-e80c8313d14e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:08.802053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e52e89-25aa-4824-8c2d-e80c8313d14e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:08.802176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e52e89-25aa-4824-8c2d-e80c8313d14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:08.866265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-37e52e89-25aa-4824-8c2d-e80c8313d14e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:08.867437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-37e52e89-25aa-4824-8c2d-e80c8313d14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:08.957511 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 643/1321] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:08.997231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980afd9-4824-4083-9c42-581c604afdc2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:08.998744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a980afd9-4824-4083-9c42-581c604afdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:09.099745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980afd9-4824-4083-9c42-581c604afdc2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:09.170254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746a83-2355-418f-b93a-0c417873be08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:09.170887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746a83-2355-418f-b93a-0c417873be08 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:09.171180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746a83-2355-418f-b93a-0c417873be08 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:09.171453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746a83-2355-418f-b93a-0c417873be08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:09.173126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0b746a83-2355-418f-b93a-0c417873be08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:09.276045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b746a83-2355-418f-b93a-0c417873be08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:09.277472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b746a83-2355-418f-b93a-0c417873be08 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:09.294298 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 679/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:12.264216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf433ba4-ae13-4a72-b381-c4baa6930705 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:12.264735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf433ba4-ae13-4a72-b381-c4baa6930705 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:12.264860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf433ba4-ae13-4a72-b381-c4baa6930705 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:12.267163 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 644/1323] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:12.274016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed59b2f-0631-451c-99c9-35ec81f9ddae None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:12.274474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed59b2f-0631-451c-99c9-35ec81f9ddae None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:12.274620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed59b2f-0631-451c-99c9-35ec81f9ddae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:12.336947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-aed59b2f-0631-451c-99c9-35ec81f9ddae None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:12.338144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aed59b2f-0631-451c-99c9-35ec81f9ddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:12.431161 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 680/1324] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:12.467607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf433ba4-ae13-4a72-b381-c4baa6930705 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:12.469479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bf433ba4-ae13-4a72-b381-c4baa6930705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:12.570766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf433ba4-ae13-4a72-b381-c4baa6930705 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:12.641573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdedff-9aa5-40a7-a83d-47fcaf97aa3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:12.642211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdedff-9aa5-40a7-a83d-47fcaf97aa3e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:12.642493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdedff-9aa5-40a7-a83d-47fcaf97aa3e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:12.642769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdedff-9aa5-40a7-a83d-47fcaf97aa3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:12.644433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0cbdedff-9aa5-40a7-a83d-47fcaf97aa3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:12.749140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdedff-9aa5-40a7-a83d-47fcaf97aa3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:12.751253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdedff-9aa5-40a7-a83d-47fcaf97aa3e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:12.768748 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 645/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:15.159408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829bff0-c2b1-4665-a1a4-c0f359a6f796 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:15.160192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829bff0-c2b1-4665-a1a4-c0f359a6f796 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:15.160192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829bff0-c2b1-4665-a1a4-c0f359a6f796 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:15.161706 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 681/1326] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:15.168681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab98d4b-eb10-411c-8f7c-c19771458d65 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:15.169263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab98d4b-eb10-411c-8f7c-c19771458d65 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:15.169263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab98d4b-eb10-411c-8f7c-c19771458d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:15.234095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8ab98d4b-eb10-411c-8f7c-c19771458d65 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:15.235281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8ab98d4b-eb10-411c-8f7c-c19771458d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:15.327765 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 646/1327] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:15.364674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829bff0-c2b1-4665-a1a4-c0f359a6f796 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:15.366259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2829bff0-c2b1-4665-a1a4-c0f359a6f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:15.468719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829bff0-c2b1-4665-a1a4-c0f359a6f796 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:15.540270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee95465-75d4-429a-bea1-7defc0f08576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:15.540911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95465-75d4-429a-bea1-7defc0f08576 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:15.541191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95465-75d4-429a-bea1-7defc0f08576 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:15.541461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95465-75d4-429a-bea1-7defc0f08576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:15.543051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2ee95465-75d4-429a-bea1-7defc0f08576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:15.645296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee95465-75d4-429a-bea1-7defc0f08576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:15.646627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee95465-75d4-429a-bea1-7defc0f08576 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:15.663505 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 682/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:18.075472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe286c-07c6-463f-a6d7-5688c4b28b18 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:18.076031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe286c-07c6-463f-a6d7-5688c4b28b18 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:18.076139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe286c-07c6-463f-a6d7-5688c4b28b18 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:18.078405 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 647/1329] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:18.084851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baf9d0-240f-4eb9-a56b-40a89d07a623 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:18.085295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baf9d0-240f-4eb9-a56b-40a89d07a623 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:18.085392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baf9d0-240f-4eb9-a56b-40a89d07a623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:18.148619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-48baf9d0-240f-4eb9-a56b-40a89d07a623 None None] MFA Rules not processed for user `3928202b4ef24ba2bc9eb5d29b739b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:18.149823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-48baf9d0-240f-4eb9-a56b-40a89d07a623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:18.242425 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 683/1330] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:18 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:18.282148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe286c-07c6-463f-a6d7-5688c4b28b18 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:18.283728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-84fe286c-07c6-463f-a6d7-5688c4b28b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:18.385363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe286c-07c6-463f-a6d7-5688c4b28b18 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:18.458050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d98a3-753b-4fe1-831f-1a7d23e3f054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:18.458691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d98a3-753b-4fe1-831f-1a7d23e3f054 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:18.458969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d98a3-753b-4fe1-831f-1a7d23e3f054 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:18.459240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d98a3-753b-4fe1-831f-1a7d23e3f054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:18.460872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3b7d98a3-753b-4fe1-831f-1a7d23e3f054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:18.563854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d98a3-753b-4fe1-831f-1a7d23e3f054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:18.565249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d98a3-753b-4fe1-831f-1a7d23e3f054 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:18.582474 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 648/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:18 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:21.184129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22afdbe-89a4-4f0e-be75-670db3b2724d None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:21.184643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22afdbe-89a4-4f0e-be75-670db3b2724d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:21.184750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22afdbe-89a4-4f0e-be75-670db3b2724d None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:21.186411 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 684/1332] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:21.193339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d9a41-5550-4a05-823b-56894b87aa03 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:21.193781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d9a41-5550-4a05-823b-56894b87aa03 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:21.193905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d9a41-5550-4a05-823b-56894b87aa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:21.257207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-868d9a41-5550-4a05-823b-56894b87aa03 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:21.258316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-868d9a41-5550-4a05-823b-56894b87aa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:21.351444 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 649/1333] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:21.388498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22afdbe-89a4-4f0e-be75-670db3b2724d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:21.389999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b22afdbe-89a4-4f0e-be75-670db3b2724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:21.491472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22afdbe-89a4-4f0e-be75-670db3b2724d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:21.563860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52f0df-d98a-4d86-ba14-a72b1369bd7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:21.564552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f0df-d98a-4d86-ba14-a72b1369bd7f service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:21.564836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f0df-d98a-4d86-ba14-a72b1369bd7f service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:21.565113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f0df-d98a-4d86-ba14-a72b1369bd7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:21.566755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2c52f0df-d98a-4d86-ba14-a72b1369bd7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:21.676805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52f0df-d98a-4d86-ba14-a72b1369bd7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:21.678267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52f0df-d98a-4d86-ba14-a72b1369bd7f service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:21.697726 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 685/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:24.091207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29577f00-6874-4ab5-b335-c1b670b4bca4 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:24.091813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29577f00-6874-4ab5-b335-c1b670b4bca4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:24.091813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29577f00-6874-4ab5-b335-c1b670b4bca4 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:24.093874 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 650/1335] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:24.100445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeda1c0-e081-4881-aeeb-66bffa2dbfc1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:24.100864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeda1c0-e081-4881-aeeb-66bffa2dbfc1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:24.101039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeda1c0-e081-4881-aeeb-66bffa2dbfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:24.163514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fdeda1c0-e081-4881-aeeb-66bffa2dbfc1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:24.164730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fdeda1c0-e081-4881-aeeb-66bffa2dbfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:24.260098 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 686/1336] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:24.301058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29577f00-6874-4ab5-b335-c1b670b4bca4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:24.302620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-29577f00-6874-4ab5-b335-c1b670b4bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:24.402074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29577f00-6874-4ab5-b335-c1b670b4bca4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:24.471728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3739d8-d9d6-4e27-83c6-4c8fc1b63c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:24.472399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3739d8-d9d6-4e27-83c6-4c8fc1b63c45 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:24.472680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3739d8-d9d6-4e27-83c6-4c8fc1b63c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:24.472954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3739d8-d9d6-4e27-83c6-4c8fc1b63c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:24.474667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba3739d8-d9d6-4e27-83c6-4c8fc1b63c45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:24.578134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3739d8-d9d6-4e27-83c6-4c8fc1b63c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:24.579511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3739d8-d9d6-4e27-83c6-4c8fc1b63c45 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:24.596982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 651/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:39:27.231526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4850513-6131-4c2a-aaa6-fcd146c3d9c9 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:27.232075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4850513-6131-4c2a-aaa6-fcd146c3d9c9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:27.232172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4850513-6131-4c2a-aaa6-fcd146c3d9c9 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:27.233864 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 687/1338] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:27.240219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8f54e-628c-4d31-88a9-f9bb1ec76b0b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:27.240663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8f54e-628c-4d31-88a9-f9bb1ec76b0b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:27.240757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a8f54e-628c-4d31-88a9-f9bb1ec76b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:27.304458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-82a8f54e-628c-4d31-88a9-f9bb1ec76b0b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:27.305575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-82a8f54e-628c-4d31-88a9-f9bb1ec76b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:27.398213 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 652/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:27.435015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4850513-6131-4c2a-aaa6-fcd146c3d9c9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:27.436566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c4850513-6131-4c2a-aaa6-fcd146c3d9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:27.536476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4850513-6131-4c2a-aaa6-fcd146c3d9c9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:27.610584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca891d0-2ce4-47f7-96a8-7edd9eb58517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:27.611147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca891d0-2ce4-47f7-96a8-7edd9eb58517 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:27.611425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca891d0-2ce4-47f7-96a8-7edd9eb58517 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:27.611694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca891d0-2ce4-47f7-96a8-7edd9eb58517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:27.613327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bca891d0-2ce4-47f7-96a8-7edd9eb58517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:27.714315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca891d0-2ce4-47f7-96a8-7edd9eb58517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:27.715731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca891d0-2ce4-47f7-96a8-7edd9eb58517 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:27.732889 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 688/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:32.059575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8a00f-ccb3-4ea5-af2b-747ecbf6ee72 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:32.060104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8a00f-ccb3-4ea5-af2b-747ecbf6ee72 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:32.060195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b8a00f-ccb3-4ea5-af2b-747ecbf6ee72 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:32.062565 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 653/1341] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:32.068759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef61545-2df4-44a6-a207-f1348300dfb8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:32.069182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef61545-2df4-44a6-a207-f1348300dfb8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:32.069317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef61545-2df4-44a6-a207-f1348300dfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:32.138158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4ef61545-2df4-44a6-a207-f1348300dfb8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:32.139344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4ef61545-2df4-44a6-a207-f1348300dfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:32.240415 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 689/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:32.281053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8a00f-ccb3-4ea5-af2b-747ecbf6ee72 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:32.283359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e4b8a00f-ccb3-4ea5-af2b-747ecbf6ee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:32.377818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b8a00f-ccb3-4ea5-af2b-747ecbf6ee72 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:32.381788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df2e82-6117-4bfb-8777-3bc04bc44c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:32.382569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2e82-6117-4bfb-8777-3bc04bc44c56 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:32.382918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2e82-6117-4bfb-8777-3bc04bc44c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:32.383122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df2e82-6117-4bfb-8777-3bc04bc44c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:32.392588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df2e82-6117-4bfb-8777-3bc04bc44c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:32.394064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df2e82-6117-4bfb-8777-3bc04bc44c56 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:32.403289 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 654/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:35.320514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302b56-48cf-4ceb-9406-45194b5c8601 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:35.321054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302b56-48cf-4ceb-9406-45194b5c8601 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:35.321054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10302b56-48cf-4ceb-9406-45194b5c8601 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:35.322729 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 690/1344] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:35.329176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af12759-83df-4e63-946b-ba0ff1be7c11 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:35.329610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af12759-83df-4e63-946b-ba0ff1be7c11 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:35.329846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af12759-83df-4e63-946b-ba0ff1be7c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:35.357196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4af12759-83df-4e63-946b-ba0ff1be7c11 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:35.358358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4af12759-83df-4e63-946b-ba0ff1be7c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:35.431601 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 655/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:35.470135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10302b56-48cf-4ceb-9406-45194b5c8601 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:35.480849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10302b56-48cf-4ceb-9406-45194b5c8601 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:35.484855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619134-c316-42bc-af7b-38be2ebfb923 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:35.485486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619134-c316-42bc-af7b-38be2ebfb923 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:35.485769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619134-c316-42bc-af7b-38be2ebfb923 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:35.486046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619134-c316-42bc-af7b-38be2ebfb923 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:35.495119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec619134-c316-42bc-af7b-38be2ebfb923 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:35.496587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec619134-c316-42bc-af7b-38be2ebfb923 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:35.508612 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 691/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:39.898744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cfd77-ad47-4486-a720-5423e511b096 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:39.899269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cfd77-ad47-4486-a720-5423e511b096 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:39.899269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30cfd77-ad47-4486-a720-5423e511b096 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:39.901155 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 656/1347] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:39.908021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01285148-e6c4-48d2-a0bb-325772b59800 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:39.908438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01285148-e6c4-48d2-a0bb-325772b59800 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:39.908688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01285148-e6c4-48d2-a0bb-325772b59800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:39.926717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-01285148-e6c4-48d2-a0bb-325772b59800 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:39.927888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-01285148-e6c4-48d2-a0bb-325772b59800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:39.935571 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 692/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:39.974323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cfd77-ad47-4486-a720-5423e511b096 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:39.985904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30cfd77-ad47-4486-a720-5423e511b096 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:39.989961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da493-4dba-45a3-81ab-095be2364552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:39.990611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da493-4dba-45a3-81ab-095be2364552 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:39.990893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da493-4dba-45a3-81ab-095be2364552 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:39.991195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da493-4dba-45a3-81ab-095be2364552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:40.000072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da493-4dba-45a3-81ab-095be2364552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:40.001497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da493-4dba-45a3-81ab-095be2364552 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:40.010965 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 657/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:45.447640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695deb2-2aa5-4640-ac5e-7c867bdfe6b2 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:45.448894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695deb2-2aa5-4640-ac5e-7c867bdfe6b2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:45.449412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695deb2-2aa5-4640-ac5e-7c867bdfe6b2 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:45.451257 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 693/1350] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:39:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:45.456479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7a467-41ce-4593-9396-89de473fee5c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:45.457370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7a467-41ce-4593-9396-89de473fee5c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:45.457847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7a467-41ce-4593-9396-89de473fee5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:45.574393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-09e7a467-41ce-4593-9396-89de473fee5c None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:45.575554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-09e7a467-41ce-4593-9396-89de473fee5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:45.654893 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 658/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:39:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:50.441851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c067-59f9-45e2-8cef-7dd619fbb6d4 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:50.442422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c067-59f9-45e2-8cef-7dd619fbb6d4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:50.442422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3c067-59f9-45e2-8cef-7dd619fbb6d4 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:50.444558 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 694/1352] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:50.450598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07624de8-58ec-4119-a9a2-35e753bcc0d3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:50.451190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07624de8-58ec-4119-a9a2-35e753bcc0d3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:50.451751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07624de8-58ec-4119-a9a2-35e753bcc0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:50.472366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-07624de8-58ec-4119-a9a2-35e753bcc0d3 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:50.473846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-07624de8-58ec-4119-a9a2-35e753bcc0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:50.482797 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 659/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:39:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:52.108848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0acb-0cdc-4448-b864-ea57723265f5 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:52.109363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0acb-0cdc-4448-b864-ea57723265f5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:52.109454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d0acb-0cdc-4448-b864-ea57723265f5 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:52.111634 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 695/1354] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:52.118151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ce96-7b3c-4d81-aec6-d5e96e9c6f92 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:52.118572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ce96-7b3c-4d81-aec6-d5e96e9c6f92 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:52.118825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4ce96-7b3c-4d81-aec6-d5e96e9c6f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:52.137130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a6f4ce96-7b3c-4d81-aec6-d5e96e9c6f92 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:52.138303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a6f4ce96-7b3c-4d81-aec6-d5e96e9c6f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:52.147368 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 660/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:39:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:39:55.822241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68145b-24b7-4ba8-844d-ef42727db632 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:55.822840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68145b-24b7-4ba8-844d-ef42727db632 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:55.822840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea68145b-24b7-4ba8-844d-ef42727db632 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:55.824836 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 696/1356] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:55.831106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a87466-4f33-401b-9aa8-08891fd9e6d4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:55.831498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a87466-4f33-401b-9aa8-08891fd9e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:55.831662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a87466-4f33-401b-9aa8-08891fd9e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:55.849909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d6a87466-4f33-401b-9aa8-08891fd9e6d4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:55.851270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d6a87466-4f33-401b-9aa8-08891fd9e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:55.859803 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 661/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:55.909374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18db3-9e80-49ef-8cfc-ca3227856b26 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:55.909665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18db3-9e80-49ef-8cfc-ca3227856b26 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:55.909946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab18db3-9e80-49ef-8cfc-ca3227856b26 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:55.911968 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 697/1358] 10.222.0.16 () {54 vars in 960 bytes} [Sat Mar 26 20:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:55.917391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d6bf9-88f4-4e2e-8b1f-9b75644c3a11 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:55.917792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d6bf9-88f4-4e2e-8b1f-9b75644c3a11 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:55.918081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d6bf9-88f4-4e2e-8b1f-9b75644c3a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:55.964790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a13d6bf9-88f4-4e2e-8b1f-9b75644c3a11 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:55.966083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a13d6bf9-88f4-4e2e-8b1f-9b75644c3a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:56.065751 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 662/1359] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 20:39:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:56.074125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18db3-9e80-49ef-8cfc-ca3227856b26 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:56.089430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab18db3-9e80-49ef-8cfc-ca3227856b26 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:56.095875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aec0cd-b48e-4426-8b4b-8afcfa675501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:56.096799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec0cd-b48e-4426-8b4b-8afcfa675501 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:56.097155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec0cd-b48e-4426-8b4b-8afcfa675501 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:56.097633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aec0cd-b48e-4426-8b4b-8afcfa675501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:56.106590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec0cd-b48e-4426-8b4b-8afcfa675501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:56.108349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aec0cd-b48e-4426-8b4b-8afcfa675501 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:56.117974 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 698/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:39:58.694566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d571c6-d233-40ce-9f46-fc5d7cf938a8 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:58.695090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d571c6-d233-40ce-9f46-fc5d7cf938a8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:58.695090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d571c6-d233-40ce-9f46-fc5d7cf938a8 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:58.697889 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 663/1361] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:39:58.703519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7f0c-e1bb-4f7d-ae7f-f1423baeb7aa None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:58.703999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7f0c-e1bb-4f7d-ae7f-f1423baeb7aa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:58.704098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed7f0c-e1bb-4f7d-ae7f-f1423baeb7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:58.722291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-46ed7f0c-e1bb-4f7d-ae7f-f1423baeb7aa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:39:58.723460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-46ed7f0c-e1bb-4f7d-ae7f-f1423baeb7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:39:58.733961 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 699/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:39:58.778173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d571c6-d233-40ce-9f46-fc5d7cf938a8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:39:58.793268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d571c6-d233-40ce-9f46-fc5d7cf938a8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:39:58.799218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427cd62-6750-4b87-b60d-e7446825b3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:39:58.799845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427cd62-6750-4b87-b60d-e7446825b3e3 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:39:58.800155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427cd62-6750-4b87-b60d-e7446825b3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:39:58.800425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427cd62-6750-4b87-b60d-e7446825b3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:39:58.808391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427cd62-6750-4b87-b60d-e7446825b3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:39:58.809977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427cd62-6750-4b87-b60d-e7446825b3e3 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:39:58.819461 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 664/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:01.458166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24daa-1a7b-4426-8241-6b5e86c2cb5c None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:01.458166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24daa-1a7b-4426-8241-6b5e86c2cb5c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:01.458166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a24daa-1a7b-4426-8241-6b5e86c2cb5c None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:01.459737 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 700/1364] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:40:01.466507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36b8c-b311-4a33-bec1-9e80361b7dd8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:01.466953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36b8c-b311-4a33-bec1-9e80361b7dd8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:01.467049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d36b8c-b311-4a33-bec1-9e80361b7dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:01.485428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a4d36b8c-b311-4a33-bec1-9e80361b7dd8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:01.486591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a4d36b8c-b311-4a33-bec1-9e80361b7dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:01.494365 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 665/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:01.541999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4da2fe-87f3-49d5-ac9b-079b6ac44cd6 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:01.542340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4da2fe-87f3-49d5-ac9b-079b6ac44cd6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:01.542623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4da2fe-87f3-49d5-ac9b-079b6ac44cd6 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:01.544378 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 701/1366] 10.222.0.16 () {54 vars in 960 bytes} [Sat Mar 26 20:40:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:01.549776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae52c85-c3ce-4a4d-8a80-cc3332ddff94 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:01.550073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae52c85-c3ce-4a4d-8a80-cc3332ddff94 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:01.550350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae52c85-c3ce-4a4d-8a80-cc3332ddff94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:01.568918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3ae52c85-c3ce-4a4d-8a80-cc3332ddff94 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:01.570090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3ae52c85-c3ce-4a4d-8a80-cc3332ddff94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:01.579839 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 666/1367] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 20:40:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:40:01.587616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4da2fe-87f3-49d5-ac9b-079b6ac44cd6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:01.601822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4da2fe-87f3-49d5-ac9b-079b6ac44cd6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:01.607378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872e2ce-f2ad-4db1-8f89-09ad87c89785 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:01.608061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872e2ce-f2ad-4db1-8f89-09ad87c89785 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:01.608349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872e2ce-f2ad-4db1-8f89-09ad87c89785 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:01.608627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872e2ce-f2ad-4db1-8f89-09ad87c89785 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:01.621888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872e2ce-f2ad-4db1-8f89-09ad87c89785 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:01.623491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872e2ce-f2ad-4db1-8f89-09ad87c89785 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:01.633752 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 702/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:04.132269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519771f1-aa11-4623-902a-8126c658c6ab None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:04.133148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519771f1-aa11-4623-902a-8126c658c6ab None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:04.133582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519771f1-aa11-4623-902a-8126c658c6ab None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:04.139608 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 667/1369] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:04.144261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff18ef-f50f-4583-ba11-757bc5ad86a9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:04.144708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff18ef-f50f-4583-ba11-757bc5ad86a9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:04.144818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff18ef-f50f-4583-ba11-757bc5ad86a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:04.165093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2dff18ef-f50f-4583-ba11-757bc5ad86a9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:04.166085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2dff18ef-f50f-4583-ba11-757bc5ad86a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:04.180415 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 703/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:04.227463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519771f1-aa11-4623-902a-8126c658c6ab None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:04.265280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519771f1-aa11-4623-902a-8126c658c6ab None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:04.287226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9150b8ce-e634-4d1e-a320-2056a7ddbc6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:04.288473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150b8ce-e634-4d1e-a320-2056a7ddbc6c service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:04.288915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150b8ce-e634-4d1e-a320-2056a7ddbc6c service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:04.289343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9150b8ce-e634-4d1e-a320-2056a7ddbc6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:04.309467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150b8ce-e634-4d1e-a320-2056a7ddbc6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:04.311507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9150b8ce-e634-4d1e-a320-2056a7ddbc6c service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:04.323865 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 668/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:06.952103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4fd06-1870-4bc1-b89f-20a82e7634c2 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:06.952572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4fd06-1870-4bc1-b89f-20a82e7634c2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:06.952665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4fd06-1870-4bc1-b89f-20a82e7634c2 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:06.959872 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 704/1372] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:06.961333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559300-e666-409e-ab10-e7cd0a672323 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:06.962087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559300-e666-409e-ab10-e7cd0a672323 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:06.962517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb559300-e666-409e-ab10-e7cd0a672323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:06.981910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bb559300-e666-409e-ab10-e7cd0a672323 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:06.983867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bb559300-e666-409e-ab10-e7cd0a672323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:06.992883 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 669/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:07.038316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4fd06-1870-4bc1-b89f-20a82e7634c2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:07.053947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4fd06-1870-4bc1-b89f-20a82e7634c2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:07.059679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98918b36-f780-4a13-919b-f94b5849b49a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:07.060555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98918b36-f780-4a13-919b-f94b5849b49a service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:07.061024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98918b36-f780-4a13-919b-f94b5849b49a service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:07.061468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98918b36-f780-4a13-919b-f94b5849b49a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:07.070262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98918b36-f780-4a13-919b-f94b5849b49a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:07.072046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98918b36-f780-4a13-919b-f94b5849b49a service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:07.093580 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 705/1374] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:08.015807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb333bee-36f3-4779-b866-cb3a42e060f2 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:08.016355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb333bee-36f3-4779-b866-cb3a42e060f2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:08.016436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb333bee-36f3-4779-b866-cb3a42e060f2 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:08.018163 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 670/1375] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:08.028618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc153-6c0d-4c1b-b536-ade8bbdf7b96 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:08.029045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc153-6c0d-4c1b-b536-ade8bbdf7b96 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:08.029218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc153-6c0d-4c1b-b536-ade8bbdf7b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:08.049501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1dcdc153-6c0d-4c1b-b536-ade8bbdf7b96 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:08.050995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1dcdc153-6c0d-4c1b-b536-ade8bbdf7b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:08.059354 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 706/1376] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:08.413160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3b88e-977a-4b02-bf30-6402c4c98257 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:08.413973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3b88e-977a-4b02-bf30-6402c4c98257 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:08.414266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3b88e-977a-4b02-bf30-6402c4c98257 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:08.416125 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 671/1377] 10.222.0.16 () {54 vars in 962 bytes} [Sat Mar 26 20:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:40:08.421872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a3b4-9a94-4109-b8ad-9da63697c95a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:08.422238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a3b4-9a94-4109-b8ad-9da63697c95a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:08.422586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730a3b4-9a94-4109-b8ad-9da63697c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:08.475721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0730a3b4-9a94-4109-b8ad-9da63697c95a None None] MFA Rules not processed for user `416ac158078b4b678c236e0ad811acad`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:08.481297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0730a3b4-9a94-4109-b8ad-9da63697c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:08.547474 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 707/1378] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Mar 26 20:40:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:08.555159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3b88e-977a-4b02-bf30-6402c4c98257 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:08.566435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3b88e-977a-4b02-bf30-6402c4c98257 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:08.570054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a4207-384e-4ccc-b412-42d63f9000d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:08.570845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a4207-384e-4ccc-b412-42d63f9000d3 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:08.571232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a4207-384e-4ccc-b412-42d63f9000d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:08.571611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a4207-384e-4ccc-b412-42d63f9000d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:08.581093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a4207-384e-4ccc-b412-42d63f9000d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:08.582637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a4207-384e-4ccc-b412-42d63f9000d3 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:08.592541 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 672/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:09.634974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf051a8-e535-44c3-9f5d-a4f45c00937d None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:09.634974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf051a8-e535-44c3-9f5d-a4f45c00937d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:09.636954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf051a8-e535-44c3-9f5d-a4f45c00937d None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:09.639761 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 708/1380] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:09.647200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e2dc-ebaf-4775-bb85-7161f060bf11 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:09.647656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e2dc-ebaf-4775-bb85-7161f060bf11 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:09.647897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e2dc-ebaf-4775-bb85-7161f060bf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:09.674150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-68e1e2dc-ebaf-4775-bb85-7161f060bf11 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:09.675663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-68e1e2dc-ebaf-4775-bb85-7161f060bf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:09.707284 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 673/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:09.743426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf051a8-e535-44c3-9f5d-a4f45c00937d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:09.761487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf051a8-e535-44c3-9f5d-a4f45c00937d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:09.769450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6e58d-aefe-4a67-99c2-9d8fe5be5872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:09.770232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e58d-aefe-4a67-99c2-9d8fe5be5872 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:09.770534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e58d-aefe-4a67-99c2-9d8fe5be5872 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:09.770811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6e58d-aefe-4a67-99c2-9d8fe5be5872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:09.780558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6e58d-aefe-4a67-99c2-9d8fe5be5872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:09.782500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6e58d-aefe-4a67-99c2-9d8fe5be5872 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:09.792245 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 709/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:40:12.573986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16743d-aeee-48c4-8ef5-6f1874d42804 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:12.575233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16743d-aeee-48c4-8ef5-6f1874d42804 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:12.575724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16743d-aeee-48c4-8ef5-6f1874d42804 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:12.577867 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 674/1383] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:12.584912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7623eb-e16d-4d7d-a337-d1fbd78409a5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:12.585770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7623eb-e16d-4d7d-a337-d1fbd78409a5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:12.586203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7623eb-e16d-4d7d-a337-d1fbd78409a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:12.610010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9b7623eb-e16d-4d7d-a337-d1fbd78409a5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:12.611112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9b7623eb-e16d-4d7d-a337-d1fbd78409a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:12.622078 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 710/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:40:12.669381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16743d-aeee-48c4-8ef5-6f1874d42804 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:12.689957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16743d-aeee-48c4-8ef5-6f1874d42804 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:12.698143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdf553-4f1a-4835-9149-4cae9071795f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:12.699076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdf553-4f1a-4835-9149-4cae9071795f service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:12.699583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdf553-4f1a-4835-9149-4cae9071795f service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:12.700238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdf553-4f1a-4835-9149-4cae9071795f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:12.710516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdf553-4f1a-4835-9149-4cae9071795f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:12.712448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdf553-4f1a-4835-9149-4cae9071795f service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:12.727594 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 675/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:15.124861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1b077-99d9-4243-9594-a83ba1ca209f None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:15.126056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1b077-99d9-4243-9594-a83ba1ca209f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:15.126056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1b077-99d9-4243-9594-a83ba1ca209f None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:15.127160 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 711/1386] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:15.133747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a064e-cd3f-4f43-a137-b5d7a4d04f3f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:15.134250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a064e-cd3f-4f43-a137-b5d7a4d04f3f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:15.134350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a064e-cd3f-4f43-a137-b5d7a4d04f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:15.152748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7e0a064e-cd3f-4f43-a137-b5d7a4d04f3f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:15.153931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e0a064e-cd3f-4f43-a137-b5d7a4d04f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:15.162051 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 676/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:15.207091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1b077-99d9-4243-9594-a83ba1ca209f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:15.222579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1b077-99d9-4243-9594-a83ba1ca209f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:15.228218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed8709-9aea-4b25-9065-5790deae7bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:15.228964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed8709-9aea-4b25-9065-5790deae7bed service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:15.229349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed8709-9aea-4b25-9065-5790deae7bed service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:15.229727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed8709-9aea-4b25-9065-5790deae7bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:15.238736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed8709-9aea-4b25-9065-5790deae7bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:15.240487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed8709-9aea-4b25-9065-5790deae7bed service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:15.252101 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 712/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:17.787841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2b29-26eb-425f-9624-f4594673fc96 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:17.788836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2b29-26eb-425f-9624-f4594673fc96 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:17.788836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef2b29-26eb-425f-9624-f4594673fc96 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:17.790366 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 677/1389] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:17.798236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff0a07-e07c-44c9-9d28-ca26f9728bac None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:17.798772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff0a07-e07c-44c9-9d28-ca26f9728bac None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:17.798946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff0a07-e07c-44c9-9d28-ca26f9728bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:17.833731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0dff0a07-e07c-44c9-9d28-ca26f9728bac None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:17.834958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0dff0a07-e07c-44c9-9d28-ca26f9728bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:17.843330 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 713/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:17.890973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef2b29-26eb-425f-9624-f4594673fc96 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:17.906450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef2b29-26eb-425f-9624-f4594673fc96 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:17.913869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f821d3d-c760-4cf5-bd6c-ab7f297f38a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:17.914661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f821d3d-c760-4cf5-bd6c-ab7f297f38a0 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:17.915014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f821d3d-c760-4cf5-bd6c-ab7f297f38a0 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:17.915358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f821d3d-c760-4cf5-bd6c-ab7f297f38a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:17.925857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f821d3d-c760-4cf5-bd6c-ab7f297f38a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:17.927880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f821d3d-c760-4cf5-bd6c-ab7f297f38a0 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:17.938729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 678/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:20.548797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc606cd2-cd86-476a-b946-cc71e5c5a221 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:20.549536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc606cd2-cd86-476a-b946-cc71e5c5a221 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:20.549536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc606cd2-cd86-476a-b946-cc71e5c5a221 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:20.551070 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 714/1392] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:20.557717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cad85-25ac-41e5-80a0-f43fd7e45a4d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:20.558705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cad85-25ac-41e5-80a0-f43fd7e45a4d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:20.558705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cad85-25ac-41e5-80a0-f43fd7e45a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:20.577663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9a5cad85-25ac-41e5-80a0-f43fd7e45a4d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:20.578818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9a5cad85-25ac-41e5-80a0-f43fd7e45a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:20.587014 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 679/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:40:20.631019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc606cd2-cd86-476a-b946-cc71e5c5a221 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:20.646652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc606cd2-cd86-476a-b946-cc71e5c5a221 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:20.652126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6500b3-6d56-4998-a75c-38b935492fe5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:20.652723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6500b3-6d56-4998-a75c-38b935492fe5 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:20.653008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6500b3-6d56-4998-a75c-38b935492fe5 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:20.653273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6500b3-6d56-4998-a75c-38b935492fe5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:20.662084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6500b3-6d56-4998-a75c-38b935492fe5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:20.663662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6500b3-6d56-4998-a75c-38b935492fe5 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:20.673545 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 715/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:40:23.347694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e04a84-4c5d-4d1b-9b2f-5edae60b8f4c None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:23.348330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e04a84-4c5d-4d1b-9b2f-5edae60b8f4c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:23.348330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e04a84-4c5d-4d1b-9b2f-5edae60b8f4c None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:23.350070 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 680/1395] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:40:23.356635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04aea-dbb9-4db1-94ad-ce64aad17bcd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:23.357082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04aea-dbb9-4db1-94ad-ce64aad17bcd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:23.357184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a04aea-dbb9-4db1-94ad-ce64aad17bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:23.375018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-51a04aea-dbb9-4db1-94ad-ce64aad17bcd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:23.376837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-51a04aea-dbb9-4db1-94ad-ce64aad17bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:23.384639 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 716/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:23.429921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e04a84-4c5d-4d1b-9b2f-5edae60b8f4c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:23.444434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e04a84-4c5d-4d1b-9b2f-5edae60b8f4c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:23.450685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7fd23-b575-4756-a962-311c24477425 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:23.451996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7fd23-b575-4756-a962-311c24477425 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:23.452234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7fd23-b575-4756-a962-311c24477425 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:23.452530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7fd23-b575-4756-a962-311c24477425 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:23.462265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7fd23-b575-4756-a962-311c24477425 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:23.463878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7fd23-b575-4756-a962-311c24477425 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:23.473594 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 681/1397] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:25.104383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441156-4bd5-4c10-afc8-55e2045cf62c None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:25.104966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441156-4bd5-4c10-afc8-55e2045cf62c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:25.104966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441156-4bd5-4c10-afc8-55e2045cf62c None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:25.106689 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 717/1398] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:25.113807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160053fa-4187-4783-a94d-c359a86c12b7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:25.114336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160053fa-4187-4783-a94d-c359a86c12b7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:25.114434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160053fa-4187-4783-a94d-c359a86c12b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:25.131961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-160053fa-4187-4783-a94d-c359a86c12b7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:25.133137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-160053fa-4187-4783-a94d-c359a86c12b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:25.141634 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 682/1399] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:25.198099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13f20-7b56-4045-ba8a-52cee7a425db None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:25.198387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13f20-7b56-4045-ba8a-52cee7a425db None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:25.198666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13f20-7b56-4045-ba8a-52cee7a425db None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:25.200437 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 718/1400] 10.222.0.16 () {54 vars in 961 bytes} [Sat Mar 26 20:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:25.205836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086b69-7656-4a89-9ff5-c437eb401cfe None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:25.206127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086b69-7656-4a89-9ff5-c437eb401cfe None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:25.206409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae086b69-7656-4a89-9ff5-c437eb401cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:25.252828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ae086b69-7656-4a89-9ff5-c437eb401cfe None None] MFA Rules not processed for user `82c1da5e55da4bf380e86064d66e638b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:25.253986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ae086b69-7656-4a89-9ff5-c437eb401cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:25.311175 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 683/1401] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Mar 26 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:25.318407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13f20-7b56-4045-ba8a-52cee7a425db None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:25.329530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13f20-7b56-4045-ba8a-52cee7a425db None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:25.333137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca17b5-a503-4353-b6fa-1e05ddeaea4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:25.333845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca17b5-a503-4353-b6fa-1e05ddeaea4c service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:25.334132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca17b5-a503-4353-b6fa-1e05ddeaea4c service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:25.334407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca17b5-a503-4353-b6fa-1e05ddeaea4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:25.344436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca17b5-a503-4353-b6fa-1e05ddeaea4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:25.345869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca17b5-a503-4353-b6fa-1e05ddeaea4c service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:25.355203 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 719/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:40:25.777562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d8f9c-a2bc-49e9-a32e-7e639fd665bf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:25.777862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d8f9c-a2bc-49e9-a32e-7e639fd665bf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:25.778144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d8f9c-a2bc-49e9-a32e-7e639fd665bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:25.829474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e64d8f9c-a2bc-49e9-a32e-7e639fd665bf None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:25.830565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e64d8f9c-a2bc-49e9-a32e-7e639fd665bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:25.890909 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 684/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:40:25.891357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eff8f-6e97-4033-b669-46f3ba0a0462 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:25.891647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eff8f-6e97-4033-b669-46f3ba0a0462 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:25.891976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eff8f-6e97-4033-b669-46f3ba0a0462 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:25.893928 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 720/1404] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:40:25.900848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd545-03c8-422e-848a-d5fde0e3021c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:25.900959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd545-03c8-422e-848a-d5fde0e3021c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:25.901176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cd545-03c8-422e-848a-d5fde0e3021c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:25.919685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3c3cd545-03c8-422e-848a-d5fde0e3021c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:25.922123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3c3cd545-03c8-422e-848a-d5fde0e3021c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:25.930681 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 685/1405] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:40:25.977224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eff8f-6e97-4033-b669-46f3ba0a0462 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:25.992744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eff8f-6e97-4033-b669-46f3ba0a0462 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:25.998613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d4c70-f19b-47c1-a63b-487355c9c8b9 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:25.998903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d4c70-f19b-47c1-a63b-487355c9c8b9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:25.999175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d4c70-f19b-47c1-a63b-487355c9c8b9 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:26.000982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 686/1406] 10.222.0.16 () {54 vars in 942 bytes} [Sat Mar 26 20:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:26.002413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf0d0f-36b3-4369-886a-7685c94da7fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:26.002994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf0d0f-36b3-4369-886a-7685c94da7fa service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:26.003211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf0d0f-36b3-4369-886a-7685c94da7fa service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:26.003495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf0d0f-36b3-4369-886a-7685c94da7fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:26.006502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41b6e-f009-4274-9e7d-a12f42c944c1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:26.006785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41b6e-f009-4274-9e7d-a12f42c944c1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:26.007069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b41b6e-f009-4274-9e7d-a12f42c944c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:26.013662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf0d0f-36b3-4369-886a-7685c94da7fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:26.015260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf0d0f-36b3-4369-886a-7685c94da7fa service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:26.025569 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 721/1407] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:26.061533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a1b41b6e-f009-4274-9e7d-a12f42c944c1 None None] MFA Rules not processed for user `08d764c8ff5f48a092bd69030c5e1b47`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:26.062904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a1b41b6e-f009-4274-9e7d-a12f42c944c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:26.139173 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 687/1408] 10.222.0.16 () {58 vars in 1039 bytes} [Sat Mar 26 20:40:26 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:40:26.148015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf0d0f-36b3-4369-886a-7685c94da7fa service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:26.159847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf0d0f-36b3-4369-886a-7685c94da7fa service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:26.165166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10484836-6266-4210-9825-cdc2f1d74209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:26.165823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10484836-6266-4210-9825-cdc2f1d74209 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:26.166102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10484836-6266-4210-9825-cdc2f1d74209 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:26.166377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10484836-6266-4210-9825-cdc2f1d74209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:26.175714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10484836-6266-4210-9825-cdc2f1d74209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:26.177344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10484836-6266-4210-9825-cdc2f1d74209 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:26.186976 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 722/1409] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:40:50.148443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5d6de-006c-4073-8c00-932d5173ef13 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:50.149068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5d6de-006c-4073-8c00-932d5173ef13 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:50.149068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5d6de-006c-4073-8c00-932d5173ef13 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:50.150867 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 688/1410] 10.222.0.16 () {54 vars in 918 bytes} [Sat Mar 26 20:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:50.156065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89488f-5929-4dbe-adef-8aea366d9374 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:50.156548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89488f-5929-4dbe-adef-8aea366d9374 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:50.156655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89488f-5929-4dbe-adef-8aea366d9374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:50.174653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7d89488f-5929-4dbe-adef-8aea366d9374 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:50.175885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7d89488f-5929-4dbe-adef-8aea366d9374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:50.184683 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 723/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Mar 26 20:40:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:50.199464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c83d-4678-4347-82b3-f1b0542f52eb None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:50.199753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c83d-4678-4347-82b3-f1b0542f52eb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:50.200065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f4c83d-4678-4347-82b3-f1b0542f52eb None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:50.201834 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 689/1412] 10.222.0.16 () {54 vars in 918 bytes} [Sat Mar 26 20:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:50.206347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d551-0b3d-49c9-bd83-023cb57c6890 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:50.206664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d551-0b3d-49c9-bd83-023cb57c6890 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:50.206942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173d551-0b3d-49c9-bd83-023cb57c6890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:50.224667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a173d551-0b3d-49c9-bd83-023cb57c6890 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:50.225814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a173d551-0b3d-49c9-bd83-023cb57c6890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:50.235358 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 724/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Mar 26 20:40:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:53.072060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135bcd-9d22-4c55-a2d8-59f55771e6c8 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:53.072665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135bcd-9d22-4c55-a2d8-59f55771e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:53.072665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33135bcd-9d22-4c55-a2d8-59f55771e6c8 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:53.074421 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 690/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:53.081417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e828-88ce-4a63-a807-fc7c25cb024f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:53.081895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e828-88ce-4a63-a807-fc7c25cb024f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:53.082000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e828-88ce-4a63-a807-fc7c25cb024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:53.099482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2720e828-88ce-4a63-a807-fc7c25cb024f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:53.100706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2720e828-88ce-4a63-a807-fc7c25cb024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:53.108908 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 725/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:53.151312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33135bcd-9d22-4c55-a2d8-59f55771e6c8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:53.165411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33135bcd-9d22-4c55-a2d8-59f55771e6c8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:53.171274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da76124-cc48-45ab-8e33-5a81ba3541f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:53.171895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da76124-cc48-45ab-8e33-5a81ba3541f9 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:53.172277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da76124-cc48-45ab-8e33-5a81ba3541f9 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:53.172558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da76124-cc48-45ab-8e33-5a81ba3541f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:53.180520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da76124-cc48-45ab-8e33-5a81ba3541f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:53.182134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da76124-cc48-45ab-8e33-5a81ba3541f9 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:53.192243 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 691/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:54.649138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d99a88-cf1c-4b5d-aaaa-71586a70f936 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:54.649709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d99a88-cf1c-4b5d-aaaa-71586a70f936 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:54.649709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d99a88-cf1c-4b5d-aaaa-71586a70f936 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:54.651424 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 726/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:54.657143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e3b7f-602f-4265-a478-19ccb1bcf00c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:54.657546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e3b7f-602f-4265-a478-19ccb1bcf00c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:54.657699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e3b7f-602f-4265-a478-19ccb1bcf00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:54.675370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-006e3b7f-602f-4265-a478-19ccb1bcf00c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:54.676590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-006e3b7f-602f-4265-a478-19ccb1bcf00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:54.684304 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 692/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:54.885577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d99a88-cf1c-4b5d-aaaa-71586a70f936 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:54.900189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d99a88-cf1c-4b5d-aaaa-71586a70f936 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:54.905380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62af004-6a26-488f-9b80-849783693322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:54.906008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62af004-6a26-488f-9b80-849783693322 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:54.906278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62af004-6a26-488f-9b80-849783693322 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:54.906552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62af004-6a26-488f-9b80-849783693322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:54.915493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62af004-6a26-488f-9b80-849783693322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:54.917216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62af004-6a26-488f-9b80-849783693322 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:54.927202 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 727/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:56.302239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665828c9-2ece-4af0-9a82-a7b7048649f0 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:56.302714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665828c9-2ece-4af0-9a82-a7b7048649f0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:56.302714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665828c9-2ece-4af0-9a82-a7b7048649f0 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:56.304574 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 693/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:56.309378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381bdd8-c329-4ce2-90a1-c6dbdbfa0fe4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:56.310283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381bdd8-c329-4ce2-90a1-c6dbdbfa0fe4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:56.310447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381bdd8-c329-4ce2-90a1-c6dbdbfa0fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:56.328454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a381bdd8-c329-4ce2-90a1-c6dbdbfa0fe4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:56.329627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a381bdd8-c329-4ce2-90a1-c6dbdbfa0fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:56.337166 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 728/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:56.493323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665828c9-2ece-4af0-9a82-a7b7048649f0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:56.508192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665828c9-2ece-4af0-9a82-a7b7048649f0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:56.514182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3739e-47f7-4e08-8d60-5a7a7b7f7144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:56.514816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3739e-47f7-4e08-8d60-5a7a7b7f7144 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:56.515083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3739e-47f7-4e08-8d60-5a7a7b7f7144 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:56.515354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3739e-47f7-4e08-8d60-5a7a7b7f7144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:56.523250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3739e-47f7-4e08-8d60-5a7a7b7f7144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:56.524869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3739e-47f7-4e08-8d60-5a7a7b7f7144 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:56.534078 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 694/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:57.920178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c8638-e3eb-4a9d-a627-177eca650e51 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:57.920761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c8638-e3eb-4a9d-a627-177eca650e51 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:57.920761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c8638-e3eb-4a9d-a627-177eca650e51 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:57.922488 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 729/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:57.927366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e4d4-19f9-4b6d-a384-88a90ef94246 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:57.927823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e4d4-19f9-4b6d-a384-88a90ef94246 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:57.927938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e4d4-19f9-4b6d-a384-88a90ef94246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:57.945918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9333e4d4-19f9-4b6d-a384-88a90ef94246 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:57.947094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9333e4d4-19f9-4b6d-a384-88a90ef94246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:57.955267 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 695/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:40:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:58.114033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c8638-e3eb-4a9d-a627-177eca650e51 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:58.128645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c8638-e3eb-4a9d-a627-177eca650e51 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:58.134041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccc90c-5771-41df-bf99-99409d612cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:58.134661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc90c-5771-41df-bf99-99409d612cb5 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:58.134944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc90c-5771-41df-bf99-99409d612cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:58.135224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc90c-5771-41df-bf99-99409d612cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:58.143787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccc90c-5771-41df-bf99-99409d612cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:58.145401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccc90c-5771-41df-bf99-99409d612cb5 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:58.154549 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 730/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:40:59.523245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd67961-1ee3-4c93-90ca-49107b3a4a8d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:59.523855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd67961-1ee3-4c93-90ca-49107b3a4a8d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:59.523855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd67961-1ee3-4c93-90ca-49107b3a4a8d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:59.525628 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 696/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:40:59.530731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368fd5f-9db8-42fa-b520-74230942efb0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:59.531201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368fd5f-9db8-42fa-b520-74230942efb0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:59.531316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368fd5f-9db8-42fa-b520-74230942efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:59.548850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8368fd5f-9db8-42fa-b520-74230942efb0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:40:59.550037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8368fd5f-9db8-42fa-b520-74230942efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:40:59.558221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 731/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:40:59.716237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd67961-1ee3-4c93-90ca-49107b3a4a8d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:40:59.730326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd67961-1ee3-4c93-90ca-49107b3a4a8d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:40:59.736159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302644c-cf1f-44dc-8cda-e8914d4b2603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:40:59.736773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302644c-cf1f-44dc-8cda-e8914d4b2603 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:40:59.737051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302644c-cf1f-44dc-8cda-e8914d4b2603 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:40:59.737324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302644c-cf1f-44dc-8cda-e8914d4b2603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:40:59.745111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302644c-cf1f-44dc-8cda-e8914d4b2603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:40:59.746685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8302644c-cf1f-44dc-8cda-e8914d4b2603 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:40:59.756364 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 697/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:40:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:01.080925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff890-0ad2-431f-8c04-0d9fb4644175 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:01.081484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff890-0ad2-431f-8c04-0d9fb4644175 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:01.081484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ff890-0ad2-431f-8c04-0d9fb4644175 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:01.083232 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 732/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:01.088175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d08c-9202-487a-b902-5e01de9c2f7b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:01.088620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d08c-9202-487a-b902-5e01de9c2f7b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:01.088739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127d08c-9202-487a-b902-5e01de9c2f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:01.106544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5127d08c-9202-487a-b902-5e01de9c2f7b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:01.107715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5127d08c-9202-487a-b902-5e01de9c2f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:01.115372 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 698/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:01.274724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff890-0ad2-431f-8c04-0d9fb4644175 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:01.288860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ff890-0ad2-431f-8c04-0d9fb4644175 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:01.294759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eeac6a-23e6-4215-8610-5677f0169eac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:01.295413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeac6a-23e6-4215-8610-5677f0169eac service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:01.295698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeac6a-23e6-4215-8610-5677f0169eac service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:01.296013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeac6a-23e6-4215-8610-5677f0169eac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:01.304022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eeac6a-23e6-4215-8610-5677f0169eac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:01.305619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eeac6a-23e6-4215-8610-5677f0169eac service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:01.315317 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 733/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:02.620260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409c637-a880-44fc-a087-c55213ef7941 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:02.620819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409c637-a880-44fc-a087-c55213ef7941 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:02.620819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409c637-a880-44fc-a087-c55213ef7941 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:02.623142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 699/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:02.628385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5559c09-966a-4e50-837d-fcecebc60d0f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:02.628804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5559c09-966a-4e50-837d-fcecebc60d0f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:02.628944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5559c09-966a-4e50-837d-fcecebc60d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:02.647787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d5559c09-966a-4e50-837d-fcecebc60d0f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:02.649046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d5559c09-966a-4e50-837d-fcecebc60d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:02.656640 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 734/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:02.815673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409c637-a880-44fc-a087-c55213ef7941 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:02.829525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409c637-a880-44fc-a087-c55213ef7941 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:02.834819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c9959-f197-4b13-94db-08fed50d43f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:02.835447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c9959-f197-4b13-94db-08fed50d43f6 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:02.835728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c9959-f197-4b13-94db-08fed50d43f6 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:02.836029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c9959-f197-4b13-94db-08fed50d43f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:02.844184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c9959-f197-4b13-94db-08fed50d43f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:02.845765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c9959-f197-4b13-94db-08fed50d43f6 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:02.854833 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 700/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:04.172184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416deff-2369-4aaf-bae6-513082c80b34 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:04.172732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416deff-2369-4aaf-bae6-513082c80b34 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:04.172732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416deff-2369-4aaf-bae6-513082c80b34 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:04.174555 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 735/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:04.179504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f760c-8f36-48fc-a4ce-c8fee827d221 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:04.180046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f760c-8f36-48fc-a4ce-c8fee827d221 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:04.180155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f760c-8f36-48fc-a4ce-c8fee827d221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:04.198343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c48f760c-8f36-48fc-a4ce-c8fee827d221 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:04.199538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c48f760c-8f36-48fc-a4ce-c8fee827d221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:04.207211 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 701/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:04.365184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416deff-2369-4aaf-bae6-513082c80b34 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:04.379800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416deff-2369-4aaf-bae6-513082c80b34 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:04.385157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef44eb9-bd66-49e8-a66c-891c32125111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:04.385773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef44eb9-bd66-49e8-a66c-891c32125111 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:04.386052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef44eb9-bd66-49e8-a66c-891c32125111 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:04.386324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef44eb9-bd66-49e8-a66c-891c32125111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:04.394528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef44eb9-bd66-49e8-a66c-891c32125111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:04.396139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef44eb9-bd66-49e8-a66c-891c32125111 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:04.405233 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 736/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:05.726446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bec54-a62c-460e-abca-6364013209c9 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:05.727020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bec54-a62c-460e-abca-6364013209c9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:05.727020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bec54-a62c-460e-abca-6364013209c9 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:05.728873 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 702/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:05.734313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed2d6f-bc94-4c9d-ad39-275ef5165901 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:05.734992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed2d6f-bc94-4c9d-ad39-275ef5165901 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:05.734992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed2d6f-bc94-4c9d-ad39-275ef5165901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:05.753619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9bed2d6f-bc94-4c9d-ad39-275ef5165901 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:05.754794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9bed2d6f-bc94-4c9d-ad39-275ef5165901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:05.762458 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 737/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:05.918225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bec54-a62c-460e-abca-6364013209c9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:05.932747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bec54-a62c-460e-abca-6364013209c9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:05.938722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2e663-ba0f-46d9-9bea-ca4182a7268f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:05.939346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2e663-ba0f-46d9-9bea-ca4182a7268f service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:05.939624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2e663-ba0f-46d9-9bea-ca4182a7268f service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:05.940053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2e663-ba0f-46d9-9bea-ca4182a7268f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:05.948107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2e663-ba0f-46d9-9bea-ca4182a7268f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:05.949686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2e663-ba0f-46d9-9bea-ca4182a7268f service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:05.958812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 703/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:08.217974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47883b2b-b405-4695-93d8-3f9b825ada1b None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:08.218569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47883b2b-b405-4695-93d8-3f9b825ada1b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:08.218569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47883b2b-b405-4695-93d8-3f9b825ada1b None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:08.220309 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 738/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:08.226791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5fb76-c06a-4ad5-812a-864ef6b1edc1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:08.227224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5fb76-c06a-4ad5-812a-864ef6b1edc1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:08.227349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5fb76-c06a-4ad5-812a-864ef6b1edc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:08.246528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6fa5fb76-c06a-4ad5-812a-864ef6b1edc1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:08.248259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6fa5fb76-c06a-4ad5-812a-864ef6b1edc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:08.256008 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 704/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:08.295185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47883b2b-b405-4695-93d8-3f9b825ada1b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:08.305716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47883b2b-b405-4695-93d8-3f9b825ada1b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:08.309820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2aa62-5768-499f-9a67-336495cb3645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:08.310448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2aa62-5768-499f-9a67-336495cb3645 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:08.310729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2aa62-5768-499f-9a67-336495cb3645 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:08.311000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2aa62-5768-499f-9a67-336495cb3645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:08.319708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2aa62-5768-499f-9a67-336495cb3645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:08.321186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2aa62-5768-499f-9a67-336495cb3645 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:08.330986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 739/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:10.824094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec52846-26db-450d-aac1-163a7bb1791f None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:10.824635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec52846-26db-450d-aac1-163a7bb1791f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:10.824635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec52846-26db-450d-aac1-163a7bb1791f None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:10.826491 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 705/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:10.832776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95885-e053-49c1-92a9-4587b9a3a660 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:10.833211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95885-e053-49c1-92a9-4587b9a3a660 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:10.833342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f95885-e053-49c1-92a9-4587b9a3a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:10.851855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-78f95885-e053-49c1-92a9-4587b9a3a660 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:10.853068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-78f95885-e053-49c1-92a9-4587b9a3a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:10.861345 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 740/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:10.899860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec52846-26db-450d-aac1-163a7bb1791f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:10.910785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec52846-26db-450d-aac1-163a7bb1791f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:10.914223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a51ecd-067f-44d5-a634-1cd10fcd021e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:10.914835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51ecd-067f-44d5-a634-1cd10fcd021e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:10.915116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51ecd-067f-44d5-a634-1cd10fcd021e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:10.915389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a51ecd-067f-44d5-a634-1cd10fcd021e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:10.923973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51ecd-067f-44d5-a634-1cd10fcd021e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:10.925406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a51ecd-067f-44d5-a634-1cd10fcd021e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:10.934427 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 706/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:13.572785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef8a9d-0015-4716-81fc-4f8c74a2488f None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:13.573348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef8a9d-0015-4716-81fc-4f8c74a2488f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:13.573461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef8a9d-0015-4716-81fc-4f8c74a2488f None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:13.575872 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 741/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:13.582252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfb4a2-bfe3-484e-bb8a-1299540eebe3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:13.582687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfb4a2-bfe3-484e-bb8a-1299540eebe3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:13.582807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfb4a2-bfe3-484e-bb8a-1299540eebe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:13.600542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-dbcfb4a2-bfe3-484e-bb8a-1299540eebe3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:13.601704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dbcfb4a2-bfe3-484e-bb8a-1299540eebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:13.609332 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 707/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:13.649515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef8a9d-0015-4716-81fc-4f8c74a2488f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:13.659978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef8a9d-0015-4716-81fc-4f8c74a2488f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:13.663387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f85b9-5578-403f-8f29-df398e6570ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:13.664042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f85b9-5578-403f-8f29-df398e6570ee service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:13.664326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f85b9-5578-403f-8f29-df398e6570ee service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:13.664603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f85b9-5578-403f-8f29-df398e6570ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:13.673143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f85b9-5578-403f-8f29-df398e6570ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:13.674575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f85b9-5578-403f-8f29-df398e6570ee service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:13.683694 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 742/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:16.139280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dcd4e-272b-4772-afaa-dce43e603806 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:16.139818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dcd4e-272b-4772-afaa-dce43e603806 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:16.139943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935dcd4e-272b-4772-afaa-dce43e603806 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:16.141684 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 708/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:16.148159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762367b-7aef-45be-864c-c0e3c32de101 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:16.148628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762367b-7aef-45be-864c-c0e3c32de101 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:16.148733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762367b-7aef-45be-864c-c0e3c32de101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:16.166955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e762367b-7aef-45be-864c-c0e3c32de101 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:16.168193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e762367b-7aef-45be-864c-c0e3c32de101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:16.175809 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 743/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:16.215884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dcd4e-272b-4772-afaa-dce43e603806 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:16.226534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935dcd4e-272b-4772-afaa-dce43e603806 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:16.230001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d705f6-80cd-426a-bae8-a6f991c3365e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:16.230627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d705f6-80cd-426a-bae8-a6f991c3365e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:16.230938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d705f6-80cd-426a-bae8-a6f991c3365e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:16.231211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d705f6-80cd-426a-bae8-a6f991c3365e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:16.239788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d705f6-80cd-426a-bae8-a6f991c3365e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:16.241260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d705f6-80cd-426a-bae8-a6f991c3365e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:16.250302 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 709/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:18.645906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906293a0-3d11-4b77-a0c3-f0f340ee5b07 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:18.646439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906293a0-3d11-4b77-a0c3-f0f340ee5b07 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:18.646439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906293a0-3d11-4b77-a0c3-f0f340ee5b07 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:18.648214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 744/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:18.654601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52820c-1da3-4235-9580-3965d74762c5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:18.655031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52820c-1da3-4235-9580-3965d74762c5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:18.655241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52820c-1da3-4235-9580-3965d74762c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:18.674428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6a52820c-1da3-4235-9580-3965d74762c5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:18.675692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6a52820c-1da3-4235-9580-3965d74762c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:18.683515 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 710/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:18.722667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906293a0-3d11-4b77-a0c3-f0f340ee5b07 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:18.733692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906293a0-3d11-4b77-a0c3-f0f340ee5b07 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:18.737095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdd8ef-91aa-4a4b-b899-819e8595e587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:18.737714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd8ef-91aa-4a4b-b899-819e8595e587 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:18.737995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd8ef-91aa-4a4b-b899-819e8595e587 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:18.738268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdd8ef-91aa-4a4b-b899-819e8595e587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:18.747518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdd8ef-91aa-4a4b-b899-819e8595e587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:18.748992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdd8ef-91aa-4a4b-b899-819e8595e587 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:18.758128 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 745/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:21.191879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc033b-7877-4221-935b-0e82745fe1e1 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:21.192498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc033b-7877-4221-935b-0e82745fe1e1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:21.192498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc033b-7877-4221-935b-0e82745fe1e1 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:21.194209 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 711/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:21.200705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0cd9-f260-4fda-ba92-97aafd0308ff None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:21.201128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0cd9-f260-4fda-ba92-97aafd0308ff None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:21.201241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0cd9-f260-4fda-ba92-97aafd0308ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:21.219524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a48a0cd9-f260-4fda-ba92-97aafd0308ff None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:21.220738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a48a0cd9-f260-4fda-ba92-97aafd0308ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:21.228380 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 746/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:21.267284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc033b-7877-4221-935b-0e82745fe1e1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:21.278291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc033b-7877-4221-935b-0e82745fe1e1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:21.281663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39273780-48d3-41a1-bf5f-83201cfc8d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:21.282274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39273780-48d3-41a1-bf5f-83201cfc8d88 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:21.282550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39273780-48d3-41a1-bf5f-83201cfc8d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:21.282818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39273780-48d3-41a1-bf5f-83201cfc8d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:21.291359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39273780-48d3-41a1-bf5f-83201cfc8d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:21.292813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39273780-48d3-41a1-bf5f-83201cfc8d88 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:21.302338 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 712/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:23.685326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f410a0-d8ab-47db-9e4a-9fd60f951382 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:23.685903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f410a0-d8ab-47db-9e4a-9fd60f951382 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:23.685903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f410a0-d8ab-47db-9e4a-9fd60f951382 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:23.687709 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 747/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:23.694266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61eed6-3277-4e75-bb6c-545b9c9364e9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:23.694679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61eed6-3277-4e75-bb6c-545b9c9364e9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:23.694816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61eed6-3277-4e75-bb6c-545b9c9364e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:23.712002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2f61eed6-3277-4e75-bb6c-545b9c9364e9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:23.713154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f61eed6-3277-4e75-bb6c-545b9c9364e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:23.721005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 713/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:23.760172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f410a0-d8ab-47db-9e4a-9fd60f951382 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:23.761868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-74f410a0-d8ab-47db-9e4a-9fd60f951382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:23.774285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f410a0-d8ab-47db-9e4a-9fd60f951382 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:23.777722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a771c6-87a6-4e62-aa2e-fce9322c9de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:23.778342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a771c6-87a6-4e62-aa2e-fce9322c9de5 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:23.778625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a771c6-87a6-4e62-aa2e-fce9322c9de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:23.778901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a771c6-87a6-4e62-aa2e-fce9322c9de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:23.787493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a771c6-87a6-4e62-aa2e-fce9322c9de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:23.788950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a771c6-87a6-4e62-aa2e-fce9322c9de5 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:23.798634 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 748/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:26.214419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e66c-5fdd-4906-a5bd-3574704d257d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:26.215579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e66c-5fdd-4906-a5bd-3574704d257d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:26.215579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0e66c-5fdd-4906-a5bd-3574704d257d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:26.217572 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 714/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:26.224015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b644e-a4f3-4f3a-a87a-53a2ee390695 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:26.224417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b644e-a4f3-4f3a-a87a-53a2ee390695 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:26.224572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b644e-a4f3-4f3a-a87a-53a2ee390695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:26.242672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-073b644e-a4f3-4f3a-a87a-53a2ee390695 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:26.243859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-073b644e-a4f3-4f3a-a87a-53a2ee390695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:26.252007 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 749/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:26.289733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0e66c-5fdd-4906-a5bd-3574704d257d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:26.300091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0e66c-5fdd-4906-a5bd-3574704d257d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:26.303539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9686a-71e6-46dc-88f5-8d4b9580cd51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:26.304194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9686a-71e6-46dc-88f5-8d4b9580cd51 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:26.304472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9686a-71e6-46dc-88f5-8d4b9580cd51 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:26.304740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9686a-71e6-46dc-88f5-8d4b9580cd51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:26.313666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9686a-71e6-46dc-88f5-8d4b9580cd51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:26.315089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9686a-71e6-46dc-88f5-8d4b9580cd51 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:26.325105 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 715/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:28.704458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ebe51-7261-441e-8d3c-a6ad4ad17894 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:28.705013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ebe51-7261-441e-8d3c-a6ad4ad17894 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:28.705013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ebe51-7261-441e-8d3c-a6ad4ad17894 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:28.706735 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 750/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:28.713283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c8cee-1314-4cf6-a52a-4f44d582fc04 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:28.713705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c8cee-1314-4cf6-a52a-4f44d582fc04 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:28.713864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c8cee-1314-4cf6-a52a-4f44d582fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:28.733464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-527c8cee-1314-4cf6-a52a-4f44d582fc04 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:28.734669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-527c8cee-1314-4cf6-a52a-4f44d582fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:28.742350 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 716/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:28.779691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ebe51-7261-441e-8d3c-a6ad4ad17894 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:28.790057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ebe51-7261-441e-8d3c-a6ad4ad17894 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:28.794153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a878e90-0c22-487f-8321-3c217ace276e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:28.794769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a878e90-0c22-487f-8321-3c217ace276e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:28.795047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a878e90-0c22-487f-8321-3c217ace276e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:28.795322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a878e90-0c22-487f-8321-3c217ace276e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:28.803891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a878e90-0c22-487f-8321-3c217ace276e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:28.805351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a878e90-0c22-487f-8321-3c217ace276e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:28.814462 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 751/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:31.215358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9ef28-d1f2-4ffd-9ec7-cf6ca67d302d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:31.215994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9ef28-d1f2-4ffd-9ec7-cf6ca67d302d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:31.215994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9ef28-d1f2-4ffd-9ec7-cf6ca67d302d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:31.218060 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 717/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:31.224946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211fe66-ed55-4980-8642-94df0d2e4e01 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:31.225358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211fe66-ed55-4980-8642-94df0d2e4e01 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:31.225494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211fe66-ed55-4980-8642-94df0d2e4e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:31.243290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2211fe66-ed55-4980-8642-94df0d2e4e01 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:31.244495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2211fe66-ed55-4980-8642-94df0d2e4e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:31.253015 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 752/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:31.289514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9ef28-d1f2-4ffd-9ec7-cf6ca67d302d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:31.300277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9ef28-d1f2-4ffd-9ec7-cf6ca67d302d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:31.303705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173991a-ed74-4ff8-ab58-15a994fbd999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:31.304359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173991a-ed74-4ff8-ab58-15a994fbd999 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:31.304636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173991a-ed74-4ff8-ab58-15a994fbd999 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:31.304906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173991a-ed74-4ff8-ab58-15a994fbd999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:31.314032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173991a-ed74-4ff8-ab58-15a994fbd999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:31.315454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173991a-ed74-4ff8-ab58-15a994fbd999 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:31.324551 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 718/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:52.810640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f5331-cdfd-4448-ba75-748289cb3844 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:52.811167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f5331-cdfd-4448-ba75-748289cb3844 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:52.811283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498f5331-cdfd-4448-ba75-748289cb3844 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:52.813033 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 753/1471] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:52.818385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e91f4-9e3e-49b3-a711-112b1160b5e2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:52.818780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e91f4-9e3e-49b3-a711-112b1160b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:52.818943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e91f4-9e3e-49b3-a711-112b1160b5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:52.837150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-827e91f4-9e3e-49b3-a711-112b1160b5e2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:52.838336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-827e91f4-9e3e-49b3-a711-112b1160b5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:52.846298 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 719/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:52.893945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2194ae-cb9b-49bd-8229-5b8e724525ab None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:52.894236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2194ae-cb9b-49bd-8229-5b8e724525ab None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:52.894519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2194ae-cb9b-49bd-8229-5b8e724525ab None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:52.896301 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 754/1473] 10.222.0.16 () {54 vars in 961 bytes} [Sat Mar 26 20:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:52.901007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d9b35-b9c3-4e36-801c-86bac37bd990 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:52.901335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d9b35-b9c3-4e36-801c-86bac37bd990 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:52.901619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d9b35-b9c3-4e36-801c-86bac37bd990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:52.919636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-515d9b35-b9c3-4e36-801c-86bac37bd990 None None] MFA Rules not processed for user `82c1da5e55da4bf380e86064d66e638b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:52.920836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-515d9b35-b9c3-4e36-801c-86bac37bd990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:52.927437 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 720/1474] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Mar 26 20:41:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:41:52.935179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2194ae-cb9b-49bd-8229-5b8e724525ab None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:52.945555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2194ae-cb9b-49bd-8229-5b8e724525ab None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:52.948946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673aaf3-c7ae-44af-9dfb-c22507f9472f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:52.949552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673aaf3-c7ae-44af-9dfb-c22507f9472f service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:52.949826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673aaf3-c7ae-44af-9dfb-c22507f9472f service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:52.950101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673aaf3-c7ae-44af-9dfb-c22507f9472f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:52.958541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673aaf3-c7ae-44af-9dfb-c22507f9472f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:52.959983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673aaf3-c7ae-44af-9dfb-c22507f9472f service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:52.969267 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 755/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:41:55.418327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47a18c-236c-4f8f-8f72-aec23a6891b0 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:55.418897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47a18c-236c-4f8f-8f72-aec23a6891b0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:55.418897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47a18c-236c-4f8f-8f72-aec23a6891b0 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:55.420783 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 721/1476] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:55.427283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0c22-98c3-4eef-a3ce-b28238b4853b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:55.427698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0c22-98c3-4eef-a3ce-b28238b4853b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:55.427837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0c22-98c3-4eef-a3ce-b28238b4853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:55.445132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4c7b0c22-98c3-4eef-a3ce-b28238b4853b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:55.446313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4c7b0c22-98c3-4eef-a3ce-b28238b4853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:55.454594 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 756/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:55.479327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47a18c-236c-4f8f-8f72-aec23a6891b0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:55.491688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47a18c-236c-4f8f-8f72-aec23a6891b0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:55.496645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c71f7c-64ea-4870-b54d-df3b03ae6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:55.497277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c71f7c-64ea-4870-b54d-df3b03ae6657 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:55.497557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c71f7c-64ea-4870-b54d-df3b03ae6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:55.497835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c71f7c-64ea-4870-b54d-df3b03ae6657 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:55.498573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c71f7c-64ea-4870-b54d-df3b03ae6657 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:55.500348 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-f3c71f7c-64ea-4870-b54d-df3b03ae6657 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:41:55.500348 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:41:55.500348 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:41:55.501498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c71f7c-64ea-4870-b54d-df3b03ae6657 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:55.520392 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 722/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Mar 26 20:41:55 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:41:57.892720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20376e-fe9d-4e21-aa11-d02e801bb659 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:57.893284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20376e-fe9d-4e21-aa11-d02e801bb659 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:57.893284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20376e-fe9d-4e21-aa11-d02e801bb659 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:57.895028 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 757/1479] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:41:57.902166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4d17-975e-4857-8357-38c31802227b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:57.902621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4d17-975e-4857-8357-38c31802227b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:57.902725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c4d17-975e-4857-8357-38c31802227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:57.920851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-742c4d17-975e-4857-8357-38c31802227b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:41:57.922014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-742c4d17-975e-4857-8357-38c31802227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:41:57.929945 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 723/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:41:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:41:57.971589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20376e-fe9d-4e21-aa11-d02e801bb659 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:41:57.986067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20376e-fe9d-4e21-aa11-d02e801bb659 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:41:57.991316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1cf845-5d25-48da-8d27-42833850d9de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:41:57.991945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf845-5d25-48da-8d27-42833850d9de service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:41:57.992238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf845-5d25-48da-8d27-42833850d9de service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:41:57.992514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1cf845-5d25-48da-8d27-42833850d9de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:41:58.000287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cf845-5d25-48da-8d27-42833850d9de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:41:58.001867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1cf845-5d25-48da-8d27-42833850d9de service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:41:58.011039 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 758/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:41:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:42:00.560283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72259b-e672-481b-917b-600ec155a686 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:00.560896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72259b-e672-481b-917b-600ec155a686 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:00.560896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72259b-e672-481b-917b-600ec155a686 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:00.562554 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 724/1482] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:42:00.569448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9869cf6-cbc1-4ee3-8fa5-0207c06b7bef None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:00.569931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9869cf6-cbc1-4ee3-8fa5-0207c06b7bef None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:00.570059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9869cf6-cbc1-4ee3-8fa5-0207c06b7bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:00.587590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b9869cf6-cbc1-4ee3-8fa5-0207c06b7bef None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:42:00.588895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b9869cf6-cbc1-4ee3-8fa5-0207c06b7bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:42:00.597055 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 759/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:42:00.635479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72259b-e672-481b-917b-600ec155a686 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:42:00.645962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72259b-e672-481b-917b-600ec155a686 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:42:00.649406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a2ca0-292f-4052-8823-bc6407704f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:42:00.650058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a2ca0-292f-4052-8823-bc6407704f3b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:00.650343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a2ca0-292f-4052-8823-bc6407704f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:00.650617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a2ca0-292f-4052-8823-bc6407704f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:00.659314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a2ca0-292f-4052-8823-bc6407704f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:42:00.660787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a2ca0-292f-4052-8823-bc6407704f3b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:42:00.670422 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 725/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:42:03.092648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c751d97-4ee8-4c34-ba16-ba7805bbed56 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:03.093196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c751d97-4ee8-4c34-ba16-ba7805bbed56 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:03.093196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c751d97-4ee8-4c34-ba16-ba7805bbed56 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:03.094972 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 760/1485] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:42:03.101618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292da0bc-69ba-4bda-a91f-dcc68affe781 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:03.102074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292da0bc-69ba-4bda-a91f-dcc68affe781 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:03.102210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292da0bc-69ba-4bda-a91f-dcc68affe781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:03.119473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-292da0bc-69ba-4bda-a91f-dcc68affe781 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:42:03.121211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-292da0bc-69ba-4bda-a91f-dcc68affe781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:42:03.128969 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 726/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:42:03.167411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c751d97-4ee8-4c34-ba16-ba7805bbed56 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:42:03.178095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c751d97-4ee8-4c34-ba16-ba7805bbed56 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:42:03.181541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d435d-6791-4038-8db7-c4be151aa235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:42:03.182648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d435d-6791-4038-8db7-c4be151aa235 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:03.182933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d435d-6791-4038-8db7-c4be151aa235 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:03.183203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d435d-6791-4038-8db7-c4be151aa235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:03.191798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d435d-6791-4038-8db7-c4be151aa235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:42:03.193259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d435d-6791-4038-8db7-c4be151aa235 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:42:03.203008 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 761/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:42:05.745482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6cb3b-a512-4c1b-8658-02bbeb72ecc4 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:05.746060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6cb3b-a512-4c1b-8658-02bbeb72ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:05.746060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee6cb3b-a512-4c1b-8658-02bbeb72ecc4 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:05.747799 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 727/1488] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:42:05.754275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa76144-ecab-40fe-be36-cd5f0ced2a98 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:05.754777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa76144-ecab-40fe-be36-cd5f0ced2a98 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:05.754889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa76144-ecab-40fe-be36-cd5f0ced2a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:05.772734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cfa76144-ecab-40fe-be36-cd5f0ced2a98 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:42:05.773939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cfa76144-ecab-40fe-be36-cd5f0ced2a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:42:05.782146 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 762/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:42:05.822577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6cb3b-a512-4c1b-8658-02bbeb72ecc4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:42:05.833316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee6cb3b-a512-4c1b-8658-02bbeb72ecc4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:42:05.836729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532defe-4ac9-4da3-9ce3-fc29e6365561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:42:05.837347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532defe-4ac9-4da3-9ce3-fc29e6365561 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:05.837625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532defe-4ac9-4da3-9ce3-fc29e6365561 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:05.837898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532defe-4ac9-4da3-9ce3-fc29e6365561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:05.847334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532defe-4ac9-4da3-9ce3-fc29e6365561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:42:05.848797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532defe-4ac9-4da3-9ce3-fc29e6365561 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:42:05.857792 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 728/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:42:08.397904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b86458-4425-4a2b-b0e2-322544827881 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:08.398439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b86458-4425-4a2b-b0e2-322544827881 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:08.398439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b86458-4425-4a2b-b0e2-322544827881 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:08.400235 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 763/1491] 10.222.0.16 () {54 vars in 926 bytes} [Sat Mar 26 20:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:42:08.406593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771a13a-0c14-4f72-83df-de40ffc24dc3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:08.407024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771a13a-0c14-4f72-83df-de40ffc24dc3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:08.407204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771a13a-0c14-4f72-83df-de40ffc24dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:08.424673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f771a13a-0c14-4f72-83df-de40ffc24dc3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:42:08.425851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f771a13a-0c14-4f72-83df-de40ffc24dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:42:08.434119 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 729/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Sat Mar 26 20:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:42:08.474309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b86458-4425-4a2b-b0e2-322544827881 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:42:08.484589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b86458-4425-4a2b-b0e2-322544827881 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:42:08.488041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f1953-bc74-427c-95d2-1281c966dcc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:42:08.488657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1953-bc74-427c-95d2-1281c966dcc9 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:42:08.488936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1953-bc74-427c-95d2-1281c966dcc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:42:08.489209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f1953-bc74-427c-95d2-1281c966dcc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:42:08.498188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f1953-bc74-427c-95d2-1281c966dcc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:42:08.499609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f1953-bc74-427c-95d2-1281c966dcc9 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:42:08.508644 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 764/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:43:34.791708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750118b-9af5-4227-aee1-99b0095cab25 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:34.792326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750118b-9af5-4227-aee1-99b0095cab25 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:34.792326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750118b-9af5-4227-aee1-99b0095cab25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:34.810217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1750118b-9af5-4227-aee1-99b0095cab25 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:43:34.811374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1750118b-9af5-4227-aee1-99b0095cab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:43:34.818918 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 730/1494] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:43:34.828521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098e024-c7da-439a-be75-7c72bcc48a48 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:34.829033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098e024-c7da-439a-be75-7c72bcc48a48 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:34.829141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098e024-c7da-439a-be75-7c72bcc48a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:34.846524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c098e024-c7da-439a-be75-7c72bcc48a48 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:43:34.847706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c098e024-c7da-439a-be75-7c72bcc48a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:43:34.855351 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 765/1495] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:43:34.859684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750118b-9af5-4227-aee1-99b0095cab25 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:34.869731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750118b-9af5-4227-aee1-99b0095cab25 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:34.874229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:34.874860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:34.875142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:34.875420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:34.876165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:43:34.876472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:34.877491 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:43:34.877491 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:43:34.877491 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:43:34.878360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:34.890010 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 731/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:43:34.897905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098e024-c7da-439a-be75-7c72bcc48a48 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:34.906775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098e024-c7da-439a-be75-7c72bcc48a48 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:34.911253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3026e-e833-4ce4-aaca-35b6cfb7da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:34.911885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3026e-e833-4ce4-aaca-35b6cfb7da99 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:34.912203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3026e-e833-4ce4-aaca-35b6cfb7da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:34.912485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3026e-e833-4ce4-aaca-35b6cfb7da99 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:34.913701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3026e-e833-4ce4-aaca-35b6cfb7da99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:34.915445 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-5bd3026e-e833-4ce4-aaca-35b6cfb7da99 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:43:34.915445 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:43:34.915445 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:43:34.916670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3026e-e833-4ce4-aaca-35b6cfb7da99 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:34.952214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 766/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:43:34 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:43:34.956348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:34.966364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd2ae2-3550-4ba0-a257-5296b1daa179 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:35.022196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20bf63-bad8-4761-9f25-f5697adc9cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:35.023007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20bf63-bad8-4761-9f25-f5697adc9cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.023117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20bf63-bad8-4761-9f25-f5697adc9cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.023385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20bf63-bad8-4761-9f25-f5697adc9cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.024136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20bf63-bad8-4761-9f25-f5697adc9cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:35.025168 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-3f20bf63-bad8-4761-9f25-f5697adc9cc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:43:35.025168 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:43:35.025168 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:43:35.026366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20bf63-bad8-4761-9f25-f5697adc9cc7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:35.046582 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 732/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:43:34 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:43:35.050818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3026e-e833-4ce4-aaca-35b6cfb7da99 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:35.061456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3026e-e833-4ce4-aaca-35b6cfb7da99 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:35.065911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d62f-0df2-47a9-8190-e74b1bfc86b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:35.066555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d62f-0df2-47a9-8190-e74b1bfc86b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.066838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d62f-0df2-47a9-8190-e74b1bfc86b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.067114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d62f-0df2-47a9-8190-e74b1bfc86b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.067826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d62f-0df2-47a9-8190-e74b1bfc86b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:35.068873 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-7040d62f-0df2-47a9-8190-e74b1bfc86b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:43:35.068873 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:43:35.068873 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:43:35.069753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d62f-0df2-47a9-8190-e74b1bfc86b9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:35.081958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 767/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:43:35.085819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20bf63-bad8-4761-9f25-f5697adc9cc7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:35.095752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20bf63-bad8-4761-9f25-f5697adc9cc7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:35.100214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18dc77-8613-45ff-bd8f-a69b1431ec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:35.101355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18dc77-8613-45ff-bd8f-a69b1431ec95 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.101636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18dc77-8613-45ff-bd8f-a69b1431ec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.101907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18dc77-8613-45ff-bd8f-a69b1431ec95 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.102606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18dc77-8613-45ff-bd8f-a69b1431ec95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:35.103610 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-ed18dc77-8613-45ff-bd8f-a69b1431ec95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:43:35.103610 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:43:35.103610 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:43:35.104499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18dc77-8613-45ff-bd8f-a69b1431ec95 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:35.117800 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 733/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:43:35.121721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d62f-0df2-47a9-8190-e74b1bfc86b9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:35.131253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d62f-0df2-47a9-8190-e74b1bfc86b9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:35.136617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec2f6d-7383-4a9a-8c72-f536026088b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:35.137724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2f6d-7383-4a9a-8c72-f536026088b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.138114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2f6d-7383-4a9a-8c72-f536026088b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.138473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec2f6d-7383-4a9a-8c72-f536026088b6 admin admin] PATH_INFO: `/v3/projects/e26845df8e8641f6a87896a7e411473c/users/c0f9b7e39a594d1ba5508520b3bc0959/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.153167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec2f6d-7383-4a9a-8c72-f536026088b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26845df8e8641f6a87896a7e411473c, user_id=c0f9b7e39a594d1ba5508520b3bc0959, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:35.154204 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-29ec2f6d-7383-4a9a-8c72-f536026088b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:43:35.154204 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:43:35.154204 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:43:35.156150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec2f6d-7383-4a9a-8c72-f536026088b6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:35.168780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 768/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:43:35 2022] PUT /identity/v3/projects/e26845df8e8641f6a87896a7e411473c/users/c0f9b7e39a594d1ba5508520b3bc0959/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:43:35.180475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea12d51-e5b5-49e9-9bc6-3cf36216e8c0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.180773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea12d51-e5b5-49e9-9bc6-3cf36216e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.181055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea12d51-e5b5-49e9-9bc6-3cf36216e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.207909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4ea12d51-e5b5-49e9-9bc6-3cf36216e8c0 None None] MFA Rules not processed for user `c0f9b7e39a594d1ba5508520b3bc0959`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:43:35.209130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4ea12d51-e5b5-49e9-9bc6-3cf36216e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:43:35.269921 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 734/1502] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:43:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:43:35.281589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec2f6d-7383-4a9a-8c72-f536026088b6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:35.348219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec2f6d-7383-4a9a-8c72-f536026088b6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:35.354168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab962b-c909-4b2a-9e42-6737a5e3c5fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:35.354795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab962b-c909-4b2a-9e42-6737a5e3c5fd service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.355076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab962b-c909-4b2a-9e42-6737a5e3c5fd service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.355351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab962b-c909-4b2a-9e42-6737a5e3c5fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.362990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab962b-c909-4b2a-9e42-6737a5e3c5fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:35.364790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab962b-c909-4b2a-9e42-6737a5e3c5fd service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:35.373318 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 769/1503] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:43:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:43:35.444046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7826de2-3b3f-49e8-a38e-3256b1662d30 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.444374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7826de2-3b3f-49e8-a38e-3256b1662d30 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.444655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7826de2-3b3f-49e8-a38e-3256b1662d30 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.446346 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 735/1504] 10.222.0.16 () {52 vars in 829 bytes} [Sat Mar 26 20:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:43:35.449843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab962b-c909-4b2a-9e42-6737a5e3c5fd service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:35.509478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab962b-c909-4b2a-9e42-6737a5e3c5fd service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:35.513909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:35.514756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.515031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.515298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] PATH_INFO: `/v3/users/c0f9b7e39a594d1ba5508520b3bc0959` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.516509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f9b7e39a594d1ba5508520b3bc0959)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:35.517517 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:43:35.517517 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:43:35.517517 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:43:35.518712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:35.582520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f9b7e39a594d1ba5508520b3bc0959'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:35.596587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f9b7e39a594d1ba5508520b3bc0959'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:35.597365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f9b7e39a594d1ba5508520b3bc0959'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:35.597991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f9b7e39a594d1ba5508520b3bc0959'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:35.607576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f9b7e39a594d1ba5508520b3bc0959'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:35.629953 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 770/1505] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:43:35 2022] DELETE /identity/v3/users/c0f9b7e39a594d1ba5508520b3bc0959 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:43:35.634862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63662-e7cc-4943-a2bb-f9ebca18c634 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.635150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63662-e7cc-4943-a2bb-f9ebca18c634 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.635425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e63662-e7cc-4943-a2bb-f9ebca18c634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.653076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f3e63662-e7cc-4943-a2bb-f9ebca18c634 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:43:35.654250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f3e63662-e7cc-4943-a2bb-f9ebca18c634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:43:35.707983 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 736/1506] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:43:35.718115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:35.719484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:43:35.774259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5136b67-7293-42a9-a7aa-10af96bf5405 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:35.777837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176c097-3be4-43e0-8fe7-60eb8f53f67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:35.778466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176c097-3be4-43e0-8fe7-60eb8f53f67d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:35.778751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176c097-3be4-43e0-8fe7-60eb8f53f67d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:35.779030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176c097-3be4-43e0-8fe7-60eb8f53f67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:35.788224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176c097-3be4-43e0-8fe7-60eb8f53f67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:35.789835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176c097-3be4-43e0-8fe7-60eb8f53f67d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:35.799203 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 771/1507] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:43:36.134578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e63662-e7cc-4943-a2bb-f9ebca18c634 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:43:36.136181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f3e63662-e7cc-4943-a2bb-f9ebca18c634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:43:36.149431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e63662-e7cc-4943-a2bb-f9ebca18c634 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:43:36.154482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:43:36.155331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:43:36.155711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:43:36.156022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] PATH_INFO: `/v3/projects/e26845df8e8641f6a87896a7e411473c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:43:36.157272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26845df8e8641f6a87896a7e411473c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:43:36.158305 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:43:36.158305 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:43:36.158305 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:43:36.159488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:43:36.220247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26845df8e8641f6a87896a7e411473c', 'request_id': 'req-fd711dfa-a66c-483d-905f-c616622b3a7d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:36.229653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26845df8e8641f6a87896a7e411473c', 'request_id': 'req-fd711dfa-a66c-483d-905f-c616622b3a7d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:36.235565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26845df8e8641f6a87896a7e411473c', 'request_id': 'req-fd711dfa-a66c-483d-905f-c616622b3a7d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:36.253753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] The token cache is being invalidate because project e26845df8e8641f6a87896a7e411473c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:43:36.254041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:36.254687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd711dfa-a66c-483d-905f-c616622b3a7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:43:36.256337 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 737/1508] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:43:36 2022] DELETE /identity/v3/projects/e26845df8e8641f6a87896a7e411473c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:46:45.969097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377275aa-bb01-45cf-a95b-fd7313958cd0 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:45.969709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377275aa-bb01-45cf-a95b-fd7313958cd0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:45.969709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377275aa-bb01-45cf-a95b-fd7313958cd0 None None] PATH_INFO: `/v3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:45.971001 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 772/1509] 10.222.0.18 () {54 vars in 925 bytes} [Sat Mar 26 20:46:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:46:45.977503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa3e87-5ad7-46cc-9a56-3a09cc7de607 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:45.977910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa3e87-5ad7-46cc-9a56-3a09cc7de607 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:45.978054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa3e87-5ad7-46cc-9a56-3a09cc7de607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:46.000412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-22fa3e87-5ad7-46cc-9a56-3a09cc7de607 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:46:46.001665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-22fa3e87-5ad7-46cc-9a56-3a09cc7de607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:46:46.063628 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 738/1510] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Mar 26 20:46:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:46:47.968546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa608a-7692-4951-b022-992f4eb67894 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:47.969097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa608a-7692-4951-b022-992f4eb67894 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:47.969097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa608a-7692-4951-b022-992f4eb67894 None None] PATH_INFO: `/v3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:47.970369 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 773/1511] 10.222.0.21 () {54 vars in 925 bytes} [Sat Mar 26 20:46:47 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:46:47.976731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef5d6-1c25-4969-b76b-c35c8cb0cd3d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:47.977176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef5d6-1c25-4969-b76b-c35c8cb0cd3d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:47.977283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ef5d6-1c25-4969-b76b-c35c8cb0cd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:47.995558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-457ef5d6-1c25-4969-b76b-c35c8cb0cd3d None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:46:47.997272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-457ef5d6-1c25-4969-b76b-c35c8cb0cd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:46:48.005769 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 739/1512] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Mar 26 20:46:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:46:50.014548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3b08-f63d-4cb8-837b-77daf6bd4ec9 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:50.015101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3b08-f63d-4cb8-837b-77daf6bd4ec9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:50.015101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3b08-f63d-4cb8-837b-77daf6bd4ec9 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:50.016915 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 774/1513] 10.222.0.16 () {54 vars in 960 bytes} [Sat Mar 26 20:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:46:50.021928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea185c4-d53b-4574-ac74-fad73f6a161b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:50.022409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea185c4-d53b-4574-ac74-fad73f6a161b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:50.022514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea185c4-d53b-4574-ac74-fad73f6a161b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:50.041115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3ea185c4-d53b-4574-ac74-fad73f6a161b None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:46:50.042327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3ea185c4-d53b-4574-ac74-fad73f6a161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:46:50.051375 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 740/1514] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 20:46:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:46:50.058857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3b08-f63d-4cb8-837b-77daf6bd4ec9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:46:50.071504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3b08-f63d-4cb8-837b-77daf6bd4ec9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:46:50.076431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36a8c8-9ed3-4346-90cb-4d4b80880663 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:46:50.077039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a8c8-9ed3-4346-90cb-4d4b80880663 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:50.077317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a8c8-9ed3-4346-90cb-4d4b80880663 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:50.077588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36a8c8-9ed3-4346-90cb-4d4b80880663 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:50.086454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36a8c8-9ed3-4346-90cb-4d4b80880663 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:46:50.088088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36a8c8-9ed3-4346-90cb-4d4b80880663 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:46:50.098094 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 775/1515] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:46:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:46:51.994053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac7f5-49b9-4ef2-a7fe-221ad527a932 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:51.994512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac7f5-49b9-4ef2-a7fe-221ad527a932 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:51.994615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac7f5-49b9-4ef2-a7fe-221ad527a932 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:51.996469 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 741/1516] 10.222.0.16 () {54 vars in 960 bytes} [Sat Mar 26 20:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:46:52.001563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ad7cf-beb0-4059-98d1-336b5b65587f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:52.001985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ad7cf-beb0-4059-98d1-336b5b65587f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:52.002117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ad7cf-beb0-4059-98d1-336b5b65587f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:52.021420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a81ad7cf-beb0-4059-98d1-336b5b65587f None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:46:52.022527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a81ad7cf-beb0-4059-98d1-336b5b65587f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:46:52.031700 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 776/1517] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 20:46:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:46:52.039224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac7f5-49b9-4ef2-a7fe-221ad527a932 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:46:52.052152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac7f5-49b9-4ef2-a7fe-221ad527a932 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:46:52.056933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6492d-adec-4d62-af07-c72b9a5814bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:46:52.057548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6492d-adec-4d62-af07-c72b9a5814bd service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:46:52.057828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6492d-adec-4d62-af07-c72b9a5814bd service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:46:52.058103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6492d-adec-4d62-af07-c72b9a5814bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:46:52.068493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6492d-adec-4d62-af07-c72b9a5814bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:46:52.070080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6492d-adec-4d62-af07-c72b9a5814bd service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:46:52.079856 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 742/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:46:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:47:24.199522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64faa-f388-4a48-9407-3d8d7ebdccaf None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:24.200137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64faa-f388-4a48-9407-3d8d7ebdccaf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:24.200137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd64faa-f388-4a48-9407-3d8d7ebdccaf None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:24.201857 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 777/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:47:24.206747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916a8f-55fc-4364-bcc8-ae24ef6a1eb8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:24.207451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916a8f-55fc-4364-bcc8-ae24ef6a1eb8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:24.207560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97916a8f-55fc-4364-bcc8-ae24ef6a1eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:24.225683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-97916a8f-55fc-4364-bcc8-ae24ef6a1eb8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:47:24.226843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-97916a8f-55fc-4364-bcc8-ae24ef6a1eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:47:24.283089 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 743/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:47:24.437979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64faa-f388-4a48-9407-3d8d7ebdccaf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:47:24.439639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0cd64faa-f388-4a48-9407-3d8d7ebdccaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:47:24.512089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd64faa-f388-4a48-9407-3d8d7ebdccaf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:47:24.517537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f6b37-2529-4988-9267-257985d8e3b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:47:24.518171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6b37-2529-4988-9267-257985d8e3b0 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:24.518454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6b37-2529-4988-9267-257985d8e3b0 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:24.518733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6b37-2529-4988-9267-257985d8e3b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:24.526715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f6b37-2529-4988-9267-257985d8e3b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:47:24.528346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242f6b37-2529-4988-9267-257985d8e3b0 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:47:24.537511 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 778/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:47:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:47:25.869937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a07215-7384-43bf-ae23-deb18daedb2d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:25.870540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a07215-7384-43bf-ae23-deb18daedb2d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:25.870540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a07215-7384-43bf-ae23-deb18daedb2d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:25.872369 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 744/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Mar 26 20:47:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:47:25.876994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed63ed6-0717-4f36-b932-9ae062fcee2b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:25.877395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed63ed6-0717-4f36-b932-9ae062fcee2b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:25.877550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed63ed6-0717-4f36-b932-9ae062fcee2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:25.895527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9ed63ed6-0717-4f36-b932-9ae062fcee2b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:47:25.896746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9ed63ed6-0717-4f36-b932-9ae062fcee2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:47:25.906302 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 779/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Mar 26 20:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:47:26.062606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a07215-7384-43bf-ae23-deb18daedb2d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:47:26.077303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a07215-7384-43bf-ae23-deb18daedb2d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:47:26.082912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e00cb-8848-4fc6-bba7-cd90d747e45d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:47:26.083530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e00cb-8848-4fc6-bba7-cd90d747e45d service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:26.083810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e00cb-8848-4fc6-bba7-cd90d747e45d service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:26.084115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e00cb-8848-4fc6-bba7-cd90d747e45d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:26.092157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e00cb-8848-4fc6-bba7-cd90d747e45d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:47:26.093801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92e00cb-8848-4fc6-bba7-cd90d747e45d service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:47:26.103068 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 745/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:47:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:47:30.236906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df518384-37c8-48c8-b069-b6f3ebc706bc None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:30.237454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df518384-37c8-48c8-b069-b6f3ebc706bc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:30.237454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df518384-37c8-48c8-b069-b6f3ebc706bc None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:30.239186 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 780/1525] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:47:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:47:30.244866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29955b4-103e-4178-891d-23506771777e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:30.245304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29955b4-103e-4178-891d-23506771777e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:30.245407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29955b4-103e-4178-891d-23506771777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:30.263409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d29955b4-103e-4178-891d-23506771777e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:47:30.264621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d29955b4-103e-4178-891d-23506771777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:47:30.272274 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 746/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:47:30.309382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df518384-37c8-48c8-b069-b6f3ebc706bc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:47:30.311015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df518384-37c8-48c8-b069-b6f3ebc706bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:47:30.364457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df518384-37c8-48c8-b069-b6f3ebc706bc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:47:30.367855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63388e23-8ca8-4fb4-8f8c-cba56e2913e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:47:30.368511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63388e23-8ca8-4fb4-8f8c-cba56e2913e1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:30.368789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63388e23-8ca8-4fb4-8f8c-cba56e2913e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:30.369684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63388e23-8ca8-4fb4-8f8c-cba56e2913e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:30.378122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63388e23-8ca8-4fb4-8f8c-cba56e2913e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:47:30.379545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63388e23-8ca8-4fb4-8f8c-cba56e2913e1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:47:30.388688 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 781/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:47:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:47:32.757484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d8dd-1dea-426e-aa4b-ada3d71326bb None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:32.757996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d8dd-1dea-426e-aa4b-ada3d71326bb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:32.757996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061d8dd-1dea-426e-aa4b-ada3d71326bb None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:32.760421 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 747/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sat Mar 26 20:47:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:47:32.767036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5862827-4b62-4c60-9d1a-50f26b48d32d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:32.767456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5862827-4b62-4c60-9d1a-50f26b48d32d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:32.767614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5862827-4b62-4c60-9d1a-50f26b48d32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:32.785498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e5862827-4b62-4c60-9d1a-50f26b48d32d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:47:32.786707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e5862827-4b62-4c60-9d1a-50f26b48d32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:47:32.794335 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 782/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Mar 26 20:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:47:32.832761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061d8dd-1dea-426e-aa4b-ada3d71326bb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:47:32.834412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3061d8dd-1dea-426e-aa4b-ada3d71326bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:47:32.846916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061d8dd-1dea-426e-aa4b-ada3d71326bb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:47:32.850390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963941c-d6f9-4da1-a09d-70cdc2da9628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:47:32.851000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963941c-d6f9-4da1-a09d-70cdc2da9628 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:47:32.851275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963941c-d6f9-4da1-a09d-70cdc2da9628 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:47:32.851547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963941c-d6f9-4da1-a09d-70cdc2da9628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:47:32.860388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963941c-d6f9-4da1-a09d-70cdc2da9628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:47:32.861816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963941c-d6f9-4da1-a09d-70cdc2da9628 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:47:32.871651 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 748/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:48:23.949023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ddfff-7f63-408d-99c3-20c432096962 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:23.949669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ddfff-7f63-408d-99c3-20c432096962 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:23.949669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ddfff-7f63-408d-99c3-20c432096962 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:23.951300 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 783/1531] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:48:23.957935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b803-915c-44ae-993a-879a4d5fb92e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:23.958426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b803-915c-44ae-993a-879a4d5fb92e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:23.958525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6b803-915c-44ae-993a-879a4d5fb92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:23.976343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-23d6b803-915c-44ae-993a-879a4d5fb92e None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:48:23.977552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-23d6b803-915c-44ae-993a-879a4d5fb92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:48:23.985961 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 749/1532] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:48:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:48:59.618923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec268ba1-6fc3-4c7f-b1b9-50aa82691430 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:59.619523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec268ba1-6fc3-4c7f-b1b9-50aa82691430 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:59.619523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec268ba1-6fc3-4c7f-b1b9-50aa82691430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:59.640098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b66a4d-96fe-4b53-a18f-2cd7220a5746 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:59.640658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b66a4d-96fe-4b53-a18f-2cd7220a5746 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:59.640658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b66a4d-96fe-4b53-a18f-2cd7220a5746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:59.649311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ec268ba1-6fc3-4c7f-b1b9-50aa82691430 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:48:59.650796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ec268ba1-6fc3-4c7f-b1b9-50aa82691430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:48:59.660790 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 784/1533] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:48:59.672506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-32b66a4d-96fe-4b53-a18f-2cd7220a5746 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:48:59.673760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-32b66a4d-96fe-4b53-a18f-2cd7220a5746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:48:59.680541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2640a-dc03-4664-9378-fa3892d3d3cd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:59.680818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2640a-dc03-4664-9378-fa3892d3d3cd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:59.681084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef2640a-dc03-4664-9378-fa3892d3d3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:59.683576 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 750/1534] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:48:59.696174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d132-dca6-4819-aa38-fbd67f295b1f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:59.696555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d132-dca6-4819-aa38-fbd67f295b1f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:59.696751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0d132-dca6-4819-aa38-fbd67f295b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:59.713490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fef2640a-dc03-4664-9378-fa3892d3d3cd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:48:59.714726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fef2640a-dc03-4664-9378-fa3892d3d3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:48:59.721695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5ee0d132-dca6-4819-aa38-fbd67f295b1f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:48:59.723243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5ee0d132-dca6-4819-aa38-fbd67f295b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:48:59.729451 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 785/1535] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:48:59.734019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2640a-dc03-4664-9378-fa3892d3d3cd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:48:59.738258 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 751/1536] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Mar 26 20:48:59.743797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d132-dca6-4819-aa38-fbd67f295b1f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:48:59.748281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef2640a-dc03-4664-9378-fa3892d3d3cd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:48:59.758834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0d132-dca6-4819-aa38-fbd67f295b1f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:48:59.763865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae578-841e-465f-9c48-60efed5e8be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:48:59.764074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:48:59.764572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae578-841e-465f-9c48-60efed5e8be6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:59.764666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:59.764850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae578-841e-465f-9c48-60efed5e8be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:59.764938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:59.765131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ae578-841e-465f-9c48-60efed5e8be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:59.765231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:59.765865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:48:59.766152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ae578-841e-465f-9c48-60efed5e8be6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:48:59.766243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:48:59.766458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ae578-841e-465f-9c48-60efed5e8be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:48:59.767344 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:48:59.767344 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:48:59.767344 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:48:59.768291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:48:59.772917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ae578-841e-465f-9c48-60efed5e8be6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:48:59.785796 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 786/1537] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:48:59.791394 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 752/1538] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:48:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:48:59.795738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:48:59.799725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae578-841e-465f-9c48-60efed5e8be6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:48:59.810511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ae578-841e-465f-9c48-60efed5e8be6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:48:59.812949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb8e1d-5223-461f-999a-7aae88e4ebc2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:48:59.821541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1abc8d-a11b-4af7-9cea-479b001e3fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:48:59.822218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1abc8d-a11b-4af7-9cea-479b001e3fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:59.822617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1abc8d-a11b-4af7-9cea-479b001e3fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:59.823277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1abc8d-a11b-4af7-9cea-479b001e3fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:59.823817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1abc8d-a11b-4af7-9cea-479b001e3fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:48:59.824896 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-fd1abc8d-a11b-4af7-9cea-479b001e3fc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:48:59.824896 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:48:59.824896 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:48:59.825204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dadca6-f8cd-465a-9eb2-4cd61ebf06ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:48:59.825853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dadca6-f8cd-465a-9eb2-4cd61ebf06ba admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:59.826099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1abc8d-a11b-4af7-9cea-479b001e3fc0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:48:59.826193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dadca6-f8cd-465a-9eb2-4cd61ebf06ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:59.826392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dadca6-f8cd-465a-9eb2-4cd61ebf06ba admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:59.827080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dadca6-f8cd-465a-9eb2-4cd61ebf06ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:48:59.829432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dadca6-f8cd-465a-9eb2-4cd61ebf06ba admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:48:59.875710 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 787/1539] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:48:59 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:48:59.879978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff260-247f-498d-abc4-ea3fbba2ada3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:48:59.880272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff260-247f-498d-abc4-ea3fbba2ada3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:48:59.880558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdff260-247f-498d-abc4-ea3fbba2ada3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:48:59.885604 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 753/1540] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:48:59 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:48:59.886449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1abc8d-a11b-4af7-9cea-479b001e3fc0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:48:59.903410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5bdff260-247f-498d-abc4-ea3fbba2ada3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:48:59.904655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5bdff260-247f-498d-abc4-ea3fbba2ada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.003263 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 788/1541] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:00.004215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdff260-247f-498d-abc4-ea3fbba2ada3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.025218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdff260-247f-498d-abc4-ea3fbba2ada3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.032736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dba218-c065-4d6b-9a79-e645688b0c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.033412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dba218-c065-4d6b-9a79-e645688b0c85 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.033683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dba218-c065-4d6b-9a79-e645688b0c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.033951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dba218-c065-4d6b-9a79-e645688b0c85 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.034628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dba218-c065-4d6b-9a79-e645688b0c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.035630 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-73dba218-c065-4d6b-9a79-e645688b0c85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:00.035630 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:49:00.035630 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:49:00.038939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dba218-c065-4d6b-9a79-e645688b0c85 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.049872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1abc8d-a11b-4af7-9cea-479b001e3fc0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.058870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e189dbb-3f24-4309-824f-ad71776c5db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.059892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e189dbb-3f24-4309-824f-ad71776c5db0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.060528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e189dbb-3f24-4309-824f-ad71776c5db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.060806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e189dbb-3f24-4309-824f-ad71776c5db0 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.062658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e189dbb-3f24-4309-824f-ad71776c5db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.063760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e189dbb-3f24-4309-824f-ad71776c5db0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.070171 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 789/1542] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/users => generated 292 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:00.071288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012023fc-30cf-4c14-b181-e4741c8f26c4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.071590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012023fc-30cf-4c14-b181-e4741c8f26c4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.071871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012023fc-30cf-4c14-b181-e4741c8f26c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.091346 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 754/1543] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:48:59 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:00.093203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf783fec-58c7-4467-b18b-18ef4ff0f59d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.093561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf783fec-58c7-4467-b18b-18ef4ff0f59d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.093907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf783fec-58c7-4467-b18b-18ef4ff0f59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.099428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-012023fc-30cf-4c14-b181-e4741c8f26c4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.101294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-012023fc-30cf-4c14-b181-e4741c8f26c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.110772 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 790/1544] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.112241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c296-21e0-44fb-bd3b-88c02f3011a3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.112678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c296-21e0-44fb-bd3b-88c02f3011a3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.112964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c296-21e0-44fb-bd3b-88c02f3011a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.117052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cf783fec-58c7-4467-b18b-18ef4ff0f59d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.118259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf783fec-58c7-4467-b18b-18ef4ff0f59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.129067 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 755/1545] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.130240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730cdd7-a3b9-4e80-9f7c-e3bf8d9b4044 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.130527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730cdd7-a3b9-4e80-9f7c-e3bf8d9b4044 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.130807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730cdd7-a3b9-4e80-9f7c-e3bf8d9b4044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.132740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2d85c296-21e0-44fb-bd3b-88c02f3011a3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.134078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2d85c296-21e0-44fb-bd3b-88c02f3011a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.147940 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 791/1546] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.147940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334182-ad3f-4bbc-9517-b4814d6389b4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.147940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334182-ad3f-4bbc-9517-b4814d6389b4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.147940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29334182-ad3f-4bbc-9517-b4814d6389b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.159316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0730cdd7-a3b9-4e80-9f7c-e3bf8d9b4044 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.160549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0730cdd7-a3b9-4e80-9f7c-e3bf8d9b4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.165642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-29334182-ad3f-4bbc-9517-b4814d6389b4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.166894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-29334182-ad3f-4bbc-9517-b4814d6389b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.171796 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 756/1547] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.172695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730cdd7-a3b9-4e80-9f7c-e3bf8d9b4044 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.180603 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 792/1548] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.182054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae431bd-3e8e-494f-b128-845de14f5e75 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.182469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae431bd-3e8e-494f-b128-845de14f5e75 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.182753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae431bd-3e8e-494f-b128-845de14f5e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.187026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730cdd7-a3b9-4e80-9f7c-e3bf8d9b4044 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.195957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8062f3-c248-43a5-b50a-45a3bf297122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.195957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8062f3-c248-43a5-b50a-45a3bf297122 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.195957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8062f3-c248-43a5-b50a-45a3bf297122 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.195957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8062f3-c248-43a5-b50a-45a3bf297122 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.196747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8062f3-c248-43a5-b50a-45a3bf297122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.198220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8062f3-c248-43a5-b50a-45a3bf297122 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.204312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fae431bd-3e8e-494f-b128-845de14f5e75 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.205524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fae431bd-3e8e-494f-b128-845de14f5e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.209009 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 757/1549] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:00.209940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8062f3-c248-43a5-b50a-45a3bf297122 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.217719 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 793/1550] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.219015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce3fa-1106-4fd0-82e4-92ff6d30c341 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.219294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce3fa-1106-4fd0-82e4-92ff6d30c341 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.219572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dce3fa-1106-4fd0-82e4-92ff6d30c341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.222062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8062f3-c248-43a5-b50a-45a3bf297122 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.230518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8f1b0-2da8-4c7c-812c-8657fb2fc23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.231205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f1b0-2da8-4c7c-812c-8657fb2fc23a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.231450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f1b0-2da8-4c7c-812c-8657fb2fc23a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.231736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8f1b0-2da8-4c7c-812c-8657fb2fc23a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.232683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8f1b0-2da8-4c7c-812c-8657fb2fc23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.234420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8f1b0-2da8-4c7c-812c-8657fb2fc23a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.245693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-10dce3fa-1106-4fd0-82e4-92ff6d30c341 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.246451 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 758/1551] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:00.246896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-10dce3fa-1106-4fd0-82e4-92ff6d30c341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.247641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5efa5-48e9-4925-bae1-139785b4b03d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.247960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5efa5-48e9-4925-bae1-139785b4b03d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.248251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5efa5-48e9-4925-bae1-139785b4b03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.259045 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 794/1552] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.260441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b4ce8-2e3a-4b83-aac4-7ba9a13b1fef None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.260825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b4ce8-2e3a-4b83-aac4-7ba9a13b1fef None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.261221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b4ce8-2e3a-4b83-aac4-7ba9a13b1fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.271060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e0d5efa5-48e9-4925-bae1-139785b4b03d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.272340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e0d5efa5-48e9-4925-bae1-139785b4b03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.279256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-885b4ce8-2e3a-4b83-aac4-7ba9a13b1fef None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.280431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-885b4ce8-2e3a-4b83-aac4-7ba9a13b1fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.281112 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 759/1553] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.281972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5efa5-48e9-4925-bae1-139785b4b03d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.288768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 795/1554] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.289959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c351c8-5c55-4842-ab0c-e97a07e456c2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.290240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c351c8-5c55-4842-ab0c-e97a07e456c2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.290512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c351c8-5c55-4842-ab0c-e97a07e456c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.291900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5efa5-48e9-4925-bae1-139785b4b03d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.296711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fc521-78f1-4b9d-b9ee-95281a7c4dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.297358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fc521-78f1-4b9d-b9ee-95281a7c4dbc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.297642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fc521-78f1-4b9d-b9ee-95281a7c4dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.297926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fc521-78f1-4b9d-b9ee-95281a7c4dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.298673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fc521-78f1-4b9d-b9ee-95281a7c4dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:00.298980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fc521-78f1-4b9d-b9ee-95281a7c4dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.300639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fc521-78f1-4b9d-b9ee-95281a7c4dbc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.308243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-01c351c8-5c55-4842-ab0c-e97a07e456c2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.309589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-01c351c8-5c55-4842-ab0c-e97a07e456c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.312693 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 760/1555] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:00.313302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fc521-78f1-4b9d-b9ee-95281a7c4dbc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.322012 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 796/1556] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.322012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff558fc8-30d7-413e-b555-2e266eea6ed8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.322012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff558fc8-30d7-413e-b555-2e266eea6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.322012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff558fc8-30d7-413e-b555-2e266eea6ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.322600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fc521-78f1-4b9d-b9ee-95281a7c4dbc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.327111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554684bd-3918-4d39-92ca-279a6d800f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.327750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554684bd-3918-4d39-92ca-279a6d800f96 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.328066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554684bd-3918-4d39-92ca-279a6d800f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.328352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554684bd-3918-4d39-92ca-279a6d800f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.329340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554684bd-3918-4d39-92ca-279a6d800f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.330932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554684bd-3918-4d39-92ca-279a6d800f96 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.339085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ff558fc8-30d7-413e-b555-2e266eea6ed8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.340283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ff558fc8-30d7-413e-b555-2e266eea6ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.341122 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 761/1557] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:00.341856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554684bd-3918-4d39-92ca-279a6d800f96 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.348286 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 797/1558] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.349262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff558fc8-30d7-413e-b555-2e266eea6ed8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.352258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554684bd-3918-4d39-92ca-279a6d800f96 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.356734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3813-c6c7-4ed1-b9eb-d79d85ca307d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.357364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3813-c6c7-4ed1-b9eb-d79d85ca307d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.357650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3813-c6c7-4ed1-b9eb-d79d85ca307d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.357975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa3813-c6c7-4ed1-b9eb-d79d85ca307d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.358711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa3813-c6c7-4ed1-b9eb-d79d85ca307d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.360330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa3813-c6c7-4ed1-b9eb-d79d85ca307d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.361408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff558fc8-30d7-413e-b555-2e266eea6ed8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.366633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee06fd-e488-44e6-a5fd-6e53ded843da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.367264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee06fd-e488-44e6-a5fd-6e53ded843da admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.367545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee06fd-e488-44e6-a5fd-6e53ded843da admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.367817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ee06fd-e488-44e6-a5fd-6e53ded843da admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.368562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee06fd-e488-44e6-a5fd-6e53ded843da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:00.368868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee06fd-e488-44e6-a5fd-6e53ded843da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.370449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ee06fd-e488-44e6-a5fd-6e53ded843da admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.370570 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 762/1559] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:00.371283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3813-c6c7-4ed1-b9eb-d79d85ca307d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.380535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa3813-c6c7-4ed1-b9eb-d79d85ca307d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.383266 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 798/1560] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:00.384035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee06fd-e488-44e6-a5fd-6e53ded843da admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.392016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d79d-0faa-4377-b758-4968978b0ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.392645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d79d-0faa-4377-b758-4968978b0ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.392926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d79d-0faa-4377-b758-4968978b0ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.393201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6d79d-0faa-4377-b758-4968978b0ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.393955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6d79d-0faa-4377-b758-4968978b0ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:00.394266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6d79d-0faa-4377-b758-4968978b0ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.395836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6d79d-0faa-4377-b758-4968978b0ca5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.399188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ee06fd-e488-44e6-a5fd-6e53ded843da admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.403667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dfa47-e391-4aba-886f-5048f77def50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.404437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dfa47-e391-4aba-886f-5048f77def50 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.404725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dfa47-e391-4aba-886f-5048f77def50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.405028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dfa47-e391-4aba-886f-5048f77def50 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.405734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dfa47-e391-4aba-886f-5048f77def50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:00.406043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dfa47-e391-4aba-886f-5048f77def50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.407646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56dfa47-e391-4aba-886f-5048f77def50 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.408443 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 763/1561] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:00.409223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d79d-0faa-4377-b758-4968978b0ca5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.418858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6d79d-0faa-4377-b758-4968978b0ca5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.419523 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 799/1562] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:00.420329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dfa47-e391-4aba-886f-5048f77def50 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.429031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f172f-3c0e-4544-856e-06fd1f2bf2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.429671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f172f-3c0e-4544-856e-06fd1f2bf2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.429956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f172f-3c0e-4544-856e-06fd1f2bf2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.430233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f172f-3c0e-4544-856e-06fd1f2bf2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.430329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dfa47-e391-4aba-886f-5048f77def50 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.431013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f172f-3c0e-4544-856e-06fd1f2bf2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.432980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0f172f-3c0e-4544-856e-06fd1f2bf2d9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.434832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310581b2-0e10-43c8-8900-fb722506fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.435487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310581b2-0e10-43c8-8900-fb722506fdab admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.435772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310581b2-0e10-43c8-8900-fb722506fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.436086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310581b2-0e10-43c8-8900-fb722506fdab admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.436796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310581b2-0e10-43c8-8900-fb722506fdab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:00.437106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310581b2-0e10-43c8-8900-fb722506fdab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.438707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310581b2-0e10-43c8-8900-fb722506fdab admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.450994 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 800/1563] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:00.451772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310581b2-0e10-43c8-8900-fb722506fdab admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.460917 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 764/1564] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:00.461759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310581b2-0e10-43c8-8900-fb722506fdab admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.461859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f172f-3c0e-4544-856e-06fd1f2bf2d9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.517801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c031-88ea-490c-9587-166b47b246d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.518680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c031-88ea-490c-9587-166b47b246d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.518955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c031-88ea-490c-9587-166b47b246d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.519226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330c031-88ea-490c-9587-166b47b246d3 admin admin] PATH_INFO: `/v3/projects/330a9fb37786483a8c98e7864356025f/users/2d54340f1ffa4a4d91edc495ad009807/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.525210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0f172f-3c0e-4544-856e-06fd1f2bf2d9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.530217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1060-f394-4180-a6d4-8d106da7f67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.530865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1060-f394-4180-a6d4-8d106da7f67d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.531145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1060-f394-4180-a6d4-8d106da7f67d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.531503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca1060-f394-4180-a6d4-8d106da7f67d admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.532196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca1060-f394-4180-a6d4-8d106da7f67d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:00.532591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca1060-f394-4180-a6d4-8d106da7f67d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.534382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca1060-f394-4180-a6d4-8d106da7f67d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.534703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c031-88ea-490c-9587-166b47b246d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330a9fb37786483a8c98e7864356025f, user_id=2d54340f1ffa4a4d91edc495ad009807, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.537752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c330c031-88ea-490c-9587-166b47b246d3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.546600 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 765/1565] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:00.547380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1060-f394-4180-a6d4-8d106da7f67d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.551669 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 801/1566] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:00 2022] PUT /identity/v3/projects/330a9fb37786483a8c98e7864356025f/users/2d54340f1ffa4a4d91edc495ad009807/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:00.552465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c031-88ea-490c-9587-166b47b246d3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.567432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca1060-f394-4180-a6d4-8d106da7f67d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.622415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd287b-b602-474a-b33d-77a6b2ebbad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.623299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd287b-b602-474a-b33d-77a6b2ebbad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.623582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd287b-b602-474a-b33d-77a6b2ebbad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.623854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd287b-b602-474a-b33d-77a6b2ebbad0 admin admin] PATH_INFO: `/v3/projects/15f6fd60092b410ba8fb57ee200eda6f/users/bf95903dfc0e4f718a324f131a3e4f4c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.625499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330c031-88ea-490c-9587-166b47b246d3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.630325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474af584-6a26-4ce7-919b-175d875a4b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.631055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474af584-6a26-4ce7-919b-175d875a4b8a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.631356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474af584-6a26-4ce7-919b-175d875a4b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.632236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474af584-6a26-4ce7-919b-175d875a4b8a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.633493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474af584-6a26-4ce7-919b-175d875a4b8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.635448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474af584-6a26-4ce7-919b-175d875a4b8a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.638913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd287b-b602-474a-b33d-77a6b2ebbad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f6fd60092b410ba8fb57ee200eda6f, user_id=bf95903dfc0e4f718a324f131a3e4f4c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.640107 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-b6dd287b-b602-474a-b33d-77a6b2ebbad0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:00.640107 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:49:00.640107 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:49:00.642091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dd287b-b602-474a-b33d-77a6b2ebbad0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.655944 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 766/1567] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:00 2022] PUT /identity/v3/projects/15f6fd60092b410ba8fb57ee200eda6f/users/bf95903dfc0e4f718a324f131a3e4f4c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:00.656939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd287b-b602-474a-b33d-77a6b2ebbad0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.666978 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 802/1568] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:00.667678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474af584-6a26-4ce7-919b-175d875a4b8a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.724272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dd287b-b602-474a-b33d-77a6b2ebbad0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.726412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474af584-6a26-4ce7-919b-175d875a4b8a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.729027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf5303-c394-4780-8580-3203b1492569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.729676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf5303-c394-4780-8580-3203b1492569 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.729999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf5303-c394-4780-8580-3203b1492569 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.730231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf5303-c394-4780-8580-3203b1492569 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.730915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf5303-c394-4780-8580-3203b1492569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.731054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89962ea-daca-4c96-92b8-53048b8826b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.731698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89962ea-daca-4c96-92b8-53048b8826b6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.732013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89962ea-daca-4c96-92b8-53048b8826b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.732290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89962ea-daca-4c96-92b8-53048b8826b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.732968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf5303-c394-4780-8580-3203b1492569 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.733069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89962ea-daca-4c96-92b8-53048b8826b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.734905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89962ea-daca-4c96-92b8-53048b8826b6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.762213 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 767/1569] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:00.762213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf5303-c394-4780-8580-3203b1492569 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.762447 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 803/1570] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:00.762707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89962ea-daca-4c96-92b8-53048b8826b6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.821555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf5303-c394-4780-8580-3203b1492569 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.821864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89962ea-daca-4c96-92b8-53048b8826b6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.826138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a69cada-1731-4928-acbc-66f76b6e72c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.826601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c782d9a-1061-44eb-af04-7200ae4328f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.826787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69cada-1731-4928-acbc-66f76b6e72c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.827093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69cada-1731-4928-acbc-66f76b6e72c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.827248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c782d9a-1061-44eb-af04-7200ae4328f9 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.827369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a69cada-1731-4928-acbc-66f76b6e72c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.827532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c782d9a-1061-44eb-af04-7200ae4328f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.827810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c782d9a-1061-44eb-af04-7200ae4328f9 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.828081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69cada-1731-4928-acbc-66f76b6e72c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.828532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c782d9a-1061-44eb-af04-7200ae4328f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.830305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a69cada-1731-4928-acbc-66f76b6e72c7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.830693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c782d9a-1061-44eb-af04-7200ae4328f9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.854795 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 804/1571] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:00.854795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c782d9a-1061-44eb-af04-7200ae4328f9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.862467 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 768/1572] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:00.862467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e11d4-5beb-4673-a7ae-1d1d77097980 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.862467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e11d4-5beb-4673-a7ae-1d1d77097980 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.862467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e11d4-5beb-4673-a7ae-1d1d77097980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.862820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c782d9a-1061-44eb-af04-7200ae4328f9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.887115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1e4e11d4-5beb-4673-a7ae-1d1d77097980 None None] MFA Rules not processed for user `2d54340f1ffa4a4d91edc495ad009807`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.888265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1e4e11d4-5beb-4673-a7ae-1d1d77097980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:00.915747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f9803-f7dd-443f-a706-4564a6a0815b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:00.916495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f9803-f7dd-443f-a706-4564a6a0815b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.916777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f9803-f7dd-443f-a706-4564a6a0815b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.917051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f9803-f7dd-443f-a706-4564a6a0815b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.917731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f9803-f7dd-443f-a706-4564a6a0815b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:00.919633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4f9803-f7dd-443f-a706-4564a6a0815b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:00.944290 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 805/1573] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:00.945686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52d58-8740-4f8c-a6bf-aa6d6bc4be71 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:00.946085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52d58-8740-4f8c-a6bf-aa6d6bc4be71 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:00.946475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52d58-8740-4f8c-a6bf-aa6d6bc4be71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:00.960079 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 769/1574] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:00.960881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e11d4-5beb-4673-a7ae-1d1d77097980 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:00.970819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e11d4-5beb-4673-a7ae-1d1d77097980 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:00.973305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f5b52d58-8740-4f8c-a6bf-aa6d6bc4be71 None None] MFA Rules not processed for user `bf95903dfc0e4f718a324f131a3e4f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:00.974502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f5b52d58-8740-4f8c-a6bf-aa6d6bc4be71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:01.027714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b02aec-1536-4c05-b328-fcd39d5d5792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.028428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02aec-1536-4c05-b328-fcd39d5d5792 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.028716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02aec-1536-4c05-b328-fcd39d5d5792 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.028999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b02aec-1536-4c05-b328-fcd39d5d5792 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.029680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b02aec-1536-4c05-b328-fcd39d5d5792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.031664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b02aec-1536-4c05-b328-fcd39d5d5792 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.039761 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 806/1575] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:01.044124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b52d58-8740-4f8c-a6bf-aa6d6bc4be71 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.052095 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 770/1576] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:00 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:01.055004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b52d58-8740-4f8c-a6bf-aa6d6bc4be71 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.055778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b02aec-1536-4c05-b328-fcd39d5d5792 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.059523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acea60-eddf-4d3b-b865-e0881050e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.060209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acea60-eddf-4d3b-b865-e0881050e94d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.060482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acea60-eddf-4d3b-b865-e0881050e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.060758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acea60-eddf-4d3b-b865-e0881050e94d admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.061466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acea60-eddf-4d3b-b865-e0881050e94d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.063410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acea60-eddf-4d3b-b865-e0881050e94d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.064953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b02aec-1536-4c05-b328-fcd39d5d5792 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.069888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acdc76-4ba0-45a6-80b2-cf74068647a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.070517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acdc76-4ba0-45a6-80b2-cf74068647a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.070796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acdc76-4ba0-45a6-80b2-cf74068647a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.071071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9acdc76-4ba0-45a6-80b2-cf74068647a2 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.071741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acdc76-4ba0-45a6-80b2-cf74068647a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.073720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9acdc76-4ba0-45a6-80b2-cf74068647a2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.083372 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 807/1577] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:01.084521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acea60-eddf-4d3b-b865-e0881050e94d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.095466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acea60-eddf-4d3b-b865-e0881050e94d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.100330 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 771/1578] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:01.100330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acdc76-4ba0-45a6-80b2-cf74068647a2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.103042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d2e2-afaf-46ad-8188-5edfdc3532a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.103677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d2e2-afaf-46ad-8188-5edfdc3532a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.103983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d2e2-afaf-46ad-8188-5edfdc3532a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.104257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352d2e2-afaf-46ad-8188-5edfdc3532a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.104963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352d2e2-afaf-46ad-8188-5edfdc3532a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.106564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352d2e2-afaf-46ad-8188-5edfdc3532a0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.109413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9acdc76-4ba0-45a6-80b2-cf74068647a2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.114127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d1e73-d8b2-4230-bfc6-76b071da2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.114891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d1e73-d8b2-4230-bfc6-76b071da2cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.115279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d1e73-d8b2-4230-bfc6-76b071da2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.115725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d1e73-d8b2-4230-bfc6-76b071da2cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.116158 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 808/1579] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.119307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d1e73-d8b2-4230-bfc6-76b071da2cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.119403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d2e2-afaf-46ad-8188-5edfdc3532a0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.119506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d1e73-d8b2-4230-bfc6-76b071da2cb0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.125866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352d2e2-afaf-46ad-8188-5edfdc3532a0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.130922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6eeb6-c087-4942-9a2e-636ce3ebeb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.132127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6eeb6-c087-4942-9a2e-636ce3ebeb2b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.132410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6eeb6-c087-4942-9a2e-636ce3ebeb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.132739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6eeb6-c087-4942-9a2e-636ce3ebeb2b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.133453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6eeb6-c087-4942-9a2e-636ce3ebeb2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.135294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6eeb6-c087-4942-9a2e-636ce3ebeb2b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.139470 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 772/1580] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:01.140665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d1e73-d8b2-4230-bfc6-76b071da2cb0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.153000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d1e73-d8b2-4230-bfc6-76b071da2cb0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.159225 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 809/1581] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:01.159225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6eeb6-c087-4942-9a2e-636ce3ebeb2b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.159419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68de1-234e-4ed3-bdab-c8dd63e8ef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.159419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68de1-234e-4ed3-bdab-c8dd63e8ef08 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.159419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68de1-234e-4ed3-bdab-c8dd63e8ef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.159419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c68de1-234e-4ed3-bdab-c8dd63e8ef08 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.159794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c68de1-234e-4ed3-bdab-c8dd63e8ef08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.162034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c68de1-234e-4ed3-bdab-c8dd63e8ef08 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.166754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6eeb6-c087-4942-9a2e-636ce3ebeb2b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.171327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383724ba-4fb4-4147-9555-609ea9ff7531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.172055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383724ba-4fb4-4147-9555-609ea9ff7531 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.172461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383724ba-4fb4-4147-9555-609ea9ff7531 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.172741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383724ba-4fb4-4147-9555-609ea9ff7531 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.173425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383724ba-4fb4-4147-9555-609ea9ff7531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.175473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383724ba-4fb4-4147-9555-609ea9ff7531 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.191132 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 773/1582] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:01.192273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68de1-234e-4ed3-bdab-c8dd63e8ef08 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.206677 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 810/1583] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:01.207511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383724ba-4fb4-4147-9555-609ea9ff7531 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.259979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c68de1-234e-4ed3-bdab-c8dd63e8ef08 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.264644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d863a-b59f-407b-be85-6774cf4ed716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.265310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d863a-b59f-407b-be85-6774cf4ed716 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.265598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d863a-b59f-407b-be85-6774cf4ed716 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.265781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383724ba-4fb4-4147-9555-609ea9ff7531 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.265889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d863a-b59f-407b-be85-6774cf4ed716 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.266586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d863a-b59f-407b-be85-6774cf4ed716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.268269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d863a-b59f-407b-be85-6774cf4ed716 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.270279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521023c4-bdc9-4e23-b1fe-e30748268ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.270919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521023c4-bdc9-4e23-b1fe-e30748268ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.271200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521023c4-bdc9-4e23-b1fe-e30748268ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.271471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521023c4-bdc9-4e23-b1fe-e30748268ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.272243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521023c4-bdc9-4e23-b1fe-e30748268ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.273839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521023c4-bdc9-4e23-b1fe-e30748268ca5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.277884 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 774/1584] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.278680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d863a-b59f-407b-be85-6774cf4ed716 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.285733 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 811/1585] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.286603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521023c4-bdc9-4e23-b1fe-e30748268ca5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.288259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d863a-b59f-407b-be85-6774cf4ed716 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.292799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abae7f-cc5e-47c2-9b3e-c2c5f62b7c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.293433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abae7f-cc5e-47c2-9b3e-c2c5f62b7c7d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.293716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abae7f-cc5e-47c2-9b3e-c2c5f62b7c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.294052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03abae7f-cc5e-47c2-9b3e-c2c5f62b7c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.294757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abae7f-cc5e-47c2-9b3e-c2c5f62b7c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.296198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521023c4-bdc9-4e23-b1fe-e30748268ca5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.296379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03abae7f-cc5e-47c2-9b3e-c2c5f62b7c7d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.300662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa80ae-312e-4504-9cb8-51d01cd255f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.301287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa80ae-312e-4504-9cb8-51d01cd255f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.301573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa80ae-312e-4504-9cb8-51d01cd255f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.301850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa80ae-312e-4504-9cb8-51d01cd255f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.302550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa80ae-312e-4504-9cb8-51d01cd255f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.304680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa80ae-312e-4504-9cb8-51d01cd255f4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.306645 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 775/1586] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.307211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abae7f-cc5e-47c2-9b3e-c2c5f62b7c7d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.316439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03abae7f-cc5e-47c2-9b3e-c2c5f62b7c7d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.317101 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 812/1587] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.317911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa80ae-312e-4504-9cb8-51d01cd255f4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.323797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d2b3e-111c-4290-972e-72f966664e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.324559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d2b3e-111c-4290-972e-72f966664e1e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.324848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d2b3e-111c-4290-972e-72f966664e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.325128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d2b3e-111c-4290-972e-72f966664e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.325834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d2b3e-111c-4290-972e-72f966664e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.327422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d2b3e-111c-4290-972e-72f966664e1e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.330085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa80ae-312e-4504-9cb8-51d01cd255f4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.334623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18d7f0-4f3d-4445-bd90-66b1f3909468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.335251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18d7f0-4f3d-4445-bd90-66b1f3909468 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.335536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18d7f0-4f3d-4445-bd90-66b1f3909468 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.335815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18d7f0-4f3d-4445-bd90-66b1f3909468 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.336556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18d7f0-4f3d-4445-bd90-66b1f3909468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.337941 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 776/1588] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.338184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18d7f0-4f3d-4445-bd90-66b1f3909468 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.338709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d2b3e-111c-4290-972e-72f966664e1e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.347891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d2b3e-111c-4290-972e-72f966664e1e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.348502 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 813/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.349128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18d7f0-4f3d-4445-bd90-66b1f3909468 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.352844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973fd8c-37fa-4127-83b4-5fee0450372f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.353484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973fd8c-37fa-4127-83b4-5fee0450372f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.353770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973fd8c-37fa-4127-83b4-5fee0450372f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.354048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1973fd8c-37fa-4127-83b4-5fee0450372f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.354742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973fd8c-37fa-4127-83b4-5fee0450372f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.356688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1973fd8c-37fa-4127-83b4-5fee0450372f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.358588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18d7f0-4f3d-4445-bd90-66b1f3909468 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.363081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aac44-4456-4ab9-8178-b404ae0baff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.363708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aac44-4456-4ab9-8178-b404ae0baff4 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.364022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aac44-4456-4ab9-8178-b404ae0baff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.364300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aac44-4456-4ab9-8178-b404ae0baff4 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.364969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aac44-4456-4ab9-8178-b404ae0baff4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.367465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aac44-4456-4ab9-8178-b404ae0baff4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.376906 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 777/1590] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/users => generated 298 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:01.377837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973fd8c-37fa-4127-83b4-5fee0450372f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.388278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1973fd8c-37fa-4127-83b4-5fee0450372f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.390689 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 814/1591] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:01.391482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aac44-4456-4ab9-8178-b404ae0baff4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.392818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946073e1-a143-4898-bb34-dfb943115708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.393544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946073e1-a143-4898-bb34-dfb943115708 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.393730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946073e1-a143-4898-bb34-dfb943115708 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.394008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946073e1-a143-4898-bb34-dfb943115708 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.394712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946073e1-a143-4898-bb34-dfb943115708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.396412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946073e1-a143-4898-bb34-dfb943115708 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.401195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aac44-4456-4ab9-8178-b404ae0baff4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.405734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4902ae-6019-4d91-8d4b-0e4e733b67f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.406155 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 778/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.406366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4902ae-6019-4d91-8d4b-0e4e733b67f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.406651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4902ae-6019-4d91-8d4b-0e4e733b67f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.406927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4902ae-6019-4d91-8d4b-0e4e733b67f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.407020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946073e1-a143-4898-bb34-dfb943115708 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.407645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4902ae-6019-4d91-8d4b-0e4e733b67f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.409341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4902ae-6019-4d91-8d4b-0e4e733b67f5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.416304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946073e1-a143-4898-bb34-dfb943115708 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.422022 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 815/1593] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.422022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4902ae-6019-4d91-8d4b-0e4e733b67f5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.422328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a6cd-57d8-4725-9cc7-6320ef95727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.422328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a6cd-57d8-4725-9cc7-6320ef95727d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.422328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a6cd-57d8-4725-9cc7-6320ef95727d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.422328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5a6cd-57d8-4725-9cc7-6320ef95727d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.422664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5a6cd-57d8-4725-9cc7-6320ef95727d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.424282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5a6cd-57d8-4725-9cc7-6320ef95727d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.429370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4902ae-6019-4d91-8d4b-0e4e733b67f5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.434033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe0ee9-b78e-4de4-8920-fe6d8419c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.434878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe0ee9-b78e-4de4-8920-fe6d8419c615 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.435169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe0ee9-b78e-4de4-8920-fe6d8419c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.435448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe0ee9-b78e-4de4-8920-fe6d8419c615 admin admin] PATH_INFO: `/v3/projects/1353dd7feef943c1ac6f231c73daaf30/users/60be9224375846f9a012085ca9238c27/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.437080 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 779/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.438156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a6cd-57d8-4725-9cc7-6320ef95727d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.449533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5a6cd-57d8-4725-9cc7-6320ef95727d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.450956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe0ee9-b78e-4de4-8920-fe6d8419c615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1353dd7feef943c1ac6f231c73daaf30, user_id=60be9224375846f9a012085ca9238c27, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.453684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe0ee9-b78e-4de4-8920-fe6d8419c615 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.454352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1a2f-4dd2-4b93-9895-0d5c7a56b0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.454996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1a2f-4dd2-4b93-9895-0d5c7a56b0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.455279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1a2f-4dd2-4b93-9895-0d5c7a56b0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.455558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f1a2f-4dd2-4b93-9895-0d5c7a56b0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.456305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f1a2f-4dd2-4b93-9895-0d5c7a56b0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.458026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f1a2f-4dd2-4b93-9895-0d5c7a56b0e2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.466810 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 816/1595] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:01 2022] PUT /identity/v3/projects/1353dd7feef943c1ac6f231c73daaf30/users/60be9224375846f9a012085ca9238c27/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:01.476788 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 780/1596] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.476788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1a2f-4dd2-4b93-9895-0d5c7a56b0e2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.476961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe0ee9-b78e-4de4-8920-fe6d8419c615 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.481145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f1a2f-4dd2-4b93-9895-0d5c7a56b0e2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.537872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c514432-a3d5-4a59-b2de-e577d8fc7467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.538657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c514432-a3d5-4a59-b2de-e577d8fc7467 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.538825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c514432-a3d5-4a59-b2de-e577d8fc7467 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.539088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c514432-a3d5-4a59-b2de-e577d8fc7467 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.540172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe0ee9-b78e-4de4-8920-fe6d8419c615 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.540299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c514432-a3d5-4a59-b2de-e577d8fc7467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.541880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c514432-a3d5-4a59-b2de-e577d8fc7467 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.544721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dcc5f-fee7-4d16-9950-a8511367d171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.545379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dcc5f-fee7-4d16-9950-a8511367d171 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.545664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dcc5f-fee7-4d16-9950-a8511367d171 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.545945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dcc5f-fee7-4d16-9950-a8511367d171 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.546659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dcc5f-fee7-4d16-9950-a8511367d171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.548288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dcc5f-fee7-4d16-9950-a8511367d171 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.551507 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 781/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.551507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c514432-a3d5-4a59-b2de-e577d8fc7467 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.559072 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 817/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.559707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dcc5f-fee7-4d16-9950-a8511367d171 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.564983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c514432-a3d5-4a59-b2de-e577d8fc7467 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.569576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dcc5f-fee7-4d16-9950-a8511367d171 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.570081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47cc3-a067-4a62-a850-6eb5f45075bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.570727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47cc3-a067-4a62-a850-6eb5f45075bb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.571018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47cc3-a067-4a62-a850-6eb5f45075bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.571295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47cc3-a067-4a62-a850-6eb5f45075bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.572030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47cc3-a067-4a62-a850-6eb5f45075bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.573627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47cc3-a067-4a62-a850-6eb5f45075bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.574401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93310ff-2a37-405e-9b23-31abc8467f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.575276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93310ff-2a37-405e-9b23-31abc8467f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.575557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93310ff-2a37-405e-9b23-31abc8467f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.575826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93310ff-2a37-405e-9b23-31abc8467f29 admin admin] PATH_INFO: `/v3/projects/ac4fcbd8371642739c433d9d2bd24692/users/dfb61c96ff5c4b88a31791121d8b6cdd/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.583985 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 782/1599] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:01.584765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47cc3-a067-4a62-a850-6eb5f45075bb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.594196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93310ff-2a37-405e-9b23-31abc8467f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4fcbd8371642739c433d9d2bd24692, user_id=dfb61c96ff5c4b88a31791121d8b6cdd, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.594951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47cc3-a067-4a62-a850-6eb5f45075bb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.596985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93310ff-2a37-405e-9b23-31abc8467f29 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.599540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dba61f-530e-44ea-9432-927cbd07f4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.600961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dba61f-530e-44ea-9432-927cbd07f4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.601249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dba61f-530e-44ea-9432-927cbd07f4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.601528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dba61f-530e-44ea-9432-927cbd07f4ec admin admin] PATH_INFO: `/v3/projects/c439fc913e3941a58947832c0afa7295/users/1ee86e1c8c6d4db08cec5c2e92851c83/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.610307 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 818/1600] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:01 2022] PUT /identity/v3/projects/ac4fcbd8371642739c433d9d2bd24692/users/dfb61c96ff5c4b88a31791121d8b6cdd/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:01.611138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93310ff-2a37-405e-9b23-31abc8467f29 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.627068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dba61f-530e-44ea-9432-927cbd07f4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c439fc913e3941a58947832c0afa7295, user_id=1ee86e1c8c6d4db08cec5c2e92851c83, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.630066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dba61f-530e-44ea-9432-927cbd07f4ec admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.643418 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 783/1601] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:01 2022] PUT /identity/v3/projects/c439fc913e3941a58947832c0afa7295/users/1ee86e1c8c6d4db08cec5c2e92851c83/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:01.644779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dba61f-530e-44ea-9432-927cbd07f4ec admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.671040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93310ff-2a37-405e-9b23-31abc8467f29 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.714146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dba61f-530e-44ea-9432-927cbd07f4ec admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.718780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4b1b6-520d-4f89-b6e3-4fbca629ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.719653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b1b6-520d-4f89-b6e3-4fbca629ec9d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.719953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b1b6-520d-4f89-b6e3-4fbca629ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.720266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4b1b6-520d-4f89-b6e3-4fbca629ec9d admin admin] PATH_INFO: `/v3/projects/5d8ced74926049d1be9a6f37774c25d7/users/a9ccad64afc44366a9db10b9ab9e72eb/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.725802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5723bd7-6e4e-4d94-8a82-ff1f805fc19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.726692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5723bd7-6e4e-4d94-8a82-ff1f805fc19c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.727089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5723bd7-6e4e-4d94-8a82-ff1f805fc19c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.727368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5723bd7-6e4e-4d94-8a82-ff1f805fc19c admin admin] PATH_INFO: `/v3/projects/f128aa269f41499eb61904f05f39b486/users/cf5ef6b17e17455bac247c0e81109241/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.734695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4b1b6-520d-4f89-b6e3-4fbca629ec9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8ced74926049d1be9a6f37774c25d7, user_id=a9ccad64afc44366a9db10b9ab9e72eb, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.737593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4b1b6-520d-4f89-b6e3-4fbca629ec9d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.741641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5723bd7-6e4e-4d94-8a82-ff1f805fc19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f128aa269f41499eb61904f05f39b486, user_id=cf5ef6b17e17455bac247c0e81109241, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.744347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5723bd7-6e4e-4d94-8a82-ff1f805fc19c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.752654 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 784/1602] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:01 2022] PUT /identity/v3/projects/5d8ced74926049d1be9a6f37774c25d7/users/a9ccad64afc44366a9db10b9ab9e72eb/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:01.754072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a396d6-ef2e-4054-86ca-b1482eadde2f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.754505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a396d6-ef2e-4054-86ca-b1482eadde2f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.754925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a396d6-ef2e-4054-86ca-b1482eadde2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.755842 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 819/1603] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:01 2022] PUT /identity/v3/projects/f128aa269f41499eb61904f05f39b486/users/cf5ef6b17e17455bac247c0e81109241/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:01.756723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5723bd7-6e4e-4d94-8a82-ff1f805fc19c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.789671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-73a396d6-ef2e-4054-86ca-b1482eadde2f None None] MFA Rules not processed for user `60be9224375846f9a012085ca9238c27`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:01.791115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-73a396d6-ef2e-4054-86ca-b1482eadde2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:01.822603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5723bd7-6e4e-4d94-8a82-ff1f805fc19c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.827566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199d77d-6eb0-4b29-bce2-68b3674ea299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.828545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199d77d-6eb0-4b29-bce2-68b3674ea299 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.829082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199d77d-6eb0-4b29-bce2-68b3674ea299 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.829368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199d77d-6eb0-4b29-bce2-68b3674ea299 admin admin] PATH_INFO: `/v3/projects/b14987444eae40588ea209778938f9c6/users/ff083e7a1c254012833ec4de907acbec/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.843623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199d77d-6eb0-4b29-bce2-68b3674ea299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14987444eae40588ea209778938f9c6, user_id=ff083e7a1c254012833ec4de907acbec, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.846456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199d77d-6eb0-4b29-bce2-68b3674ea299 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.853401 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 785/1604] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:01.854269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a396d6-ef2e-4054-86ca-b1482eadde2f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.862947 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 820/1605] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:01 2022] PUT /identity/v3/projects/b14987444eae40588ea209778938f9c6/users/ff083e7a1c254012833ec4de907acbec/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:01.863716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199d77d-6eb0-4b29-bce2-68b3674ea299 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:01.866774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a396d6-ef2e-4054-86ca-b1482eadde2f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.920017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10cdfaa-cb2b-4160-a738-89387989daf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.921049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cdfaa-cb2b-4160-a738-89387989daf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.921338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cdfaa-cb2b-4160-a738-89387989daf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.921613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10cdfaa-cb2b-4160-a738-89387989daf7 admin admin] PATH_INFO: `/v3/projects/33d7dead9bee45f288900c157201b337/users/d1e20172563a4c68bec7874b43416e12/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.922139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199d77d-6eb0-4b29-bce2-68b3674ea299 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:01.926568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1b2ff-82a6-43ed-8136-7bdeb2b2ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:01.927427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1b2ff-82a6-43ed-8136-7bdeb2b2ca2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.927706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1b2ff-82a6-43ed-8136-7bdeb2b2ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.928067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1b2ff-82a6-43ed-8136-7bdeb2b2ca2c admin admin] PATH_INFO: `/v3/projects/4bace01d233945a1b8d903080ab2a251/users/d407eb06db224f819526e9335b151b62/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.935930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cdfaa-cb2b-4160-a738-89387989daf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d7dead9bee45f288900c157201b337, user_id=d1e20172563a4c68bec7874b43416e12, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.938619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10cdfaa-cb2b-4160-a738-89387989daf7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.942131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1b2ff-82a6-43ed-8136-7bdeb2b2ca2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bace01d233945a1b8d903080ab2a251, user_id=d407eb06db224f819526e9335b151b62, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:01.945370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1b2ff-82a6-43ed-8136-7bdeb2b2ca2c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:01.952749 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 786/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:01 2022] PUT /identity/v3/projects/33d7dead9bee45f288900c157201b337/users/d1e20172563a4c68bec7874b43416e12/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:01.954036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9825a86-0c78-494d-8a27-9c3e91883528 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.954472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9825a86-0c78-494d-8a27-9c3e91883528 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.954764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9825a86-0c78-494d-8a27-9c3e91883528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.968168 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 821/1607] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:01 2022] PUT /identity/v3/projects/4bace01d233945a1b8d903080ab2a251/users/d407eb06db224f819526e9335b151b62/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:01.969612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f7d38-415b-4ffd-99e3-693eb3625674 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:01.969903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f7d38-415b-4ffd-99e3-693eb3625674 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:01.970302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f7d38-415b-4ffd-99e3-693eb3625674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:01.981214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f9825a86-0c78-494d-8a27-9c3e91883528 None None] MFA Rules not processed for user `dfb61c96ff5c4b88a31791121d8b6cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:01.982407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f9825a86-0c78-494d-8a27-9c3e91883528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:01.995578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-933f7d38-415b-4ffd-99e3-693eb3625674 None None] MFA Rules not processed for user `1ee86e1c8c6d4db08cec5c2e92851c83`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:01.996788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-933f7d38-415b-4ffd-99e3-693eb3625674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:02.045549 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 787/1608] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:02.049233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cc060-9fd4-4c29-a55f-deb52d5caf74 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.049233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cc060-9fd4-4c29-a55f-deb52d5caf74 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.049233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cc060-9fd4-4c29-a55f-deb52d5caf74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.060718 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 822/1609] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:02.065302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56e6d7-298d-44c7-82b6-0bc9702002b9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.065596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56e6d7-298d-44c7-82b6-0bc9702002b9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.065875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56e6d7-298d-44c7-82b6-0bc9702002b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.074438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3a3cc060-9fd4-4c29-a55f-deb52d5caf74 None None] MFA Rules not processed for user `a9ccad64afc44366a9db10b9ab9e72eb`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:02.075628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a3cc060-9fd4-4c29-a55f-deb52d5caf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:02.091499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3e56e6d7-298d-44c7-82b6-0bc9702002b9 None None] MFA Rules not processed for user `cf5ef6b17e17455bac247c0e81109241`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:02.092854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3e56e6d7-298d-44c7-82b6-0bc9702002b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:02.138523 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 788/1610] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:02.140799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cc060-9fd4-4c29-a55f-deb52d5caf74 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.154406 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 823/1611] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:02.155230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56e6d7-298d-44c7-82b6-0bc9702002b9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.203685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cc060-9fd4-4c29-a55f-deb52d5caf74 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.208374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4578d-9945-4f0f-a646-4b5dbce41e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.209025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4578d-9945-4f0f-a646-4b5dbce41e9d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.209862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4578d-9945-4f0f-a646-4b5dbce41e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.210141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4578d-9945-4f0f-a646-4b5dbce41e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.210828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4578d-9945-4f0f-a646-4b5dbce41e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.212781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4578d-9945-4f0f-a646-4b5dbce41e9d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.215653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56e6d7-298d-44c7-82b6-0bc9702002b9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.220253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b433b1-71c4-4969-908a-85b8fe0aff30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.220908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b433b1-71c4-4969-908a-85b8fe0aff30 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.221188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b433b1-71c4-4969-908a-85b8fe0aff30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.221462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b433b1-71c4-4969-908a-85b8fe0aff30 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.222186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b433b1-71c4-4969-908a-85b8fe0aff30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.223794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b433b1-71c4-4969-908a-85b8fe0aff30 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.234337 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 824/1612] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:02.238707 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 789/1613] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.238820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0771bd4-6cfb-48b5-aef1-a50a827e0736 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.239011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0771bd4-6cfb-48b5-aef1-a50a827e0736 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.239255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0771bd4-6cfb-48b5-aef1-a50a827e0736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.239535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4578d-9945-4f0f-a646-4b5dbce41e9d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.264201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c0771bd4-6cfb-48b5-aef1-a50a827e0736 None None] MFA Rules not processed for user `d1e20172563a4c68bec7874b43416e12`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:02.265428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c0771bd4-6cfb-48b5-aef1-a50a827e0736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:02.298321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4578d-9945-4f0f-a646-4b5dbce41e9d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.302866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03865a2f-32af-480d-b403-6db1d09eb002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.303553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03865a2f-32af-480d-b403-6db1d09eb002 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.303842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03865a2f-32af-480d-b403-6db1d09eb002 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.304167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03865a2f-32af-480d-b403-6db1d09eb002 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.304985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03865a2f-32af-480d-b403-6db1d09eb002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.306608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03865a2f-32af-480d-b403-6db1d09eb002 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.316257 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 790/1614] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:02.316975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03865a2f-32af-480d-b403-6db1d09eb002 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.326753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03865a2f-32af-480d-b403-6db1d09eb002 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.329794 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 825/1615] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:02.330643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0771bd4-6cfb-48b5-aef1-a50a827e0736 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.331563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e6a9f-7840-4432-960b-7f3f93c3aea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.332223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e6a9f-7840-4432-960b-7f3f93c3aea0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.332507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e6a9f-7840-4432-960b-7f3f93c3aea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.332785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e6a9f-7840-4432-960b-7f3f93c3aea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.333463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e6a9f-7840-4432-960b-7f3f93c3aea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.335951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e6a9f-7840-4432-960b-7f3f93c3aea0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.341481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0771bd4-6cfb-48b5-aef1-a50a827e0736 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.346052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc53e-1924-4efa-96c1-90e4c57531ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.346681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc53e-1924-4efa-96c1-90e4c57531ad admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.346966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc53e-1924-4efa-96c1-90e4c57531ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.347244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc53e-1924-4efa-96c1-90e4c57531ad admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.347934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bc53e-1924-4efa-96c1-90e4c57531ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.349894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bc53e-1924-4efa-96c1-90e4c57531ad admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.362055 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 791/1616] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.362919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e6a9f-7840-4432-960b-7f3f93c3aea0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.376684 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 826/1617] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.377460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc53e-1924-4efa-96c1-90e4c57531ad admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.422688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e6a9f-7840-4432-960b-7f3f93c3aea0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.430981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc53e-1924-4efa-96c1-90e4c57531ad admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.434702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f425-76e4-428a-9ae1-e1c02c05c91c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.435344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f425-76e4-428a-9ae1-e1c02c05c91c service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.435630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f425-76e4-428a-9ae1-e1c02c05c91c service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.435906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f425-76e4-428a-9ae1-e1c02c05c91c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.477438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205f25-5e3c-4a6c-912f-87d2b38700e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.478002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205f25-5e3c-4a6c-912f-87d2b38700e4 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.478304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205f25-5e3c-4a6c-912f-87d2b38700e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.478572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1205f25-5e3c-4a6c-912f-87d2b38700e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.479253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205f25-5e3c-4a6c-912f-87d2b38700e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.481235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1205f25-5e3c-4a6c-912f-87d2b38700e4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.490107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f425-76e4-428a-9ae1-e1c02c05c91c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.491556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f425-76e4-428a-9ae1-e1c02c05c91c service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.500526 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 827/1618] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:02.501111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f425-76e4-428a-9ae1-e1c02c05c91c service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.509282 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 792/1619] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.509282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205f25-5e3c-4a6c-912f-87d2b38700e4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.511526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f425-76e4-428a-9ae1-e1c02c05c91c service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.567391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c958f25-2257-41d0-95ed-cd4bd7d2b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.568452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c958f25-2257-41d0-95ed-cd4bd7d2b637 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.569388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c958f25-2257-41d0-95ed-cd4bd7d2b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.570482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c958f25-2257-41d0-95ed-cd4bd7d2b637 admin admin] PATH_INFO: `/v3/projects/b14987444eae40588ea209778938f9c6/users/ff083e7a1c254012833ec4de907acbec/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.572132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c958f25-2257-41d0-95ed-cd4bd7d2b637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b14987444eae40588ea209778938f9c6, user_id=ff083e7a1c254012833ec4de907acbec, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.572366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1205f25-5e3c-4a6c-912f-87d2b38700e4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.575145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c958f25-2257-41d0-95ed-cd4bd7d2b637 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.579138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a0483-2cb4-49f9-af4b-c5b7ae8e53fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.579826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a0483-2cb4-49f9-af4b-c5b7ae8e53fe admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.580214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a0483-2cb4-49f9-af4b-c5b7ae8e53fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.580398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a0483-2cb4-49f9-af4b-c5b7ae8e53fe admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.581102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a0483-2cb4-49f9-af4b-c5b7ae8e53fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.583052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a0483-2cb4-49f9-af4b-c5b7ae8e53fe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.589268 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 828/1620] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:02 2022] PUT /identity/v3/projects/b14987444eae40588ea209778938f9c6/users/ff083e7a1c254012833ec4de907acbec/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:02.590475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c958f25-2257-41d0-95ed-cd4bd7d2b637 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.606388 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 793/1621] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.607200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a0483-2cb4-49f9-af4b-c5b7ae8e53fe admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.617133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a0483-2cb4-49f9-af4b-c5b7ae8e53fe admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.662025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c958f25-2257-41d0-95ed-cd4bd7d2b637 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.667365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff59821-d4d3-46a9-8249-df17b3fa7bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.668284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff59821-d4d3-46a9-8249-df17b3fa7bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.668573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff59821-d4d3-46a9-8249-df17b3fa7bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.668842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff59821-d4d3-46a9-8249-df17b3fa7bbc admin admin] PATH_INFO: `/v3/projects/4bace01d233945a1b8d903080ab2a251/users/d407eb06db224f819526e9335b151b62/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.670939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff59821-d4d3-46a9-8249-df17b3fa7bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bace01d233945a1b8d903080ab2a251, user_id=d407eb06db224f819526e9335b151b62, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.673757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff59821-d4d3-46a9-8249-df17b3fa7bbc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.677159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff72ad-a10a-4fc9-9b25-7bc67587efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.677822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff72ad-a10a-4fc9-9b25-7bc67587efe3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.678685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff72ad-a10a-4fc9-9b25-7bc67587efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.678864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff72ad-a10a-4fc9-9b25-7bc67587efe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.679561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff72ad-a10a-4fc9-9b25-7bc67587efe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.681840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff72ad-a10a-4fc9-9b25-7bc67587efe3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.692215 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 829/1622] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:02 2022] PUT /identity/v3/projects/4bace01d233945a1b8d903080ab2a251/users/d407eb06db224f819526e9335b151b62/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:02.692215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff59821-d4d3-46a9-8249-df17b3fa7bbc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.719404 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 794/1623] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.720584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff72ad-a10a-4fc9-9b25-7bc67587efe3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.763171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff59821-d4d3-46a9-8249-df17b3fa7bbc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.786797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff72ad-a10a-4fc9-9b25-7bc67587efe3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.792038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70324e-b3d6-48e1-9d65-4504795b189f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.792791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70324e-b3d6-48e1-9d65-4504795b189f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.793075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70324e-b3d6-48e1-9d65-4504795b189f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.793350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70324e-b3d6-48e1-9d65-4504795b189f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.794033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70324e-b3d6-48e1-9d65-4504795b189f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.795980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70324e-b3d6-48e1-9d65-4504795b189f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.819347 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 795/1624] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.820001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70324e-b3d6-48e1-9d65-4504795b189f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.825583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8370d1-0650-487e-a454-c7a39ab5eca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.826297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8370d1-0650-487e-a454-c7a39ab5eca0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.826576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8370d1-0650-487e-a454-c7a39ab5eca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.826861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8370d1-0650-487e-a454-c7a39ab5eca0 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.827555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8370d1-0650-487e-a454-c7a39ab5eca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.829808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8370d1-0650-487e-a454-c7a39ab5eca0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.830197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70324e-b3d6-48e1-9d65-4504795b189f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.834949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcb24d-59fb-48f2-a2fa-42b14e15a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.835595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb24d-59fb-48f2-a2fa-42b14e15a7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.835877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb24d-59fb-48f2-a2fa-42b14e15a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.836187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fcb24d-59fb-48f2-a2fa-42b14e15a7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.836943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcb24d-59fb-48f2-a2fa-42b14e15a7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.838993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fcb24d-59fb-48f2-a2fa-42b14e15a7b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.850040 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 830/1625] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.851521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0094aa-960a-4bd5-8991-3eaab7d5aab5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.851881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0094aa-960a-4bd5-8991-3eaab7d5aab5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.852252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0094aa-960a-4bd5-8991-3eaab7d5aab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.861575 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 796/1626] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.862386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcb24d-59fb-48f2-a2fa-42b14e15a7b0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.872558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fcb24d-59fb-48f2-a2fa-42b14e15a7b0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.877332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613ffbe-85e7-401c-a4bf-3f8be08459de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.878040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613ffbe-85e7-401c-a4bf-3f8be08459de admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.878324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613ffbe-85e7-401c-a4bf-3f8be08459de admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.878602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613ffbe-85e7-401c-a4bf-3f8be08459de admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.878687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dc0094aa-960a-4bd5-8991-3eaab7d5aab5 None None] MFA Rules not processed for user `ff083e7a1c254012833ec4de907acbec`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:02.879310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613ffbe-85e7-401c-a4bf-3f8be08459de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.879821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dc0094aa-960a-4bd5-8991-3eaab7d5aab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:02.880965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613ffbe-85e7-401c-a4bf-3f8be08459de admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.891713 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 797/1627] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:02.892931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d9578-337e-4b05-9c5c-d48d88cccf14 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.893219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d9578-337e-4b05-9c5c-d48d88cccf14 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.893499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d9578-337e-4b05-9c5c-d48d88cccf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.918168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d89d9578-337e-4b05-9c5c-d48d88cccf14 None None] MFA Rules not processed for user `d407eb06db224f819526e9335b151b62`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:02.919385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d89d9578-337e-4b05-9c5c-d48d88cccf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:02.944989 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 831/1628] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:02.945825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0094aa-960a-4bd5-8991-3eaab7d5aab5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.960589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0094aa-960a-4bd5-8991-3eaab7d5aab5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:02.965790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf8ef3-7c22-468d-84da-778bbd41e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:02.966486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf8ef3-7c22-468d-84da-778bbd41e7fe admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:02.966774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf8ef3-7c22-468d-84da-778bbd41e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:02.967052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf8ef3-7c22-468d-84da-778bbd41e7fe admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:02.967733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf8ef3-7c22-468d-84da-778bbd41e7fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:02.969715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cf8ef3-7c22-468d-84da-778bbd41e7fe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:02.989645 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 832/1629] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/users => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:02.989851 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 798/1630] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:02.991221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d9578-337e-4b05-9c5c-d48d88cccf14 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:02.991340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf8ef3-7c22-468d-84da-778bbd41e7fe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.003115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf8ef3-7c22-468d-84da-778bbd41e7fe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.004105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d9578-337e-4b05-9c5c-d48d88cccf14 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.013159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5b592-fb49-4000-bf60-a93c235705c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.013842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5b592-fb49-4000-bf60-a93c235705c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.014087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.014212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5b592-fb49-4000-bf60-a93c235705c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.014376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5b592-fb49-4000-bf60-a93c235705c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.014951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.015089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5b592-fb49-4000-bf60-a93c235705c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.015238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.015519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] PATH_INFO: `/v3/users/cf5ef6b17e17455bac247c0e81109241` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.016735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5b592-fb49-4000-bf60-a93c235705c1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.016824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf5ef6b17e17455bac247c0e81109241)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.019125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.028660 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 799/1631] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:03.029495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5b592-fb49-4000-bf60-a93c235705c1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.039982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5b592-fb49-4000-bf60-a93c235705c1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.045605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0edbde-2eee-41a1-8a96-5f778a8b7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.046369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0edbde-2eee-41a1-8a96-5f778a8b7d14 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.046719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0edbde-2eee-41a1-8a96-5f778a8b7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.047067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0edbde-2eee-41a1-8a96-5f778a8b7d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.047854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0edbde-2eee-41a1-8a96-5f778a8b7d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.049538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0edbde-2eee-41a1-8a96-5f778a8b7d14 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.060110 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 800/1632] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:03.060905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0edbde-2eee-41a1-8a96-5f778a8b7d14 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.067216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf5ef6b17e17455bac247c0e81109241'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:03.073662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0edbde-2eee-41a1-8a96-5f778a8b7d14 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.074539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf5ef6b17e17455bac247c0e81109241'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:03.075213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf5ef6b17e17455bac247c0e81109241'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:03.075822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf5ef6b17e17455bac247c0e81109241'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:03.078393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805349cf-39e7-413e-86b5-39bd4a6b11fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.079291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805349cf-39e7-413e-86b5-39bd4a6b11fb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.079578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805349cf-39e7-413e-86b5-39bd4a6b11fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.079858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805349cf-39e7-413e-86b5-39bd4a6b11fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.080771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805349cf-39e7-413e-86b5-39bd4a6b11fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.082596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805349cf-39e7-413e-86b5-39bd4a6b11fb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.083428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1198afe8-5f87-49fb-a94a-cd07c5e2265a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf5ef6b17e17455bac247c0e81109241'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:03.093035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 801/1633] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:03.093802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805349cf-39e7-413e-86b5-39bd4a6b11fb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.095453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-805349cf-39e7-413e-86b5-39bd4a6b11fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.101343 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 833/1634] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:02 2022] DELETE /identity/v3/users/cf5ef6b17e17455bac247c0e81109241 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:03.102739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049d0d-13f2-4337-b29c-3ee13c91b11e None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.103015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049d0d-13f2-4337-b29c-3ee13c91b11e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.103294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1049d0d-13f2-4337-b29c-3ee13c91b11e None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.105111 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 834/1635] 10.222.0.16 () {54 vars in 960 bytes} [Sat Mar 26 20:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:03.105864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1049d0d-13f2-4337-b29c-3ee13c91b11e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.107569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a1049d0d-13f2-4337-b29c-3ee13c91b11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.108428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805349cf-39e7-413e-86b5-39bd4a6b11fb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.161990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10002aa7-8098-448a-a0f1-821242aeb4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.163391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10002aa7-8098-448a-a0f1-821242aeb4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.163828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10002aa7-8098-448a-a0f1-821242aeb4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.164142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10002aa7-8098-448a-a0f1-821242aeb4f4 admin admin] PATH_INFO: `/v3/projects/05e78eaca25f4f9bbbd0bf215af9e315/users/37b87fd468ba40618511a5459715a0d7/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.172486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1049d0d-13f2-4337-b29c-3ee13c91b11e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.177284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d27a93-c4ba-4e84-9ed7-6b8cee7fc907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.178097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27a93-c4ba-4e84-9ed7-6b8cee7fc907 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.178199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10002aa7-8098-448a-a0f1-821242aeb4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e78eaca25f4f9bbbd0bf215af9e315, user_id=37b87fd468ba40618511a5459715a0d7, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.178381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27a93-c4ba-4e84-9ed7-6b8cee7fc907 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.178657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27a93-c4ba-4e84-9ed7-6b8cee7fc907 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.180002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27a93-c4ba-4e84-9ed7-6b8cee7fc907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.181309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10002aa7-8098-448a-a0f1-821242aeb4f4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.181689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27a93-c4ba-4e84-9ed7-6b8cee7fc907 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.191784 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 835/1636] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:03.193174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc9a22-64cf-4793-9ade-6c45125ba674 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.193459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc9a22-64cf-4793-9ade-6c45125ba674 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.193741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc9a22-64cf-4793-9ade-6c45125ba674 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.194573 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 802/1637] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:03 2022] PUT /identity/v3/projects/05e78eaca25f4f9bbbd0bf215af9e315/users/37b87fd468ba40618511a5459715a0d7/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:03.195473 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 836/1638] 10.222.0.16 () {54 vars in 960 bytes} [Sat Mar 26 20:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:03.198856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc9a22-64cf-4793-9ade-6c45125ba674 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.199765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0fbc9a22-64cf-4793-9ade-6c45125ba674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.200209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10002aa7-8098-448a-a0f1-821242aeb4f4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.202059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-10002aa7-8098-448a-a0f1-821242aeb4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.264343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10002aa7-8098-448a-a0f1-821242aeb4f4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.264510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc9a22-64cf-4793-9ade-6c45125ba674 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.268831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232740f4-c009-442d-b0c5-59f808845311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.268980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14afd-a248-4f55-9341-c72a5e0bec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.269706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232740f4-c009-442d-b0c5-59f808845311 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.269844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14afd-a248-4f55-9341-c72a5e0bec8c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.269989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232740f4-c009-442d-b0c5-59f808845311 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.270199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14afd-a248-4f55-9341-c72a5e0bec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.270289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232740f4-c009-442d-b0c5-59f808845311 admin admin] PATH_INFO: `/v3/projects/d29fb9a8facc47ac9ac51a34fa80328b/users/b98baf6a0fbe4030a50fead74f36543c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.270394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14afd-a248-4f55-9341-c72a5e0bec8c admin admin] PATH_INFO: `/v3/projects/f553d705e9094d75aba04f42f75da578/users/e8729c10afe047fdb253b6f24de46604/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.283777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232740f4-c009-442d-b0c5-59f808845311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29fb9a8facc47ac9ac51a34fa80328b, user_id=b98baf6a0fbe4030a50fead74f36543c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.284464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c14afd-a248-4f55-9341-c72a5e0bec8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f553d705e9094d75aba04f42f75da578, user_id=e8729c10afe047fdb253b6f24de46604, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.286458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232740f4-c009-442d-b0c5-59f808845311 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.287121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c14afd-a248-4f55-9341-c72a5e0bec8c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.304231 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 803/1639] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:03 2022] PUT /identity/v3/projects/d29fb9a8facc47ac9ac51a34fa80328b/users/b98baf6a0fbe4030a50fead74f36543c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:03.304389 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 837/1640] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:03 2022] PUT /identity/v3/projects/f553d705e9094d75aba04f42f75da578/users/e8729c10afe047fdb253b6f24de46604/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:03.304389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c017d-4057-4215-9e5c-0a058609527c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.304389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c017d-4057-4215-9e5c-0a058609527c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.304389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c017d-4057-4215-9e5c-0a058609527c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.305416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232740f4-c009-442d-b0c5-59f808845311 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.306995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-232740f4-c009-442d-b0c5-59f808845311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.320268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6d8c017d-4057-4215-9e5c-0a058609527c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:03.321440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6d8c017d-4057-4215-9e5c-0a058609527c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.368600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232740f4-c009-442d-b0c5-59f808845311 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.378252 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 838/1641] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:03.379443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac68cd-6a6d-490f-9fc3-ebe784afc87b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.379737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac68cd-6a6d-490f-9fc3-ebe784afc87b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.380122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac68cd-6a6d-490f-9fc3-ebe784afc87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.399220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-18ac68cd-6a6d-490f-9fc3-ebe784afc87b None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:03.400443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-18ac68cd-6a6d-490f-9fc3-ebe784afc87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.423893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d78d3f-444c-4a92-9457-8b893bb0e274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.424808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d78d3f-444c-4a92-9457-8b893bb0e274 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.425089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d78d3f-444c-4a92-9457-8b893bb0e274 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.425360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d78d3f-444c-4a92-9457-8b893bb0e274 admin admin] PATH_INFO: `/v3/projects/bcdf204a282945d5b5f78786837cc6a5/users/dc630bbeca714703b58a689bd64a5356/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.439398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d78d3f-444c-4a92-9457-8b893bb0e274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdf204a282945d5b5f78786837cc6a5, user_id=dc630bbeca714703b58a689bd64a5356, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.442134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d78d3f-444c-4a92-9457-8b893bb0e274 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.455885 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 804/1642] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:03 2022] PUT /identity/v3/projects/bcdf204a282945d5b5f78786837cc6a5/users/dc630bbeca714703b58a689bd64a5356/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:03.456461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d78d3f-444c-4a92-9457-8b893bb0e274 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.467366 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 839/1643] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:03.468706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c5a1-8aac-4a59-a5fd-5069bf466c36 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.468992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c5a1-8aac-4a59-a5fd-5069bf466c36 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.469268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c5a1-8aac-4a59-a5fd-5069bf466c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.487035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0b18c5a1-8aac-4a59-a5fd-5069bf466c36 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:03.488246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0b18c5a1-8aac-4a59-a5fd-5069bf466c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.519574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d78d3f-444c-4a92-9457-8b893bb0e274 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.524293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193600d-9090-46df-8001-d3a9de961651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.525205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193600d-9090-46df-8001-d3a9de961651 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.525527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193600d-9090-46df-8001-d3a9de961651 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.525850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193600d-9090-46df-8001-d3a9de961651 admin admin] PATH_INFO: `/v3/projects/db5c402c9d754304a3011b64d91c482f/users/e3564252f55f4da8a7e2e2582bf69bca/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.539712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193600d-9090-46df-8001-d3a9de961651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5c402c9d754304a3011b64d91c482f, user_id=e3564252f55f4da8a7e2e2582bf69bca, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.542540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193600d-9090-46df-8001-d3a9de961651 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.555882 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 805/1644] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:03 2022] PUT /identity/v3/projects/db5c402c9d754304a3011b64d91c482f/users/e3564252f55f4da8a7e2e2582bf69bca/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:03.556715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193600d-9090-46df-8001-d3a9de961651 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.560061 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 840/1645] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 20:49:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:03.561003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c5a1-8aac-4a59-a5fd-5069bf466c36 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.571244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c5a1-8aac-4a59-a5fd-5069bf466c36 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.617293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193600d-9090-46df-8001-d3a9de961651 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.621779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f8b8e-2b4e-447a-977e-304fac6d9c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.622418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f8b8e-2b4e-447a-977e-304fac6d9c1b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.622696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f8b8e-2b4e-447a-977e-304fac6d9c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.622972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f8b8e-2b4e-447a-977e-304fac6d9c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.623682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f8b8e-2b4e-447a-977e-304fac6d9c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.625225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9ddf-62af-4915-9fa8-c26fffae6f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.625345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f8b8e-2b4e-447a-977e-304fac6d9c1b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.625909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9ddf-62af-4915-9fa8-c26fffae6f1f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.626221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9ddf-62af-4915-9fa8-c26fffae6f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.626500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb9ddf-62af-4915-9fa8-c26fffae6f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.627216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb9ddf-62af-4915-9fa8-c26fffae6f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.628835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb9ddf-62af-4915-9fa8-c26fffae6f1f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.635735 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 806/1646] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:03.636420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f8b8e-2b4e-447a-977e-304fac6d9c1b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.642353 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 841/1647] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:03.642353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9ddf-62af-4915-9fa8-c26fffae6f1f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.642353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2bdb9ddf-62af-4915-9fa8-c26fffae6f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.646052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f8b8e-2b4e-447a-977e-304fac6d9c1b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.650634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59119e-e1c8-47db-a40b-7130ae4cb20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.651273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59119e-e1c8-47db-a40b-7130ae4cb20f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.651550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59119e-e1c8-47db-a40b-7130ae4cb20f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.651822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59119e-e1c8-47db-a40b-7130ae4cb20f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.652563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59119e-e1c8-47db-a40b-7130ae4cb20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.654159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59119e-e1c8-47db-a40b-7130ae4cb20f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.663794 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 807/1648] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:03.665404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59119e-e1c8-47db-a40b-7130ae4cb20f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.674790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59119e-e1c8-47db-a40b-7130ae4cb20f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.679830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef51bb-1d63-4e03-b766-5ef9ef05c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.680485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef51bb-1d63-4e03-b766-5ef9ef05c9d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.680771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef51bb-1d63-4e03-b766-5ef9ef05c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.681051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef51bb-1d63-4e03-b766-5ef9ef05c9d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.681751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef51bb-1d63-4e03-b766-5ef9ef05c9d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.683384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef51bb-1d63-4e03-b766-5ef9ef05c9d6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.693045 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 808/1649] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:03.694524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef51bb-1d63-4e03-b766-5ef9ef05c9d6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.696738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb9ddf-62af-4915-9fa8-c26fffae6f1f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.700373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef8664-6149-4bdd-ad6d-0ea7cee597ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.701011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef8664-6149-4bdd-ad6d-0ea7cee597ce service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.701297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef8664-6149-4bdd-ad6d-0ea7cee597ce service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.701576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef8664-6149-4bdd-ad6d-0ea7cee597ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.710808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef8664-6149-4bdd-ad6d-0ea7cee597ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.712284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef8664-6149-4bdd-ad6d-0ea7cee597ce service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.721525 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 842/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:03.722292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef8664-6149-4bdd-ad6d-0ea7cee597ce service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.731121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef8664-6149-4bdd-ad6d-0ea7cee597ce service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.736142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e7013-7865-4b19-b2ce-a3620a7e353c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.736787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e7013-7865-4b19-b2ce-a3620a7e353c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.737076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e7013-7865-4b19-b2ce-a3620a7e353c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.737352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e7013-7865-4b19-b2ce-a3620a7e353c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.738062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e7013-7865-4b19-b2ce-a3620a7e353c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.739652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e7013-7865-4b19-b2ce-a3620a7e353c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.750463 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 843/1651] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:03.751273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e7013-7865-4b19-b2ce-a3620a7e353c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.773931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef51bb-1d63-4e03-b766-5ef9ef05c9d6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.781209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92111d-2614-40b8-b568-89afb1736f32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.781865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92111d-2614-40b8-b568-89afb1736f32 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.782151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92111d-2614-40b8-b568-89afb1736f32 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.782480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92111d-2614-40b8-b568-89afb1736f32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.784611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2a92111d-2614-40b8-b568-89afb1736f32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.828600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e7013-7865-4b19-b2ce-a3620a7e353c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.834507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33483-35a1-4e80-a8c1-121485c6006c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.835153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33483-35a1-4e80-a8c1-121485c6006c service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.835434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33483-35a1-4e80-a8c1-121485c6006c service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.835711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b33483-35a1-4e80-a8c1-121485c6006c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.837577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-90b33483-35a1-4e80-a8c1-121485c6006c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:03.848448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92111d-2614-40b8-b568-89afb1736f32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.850578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92111d-2614-40b8-b568-89afb1736f32 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.859911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 809/1652] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:03.860645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92111d-2614-40b8-b568-89afb1736f32 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.871256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92111d-2614-40b8-b568-89afb1736f32 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.876150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d057-d957-4e9e-821f-51b2c26d90b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:03.877141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d057-d957-4e9e-821f-51b2c26d90b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:03.877430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d057-d957-4e9e-821f-51b2c26d90b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:03.877707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d057-d957-4e9e-821f-51b2c26d90b8 admin admin] PATH_INFO: `/v3/projects/05e78eaca25f4f9bbbd0bf215af9e315/users/37b87fd468ba40618511a5459715a0d7/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:03.879943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48d057-d957-4e9e-821f-51b2c26d90b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e78eaca25f4f9bbbd0bf215af9e315, user_id=37b87fd468ba40618511a5459715a0d7, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.882692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48d057-d957-4e9e-821f-51b2c26d90b8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.894036 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 810/1653] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:03 2022] PUT /identity/v3/projects/05e78eaca25f4f9bbbd0bf215af9e315/users/37b87fd468ba40618511a5459715a0d7/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:03.894921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d057-d957-4e9e-821f-51b2c26d90b8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.920798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33483-35a1-4e80-a8c1-121485c6006c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:03.922417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b33483-35a1-4e80-a8c1-121485c6006c service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:03.943671 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 844/1654] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:03.950604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33483-35a1-4e80-a8c1-121485c6006c service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:03.969259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b33483-35a1-4e80-a8c1-121485c6006c service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:03.995328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d057-d957-4e9e-821f-51b2c26d90b8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.003988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a149b9a-4b83-4023-8747-75e11ffa6735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.009907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a149b9a-4b83-4023-8747-75e11ffa6735 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.010793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a149b9a-4b83-4023-8747-75e11ffa6735 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.011279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a149b9a-4b83-4023-8747-75e11ffa6735 admin admin] PATH_INFO: `/v3/projects/f553d705e9094d75aba04f42f75da578/users/e8729c10afe047fdb253b6f24de46604/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.014768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a149b9a-4b83-4023-8747-75e11ffa6735 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f553d705e9094d75aba04f42f75da578, user_id=e8729c10afe047fdb253b6f24de46604, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.022862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a149b9a-4b83-4023-8747-75e11ffa6735 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.036727 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 811/1655] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:03 2022] PUT /identity/v3/projects/f553d705e9094d75aba04f42f75da578/users/e8729c10afe047fdb253b6f24de46604/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:04.038448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a149b9a-4b83-4023-8747-75e11ffa6735 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.090291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595985-9a31-451a-8793-d7b850d35806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.093106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595985-9a31-451a-8793-d7b850d35806 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.094600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595985-9a31-451a-8793-d7b850d35806 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.094992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595985-9a31-451a-8793-d7b850d35806 admin admin] PATH_INFO: `/v3/projects/d29fb9a8facc47ac9ac51a34fa80328b/users/b98baf6a0fbe4030a50fead74f36543c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.101879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595985-9a31-451a-8793-d7b850d35806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29fb9a8facc47ac9ac51a34fa80328b, user_id=b98baf6a0fbe4030a50fead74f36543c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.105769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595985-9a31-451a-8793-d7b850d35806 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.122093 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 845/1656] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:03 2022] PUT /identity/v3/projects/d29fb9a8facc47ac9ac51a34fa80328b/users/b98baf6a0fbe4030a50fead74f36543c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:04.123509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595985-9a31-451a-8793-d7b850d35806 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.142714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a149b9a-4b83-4023-8747-75e11ffa6735 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.198649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034f131-f07c-475e-b3c3-75526a5e08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.199849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595985-9a31-451a-8793-d7b850d35806 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.200083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034f131-f07c-475e-b3c3-75526a5e08e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.200454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034f131-f07c-475e-b3c3-75526a5e08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.200739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034f131-f07c-475e-b3c3-75526a5e08e6 admin admin] PATH_INFO: `/v3/projects/bcdf204a282945d5b5f78786837cc6a5/users/dc630bbeca714703b58a689bd64a5356/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.203610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034f131-f07c-475e-b3c3-75526a5e08e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdf204a282945d5b5f78786837cc6a5, user_id=dc630bbeca714703b58a689bd64a5356, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.205753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560afa3-9894-4711-a0f5-a10f7cd3004d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.206908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560afa3-9894-4711-a0f5-a10f7cd3004d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.207029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034f131-f07c-475e-b3c3-75526a5e08e6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.207188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560afa3-9894-4711-a0f5-a10f7cd3004d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.207523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560afa3-9894-4711-a0f5-a10f7cd3004d admin admin] PATH_INFO: `/v3/projects/db5c402c9d754304a3011b64d91c482f/users/e3564252f55f4da8a7e2e2582bf69bca/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.213173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560afa3-9894-4711-a0f5-a10f7cd3004d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5c402c9d754304a3011b64d91c482f, user_id=e3564252f55f4da8a7e2e2582bf69bca, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.215842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560afa3-9894-4711-a0f5-a10f7cd3004d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.226712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 812/1657] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:04 2022] PUT /identity/v3/projects/bcdf204a282945d5b5f78786837cc6a5/users/dc630bbeca714703b58a689bd64a5356/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:04.226712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4d422-98cd-49bb-97b1-805b96f8c70c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.226712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4d422-98cd-49bb-97b1-805b96f8c70c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.226712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e4d422-98cd-49bb-97b1-805b96f8c70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.239964 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 846/1658] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:04 2022] PUT /identity/v3/projects/db5c402c9d754304a3011b64d91c482f/users/e3564252f55f4da8a7e2e2582bf69bca/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:04.239964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49569f1a-05aa-4ddc-afcf-50dbe2566029 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.239964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49569f1a-05aa-4ddc-afcf-50dbe2566029 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.239964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49569f1a-05aa-4ddc-afcf-50dbe2566029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.263890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-49569f1a-05aa-4ddc-afcf-50dbe2566029 None None] MFA Rules not processed for user `e8729c10afe047fdb253b6f24de46604`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:04.265136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-49569f1a-05aa-4ddc-afcf-50dbe2566029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.265932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-13e4d422-98cd-49bb-97b1-805b96f8c70c None None] MFA Rules not processed for user `37b87fd468ba40618511a5459715a0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:04.267257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-13e4d422-98cd-49bb-97b1-805b96f8c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.337404 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 813/1659] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:04.338193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4d422-98cd-49bb-97b1-805b96f8c70c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.339576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-13e4d422-98cd-49bb-97b1-805b96f8c70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.341256 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 847/1660] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:04.341947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49569f1a-05aa-4ddc-afcf-50dbe2566029 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.343442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-49569f1a-05aa-4ddc-afcf-50dbe2566029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.406403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49569f1a-05aa-4ddc-afcf-50dbe2566029 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.406793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e4d422-98cd-49bb-97b1-805b96f8c70c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.410984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.411274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.411843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.412143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.412309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.412985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] PATH_INFO: `/v3/users/2d54340f1ffa4a4d91edc495ad009807` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.413070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.413278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] PATH_INFO: `/v3/projects/f128aa269f41499eb61904f05f39b486` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.414199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d54340f1ffa4a4d91edc495ad009807)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.414478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f128aa269f41499eb61904f05f39b486)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.416147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.416408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.462184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d54340f1ffa4a4d91edc495ad009807'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.462858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f128aa269f41499eb61904f05f39b486', 'request_id': 'req-8db80666-3f3a-4a13-b849-6b74b1c00722'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.469612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d54340f1ffa4a4d91edc495ad009807'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.470122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f128aa269f41499eb61904f05f39b486', 'request_id': 'req-8db80666-3f3a-4a13-b849-6b74b1c00722'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.470273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d54340f1ffa4a4d91edc495ad009807'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.470900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d54340f1ffa4a4d91edc495ad009807'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.476777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f128aa269f41499eb61904f05f39b486', 'request_id': 'req-8db80666-3f3a-4a13-b849-6b74b1c00722'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.478441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66f76960-e8b6-482a-a172-0697350a8177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d54340f1ffa4a4d91edc495ad009807'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.487850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] The token cache is being invalidate because project f128aa269f41499eb61904f05f39b486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:04.488191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.488858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8db80666-3f3a-4a13-b849-6b74b1c00722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:04.490429 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 814/1661] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:04 2022] DELETE /identity/v3/projects/f128aa269f41499eb61904f05f39b486 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:04.491710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b897d2d-db60-4d5e-a14d-91f363e72f57 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.492033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b897d2d-db60-4d5e-a14d-91f363e72f57 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.492314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b897d2d-db60-4d5e-a14d-91f363e72f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.499907 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 848/1662] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:04 2022] DELETE /identity/v3/users/2d54340f1ffa4a4d91edc495ad009807 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:04.499907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1704efa-4b88-4489-b65b-b8573319e92d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.499907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1704efa-4b88-4489-b65b-b8573319e92d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.499907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1704efa-4b88-4489-b65b-b8573319e92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.518149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8b897d2d-db60-4d5e-a14d-91f363e72f57 None None] MFA Rules not processed for user `b98baf6a0fbe4030a50fead74f36543c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:04.519346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8b897d2d-db60-4d5e-a14d-91f363e72f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.524818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e1704efa-4b88-4489-b65b-b8573319e92d None None] MFA Rules not processed for user `dc630bbeca714703b58a689bd64a5356`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:04.525996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e1704efa-4b88-4489-b65b-b8573319e92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.590923 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 815/1663] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:04.596475 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 849/1664] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:04.596611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99933c-3f16-47ca-b8da-bcd0390bd3cb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.596869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99933c-3f16-47ca-b8da-bcd0390bd3cb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.597436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99933c-3f16-47ca-b8da-bcd0390bd3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.601621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1704efa-4b88-4489-b65b-b8573319e92d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.602934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e1704efa-4b88-4489-b65b-b8573319e92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.622659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4a99933c-3f16-47ca-b8da-bcd0390bd3cb None None] MFA Rules not processed for user `e3564252f55f4da8a7e2e2582bf69bca`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:04.623843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4a99933c-3f16-47ca-b8da-bcd0390bd3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.672639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1704efa-4b88-4489-b65b-b8573319e92d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.678177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa67726-b0de-4963-ad95-723c0bfd4ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.678800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa67726-b0de-4963-ad95-723c0bfd4ae7 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.679082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa67726-b0de-4963-ad95-723c0bfd4ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.679355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa67726-b0de-4963-ad95-723c0bfd4ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.681152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aaa67726-b0de-4963-ad95-723c0bfd4ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.689674 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 816/1665] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:04.694736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99933c-3f16-47ca-b8da-bcd0390bd3cb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.694736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4a99933c-3f16-47ca-b8da-bcd0390bd3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.707812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99933c-3f16-47ca-b8da-bcd0390bd3cb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.714043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a49b3-35c6-4130-9a85-c447306404c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.714678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a49b3-35c6-4130-9a85-c447306404c2 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.714962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a49b3-35c6-4130-9a85-c447306404c2 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.715238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a49b3-35c6-4130-9a85-c447306404c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.717027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1e1a49b3-35c6-4130-9a85-c447306404c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.737548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa67726-b0de-4963-ad95-723c0bfd4ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.739240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa67726-b0de-4963-ad95-723c0bfd4ae7 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.748133 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 850/1666] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:04.749368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807687-516c-40fb-9204-46cc7047c473 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.749652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807687-516c-40fb-9204-46cc7047c473 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.749936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5807687-516c-40fb-9204-46cc7047c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.768818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e5807687-516c-40fb-9204-46cc7047c473 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:04.770025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e5807687-516c-40fb-9204-46cc7047c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.777708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a49b3-35c6-4130-9a85-c447306404c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.779340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a49b3-35c6-4130-9a85-c447306404c2 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.794056 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 817/1667] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:04.795651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197945-91b3-4e89-acf2-60c20e612e99 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.795971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197945-91b3-4e89-acf2-60c20e612e99 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.796248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53197945-91b3-4e89-acf2-60c20e612e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.812815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-53197945-91b3-4e89-acf2-60c20e612e99 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:04.814013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-53197945-91b3-4e89-acf2-60c20e612e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.836278 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 851/1668] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:04.837113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5807687-516c-40fb-9204-46cc7047c473 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.849230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5807687-516c-40fb-9204-46cc7047c473 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.854718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.855347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.855633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.855970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.857755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.875562 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 818/1669] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:04.876435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53197945-91b3-4e89-acf2-60c20e612e99 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.889827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53197945-91b3-4e89-acf2-60c20e612e99 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.895433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1576c-17d1-43ea-877d-35192dbe6314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.896104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1576c-17d1-43ea-877d-35192dbe6314 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.896392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1576c-17d1-43ea-877d-35192dbe6314 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.897318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1576c-17d1-43ea-877d-35192dbe6314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.905590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1576c-17d1-43ea-877d-35192dbe6314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.907203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1576c-17d1-43ea-877d-35192dbe6314 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.917474 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 819/1670] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:04.919620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.920101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082e20-fcb0-4eae-8271-5ff6a3299688 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.920512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082e20-fcb0-4eae-8271-5ff6a3299688 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.920890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80082e20-fcb0-4eae-8271-5ff6a3299688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.921265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:04.931500 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 852/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:04.941408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.943019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-80082e20-fcb0-4eae-8271-5ff6a3299688 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:04.944551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.945364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-80082e20-fcb0-4eae-8271-5ff6a3299688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:04.959611 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 820/1672] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:04.959940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082e20-fcb0-4eae-8271-5ff6a3299688 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:04.973720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80082e20-fcb0-4eae-8271-5ff6a3299688 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:04.981153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0269342-e848-4ae1-92db-f5e3048d3062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:04.981805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0269342-e848-4ae1-92db-f5e3048d3062 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:04.982097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0269342-e848-4ae1-92db-f5e3048d3062 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:04.982364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0269342-e848-4ae1-92db-f5e3048d3062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:04.993060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0269342-e848-4ae1-92db-f5e3048d3062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:04.994820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0269342-e848-4ae1-92db-f5e3048d3062 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.007986 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 821/1673] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:05.008838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0269342-e848-4ae1-92db-f5e3048d3062 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.020795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044d617-a476-4232-b06d-54dd0f0012cb service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.026267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c32c8-6df2-4d49-832c-71c2330313f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.027078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c32c8-6df2-4d49-832c-71c2330313f4 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.027380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c32c8-6df2-4d49-832c-71c2330313f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.027657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c32c8-6df2-4d49-832c-71c2330313f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.028782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0269342-e848-4ae1-92db-f5e3048d3062 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.033451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fdfe1-907f-4493-966f-b5a742cd77bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.034438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fdfe1-907f-4493-966f-b5a742cd77bb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.034737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fdfe1-907f-4493-966f-b5a742cd77bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.035024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fdfe1-907f-4493-966f-b5a742cd77bb admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.035743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fdfe1-907f-4493-966f-b5a742cd77bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:05.036090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fdfe1-907f-4493-966f-b5a742cd77bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.038342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fdfe1-907f-4493-966f-b5a742cd77bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.040200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c32c8-6df2-4d49-832c-71c2330313f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.041921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c32c8-6df2-4d49-832c-71c2330313f4 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.055359 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 822/1674] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:05.055359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fdfe1-907f-4493-966f-b5a742cd77bb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.059860 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 853/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:05.060745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c32c8-6df2-4d49-832c-71c2330313f4 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.067459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fdfe1-907f-4493-966f-b5a742cd77bb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.073784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531923b-ad9a-4e8f-bce3-2af6d3b54fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.074656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531923b-ad9a-4e8f-bce3-2af6d3b54fc1 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.075135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531923b-ad9a-4e8f-bce3-2af6d3b54fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.075484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531923b-ad9a-4e8f-bce3-2af6d3b54fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.076963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c32c8-6df2-4d49-832c-71c2330313f4 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.083369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fd171-5931-46e5-84a4-ea2c15240f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.084592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fd171-5931-46e5-84a4-ea2c15240f39 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.084882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fd171-5931-46e5-84a4-ea2c15240f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.085241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fd171-5931-46e5-84a4-ea2c15240f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.085939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fd171-5931-46e5-84a4-ea2c15240f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.088173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fd171-5931-46e5-84a4-ea2c15240f39 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.089379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531923b-ad9a-4e8f-bce3-2af6d3b54fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.090842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531923b-ad9a-4e8f-bce3-2af6d3b54fc1 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.110690 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 823/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:05.125080 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 854/1677] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:05 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:05.126997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531923b-ad9a-4e8f-bce3-2af6d3b54fc1 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.140338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531923b-ad9a-4e8f-bce3-2af6d3b54fc1 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.216579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd7fc7-16d6-4cb5-827a-6a54844da634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.217789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd7fc7-16d6-4cb5-827a-6a54844da634 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.218622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd7fc7-16d6-4cb5-827a-6a54844da634 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.231526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd7fc7-16d6-4cb5-827a-6a54844da634 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.232555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd7fc7-16d6-4cb5-827a-6a54844da634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.237304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd7fc7-16d6-4cb5-827a-6a54844da634 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.276134 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 824/1678] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:05 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:05.280449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fd171-5931-46e5-84a4-ea2c15240f39 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.292835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fd171-5931-46e5-84a4-ea2c15240f39 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.298001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed882a47-e0ba-4386-a040-beef3cfbc2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.298798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882a47-e0ba-4386-a040-beef3cfbc2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.299287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882a47-e0ba-4386-a040-beef3cfbc2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.299681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed882a47-e0ba-4386-a040-beef3cfbc2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.300770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed882a47-e0ba-4386-a040-beef3cfbc2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.302574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed882a47-e0ba-4386-a040-beef3cfbc2c6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.316584 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 855/1679] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:05.325256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd7fc7-16d6-4cb5-827a-6a54844da634 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.338841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd7fc7-16d6-4cb5-827a-6a54844da634 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.345481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dc9c5-60f1-4797-9fc8-a78327499ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.346214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dc9c5-60f1-4797-9fc8-a78327499ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.346595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dc9c5-60f1-4797-9fc8-a78327499ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.346885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dc9c5-60f1-4797-9fc8-a78327499ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.347978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dc9c5-60f1-4797-9fc8-a78327499ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.350687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dc9c5-60f1-4797-9fc8-a78327499ea4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.365633 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 825/1680] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:49:05.367655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed882a47-e0ba-4386-a040-beef3cfbc2c6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.372503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dc9c5-60f1-4797-9fc8-a78327499ea4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.382803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed882a47-e0ba-4386-a040-beef3cfbc2c6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.399264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261684-4d99-47f5-aa74-57457b7bb1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.400506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261684-4d99-47f5-aa74-57457b7bb1b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.400840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261684-4d99-47f5-aa74-57457b7bb1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.401562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38261684-4d99-47f5-aa74-57457b7bb1b0 admin admin] PATH_INFO: `/v3/projects/c2133fff60db4fe9bb0aa9bbb266e602/users/a63e6f035306422cab01a0b1a2f5d635/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.428703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38261684-4d99-47f5-aa74-57457b7bb1b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2133fff60db4fe9bb0aa9bbb266e602, user_id=a63e6f035306422cab01a0b1a2f5d635, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.432180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38261684-4d99-47f5-aa74-57457b7bb1b0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.456866 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 856/1681] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:05 2022] PUT /identity/v3/projects/c2133fff60db4fe9bb0aa9bbb266e602/users/a63e6f035306422cab01a0b1a2f5d635/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:05.457696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261684-4d99-47f5-aa74-57457b7bb1b0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.469173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-38261684-4d99-47f5-aa74-57457b7bb1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:05.469547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dc9c5-60f1-4797-9fc8-a78327499ea4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.538590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38261684-4d99-47f5-aa74-57457b7bb1b0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.544921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.545867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.546247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.546598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] PATH_INFO: `/v3/projects/330a9fb37786483a8c98e7864356025f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.547942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330a9fb37786483a8c98e7864356025f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.549063 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.549063 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:49:05.549063 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:49:05.549292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11542b-48ec-44bd-9fbc-9498f34421b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.550017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11542b-48ec-44bd-9fbc-9498f34421b0 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.550310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11542b-48ec-44bd-9fbc-9498f34421b0 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.550452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.550606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11542b-48ec-44bd-9fbc-9498f34421b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.552525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7f11542b-48ec-44bd-9fbc-9498f34421b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:05.618827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330a9fb37786483a8c98e7864356025f', 'request_id': 'req-d40e6429-d5d9-488f-99c6-b6fd03db5488'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.627941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330a9fb37786483a8c98e7864356025f', 'request_id': 'req-d40e6429-d5d9-488f-99c6-b6fd03db5488'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.636456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330a9fb37786483a8c98e7864356025f', 'request_id': 'req-d40e6429-d5d9-488f-99c6-b6fd03db5488'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.641847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11542b-48ec-44bd-9fbc-9498f34421b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.643732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f11542b-48ec-44bd-9fbc-9498f34421b0 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.653845 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 826/1682] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:05.655041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4cae0-b59d-41c1-88ef-ea8086781dc8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.655334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4cae0-b59d-41c1-88ef-ea8086781dc8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.655608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4cae0-b59d-41c1-88ef-ea8086781dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.662038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] The token cache is being invalidate because project 330a9fb37786483a8c98e7864356025f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:05.662582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.663439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.674621 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 857/1683] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:05 2022] DELETE /identity/v3/projects/330a9fb37786483a8c98e7864356025f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:05.675585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.677584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:05.685334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-06a4cae0-b59d-41c1-88ef-ea8086781dc8 None None] MFA Rules not processed for user `a63e6f035306422cab01a0b1a2f5d635`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:05.688273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-06a4cae0-b59d-41c1-88ef-ea8086781dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:05.766998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e6429-d5d9-488f-99c6-b6fd03db5488 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.772394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.773511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.773791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.774065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] PATH_INFO: `/v3/users/ff083e7a1c254012833ec4de907acbec` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.775446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff083e7a1c254012833ec4de907acbec)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.777274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.808157 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 827/1684] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:05.808157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4cae0-b59d-41c1-88ef-ea8086781dc8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.808157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-06a4cae0-b59d-41c1-88ef-ea8086781dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:05.825028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4cae0-b59d-41c1-88ef-ea8086781dc8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:05.830565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:05.831424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.831707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.832093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] PATH_INFO: `/v3/users/1ee86e1c8c6d4db08cec5c2e92851c83` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.833306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee86e1c8c6d4db08cec5c2e92851c83)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:05.834290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff083e7a1c254012833ec4de907acbec'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.834403 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:49:05.834403 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:49:05.834403 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:49:05.835579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:05.842370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff083e7a1c254012833ec4de907acbec'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.843416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff083e7a1c254012833ec4de907acbec'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.844218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff083e7a1c254012833ec4de907acbec'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.855805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a6133ebc-8a46-4cf5-94ab-768516a052c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff083e7a1c254012833ec4de907acbec'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.876638 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 858/1685] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:05 2022] DELETE /identity/v3/users/ff083e7a1c254012833ec4de907acbec => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:05.878212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd125-d492-425e-8203-db5f5ebde94c None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:05.878644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd125-d492-425e-8203-db5f5ebde94c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:05.879685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17dd125-d492-425e-8203-db5f5ebde94c None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:05.882104 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 859/1686] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:05.882811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dd125-d492-425e-8203-db5f5ebde94c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:05.889433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c17dd125-d492-425e-8203-db5f5ebde94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:05.925375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee86e1c8c6d4db08cec5c2e92851c83'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.936756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee86e1c8c6d4db08cec5c2e92851c83'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.938155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee86e1c8c6d4db08cec5c2e92851c83'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.939016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee86e1c8c6d4db08cec5c2e92851c83'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.971124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee86e1c8c6d4db08cec5c2e92851c83'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:05.989247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17dd125-d492-425e-8203-db5f5ebde94c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.003002 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 828/1687] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:05 2022] DELETE /identity/v3/users/1ee86e1c8c6d4db08cec5c2e92851c83 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:06.003084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb36805-1263-4250-9756-49404a01eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.003169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.003252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb36805-1263-4250-9756-49404a01eedf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.003252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb36805-1263-4250-9756-49404a01eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.003252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb36805-1263-4250-9756-49404a01eedf admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.003252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb36805-1263-4250-9756-49404a01eedf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.003252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb36805-1263-4250-9756-49404a01eedf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.009367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.058411 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 860/1688] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:05 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:06.058411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdb69d-d370-467c-b866-1a98d228f511 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.058411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdb69d-d370-467c-b866-1a98d228f511 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.058668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdb69d-d370-467c-b866-1a98d228f511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.082897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-53fdb69d-d370-467c-b866-1a98d228f511 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:06.084465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-53fdb69d-d370-467c-b866-1a98d228f511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.097650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce135a-2cea-4288-a387-567c7bb1be71 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.183229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.184189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.184471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.184745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] PATH_INFO: `/v3/users/bf95903dfc0e4f718a324f131a3e4f4c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.189035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf95903dfc0e4f718a324f131a3e4f4c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.190408 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 861/1689] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:49:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:06.191159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.192173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466706-f551-4992-b66f-32d6f72ed6a7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.192732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466706-f551-4992-b66f-32d6f72ed6a7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.193191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e466706-f551-4992-b66f-32d6f72ed6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.221159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7e466706-f551-4992-b66f-32d6f72ed6a7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:06.222461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7e466706-f551-4992-b66f-32d6f72ed6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.234163 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 862/1690] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:06.235004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466706-f551-4992-b66f-32d6f72ed6a7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.236576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7e466706-f551-4992-b66f-32d6f72ed6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.251291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e466706-f551-4992-b66f-32d6f72ed6a7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.256465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7666-a94d-4449-892e-c6f3a5b9caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.257193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7666-a94d-4449-892e-c6f3a5b9caae admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.257479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7666-a94d-4449-892e-c6f3a5b9caae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.257755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7666-a94d-4449-892e-c6f3a5b9caae admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.258439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7666-a94d-4449-892e-c6f3a5b9caae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.260555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7666-a94d-4449-892e-c6f3a5b9caae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.267306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf95903dfc0e4f718a324f131a3e4f4c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.280963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf95903dfc0e4f718a324f131a3e4f4c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.281674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf95903dfc0e4f718a324f131a3e4f4c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.282416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf95903dfc0e4f718a324f131a3e4f4c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.285148 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 863/1691] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:06 2022] POST /identity/v3/users => generated 300 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:06.286097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7666-a94d-4449-892e-c6f3a5b9caae admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.288358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a9ee7666-a94d-4449-892e-c6f3a5b9caae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.298830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf95903dfc0e4f718a324f131a3e4f4c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.305024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7666-a94d-4449-892e-c6f3a5b9caae admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.311124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.312006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.312427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.312706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.314806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.318644 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 829/1692] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:05 2022] DELETE /identity/v3/users/bf95903dfc0e4f718a324f131a3e4f4c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:06.321187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.321417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.331037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.333461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.353197 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 864/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:06.354219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.357192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.380324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee021a-fce7-4327-a8c1-2f1b3036bbf7 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.425136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009a232-9031-4eb0-b370-afa3a2ff13d3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.430081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269e3da-71c7-451e-b48c-fc460a44b77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.431205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269e3da-71c7-451e-b48c-fc460a44b77d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.431491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269e3da-71c7-451e-b48c-fc460a44b77d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.431768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269e3da-71c7-451e-b48c-fc460a44b77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.433892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2269e3da-71c7-451e-b48c-fc460a44b77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.480142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be8531-2608-4fb2-bbc2-188a70a96626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.481189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8531-2608-4fb2-bbc2-188a70a96626 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.481810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8531-2608-4fb2-bbc2-188a70a96626 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.482883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be8531-2608-4fb2-bbc2-188a70a96626 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.484026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8531-2608-4fb2-bbc2-188a70a96626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.487526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be8531-2608-4fb2-bbc2-188a70a96626 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.520870 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 865/1694] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:06.526145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2f5e7-0053-4ebe-922e-db51347e96f6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.526736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2f5e7-0053-4ebe-922e-db51347e96f6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.527035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2f5e7-0053-4ebe-922e-db51347e96f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.551203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bcf2f5e7-0053-4ebe-922e-db51347e96f6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:06.552557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bcf2f5e7-0053-4ebe-922e-db51347e96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.558922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269e3da-71c7-451e-b48c-fc460a44b77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.560671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2269e3da-71c7-451e-b48c-fc460a44b77d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.561044 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 866/1695] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:06.561849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2f5e7-0053-4ebe-922e-db51347e96f6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.563124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bcf2f5e7-0053-4ebe-922e-db51347e96f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.571831 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 830/1696] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:06.572685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269e3da-71c7-451e-b48c-fc460a44b77d service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.582823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269e3da-71c7-451e-b48c-fc460a44b77d service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.588476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffd716-a98a-4c30-8aba-c81040ee3151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.589420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffd716-a98a-4c30-8aba-c81040ee3151 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.589673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffd716-a98a-4c30-8aba-c81040ee3151 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.590071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffd716-a98a-4c30-8aba-c81040ee3151 admin admin] PATH_INFO: `/v3/projects/44055431d9734f7c99d840d25fc702e4/users/ac11ea59379e47aa83dc490bf56ae97c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.598103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2f5e7-0053-4ebe-922e-db51347e96f6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.604640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.606342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.606707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.607065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] PATH_INFO: `/v3/projects/b14987444eae40588ea209778938f9c6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.608403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b14987444eae40588ea209778938f9c6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.610661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffd716-a98a-4c30-8aba-c81040ee3151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44055431d9734f7c99d840d25fc702e4, user_id=ac11ea59379e47aa83dc490bf56ae97c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.611137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.613403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffd716-a98a-4c30-8aba-c81040ee3151 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.630362 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 831/1697] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:06 2022] PUT /identity/v3/projects/44055431d9734f7c99d840d25fc702e4/users/ac11ea59379e47aa83dc490bf56ae97c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:06.631371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffd716-a98a-4c30-8aba-c81040ee3151 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.633008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1bffd716-a98a-4c30-8aba-c81040ee3151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.669045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b14987444eae40588ea209778938f9c6', 'request_id': 'req-455f08d0-b90b-440b-85a5-719797f1bf0c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.676944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b14987444eae40588ea209778938f9c6', 'request_id': 'req-455f08d0-b90b-440b-85a5-719797f1bf0c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.683965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b14987444eae40588ea209778938f9c6', 'request_id': 'req-455f08d0-b90b-440b-85a5-719797f1bf0c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.696189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] The token cache is being invalidate because project b14987444eae40588ea209778938f9c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:06.696475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.697126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.699975 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 867/1698] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:06 2022] DELETE /identity/v3/projects/b14987444eae40588ea209778938f9c6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:06.699975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.701631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.705200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffd716-a98a-4c30-8aba-c81040ee3151 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.770832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.772288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.772574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.772847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] PATH_INFO: `/v3/users/60be9224375846f9a012085ca9238c27` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.774045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60be9224375846f9a012085ca9238c27)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.776026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.779737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f08d0-b90b-440b-85a5-719797f1bf0c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.784032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.784996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.784996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.785242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.787086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.800013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.801733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.814348 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 868/1699] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:06.815076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.816834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.828341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60be9224375846f9a012085ca9238c27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.838846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60be9224375846f9a012085ca9238c27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.839980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60be9224375846f9a012085ca9238c27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.840618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60be9224375846f9a012085ca9238c27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.855162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27e9da13-e76f-40d5-a844-7e58ad4dfb72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60be9224375846f9a012085ca9238c27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:06.869805 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 832/1700] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:06 2022] DELETE /identity/v3/users/60be9224375846f9a012085ca9238c27 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:06.871129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d665f-1f73-46a3-9768-f324a50d4808 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.871413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d665f-1f73-46a3-9768-f324a50d4808 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.872116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d665f-1f73-46a3-9768-f324a50d4808 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.873946 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 833/1701] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:06.874658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d665f-1f73-46a3-9768-f324a50d4808 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:06.876362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9c4d665f-1f73-46a3-9768-f324a50d4808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.897725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d666f62-48ce-41a4-aa89-bcb854358fbd service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.953547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d665f-1f73-46a3-9768-f324a50d4808 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:06.959762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87a8c3-0af8-4d76-8482-51a6063c9be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.960534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87a8c3-0af8-4d76-8482-51a6063c9be6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.960872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87a8c3-0af8-4d76-8482-51a6063c9be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.961158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87a8c3-0af8-4d76-8482-51a6063c9be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.961972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87a8c3-0af8-4d76-8482-51a6063c9be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:06.963768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87a8c3-0af8-4d76-8482-51a6063c9be6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:06.971690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fea09-6e34-4827-b3f3-d64e3194c517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:06.972449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fea09-6e34-4827-b3f3-d64e3194c517 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.972851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fea09-6e34-4827-b3f3-d64e3194c517 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.973228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fea09-6e34-4827-b3f3-d64e3194c517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.975312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8a6fea09-6e34-4827-b3f3-d64e3194c517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:06.976269 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 834/1702] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:06.977727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acda8f-226b-4ece-bc23-28b3e9102a56 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:06.978017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acda8f-226b-4ece-bc23-28b3e9102a56 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:06.978308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acda8f-226b-4ece-bc23-28b3e9102a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:06.998428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d3acda8f-226b-4ece-bc23-28b3e9102a56 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:07.000547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d3acda8f-226b-4ece-bc23-28b3e9102a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.009825 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 835/1703] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:07.022246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db90d5-2741-4154-a183-a36fe180d9b8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.022544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db90d5-2741-4154-a183-a36fe180d9b8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.022825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db90d5-2741-4154-a183-a36fe180d9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.040923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f8db90d5-2741-4154-a183-a36fe180d9b8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:07.042176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f8db90d5-2741-4154-a183-a36fe180d9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.050250 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 836/1704] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:07.051897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3c100-f6c3-45ed-a310-6e3d3314364a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.052233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3c100-f6c3-45ed-a310-6e3d3314364a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.052512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3c100-f6c3-45ed-a310-6e3d3314364a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.073244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fda3c100-f6c3-45ed-a310-6e3d3314364a None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:07.074027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fea09-6e34-4827-b3f3-d64e3194c517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:07.074566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fda3c100-f6c3-45ed-a310-6e3d3314364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.076709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fea09-6e34-4827-b3f3-d64e3194c517 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:07.090837 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 869/1705] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:07.091730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fea09-6e34-4827-b3f3-d64e3194c517 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:07.103161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fea09-6e34-4827-b3f3-d64e3194c517 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:07.117007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e212d-c330-4fcb-829a-02c89f4106b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:07.117921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e212d-c330-4fcb-829a-02c89f4106b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.118205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e212d-c330-4fcb-829a-02c89f4106b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.118483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e212d-c330-4fcb-829a-02c89f4106b4 admin admin] PATH_INFO: `/v3/projects/44055431d9734f7c99d840d25fc702e4/users/ac11ea59379e47aa83dc490bf56ae97c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.122033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e212d-c330-4fcb-829a-02c89f4106b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44055431d9734f7c99d840d25fc702e4, user_id=ac11ea59379e47aa83dc490bf56ae97c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:07.135129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e212d-c330-4fcb-829a-02c89f4106b4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:07.146004 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 837/1706] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:49:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:07.147644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3c100-f6c3-45ed-a310-6e3d3314364a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:07.149442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fda3c100-f6c3-45ed-a310-6e3d3314364a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.165314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3c100-f6c3-45ed-a310-6e3d3314364a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:07.179071 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 870/1707] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:07 2022] PUT /identity/v3/projects/44055431d9734f7c99d840d25fc702e4/users/ac11ea59379e47aa83dc490bf56ae97c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:07.179071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce813626-62fb-48d8-afca-55dfba2d2e19 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.179071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce813626-62fb-48d8-afca-55dfba2d2e19 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.179071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce813626-62fb-48d8-afca-55dfba2d2e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.198817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ce813626-62fb-48d8-afca-55dfba2d2e19 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:07.200492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce813626-62fb-48d8-afca-55dfba2d2e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.228390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:07.229247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.229505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.229786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] PATH_INFO: `/v3/projects/c439fc913e3941a58947832c0afa7295` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.232855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c439fc913e3941a58947832c0afa7295)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:07.239190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:07.303230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c439fc913e3941a58947832c0afa7295', 'request_id': 'req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.305585 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 871/1708] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:07.306475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce813626-62fb-48d8-afca-55dfba2d2e19 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:07.307789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce813626-62fb-48d8-afca-55dfba2d2e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.317189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c439fc913e3941a58947832c0afa7295', 'request_id': 'req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.324671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c439fc913e3941a58947832c0afa7295', 'request_id': 'req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.338098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] The token cache is being invalidate because project c439fc913e3941a58947832c0afa7295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:07.338629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.339892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfa44bc8-6c03-42ee-a9a5-efbf47fdfe92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.341957 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 838/1709] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:07 2022] DELETE /identity/v3/projects/c439fc913e3941a58947832c0afa7295 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:07.343521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5509-5997-4b37-89ae-00acb662fe5d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.343865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5509-5997-4b37-89ae-00acb662fe5d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.344217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b5509-5997-4b37-89ae-00acb662fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.370720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce813626-62fb-48d8-afca-55dfba2d2e19 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:07.375886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-631b5509-5997-4b37-89ae-00acb662fe5d None None] MFA Rules not processed for user `ac11ea59379e47aa83dc490bf56ae97c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:07.377129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-631b5509-5997-4b37-89ae-00acb662fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.421609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:07.422271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.422554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.422831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.424800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.465295 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 839/1710] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:07.466252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5509-5997-4b37-89ae-00acb662fe5d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:07.468341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-631b5509-5997-4b37-89ae-00acb662fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.496474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:07.498879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:07.509323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 872/1711] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:07.510137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:07.511594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.525647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60ba67-1f8f-437a-9be2-53ee5e301ef0 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:07.534830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:07.534830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.534830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.534830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] PATH_INFO: `/v3/projects/15f6fd60092b410ba8fb57ee200eda6f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.535139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f6fd60092b410ba8fb57ee200eda6f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:07.535823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:07.576219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b5509-5997-4b37-89ae-00acb662fe5d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:07.583507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:07.585063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.585608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.585898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.589591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.611573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:07.613290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:07.619295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f6fd60092b410ba8fb57ee200eda6f', 'request_id': 'req-86e1a941-3ac7-4f15-be04-732bde2fc3eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.624221 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 840/1712] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:07.625167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:07.626866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.637565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f6fd60092b410ba8fb57ee200eda6f', 'request_id': 'req-86e1a941-3ac7-4f15-be04-732bde2fc3eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.645840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72108a0-9ab8-4eda-bf6b-7c7027e706d2 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:07.659086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f6fd60092b410ba8fb57ee200eda6f', 'request_id': 'req-86e1a941-3ac7-4f15-be04-732bde2fc3eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.667966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] The token cache is being invalidate because project 15f6fd60092b410ba8fb57ee200eda6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:07.668223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.668892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.702266 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 873/1713] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:07 2022] DELETE /identity/v3/projects/15f6fd60092b410ba8fb57ee200eda6f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:07.703190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:07.704888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.733921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632843a-a3fc-4ddc-addf-863b06cea81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:07.734673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632843a-a3fc-4ddc-addf-863b06cea81e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.735053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632843a-a3fc-4ddc-addf-863b06cea81e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.735425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632843a-a3fc-4ddc-addf-863b06cea81e admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.736285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632843a-a3fc-4ddc-addf-863b06cea81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:07.736690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632843a-a3fc-4ddc-addf-863b06cea81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:07.738727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d632843a-a3fc-4ddc-addf-863b06cea81e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:07.755411 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 841/1714] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:07.757453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97371-3ed2-495c-8cde-8f3d855852b0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.757827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97371-3ed2-495c-8cde-8f3d855852b0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.758175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97371-3ed2-495c-8cde-8f3d855852b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.798364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-48b97371-3ed2-495c-8cde-8f3d855852b0 None None] MFA Rules not processed for user `a63e6f035306422cab01a0b1a2f5d635`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:07.799429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-48b97371-3ed2-495c-8cde-8f3d855852b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.844261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e1a941-3ac7-4f15-be04-732bde2fc3eb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:07.866507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:07.869128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.869427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.869802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] PATH_INFO: `/v3/users/b98baf6a0fbe4030a50fead74f36543c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.871532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98baf6a0fbe4030a50fead74f36543c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:07.873968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:07.910394 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 842/1715] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:07.910394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b97371-3ed2-495c-8cde-8f3d855852b0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:07.910868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-48b97371-3ed2-495c-8cde-8f3d855852b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:07.925765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b97371-3ed2-495c-8cde-8f3d855852b0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:07.936169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:07.937049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:07.937390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:07.937588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] PATH_INFO: `/v3/users/d407eb06db224f819526e9335b151b62` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:07.939464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d407eb06db224f819526e9335b151b62)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:07.941466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:07.949571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98baf6a0fbe4030a50fead74f36543c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.957345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98baf6a0fbe4030a50fead74f36543c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.958258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98baf6a0fbe4030a50fead74f36543c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.959094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98baf6a0fbe4030a50fead74f36543c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.969377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98baf6a0fbe4030a50fead74f36543c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.989530 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 874/1716] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:07 2022] DELETE /identity/v3/users/b98baf6a0fbe4030a50fead74f36543c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:07.996862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:07.996989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd407eb06db224f819526e9335b151b62'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:07.998491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.013422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd407eb06db224f819526e9335b151b62'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.014117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd407eb06db224f819526e9335b151b62'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.014756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd407eb06db224f819526e9335b151b62'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.035510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd407eb06db224f819526e9335b151b62'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.059696 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 843/1717] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:07 2022] DELETE /identity/v3/users/d407eb06db224f819526e9335b151b62 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:08.059696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:08.072744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.100028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd7fef-5cac-4903-8bba-973bb48bb200 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:08.202257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863dfa6-07a4-4225-867d-97f1433002c0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:08.208078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:08.209467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.209818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.210166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] PATH_INFO: `/v3/users/dfb61c96ff5c4b88a31791121d8b6cdd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.211540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfb61c96ff5c4b88a31791121d8b6cdd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:08.214542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:08.238929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f1e09-cafb-481b-8c74-97473b1d6518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:08.240791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f1e09-cafb-481b-8c74-97473b1d6518 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.241015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f1e09-cafb-481b-8c74-97473b1d6518 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.241428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0f1e09-cafb-481b-8c74-97473b1d6518 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.242133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f1e09-cafb-481b-8c74-97473b1d6518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:08.244374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0f1e09-cafb-481b-8c74-97473b1d6518 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:08.282936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfb61c96ff5c4b88a31791121d8b6cdd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.293958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfb61c96ff5c4b88a31791121d8b6cdd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.295262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfb61c96ff5c4b88a31791121d8b6cdd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.296237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfb61c96ff5c4b88a31791121d8b6cdd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.299811 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 875/1718] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:07 2022] POST /identity/v3/projects => generated 383 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:08.301394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f1e09-cafb-481b-8c74-97473b1d6518 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:08.304634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-db0f1e09-cafb-481b-8c74-97473b1d6518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.314067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfb61c96ff5c4b88a31791121d8b6cdd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.333382 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 844/1719] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:08 2022] DELETE /identity/v3/users/dfb61c96ff5c4b88a31791121d8b6cdd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:08.338812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:08.341538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.459126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671ab56-bad8-4c55-b083-045e84c04066 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:08.464904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:08.466167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.467183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0f1e09-cafb-481b-8c74-97473b1d6518 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:08.467638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.468183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] PATH_INFO: `/v3/projects/1353dd7feef943c1ac6f231c73daaf30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.469647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1353dd7feef943c1ac6f231c73daaf30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:08.472048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:08.556514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1353dd7feef943c1ac6f231c73daaf30', 'request_id': 'req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.559032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10088226-f5fb-49c1-8110-9036438f4e76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:08.564471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10088226-f5fb-49c1-8110-9036438f4e76 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.564921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10088226-f5fb-49c1-8110-9036438f4e76 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.565181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10088226-f5fb-49c1-8110-9036438f4e76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.568425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-10088226-f5fb-49c1-8110-9036438f4e76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.570132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1353dd7feef943c1ac6f231c73daaf30', 'request_id': 'req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.580814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1353dd7feef943c1ac6f231c73daaf30', 'request_id': 'req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.594562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] The token cache is being invalidate because project 1353dd7feef943c1ac6f231c73daaf30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:08.594961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.595752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.597838 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 845/1720] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:08 2022] DELETE /identity/v3/projects/1353dd7feef943c1ac6f231c73daaf30 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:08.601852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:08.605132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.652816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10088226-f5fb-49c1-8110-9036438f4e76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:08.654620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10088226-f5fb-49c1-8110-9036438f4e76 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:08.664534 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 876/1721] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:08.666204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8dc63-45d0-4336-8f93-5215d616e303 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.666624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8dc63-45d0-4336-8f93-5215d616e303 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.669052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8dc63-45d0-4336-8f93-5215d616e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.688547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6bb8dc63-45d0-4336-8f93-5215d616e303 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:08.690011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6bb8dc63-45d0-4336-8f93-5215d616e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.690641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab3b7c-1d9e-4210-97ef-6e937c3c210c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:08.696529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323bf5a-22a8-46a6-9fb5-de427fd85398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:08.697193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323bf5a-22a8-46a6-9fb5-de427fd85398 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.697477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323bf5a-22a8-46a6-9fb5-de427fd85398 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.697752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323bf5a-22a8-46a6-9fb5-de427fd85398 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.698436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323bf5a-22a8-46a6-9fb5-de427fd85398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:08.698830 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 877/1722] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:08.700162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178262e-aa15-4e19-bb9e-05dea18e333e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.700405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323bf5a-22a8-46a6-9fb5-de427fd85398 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:08.700529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178262e-aa15-4e19-bb9e-05dea18e333e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.700708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178262e-aa15-4e19-bb9e-05dea18e333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.718804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b178262e-aa15-4e19-bb9e-05dea18e333e None None] MFA Rules not processed for user `d1e20172563a4c68bec7874b43416e12`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:08.720086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b178262e-aa15-4e19-bb9e-05dea18e333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.731037 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 846/1723] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:08 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:08.731037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323bf5a-22a8-46a6-9fb5-de427fd85398 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:08.731037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7323bf5a-22a8-46a6-9fb5-de427fd85398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.742623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323bf5a-22a8-46a6-9fb5-de427fd85398 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:08.747279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:08.748096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.748382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.749320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] PATH_INFO: `/v3/projects/d29fb9a8facc47ac9ac51a34fa80328b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.750691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29fb9a8facc47ac9ac51a34fa80328b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:08.752651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:08.773046 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 878/1724] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:08.775521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178262e-aa15-4e19-bb9e-05dea18e333e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:08.776915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b178262e-aa15-4e19-bb9e-05dea18e333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.790949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178262e-aa15-4e19-bb9e-05dea18e333e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:08.799085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29fb9a8facc47ac9ac51a34fa80328b', 'request_id': 'req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.806274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29fb9a8facc47ac9ac51a34fa80328b', 'request_id': 'req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.812045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29fb9a8facc47ac9ac51a34fa80328b', 'request_id': 'req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.822832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] The token cache is being invalidate because project d29fb9a8facc47ac9ac51a34fa80328b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:08.823120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.823770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.825344 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 847/1725] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:08 2022] DELETE /identity/v3/projects/d29fb9a8facc47ac9ac51a34fa80328b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:08.826096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:08.827383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.845089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:08.845943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.846224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.846501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] PATH_INFO: `/v3/projects/4bace01d233945a1b8d903080ab2a251` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.847724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bace01d233945a1b8d903080ab2a251)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:08.850342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:08.894014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bbdf5-c28d-4aa1-875e-7d3aa7c970ea admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:08.895938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bace01d233945a1b8d903080ab2a251', 'request_id': 'req-7f6b7903-698a-48b0-b767-e972eab122d2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.903476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bace01d233945a1b8d903080ab2a251', 'request_id': 'req-7f6b7903-698a-48b0-b767-e972eab122d2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.908830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bace01d233945a1b8d903080ab2a251', 'request_id': 'req-7f6b7903-698a-48b0-b767-e972eab122d2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.920720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] The token cache is being invalidate because project 4bace01d233945a1b8d903080ab2a251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:08.921010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.921646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:08.923173 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 879/1726] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:08 2022] DELETE /identity/v3/projects/4bace01d233945a1b8d903080ab2a251 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:08.923954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:08.925245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:08.950844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:08.951705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.952011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.952284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] PATH_INFO: `/v3/users/37b87fd468ba40618511a5459715a0d7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:08.953478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b87fd468ba40618511a5459715a0d7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:08.955770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:08.992327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b7903-698a-48b0-b767-e972eab122d2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:08.997509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:08.998326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:08.998598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:08.998871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] PATH_INFO: `/v3/users/a9ccad64afc44366a9db10b9ab9e72eb` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.000078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ccad64afc44366a9db10b9ab9e72eb)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.001515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b87fd468ba40618511a5459715a0d7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.002002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.009519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b87fd468ba40618511a5459715a0d7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.010249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b87fd468ba40618511a5459715a0d7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.010892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b87fd468ba40618511a5459715a0d7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.023462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-61a1c528-b08d-4581-b869-42f568d2400f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b87fd468ba40618511a5459715a0d7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.036126 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 848/1727] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:08 2022] DELETE /identity/v3/users/37b87fd468ba40618511a5459715a0d7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:09.038339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca03c7-443f-4582-ac36-141724100464 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.038662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca03c7-443f-4582-ac36-141724100464 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.038977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca03c7-443f-4582-ac36-141724100464 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.040729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 849/1728] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:09.046580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca03c7-443f-4582-ac36-141724100464 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.048555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7aca03c7-443f-4582-ac36-141724100464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.054414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ccad64afc44366a9db10b9ab9e72eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.061302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ccad64afc44366a9db10b9ab9e72eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.062000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ccad64afc44366a9db10b9ab9e72eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.062624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ccad64afc44366a9db10b9ab9e72eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.071528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ccad64afc44366a9db10b9ab9e72eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.091092 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 880/1729] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:08 2022] DELETE /identity/v3/users/a9ccad64afc44366a9db10b9ab9e72eb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:09.092291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.093891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.110970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca03c7-443f-4582-ac36-141724100464 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.161385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f2209-4f33-4973-a086-d930eac0f90b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.164070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd616b-0d0a-4766-9e3b-7dd84c0f3983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.164751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd616b-0d0a-4766-9e3b-7dd84c0f3983 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.165035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd616b-0d0a-4766-9e3b-7dd84c0f3983 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.165312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd616b-0d0a-4766-9e3b-7dd84c0f3983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.167273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c53aa-2999-462e-ba23-6d06918b81ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.167569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-61fd616b-0d0a-4766-9e3b-7dd84c0f3983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.168363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c53aa-2999-462e-ba23-6d06918b81ff admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.168723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c53aa-2999-462e-ba23-6d06918b81ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.169062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c53aa-2999-462e-ba23-6d06918b81ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.169851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c53aa-2999-462e-ba23-6d06918b81ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.171572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c53aa-2999-462e-ba23-6d06918b81ff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.181299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd616b-0d0a-4766-9e3b-7dd84c0f3983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.182796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd616b-0d0a-4766-9e3b-7dd84c0f3983 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.184316 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 881/1730] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:09.184316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c53aa-2999-462e-ba23-6d06918b81ff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.188574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ad7c53aa-2999-462e-ba23-6d06918b81ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.205428 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 850/1731] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:09.210961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb9b43-c849-47af-8793-95a9ad07e504 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.211258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb9b43-c849-47af-8793-95a9ad07e504 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.211596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb9b43-c849-47af-8793-95a9ad07e504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.232957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-03eb9b43-c849-47af-8793-95a9ad07e504 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:09.234558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-03eb9b43-c849-47af-8793-95a9ad07e504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.247484 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 851/1732] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:09.250495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649029-0537-46fd-9365-538a6a76e299 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.250740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649029-0537-46fd-9365-538a6a76e299 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.251024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e649029-0537-46fd-9365-538a6a76e299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.283007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8e649029-0537-46fd-9365-538a6a76e299 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:09.283410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c53aa-2999-462e-ba23-6d06918b81ff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.285321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e649029-0537-46fd-9365-538a6a76e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.291399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ac217-d721-44f9-a292-7feabde1a259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.292095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ac217-d721-44f9-a292-7feabde1a259 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.292387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ac217-d721-44f9-a292-7feabde1a259 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.292789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ac217-d721-44f9-a292-7feabde1a259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.294681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cc4ac217-d721-44f9-a292-7feabde1a259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.296417 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 852/1733] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:09.303032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20168-153a-4a5d-93dc-3e9de947055d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.303032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20168-153a-4a5d-93dc-3e9de947055d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.303032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db20168-153a-4a5d-93dc-3e9de947055d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.323695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2db20168-153a-4a5d-93dc-3e9de947055d None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:09.325259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2db20168-153a-4a5d-93dc-3e9de947055d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.342393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 853/1734] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:09.351819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152b41-3108-4036-8322-b31f62d76a89 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.352525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152b41-3108-4036-8322-b31f62d76a89 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.356208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae152b41-3108-4036-8322-b31f62d76a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.377673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ac217-d721-44f9-a292-7feabde1a259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.379172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4ac217-d721-44f9-a292-7feabde1a259 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.386467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ae152b41-3108-4036-8322-b31f62d76a89 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:09.387840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ae152b41-3108-4036-8322-b31f62d76a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.398314 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 882/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:09.399029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ac217-d721-44f9-a292-7feabde1a259 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.409346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ac217-d721-44f9-a292-7feabde1a259 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.410448 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 854/1736] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:09.414318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1991c4d-6b8b-4d8c-a547-3668a667324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.414972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1991c4d-6b8b-4d8c-a547-3668a667324c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.415267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1991c4d-6b8b-4d8c-a547-3668a667324c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.415533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1991c4d-6b8b-4d8c-a547-3668a667324c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.417344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1991c4d-6b8b-4d8c-a547-3668a667324c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.419167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1991c4d-6b8b-4d8c-a547-3668a667324c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.427422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925019e0-ed6a-4154-8ad6-3ced83c6c43c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.428230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925019e0-ed6a-4154-8ad6-3ced83c6c43c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.428874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925019e0-ed6a-4154-8ad6-3ced83c6c43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.434728 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 883/1737] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:09.436250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ea813-d6d6-4563-b6c1-80ed3f4a925b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.436548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ea813-d6d6-4563-b6c1-80ed3f4a925b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.436830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ea813-d6d6-4563-b6c1-80ed3f4a925b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.466048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-829ea813-d6d6-4563-b6c1-80ed3f4a925b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:09.467438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-829ea813-d6d6-4563-b6c1-80ed3f4a925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.468587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-925019e0-ed6a-4154-8ad6-3ced83c6c43c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:09.469937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-925019e0-ed6a-4154-8ad6-3ced83c6c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.480634 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 884/1738] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:09.480956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ea813-d6d6-4563-b6c1-80ed3f4a925b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.484003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-829ea813-d6d6-4563-b6c1-80ed3f4a925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.488701 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 855/1739] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:09.489441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925019e0-ed6a-4154-8ad6-3ced83c6c43c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.491542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-925019e0-ed6a-4154-8ad6-3ced83c6c43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.496479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ea813-d6d6-4563-b6c1-80ed3f4a925b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.501761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.502366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.502897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.503001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] PATH_INFO: `/v3/projects/05e78eaca25f4f9bbbd0bf215af9e315` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.504459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e78eaca25f4f9bbbd0bf215af9e315)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.506841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.561167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e78eaca25f4f9bbbd0bf215af9e315', 'request_id': 'req-e2921b31-ac24-41c0-8fe9-0eb3d9264959'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.569242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e78eaca25f4f9bbbd0bf215af9e315', 'request_id': 'req-e2921b31-ac24-41c0-8fe9-0eb3d9264959'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.570175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925019e0-ed6a-4154-8ad6-3ced83c6c43c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.574691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e78eaca25f4f9bbbd0bf215af9e315', 'request_id': 'req-e2921b31-ac24-41c0-8fe9-0eb3d9264959'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.586399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] The token cache is being invalidate because project 05e78eaca25f4f9bbbd0bf215af9e315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:09.586707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.587584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.589194 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 885/1740] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:09 2022] DELETE /identity/v3/projects/05e78eaca25f4f9bbbd0bf215af9e315 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:09.590270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.591632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.618034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.618801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.619090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.619366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.621159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.647787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2921b31-ac24-41c0-8fe9-0eb3d9264959 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.651504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.652170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.652451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.652723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.654511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.689003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.690463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.701772 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 856/1741] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:09.702548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.704101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.717066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.718725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.729160 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 886/1742] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:09.729840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.731338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.743956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19851ad0-e338-4010-8061-1efadcdd8ba9 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.748705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc9056-d03e-41c7-8c77-8ad73c3fcd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.749418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc9056-d03e-41c7-8c77-8ad73c3fcd3a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.749705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc9056-d03e-41c7-8c77-8ad73c3fcd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.749982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc9056-d03e-41c7-8c77-8ad73c3fcd3a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.750699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc9056-d03e-41c7-8c77-8ad73c3fcd3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:09.751003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc9056-d03e-41c7-8c77-8ad73c3fcd3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.752720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc9056-d03e-41c7-8c77-8ad73c3fcd3a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.766380 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 887/1743] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:09.768449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8c1ab-27cb-40bd-b09c-c4ae3a4ca001 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.768749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8c1ab-27cb-40bd-b09c-c4ae3a4ca001 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.769028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8c1ab-27cb-40bd-b09c-c4ae3a4ca001 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.776475 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 888/1744] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:09.777357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8c1ab-27cb-40bd-b09c-c4ae3a4ca001 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.780478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7dd8c1ab-27cb-40bd-b09c-c4ae3a4ca001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.783706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e65c-ca27-4b34-9e6f-3ebf40779db6 service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.788878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb333c1-670c-43a6-8b02-a4f2967a1e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.789844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb333c1-670c-43a6-8b02-a4f2967a1e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.790233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb333c1-670c-43a6-8b02-a4f2967a1e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.790558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb333c1-670c-43a6-8b02-a4f2967a1e44 admin admin] PATH_INFO: `/v3/projects/8f6a99a746504f6c861ee0aefccf29af/users/1dec9141ca4440a0be105a729e7a0edc/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.800219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8c1ab-27cb-40bd-b09c-c4ae3a4ca001 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.806631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.807432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.807756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.808124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.808957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:09.809265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.810885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.811852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb333c1-670c-43a6-8b02-a4f2967a1e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6a99a746504f6c861ee0aefccf29af, user_id=1dec9141ca4440a0be105a729e7a0edc, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.814942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb333c1-670c-43a6-8b02-a4f2967a1e44 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.825315 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 889/1745] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:09.826465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.829029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.842098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45599b-b69f-495f-a04b-379e4d5bc3a8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.843643 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 857/1746] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:09 2022] PUT /identity/v3/projects/8f6a99a746504f6c861ee0aefccf29af/users/1dec9141ca4440a0be105a729e7a0edc/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:09.850776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca48665-f49f-48ef-a67f-5b0a22d5a94f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.851137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca48665-f49f-48ef-a67f-5b0a22d5a94f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.851982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca48665-f49f-48ef-a67f-5b0a22d5a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.884988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bca48665-f49f-48ef-a67f-5b0a22d5a94f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:09.886306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bca48665-f49f-48ef-a67f-5b0a22d5a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:09.905576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:09.907383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:09.908236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:09.908844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] PATH_INFO: `/v3/projects/ac4fcbd8371642739c433d9d2bd24692` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:09.910662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4fcbd8371642739c433d9d2bd24692)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:09.914672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:09.956652 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 858/1747] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:09.962314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca48665-f49f-48ef-a67f-5b0a22d5a94f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:09.974223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca48665-f49f-48ef-a67f-5b0a22d5a94f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:09.982341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4fcbd8371642739c433d9d2bd24692', 'request_id': 'req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:09.994752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4fcbd8371642739c433d9d2bd24692', 'request_id': 'req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.003409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4fcbd8371642739c433d9d2bd24692', 'request_id': 'req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.035185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] The token cache is being invalidate because project ac4fcbd8371642739c433d9d2bd24692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:10.035565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.036339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f14459f8-4aa8-494f-b2be-971c0ea3ac8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.039276 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 890/1748] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:09 2022] DELETE /identity/v3/projects/ac4fcbd8371642739c433d9d2bd24692 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:10.040755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbadef8-131b-4ef6-85a5-da5fc68a2bed None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.041109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbadef8-131b-4ef6-85a5-da5fc68a2bed None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.041957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbadef8-131b-4ef6-85a5-da5fc68a2bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.062118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0764e-d79b-40b4-8adc-c267039f1ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.062795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0764e-d79b-40b4-8adc-c267039f1ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.063090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0764e-d79b-40b4-8adc-c267039f1ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.063360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0764e-d79b-40b4-8adc-c267039f1ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.064093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0764e-d79b-40b4-8adc-c267039f1ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.066076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a0764e-d79b-40b4-8adc-c267039f1ff0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.073840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bfbadef8-131b-4ef6-85a5-da5fc68a2bed None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:10.075067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bfbadef8-131b-4ef6-85a5-da5fc68a2bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.095792 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 859/1749] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:09 2022] POST /identity/v3/projects => generated 393 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:10.095792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0764e-d79b-40b4-8adc-c267039f1ff0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.100462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-28a0764e-d79b-40b4-8adc-c267039f1ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.180051 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 891/1750] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:10.181740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2d83-d4a4-4eb0-bce0-fb5789c98c88 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.182150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2d83-d4a4-4eb0-bce0-fb5789c98c88 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.182495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a2d83-d4a4-4eb0-bce0-fb5789c98c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.205652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0764e-d79b-40b4-8adc-c267039f1ff0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.210753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f15a2d83-d4a4-4eb0-bce0-fb5789c98c88 None None] MFA Rules not processed for user `1dec9141ca4440a0be105a729e7a0edc`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:10.212036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f15a2d83-d4a4-4eb0-bce0-fb5789c98c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.214621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac4362-90dc-48b7-b267-159512036c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.215594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4362-90dc-48b7-b267-159512036c6a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.216637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4362-90dc-48b7-b267-159512036c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.216924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac4362-90dc-48b7-b267-159512036c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.217766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac4362-90dc-48b7-b267-159512036c6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.220404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac4362-90dc-48b7-b267-159512036c6a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.252081 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 860/1751] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:10 2022] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:10.253744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aaed2-6086-4d15-b0c3-9b456ea41b59 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.254057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aaed2-6086-4d15-b0c3-9b456ea41b59 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.254456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aaed2-6086-4d15-b0c3-9b456ea41b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.273892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ad0aaed2-6086-4d15-b0c3-9b456ea41b59 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:10.275225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ad0aaed2-6086-4d15-b0c3-9b456ea41b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.320453 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 892/1752] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:10.324036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2d83-d4a4-4eb0-bce0-fb5789c98c88 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.325611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f15a2d83-d4a4-4eb0-bce0-fb5789c98c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.341230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a2d83-d4a4-4eb0-bce0-fb5789c98c88 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.359907 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 861/1753] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:10.364653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aaed2-6086-4d15-b0c3-9b456ea41b59 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.366482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ad0aaed2-6086-4d15-b0c3-9b456ea41b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.378550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aaed2-6086-4d15-b0c3-9b456ea41b59 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.383279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477d5fd-a354-4868-8d4a-f51740fa8707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.383957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477d5fd-a354-4868-8d4a-f51740fa8707 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.384253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477d5fd-a354-4868-8d4a-f51740fa8707 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.384532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477d5fd-a354-4868-8d4a-f51740fa8707 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.385223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477d5fd-a354-4868-8d4a-f51740fa8707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.387158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477d5fd-a354-4868-8d4a-f51740fa8707 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.399724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.400629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.400910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.401183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] PATH_INFO: `/v3/users/e8729c10afe047fdb253b6f24de46604` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.402384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8729c10afe047fdb253b6f24de46604)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.404368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.411110 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 862/1754] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:10 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:10.411110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477d5fd-a354-4868-8d4a-f51740fa8707 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.411110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4477d5fd-a354-4868-8d4a-f51740fa8707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.423429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477d5fd-a354-4868-8d4a-f51740fa8707 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.428394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.429508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.429857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.430243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] PATH_INFO: `/v3/projects/5d8ced74926049d1be9a6f37774c25d7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.431651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8ced74926049d1be9a6f37774c25d7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.433737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.449976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8729c10afe047fdb253b6f24de46604'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.457067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8729c10afe047fdb253b6f24de46604'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.457932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8729c10afe047fdb253b6f24de46604'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.458585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8729c10afe047fdb253b6f24de46604'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.466841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8729c10afe047fdb253b6f24de46604'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.482495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8ced74926049d1be9a6f37774c25d7', 'request_id': 'req-119caaa4-3c24-4759-adec-05d14afd9408'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.484449 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 893/1755] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:10 2022] DELETE /identity/v3/users/e8729c10afe047fdb253b6f24de46604 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:10.485246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.487288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.493591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8ced74926049d1be9a6f37774c25d7', 'request_id': 'req-119caaa4-3c24-4759-adec-05d14afd9408'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.501959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8ced74926049d1be9a6f37774c25d7', 'request_id': 'req-119caaa4-3c24-4759-adec-05d14afd9408'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.515519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] The token cache is being invalidate because project 5d8ced74926049d1be9a6f37774c25d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:10.515766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.516568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:10.518253 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 863/1756] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:10 2022] DELETE /identity/v3/projects/5d8ced74926049d1be9a6f37774c25d7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:10.519053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.520420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.560964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7283a-6074-4134-9c95-532deb896400 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.565292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.566077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.566355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.566714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.569080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.601275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119caaa4-3c24-4759-adec-05d14afd9408 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.652315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.653747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.665553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00886447-e7ce-44a5-af82-268de8ff8724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.666308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00886447-e7ce-44a5-af82-268de8ff8724 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.666666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00886447-e7ce-44a5-af82-268de8ff8724 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.667015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00886447-e7ce-44a5-af82-268de8ff8724 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.667204 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 894/1757] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:10.668121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.668514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00886447-e7ce-44a5-af82-268de8ff8724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.670835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00886447-e7ce-44a5-af82-268de8ff8724 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.672168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.687767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a458bc-ee94-4bea-af99-7cf12ef89bda service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.697454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d5847-e02a-4e84-a0c9-3b42f76309de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.697610 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 864/1758] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:10 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:10.698414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00886447-e7ce-44a5-af82-268de8ff8724 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.698662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d5847-e02a-4e84-a0c9-3b42f76309de admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.700315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d5847-e02a-4e84-a0c9-3b42f76309de admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.700453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-00886447-e7ce-44a5-af82-268de8ff8724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.701002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d5847-e02a-4e84-a0c9-3b42f76309de admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.701840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d5847-e02a-4e84-a0c9-3b42f76309de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.704599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d5847-e02a-4e84-a0c9-3b42f76309de admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.741781 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 895/1759] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:10 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:10.741781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d5847-e02a-4e84-a0c9-3b42f76309de admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.743416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f60d5847-e02a-4e84-a0c9-3b42f76309de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.794551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00886447-e7ce-44a5-af82-268de8ff8724 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.838647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d5847-e02a-4e84-a0c9-3b42f76309de admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.845296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.845957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.846244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.846576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.847455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:10.847767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.849671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.864087 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 896/1760] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:10.864087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.867588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.871497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.872274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.872670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.872821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.874668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.880542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c74e4-f06d-49a5-9c44-004254761e80 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.885771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8c396-b16b-4dbf-be7c-d77c2bc88f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.886860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c396-b16b-4dbf-be7c-d77c2bc88f23 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.886860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c396-b16b-4dbf-be7c-d77c2bc88f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.887071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8c396-b16b-4dbf-be7c-d77c2bc88f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.887155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.887751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8c396-b16b-4dbf-be7c-d77c2bc88f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.888748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.889405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8c396-b16b-4dbf-be7c-d77c2bc88f23 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.899903 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 865/1761] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:10.900920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.901594 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 897/1762] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:10.902444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8c396-b16b-4dbf-be7c-d77c2bc88f23 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.902947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:10.915557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8c396-b16b-4dbf-be7c-d77c2bc88f23 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.919732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef9ed0-4aa2-4e84-8a28-97c174f306e2 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.921119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c83c3-3cf5-4d94-b712-d4258d334a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.921733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c83c3-3cf5-4d94-b712-d4258d334a55 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.922020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c83c3-3cf5-4d94-b712-d4258d334a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.922298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c83c3-3cf5-4d94-b712-d4258d334a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.923031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c83c3-3cf5-4d94-b712-d4258d334a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.924656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c83c3-3cf5-4d94-b712-d4258d334a55 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.927315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.929096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.929589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.930066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] PATH_INFO: `/v3/users/dc630bbeca714703b58a689bd64a5356` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.932463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc630bbeca714703b58a689bd64a5356)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.934909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.938148 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 898/1763] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:10.939151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c83c3-3cf5-4d94-b712-d4258d334a55 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.956605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c83c3-3cf5-4d94-b712-d4258d334a55 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:10.964180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a81ca-c4bc-4d3c-aa2a-8a0e0bc0386b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:10.964970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a81ca-c4bc-4d3c-aa2a-8a0e0bc0386b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:10.965413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a81ca-c4bc-4d3c-aa2a-8a0e0bc0386b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:10.965816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a81ca-c4bc-4d3c-aa2a-8a0e0bc0386b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:10.966859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a81ca-c4bc-4d3c-aa2a-8a0e0bc0386b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:10.969464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a81ca-c4bc-4d3c-aa2a-8a0e0bc0386b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:10.993499 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 899/1764] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:10 2022] POST /identity/v3/users => generated 297 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:10.994431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a81ca-c4bc-4d3c-aa2a-8a0e0bc0386b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:10.997640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-734a81ca-c4bc-4d3c-aa2a-8a0e0bc0386b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:11.001814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc630bbeca714703b58a689bd64a5356'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.012130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc630bbeca714703b58a689bd64a5356'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.013108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc630bbeca714703b58a689bd64a5356'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.013971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc630bbeca714703b58a689bd64a5356'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.020970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a81ca-c4bc-4d3c-aa2a-8a0e0bc0386b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.028413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.029904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.030401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.030894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc630bbeca714703b58a689bd64a5356'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.031081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] PATH_INFO: `/v3/projects/f553d705e9094d75aba04f42f75da578` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.032531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f553d705e9094d75aba04f42f75da578)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.034846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.046142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 866/1765] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:10 2022] DELETE /identity/v3/users/dc630bbeca714703b58a689bd64a5356 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:11.050260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:11.051968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:11.105898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f553d705e9094d75aba04f42f75da578', 'request_id': 'req-64be44bb-5ce3-47e1-837d-1d26362b3267'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.117824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f553d705e9094d75aba04f42f75da578', 'request_id': 'req-64be44bb-5ce3-47e1-837d-1d26362b3267'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.128130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f553d705e9094d75aba04f42f75da578', 'request_id': 'req-64be44bb-5ce3-47e1-837d-1d26362b3267'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.139144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd90844-7c71-46a1-b17c-eb7f331054a6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.144439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] The token cache is being invalidate because project f553d705e9094d75aba04f42f75da578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:11.144874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.147112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:11.152972 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 900/1766] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:10 2022] DELETE /identity/v3/projects/f553d705e9094d75aba04f42f75da578 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:11.154730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:11.157376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:11.228493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085fb81-7beb-4665-a2cf-04cc26983503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.229682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085fb81-7beb-4665-a2cf-04cc26983503 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.230021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085fb81-7beb-4665-a2cf-04cc26983503 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.230309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085fb81-7beb-4665-a2cf-04cc26983503 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.231193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085fb81-7beb-4665-a2cf-04cc26983503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.233354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085fb81-7beb-4665-a2cf-04cc26983503 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.255399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be44bb-5ce3-47e1-837d-1d26362b3267 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.262416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a045d-c8fc-4dbd-b5e1-e293222ab204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.263367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a045d-c8fc-4dbd-b5e1-e293222ab204 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.263736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a045d-c8fc-4dbd-b5e1-e293222ab204 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.264377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a045d-c8fc-4dbd-b5e1-e293222ab204 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.265721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a045d-c8fc-4dbd-b5e1-e293222ab204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.267830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a045d-c8fc-4dbd-b5e1-e293222ab204 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.281655 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 867/1767] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:11 2022] POST /identity/v3/projects => generated 399 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:11.281655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085fb81-7beb-4665-a2cf-04cc26983503 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:11.281871 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 901/1768] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:11.282641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a045d-c8fc-4dbd-b5e1-e293222ab204 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:11.285265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6085fb81-7beb-4665-a2cf-04cc26983503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:11.296802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cb4a045d-c8fc-4dbd-b5e1-e293222ab204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:11.324734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a045d-c8fc-4dbd-b5e1-e293222ab204 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.444241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085fb81-7beb-4665-a2cf-04cc26983503 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.449975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3935-ce63-4c73-8676-844f955ea786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.450661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3935-ce63-4c73-8676-844f955ea786 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.451032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3935-ce63-4c73-8676-844f955ea786 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.451299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3935-ce63-4c73-8676-844f955ea786 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.452907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd3935-ce63-4c73-8676-844f955ea786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.455262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd3935-ce63-4c73-8676-844f955ea786 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.468720 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 868/1769] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:11.470104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff230cc-ab8f-457d-bec7-cb5cac5872e5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.470399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff230cc-ab8f-457d-bec7-cb5cac5872e5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.470680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff230cc-ab8f-457d-bec7-cb5cac5872e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.490725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8ff230cc-ab8f-457d-bec7-cb5cac5872e5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:11.492573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8ff230cc-ab8f-457d-bec7-cb5cac5872e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:11.493159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af9552-16e2-4a4a-be41-b63ef2c846a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.494187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9552-16e2-4a4a-be41-b63ef2c846a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.494999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9552-16e2-4a4a-be41-b63ef2c846a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.495420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af9552-16e2-4a4a-be41-b63ef2c846a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.496404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af9552-16e2-4a4a-be41-b63ef2c846a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.498449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af9552-16e2-4a4a-be41-b63ef2c846a8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.508469 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 869/1770] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:11.509540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff230cc-ab8f-457d-bec7-cb5cac5872e5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:11.510955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8ff230cc-ab8f-457d-bec7-cb5cac5872e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:11.512887 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 902/1771] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:11.514088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af9552-16e2-4a4a-be41-b63ef2c846a8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:11.526661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af9552-16e2-4a4a-be41-b63ef2c846a8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.527221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff230cc-ab8f-457d-bec7-cb5cac5872e5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.532343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ed345-48de-4fe1-b2f0-75da72c0dbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.533096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19541266-43d9-4a85-a885-ab061f00e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.533750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ed345-48de-4fe1-b2f0-75da72c0dbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.533864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19541266-43d9-4a85-a885-ab061f00e162 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.534041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19541266-43d9-4a85-a885-ab061f00e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.534331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19541266-43d9-4a85-a885-ab061f00e162 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.534599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ed345-48de-4fe1-b2f0-75da72c0dbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.535029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19541266-43d9-4a85-a885-ab061f00e162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.535281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ed345-48de-4fe1-b2f0-75da72c0dbd4 admin admin] PATH_INFO: `/v3/projects/9a452cecead647e58b2f872632f76c74/users/0cd618873f1944858dba8333d5b25048/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.537059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19541266-43d9-4a85-a885-ab061f00e162 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.558438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ed345-48de-4fe1-b2f0-75da72c0dbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a452cecead647e58b2f872632f76c74, user_id=0cd618873f1944858dba8333d5b25048, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.561493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ed345-48de-4fe1-b2f0-75da72c0dbd4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.563980 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 870/1772] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:11 2022] POST /identity/v3/users => generated 300 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:11.565587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19541266-43d9-4a85-a885-ab061f00e162 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:11.580949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 903/1773] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:11 2022] PUT /identity/v3/projects/9a452cecead647e58b2f872632f76c74/users/0cd618873f1944858dba8333d5b25048/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:11.582403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397ad9-b3b4-4f45-b7f5-e8ce6fe2e706 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.582837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397ad9-b3b4-4f45-b7f5-e8ce6fe2e706 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.583263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46397ad9-b3b4-4f45-b7f5-e8ce6fe2e706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.589788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19541266-43d9-4a85-a885-ab061f00e162 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.638344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-46397ad9-b3b4-4f45-b7f5-e8ce6fe2e706 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:11.640105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-46397ad9-b3b4-4f45-b7f5-e8ce6fe2e706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:11.685049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5bdb1-510f-4734-b932-9ff9516a7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.686246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5bdb1-510f-4734-b932-9ff9516a7bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.686839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5bdb1-510f-4734-b932-9ff9516a7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.687474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5bdb1-510f-4734-b932-9ff9516a7bd8 admin admin] PATH_INFO: `/v3/projects/f82ec89b09b84613a8e28fecf28e9f47/users/b3dca0dea5324c049251a4728b090e77/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.710748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5bdb1-510f-4734-b932-9ff9516a7bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82ec89b09b84613a8e28fecf28e9f47, user_id=b3dca0dea5324c049251a4728b090e77, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.714365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5bdb1-510f-4734-b932-9ff9516a7bd8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.735996 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 871/1774] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:11 2022] PUT /identity/v3/projects/f82ec89b09b84613a8e28fecf28e9f47/users/b3dca0dea5324c049251a4728b090e77/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:11.737119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5bdb1-510f-4734-b932-9ff9516a7bd8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:11.753951 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 904/1775] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:11.753951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397ad9-b3b4-4f45-b7f5-e8ce6fe2e706 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:11.775116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46397ad9-b3b4-4f45-b7f5-e8ce6fe2e706 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.841977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5bdb1-510f-4734-b932-9ff9516a7bd8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:11.848368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dbcfbd-b69d-4978-a3fb-9ea164cf3120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.849503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbcfbd-b69d-4978-a3fb-9ea164cf3120 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.849986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbcfbd-b69d-4978-a3fb-9ea164cf3120 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.850758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dbcfbd-b69d-4978-a3fb-9ea164cf3120 admin admin] PATH_INFO: `/v3/projects/87905e05ff4447858ea65069d73987ee/users/f355bdb93d0a4d9d9e22468f81d6148f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.868328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b926aa1-009d-46da-8fc9-324ab31c4cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:11.869375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b926aa1-009d-46da-8fc9-324ab31c4cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.869742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b926aa1-009d-46da-8fc9-324ab31c4cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.870169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b926aa1-009d-46da-8fc9-324ab31c4cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.871412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b926aa1-009d-46da-8fc9-324ab31c4cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.875958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b926aa1-009d-46da-8fc9-324ab31c4cd9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.883723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbcfbd-b69d-4978-a3fb-9ea164cf3120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87905e05ff4447858ea65069d73987ee, user_id=f355bdb93d0a4d9d9e22468f81d6148f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:11.886751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dbcfbd-b69d-4978-a3fb-9ea164cf3120 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:11.892865 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 905/1776] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:11.896667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669371-8294-4fa8-b30e-6ab378fe9fd5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.897139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669371-8294-4fa8-b30e-6ab378fe9fd5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.897574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06669371-8294-4fa8-b30e-6ab378fe9fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.915457 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 872/1777] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:11 2022] PUT /identity/v3/projects/87905e05ff4447858ea65069d73987ee/users/f355bdb93d0a4d9d9e22468f81d6148f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:11.917185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eff23-4244-40be-a4d2-22bc0706927e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:11.917697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eff23-4244-40be-a4d2-22bc0706927e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:11.918432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eff23-4244-40be-a4d2-22bc0706927e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:11.928254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-06669371-8294-4fa8-b30e-6ab378fe9fd5 None None] MFA Rules not processed for user `0cd618873f1944858dba8333d5b25048`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:11.929780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-06669371-8294-4fa8-b30e-6ab378fe9fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:11.958628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a75eff23-4244-40be-a4d2-22bc0706927e None None] MFA Rules not processed for user `b3dca0dea5324c049251a4728b090e77`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:11.960438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a75eff23-4244-40be-a4d2-22bc0706927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.022623 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 906/1778] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:12.023729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669371-8294-4fa8-b30e-6ab378fe9fd5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.074318 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 873/1779] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:12.078380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eff23-4244-40be-a4d2-22bc0706927e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.078380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a75eff23-4244-40be-a4d2-22bc0706927e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.121154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06669371-8294-4fa8-b30e-6ab378fe9fd5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.125875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e0aa-2b3d-4996-92b5-b10ee6f4c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.126543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e0aa-2b3d-4996-92b5-b10ee6f4c0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.126819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e0aa-2b3d-4996-92b5-b10ee6f4c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.127233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6e0aa-2b3d-4996-92b5-b10ee6f4c0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.128056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6e0aa-2b3d-4996-92b5-b10ee6f4c0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:12.128367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6e0aa-2b3d-4996-92b5-b10ee6f4c0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.129985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6e0aa-2b3d-4996-92b5-b10ee6f4c0d9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.146854 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 907/1780] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:12.148359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e0aa-2b3d-4996-92b5-b10ee6f4c0d9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.159633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6e0aa-2b3d-4996-92b5-b10ee6f4c0d9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.165970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ad595-91d1-4bcd-a4c3-74ab4fc10309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.166729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ad595-91d1-4bcd-a4c3-74ab4fc10309 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.167158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ad595-91d1-4bcd-a4c3-74ab4fc10309 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.167457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ad595-91d1-4bcd-a4c3-74ab4fc10309 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.172489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ad595-91d1-4bcd-a4c3-74ab4fc10309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.172489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ad595-91d1-4bcd-a4c3-74ab4fc10309 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.184124 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 908/1781] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:12.185635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ad595-91d1-4bcd-a4c3-74ab4fc10309 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.194665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eff23-4244-40be-a4d2-22bc0706927e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.204637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.206091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.206542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.207325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] PATH_INFO: `/v3/projects/bcdf204a282945d5b5f78786837cc6a5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.209688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdf204a282945d5b5f78786837cc6a5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.210232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ad595-91d1-4bcd-a4c3-74ab4fc10309 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.212611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.215528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111ec6-81ff-4c97-b221-1dcd5ab28e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.216500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111ec6-81ff-4c97-b221-1dcd5ab28e5c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.216695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111ec6-81ff-4c97-b221-1dcd5ab28e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.216976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c111ec6-81ff-4c97-b221-1dcd5ab28e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.217701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111ec6-81ff-4c97-b221-1dcd5ab28e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.219577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c111ec6-81ff-4c97-b221-1dcd5ab28e5c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.234120 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 909/1782] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:12.234120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111ec6-81ff-4c97-b221-1dcd5ab28e5c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.246743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c111ec6-81ff-4c97-b221-1dcd5ab28e5c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.251983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd280ac-81a6-4467-a7d9-acda30e53734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.252658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd280ac-81a6-4467-a7d9-acda30e53734 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.252926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd280ac-81a6-4467-a7d9-acda30e53734 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.253194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd280ac-81a6-4467-a7d9-acda30e53734 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.253878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd280ac-81a6-4467-a7d9-acda30e53734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.256291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd280ac-81a6-4467-a7d9-acda30e53734 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.275995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdf204a282945d5b5f78786837cc6a5', 'request_id': 'req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:12.285685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdf204a282945d5b5f78786837cc6a5', 'request_id': 'req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:12.294019 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 910/1783] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:12.294019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd280ac-81a6-4467-a7d9-acda30e53734 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.294321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdf204a282945d5b5f78786837cc6a5', 'request_id': 'req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:12.306529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] The token cache is being invalidate because project bcdf204a282945d5b5f78786837cc6a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:12.306913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:12.308182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:12.310045 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 874/1784] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:12 2022] DELETE /identity/v3/projects/bcdf204a282945d5b5f78786837cc6a5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:12.310620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.312020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.381609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd280ac-81a6-4467-a7d9-acda30e53734 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.391285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a5b4c-f820-4fdb-b3df-6e24a47cd0b8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.398175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c514f-bfd7-4773-abd8-efb600aaddec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.398550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8547f7-4ed3-491b-8e22-634e42d8f9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.399227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8547f7-4ed3-491b-8e22-634e42d8f9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.399513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8547f7-4ed3-491b-8e22-634e42d8f9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.399790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8547f7-4ed3-491b-8e22-634e42d8f9a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.400158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c514f-bfd7-4773-abd8-efb600aaddec admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.400458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c514f-bfd7-4773-abd8-efb600aaddec admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.400572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8547f7-4ed3-491b-8e22-634e42d8f9a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.400943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c514f-bfd7-4773-abd8-efb600aaddec admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.401758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c514f-bfd7-4773-abd8-efb600aaddec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.402567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8547f7-4ed3-491b-8e22-634e42d8f9a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.404337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c514f-bfd7-4773-abd8-efb600aaddec admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.440587 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 911/1785] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:12.441718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8547f7-4ed3-491b-8e22-634e42d8f9a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.446327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8f8547f7-4ed3-491b-8e22-634e42d8f9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.460840 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 875/1786] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/projects => generated 395 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:12.461944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c514f-bfd7-4773-abd8-efb600aaddec admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.470529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c00c514f-bfd7-4773-abd8-efb600aaddec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.556704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8547f7-4ed3-491b-8e22-634e42d8f9a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.587568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c514f-bfd7-4773-abd8-efb600aaddec admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.595325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d47a3c-64ec-4f60-b360-b12335a0af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.596421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d47a3c-64ec-4f60-b360-b12335a0af37 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.596806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d47a3c-64ec-4f60-b360-b12335a0af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.597154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d47a3c-64ec-4f60-b360-b12335a0af37 admin admin] PATH_INFO: `/v3/projects/87905e05ff4447858ea65069d73987ee/users/f355bdb93d0a4d9d9e22468f81d6148f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.599277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d47a3c-64ec-4f60-b360-b12335a0af37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87905e05ff4447858ea65069d73987ee, user_id=f355bdb93d0a4d9d9e22468f81d6148f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.602118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d47a3c-64ec-4f60-b360-b12335a0af37 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.616313 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 876/1787] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:12 2022] PUT /identity/v3/projects/87905e05ff4447858ea65069d73987ee/users/f355bdb93d0a4d9d9e22468f81d6148f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:12.617354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d47a3c-64ec-4f60-b360-b12335a0af37 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.619136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e3d47a3c-64ec-4f60-b360-b12335a0af37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.639449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f714ad3-9f62-4682-b4df-563a38676fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.640383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f714ad3-9f62-4682-b4df-563a38676fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.640674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f714ad3-9f62-4682-b4df-563a38676fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.640953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f714ad3-9f62-4682-b4df-563a38676fb6 admin admin] PATH_INFO: `/v3/projects/f95ca6e8c53c4337b83f51f112c043d5/users/65fb1ca790104ee38cad504f86b54b03/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.656233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f714ad3-9f62-4682-b4df-563a38676fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95ca6e8c53c4337b83f51f112c043d5, user_id=65fb1ca790104ee38cad504f86b54b03, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.658955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f714ad3-9f62-4682-b4df-563a38676fb6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.674441 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 912/1788] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:12 2022] PUT /identity/v3/projects/f95ca6e8c53c4337b83f51f112c043d5/users/65fb1ca790104ee38cad504f86b54b03/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:12.678751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8c8f4-3cec-4d2b-9f5d-c76d84b9cb5b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.680143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8c8f4-3cec-4d2b-9f5d-c76d84b9cb5b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.680744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8c8f4-3cec-4d2b-9f5d-c76d84b9cb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.698038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d47a3c-64ec-4f60-b360-b12335a0af37 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.704887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-00c8c8f4-3cec-4d2b-9f5d-c76d84b9cb5b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:12.706136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-00c8c8f4-3cec-4d2b-9f5d-c76d84b9cb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.754014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ea71f-bf20-4174-839e-0c0a4c292594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.754692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ea71f-bf20-4174-839e-0c0a4c292594 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.754983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ea71f-bf20-4174-839e-0c0a4c292594 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.755257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ea71f-bf20-4174-839e-0c0a4c292594 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.756545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ea71f-bf20-4174-839e-0c0a4c292594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.758532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ea71f-bf20-4174-839e-0c0a4c292594 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.772116 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 913/1789] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:12.773026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8c8f4-3cec-4d2b-9f5d-c76d84b9cb5b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.774729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-00c8c8f4-3cec-4d2b-9f5d-c76d84b9cb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.787595 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 877/1790] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/users => generated 303 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:12.787851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8c8f4-3cec-4d2b-9f5d-c76d84b9cb5b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.792655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ea71f-bf20-4174-839e-0c0a4c292594 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:12.797256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca17fc-27c6-480d-b634-2fbb6405a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.797924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca17fc-27c6-480d-b634-2fbb6405a491 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.798205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca17fc-27c6-480d-b634-2fbb6405a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.798480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca17fc-27c6-480d-b634-2fbb6405a491 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.799187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca17fc-27c6-480d-b634-2fbb6405a491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.801381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca17fc-27c6-480d-b634-2fbb6405a491 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.805480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ea71f-bf20-4174-839e-0c0a4c292594 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:12.810288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ab0d-7ae0-4383-82e2-1e4459f80d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:12.810946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ab0d-7ae0-4383-82e2-1e4459f80d84 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.811230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ab0d-7ae0-4383-82e2-1e4459f80d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.811536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ab0d-7ae0-4383-82e2-1e4459f80d84 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.812262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73ab0d-7ae0-4383-82e2-1e4459f80d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:12.814348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73ab0d-7ae0-4383-82e2-1e4459f80d84 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:12.823768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 914/1791] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/users => generated 300 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:12.827908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13764005-4e78-4364-8df8-f4c3e2965142 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.828228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13764005-4e78-4364-8df8-f4c3e2965142 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.828845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13764005-4e78-4364-8df8-f4c3e2965142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.850034 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 878/1792] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/users => generated 298 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:12.850034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c2a64-84ec-4526-9d18-93938e272c0e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.850034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c2a64-84ec-4526-9d18-93938e272c0e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.850034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c2a64-84ec-4526-9d18-93938e272c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:12.863834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-13764005-4e78-4364-8df8-f4c3e2965142 None None] MFA Rules not processed for user `f355bdb93d0a4d9d9e22468f81d6148f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:12.865826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-13764005-4e78-4364-8df8-f4c3e2965142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.881668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-959c2a64-84ec-4526-9d18-93938e272c0e None None] MFA Rules not processed for user `65fb1ca790104ee38cad504f86b54b03`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:12.882934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-959c2a64-84ec-4526-9d18-93938e272c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:12.971287 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 879/1793] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:12.972880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d2546-07b7-418d-b13f-da95ab7b4b16 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:12.973233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d2546-07b7-418d-b13f-da95ab7b4b16 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:12.973520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d2546-07b7-418d-b13f-da95ab7b4b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.003395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-491d2546-07b7-418d-b13f-da95ab7b4b16 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:13.004835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-491d2546-07b7-418d-b13f-da95ab7b4b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:13.012918 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 915/1794] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:13.014891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13764005-4e78-4364-8df8-f4c3e2965142 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.024251 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 880/1795] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:13.027495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d2546-07b7-418d-b13f-da95ab7b4b16 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.040496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13764005-4e78-4364-8df8-f4c3e2965142 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.044924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d2546-07b7-418d-b13f-da95ab7b4b16 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.053861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8481d-5135-4840-9c3e-22f7706cda82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.055314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8481d-5135-4840-9c3e-22f7706cda82 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.055607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8481d-5135-4840-9c3e-22f7706cda82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.055891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8481d-5135-4840-9c3e-22f7706cda82 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.058309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8481d-5135-4840-9c3e-22f7706cda82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.061054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862968d-085f-458f-8f57-51b15a248b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.061743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862968d-085f-458f-8f57-51b15a248b01 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.062035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862968d-085f-458f-8f57-51b15a248b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.062318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862968d-085f-458f-8f57-51b15a248b01 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.063053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862968d-085f-458f-8f57-51b15a248b01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.063973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8481d-5135-4840-9c3e-22f7706cda82 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.065111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862968d-085f-458f-8f57-51b15a248b01 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.091856 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 881/1796] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:13.092686 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 916/1797] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:13.095779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8481d-5135-4840-9c3e-22f7706cda82 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.096261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862968d-085f-458f-8f57-51b15a248b01 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.113448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8481d-5135-4840-9c3e-22f7706cda82 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.116583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862968d-085f-458f-8f57-51b15a248b01 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.124854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa271cec-b1b5-4d4a-b179-cea925c00c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.125645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa271cec-b1b5-4d4a-b179-cea925c00c26 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.125898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69285b-4ef0-458e-af79-021d2571ee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.127452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69285b-4ef0-458e-af79-021d2571ee50 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.127568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa271cec-b1b5-4d4a-b179-cea925c00c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.127788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa271cec-b1b5-4d4a-b179-cea925c00c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.127890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69285b-4ef0-458e-af79-021d2571ee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.128175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69285b-4ef0-458e-af79-021d2571ee50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.128778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa271cec-b1b5-4d4a-b179-cea925c00c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.129015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69285b-4ef0-458e-af79-021d2571ee50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.131056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa271cec-b1b5-4d4a-b179-cea925c00c26 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.131481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69285b-4ef0-458e-af79-021d2571ee50 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.151213 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 882/1798] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:13.151213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69285b-4ef0-458e-af79-021d2571ee50 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.155143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-db69285b-4ef0-458e-af79-021d2571ee50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:13.168780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 917/1799] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:13 2022] POST /identity/v3/projects => generated 399 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:13.169867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa271cec-b1b5-4d4a-b179-cea925c00c26 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.233591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa271cec-b1b5-4d4a-b179-cea925c00c26 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.238396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa393f0-f8fb-4f3f-8ddc-a0c8cb9fa071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.239139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa393f0-f8fb-4f3f-8ddc-a0c8cb9fa071 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.239609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa393f0-f8fb-4f3f-8ddc-a0c8cb9fa071 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.240057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa393f0-f8fb-4f3f-8ddc-a0c8cb9fa071 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.240794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa393f0-f8fb-4f3f-8ddc-a0c8cb9fa071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:13.241104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa393f0-f8fb-4f3f-8ddc-a0c8cb9fa071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.242840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa393f0-f8fb-4f3f-8ddc-a0c8cb9fa071 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.246314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69285b-4ef0-458e-af79-021d2571ee50 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.256685 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 918/1800] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:13.258666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa393f0-f8fb-4f3f-8ddc-a0c8cb9fa071 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.270465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa393f0-f8fb-4f3f-8ddc-a0c8cb9fa071 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.276793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fcf5b-8041-4f16-8a80-366053777183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.277774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fcf5b-8041-4f16-8a80-366053777183 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.278083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fcf5b-8041-4f16-8a80-366053777183 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.292985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fcf5b-8041-4f16-8a80-366053777183 admin admin] PATH_INFO: `/v3/projects/eb5b26cc735f46fdbc494a2c636741f8/users/d045848741fb4b4e9efbbe14ffce9a26/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.320003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fcf5b-8041-4f16-8a80-366053777183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5b26cc735f46fdbc494a2c636741f8, user_id=d045848741fb4b4e9efbbe14ffce9a26, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.323957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fcf5b-8041-4f16-8a80-366053777183 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.332326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d032a-8254-40cc-9a30-4a0fdf3d694d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.333228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d032a-8254-40cc-9a30-4a0fdf3d694d service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.333547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d032a-8254-40cc-9a30-4a0fdf3d694d service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.334535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d032a-8254-40cc-9a30-4a0fdf3d694d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.357506 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 919/1801] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:13 2022] PUT /identity/v3/projects/eb5b26cc735f46fdbc494a2c636741f8/users/d045848741fb4b4e9efbbe14ffce9a26/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:13.358601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fcf5b-8041-4f16-8a80-366053777183 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.420164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d032a-8254-40cc-9a30-4a0fdf3d694d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.421897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d032a-8254-40cc-9a30-4a0fdf3d694d service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.443952 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 883/1802] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:13.445266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d032a-8254-40cc-9a30-4a0fdf3d694d service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.453976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fcf5b-8041-4f16-8a80-366053777183 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.461463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98583ae-33da-4b69-ab58-1b6c5ef86d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.462462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98583ae-33da-4b69-ab58-1b6c5ef86d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.462739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98583ae-33da-4b69-ab58-1b6c5ef86d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.463087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98583ae-33da-4b69-ab58-1b6c5ef86d6c admin admin] PATH_INFO: `/v3/projects/4ebb99804f8549d893890dc485f0cdbb/users/d95dc1d638ff4494827d30738f836f74/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.470130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d032a-8254-40cc-9a30-4a0fdf3d694d service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.482777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b4a7-7e83-46a4-81d2-c64d5b388ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.483315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b4a7-7e83-46a4-81d2-c64d5b388ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.483596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b4a7-7e83-46a4-81d2-c64d5b388ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.483871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2b4a7-7e83-46a4-81d2-c64d5b388ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.484631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2b4a7-7e83-46a4-81d2-c64d5b388ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.490977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2b4a7-7e83-46a4-81d2-c64d5b388ed8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.497799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98583ae-33da-4b69-ab58-1b6c5ef86d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebb99804f8549d893890dc485f0cdbb, user_id=d95dc1d638ff4494827d30738f836f74, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.501577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98583ae-33da-4b69-ab58-1b6c5ef86d6c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.508558 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 884/1803] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:13.510594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b4a7-7e83-46a4-81d2-c64d5b388ed8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.523491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2b4a7-7e83-46a4-81d2-c64d5b388ed8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.526248 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 920/1804] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:13 2022] PUT /identity/v3/projects/4ebb99804f8549d893890dc485f0cdbb/users/d95dc1d638ff4494827d30738f836f74/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:13.527516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98583ae-33da-4b69-ab58-1b6c5ef86d6c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.616120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d51e24-29d9-437e-9417-9c3d2df2467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.616853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d51e24-29d9-437e-9417-9c3d2df2467f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.617137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d51e24-29d9-437e-9417-9c3d2df2467f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.617817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d51e24-29d9-437e-9417-9c3d2df2467f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.618281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d51e24-29d9-437e-9417-9c3d2df2467f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.621039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d51e24-29d9-437e-9417-9c3d2df2467f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.622104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98583ae-33da-4b69-ab58-1b6c5ef86d6c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.635227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e8c9a-9b1b-4f5d-948b-afa63b089efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.636683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8c9a-9b1b-4f5d-948b-afa63b089efa admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.637022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8c9a-9b1b-4f5d-948b-afa63b089efa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.638720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8c9a-9b1b-4f5d-948b-afa63b089efa admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.638720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e8c9a-9b1b-4f5d-948b-afa63b089efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.640598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e8c9a-9b1b-4f5d-948b-afa63b089efa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.652571 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 885/1805] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:13 2022] POST /identity/v3/users => generated 306 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:13.658260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a6f65-7f76-45f6-adf1-06ab5cef54e8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.659763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a6f65-7f76-45f6-adf1-06ab5cef54e8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.660240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a6f65-7f76-45f6-adf1-06ab5cef54e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.703173 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 921/1806] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:13 2022] POST /identity/v3/projects => generated 403 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:13.704480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e8c9a-9b1b-4f5d-948b-afa63b089efa admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.713104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c63a6f65-7f76-45f6-adf1-06ab5cef54e8 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:13.715323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c63a6f65-7f76-45f6-adf1-06ab5cef54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:13.791732 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 886/1807] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:13.793605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ed0ed-cc5c-4fe5-8f69-3c6912cbf460 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.794131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ed0ed-cc5c-4fe5-8f69-3c6912cbf460 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.794604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ed0ed-cc5c-4fe5-8f69-3c6912cbf460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.796732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e8c9a-9b1b-4f5d-948b-afa63b089efa admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.824597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-184ed0ed-cc5c-4fe5-8f69-3c6912cbf460 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:13.826438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-184ed0ed-cc5c-4fe5-8f69-3c6912cbf460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:13.828185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61089a25-2d2b-4119-bc03-d428524588e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.830570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61089a25-2d2b-4119-bc03-d428524588e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.831420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61089a25-2d2b-4119-bc03-d428524588e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.831715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61089a25-2d2b-4119-bc03-d428524588e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.832540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61089a25-2d2b-4119-bc03-d428524588e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.835286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61089a25-2d2b-4119-bc03-d428524588e4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.836446 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 887/1808] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:49:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:13.845211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ed0ed-cc5c-4fe5-8f69-3c6912cbf460 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.856134 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 922/1809] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:13.857121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61089a25-2d2b-4119-bc03-d428524588e4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.857820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ed0ed-cc5c-4fe5-8f69-3c6912cbf460 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.866042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807c564-9e36-455e-bcc0-73ae44309d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.867151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807c564-9e36-455e-bcc0-73ae44309d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.867585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807c564-9e36-455e-bcc0-73ae44309d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.868003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8807c564-9e36-455e-bcc0-73ae44309d79 admin admin] PATH_INFO: `/v3/projects/c37576cbe4f749f89162f328e4429aec/users/df091ca34fce47c7a5f9e3efa9c8f656/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.874914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61089a25-2d2b-4119-bc03-d428524588e4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.883100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09957d1-0455-4777-950e-a195d3724622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.883780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09957d1-0455-4777-950e-a195d3724622 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.884093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09957d1-0455-4777-950e-a195d3724622 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.884371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09957d1-0455-4777-950e-a195d3724622 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.885100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09957d1-0455-4777-950e-a195d3724622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.886928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09957d1-0455-4777-950e-a195d3724622 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.904844 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 923/1810] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:13.905053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807c564-9e36-455e-bcc0-73ae44309d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37576cbe4f749f89162f328e4429aec, user_id=df091ca34fce47c7a5f9e3efa9c8f656, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.905719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09957d1-0455-4777-950e-a195d3724622 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.908407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8807c564-9e36-455e-bcc0-73ae44309d79 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.918120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09957d1-0455-4777-950e-a195d3724622 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:13.924453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:13.925500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:13.925911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:13.926198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] PATH_INFO: `/v3/users/1dec9141ca4440a0be105a729e7a0edc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:13.928132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dec9141ca4440a0be105a729e7a0edc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:13.930195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:13.932980 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 888/1811] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:13 2022] PUT /identity/v3/projects/c37576cbe4f749f89162f328e4429aec/users/df091ca34fce47c7a5f9e3efa9c8f656/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:13.935111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807c564-9e36-455e-bcc0-73ae44309d79 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:13.997392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dec9141ca4440a0be105a729e7a0edc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:14.009340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dec9141ca4440a0be105a729e7a0edc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:14.010946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dec9141ca4440a0be105a729e7a0edc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:14.011688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dec9141ca4440a0be105a729e7a0edc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:14.021261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dec9141ca4440a0be105a729e7a0edc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:14.034432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8807c564-9e36-455e-bcc0-73ae44309d79 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:14.039552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ada05-00f8-4971-886a-04124157011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:14.040378 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 924/1812] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:13 2022] DELETE /identity/v3/users/1dec9141ca4440a0be105a729e7a0edc => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:14.043307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:14.043307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.043592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ada05-00f8-4971-886a-04124157011a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.044094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ada05-00f8-4971-886a-04124157011a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.044384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ada05-00f8-4971-886a-04124157011a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.045134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ada05-00f8-4971-886a-04124157011a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:14.046782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ada05-00f8-4971-886a-04124157011a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:14.058893 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 889/1813] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:14.060213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ada05-00f8-4971-886a-04124157011a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:14.062274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c72ada05-00f8-4971-886a-04124157011a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.076735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ada05-00f8-4971-886a-04124157011a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:14.114148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5381ea-6ca7-40a3-af2d-fb4e03b919bb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:14.119753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ad5f0-0c2c-4c9d-ae0a-103f045cee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:14.120553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ad5f0-0c2c-4c9d-ae0a-103f045cee2a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.120897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ad5f0-0c2c-4c9d-ae0a-103f045cee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.121239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ad5f0-0c2c-4c9d-ae0a-103f045cee2a admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.121998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ad5f0-0c2c-4c9d-ae0a-103f045cee2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:14.124121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ad5f0-0c2c-4c9d-ae0a-103f045cee2a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:14.137965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d13266-3187-4693-bbf6-176d577ec387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:14.138867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13266-3187-4693-bbf6-176d577ec387 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.139162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13266-3187-4693-bbf6-176d577ec387 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.139424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d13266-3187-4693-bbf6-176d577ec387 admin admin] PATH_INFO: `/v3/projects/eb5b26cc735f46fdbc494a2c636741f8/users/d045848741fb4b4e9efbbe14ffce9a26/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.141654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d13266-3187-4693-bbf6-176d577ec387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5b26cc735f46fdbc494a2c636741f8, user_id=d045848741fb4b4e9efbbe14ffce9a26, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:14.144467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d13266-3187-4693-bbf6-176d577ec387 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:14.147096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 925/1814] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:14 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:14.147942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ad5f0-0c2c-4c9d-ae0a-103f045cee2a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:14.150858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-385ad5f0-0c2c-4c9d-ae0a-103f045cee2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.157195 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 890/1815] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:14 2022] PUT /identity/v3/projects/eb5b26cc735f46fdbc494a2c636741f8/users/d045848741fb4b4e9efbbe14ffce9a26/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:14.163656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ad5f0-0c2c-4c9d-ae0a-103f045cee2a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:14.167896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1343a6-9d2f-492a-9236-5f7ce1901651 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.168225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1343a6-9d2f-492a-9236-5f7ce1901651 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.169015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1343a6-9d2f-492a-9236-5f7ce1901651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.200115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0f1343a6-9d2f-492a-9236-5f7ce1901651 None None] MFA Rules not processed for user `df091ca34fce47c7a5f9e3efa9c8f656`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:14.201332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0f1343a6-9d2f-492a-9236-5f7ce1901651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.226768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724b5e-eb03-407e-9fbc-f111c94fd7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:14.227797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724b5e-eb03-407e-9fbc-f111c94fd7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.228140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724b5e-eb03-407e-9fbc-f111c94fd7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.228419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d724b5e-eb03-407e-9fbc-f111c94fd7b4 admin admin] PATH_INFO: `/v3/projects/4ebb99804f8549d893890dc485f0cdbb/users/d95dc1d638ff4494827d30738f836f74/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.230516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d724b5e-eb03-407e-9fbc-f111c94fd7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebb99804f8549d893890dc485f0cdbb, user_id=d95dc1d638ff4494827d30738f836f74, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:14.233536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d724b5e-eb03-407e-9fbc-f111c94fd7b4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:14.254074 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 926/1816] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:14 2022] PUT /identity/v3/projects/4ebb99804f8549d893890dc485f0cdbb/users/d95dc1d638ff4494827d30738f836f74/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:14.254074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724b5e-eb03-407e-9fbc-f111c94fd7b4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:14.256664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4d724b5e-eb03-407e-9fbc-f111c94fd7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.279007 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 891/1817] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:14.280929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1343a6-9d2f-492a-9236-5f7ce1901651 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:14.281972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0f1343a6-9d2f-492a-9236-5f7ce1901651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.331697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d724b5e-eb03-407e-9fbc-f111c94fd7b4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:14.338991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e3617-f8b2-4b47-9da0-360308dfe6ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:14.340153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e3617-f8b2-4b47-9da0-360308dfe6ec service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.340570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e3617-f8b2-4b47-9da0-360308dfe6ec service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.340993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e3617-f8b2-4b47-9da0-360308dfe6ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.343415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0a2e3617-f8b2-4b47-9da0-360308dfe6ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.373253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1343a6-9d2f-492a-9236-5f7ce1901651 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:14.382061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:14.382735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.383201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.383571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.386937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.430639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e3617-f8b2-4b47-9da0-360308dfe6ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:14.433590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e3617-f8b2-4b47-9da0-360308dfe6ec service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:14.447601 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 927/1818] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:14.450034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a61e1c-c441-4284-894e-6f9be621662f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.450370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a61e1c-c441-4284-894e-6f9be621662f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.450879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a61e1c-c441-4284-894e-6f9be621662f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.483732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b8a61e1c-c441-4284-894e-6f9be621662f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:14.486592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b8a61e1c-c441-4284-894e-6f9be621662f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.523836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:14.525675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:14.535783 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 892/1819] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:49:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:49:14.547890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:14.549623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.682836 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 928/1820] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:14.684970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a61e1c-c441-4284-894e-6f9be621662f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:14.705366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cf90a-6bc5-4104-919f-15215f055fa6 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:14.712555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a61e1c-c441-4284-894e-6f9be621662f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:14.716584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d57e5f9-75c8-45b4-b341-e50468f5f924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:14.717508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57e5f9-75c8-45b4-b341-e50468f5f924 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.717791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57e5f9-75c8-45b4-b341-e50468f5f924 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.718160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57e5f9-75c8-45b4-b341-e50468f5f924 admin admin] PATH_INFO: `/v3/projects/2a70c8fa45fc4e28b57464824a3d94c4/users/5ecd1055adb7455cb1e935e9cfc743e3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.728047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722c9fd-bb5b-4d11-ab30-1adcf1b984c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:14.729317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c9fd-bb5b-4d11-ab30-1adcf1b984c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.729622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c9fd-bb5b-4d11-ab30-1adcf1b984c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.730102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722c9fd-bb5b-4d11-ab30-1adcf1b984c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.730679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722c9fd-bb5b-4d11-ab30-1adcf1b984c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:14.732323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722c9fd-bb5b-4d11-ab30-1adcf1b984c3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:14.758117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57e5f9-75c8-45b4-b341-e50468f5f924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a70c8fa45fc4e28b57464824a3d94c4, user_id=5ecd1055adb7455cb1e935e9cfc743e3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:14.761084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d57e5f9-75c8-45b4-b341-e50468f5f924 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:14.783347 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 929/1821] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:14.785182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089be2f-7644-4109-a2e0-d75f6f95e971 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.787691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089be2f-7644-4109-a2e0-d75f6f95e971 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.788139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089be2f-7644-4109-a2e0-d75f6f95e971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.818148 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 893/1822] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:14 2022] PUT /identity/v3/projects/2a70c8fa45fc4e28b57464824a3d94c4/users/5ecd1055adb7455cb1e935e9cfc743e3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:14.826296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996c9a-9f5d-4aef-890d-45f3c51b07a1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:14.827568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996c9a-9f5d-4aef-890d-45f3c51b07a1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:14.829751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2996c9a-9f5d-4aef-890d-45f3c51b07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:14.864582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0089be2f-7644-4109-a2e0-d75f6f95e971 None None] MFA Rules not processed for user `d045848741fb4b4e9efbbe14ffce9a26`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:14.865873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0089be2f-7644-4109-a2e0-d75f6f95e971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:14.940779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a2996c9a-9f5d-4aef-890d-45f3c51b07a1 None None] MFA Rules not processed for user `d95dc1d638ff4494827d30738f836f74`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:14.950133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a2996c9a-9f5d-4aef-890d-45f3c51b07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:15.050439 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 930/1823] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:15.051445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089be2f-7644-4109-a2e0-d75f6f95e971 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:15.055332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0089be2f-7644-4109-a2e0-d75f6f95e971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:15.175095 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 894/1824] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:15.177746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24aba4-2aec-49f9-b6d7-a3b151de651f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:15.179632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24aba4-2aec-49f9-b6d7-a3b151de651f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:15.180023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24aba4-2aec-49f9-b6d7-a3b151de651f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:15.212353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089be2f-7644-4109-a2e0-d75f6f95e971 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:15.234671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206d0a3-f9aa-4d12-a45c-0b7cf5ec1f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:15.236294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206d0a3-f9aa-4d12-a45c-0b7cf5ec1f7d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:15.238082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206d0a3-f9aa-4d12-a45c-0b7cf5ec1f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:15.238082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206d0a3-f9aa-4d12-a45c-0b7cf5ec1f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:15.241138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206d0a3-f9aa-4d12-a45c-0b7cf5ec1f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:15.246954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206d0a3-f9aa-4d12-a45c-0b7cf5ec1f7d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:15.284345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9e24aba4-2aec-49f9-b6d7-a3b151de651f None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:15.286257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9e24aba4-2aec-49f9-b6d7-a3b151de651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:15.308382 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 931/1825] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:15 2022] POST /identity/v3/projects => generated 399 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:15.309420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206d0a3-f9aa-4d12-a45c-0b7cf5ec1f7d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:15.314100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0206d0a3-f9aa-4d12-a45c-0b7cf5ec1f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:15.397551 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 895/1826] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Mar 26 20:49:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:15.399177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24aba4-2aec-49f9-b6d7-a3b151de651f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:15.422779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24aba4-2aec-49f9-b6d7-a3b151de651f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:15.428468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206d0a3-f9aa-4d12-a45c-0b7cf5ec1f7d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:15.434136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a39ba-6965-4b8c-818a-d399291f9734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:15.434882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a39ba-6965-4b8c-818a-d399291f9734 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:15.435503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a39ba-6965-4b8c-818a-d399291f9734 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:15.435737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a39ba-6965-4b8c-818a-d399291f9734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:15.566679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a39ba-6965-4b8c-818a-d399291f9734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:15.568339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a39ba-6965-4b8c-818a-d399291f9734 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:15.581709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a236b9-054a-4f76-b146-3cec1ab41720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:15.582673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a236b9-054a-4f76-b146-3cec1ab41720 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:15.583353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a236b9-054a-4f76-b146-3cec1ab41720 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:15.584469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a236b9-054a-4f76-b146-3cec1ab41720 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:15.588315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a236b9-054a-4f76-b146-3cec1ab41720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:15.591298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a236b9-054a-4f76-b146-3cec1ab41720 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:15.602069 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 932/1827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:15.603072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a39ba-6965-4b8c-818a-d399291f9734 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:15.617224 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 896/1828] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:15.618232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a236b9-054a-4f76-b146-3cec1ab41720 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:15.620897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b1a236b9-054a-4f76-b146-3cec1ab41720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:15.625276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a39ba-6965-4b8c-818a-d399291f9734 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:15.640877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd661c-e2fa-47b5-ae3d-653fc7890c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:15.642378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd661c-e2fa-47b5-ae3d-653fc7890c60 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:15.642378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd661c-e2fa-47b5-ae3d-653fc7890c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:15.642705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd661c-e2fa-47b5-ae3d-653fc7890c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:15.648464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd661c-e2fa-47b5-ae3d-653fc7890c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:15.650232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd661c-e2fa-47b5-ae3d-653fc7890c60 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:15.674967 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 933/1829] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:15.675947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd661c-e2fa-47b5-ae3d-653fc7890c60 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:15.712363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd661c-e2fa-47b5-ae3d-653fc7890c60 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:15.720691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa78d4-debd-460c-b0e2-d545e8990564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:15.721842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa78d4-debd-460c-b0e2-d545e8990564 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:15.722579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa78d4-debd-460c-b0e2-d545e8990564 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:15.723783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa78d4-debd-460c-b0e2-d545e8990564 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:15.725114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa78d4-debd-460c-b0e2-d545e8990564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:15.727448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaa78d4-debd-460c-b0e2-d545e8990564 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:15.782140 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 934/1830] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:15 2022] POST /identity/v3/users => generated 306 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:15.784280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa78d4-debd-460c-b0e2-d545e8990564 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:15.791051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-faaa78d4-debd-460c-b0e2-d545e8990564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:15.818785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a236b9-054a-4f76-b146-3cec1ab41720 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:15.833266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa78d4-debd-460c-b0e2-d545e8990564 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:15.836878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb423ac-54ec-46bb-ba85-d0acc5ee3d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:15.837628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb423ac-54ec-46bb-ba85-d0acc5ee3d70 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:15.837840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb423ac-54ec-46bb-ba85-d0acc5ee3d70 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:15.838306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb423ac-54ec-46bb-ba85-d0acc5ee3d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:15.847533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139622-b576-435f-8499-e887fc780d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:15.851811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139622-b576-435f-8499-e887fc780d03 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:15.853092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139622-b576-435f-8499-e887fc780d03 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:15.853514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06139622-b576-435f-8499-e887fc780d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:15.977540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06139622-b576-435f-8499-e887fc780d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:15.979610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06139622-b576-435f-8499-e887fc780d03 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:16.013469 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 935/1831] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:16.014364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139622-b576-435f-8499-e887fc780d03 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:16.030494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb423ac-54ec-46bb-ba85-d0acc5ee3d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:16.039254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb423ac-54ec-46bb-ba85-d0acc5ee3d70 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:16.067562 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 897/1832] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:16.069286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10391-28dc-41be-b0f0-0704c54da023 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:16.069419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10391-28dc-41be-b0f0-0704c54da023 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:16.071803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f10391-28dc-41be-b0f0-0704c54da023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:16.082382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06139622-b576-435f-8499-e887fc780d03 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:16.097721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3f6b2-9992-442b-8579-c7afcbce911e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:16.098514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3f6b2-9992-442b-8579-c7afcbce911e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:16.098915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3f6b2-9992-442b-8579-c7afcbce911e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:16.099024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b8f10391-28dc-41be-b0f0-0704c54da023 None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:16.100778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3f6b2-9992-442b-8579-c7afcbce911e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:16.100980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b8f10391-28dc-41be-b0f0-0704c54da023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:16.108842 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 898/1833] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Mar 26 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:16.109694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f10391-28dc-41be-b0f0-0704c54da023 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:16.124220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f10391-28dc-41be-b0f0-0704c54da023 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:16.132523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3f6b2-9992-442b-8579-c7afcbce911e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:16.132681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a51938-2f27-4b6e-bd43-4222cac386f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:16.133429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a51938-2f27-4b6e-bd43-4222cac386f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:16.133718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a51938-2f27-4b6e-bd43-4222cac386f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:16.134005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a51938-2f27-4b6e-bd43-4222cac386f1 admin admin] PATH_INFO: `/v3/projects/890bcfbbdfe74b8ea56fff1b8b7dd6fe/users/44b3ec8f2f3f4ac0a4c72a54adc76064/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:16.134179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac3f6b2-9992-442b-8579-c7afcbce911e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:16.159409 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 936/1834] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:16.160599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3f6b2-9992-442b-8579-c7afcbce911e service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:16.164076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a51938-2f27-4b6e-bd43-4222cac386f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890bcfbbdfe74b8ea56fff1b8b7dd6fe, user_id=44b3ec8f2f3f4ac0a4c72a54adc76064, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:16.179212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a51938-2f27-4b6e-bd43-4222cac386f1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:16.208460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3f6b2-9992-442b-8579-c7afcbce911e service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:16.216819 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 899/1835] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:16 2022] PUT /identity/v3/projects/890bcfbbdfe74b8ea56fff1b8b7dd6fe/users/44b3ec8f2f3f4ac0a4c72a54adc76064/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:16.218083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a51938-2f27-4b6e-bd43-4222cac386f1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:16.432369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b008dd-0ab5-4663-8ce1-d7224dfc7fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:16.434551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b008dd-0ab5-4663-8ce1-d7224dfc7fba admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:16.444062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b008dd-0ab5-4663-8ce1-d7224dfc7fba admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:16.444455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b008dd-0ab5-4663-8ce1-d7224dfc7fba admin admin] PATH_INFO: `/v3/projects/2a70c8fa45fc4e28b57464824a3d94c4/users/5ecd1055adb7455cb1e935e9cfc743e3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:16.450874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b008dd-0ab5-4663-8ce1-d7224dfc7fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a70c8fa45fc4e28b57464824a3d94c4, user_id=5ecd1055adb7455cb1e935e9cfc743e3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:16.455033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b008dd-0ab5-4663-8ce1-d7224dfc7fba admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:16.460457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a51938-2f27-4b6e-bd43-4222cac386f1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:16.468771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53745156-9b25-415b-9656-8dd20e3b5260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:16.470251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53745156-9b25-415b-9656-8dd20e3b5260 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:16.470597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53745156-9b25-415b-9656-8dd20e3b5260 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:16.470959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53745156-9b25-415b-9656-8dd20e3b5260 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:16.473289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53745156-9b25-415b-9656-8dd20e3b5260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:16.476836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53745156-9b25-415b-9656-8dd20e3b5260 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:16.490772 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 937/1836] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:16 2022] PUT /identity/v3/projects/2a70c8fa45fc4e28b57464824a3d94c4/users/5ecd1055adb7455cb1e935e9cfc743e3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:16.490772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b008dd-0ab5-4663-8ce1-d7224dfc7fba admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:16.490772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d7b008dd-0ab5-4663-8ce1-d7224dfc7fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:16.499743 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 900/1837] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:16.503701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c260-7e76-4d13-ae42-9fd919bc0331 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:16.504028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c260-7e76-4d13-ae42-9fd919bc0331 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:16.504296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a9c260-7e76-4d13-ae42-9fd919bc0331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:16.560202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-82a9c260-7e76-4d13-ae42-9fd919bc0331 None None] MFA Rules not processed for user `44b3ec8f2f3f4ac0a4c72a54adc76064`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:16.562040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-82a9c260-7e76-4d13-ae42-9fd919bc0331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:16.644739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b008dd-0ab5-4663-8ce1-d7224dfc7fba admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:16.650746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea6e72-a4d4-462b-8845-6e7a8ba9ffbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:16.651413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea6e72-a4d4-462b-8845-6e7a8ba9ffbf service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:16.651699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea6e72-a4d4-462b-8845-6e7a8ba9ffbf service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:16.652007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea6e72-a4d4-462b-8845-6e7a8ba9ffbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:16.666663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea6e72-a4d4-462b-8845-6e7a8ba9ffbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:16.668466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea6e72-a4d4-462b-8845-6e7a8ba9ffbf service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:16.699370 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 938/1838] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:16.703180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea6e72-a4d4-462b-8845-6e7a8ba9ffbf service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:16.704873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8fea6e72-a4d4-462b-8845-6e7a8ba9ffbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:16.720305 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 901/1839] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:16.721956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2483c-d311-4c64-8dff-6669d4799a2f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:16.722478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2483c-d311-4c64-8dff-6669d4799a2f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:16.723034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2483c-d311-4c64-8dff-6669d4799a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:16.769852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d3c2483c-d311-4c64-8dff-6669d4799a2f None None] MFA Rules not processed for user `5ecd1055adb7455cb1e935e9cfc743e3`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:16.772568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d3c2483c-d311-4c64-8dff-6669d4799a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:16.894523 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 902/1840] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:16.896859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2483c-d311-4c64-8dff-6669d4799a2f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:16.925564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea6e72-a4d4-462b-8845-6e7a8ba9ffbf service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:16.936638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:16.944916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:16.945211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:16.945498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] PATH_INFO: `/v3/projects/8f6a99a746504f6c861ee0aefccf29af` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:16.946868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6a99a746504f6c861ee0aefccf29af)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:16.949341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:17.002423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2483c-d311-4c64-8dff-6669d4799a2f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:17.009225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ccc21-30f8-44c7-9125-153e288aca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:17.010602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ccc21-30f8-44c7-9125-153e288aca39 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:17.010882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ccc21-30f8-44c7-9125-153e288aca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:17.011419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ccc21-30f8-44c7-9125-153e288aca39 admin admin] PATH_INFO: `/v3/projects/4c6d3a159dbc48a9a1eb3d3d0ed08e20/users/fbd46c2bd59942cb91fd4853bebc5753/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:17.044603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ccc21-30f8-44c7-9125-153e288aca39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6d3a159dbc48a9a1eb3d3d0ed08e20, user_id=fbd46c2bd59942cb91fd4853bebc5753, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:17.050539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377ccc21-30f8-44c7-9125-153e288aca39 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:17.058987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6a99a746504f6c861ee0aefccf29af', 'request_id': 'req-2987546e-9e5d-4375-9eeb-7d8fc2346e28'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.071496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6a99a746504f6c861ee0aefccf29af', 'request_id': 'req-2987546e-9e5d-4375-9eeb-7d8fc2346e28'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.073744 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 903/1841] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:16 2022] PUT /identity/v3/projects/4c6d3a159dbc48a9a1eb3d3d0ed08e20/users/fbd46c2bd59942cb91fd4853bebc5753/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:17.081495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ccc21-30f8-44c7-9125-153e288aca39 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:17.084888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6a99a746504f6c861ee0aefccf29af', 'request_id': 'req-2987546e-9e5d-4375-9eeb-7d8fc2346e28'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.131314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] The token cache is being invalidate because project 8f6a99a746504f6c861ee0aefccf29af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:17.131635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.132494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.134151 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 939/1842] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:16 2022] DELETE /identity/v3/projects/8f6a99a746504f6c861ee0aefccf29af => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:17.145887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:17.147124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:17.196422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ccc21-30f8-44c7-9125-153e288aca39 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:17.204572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:17.205850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:17.206351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:17.206997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:17.210618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:17.303589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:17.306124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:17.323790 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 904/1843] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:17.325179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:17.326752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:17.419573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee062cd-d592-47c3-bf58-b5770324c972 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:17.428294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dc2de-adbf-4bc6-afe4-53547ad2a355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:17.429095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dc2de-adbf-4bc6-afe4-53547ad2a355 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:17.429451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dc2de-adbf-4bc6-afe4-53547ad2a355 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:17.429838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dc2de-adbf-4bc6-afe4-53547ad2a355 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:17.430645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dc2de-adbf-4bc6-afe4-53547ad2a355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:17.433083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dc2de-adbf-4bc6-afe4-53547ad2a355 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:17.449511 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 905/1844] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:17.449511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dc2de-adbf-4bc6-afe4-53547ad2a355 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:17.449511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-315dc2de-adbf-4bc6-afe4-53547ad2a355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:17.471662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dc2de-adbf-4bc6-afe4-53547ad2a355 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:17.481401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:17.483946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987546e-9e5d-4375-9eeb-7d8fc2346e28 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:17.484361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:17.484773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:17.485362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] PATH_INFO: `/v3/users/f355bdb93d0a4d9d9e22468f81d6148f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:17.486991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f355bdb93d0a4d9d9e22468f81d6148f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:17.491705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:17.501238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7b42f-aa9c-4d54-9eb7-df7654772c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:17.501926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7b42f-aa9c-4d54-9eb7-df7654772c85 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:17.502207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7b42f-aa9c-4d54-9eb7-df7654772c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:17.502485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7b42f-aa9c-4d54-9eb7-df7654772c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:17.503187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7b42f-aa9c-4d54-9eb7-df7654772c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:17.505176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7b42f-aa9c-4d54-9eb7-df7654772c85 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:17.613036 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 940/1845] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:17 2022] POST /identity/v3/projects => generated 403 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:17.613036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7b42f-aa9c-4d54-9eb7-df7654772c85 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:17.613213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f355bdb93d0a4d9d9e22468f81d6148f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.636405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f355bdb93d0a4d9d9e22468f81d6148f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.642290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f355bdb93d0a4d9d9e22468f81d6148f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.643342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f355bdb93d0a4d9d9e22468f81d6148f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.674297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f355bdb93d0a4d9d9e22468f81d6148f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:17.710904 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 906/1846] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:17 2022] DELETE /identity/v3/users/f355bdb93d0a4d9d9e22468f81d6148f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:17.712048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:17.719475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:17.775837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7b42f-aa9c-4d54-9eb7-df7654772c85 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:17.924945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f72eb6-36cd-4a0c-8754-04f0dcaa6a3b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:17.945661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:17.946339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:17.946626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:17.946891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:17.949097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:18.035874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:18.037618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:18.042845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96e55-fde8-41d2-ae14-b30c43bf214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:18.046229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96e55-fde8-41d2-ae14-b30c43bf214b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.047288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96e55-fde8-41d2-ae14-b30c43bf214b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.048617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96e55-fde8-41d2-ae14-b30c43bf214b admin admin] PATH_INFO: `/v3/projects/4c6d3a159dbc48a9a1eb3d3d0ed08e20/users/fbd46c2bd59942cb91fd4853bebc5753/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.055763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d96e55-fde8-41d2-ae14-b30c43bf214b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6d3a159dbc48a9a1eb3d3d0ed08e20, user_id=fbd46c2bd59942cb91fd4853bebc5753, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:18.066435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d96e55-fde8-41d2-ae14-b30c43bf214b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:18.076343 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 907/1847] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:18.077371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:18.083195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:18.096884 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 941/1848] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:17 2022] PUT /identity/v3/projects/4c6d3a159dbc48a9a1eb3d3d0ed08e20/users/fbd46c2bd59942cb91fd4853bebc5753/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:18.097791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96e55-fde8-41d2-ae14-b30c43bf214b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:18.102362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f6d96e55-fde8-41d2-ae14-b30c43bf214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:18.114647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0bb48a-176a-43f4-b4d8-fdb3c24305db service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:18.301088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab544f33-280f-43af-82ae-331415640336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:18.301777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544f33-280f-43af-82ae-331415640336 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.302073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544f33-280f-43af-82ae-331415640336 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.302404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab544f33-280f-43af-82ae-331415640336 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.303101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab544f33-280f-43af-82ae-331415640336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:18.308973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96e55-fde8-41d2-ae14-b30c43bf214b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:18.311358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab544f33-280f-43af-82ae-331415640336 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:18.326253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:18.328542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.333324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.333712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] PATH_INFO: `/v3/users/0cd618873f1944858dba8333d5b25048` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.347810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd618873f1944858dba8333d5b25048)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:18.352122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:18.382212 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 908/1849] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:18 2022] POST /identity/v3/users => generated 308 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:18.383556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee21d8-3404-4316-9344-d53e07d3f7fe None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.385064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee21d8-3404-4316-9344-d53e07d3f7fe None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.385447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee21d8-3404-4316-9344-d53e07d3f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.462492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6fee21d8-3404-4316-9344-d53e07d3f7fe None None] MFA Rules not processed for user `fbd46c2bd59942cb91fd4853bebc5753`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:18.464755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd618873f1944858dba8333d5b25048'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:18.466762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6fee21d8-3404-4316-9344-d53e07d3f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:18.485089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd618873f1944858dba8333d5b25048'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:18.486567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd618873f1944858dba8333d5b25048'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:18.488800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd618873f1944858dba8333d5b25048'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:18.506887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-986de4d6-c701-4417-bdb7-503b9e7d4e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd618873f1944858dba8333d5b25048'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:18.529693 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 942/1850] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:18 2022] DELETE /identity/v3/users/0cd618873f1944858dba8333d5b25048 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:18.531540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56c555-7412-44be-b3ee-d5a64af18935 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.531824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56c555-7412-44be-b3ee-d5a64af18935 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.532124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56c555-7412-44be-b3ee-d5a64af18935 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.534614 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 943/1851] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:18.535377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56c555-7412-44be-b3ee-d5a64af18935 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:18.538427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c56c555-7412-44be-b3ee-d5a64af18935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:18.631566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56c555-7412-44be-b3ee-d5a64af18935 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:18.634223 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 909/1852] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:18 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:18.635443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee21d8-3404-4316-9344-d53e07d3f7fe None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:18.636887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6fee21d8-3404-4316-9344-d53e07d3f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:18.637742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38161e18-11db-4052-89e2-c34e0f80f255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:18.638825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38161e18-11db-4052-89e2-c34e0f80f255 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.639110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38161e18-11db-4052-89e2-c34e0f80f255 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.639461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38161e18-11db-4052-89e2-c34e0f80f255 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.640483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38161e18-11db-4052-89e2-c34e0f80f255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:18.642806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38161e18-11db-4052-89e2-c34e0f80f255 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:18.657065 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 944/1853] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:18.658539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b849dd4-d49b-490f-8415-8be6568b6263 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.658878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b849dd4-d49b-490f-8415-8be6568b6263 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.659162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b849dd4-d49b-490f-8415-8be6568b6263 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.661480 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 945/1854] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:18.664404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79adeb3-3386-49f8-b44d-e0e59d720fd2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.664695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79adeb3-3386-49f8-b44d-e0e59d720fd2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.664972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79adeb3-3386-49f8-b44d-e0e59d720fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.687828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b79adeb3-3386-49f8-b44d-e0e59d720fd2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:18.689524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b79adeb3-3386-49f8-b44d-e0e59d720fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:18.702489 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 946/1855] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:18.702489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752450-0cc8-4041-bd5d-736a8c0629ed None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.702489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752450-0cc8-4041-bd5d-736a8c0629ed None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.703019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4752450-0cc8-4041-bd5d-736a8c0629ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.754161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b4752450-0cc8-4041-bd5d-736a8c0629ed None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:18.754964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b4752450-0cc8-4041-bd5d-736a8c0629ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:18.795694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee21d8-3404-4316-9344-d53e07d3f7fe None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:18.858903 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 947/1856] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:18.860284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4752450-0cc8-4041-bd5d-736a8c0629ed None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:18.888885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4752450-0cc8-4041-bd5d-736a8c0629ed None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:18.911713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92194ea-4966-458a-a3a9-4ab6bab26215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:18.911713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92194ea-4966-458a-a3a9-4ab6bab26215 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.911713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92194ea-4966-458a-a3a9-4ab6bab26215 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.911713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92194ea-4966-458a-a3a9-4ab6bab26215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.913879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e92194ea-4966-458a-a3a9-4ab6bab26215 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:18.923471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad55ac-65e9-44f9-81e4-8a700b0eb481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:18.925141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad55ac-65e9-44f9-81e4-8a700b0eb481 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:18.925653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad55ac-65e9-44f9-81e4-8a700b0eb481 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:18.926094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad55ac-65e9-44f9-81e4-8a700b0eb481 admin admin] PATH_INFO: `/v3/projects/07e3f4db69224d429f259029b3e5b77f/users/bb84f8e5ceae46c9b94fddb43f5c6d25/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:18.946147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad55ac-65e9-44f9-81e4-8a700b0eb481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e3f4db69224d429f259029b3e5b77f, user_id=bb84f8e5ceae46c9b94fddb43f5c6d25, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:18.949208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ad55ac-65e9-44f9-81e4-8a700b0eb481 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:18.974930 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 948/1857] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:18 2022] PUT /identity/v3/projects/07e3f4db69224d429f259029b3e5b77f/users/bb84f8e5ceae46c9b94fddb43f5c6d25/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:18.976026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad55ac-65e9-44f9-81e4-8a700b0eb481 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:18.977953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b3ad55ac-65e9-44f9-81e4-8a700b0eb481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:19.019224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92194ea-4966-458a-a3a9-4ab6bab26215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:19.025642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92194ea-4966-458a-a3a9-4ab6bab26215 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:19.055531 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 910/1858] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:18 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:19.056980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373aaf6-7b75-409a-b64d-1134ca1232f9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:19.057343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373aaf6-7b75-409a-b64d-1134ca1232f9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:19.057543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373aaf6-7b75-409a-b64d-1134ca1232f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:19.089909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad55ac-65e9-44f9-81e4-8a700b0eb481 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:19.096384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ad3e8-0e05-4cd5-9369-ceed042445d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:19.097956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ad3e8-0e05-4cd5-9369-ceed042445d4 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:19.098671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ad3e8-0e05-4cd5-9369-ceed042445d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:19.099631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ad3e8-0e05-4cd5-9369-ceed042445d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:19.108568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1373aaf6-7b75-409a-b64d-1134ca1232f9 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:19.111992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1373aaf6-7b75-409a-b64d-1134ca1232f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:19.253813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ad3e8-0e05-4cd5-9369-ceed042445d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:19.262053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ad3e8-0e05-4cd5-9369-ceed042445d4 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:19.285794 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 949/1859] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:19.287366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ad3e8-0e05-4cd5-9369-ceed042445d4 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:19.314234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ad3e8-0e05-4cd5-9369-ceed042445d4 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:19.318407 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 911/1860] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:19.331785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466499b-6c9c-4d61-b5de-5e3dfa48a44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:19.332576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466499b-6c9c-4d61-b5de-5e3dfa48a44a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:19.332880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466499b-6c9c-4d61-b5de-5e3dfa48a44a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:19.333165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466499b-6c9c-4d61-b5de-5e3dfa48a44a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:19.334453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466499b-6c9c-4d61-b5de-5e3dfa48a44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:19.336184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466499b-6c9c-4d61-b5de-5e3dfa48a44a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:19.363485 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 950/1861] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:19.367727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373aaf6-7b75-409a-b64d-1134ca1232f9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:19.399673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373aaf6-7b75-409a-b64d-1134ca1232f9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:19.418831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2deeb-f19b-4254-9d91-bcd0d8643e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:19.421880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2deeb-f19b-4254-9d91-bcd0d8643e83 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:19.422338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2deeb-f19b-4254-9d91-bcd0d8643e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:19.423153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2deeb-f19b-4254-9d91-bcd0d8643e83 admin admin] PATH_INFO: `/v3/projects/07e3f4db69224d429f259029b3e5b77f/users/bb84f8e5ceae46c9b94fddb43f5c6d25/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:19.430399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2deeb-f19b-4254-9d91-bcd0d8643e83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e3f4db69224d429f259029b3e5b77f, user_id=bb84f8e5ceae46c9b94fddb43f5c6d25, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:19.443100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2deeb-f19b-4254-9d91-bcd0d8643e83 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:19.479152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 912/1862] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:19 2022] PUT /identity/v3/projects/07e3f4db69224d429f259029b3e5b77f/users/bb84f8e5ceae46c9b94fddb43f5c6d25/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:19.496977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2967c1-175e-47e7-b107-890db1be6596 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:19.497274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2967c1-175e-47e7-b107-890db1be6596 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:19.497802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2967c1-175e-47e7-b107-890db1be6596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:19.511385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2deeb-f19b-4254-9d91-bcd0d8643e83 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:19.513998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-28d2deeb-f19b-4254-9d91-bcd0d8643e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:19.567643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cf2967c1-175e-47e7-b107-890db1be6596 None None] MFA Rules not processed for user `bb84f8e5ceae46c9b94fddb43f5c6d25`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:19.571442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cf2967c1-175e-47e7-b107-890db1be6596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:19.647473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2deeb-f19b-4254-9d91-bcd0d8643e83 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:19.657822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828a8e-86e7-4375-be00-6ce94f12a7d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:19.659497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828a8e-86e7-4375-be00-6ce94f12a7d7 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:19.660839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828a8e-86e7-4375-be00-6ce94f12a7d7 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:19.663724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18828a8e-86e7-4375-be00-6ce94f12a7d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:19.741360 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 951/1863] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:19.834523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18828a8e-86e7-4375-be00-6ce94f12a7d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:19.838336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18828a8e-86e7-4375-be00-6ce94f12a7d7 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:19.894498 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 913/1864] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:19 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:20.023301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2967c1-175e-47e7-b107-890db1be6596 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:20.056573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2967c1-175e-47e7-b107-890db1be6596 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:20.078951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52aa900-6282-41ff-b425-43a6b045f73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:20.079683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52aa900-6282-41ff-b425-43a6b045f73f service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:20.080011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52aa900-6282-41ff-b425-43a6b045f73f service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:20.080297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52aa900-6282-41ff-b425-43a6b045f73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:20.096726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52aa900-6282-41ff-b425-43a6b045f73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:20.100564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52aa900-6282-41ff-b425-43a6b045f73f service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:20.166969 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 952/1865] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:20.321841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828a8e-86e7-4375-be00-6ce94f12a7d7 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:20.341874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18828a8e-86e7-4375-be00-6ce94f12a7d7 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:20.357857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e06e0-1e8d-427d-bc04-daff15fb9a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:20.358590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e06e0-1e8d-427d-bc04-daff15fb9a75 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:20.358883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e06e0-1e8d-427d-bc04-daff15fb9a75 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:20.359168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18e06e0-1e8d-427d-bc04-daff15fb9a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:20.394033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e06e0-1e8d-427d-bc04-daff15fb9a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:20.400623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18e06e0-1e8d-427d-bc04-daff15fb9a75 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:20.408892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52aa900-6282-41ff-b425-43a6b045f73f service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:20.431987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52aa900-6282-41ff-b425-43a6b045f73f service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:20.446373 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 914/1866] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:20.456628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3072-24b3-4d15-ac24-cddae3f8cef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:20.458119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3072-24b3-4d15-ac24-cddae3f8cef1 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:20.458587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3072-24b3-4d15-ac24-cddae3f8cef1 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:20.459026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b3072-24b3-4d15-ac24-cddae3f8cef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:20.487499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3072-24b3-4d15-ac24-cddae3f8cef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:20.490927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b3072-24b3-4d15-ac24-cddae3f8cef1 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:20.524754 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 953/1867] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:20.532517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e06e0-1e8d-427d-bc04-daff15fb9a75 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:20.533968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f18e06e0-1e8d-427d-bc04-daff15fb9a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:20.669834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3072-24b3-4d15-ac24-cddae3f8cef1 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:20.687178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b3072-24b3-4d15-ac24-cddae3f8cef1 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:20.701627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29666ebb-d2fa-429b-9083-22d30835a6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:20.704746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666ebb-d2fa-429b-9083-22d30835a6e9 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:20.705092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666ebb-d2fa-429b-9083-22d30835a6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:20.706019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29666ebb-d2fa-429b-9083-22d30835a6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:20.711936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-29666ebb-d2fa-429b-9083-22d30835a6e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:20.734611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18e06e0-1e8d-427d-bc04-daff15fb9a75 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:20.739878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:20.741450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:20.741741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:20.742017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] PATH_INFO: `/v3/projects/87905e05ff4447858ea65069d73987ee` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:20.743230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87905e05ff4447858ea65069d73987ee)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:20.745253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:20.835371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87905e05ff4447858ea65069d73987ee', 'request_id': 'req-72762601-61b0-4fdd-97de-b62d3cba07b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:20.852247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87905e05ff4447858ea65069d73987ee', 'request_id': 'req-72762601-61b0-4fdd-97de-b62d3cba07b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:20.860744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87905e05ff4447858ea65069d73987ee', 'request_id': 'req-72762601-61b0-4fdd-97de-b62d3cba07b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:20.876760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666ebb-d2fa-429b-9083-22d30835a6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:20.878080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] The token cache is being invalidate because project 87905e05ff4447858ea65069d73987ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:20.878555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:20.879237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-72762601-61b0-4fdd-97de-b62d3cba07b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:20.881035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29666ebb-d2fa-429b-9083-22d30835a6e9 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:20.884931 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 915/1868] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:20 2022] DELETE /identity/v3/projects/87905e05ff4447858ea65069d73987ee => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:20.886318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30746a4c-ba7e-4bbd-98bc-b2aa97257b65 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:20.886626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30746a4c-ba7e-4bbd-98bc-b2aa97257b65 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:20.887000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30746a4c-ba7e-4bbd-98bc-b2aa97257b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:20.904934 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 954/1869] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:20.925970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-30746a4c-ba7e-4bbd-98bc-b2aa97257b65 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:20.933075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-30746a4c-ba7e-4bbd-98bc-b2aa97257b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:21.041074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54451a9-012e-4905-a6f1-e138a6134a37 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:21.041604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54451a9-012e-4905-a6f1-e138a6134a37 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:21.042065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54451a9-012e-4905-a6f1-e138a6134a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:21.048758 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 916/1870] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:21.094053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d54451a9-012e-4905-a6f1-e138a6134a37 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:21.100678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d54451a9-012e-4905-a6f1-e138a6134a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:21.124410 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 955/1871] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:21.132116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30746a4c-ba7e-4bbd-98bc-b2aa97257b65 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:21.175882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30746a4c-ba7e-4bbd-98bc-b2aa97257b65 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:21.201939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd93d-00bb-4a04-8015-0167c36a8cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:21.204706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd93d-00bb-4a04-8015-0167c36a8cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:21.206342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd93d-00bb-4a04-8015-0167c36a8cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:21.206705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dd93d-00bb-4a04-8015-0167c36a8cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:21.217815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dd93d-00bb-4a04-8015-0167c36a8cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:21.217926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dd93d-00bb-4a04-8015-0167c36a8cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:21.229917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56dd93d-00bb-4a04-8015-0167c36a8cf0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:21.268798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54451a9-012e-4905-a6f1-e138a6134a37 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:21.270342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d54451a9-012e-4905-a6f1-e138a6134a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:21.277712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 917/1872] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:21.281106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd93d-00bb-4a04-8015-0167c36a8cf0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:21.302082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54451a9-012e-4905-a6f1-e138a6134a37 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:21.306900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dd93d-00bb-4a04-8015-0167c36a8cf0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:21.321520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc64657-e7c2-445f-b48f-077c2d73bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:21.321739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:21.322423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc64657-e7c2-445f-b48f-077c2d73bde7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:21.322908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:21.323003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc64657-e7c2-445f-b48f-077c2d73bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:21.323098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:21.325182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc64657-e7c2-445f-b48f-077c2d73bde7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:21.327352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] PATH_INFO: `/v3/users/65fb1ca790104ee38cad504f86b54b03` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:21.328828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc64657-e7c2-445f-b48f-077c2d73bde7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:21.331754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc64657-e7c2-445f-b48f-077c2d73bde7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:21.334238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fb1ca790104ee38cad504f86b54b03)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:21.338212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:21.409595 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 918/1873] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:21 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:21.412882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc64657-e7c2-445f-b48f-077c2d73bde7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:21.417929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8cc64657-e7c2-445f-b48f-077c2d73bde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:21.521799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fb1ca790104ee38cad504f86b54b03'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.571429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fb1ca790104ee38cad504f86b54b03'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.576436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fb1ca790104ee38cad504f86b54b03'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.579068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fb1ca790104ee38cad504f86b54b03'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.600999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc64657-e7c2-445f-b48f-077c2d73bde7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:21.604037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fb1ca790104ee38cad504f86b54b03'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.613573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:21.614993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:21.614993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:21.620355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] PATH_INFO: `/v3/projects/9a452cecead647e58b2f872632f76c74` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:21.622647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a452cecead647e58b2f872632f76c74)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:21.624793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:21.667165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 956/1874] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:21 2022] DELETE /identity/v3/users/65fb1ca790104ee38cad504f86b54b03 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:21.670758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:21.674887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:21.732912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a452cecead647e58b2f872632f76c74', 'request_id': 'req-f489576d-45f4-4428-a1c5-20069ece9358'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.750849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a452cecead647e58b2f872632f76c74', 'request_id': 'req-f489576d-45f4-4428-a1c5-20069ece9358'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.758736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a452cecead647e58b2f872632f76c74', 'request_id': 'req-f489576d-45f4-4428-a1c5-20069ece9358'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.788510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] The token cache is being invalidate because project 9a452cecead647e58b2f872632f76c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:21.788890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.789544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:21.791149 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 919/1875] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:21 2022] DELETE /identity/v3/projects/9a452cecead647e58b2f872632f76c74 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:21.791895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:21.795208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:21.853719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8054bb-4050-4432-badf-3f39611ce577 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:21.963191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489576d-45f4-4428-a1c5-20069ece9358 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:21.979106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f08833-bbfe-402d-a0e2-9ccdb043dfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:21.979881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f08833-bbfe-402d-a0e2-9ccdb043dfd9 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:21.980198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f08833-bbfe-402d-a0e2-9ccdb043dfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:21.980516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f08833-bbfe-402d-a0e2-9ccdb043dfd9 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:21.981302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f08833-bbfe-402d-a0e2-9ccdb043dfd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:21.981423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:21.982871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:21.983454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:21.983832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f08833-bbfe-402d-a0e2-9ccdb043dfd9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:21.984105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] PATH_INFO: `/v3/users/b3dca0dea5324c049251a4728b090e77` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:21.985652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3dca0dea5324c049251a4728b090e77)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:21.988319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:22.037427 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 920/1876] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:21 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:22.039129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a341b5e-0ed0-4c51-bc98-b2ac07bde6ec None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.039471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a341b5e-0ed0-4c51-bc98-b2ac07bde6ec None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.039781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a341b5e-0ed0-4c51-bc98-b2ac07bde6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.058682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3dca0dea5324c049251a4728b090e77'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.070524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3dca0dea5324c049251a4728b090e77'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.071475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3dca0dea5324c049251a4728b090e77'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.072751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3dca0dea5324c049251a4728b090e77'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.076109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4a341b5e-0ed0-4c51-bc98-b2ac07bde6ec None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:22.078579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4a341b5e-0ed0-4c51-bc98-b2ac07bde6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.084678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3dca0dea5324c049251a4728b090e77'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.092459 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 921/1877] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:22.092459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a341b5e-0ed0-4c51-bc98-b2ac07bde6ec None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:22.094018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4a341b5e-0ed0-4c51-bc98-b2ac07bde6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.113283 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 957/1878] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:21 2022] DELETE /identity/v3/users/b3dca0dea5324c049251a4728b090e77 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:22.114381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:22.116538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.143242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a341b5e-0ed0-4c51-bc98-b2ac07bde6ec None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:22.243949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b4e81-c57f-44ef-b4fc-a401e501526b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:22.248938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:22.249921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.250284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.250634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] PATH_INFO: `/v3/users/d95dc1d638ff4494827d30738f836f74` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.252621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95dc1d638ff4494827d30738f836f74)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:22.254345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:22.270340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:22.271866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.272194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.272650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] PATH_INFO: `/v3/users/44b3ec8f2f3f4ac0a4c72a54adc76064` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.274044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b3ec8f2f3f4ac0a4c72a54adc76064)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:22.276715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:22.338001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95dc1d638ff4494827d30738f836f74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.346890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95dc1d638ff4494827d30738f836f74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.348119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95dc1d638ff4494827d30738f836f74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.350453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95dc1d638ff4494827d30738f836f74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.361365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b3ec8f2f3f4ac0a4c72a54adc76064'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.374419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b3ec8f2f3f4ac0a4c72a54adc76064'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.375227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b3ec8f2f3f4ac0a4c72a54adc76064'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.375868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b3ec8f2f3f4ac0a4c72a54adc76064'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.379488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95dc1d638ff4494827d30738f836f74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.393182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b3ec8f2f3f4ac0a4c72a54adc76064'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:22.405233 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 958/1879] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:22 2022] DELETE /identity/v3/users/d95dc1d638ff4494827d30738f836f74 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:22.406459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:22.408057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.411967 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 922/1880] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:22 2022] DELETE /identity/v3/users/44b3ec8f2f3f4ac0a4c72a54adc76064 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:22.411967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:22.411967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.490240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7dc09-550a-4094-8fb2-ca76c44b2d37 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:22.492100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e9885-5766-4bbd-a0a2-c83e1b9395bd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:22.494831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c333d5e-176c-4669-95e8-1af1ce0a7670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:22.497585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c333d5e-176c-4669-95e8-1af1ce0a7670 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.497948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c333d5e-176c-4669-95e8-1af1ce0a7670 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.498248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c333d5e-176c-4669-95e8-1af1ce0a7670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.504154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4c333d5e-176c-4669-95e8-1af1ce0a7670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.613860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9457f0-bda1-43bf-ab47-dc9de609395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:22.614712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9457f0-bda1-43bf-ab47-dc9de609395f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.614978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9457f0-bda1-43bf-ab47-dc9de609395f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.615267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9457f0-bda1-43bf-ab47-dc9de609395f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.617876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9457f0-bda1-43bf-ab47-dc9de609395f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:22.619767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9457f0-bda1-43bf-ab47-dc9de609395f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:22.639091 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 959/1881] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:22.640507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6276-6880-4ca5-ad61-ec7e5787b7ae None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.640802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6276-6880-4ca5-ad61-ec7e5787b7ae None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.642892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a6276-6880-4ca5-ad61-ec7e5787b7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.653594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c333d5e-176c-4669-95e8-1af1ce0a7670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:22.655839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c333d5e-176c-4669-95e8-1af1ce0a7670 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:22.686032 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 923/1882] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:22.687568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508568d8-b76d-47b1-86d0-27fd1a13ba80 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.687875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508568d8-b76d-47b1-86d0-27fd1a13ba80 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.688255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508568d8-b76d-47b1-86d0-27fd1a13ba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.689041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-991a6276-6880-4ca5-ad61-ec7e5787b7ae None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:22.691521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-991a6276-6880-4ca5-ad61-ec7e5787b7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.711128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-508568d8-b76d-47b1-86d0-27fd1a13ba80 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:22.712561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-508568d8-b76d-47b1-86d0-27fd1a13ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.713129 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 960/1883] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:22.714254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a6276-6880-4ca5-ad61-ec7e5787b7ae None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:22.715820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-991a6276-6880-4ca5-ad61-ec7e5787b7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.737448 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 924/1884] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:22.737448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508568d8-b76d-47b1-86d0-27fd1a13ba80 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:22.743053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-508568d8-b76d-47b1-86d0-27fd1a13ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:22.760077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a6276-6880-4ca5-ad61-ec7e5787b7ae None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:22.773485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc03d77-54fb-4b95-928c-65fcaa14c07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:22.774456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc03d77-54fb-4b95-928c-65fcaa14c07e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.774895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc03d77-54fb-4b95-928c-65fcaa14c07e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.775330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc03d77-54fb-4b95-928c-65fcaa14c07e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.776260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc03d77-54fb-4b95-928c-65fcaa14c07e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:22.778096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc03d77-54fb-4b95-928c-65fcaa14c07e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:22.780087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508568d8-b76d-47b1-86d0-27fd1a13ba80 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:22.786406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6e970-c976-4b60-94d8-8af67c5f53bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:22.787330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6e970-c976-4b60-94d8-8af67c5f53bd service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.787865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6e970-c976-4b60-94d8-8af67c5f53bd service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.788369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6e970-c976-4b60-94d8-8af67c5f53bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.805329 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 961/1885] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:22.806538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc03d77-54fb-4b95-928c-65fcaa14c07e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:22.808821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6e970-c976-4b60-94d8-8af67c5f53bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:22.810986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6e970-c976-4b60-94d8-8af67c5f53bd service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:22.822676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc03d77-54fb-4b95-928c-65fcaa14c07e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:22.824431 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 925/1886] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:22.825519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6e970-c976-4b60-94d8-8af67c5f53bd service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:22.831101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1afc2-84ce-4083-b39e-053b6d609612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:22.831779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1afc2-84ce-4083-b39e-053b6d609612 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.832118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1afc2-84ce-4083-b39e-053b6d609612 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.832401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1afc2-84ce-4083-b39e-053b6d609612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.841665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6e970-c976-4b60-94d8-8af67c5f53bd service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:22.854165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c7a80-d15c-4dd1-9f3a-a2e6b3d66ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:22.856423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c7a80-d15c-4dd1-9f3a-a2e6b3d66ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.856715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c7a80-d15c-4dd1-9f3a-a2e6b3d66ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.858738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c7a80-d15c-4dd1-9f3a-a2e6b3d66ffb admin admin] PATH_INFO: `/v3/projects/b3cfa791dfbf4e37b7522ff071ad668a/users/ba862657ba7a49db8c09bd2d8acc3534/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.872098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1afc2-84ce-4083-b39e-053b6d609612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:22.876770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1afc2-84ce-4083-b39e-053b6d609612 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:22.907480 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 962/1887] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:22.907823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c7a80-d15c-4dd1-9f3a-a2e6b3d66ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cfa791dfbf4e37b7522ff071ad668a, user_id=ba862657ba7a49db8c09bd2d8acc3534, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:22.913278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c7a80-d15c-4dd1-9f3a-a2e6b3d66ffb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:22.954724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53a024-8dfb-4208-83b0-0c48d7113e7b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:22.955019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53a024-8dfb-4208-83b0-0c48d7113e7b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:22.955326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53a024-8dfb-4208-83b0-0c48d7113e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:22.957193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 926/1888] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:22 2022] PUT /identity/v3/projects/b3cfa791dfbf4e37b7522ff071ad668a/users/ba862657ba7a49db8c09bd2d8acc3534/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:23.000790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7c53a024-8dfb-4208-83b0-0c48d7113e7b None None] MFA Rules not processed for user `ba862657ba7a49db8c09bd2d8acc3534`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:23.002035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7c53a024-8dfb-4208-83b0-0c48d7113e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:23.105177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c7a80-d15c-4dd1-9f3a-a2e6b3d66ffb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:23.106390 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 963/1889] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:23.218905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c7a80-d15c-4dd1-9f3a-a2e6b3d66ffb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:23.248980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d8e5f-7b96-43e9-8998-dd3080dfb6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:23.249780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d8e5f-7b96-43e9-8998-dd3080dfb6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:23.250118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d8e5f-7b96-43e9-8998-dd3080dfb6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:23.250518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d8e5f-7b96-43e9-8998-dd3080dfb6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:23.254497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d8e5f-7b96-43e9-8998-dd3080dfb6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:23.263979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d8e5f-7b96-43e9-8998-dd3080dfb6f1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:23.360472 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 927/1890] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:23 2022] POST /identity/v3/projects => generated 391 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:23.364232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53a024-8dfb-4208-83b0-0c48d7113e7b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:23.387954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53a024-8dfb-4208-83b0-0c48d7113e7b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:23.485580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d8e5f-7b96-43e9-8998-dd3080dfb6f1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:23.488101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9c9d8e5f-7b96-43e9-8998-dd3080dfb6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:23.632757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6de49-f105-4151-975e-b2335c5e26f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:23.637602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6de49-f105-4151-975e-b2335c5e26f2 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:23.637602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6de49-f105-4151-975e-b2335c5e26f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:23.637602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6de49-f105-4151-975e-b2335c5e26f2 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:23.640860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6de49-f105-4151-975e-b2335c5e26f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:23.644379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f6de49-f105-4151-975e-b2335c5e26f2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:23.710949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d8e5f-7b96-43e9-8998-dd3080dfb6f1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:23.715671 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 964/1891] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:23 2022] POST /identity/v3/users => generated 302 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:49:23.722803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6de49-f105-4151-975e-b2335c5e26f2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:23.724111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:23.725455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:23.725798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:23.726210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] PATH_INFO: `/v3/projects/f82ec89b09b84613a8e28fecf28e9f47` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:23.727738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82ec89b09b84613a8e28fecf28e9f47)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:23.730875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:23.760517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f6de49-f105-4151-975e-b2335c5e26f2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:23.781478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6700-93a1-440b-a836-9b2205d82215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:23.784899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6700-93a1-440b-a836-9b2205d82215 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:23.787533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6700-93a1-440b-a836-9b2205d82215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:23.787810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6700-93a1-440b-a836-9b2205d82215 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:23.788665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b6700-93a1-440b-a836-9b2205d82215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:23.797078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b6700-93a1-440b-a836-9b2205d82215 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:23.839514 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 965/1892] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:23.839514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6700-93a1-440b-a836-9b2205d82215 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:23.840380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f68b6700-93a1-440b-a836-9b2205d82215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:23.861752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6700-93a1-440b-a836-9b2205d82215 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:23.865961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82ec89b09b84613a8e28fecf28e9f47', 'request_id': 'req-bd811042-8107-45d9-ad1b-d97ab680af08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:23.884260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82ec89b09b84613a8e28fecf28e9f47', 'request_id': 'req-bd811042-8107-45d9-ad1b-d97ab680af08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:23.903329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82ec89b09b84613a8e28fecf28e9f47', 'request_id': 'req-bd811042-8107-45d9-ad1b-d97ab680af08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:23.931367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] The token cache is being invalidate because project f82ec89b09b84613a8e28fecf28e9f47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:23.931676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:23.935101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:23.938301 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 928/1893] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:23 2022] DELETE /identity/v3/projects/f82ec89b09b84613a8e28fecf28e9f47 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:23.939088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:23.948438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:23.990178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:23.990511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:23.991105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:23.991611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] PATH_INFO: `/v3/projects/4ebb99804f8549d893890dc485f0cdbb` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:23.993065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ebb99804f8549d893890dc485f0cdbb)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:23.997348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:24.146939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ebb99804f8549d893890dc485f0cdbb', 'request_id': 'req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.150603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ebb99804f8549d893890dc485f0cdbb', 'request_id': 'req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.152503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd811042-8107-45d9-ad1b-d97ab680af08 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:24.164683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ebb99804f8549d893890dc485f0cdbb', 'request_id': 'req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.187488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] The token cache is being invalidate because project 4ebb99804f8549d893890dc485f0cdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:24.187840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.188983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.192374 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 966/1894] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:23 2022] DELETE /identity/v3/projects/4ebb99804f8549d893890dc485f0cdbb => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:24.193766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:24.197048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:24.291709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17185705-ac8b-4d8b-a7c4-07c265d8cf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:24.292957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17185705-ac8b-4d8b-a7c4-07c265d8cf9a admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:24.293279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17185705-ac8b-4d8b-a7c4-07c265d8cf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:24.293584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17185705-ac8b-4d8b-a7c4-07c265d8cf9a admin admin] PATH_INFO: `/v3/projects/60ac58d9952248728a5d039abc142972/users/e581564f95484ff89772d585789410e2/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:24.327482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17185705-ac8b-4d8b-a7c4-07c265d8cf9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ac58d9952248728a5d039abc142972, user_id=e581564f95484ff89772d585789410e2, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:24.331405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17185705-ac8b-4d8b-a7c4-07c265d8cf9a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:24.347348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45ba0f-59e2-4e32-a8f8-7a90fd5c8252 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:24.364246 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 929/1895] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:23 2022] PUT /identity/v3/projects/60ac58d9952248728a5d039abc142972/users/e581564f95484ff89772d585789410e2/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:24.365413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17185705-ac8b-4d8b-a7c4-07c265d8cf9a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:24.367673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-17185705-ac8b-4d8b-a7c4-07c265d8cf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:24.488466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:24.492189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:24.492691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:24.492820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] PATH_INFO: `/v3/users/d045848741fb4b4e9efbbe14ffce9a26` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:24.494560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d045848741fb4b4e9efbbe14ffce9a26)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:24.503013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:24.505018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17185705-ac8b-4d8b-a7c4-07c265d8cf9a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:24.518175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:24.520247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:24.520533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:24.521444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] PATH_INFO: `/v3/projects/f95ca6e8c53c4337b83f51f112c043d5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:24.525794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95ca6e8c53c4337b83f51f112c043d5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:24.532717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:24.626006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd045848741fb4b4e9efbbe14ffce9a26'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.645453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd045848741fb4b4e9efbbe14ffce9a26'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.648180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd045848741fb4b4e9efbbe14ffce9a26'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.649639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd045848741fb4b4e9efbbe14ffce9a26'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.662938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd045848741fb4b4e9efbbe14ffce9a26'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.676919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95ca6e8c53c4337b83f51f112c043d5', 'request_id': 'req-42393ce2-ecae-404d-b38e-117e3ff14e6c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.695983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95ca6e8c53c4337b83f51f112c043d5', 'request_id': 'req-42393ce2-ecae-404d-b38e-117e3ff14e6c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.706701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95ca6e8c53c4337b83f51f112c043d5', 'request_id': 'req-42393ce2-ecae-404d-b38e-117e3ff14e6c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.708051 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 967/1896] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:24 2022] DELETE /identity/v3/users/d045848741fb4b4e9efbbe14ffce9a26 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:24.710814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:24.716233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:24.732794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] The token cache is being invalidate because project f95ca6e8c53c4337b83f51f112c043d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:24.733383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.736012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42393ce2-ecae-404d-b38e-117e3ff14e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:24.740670 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 930/1897] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:24 2022] DELETE /identity/v3/projects/f95ca6e8c53c4337b83f51f112c043d5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:24.742017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe6f89-1490-499e-b119-65a58d248953 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:24.742542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe6f89-1490-499e-b119-65a58d248953 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:24.742670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe6f89-1490-499e-b119-65a58d248953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:24.788332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bebe6f89-1490-499e-b119-65a58d248953 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:24.793790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bebe6f89-1490-499e-b119-65a58d248953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:24.906094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe0d63c-dfd7-4c09-8208-16170c91be14 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:24.920987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:24.921860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:24.922137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:24.922536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] PATH_INFO: `/v3/projects/890bcfbbdfe74b8ea56fff1b8b7dd6fe` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:24.923741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=890bcfbbdfe74b8ea56fff1b8b7dd6fe)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:24.926116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:24.960605 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 931/1898] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:24.961841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe6f89-1490-499e-b119-65a58d248953 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:24.963180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bebe6f89-1490-499e-b119-65a58d248953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:24.980603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe6f89-1490-499e-b119-65a58d248953 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:24.986431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd51df-7d77-45ca-93de-1cd7b7bfef1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:24.987147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd51df-7d77-45ca-93de-1cd7b7bfef1d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:24.987455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd51df-7d77-45ca-93de-1cd7b7bfef1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:24.988039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd51df-7d77-45ca-93de-1cd7b7bfef1d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:24.988947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd51df-7d77-45ca-93de-1cd7b7bfef1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:24.991003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd51df-7d77-45ca-93de-1cd7b7bfef1d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:25.003551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890bcfbbdfe74b8ea56fff1b8b7dd6fe', 'request_id': 'req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.010977 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 932/1899] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:25.011797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd51df-7d77-45ca-93de-1cd7b7bfef1d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:25.014131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a1dd51df-7d77-45ca-93de-1cd7b7bfef1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:25.016517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890bcfbbdfe74b8ea56fff1b8b7dd6fe', 'request_id': 'req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.025633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890bcfbbdfe74b8ea56fff1b8b7dd6fe', 'request_id': 'req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.039776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] The token cache is being invalidate because project 890bcfbbdfe74b8ea56fff1b8b7dd6fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:25.040190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.041387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1cdd2132-a3f0-442a-b3df-37cb230c1dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.043861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd51df-7d77-45ca-93de-1cd7b7bfef1d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:25.046765 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 968/1900] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:24 2022] DELETE /identity/v3/projects/890bcfbbdfe74b8ea56fff1b8b7dd6fe => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:25.048275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01827c7-bfb6-4423-99a0-5dad384d7d7e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:25.048632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01827c7-bfb6-4423-99a0-5dad384d7d7e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:25.048911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01827c7-bfb6-4423-99a0-5dad384d7d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:25.073030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e01827c7-bfb6-4423-99a0-5dad384d7d7e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:25.074255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e01827c7-bfb6-4423-99a0-5dad384d7d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:25.157135 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 969/1901] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:25.158136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01827c7-bfb6-4423-99a0-5dad384d7d7e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:25.160368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e01827c7-bfb6-4423-99a0-5dad384d7d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:25.176742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:25.178587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:25.178878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:25.179377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] PATH_INFO: `/v3/users/5ecd1055adb7455cb1e935e9cfc743e3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:25.180957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ecd1055adb7455cb1e935e9cfc743e3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:25.183259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01827c7-bfb6-4423-99a0-5dad384d7d7e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:25.195668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62f1f-eedc-445c-a969-4ac40d44928e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:25.201009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62f1f-eedc-445c-a969-4ac40d44928e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:25.201489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62f1f-eedc-445c-a969-4ac40d44928e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:25.201971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b62f1f-eedc-445c-a969-4ac40d44928e admin admin] PATH_INFO: `/v3/projects/60ac58d9952248728a5d039abc142972/users/e581564f95484ff89772d585789410e2/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:25.203809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:25.205313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b62f1f-eedc-445c-a969-4ac40d44928e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ac58d9952248728a5d039abc142972, user_id=e581564f95484ff89772d585789410e2, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:25.224697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b62f1f-eedc-445c-a969-4ac40d44928e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:25.257376 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 970/1902] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:25 2022] PUT /identity/v3/projects/60ac58d9952248728a5d039abc142972/users/e581564f95484ff89772d585789410e2/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:25.268498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62f1f-eedc-445c-a969-4ac40d44928e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:25.270210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65b62f1f-eedc-445c-a969-4ac40d44928e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:25.313899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ecd1055adb7455cb1e935e9cfc743e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.332309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ecd1055adb7455cb1e935e9cfc743e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.333239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ecd1055adb7455cb1e935e9cfc743e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.334544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ecd1055adb7455cb1e935e9cfc743e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.357506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ecd1055adb7455cb1e935e9cfc743e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.377653 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 933/1903] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:25 2022] DELETE /identity/v3/users/5ecd1055adb7455cb1e935e9cfc743e3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:25.377653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:25.394783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:25.437571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b62f1f-eedc-445c-a969-4ac40d44928e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:25.572882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d91b8-a7b2-4570-a929-88a4fa0ea27f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:25.590160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900cd29-a5cc-4e13-9eb5-32bb01f748ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:25.593135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900cd29-a5cc-4e13-9eb5-32bb01f748ea admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:25.595328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900cd29-a5cc-4e13-9eb5-32bb01f748ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:25.597109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900cd29-a5cc-4e13-9eb5-32bb01f748ea admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:25.600490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:25.601527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900cd29-a5cc-4e13-9eb5-32bb01f748ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:25.601684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:25.601908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900cd29-a5cc-4e13-9eb5-32bb01f748ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:25.602198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:25.602545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] PATH_INFO: `/v3/users/bb84f8e5ceae46c9b94fddb43f5c6d25` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:25.607665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900cd29-a5cc-4e13-9eb5-32bb01f748ea admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:25.608888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb84f8e5ceae46c9b94fddb43f5c6d25)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:25.611204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:25.644870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 934/1904] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:25.646680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d31f36-7136-49cc-9d63-0094a016394c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:25.646680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d31f36-7136-49cc-9d63-0094a016394c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:25.646680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d31f36-7136-49cc-9d63-0094a016394c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:25.701857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb84f8e5ceae46c9b94fddb43f5c6d25'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.711642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb84f8e5ceae46c9b94fddb43f5c6d25'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.712559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb84f8e5ceae46c9b94fddb43f5c6d25'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.714099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb84f8e5ceae46c9b94fddb43f5c6d25'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.726995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb84f8e5ceae46c9b94fddb43f5c6d25'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:25.733864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a2d31f36-7136-49cc-9d63-0094a016394c None None] MFA Rules not processed for user `e581564f95484ff89772d585789410e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:25.737005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a2d31f36-7136-49cc-9d63-0094a016394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:25.750588 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 971/1905] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:25 2022] DELETE /identity/v3/users/bb84f8e5ceae46c9b94fddb43f5c6d25 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:25.751618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:25.765598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:25.936750 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 935/1906] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:25.947817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d31f36-7136-49cc-9d63-0094a016394c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:25.952081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a2d31f36-7136-49cc-9d63-0094a016394c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:25.974544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d230d-55de-442a-a116-833e0f86a45a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:25.994787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:26.005008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.005008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.005008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] PATH_INFO: `/v3/projects/eb5b26cc735f46fdbc494a2c636741f8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:26.005362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d31f36-7136-49cc-9d63-0094a016394c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:26.005489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5b26cc735f46fdbc494a2c636741f8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:26.007950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:26.040599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9287c7-e722-4609-bda2-9626a0f6e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:26.041265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9287c7-e722-4609-bda2-9626a0f6e696 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.041647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9287c7-e722-4609-bda2-9626a0f6e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.041918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9287c7-e722-4609-bda2-9626a0f6e696 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:26.042721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9287c7-e722-4609-bda2-9626a0f6e696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:26.044691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9287c7-e722-4609-bda2-9626a0f6e696 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:26.117675 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 936/1907] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:25 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:26.118772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9287c7-e722-4609-bda2-9626a0f6e696 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:26.131551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9f9287c7-e722-4609-bda2-9626a0f6e696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:26.138434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5b26cc735f46fdbc494a2c636741f8', 'request_id': 'req-a7ea4bad-ce5d-4bd6-842b-00e118b38364'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.151502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5b26cc735f46fdbc494a2c636741f8', 'request_id': 'req-a7ea4bad-ce5d-4bd6-842b-00e118b38364'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.200620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5b26cc735f46fdbc494a2c636741f8', 'request_id': 'req-a7ea4bad-ce5d-4bd6-842b-00e118b38364'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.244284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] The token cache is being invalidate because project eb5b26cc735f46fdbc494a2c636741f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:26.247641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.251749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.255971 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 972/1908] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:25 2022] DELETE /identity/v3/projects/eb5b26cc735f46fdbc494a2c636741f8 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:26.266364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:26.271113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:26.373020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9287c7-e722-4609-bda2-9626a0f6e696 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:26.451045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea4bad-ce5d-4bd6-842b-00e118b38364 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:26.464936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32524687-181c-4925-b70a-eb5f58331793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:26.465636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32524687-181c-4925-b70a-eb5f58331793 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.465912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32524687-181c-4925-b70a-eb5f58331793 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.466188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32524687-181c-4925-b70a-eb5f58331793 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:26.467030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32524687-181c-4925-b70a-eb5f58331793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:26.469084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32524687-181c-4925-b70a-eb5f58331793 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:26.502496 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 973/1909] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:26 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:26.503189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32524687-181c-4925-b70a-eb5f58331793 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:26.506337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-32524687-181c-4925-b70a-eb5f58331793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:26.525538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32524687-181c-4925-b70a-eb5f58331793 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:26.531346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:26.532547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.536782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.537213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] PATH_INFO: `/v3/projects/2a70c8fa45fc4e28b57464824a3d94c4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:26.540513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a70c8fa45fc4e28b57464824a3d94c4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:26.542666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:26.543361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aedc7b-2dee-4dac-be4f-4569c6961c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:26.544134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aedc7b-2dee-4dac-be4f-4569c6961c29 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.544331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aedc7b-2dee-4dac-be4f-4569c6961c29 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.544711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aedc7b-2dee-4dac-be4f-4569c6961c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:26.548248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b4aedc7b-2dee-4dac-be4f-4569c6961c29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:26.633858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aedc7b-2dee-4dac-be4f-4569c6961c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:26.635619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aedc7b-2dee-4dac-be4f-4569c6961c29 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:26.649773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a70c8fa45fc4e28b57464824a3d94c4', 'request_id': 'req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.664375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a70c8fa45fc4e28b57464824a3d94c4', 'request_id': 'req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.666812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 937/1910] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:26.671550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298671a7-f8b5-4a4a-af07-e9b276590fc8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.672156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298671a7-f8b5-4a4a-af07-e9b276590fc8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.672744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298671a7-f8b5-4a4a-af07-e9b276590fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:26.678742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a70c8fa45fc4e28b57464824a3d94c4', 'request_id': 'req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.720243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-298671a7-f8b5-4a4a-af07-e9b276590fc8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:26.722589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] The token cache is being invalidate because project 2a70c8fa45fc4e28b57464824a3d94c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:26.722837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.724351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:26.725984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-298671a7-f8b5-4a4a-af07-e9b276590fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:26.726395 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 974/1911] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:26 2022] DELETE /identity/v3/projects/2a70c8fa45fc4e28b57464824a3d94c4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:26.727575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:26.729645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:26.827185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ca1a8-e0a2-44ed-8294-3bbeabb04cef admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:26.841325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:26.842353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.842695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.843053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] PATH_INFO: `/v3/projects/07e3f4db69224d429f259029b3e5b77f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:26.845396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e3f4db69224d429f259029b3e5b77f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:26.851168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:26.858616 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 938/1912] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:26.859890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298671a7-f8b5-4a4a-af07-e9b276590fc8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:26.863755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-298671a7-f8b5-4a4a-af07-e9b276590fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:26.876342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298671a7-f8b5-4a4a-af07-e9b276590fc8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:26.881329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7fc73-6622-4f59-b61e-9a941577a5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:26.882057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fc73-6622-4f59-b61e-9a941577a5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.882410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fc73-6622-4f59-b61e-9a941577a5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.882752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7fc73-6622-4f59-b61e-9a941577a5a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:26.883546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7fc73-6622-4f59-b61e-9a941577a5a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:26.885565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7fc73-6622-4f59-b61e-9a941577a5a5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:26.899708 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 939/1913] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:26.899708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa965e2-8af2-412f-8ff7-5ace3c4cbddb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.899708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa965e2-8af2-412f-8ff7-5ace3c4cbddb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.899708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa965e2-8af2-412f-8ff7-5ace3c4cbddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:26.932893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-aaa965e2-8af2-412f-8ff7-5ace3c4cbddb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:26.934497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aaa965e2-8af2-412f-8ff7-5ace3c4cbddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:26.961249 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 940/1914] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:26.962708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5dc9-47fd-477c-a2e4-ed963321d43c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:26.963019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5dc9-47fd-477c-a2e4-ed963321d43c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:26.963279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b5dc9-47fd-477c-a2e4-ed963321d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.011534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-721b5dc9-47fd-477c-a2e4-ed963321d43c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:27.013029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-721b5dc9-47fd-477c-a2e4-ed963321d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:27.078460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e3f4db69224d429f259029b3e5b77f', 'request_id': 'req-8c546999-6016-47ab-af1a-699183e0c257'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.093467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e3f4db69224d429f259029b3e5b77f', 'request_id': 'req-8c546999-6016-47ab-af1a-699183e0c257'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.110635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e3f4db69224d429f259029b3e5b77f', 'request_id': 'req-8c546999-6016-47ab-af1a-699183e0c257'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.138564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] The token cache is being invalidate because project 07e3f4db69224d429f259029b3e5b77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:27.140293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.142394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.147325 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 975/1915] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:26 2022] DELETE /identity/v3/projects/07e3f4db69224d429f259029b3e5b77f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:27.150383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:27.154239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:27.159470 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 941/1916] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:27.160962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791c9f7-aa4b-42ea-9200-b96b654ed20f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.161248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791c9f7-aa4b-42ea-9200-b96b654ed20f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.161527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791c9f7-aa4b-42ea-9200-b96b654ed20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.187643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c546999-6016-47ab-af1a-699183e0c257 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:27.201476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c791c9f7-aa4b-42ea-9200-b96b654ed20f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:27.202675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c791c9f7-aa4b-42ea-9200-b96b654ed20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:27.206529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed5fb6-8239-4e65-a948-2652aa602766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:27.207615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5fb6-8239-4e65-a948-2652aa602766 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.208729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5fb6-8239-4e65-a948-2652aa602766 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.209261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed5fb6-8239-4e65-a948-2652aa602766 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.210402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed5fb6-8239-4e65-a948-2652aa602766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:27.212614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed5fb6-8239-4e65-a948-2652aa602766 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:27.226563 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 942/1917] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:27.233566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ea6e-6de7-44c2-ac1a-df95f5517297 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.233923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ea6e-6de7-44c2-ac1a-df95f5517297 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.234746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ea6e-6de7-44c2-ac1a-df95f5517297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.244471 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 976/1918] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:27.253273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed5fb6-8239-4e65-a948-2652aa602766 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:27.282894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed5fb6-8239-4e65-a948-2652aa602766 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:27.304870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-90e3ea6e-6de7-44c2-ac1a-df95f5517297 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:27.306484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-90e3ea6e-6de7-44c2-ac1a-df95f5517297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:27.307135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b33ff4-b07c-4d50-bb39-c2e67b27f171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:27.309848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33ff4-b07c-4d50-bb39-c2e67b27f171 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.311069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33ff4-b07c-4d50-bb39-c2e67b27f171 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.311815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b33ff4-b07c-4d50-bb39-c2e67b27f171 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.317875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b33ff4-b07c-4d50-bb39-c2e67b27f171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:27.318167 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 943/1919] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:27.319125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3ea6e-6de7-44c2-ac1a-df95f5517297 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:27.320417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b33ff4-b07c-4d50-bb39-c2e67b27f171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:27.322570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b33ff4-b07c-4d50-bb39-c2e67b27f171 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:27.330763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3ea6e-6de7-44c2-ac1a-df95f5517297 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:27.336902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:27.338710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.338710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.338911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.339735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:27.340135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:27.341914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:27.345880 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 977/1920] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:27.347030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b33ff4-b07c-4d50-bb39-c2e67b27f171 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:27.358446 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 944/1921] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:27.360208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:27.363104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:27.363902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b33ff4-b07c-4d50-bb39-c2e67b27f171 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:27.371234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e0794-5a8c-4581-9e56-fd64c2464995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:27.372747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0794-5a8c-4581-9e56-fd64c2464995 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.373441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0794-5a8c-4581-9e56-fd64c2464995 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.374982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0794-5a8c-4581-9e56-fd64c2464995 admin admin] PATH_INFO: `/v3/projects/ee5731055469439cb1236f633e699267/users/d38ad252e8e3431ba77808785cc44224/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.380913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7985c-450f-4193-b019-b4ca4058be8e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:27.398808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:27.399704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.402322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.402500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] PATH_INFO: `/v3/users/ba862657ba7a49db8c09bd2d8acc3534` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.403056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0794-5a8c-4581-9e56-fd64c2464995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5731055469439cb1236f633e699267, user_id=d38ad252e8e3431ba77808785cc44224, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:27.404749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba862657ba7a49db8c09bd2d8acc3534)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:27.406281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0794-5a8c-4581-9e56-fd64c2464995 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:27.407812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:27.443293 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 978/1922] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:27 2022] PUT /identity/v3/projects/ee5731055469439cb1236f633e699267/users/d38ad252e8e3431ba77808785cc44224/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:27.445522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f396d1-3b51-4d5f-afff-292f1ec471eb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.446108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f396d1-3b51-4d5f-afff-292f1ec471eb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.446904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f396d1-3b51-4d5f-afff-292f1ec471eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.501785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-45f396d1-3b51-4d5f-afff-292f1ec471eb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:27.503568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-45f396d1-3b51-4d5f-afff-292f1ec471eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:27.540985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba862657ba7a49db8c09bd2d8acc3534'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.565306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba862657ba7a49db8c09bd2d8acc3534'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.566475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba862657ba7a49db8c09bd2d8acc3534'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.567524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba862657ba7a49db8c09bd2d8acc3534'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.593613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba862657ba7a49db8c09bd2d8acc3534'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:27.593857 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 979/1923] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:27.594700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f396d1-3b51-4d5f-afff-292f1ec471eb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:27.596108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-45f396d1-3b51-4d5f-afff-292f1ec471eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:27.612142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f396d1-3b51-4d5f-afff-292f1ec471eb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:27.619560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c05c4-4c1e-47d5-ae81-94dffce6f356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:27.620433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c05c4-4c1e-47d5-ae81-94dffce6f356 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.620661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c05c4-4c1e-47d5-ae81-94dffce6f356 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.620971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c05c4-4c1e-47d5-ae81-94dffce6f356 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.621830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c05c4-4c1e-47d5-ae81-94dffce6f356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:27.623793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432c05c4-4c1e-47d5-ae81-94dffce6f356 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:27.627390 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 945/1924] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:27 2022] DELETE /identity/v3/users/ba862657ba7a49db8c09bd2d8acc3534 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:27.627390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:27.628634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:27.672106 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 980/1925] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:27 2022] POST /identity/v3/projects => generated 395 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:27.673792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98751d1-65f7-48a3-8ba0-a5e63dc28cd2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.674109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98751d1-65f7-48a3-8ba0-a5e63dc28cd2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.674367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98751d1-65f7-48a3-8ba0-a5e63dc28cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.713548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e98751d1-65f7-48a3-8ba0-a5e63dc28cd2 None None] MFA Rules not processed for user `d38ad252e8e3431ba77808785cc44224`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:27.715748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e98751d1-65f7-48a3-8ba0-a5e63dc28cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:27.780438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecffe67-1c3a-4671-9a0d-27bc8f6856e0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:27.838900 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 981/1926] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:27.839823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98751d1-65f7-48a3-8ba0-a5e63dc28cd2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:27.910353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aba97-ac97-4559-bd86-fa2209fd44b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:27.911781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aba97-ac97-4559-bd86-fa2209fd44b8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.912228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aba97-ac97-4559-bd86-fa2209fd44b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.912370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930aba97-ac97-4559-bd86-fa2209fd44b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.913177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aba97-ac97-4559-bd86-fa2209fd44b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:27.914798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98751d1-65f7-48a3-8ba0-a5e63dc28cd2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:27.917295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930aba97-ac97-4559-bd86-fa2209fd44b8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:27.920103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b051e11-2d7a-42a8-963b-ca09850ec793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:27.920971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b051e11-2d7a-42a8-963b-ca09850ec793 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.921356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b051e11-2d7a-42a8-963b-ca09850ec793 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.921794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b051e11-2d7a-42a8-963b-ca09850ec793 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.922662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b051e11-2d7a-42a8-963b-ca09850ec793 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:27.923073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b051e11-2d7a-42a8-963b-ca09850ec793 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:27.925072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b051e11-2d7a-42a8-963b-ca09850ec793 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:27.939811 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 982/1927] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:27.941361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4a6cc-16ff-45c8-ae6d-cf47f43295a7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:27.941746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4a6cc-16ff-45c8-ae6d-cf47f43295a7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:27.942122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4a6cc-16ff-45c8-ae6d-cf47f43295a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:27.962598 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 946/1928] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:27 2022] POST /identity/v3/projects => generated 375 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:27.963809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-57f4a6cc-16ff-45c8-ae6d-cf47f43295a7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:27.964981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aba97-ac97-4559-bd86-fa2209fd44b8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:27.965273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57f4a6cc-16ff-45c8-ae6d-cf47f43295a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:28.086440 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 983/1929] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:28.087819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4a6cc-16ff-45c8-ae6d-cf47f43295a7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.091076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57f4a6cc-16ff-45c8-ae6d-cf47f43295a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:28.113490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4a6cc-16ff-45c8-ae6d-cf47f43295a7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.118025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930aba97-ac97-4559-bd86-fa2209fd44b8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.119051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719b1c3-4137-4b5a-8705-524890310757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.119883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719b1c3-4137-4b5a-8705-524890310757 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.120438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719b1c3-4137-4b5a-8705-524890310757 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.120985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9719b1c3-4137-4b5a-8705-524890310757 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.121822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719b1c3-4137-4b5a-8705-524890310757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.124197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9719b1c3-4137-4b5a-8705-524890310757 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.133814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2865954-f64d-4183-a321-01f2958fe1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.135688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2865954-f64d-4183-a321-01f2958fe1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.136015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2865954-f64d-4183-a321-01f2958fe1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.137454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2865954-f64d-4183-a321-01f2958fe1a6 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.142882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2865954-f64d-4183-a321-01f2958fe1a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.144872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2865954-f64d-4183-a321-01f2958fe1a6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.161926 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 984/1930] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:28 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:28.163341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719b1c3-4137-4b5a-8705-524890310757 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.214194 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 947/1931] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:27 2022] POST /identity/v3/users => generated 298 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:28.216169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2865954-f64d-4183-a321-01f2958fe1a6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.244086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2865954-f64d-4183-a321-01f2958fe1a6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.271602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9719b1c3-4137-4b5a-8705-524890310757 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.276883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed6915-12ec-4ff3-bae5-a1189f1f9ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.277506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6915-12ec-4ff3-bae5-a1189f1f9ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.277863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6915-12ec-4ff3-bae5-a1189f1f9ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.278285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed6915-12ec-4ff3-bae5-a1189f1f9ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.279292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed6915-12ec-4ff3-bae5-a1189f1f9ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.282418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed6915-12ec-4ff3-bae5-a1189f1f9ca6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.343099 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 985/1932] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:28 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:28.344283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed6915-12ec-4ff3-bae5-a1189f1f9ca6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.348355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e4ed6915-12ec-4ff3-bae5-a1189f1f9ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:28.359886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d6f4e-13e8-48b2-83de-c093103683fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.362217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d6f4e-13e8-48b2-83de-c093103683fa admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.362830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d6f4e-13e8-48b2-83de-c093103683fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.363581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d6f4e-13e8-48b2-83de-c093103683fa admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.364537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d6f4e-13e8-48b2-83de-c093103683fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.368555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d6f4e-13e8-48b2-83de-c093103683fa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.400032 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 948/1933] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:28 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:28.401101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d6f4e-13e8-48b2-83de-c093103683fa admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.413205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d6f4e-13e8-48b2-83de-c093103683fa admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.437305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed6915-12ec-4ff3-bae5-a1189f1f9ca6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.447888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d163-3c9a-44aa-a319-7a76524e9535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.448742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d163-3c9a-44aa-a319-7a76524e9535 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.449100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d163-3c9a-44aa-a319-7a76524e9535 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.449442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29d163-3c9a-44aa-a319-7a76524e9535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.496717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833b00e-0f4a-4488-8a3b-e62ffc43bd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.497405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833b00e-0f4a-4488-8a3b-e62ffc43bd28 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.497684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833b00e-0f4a-4488-8a3b-e62ffc43bd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.497962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833b00e-0f4a-4488-8a3b-e62ffc43bd28 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.498649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833b00e-0f4a-4488-8a3b-e62ffc43bd28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.500630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833b00e-0f4a-4488-8a3b-e62ffc43bd28 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.528939 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 949/1934] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:28 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:28.528939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833b00e-0f4a-4488-8a3b-e62ffc43bd28 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.532447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d163-3c9a-44aa-a319-7a76524e9535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.533893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29d163-3c9a-44aa-a319-7a76524e9535 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.537006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833b00e-0f4a-4488-8a3b-e62ffc43bd28 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.541686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d337f2-edc8-411b-872f-05e7983187c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.542321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d337f2-edc8-411b-872f-05e7983187c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.542607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d337f2-edc8-411b-872f-05e7983187c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.542884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d337f2-edc8-411b-872f-05e7983187c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.543593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d337f2-edc8-411b-872f-05e7983187c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.544784 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 986/1935] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:28.545612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d163-3c9a-44aa-a319-7a76524e9535 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.548520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d337f2-edc8-411b-872f-05e7983187c1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.554711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29d163-3c9a-44aa-a319-7a76524e9535 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.559693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15f4b0-6edd-439c-a248-679de0109357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.560087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15f4b0-6edd-439c-a248-679de0109357 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.560369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15f4b0-6edd-439c-a248-679de0109357 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.560646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15f4b0-6edd-439c-a248-679de0109357 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.561523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15f4b0-6edd-439c-a248-679de0109357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.563493 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 950/1936] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:28.564493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15f4b0-6edd-439c-a248-679de0109357 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.564629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d337f2-edc8-411b-872f-05e7983187c1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.576787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d337f2-edc8-411b-872f-05e7983187c1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.584952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915e127-04d3-4f80-a6ac-c1739cd06799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.585738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e127-04d3-4f80-a6ac-c1739cd06799 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.586125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e127-04d3-4f80-a6ac-c1739cd06799 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.589923 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 987/1937] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:28 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:28.590074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915e127-04d3-4f80-a6ac-c1739cd06799 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.590074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915e127-04d3-4f80-a6ac-c1739cd06799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.590261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15f4b0-6edd-439c-a248-679de0109357 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.590347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915e127-04d3-4f80-a6ac-c1739cd06799 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.602250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15f4b0-6edd-439c-a248-679de0109357 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.607117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7609-cf9c-4ffa-84a9-b4e7294c6543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.607989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7609-cf9c-4ffa-84a9-b4e7294c6543 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.608291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7609-cf9c-4ffa-84a9-b4e7294c6543 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.608803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7609-cf9c-4ffa-84a9-b4e7294c6543 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.609407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e7609-cf9c-4ffa-84a9-b4e7294c6543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.611183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e7609-cf9c-4ffa-84a9-b4e7294c6543 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.612046 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 951/1938] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:28.612918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915e127-04d3-4f80-a6ac-c1739cd06799 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.622965 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 988/1939] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:28.624100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7609-cf9c-4ffa-84a9-b4e7294c6543 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.629321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915e127-04d3-4f80-a6ac-c1739cd06799 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.634576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7609-cf9c-4ffa-84a9-b4e7294c6543 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.634870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06730-1595-4914-bc26-9cea60bfbad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.635592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06730-1595-4914-bc26-9cea60bfbad0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.635814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06730-1595-4914-bc26-9cea60bfbad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.636124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06730-1595-4914-bc26-9cea60bfbad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.636878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d06730-1595-4914-bc26-9cea60bfbad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.638674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d06730-1595-4914-bc26-9cea60bfbad0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.639464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6b6a8-e934-429f-b152-3b5301148c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.640143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6b6a8-e934-429f-b152-3b5301148c14 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.640429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6b6a8-e934-429f-b152-3b5301148c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.640702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6b6a8-e934-429f-b152-3b5301148c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.641405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6b6a8-e934-429f-b152-3b5301148c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.643090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6b6a8-e934-429f-b152-3b5301148c14 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.651001 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 952/1940] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:28.652384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06730-1595-4914-bc26-9cea60bfbad0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.655494 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 989/1941] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:28.656309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6b6a8-e934-429f-b152-3b5301148c14 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.662804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06730-1595-4914-bc26-9cea60bfbad0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.668081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd15df5-ec8f-462e-9ac0-f5048551640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.668617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6b6a8-e934-429f-b152-3b5301148c14 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.669127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd15df5-ec8f-462e-9ac0-f5048551640e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.669420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd15df5-ec8f-462e-9ac0-f5048551640e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.670008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd15df5-ec8f-462e-9ac0-f5048551640e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.670417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd15df5-ec8f-462e-9ac0-f5048551640e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.672094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd15df5-ec8f-462e-9ac0-f5048551640e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.673978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a20e9-86e9-4e8e-8e13-daebe6c636a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.675443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a20e9-86e9-4e8e-8e13-daebe6c636a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.675881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a20e9-86e9-4e8e-8e13-daebe6c636a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.676533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a20e9-86e9-4e8e-8e13-daebe6c636a5 admin admin] PATH_INFO: `/v3/projects/a4aa7937ec134dc0b36bb547b61843f7/users/db5dd4b53b23432f8c8e1af6036be398/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.686040 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 953/1942] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:28.686040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd15df5-ec8f-462e-9ac0-f5048551640e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.698114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd15df5-ec8f-462e-9ac0-f5048551640e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.700596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a20e9-86e9-4e8e-8e13-daebe6c636a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4aa7937ec134dc0b36bb547b61843f7, user_id=db5dd4b53b23432f8c8e1af6036be398, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.704268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a20e9-86e9-4e8e-8e13-daebe6c636a5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.712308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9710f24-71cf-4b8c-b598-6517e926fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.713791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9710f24-71cf-4b8c-b598-6517e926fc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.714084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9710f24-71cf-4b8c-b598-6517e926fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.714397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9710f24-71cf-4b8c-b598-6517e926fc65 admin admin] PATH_INFO: `/v3/projects/e44f933d1bdd43529eeb3383cc391c54/users/2f17c3567fb448bcb7909eca672fd2cc/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.727002 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 990/1943] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:28 2022] PUT /identity/v3/projects/a4aa7937ec134dc0b36bb547b61843f7/users/db5dd4b53b23432f8c8e1af6036be398/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:28.727898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a20e9-86e9-4e8e-8e13-daebe6c636a5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.733295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9710f24-71cf-4b8c-b598-6517e926fc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44f933d1bdd43529eeb3383cc391c54, user_id=2f17c3567fb448bcb7909eca672fd2cc, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.736023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9710f24-71cf-4b8c-b598-6517e926fc65 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.755980 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 954/1944] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:28 2022] PUT /identity/v3/projects/e44f933d1bdd43529eeb3383cc391c54/users/2f17c3567fb448bcb7909eca672fd2cc/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:28.755980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9710f24-71cf-4b8c-b598-6517e926fc65 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.793295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a20e9-86e9-4e8e-8e13-daebe6c636a5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.830186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9710f24-71cf-4b8c-b598-6517e926fc65 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.835932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7b672-75a4-4ca5-a664-b22966379791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.836835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b672-75a4-4ca5-a664-b22966379791 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.837120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b672-75a4-4ca5-a664-b22966379791 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.837396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7b672-75a4-4ca5-a664-b22966379791 admin admin] PATH_INFO: `/v3/projects/70c93c47827247b8b178018931efb9a4/users/4ef943b3272c48aa884a7ff4a7e854d0/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.856461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7b672-75a4-4ca5-a664-b22966379791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c93c47827247b8b178018931efb9a4, user_id=4ef943b3272c48aa884a7ff4a7e854d0, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.858519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e5eae-bf58-49ce-a48f-c27e1648ec6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.859160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7b672-75a4-4ca5-a664-b22966379791 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.859280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e5eae-bf58-49ce-a48f-c27e1648ec6c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.859458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e5eae-bf58-49ce-a48f-c27e1648ec6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.859716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e5eae-bf58-49ce-a48f-c27e1648ec6c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.860603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e5eae-bf58-49ce-a48f-c27e1648ec6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.862195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e5eae-bf58-49ce-a48f-c27e1648ec6c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.872920 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 991/1945] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:28.876079 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 955/1946] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:28 2022] PUT /identity/v3/projects/70c93c47827247b8b178018931efb9a4/users/4ef943b3272c48aa884a7ff4a7e854d0/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:28.876208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e5eae-bf58-49ce-a48f-c27e1648ec6c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.876313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2882bfe-2b9c-4b19-8ae8-64da78f5a4c4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.876313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2882bfe-2b9c-4b19-8ae8-64da78f5a4c4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.876313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2882bfe-2b9c-4b19-8ae8-64da78f5a4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.891551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e5eae-bf58-49ce-a48f-c27e1648ec6c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.907171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b2882bfe-2b9c-4b19-8ae8-64da78f5a4c4 None None] MFA Rules not processed for user `2f17c3567fb448bcb7909eca672fd2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:28.908397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b2882bfe-2b9c-4b19-8ae8-64da78f5a4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:28.948241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35558922-1fe1-4375-be7e-6b6927e3ff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.948944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35558922-1fe1-4375-be7e-6b6927e3ff10 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.949224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35558922-1fe1-4375-be7e-6b6927e3ff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.949564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35558922-1fe1-4375-be7e-6b6927e3ff10 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.950283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35558922-1fe1-4375-be7e-6b6927e3ff10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.951862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35558922-1fe1-4375-be7e-6b6927e3ff10 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.961511 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 992/1947] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:28.962348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35558922-1fe1-4375-be7e-6b6927e3ff10 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.966176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-35558922-1fe1-4375-be7e-6b6927e3ff10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:28.971301 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 956/1948] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:28.972142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2882bfe-2b9c-4b19-8ae8-64da78f5a4c4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:28.978223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35558922-1fe1-4375-be7e-6b6927e3ff10 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.982193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2882bfe-2b9c-4b19-8ae8-64da78f5a4c4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:28.983019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.983860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.984169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.984448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] PATH_INFO: `/v3/projects/b3cfa791dfbf4e37b7522ff071ad668a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:28.985696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cfa791dfbf4e37b7522ff071ad668a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:28.986988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b293081-4a9a-48f1-8c8c-8986067f8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:28.987656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:28.987849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b293081-4a9a-48f1-8c8c-8986067f8dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:28.988169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b293081-4a9a-48f1-8c8c-8986067f8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:28.988451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b293081-4a9a-48f1-8c8c-8986067f8dd6 admin admin] PATH_INFO: `/v3/projects/8ffe733694b24f6a9a12e8c1adcfb773/users/41c2e37277ec418987402bf0f8e571b9/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.004172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b293081-4a9a-48f1-8c8c-8986067f8dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffe733694b24f6a9a12e8c1adcfb773, user_id=41c2e37277ec418987402bf0f8e571b9, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.007409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b293081-4a9a-48f1-8c8c-8986067f8dd6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.028242 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 957/1949] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:28 2022] PUT /identity/v3/projects/8ffe733694b24f6a9a12e8c1adcfb773/users/41c2e37277ec418987402bf0f8e571b9/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:29.029433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81732398-6c73-4eee-857c-f2f8b3b96338 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.029731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81732398-6c73-4eee-857c-f2f8b3b96338 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.030017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81732398-6c73-4eee-857c-f2f8b3b96338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.033876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cfa791dfbf4e37b7522ff071ad668a', 'request_id': 'req-a40a61d4-0e66-4879-bd65-769e490966a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.041371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cfa791dfbf4e37b7522ff071ad668a', 'request_id': 'req-a40a61d4-0e66-4879-bd65-769e490966a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.046881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cfa791dfbf4e37b7522ff071ad668a', 'request_id': 'req-a40a61d4-0e66-4879-bd65-769e490966a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.058833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-81732398-6c73-4eee-857c-f2f8b3b96338 None None] MFA Rules not processed for user `4ef943b3272c48aa884a7ff4a7e854d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:29.059014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] The token cache is being invalidate because project b3cfa791dfbf4e37b7522ff071ad668a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:29.059105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.059762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.060096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-81732398-6c73-4eee-857c-f2f8b3b96338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.061606 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 993/1950] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:28 2022] DELETE /identity/v3/projects/b3cfa791dfbf4e37b7522ff071ad668a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:29.062364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.063635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.128459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a61d4-0e66-4879-bd65-769e490966a1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.132119 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 958/1951] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:29.132962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81732398-6c73-4eee-857c-f2f8b3b96338 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.134246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-81732398-6c73-4eee-857c-f2f8b3b96338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.138021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d414eaa-5db0-40a5-9524-43602e78cc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.139273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d414eaa-5db0-40a5-9524-43602e78cc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.139606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d414eaa-5db0-40a5-9524-43602e78cc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.139830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d414eaa-5db0-40a5-9524-43602e78cc3b admin admin] PATH_INFO: `/v3/projects/a4aa7937ec134dc0b36bb547b61843f7/users/db5dd4b53b23432f8c8e1af6036be398/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.141953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d414eaa-5db0-40a5-9524-43602e78cc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4aa7937ec134dc0b36bb547b61843f7, user_id=db5dd4b53b23432f8c8e1af6036be398, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.144702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d414eaa-5db0-40a5-9524-43602e78cc3b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.149300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81732398-6c73-4eee-857c-f2f8b3b96338 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.154248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5861-5581-4c6b-ab57-6df4d7f95d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.154900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5861-5581-4c6b-ab57-6df4d7f95d4e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.155181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5861-5581-4c6b-ab57-6df4d7f95d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.155463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c5861-5581-4c6b-ab57-6df4d7f95d4e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.156210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5861-5581-4c6b-ab57-6df4d7f95d4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.165650 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 994/1952] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:29 2022] PUT /identity/v3/projects/a4aa7937ec134dc0b36bb547b61843f7/users/db5dd4b53b23432f8c8e1af6036be398/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:29.166023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c5861-5581-4c6b-ab57-6df4d7f95d4e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.166130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a34c8-af30-4629-aca9-8a14c4261e13 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.166130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a34c8-af30-4629-aca9-8a14c4261e13 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.166130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a34c8-af30-4629-aca9-8a14c4261e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.193445 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 959/1953] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:29 2022] POST /identity/v3/projects => generated 395 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:29.194288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5861-5581-4c6b-ab57-6df4d7f95d4e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.196426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9e4c5861-5581-4c6b-ab57-6df4d7f95d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.197177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d71a34c8-af30-4629-aca9-8a14c4261e13 None None] MFA Rules not processed for user `41c2e37277ec418987402bf0f8e571b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:29.199002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d71a34c8-af30-4629-aca9-8a14c4261e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.260847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c5861-5581-4c6b-ab57-6df4d7f95d4e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.265479 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 995/1954] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:29.265659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.266292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a34c8-af30-4629-aca9-8a14c4261e13 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.266776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.267155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.267535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] PATH_INFO: `/v3/users/e581564f95484ff89772d585789410e2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.267636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d71a34c8-af30-4629-aca9-8a14c4261e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.269084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e581564f95484ff89772d585789410e2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.271173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.280746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a34c8-af30-4629-aca9-8a14c4261e13 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.285373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e095fa-92af-4299-95b5-a2023cba6946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.286040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e095fa-92af-4299-95b5-a2023cba6946 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.286326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e095fa-92af-4299-95b5-a2023cba6946 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.286633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e095fa-92af-4299-95b5-a2023cba6946 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.287314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e095fa-92af-4299-95b5-a2023cba6946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.289258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e095fa-92af-4299-95b5-a2023cba6946 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.318822 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 996/1955] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:29 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:29.319022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e581564f95484ff89772d585789410e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.319128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf69f7-7be8-4f43-9f43-79aa3788f17a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.319128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf69f7-7be8-4f43-9f43-79aa3788f17a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.319128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf69f7-7be8-4f43-9f43-79aa3788f17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.324347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e581564f95484ff89772d585789410e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.324998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e581564f95484ff89772d585789410e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.325631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e581564f95484ff89772d585789410e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.337766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e581564f95484ff89772d585789410e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.343599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5fcf69f7-7be8-4f43-9f43-79aa3788f17a None None] MFA Rules not processed for user `db5dd4b53b23432f8c8e1af6036be398`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:29.344842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5fcf69f7-7be8-4f43-9f43-79aa3788f17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.350543 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 960/1956] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:29 2022] DELETE /identity/v3/users/e581564f95484ff89772d585789410e2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:29.351390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.352727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.418938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a9bd3-b8cc-46c2-8c30-fbf92f846704 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.425997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 997/1957] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:29.425997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf69f7-7be8-4f43-9f43-79aa3788f17a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.426259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b584303-cee3-44f0-b57f-71b99ea99a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.426259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b584303-cee3-44f0-b57f-71b99ea99a7e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.426259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b584303-cee3-44f0-b57f-71b99ea99a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.426529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5fcf69f7-7be8-4f43-9f43-79aa3788f17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.426650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b584303-cee3-44f0-b57f-71b99ea99a7e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.426650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b584303-cee3-44f0-b57f-71b99ea99a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.428098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b584303-cee3-44f0-b57f-71b99ea99a7e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.452793 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 961/1958] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:29 2022] POST /identity/v3/users => generated 304 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:29.452793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b584303-cee3-44f0-b57f-71b99ea99a7e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.454439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6b584303-cee3-44f0-b57f-71b99ea99a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.467358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b584303-cee3-44f0-b57f-71b99ea99a7e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.473537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c649c0b-80c2-42c1-8603-a71a72e4ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.474311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c649c0b-80c2-42c1-8603-a71a72e4ff7f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.474849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c649c0b-80c2-42c1-8603-a71a72e4ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.475124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c649c0b-80c2-42c1-8603-a71a72e4ff7f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.476081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c649c0b-80c2-42c1-8603-a71a72e4ff7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.478458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c649c0b-80c2-42c1-8603-a71a72e4ff7f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.494217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf69f7-7be8-4f43-9f43-79aa3788f17a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.499243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d97d8d-0cae-40c2-990b-b446a12ebd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.502874 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 962/1959] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:29 2022] POST /identity/v3/users => generated 294 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:29.503140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d97d8d-0cae-40c2-990b-b446a12ebd78 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.503140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d97d8d-0cae-40c2-990b-b446a12ebd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.503140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d97d8d-0cae-40c2-990b-b446a12ebd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.503394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c649c0b-80c2-42c1-8603-a71a72e4ff7f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.503478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d97d8d-0cae-40c2-990b-b446a12ebd78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.504684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d97d8d-0cae-40c2-990b-b446a12ebd78 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.506137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3c649c0b-80c2-42c1-8603-a71a72e4ff7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.556948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 998/1960] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:29 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:29.557951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d97d8d-0cae-40c2-990b-b446a12ebd78 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.627146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c649c0b-80c2-42c1-8603-a71a72e4ff7f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.643330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d97d8d-0cae-40c2-990b-b446a12ebd78 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.650695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23777fa0-32e0-40cb-9451-c132c533fe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.651734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23777fa0-32e0-40cb-9451-c132c533fe48 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.652066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23777fa0-32e0-40cb-9451-c132c533fe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.652367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23777fa0-32e0-40cb-9451-c132c533fe48 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.653187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23777fa0-32e0-40cb-9451-c132c533fe48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.657069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23777fa0-32e0-40cb-9451-c132c533fe48 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.673308 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 999/1961] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:29.674423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23777fa0-32e0-40cb-9451-c132c533fe48 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.690571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23777fa0-32e0-40cb-9451-c132c533fe48 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.695951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffeb03-2597-4e60-8581-1220e8a5db09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.696621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffeb03-2597-4e60-8581-1220e8a5db09 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.696897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffeb03-2597-4e60-8581-1220e8a5db09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.697171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffeb03-2597-4e60-8581-1220e8a5db09 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.697924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffeb03-2597-4e60-8581-1220e8a5db09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.699577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffeb03-2597-4e60-8581-1220e8a5db09 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.710913 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1000/1962] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:29.711702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffeb03-2597-4e60-8581-1220e8a5db09 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.724119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffeb03-2597-4e60-8581-1220e8a5db09 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.725221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1af9f-8616-41e3-bf92-14cf7f8c8779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.725884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1af9f-8616-41e3-bf92-14cf7f8c8779 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.726667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1af9f-8616-41e3-bf92-14cf7f8c8779 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.727072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1af9f-8616-41e3-bf92-14cf7f8c8779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.728909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc84dc-da72-408a-aed2-752afcfa282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.729558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc84dc-da72-408a-aed2-752afcfa282f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.729835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc84dc-da72-408a-aed2-752afcfa282f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.730105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc84dc-da72-408a-aed2-752afcfa282f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.730780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc84dc-da72-408a-aed2-752afcfa282f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.732714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc84dc-da72-408a-aed2-752afcfa282f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.754151 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1001/1963] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:29 2022] POST /identity/v3/users => generated 300 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:29.755247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc84dc-da72-408a-aed2-752afcfa282f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.764751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc84dc-da72-408a-aed2-752afcfa282f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.769459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677155aa-c343-42c2-8bf8-890556d6e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.770851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677155aa-c343-42c2-8bf8-890556d6e4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.771134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677155aa-c343-42c2-8bf8-890556d6e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.771411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677155aa-c343-42c2-8bf8-890556d6e4c8 admin admin] PATH_INFO: `/v3/projects/bea0e22ec8bf4889a046f35887efcd75/users/35e1d5f14f0a4cfdbefb33c658de9242/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.785722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677155aa-c343-42c2-8bf8-890556d6e4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea0e22ec8bf4889a046f35887efcd75, user_id=35e1d5f14f0a4cfdbefb33c658de9242, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.789139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677155aa-c343-42c2-8bf8-890556d6e4c8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.793854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1af9f-8616-41e3-bf92-14cf7f8c8779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.795454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e1af9f-8616-41e3-bf92-14cf7f8c8779 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.802120 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1002/1964] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:29 2022] PUT /identity/v3/projects/bea0e22ec8bf4889a046f35887efcd75/users/35e1d5f14f0a4cfdbefb33c658de9242/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:29.803077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677155aa-c343-42c2-8bf8-890556d6e4c8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.804675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-677155aa-c343-42c2-8bf8-890556d6e4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.806794 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 963/1965] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:29.807672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1af9f-8616-41e3-bf92-14cf7f8c8779 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.817532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1af9f-8616-41e3-bf92-14cf7f8c8779 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.870961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677155aa-c343-42c2-8bf8-890556d6e4c8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:29.875816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.876000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163a46f-42a5-4dc5-80d6-7db45edf4da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:29.876695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.876810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163a46f-42a5-4dc5-80d6-7db45edf4da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:29.876972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.877133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163a46f-42a5-4dc5-80d6-7db45edf4da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:29.877241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] PATH_INFO: `/v3/projects/60ac58d9952248728a5d039abc142972` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.877418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163a46f-42a5-4dc5-80d6-7db45edf4da0 admin admin] PATH_INFO: `/v3/projects/06bf78b652a0421f83c99b220ce334c6/users/9cb9502357fd45fd99a17d6df3061dbd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:29.878379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ac58d9952248728a5d039abc142972)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.880452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.892115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163a46f-42a5-4dc5-80d6-7db45edf4da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bf78b652a0421f83c99b220ce334c6, user_id=9cb9502357fd45fd99a17d6df3061dbd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:29.894927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163a46f-42a5-4dc5-80d6-7db45edf4da0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:29.908374 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 964/1966] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:29 2022] PUT /identity/v3/projects/06bf78b652a0421f83c99b220ce334c6/users/9cb9502357fd45fd99a17d6df3061dbd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:29.909207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163a46f-42a5-4dc5-80d6-7db45edf4da0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.936782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ac58d9952248728a5d039abc142972', 'request_id': 'req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.946620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ac58d9952248728a5d039abc142972', 'request_id': 'req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.953499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ac58d9952248728a5d039abc142972', 'request_id': 'req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.965438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] The token cache is being invalidate because project 60ac58d9952248728a5d039abc142972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:29.965931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.966707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:29.968614 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1003/1967] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:29 2022] DELETE /identity/v3/projects/60ac58d9952248728a5d039abc142972 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:29.972531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:29.974623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:29.976140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163a46f-42a5-4dc5-80d6-7db45edf4da0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.034704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e704d-4ff5-4c8d-8e6f-98ca757a7074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.035481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e704d-4ff5-4c8d-8e6f-98ca757a7074 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.035869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e704d-4ff5-4c8d-8e6f-98ca757a7074 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.036934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e704d-4ff5-4c8d-8e6f-98ca757a7074 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.037747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e704d-4ff5-4c8d-8e6f-98ca757a7074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.039443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e704d-4ff5-4c8d-8e6f-98ca757a7074 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.045848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b059333-ac08-4b61-ab9e-f72a6eb8cc30 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.049703 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 965/1968] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:30.051102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d13672-f6f0-46e4-9cb2-e7c80de0c6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.051766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d13672-f6f0-46e4-9cb2-e7c80de0c6fc admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.052088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d13672-f6f0-46e4-9cb2-e7c80de0c6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.052367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d13672-f6f0-46e4-9cb2-e7c80de0c6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.053327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d13672-f6f0-46e4-9cb2-e7c80de0c6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.053967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e704d-4ff5-4c8d-8e6f-98ca757a7074 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.054932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d13672-f6f0-46e4-9cb2-e7c80de0c6fc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.056127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-348e704d-4ff5-4c8d-8e6f-98ca757a7074 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:30.065769 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1004/1969] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:30.067043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f439d-6933-4d22-a31e-3c6b24125dfe None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.068038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f439d-6933-4d22-a31e-3c6b24125dfe None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.068323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f439d-6933-4d22-a31e-3c6b24125dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.069590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e704d-4ff5-4c8d-8e6f-98ca757a7074 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.074197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72e617-e846-47ab-8833-bb890336c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.074941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e617-e846-47ab-8833-bb890336c7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.075442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e617-e846-47ab-8833-bb890336c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.075815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72e617-e846-47ab-8833-bb890336c7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.076652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72e617-e846-47ab-8833-bb890336c7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.078582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72e617-e846-47ab-8833-bb890336c7a8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.087477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f17f439d-6933-4d22-a31e-3c6b24125dfe None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:30.088797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f17f439d-6933-4d22-a31e-3c6b24125dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:30.092769 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 966/1970] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:30.092769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72e617-e846-47ab-8833-bb890336c7a8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.094110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ac72e617-e846-47ab-8833-bb890336c7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:30.099998 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1005/1971] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:30.100634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f439d-6933-4d22-a31e-3c6b24125dfe None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.110035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f439d-6933-4d22-a31e-3c6b24125dfe None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.113090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72e617-e846-47ab-8833-bb890336c7a8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.115350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee556f63-2bcf-4230-94ac-360ee0e798de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.116560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee556f63-2bcf-4230-94ac-360ee0e798de admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.116872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee556f63-2bcf-4230-94ac-360ee0e798de admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.117558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee556f63-2bcf-4230-94ac-360ee0e798de admin admin] PATH_INFO: `/v3/projects/bea0e22ec8bf4889a046f35887efcd75/users/35e1d5f14f0a4cfdbefb33c658de9242/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.119020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c033f-495e-4307-906d-2225854c8049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.119162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee556f63-2bcf-4230-94ac-360ee0e798de admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea0e22ec8bf4889a046f35887efcd75, user_id=35e1d5f14f0a4cfdbefb33c658de9242, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.120834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c033f-495e-4307-906d-2225854c8049 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.120958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c033f-495e-4307-906d-2225854c8049 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.121267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c033f-495e-4307-906d-2225854c8049 admin admin] PATH_INFO: `/v3/projects/7a2f8778f8bb42768701c1aa124476f1/users/0dfd727814a14058921da30c636ccc63/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.121875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee556f63-2bcf-4230-94ac-360ee0e798de admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.144619 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1006/1972] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:30 2022] PUT /identity/v3/projects/bea0e22ec8bf4889a046f35887efcd75/users/35e1d5f14f0a4cfdbefb33c658de9242/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:30.144619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee556f63-2bcf-4230-94ac-360ee0e798de admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.144906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c033f-495e-4307-906d-2225854c8049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2f8778f8bb42768701c1aa124476f1, user_id=0dfd727814a14058921da30c636ccc63, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.144906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c033f-495e-4307-906d-2225854c8049 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.163256 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 967/1973] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:30 2022] PUT /identity/v3/projects/7a2f8778f8bb42768701c1aa124476f1/users/0dfd727814a14058921da30c636ccc63/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:30.164560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcacbb4-a399-4a6b-8996-5316584e67ec None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.164902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcacbb4-a399-4a6b-8996-5316584e67ec None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.165191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcacbb4-a399-4a6b-8996-5316584e67ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.184885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fbcacbb4-a399-4a6b-8996-5316584e67ec None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:30.189513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fbcacbb4-a399-4a6b-8996-5316584e67ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:30.205069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee556f63-2bcf-4230-94ac-360ee0e798de admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.262812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 968/1974] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:30.264288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909672-a875-45a1-ae02-6da94084da4f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.264578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909672-a875-45a1-ae02-6da94084da4f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.264964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14909672-a875-45a1-ae02-6da94084da4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.266485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6fc67-0d6d-49fd-80cc-e33f360c2cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.267457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6fc67-0d6d-49fd-80cc-e33f360c2cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.267817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6fc67-0d6d-49fd-80cc-e33f360c2cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.268224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6fc67-0d6d-49fd-80cc-e33f360c2cd2 admin admin] PATH_INFO: `/v3/projects/06bf78b652a0421f83c99b220ce334c6/users/9cb9502357fd45fd99a17d6df3061dbd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.270285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6fc67-0d6d-49fd-80cc-e33f360c2cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06bf78b652a0421f83c99b220ce334c6, user_id=9cb9502357fd45fd99a17d6df3061dbd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.273772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6fc67-0d6d-49fd-80cc-e33f360c2cd2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.295535 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1007/1975] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:30 2022] PUT /identity/v3/projects/06bf78b652a0421f83c99b220ce334c6/users/9cb9502357fd45fd99a17d6df3061dbd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:30.295535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6fc67-0d6d-49fd-80cc-e33f360c2cd2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.304248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-14909672-a875-45a1-ae02-6da94084da4f None None] MFA Rules not processed for user `35e1d5f14f0a4cfdbefb33c658de9242`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:30.308077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-14909672-a875-45a1-ae02-6da94084da4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:30.366084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6fc67-0d6d-49fd-80cc-e33f360c2cd2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.371244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee04f7f-371f-4d5a-b78b-2f89762f5670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.371926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee04f7f-371f-4d5a-b78b-2f89762f5670 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.372253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee04f7f-371f-4d5a-b78b-2f89762f5670 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.372520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee04f7f-371f-4d5a-b78b-2f89762f5670 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.373240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee04f7f-371f-4d5a-b78b-2f89762f5670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.374931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee04f7f-371f-4d5a-b78b-2f89762f5670 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.386747 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1008/1976] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:30.387476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee04f7f-371f-4d5a-b78b-2f89762f5670 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.397934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee04f7f-371f-4d5a-b78b-2f89762f5670 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.402901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b116-ff6b-4dcb-a990-10857941566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.403560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b116-ff6b-4dcb-a990-10857941566d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.403907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b116-ff6b-4dcb-a990-10857941566d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.404154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5b116-ff6b-4dcb-a990-10857941566d admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.404913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5b116-ff6b-4dcb-a990-10857941566d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:30.405227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5b116-ff6b-4dcb-a990-10857941566d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.411094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5b116-ff6b-4dcb-a990-10857941566d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.418857 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 969/1977] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:30.423290 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1009/1978] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:30.423441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425899b-a322-40bb-a0d1-09adb83aa6f8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.423441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425899b-a322-40bb-a0d1-09adb83aa6f8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.423441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425899b-a322-40bb-a0d1-09adb83aa6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.423696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b116-ff6b-4dcb-a990-10857941566d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.431574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5b116-ff6b-4dcb-a990-10857941566d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.436722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5b20-bb1f-4880-82ad-bf948c9f8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.437609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5b20-bb1f-4880-82ad-bf948c9f8e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.437908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5b20-bb1f-4880-82ad-bf948c9f8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.438172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c5b20-bb1f-4880-82ad-bf948c9f8e51 admin admin] PATH_INFO: `/v3/projects/7a2f8778f8bb42768701c1aa124476f1/users/0dfd727814a14058921da30c636ccc63/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.440209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c5b20-bb1f-4880-82ad-bf948c9f8e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2f8778f8bb42768701c1aa124476f1, user_id=0dfd727814a14058921da30c636ccc63, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.449905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c5b20-bb1f-4880-82ad-bf948c9f8e51 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.455213 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1010/1979] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:30 2022] PUT /identity/v3/projects/7a2f8778f8bb42768701c1aa124476f1/users/0dfd727814a14058921da30c636ccc63/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:30.455799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5b20-bb1f-4880-82ad-bf948c9f8e51 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.462295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d425899b-a322-40bb-a0d1-09adb83aa6f8 None None] MFA Rules not processed for user `9cb9502357fd45fd99a17d6df3061dbd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:30.463511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d425899b-a322-40bb-a0d1-09adb83aa6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:30.524731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c5b20-bb1f-4880-82ad-bf948c9f8e51 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.529828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea6fe1-c08a-4fe0-a77c-14482f286bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.530491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6fe1-c08a-4fe0-a77c-14482f286bff admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.530756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6fe1-c08a-4fe0-a77c-14482f286bff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.531030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea6fe1-c08a-4fe0-a77c-14482f286bff admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.531709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea6fe1-c08a-4fe0-a77c-14482f286bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.533682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea6fe1-c08a-4fe0-a77c-14482f286bff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.535179 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 970/1980] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:30.537154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425899b-a322-40bb-a0d1-09adb83aa6f8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.539797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d425899b-a322-40bb-a0d1-09adb83aa6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:30.564391 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1011/1981] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:30 2022] POST /identity/v3/projects => generated 395 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:30.565708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b1750-c453-4fab-8b72-a1197d4884bd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.566000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b1750-c453-4fab-8b72-a1197d4884bd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.566338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b1750-c453-4fab-8b72-a1197d4884bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.596772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-eb3b1750-c453-4fab-8b72-a1197d4884bd None None] MFA Rules not processed for user `0dfd727814a14058921da30c636ccc63`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:30.598436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-eb3b1750-c453-4fab-8b72-a1197d4884bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:30.623707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425899b-a322-40bb-a0d1-09adb83aa6f8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.667189 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1012/1982] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:30.668692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af8e04-4375-4d66-a064-f8a1fa6c2dda None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.669218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af8e04-4375-4d66-a064-f8a1fa6c2dda None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.669597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af8e04-4375-4d66-a064-f8a1fa6c2dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.688090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-62af8e04-4375-4d66-a064-f8a1fa6c2dda None None] MFA Rules not processed for user `4ef943b3272c48aa884a7ff4a7e854d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:30.689514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-62af8e04-4375-4d66-a064-f8a1fa6c2dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:30.691153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c8a34-c741-4e82-9a5f-81426ee62091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.691800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c8a34-c741-4e82-9a5f-81426ee62091 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.692128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c8a34-c741-4e82-9a5f-81426ee62091 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.692969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c8a34-c741-4e82-9a5f-81426ee62091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.746990 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1013/1983] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:30.749341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af8e04-4375-4d66-a064-f8a1fa6c2dda None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.762957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c8a34-c741-4e82-9a5f-81426ee62091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.764734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c8a34-c741-4e82-9a5f-81426ee62091 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.774217 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 971/1984] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:30.813203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c8a34-c741-4e82-9a5f-81426ee62091 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.813569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af8e04-4375-4d66-a064-f8a1fa6c2dda None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.819289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71668b-6ee6-45cb-bfc7-60723c799410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.819942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71668b-6ee6-45cb-bfc7-60723c799410 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.820320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71668b-6ee6-45cb-bfc7-60723c799410 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.820671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71668b-6ee6-45cb-bfc7-60723c799410 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.821422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71668b-6ee6-45cb-bfc7-60723c799410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.823443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71668b-6ee6-45cb-bfc7-60723c799410 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.824981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c8a34-c741-4e82-9a5f-81426ee62091 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.830783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797a517-06df-4ff4-bcf8-209d11c89e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.831724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797a517-06df-4ff4-bcf8-209d11c89e1e service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.831848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797a517-06df-4ff4-bcf8-209d11c89e1e service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.832187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797a517-06df-4ff4-bcf8-209d11c89e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.841327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797a517-06df-4ff4-bcf8-209d11c89e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.843196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797a517-06df-4ff4-bcf8-209d11c89e1e service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.847744 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1014/1985] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:30 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:30.849830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71668b-6ee6-45cb-bfc7-60723c799410 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.854503 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 972/1986] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:30.859497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71668b-6ee6-45cb-bfc7-60723c799410 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.865347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3616b7a-c1b0-4012-b1fd-ca9c0a0ff898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.866294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3616b7a-c1b0-4012-b1fd-ca9c0a0ff898 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.866737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3616b7a-c1b0-4012-b1fd-ca9c0a0ff898 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.867170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3616b7a-c1b0-4012-b1fd-ca9c0a0ff898 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.868180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3616b7a-c1b0-4012-b1fd-ca9c0a0ff898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.870218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3616b7a-c1b0-4012-b1fd-ca9c0a0ff898 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.885485 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1015/1987] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:49:30.887079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797a517-06df-4ff4-bcf8-209d11c89e1e service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.898751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797a517-06df-4ff4-bcf8-209d11c89e1e service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.904191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f23ac-0213-4bd3-8be9-e0f5aa23e897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.905073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f23ac-0213-4bd3-8be9-e0f5aa23e897 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.905488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f23ac-0213-4bd3-8be9-e0f5aa23e897 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.905959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f23ac-0213-4bd3-8be9-e0f5aa23e897 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.906781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f23ac-0213-4bd3-8be9-e0f5aa23e897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.908565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f23ac-0213-4bd3-8be9-e0f5aa23e897 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.922934 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 973/1988] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:30.924175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3616b7a-c1b0-4012-b1fd-ca9c0a0ff898 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:30.934956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3616b7a-c1b0-4012-b1fd-ca9c0a0ff898 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:30.939952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df45b60-9f4e-4c65-9a6b-d842eba54bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:30.940840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45b60-9f4e-4c65-9a6b-d842eba54bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.941119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45b60-9f4e-4c65-9a6b-d842eba54bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.941394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df45b60-9f4e-4c65-9a6b-d842eba54bd2 admin admin] PATH_INFO: `/v3/projects/cac9d686cedf4368ae6e500602e64596/users/2bcd816c4f3a495cbe7ce636cf0e2f8a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:30.956982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45b60-9f4e-4c65-9a6b-d842eba54bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac9d686cedf4368ae6e500602e64596, user_id=2bcd816c4f3a495cbe7ce636cf0e2f8a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:30.960115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df45b60-9f4e-4c65-9a6b-d842eba54bd2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:30.977052 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1016/1989] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:30 2022] PUT /identity/v3/projects/cac9d686cedf4368ae6e500602e64596/users/2bcd816c4f3a495cbe7ce636cf0e2f8a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:30.981549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e71a-d980-499f-95fb-399afe1021fd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:30.981840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e71a-d980-499f-95fb-399afe1021fd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:30.982118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83e71a-d980-499f-95fb-399afe1021fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:31.001147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8f83e71a-d980-499f-95fb-399afe1021fd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:31.002403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f83e71a-d980-499f-95fb-399afe1021fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:31.044154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df45b60-9f4e-4c65-9a6b-d842eba54bd2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:31.078375 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 974/1990] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:31.084217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e71a-d980-499f-95fb-399afe1021fd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:31.090879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f83e71a-d980-499f-95fb-399afe1021fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:31.120361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df45b60-9f4e-4c65-9a6b-d842eba54bd2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:31.126687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0384e5-c0aa-4f40-914e-098e2264c973 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:31.127269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0384e5-c0aa-4f40-914e-098e2264c973 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:31.127553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0384e5-c0aa-4f40-914e-098e2264c973 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:31.127834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0384e5-c0aa-4f40-914e-098e2264c973 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:31.130073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af0384e5-c0aa-4f40-914e-098e2264c973 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:31.155128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83e71a-d980-499f-95fb-399afe1021fd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:31.158875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d6308-e538-4fae-8f55-5d58c2134fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:31.159522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d6308-e538-4fae-8f55-5d58c2134fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:31.159948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d6308-e538-4fae-8f55-5d58c2134fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:31.160384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d6308-e538-4fae-8f55-5d58c2134fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:31.171029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d6308-e538-4fae-8f55-5d58c2134fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:31.172906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d6308-e538-4fae-8f55-5d58c2134fa3 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:31.183950 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 975/1991] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:31.184767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d6308-e538-4fae-8f55-5d58c2134fa3 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:31.202189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d6308-e538-4fae-8f55-5d58c2134fa3 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:31.209532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0384e5-c0aa-4f40-914e-098e2264c973 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:31.210250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:31.211256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:31.211366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0384e5-c0aa-4f40-914e-098e2264c973 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:31.211632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:31.212009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] PATH_INFO: `/v3/users/2f17c3567fb448bcb7909eca672fd2cc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:31.213357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f17c3567fb448bcb7909eca672fd2cc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:31.215296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:31.222663 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1017/1992] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:31.275193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f17c3567fb448bcb7909eca672fd2cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:31.287793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f17c3567fb448bcb7909eca672fd2cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:31.288644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f17c3567fb448bcb7909eca672fd2cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:31.292625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f17c3567fb448bcb7909eca672fd2cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:31.313289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f17c3567fb448bcb7909eca672fd2cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:31.334272 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 976/1993] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:31 2022] DELETE /identity/v3/users/2f17c3567fb448bcb7909eca672fd2cc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:31.337448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53493be-a12c-4cf8-9bdc-27b2bbd7ccbd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:31.337793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53493be-a12c-4cf8-9bdc-27b2bbd7ccbd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:31.338080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53493be-a12c-4cf8-9bdc-27b2bbd7ccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:31.361121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d53493be-a12c-4cf8-9bdc-27b2bbd7ccbd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:31.362322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d53493be-a12c-4cf8-9bdc-27b2bbd7ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:31.434162 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1018/1994] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:31.448682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:31.450630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:31.538741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204dfad5-fb72-43a2-a154-a716b6dc3e7e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:31.543158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a514906-e25a-4456-a3b3-69ddf9c340a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:31.543673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a514906-e25a-4456-a3b3-69ddf9c340a6 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:31.544138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a514906-e25a-4456-a3b3-69ddf9c340a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:31.544499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a514906-e25a-4456-a3b3-69ddf9c340a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:31.555587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a514906-e25a-4456-a3b3-69ddf9c340a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:31.557525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a514906-e25a-4456-a3b3-69ddf9c340a6 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:31.571612 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 977/1995] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:31.930019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53493be-a12c-4cf8-9bdc-27b2bbd7ccbd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:31.931407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d53493be-a12c-4cf8-9bdc-27b2bbd7ccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:31.949382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53493be-a12c-4cf8-9bdc-27b2bbd7ccbd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:31.955399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:31.956425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:31.956774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:31.957162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] PATH_INFO: `/v3/users/41c2e37277ec418987402bf0f8e571b9` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:31.958517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c2e37277ec418987402bf0f8e571b9)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:31.962291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:32.024024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a514906-e25a-4456-a3b3-69ddf9c340a6 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:32.025683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4a514906-e25a-4456-a3b3-69ddf9c340a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.038926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c2e37277ec418987402bf0f8e571b9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.046429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c2e37277ec418987402bf0f8e571b9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.047328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c2e37277ec418987402bf0f8e571b9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.049143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c2e37277ec418987402bf0f8e571b9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.053855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a514906-e25a-4456-a3b3-69ddf9c340a6 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:32.059120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a33f15fc-627f-4e69-801a-4b03265e9c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c2e37277ec418987402bf0f8e571b9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.065844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:32.068199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:32.073284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:32.074295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] PATH_INFO: `/v3/users/d38ad252e8e3431ba77808785cc44224` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:32.080004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38ad252e8e3431ba77808785cc44224)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:32.083797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:32.089606 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1019/1996] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:31 2022] DELETE /identity/v3/users/41c2e37277ec418987402bf0f8e571b9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:32.092067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa398b3-f477-4d37-bbca-c4b2c89ca61e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:32.092613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa398b3-f477-4d37-bbca-c4b2c89ca61e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:32.093000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa398b3-f477-4d37-bbca-c4b2c89ca61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:32.189647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38ad252e8e3431ba77808785cc44224'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.205831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6aa398b3-f477-4d37-bbca-c4b2c89ca61e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:32.209318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6aa398b3-f477-4d37-bbca-c4b2c89ca61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.220284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38ad252e8e3431ba77808785cc44224'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.221211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38ad252e8e3431ba77808785cc44224'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.222482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38ad252e8e3431ba77808785cc44224'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.257511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e374acd5-8c59-4e21-b7b4-ab682fb81dac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38ad252e8e3431ba77808785cc44224'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.279967 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 978/1997] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:32 2022] DELETE /identity/v3/users/d38ad252e8e3431ba77808785cc44224 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:32.280584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ea43-b039-4958-80fa-f3bcbad5b1f6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:32.280926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ea43-b039-4958-80fa-f3bcbad5b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:32.281209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76ea43-b039-4958-80fa-f3bcbad5b1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:32.329122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2c76ea43-b039-4958-80fa-f3bcbad5b1f6 None None] MFA Rules not processed for user `2bcd816c4f3a495cbe7ce636cf0e2f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:32.330504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2c76ea43-b039-4958-80fa-f3bcbad5b1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.396830 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1020/1998] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:32.398098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa398b3-f477-4d37-bbca-c4b2c89ca61e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:32.402474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6aa398b3-f477-4d37-bbca-c4b2c89ca61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.418064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa398b3-f477-4d37-bbca-c4b2c89ca61e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:32.436158 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 979/1999] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:32.437536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80c6fb-2b13-442e-93ee-cef1e710c722 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:32.437829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80c6fb-2b13-442e-93ee-cef1e710c722 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:32.438111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80c6fb-2b13-442e-93ee-cef1e710c722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:32.465539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2f80c6fb-2b13-442e-93ee-cef1e710c722 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:32.467182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f80c6fb-2b13-442e-93ee-cef1e710c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.493681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:32.494547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:32.494821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:32.495090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] PATH_INFO: `/v3/projects/e44f933d1bdd43529eeb3383cc391c54` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:32.496318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44f933d1bdd43529eeb3383cc391c54)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:32.498844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:32.554513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44f933d1bdd43529eeb3383cc391c54', 'request_id': 'req-495efc8a-1400-44cf-aa6d-64ebb5deaac9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.564363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44f933d1bdd43529eeb3383cc391c54', 'request_id': 'req-495efc8a-1400-44cf-aa6d-64ebb5deaac9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.573436 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 980/2000] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:32.573436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80c6fb-2b13-442e-93ee-cef1e710c722 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:32.579840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44f933d1bdd43529eeb3383cc391c54', 'request_id': 'req-495efc8a-1400-44cf-aa6d-64ebb5deaac9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.580267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f80c6fb-2b13-442e-93ee-cef1e710c722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.610568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] The token cache is being invalidate because project e44f933d1bdd43529eeb3383cc391c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:32.611412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.612376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:32.614851 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1021/2001] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:32 2022] DELETE /identity/v3/projects/e44f933d1bdd43529eeb3383cc391c54 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:32.616449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:32.620633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.708802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495efc8a-1400-44cf-aa6d-64ebb5deaac9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:32.714066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d0ba5-8e96-4197-a8f3-3b0f646ac06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:32.716932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80c6fb-2b13-442e-93ee-cef1e710c722 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:32.718986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d0ba5-8e96-4197-a8f3-3b0f646ac06e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:32.720912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d0ba5-8e96-4197-a8f3-3b0f646ac06e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:32.721383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d0ba5-8e96-4197-a8f3-3b0f646ac06e admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:32.722112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d0ba5-8e96-4197-a8f3-3b0f646ac06e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:32.724266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d0ba5-8e96-4197-a8f3-3b0f646ac06e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:32.765692 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1022/2002] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:32 2022] POST /identity/v3/projects => generated 397 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:32.766704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d0ba5-8e96-4197-a8f3-3b0f646ac06e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:32.768723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7e3d0ba5-8e96-4197-a8f3-3b0f646ac06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.782594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:32.783694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:32.784018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:32.784302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:32.786193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.803227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:32.805090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:32.819096 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 981/2003] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:32.820369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:32.822050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.833721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d0ba5-8e96-4197-a8f3-3b0f646ac06e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:32.837450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eeccee-05e5-4ed3-83c7-193a10e943f6 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:32.837755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6b50-5a5c-46e9-8be6-de804c29b564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:32.838468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6b50-5a5c-46e9-8be6-de804c29b564 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:32.838752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6b50-5a5c-46e9-8be6-de804c29b564 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:32.839107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6b50-5a5c-46e9-8be6-de804c29b564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:32.840964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3afa6b50-5a5c-46e9-8be6-de804c29b564 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:32.924337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:32.925358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:32.925869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:32.926200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] PATH_INFO: `/v3/users/35e1d5f14f0a4cfdbefb33c658de9242` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:32.946739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6b50-5a5c-46e9-8be6-de804c29b564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:32.947200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e1d5f14f0a4cfdbefb33c658de9242)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:32.951173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:32.951425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6b50-5a5c-46e9-8be6-de804c29b564 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:32.985202 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1023/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:32.986105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6b50-5a5c-46e9-8be6-de804c29b564 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:33.032964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6b50-5a5c-46e9-8be6-de804c29b564 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:33.051226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c074d9-e670-4581-ba70-b59e725633e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:33.052609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c074d9-e670-4581-ba70-b59e725633e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:33.052772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c074d9-e670-4581-ba70-b59e725633e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:33.053054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c074d9-e670-4581-ba70-b59e725633e1 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:33.053896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c074d9-e670-4581-ba70-b59e725633e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:33.056395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c074d9-e670-4581-ba70-b59e725633e1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:33.062062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e1d5f14f0a4cfdbefb33c658de9242'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:33.102732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e1d5f14f0a4cfdbefb33c658de9242'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:33.104250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e1d5f14f0a4cfdbefb33c658de9242'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:33.105439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e1d5f14f0a4cfdbefb33c658de9242'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:33.130626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e1d5f14f0a4cfdbefb33c658de9242'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:33.172415 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 982/2005] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:32 2022] DELETE /identity/v3/users/35e1d5f14f0a4cfdbefb33c658de9242 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:33.172961 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1024/2006] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:32 2022] POST /identity/v3/users => generated 305 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:33.173510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:33.177565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:33.289283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b30cb-79b3-40e1-8b62-34162bcebc49 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:33.294677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f63b5-de10-408c-a876-559da9b19a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:33.295573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f63b5-de10-408c-a876-559da9b19a0e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:33.295861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f63b5-de10-408c-a876-559da9b19a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:33.296177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f63b5-de10-408c-a876-559da9b19a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:33.297530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f63b5-de10-408c-a876-559da9b19a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:33.299512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f63b5-de10-408c-a876-559da9b19a0e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:33.315672 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 983/2007] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:33.316974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c074d9-e670-4581-ba70-b59e725633e1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:33.331344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c074d9-e670-4581-ba70-b59e725633e1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:33.337699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648aa0f-0c90-4439-92e2-a82fccb0bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:33.340640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648aa0f-0c90-4439-92e2-a82fccb0bef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:33.341176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648aa0f-0c90-4439-92e2-a82fccb0bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:33.341657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648aa0f-0c90-4439-92e2-a82fccb0bef6 admin admin] PATH_INFO: `/v3/projects/e1a411b39e0e48a6b4db8a57265e3e1f/users/a230769b24b244818bf8259559d5ebf4/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:33.362525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648aa0f-0c90-4439-92e2-a82fccb0bef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a411b39e0e48a6b4db8a57265e3e1f, user_id=a230769b24b244818bf8259559d5ebf4, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:33.366315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648aa0f-0c90-4439-92e2-a82fccb0bef6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:33.394034 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1025/2008] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:33 2022] PUT /identity/v3/projects/e1a411b39e0e48a6b4db8a57265e3e1f/users/a230769b24b244818bf8259559d5ebf4/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:33.398919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f63b5-de10-408c-a876-559da9b19a0e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:33.415205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f63b5-de10-408c-a876-559da9b19a0e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:33.536793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b3ef-7841-4ef5-ad58-48782083ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:33.537502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b3ef-7841-4ef5-ad58-48782083ba85 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:33.537790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b3ef-7841-4ef5-ad58-48782083ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:33.538072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4b3ef-7841-4ef5-ad58-48782083ba85 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:33.538807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4b3ef-7841-4ef5-ad58-48782083ba85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:33.540507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4b3ef-7841-4ef5-ad58-48782083ba85 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:33.552509 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 984/2009] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:33.557758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648aa0f-0c90-4439-92e2-a82fccb0bef6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:33.570654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648aa0f-0c90-4439-92e2-a82fccb0bef6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:33.577257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6bc4-e141-4298-bdab-f45573a2eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:33.578991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6bc4-e141-4298-bdab-f45573a2eeb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:33.579283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6bc4-e141-4298-bdab-f45573a2eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:33.579558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b6bc4-e141-4298-bdab-f45573a2eeb3 admin admin] PATH_INFO: `/v3/projects/e1a411b39e0e48a6b4db8a57265e3e1f/users/a230769b24b244818bf8259559d5ebf4/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:33.582278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b6bc4-e141-4298-bdab-f45573a2eeb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a411b39e0e48a6b4db8a57265e3e1f, user_id=a230769b24b244818bf8259559d5ebf4, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:33.587139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b6bc4-e141-4298-bdab-f45573a2eeb3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:33.606149 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1026/2010] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:33 2022] PUT /identity/v3/projects/e1a411b39e0e48a6b4db8a57265e3e1f/users/a230769b24b244818bf8259559d5ebf4/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:49:33.839883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b3ef-7841-4ef5-ad58-48782083ba85 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:33.841844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eee4b3ef-7841-4ef5-ad58-48782083ba85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:33.856207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4b3ef-7841-4ef5-ad58-48782083ba85 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:33.925759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:33.927247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:33.927533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:33.927804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] PATH_INFO: `/v3/projects/8ffe733694b24f6a9a12e8c1adcfb773` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:33.929126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffe733694b24f6a9a12e8c1adcfb773)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:33.931959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:33.983421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffe733694b24f6a9a12e8c1adcfb773', 'request_id': 'req-5f2cb467-2450-46d0-90e2-51e976e2dead'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:33.992466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffe733694b24f6a9a12e8c1adcfb773', 'request_id': 'req-5f2cb467-2450-46d0-90e2-51e976e2dead'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.000537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffe733694b24f6a9a12e8c1adcfb773', 'request_id': 'req-5f2cb467-2450-46d0-90e2-51e976e2dead'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.016289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] The token cache is being invalidate because project 8ffe733694b24f6a9a12e8c1adcfb773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:34.016691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.020090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.020090 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 985/2011] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:33 2022] DELETE /identity/v3/projects/8ffe733694b24f6a9a12e8c1adcfb773 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:34.024039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6bc4-e141-4298-bdab-f45573a2eeb3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:34.025860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6d0b6bc4-e141-4298-bdab-f45573a2eeb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:34.042918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b6bc4-e141-4298-bdab-f45573a2eeb3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:34.131749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:34.137183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:34.158121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:34.166373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.170793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.171074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] PATH_INFO: `/v3/users/0dfd727814a14058921da30c636ccc63` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.174355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dfd727814a14058921da30c636ccc63)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:34.178429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:34.234315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb467-2450-46d0-90e2-51e976e2dead admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:34.240036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:34.240942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.241421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.241750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] PATH_INFO: `/v3/projects/ee5731055469439cb1236f633e699267` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.243060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5731055469439cb1236f633e699267)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:34.246534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:34.248773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dfd727814a14058921da30c636ccc63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.257626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dfd727814a14058921da30c636ccc63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.258764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dfd727814a14058921da30c636ccc63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.259545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dfd727814a14058921da30c636ccc63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.278986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dfd727814a14058921da30c636ccc63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.301989 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1027/2012] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:34 2022] DELETE /identity/v3/users/0dfd727814a14058921da30c636ccc63 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:34.303498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:34.306087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:34.312720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5731055469439cb1236f633e699267', 'request_id': 'req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.324062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5731055469439cb1236f633e699267', 'request_id': 'req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.341675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5731055469439cb1236f633e699267', 'request_id': 'req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.374936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] The token cache is being invalidate because project ee5731055469439cb1236f633e699267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:34.377400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.378732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.381811 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 986/2013] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:34 2022] DELETE /identity/v3/projects/ee5731055469439cb1236f633e699267 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:34.386347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:34.402502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:34.421200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec586d-d8db-496d-bd78-30a8ae367a4e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:34.428453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:34.429420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.429713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.429993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] PATH_INFO: `/v3/projects/bea0e22ec8bf4889a046f35887efcd75` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.431293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea0e22ec8bf4889a046f35887efcd75)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:34.433467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:34.479582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1b7e5-57b5-49d7-b175-ec407685e5e4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:34.485068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:34.486618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.486904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.487344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] PATH_INFO: `/v3/users/db5dd4b53b23432f8c8e1af6036be398` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.488738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db5dd4b53b23432f8c8e1af6036be398)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:34.491361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:34.524379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea0e22ec8bf4889a046f35887efcd75', 'request_id': 'req-42612bfe-0c50-4390-8e7c-a13b5ea99aea'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.535644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea0e22ec8bf4889a046f35887efcd75', 'request_id': 'req-42612bfe-0c50-4390-8e7c-a13b5ea99aea'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.544929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea0e22ec8bf4889a046f35887efcd75', 'request_id': 'req-42612bfe-0c50-4390-8e7c-a13b5ea99aea'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.553606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db5dd4b53b23432f8c8e1af6036be398'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.561313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] The token cache is being invalidate because project bea0e22ec8bf4889a046f35887efcd75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:34.562116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.563324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42612bfe-0c50-4390-8e7c-a13b5ea99aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.565479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db5dd4b53b23432f8c8e1af6036be398'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.569598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db5dd4b53b23432f8c8e1af6036be398'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.570605 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1028/2014] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:34 2022] DELETE /identity/v3/projects/bea0e22ec8bf4889a046f35887efcd75 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:34.572568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267f988-f065-4db9-ad6c-13b4fd35c2b0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.573047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267f988-f065-4db9-ad6c-13b4fd35c2b0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.573439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0267f988-f065-4db9-ad6c-13b4fd35c2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.577594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db5dd4b53b23432f8c8e1af6036be398'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.602340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-327ce342-7949-40ca-9d9e-ae313cf40cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db5dd4b53b23432f8c8e1af6036be398'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:34.623503 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 987/2015] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:34 2022] DELETE /identity/v3/users/db5dd4b53b23432f8c8e1af6036be398 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:34.629056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0267f988-f065-4db9-ad6c-13b4fd35c2b0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:34.631150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0267f988-f065-4db9-ad6c-13b4fd35c2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:34.713045 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1029/2016] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:34.725646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24326-fcb8-4ff3-9a33-9921e5fc77e8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.726328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24326-fcb8-4ff3-9a33-9921e5fc77e8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.727204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24326-fcb8-4ff3-9a33-9921e5fc77e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.750202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b7e24326-fcb8-4ff3-9a33-9921e5fc77e8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:34.751517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b7e24326-fcb8-4ff3-9a33-9921e5fc77e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:34.784587 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 988/2017] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:34.786609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267f988-f065-4db9-ad6c-13b4fd35c2b0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:34.803417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0267f988-f065-4db9-ad6c-13b4fd35c2b0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:34.811399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f111043-f545-4fab-9016-8b56cefd1614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:34.813079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710488ad-2f39-4f82-8a50-3577c308bb6b None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.813756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710488ad-2f39-4f82-8a50-3577c308bb6b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.814046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710488ad-2f39-4f82-8a50-3577c308bb6b None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.816359 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 989/2018] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:49:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:34.818078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f111043-f545-4fab-9016-8b56cefd1614 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.818368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f111043-f545-4fab-9016-8b56cefd1614 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.818645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f111043-f545-4fab-9016-8b56cefd1614 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.819460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f111043-f545-4fab-9016-8b56cefd1614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:34.819795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f111043-f545-4fab-9016-8b56cefd1614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:34.822357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f111043-f545-4fab-9016-8b56cefd1614 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:34.832332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeafa96-332f-478d-b1fc-668df8ba62d2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.833329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeafa96-332f-478d-b1fc-668df8ba62d2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.833547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeafa96-332f-478d-b1fc-668df8ba62d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.880143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-beeafa96-332f-478d-b1fc-668df8ba62d2 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:34.881135 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1030/2019] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:34.881700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-beeafa96-332f-478d-b1fc-668df8ba62d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:34.884386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f111043-f545-4fab-9016-8b56cefd1614 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:34.898657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f111043-f545-4fab-9016-8b56cefd1614 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:34.906320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea63e4-a360-47e0-88c2-616ceb8a3da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:34.907351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea63e4-a360-47e0-88c2-616ceb8a3da7 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:34.907856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea63e4-a360-47e0-88c2-616ceb8a3da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:34.927412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea63e4-a360-47e0-88c2-616ceb8a3da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:34.929630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea63e4-a360-47e0-88c2-616ceb8a3da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:34.933916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea63e4-a360-47e0-88c2-616ceb8a3da7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:34.998018 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1031/2020] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:34 2022] POST /identity/v3/projects => generated 403 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:35.003443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea63e4-a360-47e0-88c2-616ceb8a3da7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:35.021358 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 990/2021] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:35.067849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeafa96-332f-478d-b1fc-668df8ba62d2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:35.069281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-beeafa96-332f-478d-b1fc-668df8ba62d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.097098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea63e4-a360-47e0-88c2-616ceb8a3da7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:35.101526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeafa96-332f-478d-b1fc-668df8ba62d2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:35.103451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61557723-f86c-4b5b-8bcd-e0aa55d7823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:35.107017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61557723-f86c-4b5b-8bcd-e0aa55d7823a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.107301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61557723-f86c-4b5b-8bcd-e0aa55d7823a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.109205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61557723-f86c-4b5b-8bcd-e0aa55d7823a admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.111295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61557723-f86c-4b5b-8bcd-e0aa55d7823a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:35.118764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61557723-f86c-4b5b-8bcd-e0aa55d7823a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:35.151544 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1032/2022] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:35 2022] POST /identity/v3/users => generated 302 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:35.152766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61557723-f86c-4b5b-8bcd-e0aa55d7823a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:35.154562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-61557723-f86c-4b5b-8bcd-e0aa55d7823a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.167956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61557723-f86c-4b5b-8bcd-e0aa55d7823a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:35.173788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:35.174642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.174920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.175189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] PATH_INFO: `/v3/projects/7a2f8778f8bb42768701c1aa124476f1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.188703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2f8778f8bb42768701c1aa124476f1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:35.190816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:35.270182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2f8778f8bb42768701c1aa124476f1', 'request_id': 'req-805245fd-334a-466a-b4fd-73e9136dcaca'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.282278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2f8778f8bb42768701c1aa124476f1', 'request_id': 'req-805245fd-334a-466a-b4fd-73e9136dcaca'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.292141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2f8778f8bb42768701c1aa124476f1', 'request_id': 'req-805245fd-334a-466a-b4fd-73e9136dcaca'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.313940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] The token cache is being invalidate because project 7a2f8778f8bb42768701c1aa124476f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:35.314224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.316277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.318611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbc05a-4b16-4322-b023-503c342abc36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:35.320152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbc05a-4b16-4322-b023-503c342abc36 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.320431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbc05a-4b16-4322-b023-503c342abc36 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.320696 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1033/2023] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:35 2022] DELETE /identity/v3/projects/7a2f8778f8bb42768701c1aa124476f1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:35.323987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbc05a-4b16-4322-b023-503c342abc36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.324110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:35.324110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.325232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-21bbc05a-4b16-4322-b023-503c342abc36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.345471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbc05a-4b16-4322-b023-503c342abc36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:35.347860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bbc05a-4b16-4322-b023-503c342abc36 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:35.361302 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 991/2024] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:35.362729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e06405-e190-46c3-83d8-5ef383322e4c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.363227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e06405-e190-46c3-83d8-5ef383322e4c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.363562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e06405-e190-46c3-83d8-5ef383322e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.398339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-70e06405-e190-46c3-83d8-5ef383322e4c None None] MFA Rules not processed for user `a230769b24b244818bf8259559d5ebf4`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:35.400777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-70e06405-e190-46c3-83d8-5ef383322e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.407463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805245fd-334a-466a-b4fd-73e9136dcaca admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:35.417763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a9288-c46b-4abe-9561-ea034da83d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:35.418791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9288-c46b-4abe-9561-ea034da83d96 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.419237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9288-c46b-4abe-9561-ea034da83d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.419618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a9288-c46b-4abe-9561-ea034da83d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.420529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9288-c46b-4abe-9561-ea034da83d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:35.422996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a9288-c46b-4abe-9561-ea034da83d96 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:35.438708 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1034/2025] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:35.438708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932118c8-f0ae-4736-9943-89f05fa3f04b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.438708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932118c8-f0ae-4736-9943-89f05fa3f04b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.438708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932118c8-f0ae-4736-9943-89f05fa3f04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.478048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-932118c8-f0ae-4736-9943-89f05fa3f04b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:35.479549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-932118c8-f0ae-4736-9943-89f05fa3f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.504286 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1035/2026] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:35.505751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932118c8-f0ae-4736-9943-89f05fa3f04b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:35.511368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-932118c8-f0ae-4736-9943-89f05fa3f04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.537734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932118c8-f0ae-4736-9943-89f05fa3f04b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:35.571036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:35.575270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.575653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.575965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] PATH_INFO: `/v3/projects/a4aa7937ec134dc0b36bb547b61843f7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.583255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4aa7937ec134dc0b36bb547b61843f7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:35.585254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:35.603392 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 992/2027] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:35.604680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e06405-e190-46c3-83d8-5ef383322e4c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:35.625548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e06405-e190-46c3-83d8-5ef383322e4c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:35.632059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac519f-6972-4c25-9d52-0112b2a9584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:35.632817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac519f-6972-4c25-9d52-0112b2a9584f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.633169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac519f-6972-4c25-9d52-0112b2a9584f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.633520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac519f-6972-4c25-9d52-0112b2a9584f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.634323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac519f-6972-4c25-9d52-0112b2a9584f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:35.636146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac519f-6972-4c25-9d52-0112b2a9584f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:35.655403 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 993/2028] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:35.658035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a2e59-92e7-431f-af81-d1b9cc54017f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.658764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a2e59-92e7-431f-af81-d1b9cc54017f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.659051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a2e59-92e7-431f-af81-d1b9cc54017f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.684261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a24a2e59-92e7-431f-af81-d1b9cc54017f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:35.685475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a24a2e59-92e7-431f-af81-d1b9cc54017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.694947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4aa7937ec134dc0b36bb547b61843f7', 'request_id': 'req-8bba8ce0-3581-43bc-b56c-78d04ba74abf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.715470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4aa7937ec134dc0b36bb547b61843f7', 'request_id': 'req-8bba8ce0-3581-43bc-b56c-78d04ba74abf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.722586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4aa7937ec134dc0b36bb547b61843f7', 'request_id': 'req-8bba8ce0-3581-43bc-b56c-78d04ba74abf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.738301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] The token cache is being invalidate because project a4aa7937ec134dc0b36bb547b61843f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:35.738480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.739700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bba8ce0-3581-43bc-b56c-78d04ba74abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:35.741640 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1036/2029] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:35 2022] DELETE /identity/v3/projects/a4aa7937ec134dc0b36bb547b61843f7 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:35.742997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aedb1-2c73-4990-8091-829b476b1915 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.743292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aedb1-2c73-4990-8091-829b476b1915 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.743656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450aedb1-2c73-4990-8091-829b476b1915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.777016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-450aedb1-2c73-4990-8091-829b476b1915 None None] MFA Rules not processed for user `2bcd816c4f3a495cbe7ce636cf0e2f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:35.779279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-450aedb1-2c73-4990-8091-829b476b1915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.820871 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 994/2030] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:35.825641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a2e59-92e7-431f-af81-d1b9cc54017f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:35.827195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a24a2e59-92e7-431f-af81-d1b9cc54017f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:35.845555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a2e59-92e7-431f-af81-d1b9cc54017f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:35.859394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee101f41-1e25-4063-b7f1-e7d84ed35bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:35.859394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee101f41-1e25-4063-b7f1-e7d84ed35bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.859394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee101f41-1e25-4063-b7f1-e7d84ed35bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.859394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee101f41-1e25-4063-b7f1-e7d84ed35bd3 admin admin] PATH_INFO: `/v3/projects/6b34ba04480d4780ab93be91471d1068/users/2c5a6d4a4d24493aa87338ce556fd678/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.889136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee101f41-1e25-4063-b7f1-e7d84ed35bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b34ba04480d4780ab93be91471d1068, user_id=2c5a6d4a4d24493aa87338ce556fd678, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:35.894069 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1037/2031] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:35.894069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03674d-5f55-4cee-b67c-a40e496c094a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:35.894069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03674d-5f55-4cee-b67c-a40e496c094a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:35.894069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad03674d-5f55-4cee-b67c-a40e496c094a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:35.894445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee101f41-1e25-4063-b7f1-e7d84ed35bd3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:35.914846 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 995/2032] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:35 2022] PUT /identity/v3/projects/6b34ba04480d4780ab93be91471d1068/users/2c5a6d4a4d24493aa87338ce556fd678/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:35.916130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee101f41-1e25-4063-b7f1-e7d84ed35bd3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:35.929751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ad03674d-5f55-4cee-b67c-a40e496c094a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:35.930055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ad03674d-5f55-4cee-b67c-a40e496c094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:36.013968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee101f41-1e25-4063-b7f1-e7d84ed35bd3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.030624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797a02d-312e-4331-83b6-cc95e2a2a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.031546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a02d-312e-4331-83b6-cc95e2a2a5fd admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.032088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a02d-312e-4331-83b6-cc95e2a2a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.032545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797a02d-312e-4331-83b6-cc95e2a2a5fd admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.033497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a02d-312e-4331-83b6-cc95e2a2a5fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:36.034005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a02d-312e-4331-83b6-cc95e2a2a5fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.037378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797a02d-312e-4331-83b6-cc95e2a2a5fd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.050601 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1038/2033] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:36.052717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03674d-5f55-4cee-b67c-a40e496c094a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.054037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ad03674d-5f55-4cee-b67c-a40e496c094a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:36.062555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 996/2034] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:36.062555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fca94f-0173-4722-ad08-497368205430 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.062555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fca94f-0173-4722-ad08-497368205430 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.062555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fca94f-0173-4722-ad08-497368205430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.084086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-72fca94f-0173-4722-ad08-497368205430 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:36.085250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-72fca94f-0173-4722-ad08-497368205430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:36.093264 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 997/2035] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:36.097008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16daa2d-1cc6-4ef6-a5ca-011d8f469738 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.097008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16daa2d-1cc6-4ef6-a5ca-011d8f469738 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.097008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16daa2d-1cc6-4ef6-a5ca-011d8f469738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.116967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b16daa2d-1cc6-4ef6-a5ca-011d8f469738 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:36.118938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b16daa2d-1cc6-4ef6-a5ca-011d8f469738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:36.127604 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 998/2036] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:36.128399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16daa2d-1cc6-4ef6-a5ca-011d8f469738 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.138738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16daa2d-1cc6-4ef6-a5ca-011d8f469738 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.144226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f0629-6b49-4e40-84b3-5448825eeb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.145035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f0629-6b49-4e40-84b3-5448825eeb0e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.145418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f0629-6b49-4e40-84b3-5448825eeb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.145772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f0629-6b49-4e40-84b3-5448825eeb0e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.146376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad03674d-5f55-4cee-b67c-a40e496c094a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.146857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f0629-6b49-4e40-84b3-5448825eeb0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.148829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f0629-6b49-4e40-84b3-5448825eeb0e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.152655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93bc37-0ed5-400c-a5f6-bc66356d75cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.153295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93bc37-0ed5-400c-a5f6-bc66356d75cf service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.153586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93bc37-0ed5-400c-a5f6-bc66356d75cf service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.153867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93bc37-0ed5-400c-a5f6-bc66356d75cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.155731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0b93bc37-0ed5-400c-a5f6-bc66356d75cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:36.183157 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 999/2037] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:36 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:36.184222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f0629-6b49-4e40-84b3-5448825eeb0e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.189203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-872f0629-6b49-4e40-84b3-5448825eeb0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:36.237398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93bc37-0ed5-400c-a5f6-bc66356d75cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.240302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93bc37-0ed5-400c-a5f6-bc66356d75cf service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.265515 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1039/2038] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:36.267747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93bc37-0ed5-400c-a5f6-bc66356d75cf service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.270643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f0629-6b49-4e40-84b3-5448825eeb0e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.277432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ea91c-2ab4-42da-9fed-320d0e5e1c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.278399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ea91c-2ab4-42da-9fed-320d0e5e1c51 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.278886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ea91c-2ab4-42da-9fed-320d0e5e1c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.279539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ea91c-2ab4-42da-9fed-320d0e5e1c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.294608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93bc37-0ed5-400c-a5f6-bc66356d75cf service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.382552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ea91c-2ab4-42da-9fed-320d0e5e1c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.384065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ea91c-2ab4-42da-9fed-320d0e5e1c51 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.404943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b711c-58d0-4dba-991d-98951368de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.405688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b711c-58d0-4dba-991d-98951368de2c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.406001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b711c-58d0-4dba-991d-98951368de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.406113 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1000/2039] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:36.406267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b711c-58d0-4dba-991d-98951368de2c admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.407130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ea91c-2ab4-42da-9fed-320d0e5e1c51 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.407318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b711c-58d0-4dba-991d-98951368de2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:36.407877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b711c-58d0-4dba-991d-98951368de2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.410209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b711c-58d0-4dba-991d-98951368de2c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.421118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ea91c-2ab4-42da-9fed-320d0e5e1c51 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.427937 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1040/2040] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:36.429319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62635bd-2605-4dac-971c-cd2b91218096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.430127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62635bd-2605-4dac-971c-cd2b91218096 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.430594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62635bd-2605-4dac-971c-cd2b91218096 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.430965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62635bd-2605-4dac-971c-cd2b91218096 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.431355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b711c-58d0-4dba-991d-98951368de2c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.431984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62635bd-2605-4dac-971c-cd2b91218096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.435097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62635bd-2605-4dac-971c-cd2b91218096 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.448364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b711c-58d0-4dba-991d-98951368de2c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.460754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778cfb8-543a-4fbc-ac25-f30e6d8d6baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.461481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778cfb8-543a-4fbc-ac25-f30e6d8d6baf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.461856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778cfb8-543a-4fbc-ac25-f30e6d8d6baf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.462279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778cfb8-543a-4fbc-ac25-f30e6d8d6baf admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.463114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778cfb8-543a-4fbc-ac25-f30e6d8d6baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.470429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778cfb8-543a-4fbc-ac25-f30e6d8d6baf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.471025 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1001/2041] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:36 2022] POST /identity/v3/users => generated 287 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:36.472168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62635bd-2605-4dac-971c-cd2b91218096 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.487586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62635bd-2605-4dac-971c-cd2b91218096 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.496130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3aa3d-a568-4ec2-9142-9f8702e6ffd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.496994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3aa3d-a568-4ec2-9142-9f8702e6ffd3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.497368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3aa3d-a568-4ec2-9142-9f8702e6ffd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.497647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3aa3d-a568-4ec2-9142-9f8702e6ffd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.498608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3aa3d-a568-4ec2-9142-9f8702e6ffd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.502478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3aa3d-a568-4ec2-9142-9f8702e6ffd3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.513253 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1041/2042] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:36 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:36.514398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778cfb8-543a-4fbc-ac25-f30e6d8d6baf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.519941 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1002/2043] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:36.521477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3aa3d-a568-4ec2-9142-9f8702e6ffd3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.534039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3aa3d-a568-4ec2-9142-9f8702e6ffd3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.650475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282b02a-44b3-421d-8a61-4a0e0dbd0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.651160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b02a-44b3-421d-8a61-4a0e0dbd0143 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.651452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b02a-44b3-421d-8a61-4a0e0dbd0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.656088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282b02a-44b3-421d-8a61-4a0e0dbd0143 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.656928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282b02a-44b3-421d-8a61-4a0e0dbd0143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.658606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282b02a-44b3-421d-8a61-4a0e0dbd0143 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.679852 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1003/2044] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:36.683734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282b02a-44b3-421d-8a61-4a0e0dbd0143 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.686233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778cfb8-543a-4fbc-ac25-f30e6d8d6baf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.694707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867bd68-3414-4784-ac87-faa77c72cab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.695793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867bd68-3414-4784-ac87-faa77c72cab1 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.696278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867bd68-3414-4784-ac87-faa77c72cab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.696629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867bd68-3414-4784-ac87-faa77c72cab1 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.697401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867bd68-3414-4784-ac87-faa77c72cab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.698895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282b02a-44b3-421d-8a61-4a0e0dbd0143 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.700071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867bd68-3414-4784-ac87-faa77c72cab1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.724728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1acc51-764a-4fb4-bdb6-6e075a9d2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.726468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1acc51-764a-4fb4-bdb6-6e075a9d2df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.726851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1acc51-764a-4fb4-bdb6-6e075a9d2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.727298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1acc51-764a-4fb4-bdb6-6e075a9d2df1 admin admin] PATH_INFO: `/v3/projects/d9200151de28444b9818c51b3fc78f74/users/0f4b514764e24149b908d57de0121e1f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.746624 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1042/2045] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:36 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:36.747952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867bd68-3414-4784-ac87-faa77c72cab1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.761886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1acc51-764a-4fb4-bdb6-6e075a9d2df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9200151de28444b9818c51b3fc78f74, user_id=0f4b514764e24149b908d57de0121e1f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.764730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1acc51-764a-4fb4-bdb6-6e075a9d2df1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.765533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867bd68-3414-4784-ac87-faa77c72cab1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.777234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc487d8-3dbd-44bf-baa3-ed99dcf634ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.778498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc487d8-3dbd-44bf-baa3-ed99dcf634ed admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.778975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc487d8-3dbd-44bf-baa3-ed99dcf634ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.779360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc487d8-3dbd-44bf-baa3-ed99dcf634ed admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.780770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc487d8-3dbd-44bf-baa3-ed99dcf634ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.782369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc487d8-3dbd-44bf-baa3-ed99dcf634ed admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.797214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1043/2047] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:36.798963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32210bdd-2d6b-4a35-9190-4827454efc57 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.799585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32210bdd-2d6b-4a35-9190-4827454efc57 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.800366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32210bdd-2d6b-4a35-9190-4827454efc57 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.801558 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1004/2047] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:36 2022] PUT /identity/v3/projects/d9200151de28444b9818c51b3fc78f74/users/0f4b514764e24149b908d57de0121e1f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:49:36.803691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1fad7-d45f-4071-a2f5-16ff8c8d8534 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.804244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1fad7-d45f-4071-a2f5-16ff8c8d8534 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.804591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e1fad7-d45f-4071-a2f5-16ff8c8d8534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.806480 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1044/2048] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:36.807680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32210bdd-2d6b-4a35-9190-4827454efc57 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.854879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f7e1fad7-d45f-4071-a2f5-16ff8c8d8534 None None] MFA Rules not processed for user `0f4b514764e24149b908d57de0121e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:36.856699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f7e1fad7-d45f-4071-a2f5-16ff8c8d8534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:36.917043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32210bdd-2d6b-4a35-9190-4827454efc57 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.930178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76a227-b4d9-4e54-8353-ad5971a5798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.930987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76a227-b4d9-4e54-8353-ad5971a5798e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.931216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76a227-b4d9-4e54-8353-ad5971a5798e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.931397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76a227-b4d9-4e54-8353-ad5971a5798e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.932911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76a227-b4d9-4e54-8353-ad5971a5798e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:36.934836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76a227-b4d9-4e54-8353-ad5971a5798e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:36.951571 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1045/2049] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:36.959248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd589e5-cf99-4c7d-b441-fbec5acaed49 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.959530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd589e5-cf99-4c7d-b441-fbec5acaed49 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.959814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd589e5-cf99-4c7d-b441-fbec5acaed49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:36.977286 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1005/2050] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:36.978392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1fad7-d45f-4071-a2f5-16ff8c8d8534 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:36.991425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e1fad7-d45f-4071-a2f5-16ff8c8d8534 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:36.994044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0cd589e5-cf99-4c7d-b441-fbec5acaed49 None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:36.995874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0cd589e5-cf99-4c7d-b441-fbec5acaed49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:36.996565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44bb0-53af-4d05-9f06-b63e5964b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:36.998055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44bb0-53af-4d05-9f06-b63e5964b080 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:36.998351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44bb0-53af-4d05-9f06-b63e5964b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:36.998685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd44bb0-53af-4d05-9f06-b63e5964b080 admin admin] PATH_INFO: `/v3/projects/cf51b08278d246e498f59455e299ba89/users/c9bd4f2793ec48a5b31d081c269a39c2/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.016223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd44bb0-53af-4d05-9f06-b63e5964b080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf51b08278d246e498f59455e299ba89, user_id=c9bd4f2793ec48a5b31d081c269a39c2, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.018964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd44bb0-53af-4d05-9f06-b63e5964b080 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.039818 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1006/2051] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:36 2022] PUT /identity/v3/projects/cf51b08278d246e498f59455e299ba89/users/c9bd4f2793ec48a5b31d081c269a39c2/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:37.041063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44bb0-53af-4d05-9f06-b63e5964b080 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.084630 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1046/2052] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:49:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:37.086168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4915c-0554-4c60-9e22-f957d5e1f6ec None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.086603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4915c-0554-4c60-9e22-f957d5e1f6ec None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.087000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4915c-0554-4c60-9e22-f957d5e1f6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.105458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-00c4915c-0554-4c60-9e22-f957d5e1f6ec None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:37.106893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-00c4915c-0554-4c60-9e22-f957d5e1f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:37.126295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd44bb0-53af-4d05-9f06-b63e5964b080 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.133141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8de3f-e8f8-4701-b3a7-4005d363f01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.134637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8de3f-e8f8-4701-b3a7-4005d363f01a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.135226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8de3f-e8f8-4701-b3a7-4005d363f01a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.135646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8de3f-e8f8-4701-b3a7-4005d363f01a admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.136959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8de3f-e8f8-4701-b3a7-4005d363f01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.139439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8de3f-e8f8-4701-b3a7-4005d363f01a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.179211 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1007/2053] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:37 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:37.182567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8de3f-e8f8-4701-b3a7-4005d363f01a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.196787 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1047/2054] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:37.198038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4915c-0554-4c60-9e22-f957d5e1f6ec None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.217967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4915c-0554-4c60-9e22-f957d5e1f6ec None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.283874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8de3f-e8f8-4701-b3a7-4005d363f01a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.292526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8281f79-7128-4339-a91d-565d841a9843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.293950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8281f79-7128-4339-a91d-565d841a9843 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.295699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8281f79-7128-4339-a91d-565d841a9843 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.296030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8281f79-7128-4339-a91d-565d841a9843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.312783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8281f79-7128-4339-a91d-565d841a9843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.314817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8281f79-7128-4339-a91d-565d841a9843 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.322873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3147e-f242-4dfa-84bc-8dd9c8342907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.323556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3147e-f242-4dfa-84bc-8dd9c8342907 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.323840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3147e-f242-4dfa-84bc-8dd9c8342907 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.324164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3147e-f242-4dfa-84bc-8dd9c8342907 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.324863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3147e-f242-4dfa-84bc-8dd9c8342907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.326826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3147e-f242-4dfa-84bc-8dd9c8342907 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.334503 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1008/2055] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:37.335370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8281f79-7128-4339-a91d-565d841a9843 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.349987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8281f79-7128-4339-a91d-565d841a9843 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.354446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb243c6-31c9-4f9d-b141-1950e358d395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.355187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb243c6-31c9-4f9d-b141-1950e358d395 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.355596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb243c6-31c9-4f9d-b141-1950e358d395 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.355893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb243c6-31c9-4f9d-b141-1950e358d395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.360909 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1048/2056] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:37 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:37.362055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3147e-f242-4dfa-84bc-8dd9c8342907 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.367899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb243c6-31c9-4f9d-b141-1950e358d395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.370379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb243c6-31c9-4f9d-b141-1950e358d395 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.380925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3147e-f242-4dfa-84bc-8dd9c8342907 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.386581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22e412-d5f5-44f7-b3f2-42a48e61c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.387056 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1009/2057] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:37.387531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22e412-d5f5-44f7-b3f2-42a48e61c0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.387657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22e412-d5f5-44f7-b3f2-42a48e61c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.387971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22e412-d5f5-44f7-b3f2-42a48e61c0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.388823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22e412-d5f5-44f7-b3f2-42a48e61c0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.390448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22e412-d5f5-44f7-b3f2-42a48e61c0d1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.405135 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1049/2058] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:37.407367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb243c6-31c9-4f9d-b141-1950e358d395 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.422217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb243c6-31c9-4f9d-b141-1950e358d395 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.428282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8654-85d8-4979-9a93-ead64f29f819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.429256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8654-85d8-4979-9a93-ead64f29f819 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.429470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8654-85d8-4979-9a93-ead64f29f819 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.429791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8654-85d8-4979-9a93-ead64f29f819 admin admin] PATH_INFO: `/v3/projects/df8c11380ae94773874837c2348a692c/users/e67cac096d534c5f8d5a9ee9526e6eec/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.450126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8654-85d8-4979-9a93-ead64f29f819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8c11380ae94773874837c2348a692c, user_id=e67cac096d534c5f8d5a9ee9526e6eec, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.453609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8654-85d8-4979-9a93-ead64f29f819 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.472031 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1010/2059] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:37 2022] PUT /identity/v3/projects/df8c11380ae94773874837c2348a692c/users/e67cac096d534c5f8d5a9ee9526e6eec/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:37.474842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22e412-d5f5-44f7-b3f2-42a48e61c0d1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.485561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22e412-d5f5-44f7-b3f2-42a48e61c0d1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.552074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec4e8d-55f5-4527-b82f-c4df5eeb9ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.552756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4e8d-55f5-4527-b82f-c4df5eeb9ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.553044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4e8d-55f5-4527-b82f-c4df5eeb9ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.553299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4e8d-55f5-4527-b82f-c4df5eeb9ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.554230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec4e8d-55f5-4527-b82f-c4df5eeb9ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.556485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec4e8d-55f5-4527-b82f-c4df5eeb9ca2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.583863 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1050/2060] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:37.585269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8654-85d8-4979-9a93-ead64f29f819 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.602178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8654-85d8-4979-9a93-ead64f29f819 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.614070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1193151-36bd-4768-9d9b-681d36da93b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.615385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1193151-36bd-4768-9d9b-681d36da93b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.615845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1193151-36bd-4768-9d9b-681d36da93b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.616296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1193151-36bd-4768-9d9b-681d36da93b3 admin admin] PATH_INFO: `/v3/projects/df8c11380ae94773874837c2348a692c/users/e67cac096d534c5f8d5a9ee9526e6eec/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.621787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1193151-36bd-4768-9d9b-681d36da93b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df8c11380ae94773874837c2348a692c, user_id=e67cac096d534c5f8d5a9ee9526e6eec, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.631070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1193151-36bd-4768-9d9b-681d36da93b3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.652383 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1011/2061] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:37 2022] PUT /identity/v3/projects/df8c11380ae94773874837c2348a692c/users/e67cac096d534c5f8d5a9ee9526e6eec/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:37.655619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04fe39-ec36-434e-83ce-2a100109f2e5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.656188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04fe39-ec36-434e-83ce-2a100109f2e5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.657019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04fe39-ec36-434e-83ce-2a100109f2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.700726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0b04fe39-ec36-434e-83ce-2a100109f2e5 None None] MFA Rules not processed for user `e67cac096d534c5f8d5a9ee9526e6eec`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:37.702132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0b04fe39-ec36-434e-83ce-2a100109f2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:37.806160 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1051/2062] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:37 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:37.813935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1193151-36bd-4768-9d9b-681d36da93b3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.826026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1193151-36bd-4768-9d9b-681d36da93b3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.831248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b6d21-155d-4060-af2b-a83f4b336312 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.831960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b6d21-155d-4060-af2b-a83f4b336312 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.832264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b6d21-155d-4060-af2b-a83f4b336312 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.833344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b6d21-155d-4060-af2b-a83f4b336312 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.834156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b6d21-155d-4060-af2b-a83f4b336312 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:37.834474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b6d21-155d-4060-af2b-a83f4b336312 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.836812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b6d21-155d-4060-af2b-a83f4b336312 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.860555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1012/2063] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:37.861331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04fe39-ec36-434e-83ce-2a100109f2e5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:37.876351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04fe39-ec36-434e-83ce-2a100109f2e5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:37.885199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154147ce-f405-4c57-b408-b3f69a100b3f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:37.886029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154147ce-f405-4c57-b408-b3f69a100b3f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.886431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154147ce-f405-4c57-b408-b3f69a100b3f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.886807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154147ce-f405-4c57-b408-b3f69a100b3f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.887684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154147ce-f405-4c57-b408-b3f69a100b3f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:37.893322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154147ce-f405-4c57-b408-b3f69a100b3f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:37.951205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57a951-aa1b-4593-8a03-f1240f31729d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:37.951503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57a951-aa1b-4593-8a03-f1240f31729d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:37.951806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57a951-aa1b-4593-8a03-f1240f31729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:37.953767 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1052/2064] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:37 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:49:37.957650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154147ce-f405-4c57-b408-b3f69a100b3f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:38.064800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ac57a951-aa1b-4593-8a03-f1240f31729d None None] MFA Rules not processed for user `2c5a6d4a4d24493aa87338ce556fd678`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:38.066064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ac57a951-aa1b-4593-8a03-f1240f31729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:38.139887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154147ce-f405-4c57-b408-b3f69a100b3f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:38.156322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:38.157001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.157291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.157574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.158314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:38.158624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:38.160285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:38.188759 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1053/2065] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:49:38.203614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:38.213039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:38.230147 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1013/2066] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:38.237077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57a951-aa1b-4593-8a03-f1240f31729d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:38.340071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57a951-aa1b-4593-8a03-f1240f31729d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:38.346657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd66194-4536-4268-a2ce-73af40ad51e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:38.347586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd66194-4536-4268-a2ce-73af40ad51e9 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.349159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd66194-4536-4268-a2ce-73af40ad51e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.349655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd66194-4536-4268-a2ce-73af40ad51e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.350545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd66194-4536-4268-a2ce-73af40ad51e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:38.352800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd66194-4536-4268-a2ce-73af40ad51e9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:38.368568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d25f-1a0a-4fc7-856a-5cb6756e0ed6 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:38.385421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e33a4-b5cb-41bf-9e14-3d86d77cafdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:38.386096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e33a4-b5cb-41bf-9e14-3d86d77cafdd service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.386391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e33a4-b5cb-41bf-9e14-3d86d77cafdd service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.386673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e33a4-b5cb-41bf-9e14-3d86d77cafdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.391987 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1014/2067] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:38 2022] POST /identity/v3/projects => generated 403 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:38.396370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd66194-4536-4268-a2ce-73af40ad51e9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:38.402526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e33a4-b5cb-41bf-9e14-3d86d77cafdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:38.404276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e33a4-b5cb-41bf-9e14-3d86d77cafdd service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:38.435973 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1054/2068] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:38.451388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e31e7c-6e7b-4568-bae5-8552c45957cb None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.451678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e31e7c-6e7b-4568-bae5-8552c45957cb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.451983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e31e7c-6e7b-4568-bae5-8552c45957cb None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.454342 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1055/2069] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:38.468589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e31e7c-6e7b-4568-bae5-8552c45957cb None None] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:49:38.494532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd66194-4536-4268-a2ce-73af40ad51e9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:38.505179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52066d-e849-4bfc-aac4-41e7aad8f6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:38.506863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52066d-e849-4bfc-aac4-41e7aad8f6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.507663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52066d-e849-4bfc-aac4-41e7aad8f6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.512306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52066d-e849-4bfc-aac4-41e7aad8f6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.513421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52066d-e849-4bfc-aac4-41e7aad8f6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:38.515485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52066d-e849-4bfc-aac4-41e7aad8f6e2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:38.588559 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1015/2070] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:38 2022] POST /identity/v3/users => generated 308 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:38.592309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52066d-e849-4bfc-aac4-41e7aad8f6e2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:38.609765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52066d-e849-4bfc-aac4-41e7aad8f6e2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:38.617917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1a668-25e3-4d46-a399-a1d6c792c2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:38.619687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1a668-25e3-4d46-a399-a1d6c792c2eb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.620179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1a668-25e3-4d46-a399-a1d6c792c2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.620669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1a668-25e3-4d46-a399-a1d6c792c2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.622183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1a668-25e3-4d46-a399-a1d6c792c2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:38.623303 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-70e31e7c-6e7b-4568-bae5-8552c45957cb None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Mar 26 20:49:38.623627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e31e7c-6e7b-4568-bae5-8552c45957cb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:38.625665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1a668-25e3-4d46-a399-a1d6c792c2eb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:38.642876 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1016/2071] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:38.646769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1a668-25e3-4d46-a399-a1d6c792c2eb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:38.672540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1a668-25e3-4d46-a399-a1d6c792c2eb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:38.686103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29b84-7d47-446d-a842-18909b3e8d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:38.687448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29b84-7d47-446d-a842-18909b3e8d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.687794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29b84-7d47-446d-a842-18909b3e8d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.688155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df29b84-7d47-446d-a842-18909b3e8d6f admin admin] PATH_INFO: `/v3/projects/b25d0924595f498399f081ad0ec70bc9/users/eb4a5fdb93c74058acadbbbc49d3d70f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.720504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29b84-7d47-446d-a842-18909b3e8d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25d0924595f498399f081ad0ec70bc9, user_id=eb4a5fdb93c74058acadbbbc49d3d70f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:38.726567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df29b84-7d47-446d-a842-18909b3e8d6f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:38.726708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e31e7c-6e7b-4568-bae5-8552c45957cb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:38.736980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8d4fe-f7ed-4a86-b1b5-f189424d6773 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:38.739500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8d4fe-f7ed-4a86-b1b5-f189424d6773 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.740682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8d4fe-f7ed-4a86-b1b5-f189424d6773 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.742639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8d4fe-f7ed-4a86-b1b5-f189424d6773 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/projects/ba5099223fbf49998bbc369cc032d8fc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.744160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8d4fe-f7ed-4a86-b1b5-f189424d6773 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba5099223fbf49998bbc369cc032d8fc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:38.750789 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1017/2072] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:38 2022] PUT /identity/v3/projects/b25d0924595f498399f081ad0ec70bc9/users/eb4a5fdb93c74058acadbbbc49d3d70f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:38.754445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29b84-7d47-446d-a842-18909b3e8d6f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:38.759948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b8d4fe-f7ed-4a86-b1b5-f189424d6773 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:38.765769 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1056/2073] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:49:38 2022] GET /identity/v3/projects/ba5099223fbf49998bbc369cc032d8fc => generated 371 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:49:38.873824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df29b84-7d47-446d-a842-18909b3e8d6f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:38.880231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b1ff5-5186-4036-9dbb-0800abef2167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:38.881535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b1ff5-5186-4036-9dbb-0800abef2167 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.881833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b1ff5-5186-4036-9dbb-0800abef2167 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.882249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b1ff5-5186-4036-9dbb-0800abef2167 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.883169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b1ff5-5186-4036-9dbb-0800abef2167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:38.885308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b1ff5-5186-4036-9dbb-0800abef2167 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:38.900100 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1018/2074] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:49:38.903105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8d4fe-f7ed-4a86-b1b5-f189424d6773 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:38.916988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8d4fe-f7ed-4a86-b1b5-f189424d6773 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:38.922701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b42cee-3588-45b6-8225-68163d6788a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:38.923715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42cee-3588-45b6-8225-68163d6788a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.924154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42cee-3588-45b6-8225-68163d6788a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.924435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b42cee-3588-45b6-8225-68163d6788a0 admin admin] PATH_INFO: `/v3/projects/b25d0924595f498399f081ad0ec70bc9/users/eb4a5fdb93c74058acadbbbc49d3d70f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.930652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b42cee-3588-45b6-8225-68163d6788a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25d0924595f498399f081ad0ec70bc9, user_id=eb4a5fdb93c74058acadbbbc49d3d70f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:38.930652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b42cee-3588-45b6-8225-68163d6788a0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:38.945275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311b5e2-3268-4a8a-94c4-4c2b5db63637 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.945887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311b5e2-3268-4a8a-94c4-4c2b5db63637 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.946320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311b5e2-3268-4a8a-94c4-4c2b5db63637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.954188 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1057/2075] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:38 2022] PUT /identity/v3/projects/b25d0924595f498399f081ad0ec70bc9/users/eb4a5fdb93c74058acadbbbc49d3d70f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:38.985944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c1c4-3324-4ee5-9625-5d6113e2c60f None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:38.986243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c1c4-3324-4ee5-9625-5d6113e2c60f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:38.986571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c1c4-3324-4ee5-9625-5d6113e2c60f None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:38.988586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a311b5e2-3268-4a8a-94c4-4c2b5db63637 None None] MFA Rules not processed for user `c9bd4f2793ec48a5b31d081c269a39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:38.988979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1058/2076] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:38.990259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a311b5e2-3268-4a8a-94c4-4c2b5db63637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:39.001101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c1c4-3324-4ee5-9625-5d6113e2c60f None None] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:49:39.098913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c1c4-3324-4ee5-9625-5d6113e2c60f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.101835 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1019/2077] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:39.106974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311b5e2-3268-4a8a-94c4-4c2b5db63637 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.195690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311b5e2-3268-4a8a-94c4-4c2b5db63637 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.203687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69e6c-5b2f-484c-905f-98f0aafbd840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.204870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69e6c-5b2f-484c-905f-98f0aafbd840 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.205295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69e6c-5b2f-484c-905f-98f0aafbd840 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.205642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69e6c-5b2f-484c-905f-98f0aafbd840 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.206414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69e6c-5b2f-484c-905f-98f0aafbd840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.209415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f69e6c-5b2f-484c-905f-98f0aafbd840 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.219864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c1c4-3324-4ee5-9625-5d6113e2c60f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.237787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78714-b0f9-4f08-bc6c-3ab452071d4d tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.239528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78714-b0f9-4f08-bc6c-3ab452071d4d tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.239816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78714-b0f9-4f08-bc6c-3ab452071d4d tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.240148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d78714-b0f9-4f08-bc6c-3ab452071d4d tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/projects/ba5099223fbf49998bbc369cc032d8fc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.241729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78714-b0f9-4f08-bc6c-3ab452071d4d tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba5099223fbf49998bbc369cc032d8fc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.243979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d78714-b0f9-4f08-bc6c-3ab452071d4d tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.245157 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1020/2078] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:39 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:39.248674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69e6c-5b2f-484c-905f-98f0aafbd840 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.251419 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1059/2079] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:49:38 2022] GET /identity/v3/projects/ba5099223fbf49998bbc369cc032d8fc => generated 371 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:39.304361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78714-b0f9-4f08-bc6c-3ab452071d4d tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.325978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d78714-b0f9-4f08-bc6c-3ab452071d4d tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.357672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f69e6c-5b2f-484c-905f-98f0aafbd840 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.364814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1666-9182-480e-a6e0-6f4887cac56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.365489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1666-9182-480e-a6e0-6f4887cac56c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.365778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1666-9182-480e-a6e0-6f4887cac56c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.366417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30e1666-9182-480e-a6e0-6f4887cac56c admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.367136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e1666-9182-480e-a6e0-6f4887cac56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.369921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30e1666-9182-480e-a6e0-6f4887cac56c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.405058 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1021/2080] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:39 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:39.409044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1666-9182-480e-a6e0-6f4887cac56c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.420442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec52bd-be97-4a77-aa48-f2014bec0b4c tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.421198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30e1666-9182-480e-a6e0-6f4887cac56c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.421326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec52bd-be97-4a77-aa48-f2014bec0b4c tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.421616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec52bd-be97-4a77-aa48-f2014bec0b4c tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.422059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec52bd-be97-4a77-aa48-f2014bec0b4c tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.423141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec52bd-be97-4a77-aa48-f2014bec0b4c tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:39.423524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec52bd-be97-4a77-aa48-f2014bec0b4c tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.425485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec52bd-be97-4a77-aa48-f2014bec0b4c tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.427411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed576a-1947-442a-af8d-bb1b02085024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.429907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed576a-1947-442a-af8d-bb1b02085024 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.430157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed576a-1947-442a-af8d-bb1b02085024 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.430468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed576a-1947-442a-af8d-bb1b02085024 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.431829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed576a-1947-442a-af8d-bb1b02085024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.437036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed576a-1947-442a-af8d-bb1b02085024 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.444376 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1060/2081] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:39.447549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec52bd-be97-4a77-aa48-f2014bec0b4c tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.460660 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1022/2082] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:39.460827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec52bd-be97-4a77-aa48-f2014bec0b4c tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.462677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed576a-1947-442a-af8d-bb1b02085024 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.467088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec992c-c0c2-42af-b0b9-73013ef080b9 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.468092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec992c-c0c2-42af-b0b9-73013ef080b9 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.468624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec992c-c0c2-42af-b0b9-73013ef080b9 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.469519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec992c-c0c2-42af-b0b9-73013ef080b9 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.470786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec992c-c0c2-42af-b0b9-73013ef080b9 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.472753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed576a-1947-442a-af8d-bb1b02085024 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.473793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec992c-c0c2-42af-b0b9-73013ef080b9 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.478370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00fc03-9556-4675-b004-b456aae0aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.479356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00fc03-9556-4675-b004-b456aae0aa1e admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.479648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00fc03-9556-4675-b004-b456aae0aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.479957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00fc03-9556-4675-b004-b456aae0aa1e admin admin] PATH_INFO: `/v3/projects/ae20fc40138243ac8c0bade1ecc3340b/users/7affcca9509940fba9479bdabcc9fc2f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.501652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00fc03-9556-4675-b004-b456aae0aa1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae20fc40138243ac8c0bade1ecc3340b, user_id=7affcca9509940fba9479bdabcc9fc2f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.506399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00fc03-9556-4675-b004-b456aae0aa1e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.513516 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1061/2083] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:39 2022] POST /identity/v3/users => generated 381 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:49:39.514868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec992c-c0c2-42af-b0b9-73013ef080b9 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.528278 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1023/2084] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:39 2022] PUT /identity/v3/projects/ae20fc40138243ac8c0bade1ecc3340b/users/7affcca9509940fba9479bdabcc9fc2f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:39.529323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00fc03-9556-4675-b004-b456aae0aa1e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.538322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec992c-c0c2-42af-b0b9-73013ef080b9 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.614914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f66a94-da57-4d03-88b4-b023ce8bee3e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.615797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f66a94-da57-4d03-88b4-b023ce8bee3e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.616211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f66a94-da57-4d03-88b4-b023ce8bee3e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.616675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f66a94-da57-4d03-88b4-b023ce8bee3e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.617433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f66a94-da57-4d03-88b4-b023ce8bee3e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:39.617856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f66a94-da57-4d03-88b4-b023ce8bee3e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.619823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f66a94-da57-4d03-88b4-b023ce8bee3e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.633957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00fc03-9556-4675-b004-b456aae0aa1e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.636261 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1062/2085] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:39.637024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f66a94-da57-4d03-88b4-b023ce8bee3e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.644368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06c527-3236-40a2-a3bd-512b1b5de6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.645090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06c527-3236-40a2-a3bd-512b1b5de6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.645374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06c527-3236-40a2-a3bd-512b1b5de6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.645643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06c527-3236-40a2-a3bd-512b1b5de6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.646367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06c527-3236-40a2-a3bd-512b1b5de6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.648010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06c527-3236-40a2-a3bd-512b1b5de6c2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.662831 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1024/2086] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:39.663724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06c527-3236-40a2-a3bd-512b1b5de6c2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.674411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06c527-3236-40a2-a3bd-512b1b5de6c2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.684915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d0b4a-2bc3-49a6-9e76-691cbb1dc04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.685841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d0b4a-2bc3-49a6-9e76-691cbb1dc04f admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.686121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d0b4a-2bc3-49a6-9e76-691cbb1dc04f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.686407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d0b4a-2bc3-49a6-9e76-691cbb1dc04f admin admin] PATH_INFO: `/v3/projects/ae20fc40138243ac8c0bade1ecc3340b/users/7affcca9509940fba9479bdabcc9fc2f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.698544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d0b4a-2bc3-49a6-9e76-691cbb1dc04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae20fc40138243ac8c0bade1ecc3340b, user_id=7affcca9509940fba9479bdabcc9fc2f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.700754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d0b4a-2bc3-49a6-9e76-691cbb1dc04f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.713923 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1025/2087] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:39 2022] PUT /identity/v3/projects/ae20fc40138243ac8c0bade1ecc3340b/users/7affcca9509940fba9479bdabcc9fc2f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:39.733567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98991b-2e59-4639-aff1-364c537c680e None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.733736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f66a94-da57-4d03-88b4-b023ce8bee3e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.733908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98991b-2e59-4639-aff1-364c537c680e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.734159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e98991b-2e59-4639-aff1-364c537c680e None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.736197 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1026/2088] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:49:39.743066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98991b-2e59-4639-aff1-364c537c680e None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:49:39.853805 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-1e98991b-2e59-4639-aff1-364c537c680e None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Mar 26 20:49:39.854062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98991b-2e59-4639-aff1-364c537c680e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:39.892048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec994c3-bf7d-4c83-99a0-6acfac3d0c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.892698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec994c3-bf7d-4c83-99a0-6acfac3d0c0e service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.892978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec994c3-bf7d-4c83-99a0-6acfac3d0c0e service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.893250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec994c3-bf7d-4c83-99a0-6acfac3d0c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.895152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3ec994c3-bf7d-4c83-99a0-6acfac3d0c0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:39.967208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e98991b-2e59-4639-aff1-364c537c680e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:39.975538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e513cc-aeff-470c-ad4f-f51caa22343e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:39.977051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e513cc-aeff-470c-ad4f-f51caa22343e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:39.977535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e513cc-aeff-470c-ad4f-f51caa22343e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:39.978147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e513cc-aeff-470c-ad4f-f51caa22343e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/projects/ba5099223fbf49998bbc369cc032d8fc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:39.979094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e513cc-aeff-470c-ad4f-f51caa22343e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba5099223fbf49998bbc369cc032d8fc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:39.982213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e513cc-aeff-470c-ad4f-f51caa22343e tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:39.985147 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1027/2089] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:49:39 2022] GET /identity/v3/projects/ba5099223fbf49998bbc369cc032d8fc => generated 371 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:49:40.013403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5ffb-523b-48a9-a49d-594e7ba89473 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:40.013691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5ffb-523b-48a9-a49d-594e7ba89473 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:40.013969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5ffb-523b-48a9-a49d-594e7ba89473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:40.034247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec994c3-bf7d-4c83-99a0-6acfac3d0c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:40.040026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec994c3-bf7d-4c83-99a0-6acfac3d0c0e service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:40.080276 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1063/2090] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:40.085853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7f5f5ffb-523b-48a9-a49d-594e7ba89473 None None] MFA Rules not processed for user `eb4a5fdb93c74058acadbbbc49d3d70f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:40.087484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7f5f5ffb-523b-48a9-a49d-594e7ba89473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:40.237335 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1028/2091] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:40.443438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53201ad9-2a0a-4963-a13d-05769ea950c6 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:40.444027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53201ad9-2a0a-4963-a13d-05769ea950c6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:40.444364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53201ad9-2a0a-4963-a13d-05769ea950c6 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:40.447685 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1064/2092] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:40.459797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5ffb-523b-48a9-a49d-594e7ba89473 None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:49:40.495501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5ffb-523b-48a9-a49d-594e7ba89473 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:40.521583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5ffb-523b-48a9-a49d-594e7ba89473 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:40.535538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68032b-1da9-408c-b935-c39feb8e25e7 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:40.542423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68032b-1da9-408c-b935-c39feb8e25e7 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:40.542990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68032b-1da9-408c-b935-c39feb8e25e7 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:40.543488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68032b-1da9-408c-b935-c39feb8e25e7 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/projects/ba5099223fbf49998bbc369cc032d8fc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:40.545908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68032b-1da9-408c-b935-c39feb8e25e7 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba5099223fbf49998bbc369cc032d8fc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:40.548434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68032b-1da9-408c-b935-c39feb8e25e7 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:40.569878 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1029/2093] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:49:40 2022] GET /identity/v3/projects/ba5099223fbf49998bbc369cc032d8fc => generated 371 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:49:40.622328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53201ad9-2a0a-4963-a13d-05769ea950c6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:40.650126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53201ad9-2a0a-4963-a13d-05769ea950c6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:40.662439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:40.664338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:40.665797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:40.666978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/users/b967d3229ed84cc1acc06e4dd0457ba7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:40.699178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b967d3229ed84cc1acc06e4dd0457ba7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:40.701521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:40.768715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b967d3229ed84cc1acc06e4dd0457ba7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:40.779272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b967d3229ed84cc1acc06e4dd0457ba7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:40.782733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b967d3229ed84cc1acc06e4dd0457ba7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:40.783393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b967d3229ed84cc1acc06e4dd0457ba7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:40.795394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b967d3229ed84cc1acc06e4dd0457ba7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:40.819149 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1065/2094] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:40 2022] DELETE /identity/v3/users/b967d3229ed84cc1acc06e4dd0457ba7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:40.823343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68032b-1da9-408c-b935-c39feb8e25e7 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:40.826583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6d68032b-1da9-408c-b935-c39feb8e25e7 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:40.847575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68032b-1da9-408c-b935-c39feb8e25e7 tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:40.915770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67cac096d534c5f8d5a9ee9526e6eec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df8c11380ae94773874837c2348a692c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:40.916675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:40.916961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:40.917238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] PATH_INFO: `/v3/projects/ba5099223fbf49998bbc369cc032d8fc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:40.918757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ba5099223fbf49998bbc369cc032d8fc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:40.920444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:40.988150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5099223fbf49998bbc369cc032d8fc', 'request_id': 'req-53743e24-527d-4b0c-9fd1-c07fab82e75b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.000258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5099223fbf49998bbc369cc032d8fc', 'request_id': 'req-53743e24-527d-4b0c-9fd1-c07fab82e75b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.009810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5099223fbf49998bbc369cc032d8fc', 'request_id': 'req-53743e24-527d-4b0c-9fd1-c07fab82e75b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.032277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] The token cache is being invalidate because project ba5099223fbf49998bbc369cc032d8fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:41.032574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.036234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53743e24-527d-4b0c-9fd1-c07fab82e75b tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.037904 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1030/2095] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:40 2022] DELETE /identity/v3/projects/ba5099223fbf49998bbc369cc032d8fc => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:41.044645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:41.045956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:41.194999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b12e1-2606-4ad9-ad5c-642bd049c67f tempest-QuotasAdminTestV236-318925305 tempest-QuotasAdminTestV236-318925305-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:41.304732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:41.306230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:41.306654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:41.307101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] PATH_INFO: `/v3/users/0f4b514764e24149b908d57de0121e1f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:41.308736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f4b514764e24149b908d57de0121e1f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:41.310985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:41.389883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f4b514764e24149b908d57de0121e1f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.397503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f4b514764e24149b908d57de0121e1f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.398308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f4b514764e24149b908d57de0121e1f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.399012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f4b514764e24149b908d57de0121e1f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.415991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59d58ccc-caff-42ff-a8d8-dc753c1d2655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f4b514764e24149b908d57de0121e1f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:41.442426 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1066/2096] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:41 2022] DELETE /identity/v3/users/0f4b514764e24149b908d57de0121e1f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:41.446699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145d010-cf10-4f8d-8ae3-1ce1e4bd6d82 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:41.446985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145d010-cf10-4f8d-8ae3-1ce1e4bd6d82 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:41.447261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145d010-cf10-4f8d-8ae3-1ce1e4bd6d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:41.467059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d145d010-cf10-4f8d-8ae3-1ce1e4bd6d82 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:41.469619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d145d010-cf10-4f8d-8ae3-1ce1e4bd6d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:41.578520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931b35-2197-4e2e-b682-8cfd313b6f7c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:41.579091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931b35-2197-4e2e-b682-8cfd313b6f7c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:41.579091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17931b35-2197-4e2e-b682-8cfd313b6f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:41.592323 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1031/2097] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:41.601137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145d010-cf10-4f8d-8ae3-1ce1e4bd6d82 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:41.604347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d145d010-cf10-4f8d-8ae3-1ce1e4bd6d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:41.678402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-17931b35-2197-4e2e-b682-8cfd313b6f7c None None] MFA Rules not processed for user `7affcca9509940fba9479bdabcc9fc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:41.679862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-17931b35-2197-4e2e-b682-8cfd313b6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:41.772955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145d010-cf10-4f8d-8ae3-1ce1e4bd6d82 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:41.776902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be007aa-62ac-4f9d-bfb9-a59155e18434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:41.778272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be007aa-62ac-4f9d-bfb9-a59155e18434 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:41.778557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be007aa-62ac-4f9d-bfb9-a59155e18434 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:41.778828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be007aa-62ac-4f9d-bfb9-a59155e18434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:41.793225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be007aa-62ac-4f9d-bfb9-a59155e18434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:41.795553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be007aa-62ac-4f9d-bfb9-a59155e18434 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:41.806675 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1032/2098] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:41.820109 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1067/2099] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:41.831008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c7400-0708-4de9-b436-5b1fe19873a7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:41.831292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c7400-0708-4de9-b436-5b1fe19873a7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:41.831593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c7400-0708-4de9-b436-5b1fe19873a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:41.855470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1d3c7400-0708-4de9-b436-5b1fe19873a7 None None] MFA Rules not processed for user `c9bd4f2793ec48a5b31d081c269a39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:41.856860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1d3c7400-0708-4de9-b436-5b1fe19873a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:41.916732 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1033/2100] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:41.928003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17931b35-2197-4e2e-b682-8cfd313b6f7c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:41.929459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-17931b35-2197-4e2e-b682-8cfd313b6f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:42.029121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17931b35-2197-4e2e-b682-8cfd313b6f7c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:42.036602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:42.037364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:42.037748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:42.038099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:42.040502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:42.053275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:42.054827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:42.064659 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1068/2101] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:42.497592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c7400-0708-4de9-b436-5b1fe19873a7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:42.499124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1d3c7400-0708-4de9-b436-5b1fe19873a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:42.516286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c7400-0708-4de9-b436-5b1fe19873a7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:42.522573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:42.523580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:42.524003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:42.524477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] PATH_INFO: `/v3/users/2c5a6d4a4d24493aa87338ce556fd678` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:42.525885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5a6d4a4d24493aa87338ce556fd678)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:42.528369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:42.602613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5a6d4a4d24493aa87338ce556fd678'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:42.611043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5a6d4a4d24493aa87338ce556fd678'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:42.612030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5a6d4a4d24493aa87338ce556fd678'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:42.613081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5a6d4a4d24493aa87338ce556fd678'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:42.630857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5a6d4a4d24493aa87338ce556fd678'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:42.652885 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1034/2102] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:42 2022] DELETE /identity/v3/users/2c5a6d4a4d24493aa87338ce556fd678 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:42.850140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:42.855931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:42.869431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c66853-d310-46de-a68e-4a6cbb683fee service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:42.937627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:42.938782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:42.939220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:42.939658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] PATH_INFO: `/v3/projects/d9200151de28444b9818c51b3fc78f74` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:42.940934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9200151de28444b9818c51b3fc78f74)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:42.943602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:43.003222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9200151de28444b9818c51b3fc78f74', 'request_id': 'req-aad5223d-b866-4564-b60b-f1b932a13fcb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.018290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9200151de28444b9818c51b3fc78f74', 'request_id': 'req-aad5223d-b866-4564-b60b-f1b932a13fcb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.034473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9200151de28444b9818c51b3fc78f74', 'request_id': 'req-aad5223d-b866-4564-b60b-f1b932a13fcb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.051393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] The token cache is being invalidate because project d9200151de28444b9818c51b3fc78f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:43.051569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.052280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.054969 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1069/2103] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:42 2022] DELETE /identity/v3/projects/d9200151de28444b9818c51b3fc78f74 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:43.058897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:43.061804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:43.090882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e809f2-2cf1-45a1-826c-d0c7e3968439 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:43.167491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:43.169555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:43.170074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:43.170495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] PATH_INFO: `/v3/users/e67cac096d534c5f8d5a9ee9526e6eec` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:43.171976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67cac096d534c5f8d5a9ee9526e6eec)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:43.175375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:43.367329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67cac096d534c5f8d5a9ee9526e6eec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.378532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:43.381027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:43.382085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67cac096d534c5f8d5a9ee9526e6eec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.383263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67cac096d534c5f8d5a9ee9526e6eec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.383871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67cac096d534c5f8d5a9ee9526e6eec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.404062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5223d-b866-4564-b60b-f1b932a13fcb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:43.407354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67cac096d534c5f8d5a9ee9526e6eec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.435087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:43.437038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:43.437612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:43.438057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] PATH_INFO: `/v3/projects/6b34ba04480d4780ab93be91471d1068` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:43.441243 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1035/2104] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:43 2022] DELETE /identity/v3/users/e67cac096d534c5f8d5a9ee9526e6eec => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:43.450594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b34ba04480d4780ab93be91471d1068)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:43.462651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:43.603158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b34ba04480d4780ab93be91471d1068', 'request_id': 'req-ea1356f1-0a35-403d-807f-bb09e935a386'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.619174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b34ba04480d4780ab93be91471d1068', 'request_id': 'req-ea1356f1-0a35-403d-807f-bb09e935a386'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.627420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b34ba04480d4780ab93be91471d1068', 'request_id': 'req-ea1356f1-0a35-403d-807f-bb09e935a386'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.649075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] The token cache is being invalidate because project 6b34ba04480d4780ab93be91471d1068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:43.652525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.655310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.659579 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1070/2105] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:43 2022] DELETE /identity/v3/projects/6b34ba04480d4780ab93be91471d1068 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:49:43.664749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:43.667123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:43.822910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d172c4-cb24-4e7f-9960-691fbe0a4d38 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:43.897280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:43.898522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:43.899005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:43.899530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] PATH_INFO: `/v3/users/eb4a5fdb93c74058acadbbbc49d3d70f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:43.901096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4a5fdb93c74058acadbbbc49d3d70f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:43.904266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:43.970921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4a5fdb93c74058acadbbbc49d3d70f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.985941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4a5fdb93c74058acadbbbc49d3d70f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.986904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4a5fdb93c74058acadbbbc49d3d70f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:43.987877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4a5fdb93c74058acadbbbc49d3d70f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.001924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4a5fdb93c74058acadbbbc49d3d70f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.020392 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1036/2106] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:43 2022] DELETE /identity/v3/users/eb4a5fdb93c74058acadbbbc49d3d70f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:44.025136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.026666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:44.045944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1356f1-0a35-403d-807f-bb09e935a386 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.197523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.198726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.199203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.199695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] PATH_INFO: `/v3/projects/df8c11380ae94773874837c2348a692c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.201702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df8c11380ae94773874837c2348a692c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.204594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.306121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.307550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:44.326713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df8c11380ae94773874837c2348a692c', 'request_id': 'req-a687af19-138d-4f0d-afae-fe4ba3a014d6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.335743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d109a-1686-40a8-a146-8d216b4a7f01 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.355098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df8c11380ae94773874837c2348a692c', 'request_id': 'req-a687af19-138d-4f0d-afae-fe4ba3a014d6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.371440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df8c11380ae94773874837c2348a692c', 'request_id': 'req-a687af19-138d-4f0d-afae-fe4ba3a014d6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.386419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] The token cache is being invalidate because project df8c11380ae94773874837c2348a692c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:44.387000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.388325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a687af19-138d-4f0d-afae-fe4ba3a014d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.390137 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1071/2107] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:44 2022] DELETE /identity/v3/projects/df8c11380ae94773874837c2348a692c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:44.396984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74253-6832-4814-865b-efa050ffe4c4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.397498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74253-6832-4814-865b-efa050ffe4c4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.397919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc74253-6832-4814-865b-efa050ffe4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.420493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1dc74253-6832-4814-865b-efa050ffe4c4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:44.422105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1dc74253-6832-4814-865b-efa050ffe4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:44.455388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.456468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.456825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.457865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] PATH_INFO: `/v3/projects/b25d0924595f498399f081ad0ec70bc9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.459246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25d0924595f498399f081ad0ec70bc9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.461765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.496904 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1072/2108] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:44.505482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13ce10-7d73-49c0-95ba-acb7177864d2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.506036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13ce10-7d73-49c0-95ba-acb7177864d2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.506769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13ce10-7d73-49c0-95ba-acb7177864d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.516035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25d0924595f498399f081ad0ec70bc9', 'request_id': 'req-ca1e3c15-63d9-45c8-9883-2994ce51d996'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.527284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ce13ce10-7d73-49c0-95ba-acb7177864d2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:44.528010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25d0924595f498399f081ad0ec70bc9', 'request_id': 'req-ca1e3c15-63d9-45c8-9883-2994ce51d996'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.529137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce13ce10-7d73-49c0-95ba-acb7177864d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:44.536173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25d0924595f498399f081ad0ec70bc9', 'request_id': 'req-ca1e3c15-63d9-45c8-9883-2994ce51d996'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.549347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] The token cache is being invalidate because project b25d0924595f498399f081ad0ec70bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:44.549347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.549877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca1e3c15-63d9-45c8-9883-2994ce51d996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:44.552624 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1037/2109] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:44 2022] DELETE /identity/v3/projects/b25d0924595f498399f081ad0ec70bc9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:44.557164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a449c4-dc89-4323-9870-64b836215e4a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.557523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a449c4-dc89-4323-9870-64b836215e4a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.557869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a449c4-dc89-4323-9870-64b836215e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.592644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-83a449c4-dc89-4323-9870-64b836215e4a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:44.593838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-83a449c4-dc89-4323-9870-64b836215e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:44.594725 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1073/2110] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:44.599821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13ce10-7d73-49c0-95ba-acb7177864d2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.608678 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1038/2111] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:44.612640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13ce10-7d73-49c0-95ba-acb7177864d2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.616102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de38e9-21f3-4e7b-85de-5edb54327d53 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.616395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de38e9-21f3-4e7b-85de-5edb54327d53 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.616673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de38e9-21f3-4e7b-85de-5edb54327d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.621443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c98ce-135e-49a6-9269-ff802dc56216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.622313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c98ce-135e-49a6-9269-ff802dc56216 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.622653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c98ce-135e-49a6-9269-ff802dc56216 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.623118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c98ce-135e-49a6-9269-ff802dc56216 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.623959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c98ce-135e-49a6-9269-ff802dc56216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:44.624412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c98ce-135e-49a6-9269-ff802dc56216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.627173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c98ce-135e-49a6-9269-ff802dc56216 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.638400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-55de38e9-21f3-4e7b-85de-5edb54327d53 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:44.639821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-55de38e9-21f3-4e7b-85de-5edb54327d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:44.642446 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1074/2112] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:44.647449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c98ce-135e-49a6-9269-ff802dc56216 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.649826 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1039/2113] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:44.656980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de38e9-21f3-4e7b-85de-5edb54327d53 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.658039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c98ce-135e-49a6-9269-ff802dc56216 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.663368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc02b-3612-4691-8c46-7411db3b92fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.664100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc02b-3612-4691-8c46-7411db3b92fe admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.664416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc02b-3612-4691-8c46-7411db3b92fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.664692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc02b-3612-4691-8c46-7411db3b92fe admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.665373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bc02b-3612-4691-8c46-7411db3b92fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.667313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bc02b-3612-4691-8c46-7411db3b92fe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.667419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de38e9-21f3-4e7b-85de-5edb54327d53 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.672387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0055b3-52ff-4d3d-b92f-427990d1aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.672962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0055b3-52ff-4d3d-b92f-427990d1aab7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.673244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0055b3-52ff-4d3d-b92f-427990d1aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.673643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0055b3-52ff-4d3d-b92f-427990d1aab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.674365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0055b3-52ff-4d3d-b92f-427990d1aab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:49:44.674681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0055b3-52ff-4d3d-b92f-427990d1aab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.676866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0055b3-52ff-4d3d-b92f-427990d1aab7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.688733 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1040/2114] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:49:44.693606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0055b3-52ff-4d3d-b92f-427990d1aab7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.695967 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1075/2115] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:44 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:49:44.700072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc02b-3612-4691-8c46-7411db3b92fe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.704592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0055b3-52ff-4d3d-b92f-427990d1aab7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.763272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7cf2-ab27-44ac-82f9-f5f2442f4f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.764025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7cf2-ab27-44ac-82f9-f5f2442f4f7b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.764313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7cf2-ab27-44ac-82f9-f5f2442f4f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.764589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc7cf2-ab27-44ac-82f9-f5f2442f4f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.765290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc7cf2-ab27-44ac-82f9-f5f2442f4f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.767436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bc02b-3612-4691-8c46-7411db3b92fe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.767592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc7cf2-ab27-44ac-82f9-f5f2442f4f7b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.772647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb0af-0867-4b5b-b220-c46649b43d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.773663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb0af-0867-4b5b-b220-c46649b43d1c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.783441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb0af-0867-4b5b-b220-c46649b43d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.783896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eb0af-0867-4b5b-b220-c46649b43d1c admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.784676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb0af-0867-4b5b-b220-c46649b43d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.787018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0eb0af-0867-4b5b-b220-c46649b43d1c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.804538 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1041/2116] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:44 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:49:44.805538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7cf2-ab27-44ac-82f9-f5f2442f4f7b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.853229 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1076/2117] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:44 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:44.854307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb0af-0867-4b5b-b220-c46649b43d1c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.880961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eb0af-0867-4b5b-b220-c46649b43d1c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.885135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc7cf2-ab27-44ac-82f9-f5f2442f4f7b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.886045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6611d3-45bc-4640-83fe-8a207f1f7a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.886934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6611d3-45bc-4640-83fe-8a207f1f7a61 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.887291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6611d3-45bc-4640-83fe-8a207f1f7a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.887721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6611d3-45bc-4640-83fe-8a207f1f7a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.888568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6611d3-45bc-4640-83fe-8a207f1f7a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.890838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6611d3-45bc-4640-83fe-8a207f1f7a61 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.893657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8558a-4d15-4404-a6e3-bbcf764878f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.895235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8558a-4d15-4404-a6e3-bbcf764878f4 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.895717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8558a-4d15-4404-a6e3-bbcf764878f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.896239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8558a-4d15-4404-a6e3-bbcf764878f4 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.897625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8558a-4d15-4404-a6e3-bbcf764878f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.900420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8558a-4d15-4404-a6e3-bbcf764878f4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.912600 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1077/2118] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:44.913798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6611d3-45bc-4640-83fe-8a207f1f7a61 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.929781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6611d3-45bc-4640-83fe-8a207f1f7a61 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.935519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffef8-9f2d-421c-8b93-fd426de39ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.936553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffef8-9f2d-421c-8b93-fd426de39ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.937026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffef8-9f2d-421c-8b93-fd426de39ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.937676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffef8-9f2d-421c-8b93-fd426de39ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:44.938768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dffef8-9f2d-421c-8b93-fd426de39ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:44.940637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dffef8-9f2d-421c-8b93-fd426de39ce7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:44.958248 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1042/2119] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:44 2022] POST /identity/v3/users => generated 295 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:44.959268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8558a-4d15-4404-a6e3-bbcf764878f4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.974239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8558a-4d15-4404-a6e3-bbcf764878f4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:44.974878 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1078/2120] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:44.977389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffef8-9f2d-421c-8b93-fd426de39ce7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:44.998193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c7c67-0f1e-4475-bb97-5fe45e8d6aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:44.998872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7c67-0f1e-4475-bb97-5fe45e8d6aba admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:44.999150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7c67-0f1e-4475-bb97-5fe45e8d6aba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:44.999425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c7c67-0f1e-4475-bb97-5fe45e8d6aba admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.000508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c7c67-0f1e-4475-bb97-5fe45e8d6aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.002679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffef8-9f2d-421c-8b93-fd426de39ce7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.011055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c7c67-0f1e-4475-bb97-5fe45e8d6aba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.018748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc56747d-3b7a-426c-a229-fe2cafd15b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.020590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56747d-3b7a-426c-a229-fe2cafd15b62 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.022725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56747d-3b7a-426c-a229-fe2cafd15b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.023243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc56747d-3b7a-426c-a229-fe2cafd15b62 admin admin] PATH_INFO: `/v3/projects/9695bc9bf47e4da7bd4c4636a4900f72/users/35af62292f65400bb9626ea4e897fbd6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.030220 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1043/2121] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:45.034778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c7c67-0f1e-4475-bb97-5fe45e8d6aba admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.053808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56747d-3b7a-426c-a229-fe2cafd15b62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9695bc9bf47e4da7bd4c4636a4900f72, user_id=35af62292f65400bb9626ea4e897fbd6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.057845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc56747d-3b7a-426c-a229-fe2cafd15b62 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.060359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c7c67-0f1e-4475-bb97-5fe45e8d6aba admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.073270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7422c35-cf20-4741-a413-6d7c8077998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.074050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7422c35-cf20-4741-a413-6d7c8077998b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.074439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7422c35-cf20-4741-a413-6d7c8077998b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.075767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7422c35-cf20-4741-a413-6d7c8077998b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.076637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7422c35-cf20-4741-a413-6d7c8077998b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.081010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7422c35-cf20-4741-a413-6d7c8077998b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.082674 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1079/2122] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:44 2022] PUT /identity/v3/projects/9695bc9bf47e4da7bd4c4636a4900f72/users/35af62292f65400bb9626ea4e897fbd6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:45.095299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e6b5-fed3-408f-8d9f-04afa9cc9a9a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.095588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e6b5-fed3-408f-8d9f-04afa9cc9a9a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.095872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077e6b5-fed3-408f-8d9f-04afa9cc9a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.099074 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1044/2123] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:45.103023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7422c35-cf20-4741-a413-6d7c8077998b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.132690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7422c35-cf20-4741-a413-6d7c8077998b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.141586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1077e6b5-fed3-408f-8d9f-04afa9cc9a9a None None] MFA Rules not processed for user `35af62292f65400bb9626ea4e897fbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:45.143302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1077e6b5-fed3-408f-8d9f-04afa9cc9a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:45.204673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c8b13-82da-4d2e-afe4-cab6832f035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.205672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c8b13-82da-4d2e-afe4-cab6832f035b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.205964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c8b13-82da-4d2e-afe4-cab6832f035b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.206247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c8b13-82da-4d2e-afe4-cab6832f035b admin admin] PATH_INFO: `/v3/projects/251f4921c1bd4095b2048fce40c57949/users/be1c10eed1574852af5f6c17327bc364/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.224941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c8b13-82da-4d2e-afe4-cab6832f035b admin admin] RBAC: Authorizing `identity:create_grant(project_id=251f4921c1bd4095b2048fce40c57949, user_id=be1c10eed1574852af5f6c17327bc364, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.227630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c8b13-82da-4d2e-afe4-cab6832f035b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.241776 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1045/2124] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:45 2022] PUT /identity/v3/projects/251f4921c1bd4095b2048fce40c57949/users/be1c10eed1574852af5f6c17327bc364/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:45.253443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdf548-e6bd-483b-af28-07cddb3fa8fa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.253741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdf548-e6bd-483b-af28-07cddb3fa8fa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.254087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdf548-e6bd-483b-af28-07cddb3fa8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.260389 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1080/2125] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:45.264989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e6b5-fed3-408f-8d9f-04afa9cc9a9a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.289289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-17bdf548-e6bd-483b-af28-07cddb3fa8fa None None] MFA Rules not processed for user `be1c10eed1574852af5f6c17327bc364`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:45.289623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077e6b5-fed3-408f-8d9f-04afa9cc9a9a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.290611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-17bdf548-e6bd-483b-af28-07cddb3fa8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:45.364909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec19a5-0ed2-46c5-b3ad-1b85095afd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.365569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec19a5-0ed2-46c5-b3ad-1b85095afd4f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.365846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec19a5-0ed2-46c5-b3ad-1b85095afd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.366123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec19a5-0ed2-46c5-b3ad-1b85095afd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.366813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec19a5-0ed2-46c5-b3ad-1b85095afd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.368764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec19a5-0ed2-46c5-b3ad-1b85095afd4f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.411285 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1081/2126] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:45 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:49:45.412725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2831742-0546-47b9-a7cb-abec80be2cdf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.412903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2831742-0546-47b9-a7cb-abec80be2cdf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.413165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2831742-0546-47b9-a7cb-abec80be2cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.418322 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1046/2127] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:45.419456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdf548-e6bd-483b-af28-07cddb3fa8fa None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.435014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdf548-e6bd-483b-af28-07cddb3fa8fa None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.435826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c2831742-0546-47b9-a7cb-abec80be2cdf None None] MFA Rules not processed for user `a63e6f035306422cab01a0b1a2f5d635`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:45.440020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c2831742-0546-47b9-a7cb-abec80be2cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:45.507670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ccf2-46f4-46de-b3b3-694835be4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.509991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ccf2-46f4-46de-b3b3-694835be4951 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.510359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ccf2-46f4-46de-b3b3-694835be4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.511571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ccf2-46f4-46de-b3b3-694835be4951 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.511571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864ccf2-46f4-46de-b3b3-694835be4951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.515828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864ccf2-46f4-46de-b3b3-694835be4951 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.520802 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1082/2128] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:45.521857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2831742-0546-47b9-a7cb-abec80be2cdf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.533315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2831742-0546-47b9-a7cb-abec80be2cdf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.538498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ace5f7-4df9-4d7b-9717-d6f129a99119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.539834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ace5f7-4df9-4d7b-9717-d6f129a99119 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.540182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ace5f7-4df9-4d7b-9717-d6f129a99119 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.541229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ace5f7-4df9-4d7b-9717-d6f129a99119 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.541229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ace5f7-4df9-4d7b-9717-d6f129a99119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.543295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ace5f7-4df9-4d7b-9717-d6f129a99119 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.561353 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1047/2129] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:45 2022] POST /identity/v3/users => generated 295 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:45.562736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ccf2-46f4-46de-b3b3-694835be4951 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.576501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ccf2-46f4-46de-b3b3-694835be4951 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.582798 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1083/2130] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:49:45 2022] POST /identity/v3/projects => generated 391 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:45.585131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ace5f7-4df9-4d7b-9717-d6f129a99119 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.592375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35038d39-c73f-429c-9852-e594cf8b5f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.593285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35038d39-c73f-429c-9852-e594cf8b5f24 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.593713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35038d39-c73f-429c-9852-e594cf8b5f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.594209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35038d39-c73f-429c-9852-e594cf8b5f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.595144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35038d39-c73f-429c-9852-e594cf8b5f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.607802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35038d39-c73f-429c-9852-e594cf8b5f24 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.625277 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1048/2131] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:49:45.626520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35038d39-c73f-429c-9852-e594cf8b5f24 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.639287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35038d39-c73f-429c-9852-e594cf8b5f24 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.662072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ace5f7-4df9-4d7b-9717-d6f129a99119 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.667569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce42ce-770a-47f1-8986-efc8558e606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.668627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce42ce-770a-47f1-8986-efc8558e606a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.669006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce42ce-770a-47f1-8986-efc8558e606a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.669553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce42ce-770a-47f1-8986-efc8558e606a admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.670363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce42ce-770a-47f1-8986-efc8558e606a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.672554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce42ce-770a-47f1-8986-efc8558e606a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.702738 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1084/2132] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:49:45 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:49:45.704258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce42ce-770a-47f1-8986-efc8558e606a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.714374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5ef5b-3630-4d35-9ce4-bd4429ab08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.715973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5ef5b-3630-4d35-9ce4-bd4429ab08cf admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.716401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5ef5b-3630-4d35-9ce4-bd4429ab08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.716861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5ef5b-3630-4d35-9ce4-bd4429ab08cf admin admin] PATH_INFO: `/v3/projects/6e8b97f48c9c407ca0d3bbed488586cb/users/60fcdbe869484a3885af345b9c06f54a/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.717223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce42ce-770a-47f1-8986-efc8558e606a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.722791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0a248-3887-4814-adc6-6d329db27f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.723613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0a248-3887-4814-adc6-6d329db27f1e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.724165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0a248-3887-4814-adc6-6d329db27f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.724545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0a248-3887-4814-adc6-6d329db27f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.725382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0a248-3887-4814-adc6-6d329db27f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.727946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0a248-3887-4814-adc6-6d329db27f1e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.737219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5ef5b-3630-4d35-9ce4-bd4429ab08cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8b97f48c9c407ca0d3bbed488586cb, user_id=60fcdbe869484a3885af345b9c06f54a, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.741330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5ef5b-3630-4d35-9ce4-bd4429ab08cf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.747118 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1085/2133] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:45.749090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0a248-3887-4814-adc6-6d329db27f1e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.765397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0a248-3887-4814-adc6-6d329db27f1e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.766085 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1049/2134] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:45 2022] PUT /identity/v3/projects/6e8b97f48c9c407ca0d3bbed488586cb/users/60fcdbe869484a3885af345b9c06f54a/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:45.767344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5ef5b-3630-4d35-9ce4-bd4429ab08cf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.849005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe771c-8e34-4c62-aa00-d18641533857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.850126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe771c-8e34-4c62-aa00-d18641533857 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.850523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe771c-8e34-4c62-aa00-d18641533857 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.850915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe771c-8e34-4c62-aa00-d18641533857 admin admin] PATH_INFO: `/v3/projects/5e1da6e2c72c47329bba36d64827b9fb/users/121e2b0a2401450e998febc994127329/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.865905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5ef5b-3630-4d35-9ce4-bd4429ab08cf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.870745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe771c-8e34-4c62-aa00-d18641533857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1da6e2c72c47329bba36d64827b9fb, user_id=121e2b0a2401450e998febc994127329, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.872658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746898d-af1a-41eb-9ff3-97cb879f0143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.873362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746898d-af1a-41eb-9ff3-97cb879f0143 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.873643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746898d-af1a-41eb-9ff3-97cb879f0143 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.873827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe771c-8e34-4c62-aa00-d18641533857 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.873933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746898d-af1a-41eb-9ff3-97cb879f0143 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.874763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746898d-af1a-41eb-9ff3-97cb879f0143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:45.876864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746898d-af1a-41eb-9ff3-97cb879f0143 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:45.897486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1050/2135] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:49:45.898993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746898d-af1a-41eb-9ff3-97cb879f0143 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.902038 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1086/2136] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:45 2022] PUT /identity/v3/projects/5e1da6e2c72c47329bba36d64827b9fb/users/121e2b0a2401450e998febc994127329/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:45.903096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe771c-8e34-4c62-aa00-d18641533857 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:45.923459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746898d-af1a-41eb-9ff3-97cb879f0143 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.983392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe771c-8e34-4c62-aa00-d18641533857 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:45.993100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e77e7-005b-4c28-8cc3-a8dbd61c802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:45.994171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e77e7-005b-4c28-8cc3-a8dbd61c802a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:45.995437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e77e7-005b-4c28-8cc3-a8dbd61c802a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:45.996199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e77e7-005b-4c28-8cc3-a8dbd61c802a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:45.998353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e77e7-005b-4c28-8cc3-a8dbd61c802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:46.001751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e77e7-005b-4c28-8cc3-a8dbd61c802a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:46.030456 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1087/2137] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:49:46.032478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e77e7-005b-4c28-8cc3-a8dbd61c802a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:46.048815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e77e7-005b-4c28-8cc3-a8dbd61c802a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:46.049376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f2e76-fc1b-4ed0-a09c-60c712bf1ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:46.050500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f2e76-fc1b-4ed0-a09c-60c712bf1ba4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:46.051961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f2e76-fc1b-4ed0-a09c-60c712bf1ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:46.052338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f2e76-fc1b-4ed0-a09c-60c712bf1ba4 admin admin] PATH_INFO: `/v3/projects/6e8b97f48c9c407ca0d3bbed488586cb/users/60fcdbe869484a3885af345b9c06f54a/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:46.054943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f2e76-fc1b-4ed0-a09c-60c712bf1ba4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8b97f48c9c407ca0d3bbed488586cb, user_id=60fcdbe869484a3885af345b9c06f54a, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:46.055652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f8b29-cbde-409e-bde4-41e604e44a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:46.057884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f8b29-cbde-409e-bde4-41e604e44a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:46.058183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f2e76-fc1b-4ed0-a09c-60c712bf1ba4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:46.058631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f8b29-cbde-409e-bde4-41e604e44a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:46.059055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f8b29-cbde-409e-bde4-41e604e44a34 admin admin] PATH_INFO: `/v3/projects/5e1da6e2c72c47329bba36d64827b9fb/users/121e2b0a2401450e998febc994127329/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:46.062350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f8b29-cbde-409e-bde4-41e604e44a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1da6e2c72c47329bba36d64827b9fb, user_id=121e2b0a2401450e998febc994127329, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:46.067596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f8b29-cbde-409e-bde4-41e604e44a34 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:46.081332 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1051/2138] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:45 2022] PUT /identity/v3/projects/6e8b97f48c9c407ca0d3bbed488586cb/users/60fcdbe869484a3885af345b9c06f54a/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:46.091090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60280-7f50-4e0c-9f19-a6d438bfeaa8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:46.091090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60280-7f50-4e0c-9f19-a6d438bfeaa8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:46.091090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f60280-7f50-4e0c-9f19-a6d438bfeaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:46.107130 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1088/2139] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:49:46 2022] PUT /identity/v3/projects/5e1da6e2c72c47329bba36d64827b9fb/users/121e2b0a2401450e998febc994127329/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:46.107945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0ddfc-c017-4094-a904-c9f5b2284274 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:46.108263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0ddfc-c017-4094-a904-c9f5b2284274 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:46.108736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0ddfc-c017-4094-a904-c9f5b2284274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:46.139669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-52f60280-7f50-4e0c-9f19-a6d438bfeaa8 None None] MFA Rules not processed for user `60fcdbe869484a3885af345b9c06f54a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:46.140988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-52f60280-7f50-4e0c-9f19-a6d438bfeaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:46.149623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f0d0ddfc-c017-4094-a904-c9f5b2284274 None None] MFA Rules not processed for user `121e2b0a2401450e998febc994127329`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:46.151383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f0d0ddfc-c017-4094-a904-c9f5b2284274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:46.292069 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1089/2140] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:46.373890 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1052/2141] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:46.385770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4ba9-dfc9-4b11-b9e0-f5279030d8d7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:46.386284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4ba9-dfc9-4b11-b9e0-f5279030d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:46.386730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c4ba9-dfc9-4b11-b9e0-f5279030d8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:46.440114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-df2c4ba9-dfc9-4b11-b9e0-f5279030d8d7 None None] MFA Rules not processed for user `35af62292f65400bb9626ea4e897fbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:46.441386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df2c4ba9-dfc9-4b11-b9e0-f5279030d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:46.537469 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1090/2142] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:46.669181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60280-7f50-4e0c-9f19-a6d438bfeaa8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:46.670754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-52f60280-7f50-4e0c-9f19-a6d438bfeaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:46.776305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f60280-7f50-4e0c-9f19-a6d438bfeaa8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:46.801205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd7ea1-04bd-45dd-96d0-a160d378562e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:46.801955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c4ba9-dfc9-4b11-b9e0-f5279030d8d7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:46.802768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7ea1-04bd-45dd-96d0-a160d378562e service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:46.803237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7ea1-04bd-45dd-96d0-a160d378562e service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:46.803421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df2c4ba9-dfc9-4b11-b9e0-f5279030d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:46.803834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd7ea1-04bd-45dd-96d0-a160d378562e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:46.823309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c4ba9-dfc9-4b11-b9e0-f5279030d8d7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:46.834553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5558d-4fb5-41af-ae65-e2bd97e1735c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:46.837732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5558d-4fb5-41af-ae65-e2bd97e1735c service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:46.838168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5558d-4fb5-41af-ae65-e2bd97e1735c service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:46.838588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5558d-4fb5-41af-ae65-e2bd97e1735c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:46.844153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6af5558d-4fb5-41af-ae65-e2bd97e1735c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:46.908202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd7ea1-04bd-45dd-96d0-a160d378562e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:46.909879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd7ea1-04bd-45dd-96d0-a160d378562e service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:46.921704 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1053/2143] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:46.978662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5558d-4fb5-41af-ae65-e2bd97e1735c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:46.980388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5558d-4fb5-41af-ae65-e2bd97e1735c service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:46.995360 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1091/2144] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:47.548222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd7ea1-04bd-45dd-96d0-a160d378562e service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:47.560759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd7ea1-04bd-45dd-96d0-a160d378562e service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:47.567576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e934a1-b628-4692-ab5e-079fa15af09c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:47.568196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e934a1-b628-4692-ab5e-079fa15af09c service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:47.569033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e934a1-b628-4692-ab5e-079fa15af09c service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:47.569033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e934a1-b628-4692-ab5e-079fa15af09c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:47.577625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e934a1-b628-4692-ab5e-079fa15af09c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:47.580393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e934a1-b628-4692-ab5e-079fa15af09c service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:47.589397 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1054/2145] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:47.745291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c917e-17eb-461d-adf7-7c80d0db40f9 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:47.745821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c917e-17eb-461d-adf7-7c80d0db40f9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:47.745922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c917e-17eb-461d-adf7-7c80d0db40f9 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:47.747986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1092/2146] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:47.753360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc821cc9-7f12-4c36-89c0-81fc72d5975c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:47.753651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc821cc9-7f12-4c36-89c0-81fc72d5975c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:47.754512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc821cc9-7f12-4c36-89c0-81fc72d5975c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:47.806631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cc821cc9-7f12-4c36-89c0-81fc72d5975c None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:47.809451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cc821cc9-7f12-4c36-89c0-81fc72d5975c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:47.921158 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1055/2147] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:49:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:47.942602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c917e-17eb-461d-adf7-7c80d0db40f9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:47.944513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ac9c917e-17eb-461d-adf7-7c80d0db40f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:47.959260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c917e-17eb-461d-adf7-7c80d0db40f9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:47.962925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89079426-de0b-4038-9a34-cf14129bfdc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:47.963566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89079426-de0b-4038-9a34-cf14129bfdc2 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:47.963848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89079426-de0b-4038-9a34-cf14129bfdc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:47.964157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89079426-de0b-4038-9a34-cf14129bfdc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:47.972681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89079426-de0b-4038-9a34-cf14129bfdc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:47.974141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89079426-de0b-4038-9a34-cf14129bfdc2 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:47.984083 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1093/2148] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:48.026306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5df67-f98e-4a21-b4cc-11d87a27aad1 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:48.026682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5df67-f98e-4a21-b4cc-11d87a27aad1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:48.027862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5df67-f98e-4a21-b4cc-11d87a27aad1 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:48.029732 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1056/2149] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:48.036339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664c605-8b1b-466a-aef2-bad15214db36 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:48.037647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664c605-8b1b-466a-aef2-bad15214db36 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:48.038143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664c605-8b1b-466a-aef2-bad15214db36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:48.113254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f664c605-8b1b-466a-aef2-bad15214db36 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:48.116264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f664c605-8b1b-466a-aef2-bad15214db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:48.167834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2000de-0d81-4f42-8717-b5b4baa47cda None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:48.167834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2000de-0d81-4f42-8717-b5b4baa47cda None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:48.167834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2000de-0d81-4f42-8717-b5b4baa47cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:48.215535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9b2000de-0d81-4f42-8717-b5b4baa47cda None None] MFA Rules not processed for user `35af62292f65400bb9626ea4e897fbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:48.226407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9b2000de-0d81-4f42-8717-b5b4baa47cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:48.242705 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1057/2150] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:48.303780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1094/2151] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:49:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:48.330932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2000de-0d81-4f42-8717-b5b4baa47cda None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:48.333296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9b2000de-0d81-4f42-8717-b5b4baa47cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:48.358541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2000de-0d81-4f42-8717-b5b4baa47cda None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:48.370517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ddcb0-ee30-4ebd-b724-a2f7f83e175e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:48.371452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddcb0-ee30-4ebd-b724-a2f7f83e175e service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:48.372014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddcb0-ee30-4ebd-b724-a2f7f83e175e service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:48.372388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ddcb0-ee30-4ebd-b724-a2f7f83e175e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:48.382882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ddcb0-ee30-4ebd-b724-a2f7f83e175e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:48.384657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ddcb0-ee30-4ebd-b724-a2f7f83e175e service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:48.396729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1058/2152] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:48.704015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936b25-09ae-481f-9f32-2e0bf763bec3 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:48.704303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936b25-09ae-481f-9f32-2e0bf763bec3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:48.704576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936b25-09ae-481f-9f32-2e0bf763bec3 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:48.706312 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1095/2153] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:48.713482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87afcd3-2b43-4738-8234-be092748aa03 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:48.713965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87afcd3-2b43-4738-8234-be092748aa03 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:48.714383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87afcd3-2b43-4738-8234-be092748aa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:48.742412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a87afcd3-2b43-4738-8234-be092748aa03 None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:48.743899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a87afcd3-2b43-4738-8234-be092748aa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:48.765587 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1059/2154] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:48.783607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936b25-09ae-481f-9f32-2e0bf763bec3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:48.803783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936b25-09ae-481f-9f32-2e0bf763bec3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:48.809964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39668ed4-3e7a-40d6-bc60-557e7a0b72fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:48.810950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39668ed4-3e7a-40d6-bc60-557e7a0b72fe service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:48.811442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39668ed4-3e7a-40d6-bc60-557e7a0b72fe service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:48.811889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39668ed4-3e7a-40d6-bc60-557e7a0b72fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:48.822544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39668ed4-3e7a-40d6-bc60-557e7a0b72fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:48.824521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39668ed4-3e7a-40d6-bc60-557e7a0b72fe service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:48.837465 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1096/2155] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:49.133548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7118bc-62fe-40a6-bb64-833ff253d7a4 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:49.141046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7118bc-62fe-40a6-bb64-833ff253d7a4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:49.141609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7118bc-62fe-40a6-bb64-833ff253d7a4 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:49.145126 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1060/2156] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:49:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:49.166179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69e9f-8ba4-419b-b064-a1f514897c9a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:49.166470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69e9f-8ba4-419b-b064-a1f514897c9a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:49.166745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69e9f-8ba4-419b-b064-a1f514897c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:49.187647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7118bc-62fe-40a6-bb64-833ff253d7a4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:49.199756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b5a69e9f-8ba4-419b-b064-a1f514897c9a None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:49.201312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b5a69e9f-8ba4-419b-b064-a1f514897c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:49.215056 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1097/2157] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:49.227415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7118bc-62fe-40a6-bb64-833ff253d7a4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:49.241917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cfe68-22fc-4f55-94ba-21c01c79b3c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:49.242663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cfe68-22fc-4f55-94ba-21c01c79b3c6 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:49.242943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cfe68-22fc-4f55-94ba-21c01c79b3c6 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:49.244302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cfe68-22fc-4f55-94ba-21c01c79b3c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:49.249987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69e9f-8ba4-419b-b064-a1f514897c9a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:49.251482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b5a69e9f-8ba4-419b-b064-a1f514897c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:49.263435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cfe68-22fc-4f55-94ba-21c01c79b3c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:49.267032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cfe68-22fc-4f55-94ba-21c01c79b3c6 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:49.268459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69e9f-8ba4-419b-b064-a1f514897c9a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:49.281005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313507a0-b5f4-4fcf-84c1-6c792eabe933 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:49.281710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313507a0-b5f4-4fcf-84c1-6c792eabe933 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:49.282004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313507a0-b5f4-4fcf-84c1-6c792eabe933 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:49.282283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313507a0-b5f4-4fcf-84c1-6c792eabe933 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:49.285278 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1061/2158] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:49.301724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313507a0-b5f4-4fcf-84c1-6c792eabe933 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:49.303255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313507a0-b5f4-4fcf-84c1-6c792eabe933 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:49.323325 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1098/2159] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:49.598801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9098e5-fd58-4dd1-b3c8-0da429935b59 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:49.598801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9098e5-fd58-4dd1-b3c8-0da429935b59 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:49.598801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9098e5-fd58-4dd1-b3c8-0da429935b59 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:49.600064 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1062/2160] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:49:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:49.613838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5e482-529f-4f91-be15-021489cdfb03 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:49.614525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5e482-529f-4f91-be15-021489cdfb03 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:49.614969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5e482-529f-4f91-be15-021489cdfb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:49.653161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-07e5e482-529f-4f91-be15-021489cdfb03 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:49.654455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07e5e482-529f-4f91-be15-021489cdfb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:49.666165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1099/2161] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:49.689306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9098e5-fd58-4dd1-b3c8-0da429935b59 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:49.704575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9098e5-fd58-4dd1-b3c8-0da429935b59 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:49.716506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c258d6-43d7-44e9-b894-3100dc2f861b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:49.717451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c258d6-43d7-44e9-b894-3100dc2f861b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:49.717951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c258d6-43d7-44e9-b894-3100dc2f861b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:49.718437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c258d6-43d7-44e9-b894-3100dc2f861b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:49.733863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c258d6-43d7-44e9-b894-3100dc2f861b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:49.736143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c258d6-43d7-44e9-b894-3100dc2f861b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:49.753207 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1063/2162] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:53.637112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5e482-529f-4f91-be15-021489cdfb03 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:53.661622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5e482-529f-4f91-be15-021489cdfb03 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:53.670538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c61cb-b190-49e8-82e7-c6448c6e067d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:53.673943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c61cb-b190-49e8-82e7-c6448c6e067d service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:53.674429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c61cb-b190-49e8-82e7-c6448c6e067d service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:53.674855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c61cb-b190-49e8-82e7-c6448c6e067d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:53.678418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b05c61cb-b190-49e8-82e7-c6448c6e067d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:53.776437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c61cb-b190-49e8-82e7-c6448c6e067d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:53.778330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05c61cb-b190-49e8-82e7-c6448c6e067d service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:53.791162 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1100/2163] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:56.087568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c1e7f-f2f1-47c0-8b47-43df2812591a None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:56.088164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c1e7f-f2f1-47c0-8b47-43df2812591a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:56.088164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c1e7f-f2f1-47c0-8b47-43df2812591a None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:56.089937 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1064/2164] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:49:56.094904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aa71e-d4ea-4c8f-ae70-c33e8ea45df1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:56.095490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aa71e-d4ea-4c8f-ae70-c33e8ea45df1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:56.095490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aa71e-d4ea-4c8f-ae70-c33e8ea45df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:56.114118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-074aa71e-d4ea-4c8f-ae70-c33e8ea45df1 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:56.115304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-074aa71e-d4ea-4c8f-ae70-c33e8ea45df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:56.123803 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1101/2165] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:56.144523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c1e7f-f2f1-47c0-8b47-43df2812591a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:56.159131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c1e7f-f2f1-47c0-8b47-43df2812591a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:56.167481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1cad1-3c0c-4bc1-941a-b1f01aaa607a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:56.168067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1cad1-3c0c-4bc1-941a-b1f01aaa607a service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:56.168352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1cad1-3c0c-4bc1-941a-b1f01aaa607a service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:56.168715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1cad1-3c0c-4bc1-941a-b1f01aaa607a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:56.178124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1cad1-3c0c-4bc1-941a-b1f01aaa607a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:56.179761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1cad1-3c0c-4bc1-941a-b1f01aaa607a service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:56.195181 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1065/2166] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:56.380196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aa71e-d4ea-4c8f-ae70-c33e8ea45df1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:56.391230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aa71e-d4ea-4c8f-ae70-c33e8ea45df1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:56.396328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a111b-288b-46e6-8a0e-22474cf8baf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:56.397044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a111b-288b-46e6-8a0e-22474cf8baf7 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:56.397388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a111b-288b-46e6-8a0e-22474cf8baf7 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:56.397728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a111b-288b-46e6-8a0e-22474cf8baf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:56.399720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-160a111b-288b-46e6-8a0e-22474cf8baf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:56.419896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a111b-288b-46e6-8a0e-22474cf8baf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:56.421640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a111b-288b-46e6-8a0e-22474cf8baf7 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:56.432746 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1102/2167] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:56.734664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1cad1-3c0c-4bc1-941a-b1f01aaa607a service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:56.771323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1cad1-3c0c-4bc1-941a-b1f01aaa607a service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:56.778370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba5799-9da0-4740-b4e5-b81e88edf9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:56.779024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba5799-9da0-4740-b4e5-b81e88edf9ec service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:56.779311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba5799-9da0-4740-b4e5-b81e88edf9ec service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:56.779590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba5799-9da0-4740-b4e5-b81e88edf9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:56.781605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-68ba5799-9da0-4740-b4e5-b81e88edf9ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:56.837105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f539-b180-4cdc-8629-d44b6155ce18 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:56.837578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f539-b180-4cdc-8629-d44b6155ce18 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:56.838872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7f539-b180-4cdc-8629-d44b6155ce18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:56.861606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba5799-9da0-4740-b4e5-b81e88edf9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:56.863326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba5799-9da0-4740-b4e5-b81e88edf9ec service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:56.874772 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1066/2168] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:56 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:56.899756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b7b7f539-b180-4cdc-8629-d44b6155ce18 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:56.901201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b7b7f539-b180-4cdc-8629-d44b6155ce18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:56.912145 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1103/2169] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:56.922574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba5799-9da0-4740-b4e5-b81e88edf9ec service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:56.932252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba5799-9da0-4740-b4e5-b81e88edf9ec service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:56.936776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470a941-f0ae-47b5-9095-2fbbc0818cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:56.937856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470a941-f0ae-47b5-9095-2fbbc0818cbc service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:56.938139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470a941-f0ae-47b5-9095-2fbbc0818cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:56.938586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470a941-f0ae-47b5-9095-2fbbc0818cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:56.957884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470a941-f0ae-47b5-9095-2fbbc0818cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:56.960441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470a941-f0ae-47b5-9095-2fbbc0818cbc service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:56.980589 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1067/2170] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:58.277949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7f539-b180-4cdc-8629-d44b6155ce18 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:58.402608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46619214-8625-4004-b21c-a4cee8905942 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:58.403172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46619214-8625-4004-b21c-a4cee8905942 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:58.403396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46619214-8625-4004-b21c-a4cee8905942 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:58.405212 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1068/2171] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:49:58.409008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7f539-b180-4cdc-8629-d44b6155ce18 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:58.412578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff1c8b-9bad-4b86-8244-6b98d58e34dc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:58.413105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff1c8b-9bad-4b86-8244-6b98d58e34dc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:58.413531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff1c8b-9bad-4b86-8244-6b98d58e34dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:58.414582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:58.416132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:58.416622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:58.417199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] PATH_INFO: `/v3/users/be1c10eed1574852af5f6c17327bc364` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:58.418683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1c10eed1574852af5f6c17327bc364)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:58.420967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:58.433661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-93ff1c8b-9bad-4b86-8244-6b98d58e34dc None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:58.434898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-93ff1c8b-9bad-4b86-8244-6b98d58e34dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:58.453115 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1069/2172] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:58.471840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff1c8b-9bad-4b86-8244-6b98d58e34dc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:58.477821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1c10eed1574852af5f6c17327bc364'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:58.486148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff1c8b-9bad-4b86-8244-6b98d58e34dc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:58.486479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1c10eed1574852af5f6c17327bc364'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:58.487198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1c10eed1574852af5f6c17327bc364'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:58.487857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1c10eed1574852af5f6c17327bc364'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:58.491551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:58.492429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:58.492759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:58.493142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:58.495223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:58.496940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c88543a4-9f0a-440b-b87a-bfc44527e175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1c10eed1574852af5f6c17327bc364'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:58.507018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:58.509128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:58.515420 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1104/2173] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:58 2022] DELETE /identity/v3/users/be1c10eed1574852af5f6c17327bc364 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:58.519786 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1070/2174] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:58.526374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd284e9-e74a-4fbb-bd5c-644b609ea968 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:58.526665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd284e9-e74a-4fbb-bd5c-644b609ea968 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:58.526939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd284e9-e74a-4fbb-bd5c-644b609ea968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:58.552225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fdd284e9-e74a-4fbb-bd5c-644b609ea968 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:58.553727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fdd284e9-e74a-4fbb-bd5c-644b609ea968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:58.673494 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1105/2175] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:49:58.684364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:58.686861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:58.704005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162d8d7-5274-4235-ae5a-ac5809bc06f1 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:58.780396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaf9cf-d5b1-4597-98cc-4c251df90778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:58.781201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaf9cf-d5b1-4597-98cc-4c251df90778 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:58.781554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaf9cf-d5b1-4597-98cc-4c251df90778 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:58.782289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaf9cf-d5b1-4597-98cc-4c251df90778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:58.804755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaf9cf-d5b1-4597-98cc-4c251df90778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:58.808416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eaf9cf-d5b1-4597-98cc-4c251df90778 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:58.837351 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1071/2176] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:59.064348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd284e9-e74a-4fbb-bd5c-644b609ea968 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:59.067158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fdd284e9-e74a-4fbb-bd5c-644b609ea968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:59.090305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd284e9-e74a-4fbb-bd5c-644b609ea968 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:59.096330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:59.098408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:59.098815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:59.099213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] PATH_INFO: `/v3/projects/251f4921c1bd4095b2048fce40c57949` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:59.100777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=251f4921c1bd4095b2048fce40c57949)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:59.102810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:59.187161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '251f4921c1bd4095b2048fce40c57949', 'request_id': 'req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.199452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '251f4921c1bd4095b2048fce40c57949', 'request_id': 'req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.208735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '251f4921c1bd4095b2048fce40c57949', 'request_id': 'req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.228562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] The token cache is being invalidate because project 251f4921c1bd4095b2048fce40c57949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:49:59.229584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.231166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b25c5122-62b8-44ec-a21b-ebf3f1a243e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.254141 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1106/2177] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:59 2022] DELETE /identity/v3/projects/251f4921c1bd4095b2048fce40c57949 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:59.259851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaf9cf-d5b1-4597-98cc-4c251df90778 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:59.275435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4eb25-66d9-48d8-a2c5-1a02c22c787c None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:59.275751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4eb25-66d9-48d8-a2c5-1a02c22c787c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:59.276724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4eb25-66d9-48d8-a2c5-1a02c22c787c None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:59.279660 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1107/2178] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:49:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:49:59.295323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaf9cf-d5b1-4597-98cc-4c251df90778 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:59.298695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dcd99-0c8c-444e-9122-468f7384ea9e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:59.299093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dcd99-0c8c-444e-9122-468f7384ea9e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:59.299523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dcd99-0c8c-444e-9122-468f7384ea9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:59.337302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-491dcd99-0c8c-444e-9122-468f7384ea9e None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:59.339609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-491dcd99-0c8c-444e-9122-468f7384ea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:59.405784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:59.407884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:59.408374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:59.409479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] PATH_INFO: `/v3/users/121e2b0a2401450e998febc994127329` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:59.411273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121e2b0a2401450e998febc994127329)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:59.415870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:59.499768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121e2b0a2401450e998febc994127329'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.506498 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1108/2179] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:59.510115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121e2b0a2401450e998febc994127329'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.511042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121e2b0a2401450e998febc994127329'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.511747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121e2b0a2401450e998febc994127329'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.530579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dcd99-0c8c-444e-9122-468f7384ea9e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:59.530780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121e2b0a2401450e998febc994127329'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.532473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-491dcd99-0c8c-444e-9122-468f7384ea9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:59.547799 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1072/2180] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:49:59 2022] DELETE /identity/v3/users/121e2b0a2401450e998febc994127329 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:49:59.625955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dcd99-0c8c-444e-9122-468f7384ea9e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:59.720987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed6cf2-4b2b-4bbe-8ef7-47273902e4f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:59.721889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed6cf2-4b2b-4bbe-8ef7-47273902e4f1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:59.722374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed6cf2-4b2b-4bbe-8ef7-47273902e4f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:59.722801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed6cf2-4b2b-4bbe-8ef7-47273902e4f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:59.725647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-daed6cf2-4b2b-4bbe-8ef7-47273902e4f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:59.808479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:59.810577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:59.831791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed6cf2-4b2b-4bbe-8ef7-47273902e4f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:59.833350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed6cf2-4b2b-4bbe-8ef7-47273902e4f1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:59.845172 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1109/2181] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:49:59.867807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e492c-5304-4d81-a05e-5eb4f9a3582e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:59.868352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e492c-5304-4d81-a05e-5eb4f9a3582e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:59.868802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e492c-5304-4d81-a05e-5eb4f9a3582e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:59.889758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ea6e492c-5304-4d81-a05e-5eb4f9a3582e None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:49:59.891581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ea6e492c-5304-4d81-a05e-5eb4f9a3582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:59.899604 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1110/2182] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:49:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:49:59.910464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a8046-e3ee-487b-94af-bf8eb79a0573 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:59.912718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e492c-5304-4d81-a05e-5eb4f9a3582e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:49:59.914684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ea6e492c-5304-4d81-a05e-5eb4f9a3582e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:49:59.918912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:59.920194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:59.920952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:59.921243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] PATH_INFO: `/v3/projects/5e1da6e2c72c47329bba36d64827b9fb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:59.922739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e1da6e2c72c47329bba36d64827b9fb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:59.926528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:59.932375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e492c-5304-4d81-a05e-5eb4f9a3582e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:49:59.938160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983058ec-2e91-4220-a78e-2b8e3951b315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:49:59.939200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983058ec-2e91-4220-a78e-2b8e3951b315 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:49:59.939898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983058ec-2e91-4220-a78e-2b8e3951b315 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:49:59.940306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983058ec-2e91-4220-a78e-2b8e3951b315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:49:59.950467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983058ec-2e91-4220-a78e-2b8e3951b315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:49:59.952861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983058ec-2e91-4220-a78e-2b8e3951b315 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:49:59.965110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1111/2183] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:49:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:49:59.980768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e1da6e2c72c47329bba36d64827b9fb', 'request_id': 'req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.990970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e1da6e2c72c47329bba36d64827b9fb', 'request_id': 'req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:49:59.996231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e1da6e2c72c47329bba36d64827b9fb', 'request_id': 'req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:00.013383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] The token cache is being invalidate because project 5e1da6e2c72c47329bba36d64827b9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:00.013750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:00.014478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb1189e-42ea-456a-b61a-ca4f4d2362ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:00.016439 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1073/2184] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:49:59 2022] DELETE /identity/v3/projects/5e1da6e2c72c47329bba36d64827b9fb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:00.021221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd9ef9-bb2e-4656-9b00-71ec4daf2abf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.021849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd9ef9-bb2e-4656-9b00-71ec4daf2abf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.022303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd9ef9-bb2e-4656-9b00-71ec4daf2abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.041039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f6dd9ef9-bb2e-4656-9b00-71ec4daf2abf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:00.042249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f6dd9ef9-bb2e-4656-9b00-71ec4daf2abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:00.114066 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1112/2185] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:00.122332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3992ac-a055-4470-b721-221643e09607 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.122624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3992ac-a055-4470-b721-221643e09607 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.122907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3992ac-a055-4470-b721-221643e09607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.150571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8e3992ac-a055-4470-b721-221643e09607 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:00.151777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e3992ac-a055-4470-b721-221643e09607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:00.161541 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1074/2186] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:00.165827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd9ef9-bb2e-4656-9b00-71ec4daf2abf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:00.177490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd9ef9-bb2e-4656-9b00-71ec4daf2abf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:00.182668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4bbee-f693-492c-a276-6822356fe2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:00.183331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4bbee-f693-492c-a276-6822356fe2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.183664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4bbee-f693-492c-a276-6822356fe2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.183877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4bbee-f693-492c-a276-6822356fe2d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.184678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4bbee-f693-492c-a276-6822356fe2d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:00.184985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4bbee-f693-492c-a276-6822356fe2d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:00.186792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4bbee-f693-492c-a276-6822356fe2d5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:00.201647 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1113/2187] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:50:00.205985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3992ac-a055-4470-b721-221643e09607 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:00.218224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3992ac-a055-4470-b721-221643e09607 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:00.223438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78f316-64bf-40a8-ad98-76f4b249be22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:00.224152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f316-64bf-40a8-ad98-76f4b249be22 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.224438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f316-64bf-40a8-ad98-76f4b249be22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.224764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78f316-64bf-40a8-ad98-76f4b249be22 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.225456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78f316-64bf-40a8-ad98-76f4b249be22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:00.227474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78f316-64bf-40a8-ad98-76f4b249be22 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:00.266846 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1075/2188] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:00 2022] POST /identity/v3/projects => generated 395 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:00.272748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4bbee-f693-492c-a276-6822356fe2d5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:00.293320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4bbee-f693-492c-a276-6822356fe2d5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:00.413660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83357489-0ec6-42ab-8b15-a1dc0d764286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:00.414731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357489-0ec6-42ab-8b15-a1dc0d764286 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.415166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357489-0ec6-42ab-8b15-a1dc0d764286 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.415619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357489-0ec6-42ab-8b15-a1dc0d764286 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.416765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83357489-0ec6-42ab-8b15-a1dc0d764286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:00.419368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83357489-0ec6-42ab-8b15-a1dc0d764286 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:00.451604 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1114/2189] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:00 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:00.456232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78f316-64bf-40a8-ad98-76f4b249be22 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:00.468167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78f316-64bf-40a8-ad98-76f4b249be22 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:00.478917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869865bc-4c64-494f-8b67-3fe2d2d0a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:00.479815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869865bc-4c64-494f-8b67-3fe2d2d0a845 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.480140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869865bc-4c64-494f-8b67-3fe2d2d0a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.480430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869865bc-4c64-494f-8b67-3fe2d2d0a845 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.481166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869865bc-4c64-494f-8b67-3fe2d2d0a845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:00.482974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869865bc-4c64-494f-8b67-3fe2d2d0a845 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:00.495363 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1076/2190] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:00.499264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83357489-0ec6-42ab-8b15-a1dc0d764286 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:00.510954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83357489-0ec6-42ab-8b15-a1dc0d764286 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:00.517780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48554ff-eb6b-43a7-a08c-b51cab16970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:00.518606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48554ff-eb6b-43a7-a08c-b51cab16970c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.519469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48554ff-eb6b-43a7-a08c-b51cab16970c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.519748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48554ff-eb6b-43a7-a08c-b51cab16970c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.520512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48554ff-eb6b-43a7-a08c-b51cab16970c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:00.522197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48554ff-eb6b-43a7-a08c-b51cab16970c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:00.533257 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1115/2191] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:00.537869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869865bc-4c64-494f-8b67-3fe2d2d0a845 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:00.548949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869865bc-4c64-494f-8b67-3fe2d2d0a845 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:00.553532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbc953-b3a4-4ce7-9bd9-f3f41aaf9518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:00.554635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbc953-b3a4-4ce7-9bd9-f3f41aaf9518 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.554925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbc953-b3a4-4ce7-9bd9-f3f41aaf9518 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.555236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbc953-b3a4-4ce7-9bd9-f3f41aaf9518 admin admin] PATH_INFO: `/v3/projects/1c87bd15896c4325b42e8eff64041a63/users/37247839208e40e7984349f36749bb22/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.578176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbc953-b3a4-4ce7-9bd9-f3f41aaf9518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c87bd15896c4325b42e8eff64041a63, user_id=37247839208e40e7984349f36749bb22, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:00.581215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbc953-b3a4-4ce7-9bd9-f3f41aaf9518 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:00.598734 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1077/2192] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:00 2022] PUT /identity/v3/projects/1c87bd15896c4325b42e8eff64041a63/users/37247839208e40e7984349f36749bb22/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:00.610759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc92e1c-a54d-4dd3-ba74-63237b88a581 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.611090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc92e1c-a54d-4dd3-ba74-63237b88a581 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.611373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc92e1c-a54d-4dd3-ba74-63237b88a581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.646981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8bc92e1c-a54d-4dd3-ba74-63237b88a581 None None] MFA Rules not processed for user `37247839208e40e7984349f36749bb22`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:00.648246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8bc92e1c-a54d-4dd3-ba74-63237b88a581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:00.744069 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1116/2193] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:00.748321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbc953-b3a4-4ce7-9bd9-f3f41aaf9518 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:00.860107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbc953-b3a4-4ce7-9bd9-f3f41aaf9518 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:00.866274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89607d9-d025-4fc3-b12d-61363da27431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:00.870848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89607d9-d025-4fc3-b12d-61363da27431 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:00.871470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89607d9-d025-4fc3-b12d-61363da27431 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:00.871988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89607d9-d025-4fc3-b12d-61363da27431 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:00.872936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89607d9-d025-4fc3-b12d-61363da27431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:00.875090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89607d9-d025-4fc3-b12d-61363da27431 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:00.916197 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1078/2194] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:00 2022] POST /identity/v3/projects => generated 393 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:00.920790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc92e1c-a54d-4dd3-ba74-63237b88a581 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:00.935529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc92e1c-a54d-4dd3-ba74-63237b88a581 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:00.971099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89607d9-d025-4fc3-b12d-61363da27431 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:00.973046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b89607d9-d025-4fc3-b12d-61363da27431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:01.038013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75088d48-ee1f-405a-9a16-6813ea4daa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:01.038978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75088d48-ee1f-405a-9a16-6813ea4daa22 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:01.039325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75088d48-ee1f-405a-9a16-6813ea4daa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:01.039664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75088d48-ee1f-405a-9a16-6813ea4daa22 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:01.040569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75088d48-ee1f-405a-9a16-6813ea4daa22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:01.042567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75088d48-ee1f-405a-9a16-6813ea4daa22 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:01.071005 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1117/2195] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:00 2022] POST /identity/v3/users => generated 303 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:01.074833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75088d48-ee1f-405a-9a16-6813ea4daa22 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:01.086900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75088d48-ee1f-405a-9a16-6813ea4daa22 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:01.091689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89607d9-d025-4fc3-b12d-61363da27431 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:01.092371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73fd6d-04a1-41ac-b127-54f4a0a2de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:01.093530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73fd6d-04a1-41ac-b127-54f4a0a2de0e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:01.093530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73fd6d-04a1-41ac-b127-54f4a0a2de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:01.093747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73fd6d-04a1-41ac-b127-54f4a0a2de0e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:01.094348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73fd6d-04a1-41ac-b127-54f4a0a2de0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:01.096025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73fd6d-04a1-41ac-b127-54f4a0a2de0e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:01.098860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771322f-b52d-432d-bab2-2feedb72f160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:01.100315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771322f-b52d-432d-bab2-2feedb72f160 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:01.100780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771322f-b52d-432d-bab2-2feedb72f160 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:01.101172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771322f-b52d-432d-bab2-2feedb72f160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:01.103172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f771322f-b52d-432d-bab2-2feedb72f160 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:01.108230 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1118/2196] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:50:01.113302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73fd6d-04a1-41ac-b127-54f4a0a2de0e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:01.123306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73fd6d-04a1-41ac-b127-54f4a0a2de0e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:01.128898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77e694-efd3-482b-9eb4-196153b60d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:01.129871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77e694-efd3-482b-9eb4-196153b60d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:01.130220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77e694-efd3-482b-9eb4-196153b60d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:01.130561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77e694-efd3-482b-9eb4-196153b60d81 admin admin] PATH_INFO: `/v3/projects/efa73746819b44cd8a4f006d97e53cbf/users/b150f4b276e0447c8957a8c0be6b621f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:01.148430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77e694-efd3-482b-9eb4-196153b60d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa73746819b44cd8a4f006d97e53cbf, user_id=b150f4b276e0447c8957a8c0be6b621f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:01.151222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee77e694-efd3-482b-9eb4-196153b60d81 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:01.168460 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1119/2197] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:01 2022] PUT /identity/v3/projects/efa73746819b44cd8a4f006d97e53cbf/users/b150f4b276e0447c8957a8c0be6b621f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:01.172307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77e694-efd3-482b-9eb4-196153b60d81 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:01.177835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771322f-b52d-432d-bab2-2feedb72f160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:01.180253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771322f-b52d-432d-bab2-2feedb72f160 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:01.191812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1079/2198] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:50:01.263445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee77e694-efd3-482b-9eb4-196153b60d81 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:01.269337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3969a6-ec8f-4704-a21c-974749f6e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:01.270007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3969a6-ec8f-4704-a21c-974749f6e6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:01.270293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3969a6-ec8f-4704-a21c-974749f6e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:01.270572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3969a6-ec8f-4704-a21c-974749f6e6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:01.271294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3969a6-ec8f-4704-a21c-974749f6e6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:01.273090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3969a6-ec8f-4704-a21c-974749f6e6a9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:01.292145 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1120/2199] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:01.293520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771322f-b52d-432d-bab2-2feedb72f160 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:01.306093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771322f-b52d-432d-bab2-2feedb72f160 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:01.310783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c0d18-5a18-4503-963c-4f9532f40f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:01.311682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0d18-5a18-4503-963c-4f9532f40f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:01.312021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0d18-5a18-4503-963c-4f9532f40f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:01.312297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c0d18-5a18-4503-963c-4f9532f40f52 admin admin] PATH_INFO: `/v3/projects/efa73746819b44cd8a4f006d97e53cbf/users/b150f4b276e0447c8957a8c0be6b621f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:01.314734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c0d18-5a18-4503-963c-4f9532f40f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa73746819b44cd8a4f006d97e53cbf, user_id=b150f4b276e0447c8957a8c0be6b621f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:01.318429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c0d18-5a18-4503-963c-4f9532f40f52 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:01.331967 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1080/2200] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:01 2022] PUT /identity/v3/projects/efa73746819b44cd8a4f006d97e53cbf/users/b150f4b276e0447c8957a8c0be6b621f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:01.339763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e65cf7-5aa1-4160-a54f-aceff72fc16d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:01.340260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e65cf7-5aa1-4160-a54f-aceff72fc16d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:01.340349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e65cf7-5aa1-4160-a54f-aceff72fc16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:01.370711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-79e65cf7-5aa1-4160-a54f-aceff72fc16d None None] MFA Rules not processed for user `b150f4b276e0447c8957a8c0be6b621f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:01.372046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-79e65cf7-5aa1-4160-a54f-aceff72fc16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:01.479887 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1121/2201] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:01.492214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1512-b64a-4448-a37b-2f31baaf88b0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:01.492723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1512-b64a-4448-a37b-2f31baaf88b0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:01.492989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f1512-b64a-4448-a37b-2f31baaf88b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:01.514746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-db3f1512-b64a-4448-a37b-2f31baaf88b0 None None] MFA Rules not processed for user `37247839208e40e7984349f36749bb22`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:01.516006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-db3f1512-b64a-4448-a37b-2f31baaf88b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:01.607266 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1081/2202] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:01.627820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e65cf7-5aa1-4160-a54f-aceff72fc16d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:01.629888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-79e65cf7-5aa1-4160-a54f-aceff72fc16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:01.719485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e65cf7-5aa1-4160-a54f-aceff72fc16d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:01.726191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89245e-9834-43e8-8ddf-0bee8b149a28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:01.726913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89245e-9834-43e8-8ddf-0bee8b149a28 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:01.727259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89245e-9834-43e8-8ddf-0bee8b149a28 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:01.727598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89245e-9834-43e8-8ddf-0bee8b149a28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:01.736984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89245e-9834-43e8-8ddf-0bee8b149a28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:01.739462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89245e-9834-43e8-8ddf-0bee8b149a28 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:01.748801 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1122/2203] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:03.485157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1512-b64a-4448-a37b-2f31baaf88b0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:03.486776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-db3f1512-b64a-4448-a37b-2f31baaf88b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:03.577584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f1512-b64a-4448-a37b-2f31baaf88b0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:03.582775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:03.583631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:03.583934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:03.584348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] PATH_INFO: `/v3/users/d1e20172563a4c68bec7874b43416e12` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:03.585748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e20172563a4c68bec7874b43416e12)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:03.587705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:03.644534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e20172563a4c68bec7874b43416e12'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:03.653878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e20172563a4c68bec7874b43416e12'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:03.654664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e20172563a4c68bec7874b43416e12'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:03.655277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e20172563a4c68bec7874b43416e12'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:03.670411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e20172563a4c68bec7874b43416e12'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:03.700177 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1082/2204] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:03 2022] DELETE /identity/v3/users/d1e20172563a4c68bec7874b43416e12 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:03.702805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9ad6-9bf0-4415-9345-96d223637fc0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:03.703295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9ad6-9bf0-4415-9345-96d223637fc0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:03.703373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9ad6-9bf0-4415-9345-96d223637fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:03.725603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a5ec9ad6-9bf0-4415-9345-96d223637fc0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:03.727221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a5ec9ad6-9bf0-4415-9345-96d223637fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:03.836726 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1123/2205] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:03.850262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:03.853017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:03.954679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ced77e-fed1-4fa8-a251-4b365a4e1fef admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:03.966604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502da9f9-4753-4f82-a503-92fa67c0e455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:03.967513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da9f9-4753-4f82-a503-92fa67c0e455 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:03.967798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da9f9-4753-4f82-a503-92fa67c0e455 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:03.969236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502da9f9-4753-4f82-a503-92fa67c0e455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:03.999783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502da9f9-4753-4f82-a503-92fa67c0e455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:04.005065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502da9f9-4753-4f82-a503-92fa67c0e455 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:04.026371 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1083/2206] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:04.275244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec9ad6-9bf0-4415-9345-96d223637fc0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:04.276673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a5ec9ad6-9bf0-4415-9345-96d223637fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:04.295566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec9ad6-9bf0-4415-9345-96d223637fc0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:04.304394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:04.305259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:04.305606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:04.305957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] PATH_INFO: `/v3/projects/33d7dead9bee45f288900c157201b337` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:04.307221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d7dead9bee45f288900c157201b337)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:04.309388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:04.372713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d7dead9bee45f288900c157201b337', 'request_id': 'req-e4acbead-6936-4ddc-96de-e720680d7463'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.392285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d7dead9bee45f288900c157201b337', 'request_id': 'req-e4acbead-6936-4ddc-96de-e720680d7463'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.401511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d7dead9bee45f288900c157201b337', 'request_id': 'req-e4acbead-6936-4ddc-96de-e720680d7463'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.431005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] The token cache is being invalidate because project 33d7dead9bee45f288900c157201b337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:04.431473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.433362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.435099 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1124/2207] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:04 2022] DELETE /identity/v3/projects/33d7dead9bee45f288900c157201b337 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:04.439193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502da9f9-4753-4f82-a503-92fa67c0e455 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:04.451601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502da9f9-4753-4f82-a503-92fa67c0e455 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:04.521897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:04.522826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:04.523123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:04.524260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] PATH_INFO: `/v3/users/e3564252f55f4da8a7e2e2582bf69bca` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:04.525588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3564252f55f4da8a7e2e2582bf69bca)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:04.533836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:04.612965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3564252f55f4da8a7e2e2582bf69bca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.629864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3564252f55f4da8a7e2e2582bf69bca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.630988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3564252f55f4da8a7e2e2582bf69bca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.631910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3564252f55f4da8a7e2e2582bf69bca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.653359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7553c90b-fdf3-4931-8965-ecc3d3eb0505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3564252f55f4da8a7e2e2582bf69bca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.669411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:04.670816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:04.681064 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1084/2208] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:04 2022] DELETE /identity/v3/users/e3564252f55f4da8a7e2e2582bf69bca => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:04.693860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4acbead-6936-4ddc-96de-e720680d7463 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:04.782024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:04.783664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:04.784150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:04.784648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] PATH_INFO: `/v3/users/df091ca34fce47c7a5f9e3efa9c8f656` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:04.786057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df091ca34fce47c7a5f9e3efa9c8f656)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:04.788988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:04.844435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df091ca34fce47c7a5f9e3efa9c8f656'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.852292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df091ca34fce47c7a5f9e3efa9c8f656'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.853600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df091ca34fce47c7a5f9e3efa9c8f656'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.854397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df091ca34fce47c7a5f9e3efa9c8f656'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.866842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df091ca34fce47c7a5f9e3efa9c8f656'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:04.893478 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1125/2209] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:04 2022] DELETE /identity/v3/users/df091ca34fce47c7a5f9e3efa9c8f656 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:04.898669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fe15e-5b29-4614-915b-9bd94794735a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:04.898965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fe15e-5b29-4614-915b-9bd94794735a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:04.899244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fe15e-5b29-4614-915b-9bd94794735a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:04.918057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-902fe15e-5b29-4614-915b-9bd94794735a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:04.919274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-902fe15e-5b29-4614-915b-9bd94794735a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:04.983378 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1085/2210] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:05.017307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:05.019224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:05.124239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6857bb3-0465-447b-967b-3fc70a4ed5f6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:05.135978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68108009-2f20-463d-b6b6-43229fae7be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:05.136997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68108009-2f20-463d-b6b6-43229fae7be3 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.137424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68108009-2f20-463d-b6b6-43229fae7be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.137831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68108009-2f20-463d-b6b6-43229fae7be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.158000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68108009-2f20-463d-b6b6-43229fae7be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:05.159826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68108009-2f20-463d-b6b6-43229fae7be3 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:05.165484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fe15e-5b29-4614-915b-9bd94794735a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:05.167652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-902fe15e-5b29-4614-915b-9bd94794735a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:05.173768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1126/2211] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:05.183984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fe15e-5b29-4614-915b-9bd94794735a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:05.191855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:05.194237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.194746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.195256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] PATH_INFO: `/v3/projects/db5c402c9d754304a3011b64d91c482f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.197439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5c402c9d754304a3011b64d91c482f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:05.200677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:05.256034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68108009-2f20-463d-b6b6-43229fae7be3 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:05.258145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-68108009-2f20-463d-b6b6-43229fae7be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:05.278310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68108009-2f20-463d-b6b6-43229fae7be3 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:05.299206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5c402c9d754304a3011b64d91c482f', 'request_id': 'req-22c3a399-2f92-4e8a-a805-286aefc90c83'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.311420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5c402c9d754304a3011b64d91c482f', 'request_id': 'req-22c3a399-2f92-4e8a-a805-286aefc90c83'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.324922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5c402c9d754304a3011b64d91c482f', 'request_id': 'req-22c3a399-2f92-4e8a-a805-286aefc90c83'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.345432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] The token cache is being invalidate because project db5c402c9d754304a3011b64d91c482f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:05.345980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.347398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22c3a399-2f92-4e8a-a805-286aefc90c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.350208 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1086/2212] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:05 2022] DELETE /identity/v3/projects/db5c402c9d754304a3011b64d91c482f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:05.356106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811365-96cc-4b3e-a3e1-398103e85b24 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.357348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811365-96cc-4b3e-a3e1-398103e85b24 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.358211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8811365-96cc-4b3e-a3e1-398103e85b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.374160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:05.375202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.375612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.376023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] PATH_INFO: `/v3/users/a63e6f035306422cab01a0b1a2f5d635` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.377407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63e6f035306422cab01a0b1a2f5d635)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:05.380772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:05.411899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a8811365-96cc-4b3e-a3e1-398103e85b24 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:05.416599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a8811365-96cc-4b3e-a3e1-398103e85b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:05.431595 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1087/2213] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:05.441156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac234064-c9b4-4f5f-b625-31cbd5cc4ae4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.441725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac234064-c9b4-4f5f-b625-31cbd5cc4ae4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.442295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac234064-c9b4-4f5f-b625-31cbd5cc4ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.471082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63e6f035306422cab01a0b1a2f5d635'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.480760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63e6f035306422cab01a0b1a2f5d635'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.481825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63e6f035306422cab01a0b1a2f5d635'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.482639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63e6f035306422cab01a0b1a2f5d635'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.494213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47d84e35-34a5-4a30-bc0e-095be2fc42c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63e6f035306422cab01a0b1a2f5d635'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:05.515236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ac234064-c9b4-4f5f-b625-31cbd5cc4ae4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:05.525359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ac234064-c9b4-4f5f-b625-31cbd5cc4ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:05.541837 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1127/2214] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:05 2022] DELETE /identity/v3/users/a63e6f035306422cab01a0b1a2f5d635 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:05.547404 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1088/2215] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:05.548230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb963f55-2407-4415-b1f3-2a8294c40774 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.549722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb963f55-2407-4415-b1f3-2a8294c40774 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.550424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb963f55-2407-4415-b1f3-2a8294c40774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.552140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac234064-c9b4-4f5f-b625-31cbd5cc4ae4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:05.563291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac234064-c9b4-4f5f-b625-31cbd5cc4ae4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:05.602889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-eb963f55-2407-4415-b1f3-2a8294c40774 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:05.606415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-eb963f55-2407-4415-b1f3-2a8294c40774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:05.672560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:05.675698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.675698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.675698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.676440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:05.676841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:05.679891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:05.699589 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1089/2216] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:05.700217 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1128/2217] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:05.708108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb963f55-2407-4415-b1f3-2a8294c40774 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:05.721395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb963f55-2407-4415-b1f3-2a8294c40774 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:05.726905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:05.730126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:05.742958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e766f1-ab4a-43d4-a881-d4635d6d39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:05.746299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e766f1-ab4a-43d4-a881-d4635d6d39bc admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.746858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e766f1-ab4a-43d4-a881-d4635d6d39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.747473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e766f1-ab4a-43d4-a881-d4635d6d39bc admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.748386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e766f1-ab4a-43d4-a881-d4635d6d39bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:05.754676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e766f1-ab4a-43d4-a881-d4635d6d39bc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:05.816445 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1129/2218] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:05 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:05.822999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e766f1-ab4a-43d4-a881-d4635d6d39bc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:05.830231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbdd1e-cc27-4488-9149-77cf881739c3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:05.919970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fb115-79a4-4b83-a37d-b1347d04a301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:05.920742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fb115-79a4-4b83-a37d-b1347d04a301 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.921026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fb115-79a4-4b83-a37d-b1347d04a301 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.921196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fb115-79a4-4b83-a37d-b1347d04a301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.926526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e766f1-ab4a-43d4-a881-d4635d6d39bc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:05.941145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec60a8f-bac8-4e90-87c4-16cc5aed645e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:05.941741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60a8f-bac8-4e90-87c4-16cc5aed645e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:05.942023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60a8f-bac8-4e90-87c4-16cc5aed645e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:05.942297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60a8f-bac8-4e90-87c4-16cc5aed645e admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:05.942987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec60a8f-bac8-4e90-87c4-16cc5aed645e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:05.945059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec60a8f-bac8-4e90-87c4-16cc5aed645e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:05.946542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fb115-79a4-4b83-a37d-b1347d04a301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:05.949428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9fb115-79a4-4b83-a37d-b1347d04a301 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:05.975870 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1130/2219] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:05 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:05.976729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec60a8f-bac8-4e90-87c4-16cc5aed645e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:05.979317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3ec60a8f-bac8-4e90-87c4-16cc5aed645e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:05.982522 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1090/2220] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:05.983834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fb115-79a4-4b83-a37d-b1347d04a301 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:06.001429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec60a8f-bac8-4e90-87c4-16cc5aed645e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:06.009834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:06.010805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.011175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.011557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] PATH_INFO: `/v3/projects/c37576cbe4f749f89162f328e4429aec` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.011669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fb115-79a4-4b83-a37d-b1347d04a301 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:06.013005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37576cbe4f749f89162f328e4429aec)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:06.015629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:06.023327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba860e7a-e18c-4f6a-ab5a-79d5d164d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:06.024464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba860e7a-e18c-4f6a-ab5a-79d5d164d1bc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.024761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba860e7a-e18c-4f6a-ab5a-79d5d164d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.025046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba860e7a-e18c-4f6a-ab5a-79d5d164d1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.025781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba860e7a-e18c-4f6a-ab5a-79d5d164d1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:06.032339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba860e7a-e18c-4f6a-ab5a-79d5d164d1bc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:06.053036 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1091/2221] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:06.057129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba860e7a-e18c-4f6a-ab5a-79d5d164d1bc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:06.083301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba860e7a-e18c-4f6a-ab5a-79d5d164d1bc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:06.090048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37576cbe4f749f89162f328e4429aec', 'request_id': 'req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.103795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37576cbe4f749f89162f328e4429aec', 'request_id': 'req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.114231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37576cbe4f749f89162f328e4429aec', 'request_id': 'req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.141509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] The token cache is being invalidate because project c37576cbe4f749f89162f328e4429aec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:06.142054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.142919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.145378 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1131/2222] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:05 2022] DELETE /identity/v3/projects/c37576cbe4f749f89162f328e4429aec => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:06.151541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:06.154047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:06.184007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d699af-da69-4460-b273-314929d3ea06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:06.185145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d699af-da69-4460-b273-314929d3ea06 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.185801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d699af-da69-4460-b273-314929d3ea06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.186613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d699af-da69-4460-b273-314929d3ea06 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.188166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d699af-da69-4460-b273-314929d3ea06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:06.191082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d699af-da69-4460-b273-314929d3ea06 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:06.214871 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1092/2223] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:06.221539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d699af-da69-4460-b273-314929d3ea06 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:06.226707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-99d699af-da69-4460-b273-314929d3ea06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:06.250840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d699af-da69-4460-b273-314929d3ea06 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:06.256325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3543b8-9f8e-4b39-93ee-60e3d0629f5f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:06.259097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6f1b4-73a1-42d5-9b50-380a2d8f7d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:06.261810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6f1b4-73a1-42d5-9b50-380a2d8f7d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.262320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6f1b4-73a1-42d5-9b50-380a2d8f7d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.266751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:06.266751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.266751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.266751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] PATH_INFO: `/v3/users/fbd46c2bd59942cb91fd4853bebc5753` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.267525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd46c2bd59942cb91fd4853bebc5753)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:06.269925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6f1b4-73a1-42d5-9b50-380a2d8f7d1b admin admin] PATH_INFO: `/v3/projects/f706e63313f04c51a24cbd952c9059b3/users/bf162265b6ce4c2b9cae7fd968c7e7b1/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.270558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:06.307093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6f1b4-73a1-42d5-9b50-380a2d8f7d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f706e63313f04c51a24cbd952c9059b3, user_id=bf162265b6ce4c2b9cae7fd968c7e7b1, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:06.307093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b6f1b4-73a1-42d5-9b50-380a2d8f7d1b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:06.346301 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1093/2224] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:06 2022] PUT /identity/v3/projects/f706e63313f04c51a24cbd952c9059b3/users/bf162265b6ce4c2b9cae7fd968c7e7b1/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:06.349299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a61a58-c848-49bd-bc3a-03bc00a7acf5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.349659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a61a58-c848-49bd-bc3a-03bc00a7acf5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.349971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a61a58-c848-49bd-bc3a-03bc00a7acf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.408213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-37a61a58-c848-49bd-bc3a-03bc00a7acf5 None None] MFA Rules not processed for user `bf162265b6ce4c2b9cae7fd968c7e7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:06.410013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-37a61a58-c848-49bd-bc3a-03bc00a7acf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:06.435318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd46c2bd59942cb91fd4853bebc5753'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.452890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd46c2bd59942cb91fd4853bebc5753'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.455099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd46c2bd59942cb91fd4853bebc5753'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.457201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd46c2bd59942cb91fd4853bebc5753'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.476449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd46c2bd59942cb91fd4853bebc5753'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.511551 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1132/2225] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:06 2022] DELETE /identity/v3/users/fbd46c2bd59942cb91fd4853bebc5753 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:06.514742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:06.516045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:06.535709 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1094/2226] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:06.540329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a61a58-c848-49bd-bc3a-03bc00a7acf5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:06.544027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-37a61a58-c848-49bd-bc3a-03bc00a7acf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:06.618157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389889e-14ed-4e03-b988-6c9e431574a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:06.628048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:06.628920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.629198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.629472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] PATH_INFO: `/v3/projects/c2133fff60db4fe9bb0aa9bbb266e602` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.630820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2133fff60db4fe9bb0aa9bbb266e602)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:06.637282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:06.685947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a61a58-c848-49bd-bc3a-03bc00a7acf5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:06.698673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8cc5-8ac3-4b59-a16f-0391b336d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:06.699295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8cc5-8ac3-4b59-a16f-0391b336d437 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.699575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8cc5-8ac3-4b59-a16f-0391b336d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.699857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef8cc5-8ac3-4b59-a16f-0391b336d437 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.700659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef8cc5-8ac3-4b59-a16f-0391b336d437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:06.702822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef8cc5-8ac3-4b59-a16f-0391b336d437 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:06.720069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2133fff60db4fe9bb0aa9bbb266e602', 'request_id': 'req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.733935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2133fff60db4fe9bb0aa9bbb266e602', 'request_id': 'req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.742493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2133fff60db4fe9bb0aa9bbb266e602', 'request_id': 'req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.758684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] The token cache is being invalidate because project c2133fff60db4fe9bb0aa9bbb266e602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:06.759236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.760130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5aaa9864-6728-4e0d-b91a-2d4981d0bd53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:06.762536 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1133/2227] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:06 2022] DELETE /identity/v3/projects/c2133fff60db4fe9bb0aa9bbb266e602 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:06.764232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d6b7-e5f0-4ada-b1bd-3b49ab7156b1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.764659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d6b7-e5f0-4ada-b1bd-3b49ab7156b1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.765257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707d6b7-e5f0-4ada-b1bd-3b49ab7156b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.767331 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1095/2228] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:06 2022] POST /identity/v3/projects => generated 369 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:06.769054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8cc5-8ac3-4b59-a16f-0391b336d437 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:06.772659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-53ef8cc5-8ac3-4b59-a16f-0391b336d437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:06.792000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4707d6b7-e5f0-4ada-b1bd-3b49ab7156b1 None None] MFA Rules not processed for user `35af62292f65400bb9626ea4e897fbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:06.793466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4707d6b7-e5f0-4ada-b1bd-3b49ab7156b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:06.914392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef8cc5-8ac3-4b59-a16f-0391b336d437 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:06.921071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:06.924180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:06.924718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:06.925406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] PATH_INFO: `/v3/users/ac11ea59379e47aa83dc490bf56ae97c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:06.927235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac11ea59379e47aa83dc490bf56ae97c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:06.930930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:07.035986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1134/2229] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:07.035986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d6b7-e5f0-4ada-b1bd-3b49ab7156b1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:07.035986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4707d6b7-e5f0-4ada-b1bd-3b49ab7156b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:07.056368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707d6b7-e5f0-4ada-b1bd-3b49ab7156b1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:07.060263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac11ea59379e47aa83dc490bf56ae97c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.067640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93378-ef61-460e-b6a1-d7c6d740053c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:07.067640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93378-ef61-460e-b6a1-d7c6d740053c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:07.067640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93378-ef61-460e-b6a1-d7c6d740053c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:07.067640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f93378-ef61-460e-b6a1-d7c6d740053c admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:07.069689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f93378-ef61-460e-b6a1-d7c6d740053c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:07.071012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f93378-ef61-460e-b6a1-d7c6d740053c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:07.076091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac11ea59379e47aa83dc490bf56ae97c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.077194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac11ea59379e47aa83dc490bf56ae97c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.077892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac11ea59379e47aa83dc490bf56ae97c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.099794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac11ea59379e47aa83dc490bf56ae97c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.104672 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1135/2230] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:07 2022] POST /identity/v3/users => generated 291 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:07.105801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93378-ef61-460e-b6a1-d7c6d740053c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:07.123451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-76f93378-ef61-460e-b6a1-d7c6d740053c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:07.133394 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1096/2231] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:06 2022] DELETE /identity/v3/users/ac11ea59379e47aa83dc490bf56ae97c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:07.141498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f93378-ef61-460e-b6a1-d7c6d740053c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:07.209172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92de26-d7e8-4e49-9d70-f646de11456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:07.210143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92de26-d7e8-4e49-9d70-f646de11456c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:07.210499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92de26-d7e8-4e49-9d70-f646de11456c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:07.210694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92de26-d7e8-4e49-9d70-f646de11456c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:07.211419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92de26-d7e8-4e49-9d70-f646de11456c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:07.213095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92de26-d7e8-4e49-9d70-f646de11456c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:07.227226 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1136/2232] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:07.228675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:07.244211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444e7af-0f25-423f-a99b-394547bca4b9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:07.249075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f6906-db58-437b-8e87-70f1e47348ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:07.249984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6906-db58-437b-8e87-70f1e47348ab admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:07.250320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6906-db58-437b-8e87-70f1e47348ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:07.250606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f6906-db58-437b-8e87-70f1e47348ab admin admin] PATH_INFO: `/v3/projects/429bf40a1bb146148eed196610755c32/users/087ec614b86a48128cd9a7ac7bd3ef89/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:07.268911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f6906-db58-437b-8e87-70f1e47348ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=429bf40a1bb146148eed196610755c32, user_id=087ec614b86a48128cd9a7ac7bd3ef89, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:07.271635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f6906-db58-437b-8e87-70f1e47348ab admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:07.293013 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1097/2233] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:07 2022] PUT /identity/v3/projects/429bf40a1bb146148eed196610755c32/users/087ec614b86a48128cd9a7ac7bd3ef89/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:07.295022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92de26-d7e8-4e49-9d70-f646de11456c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:07.306179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92de26-d7e8-4e49-9d70-f646de11456c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:07.392482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74827625-e6c3-4695-a58a-c5b14ee17772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:07.393528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74827625-e6c3-4695-a58a-c5b14ee17772 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:07.394086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74827625-e6c3-4695-a58a-c5b14ee17772 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:07.394558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74827625-e6c3-4695-a58a-c5b14ee17772 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:07.396532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74827625-e6c3-4695-a58a-c5b14ee17772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:07.398664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74827625-e6c3-4695-a58a-c5b14ee17772 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:07.414960 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1137/2234] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:07.419632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f6906-db58-437b-8e87-70f1e47348ab admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:07.433146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f6906-db58-437b-8e87-70f1e47348ab admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:07.443193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37514-12a4-4e34-bc79-4af0e813df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:07.444330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37514-12a4-4e34-bc79-4af0e813df81 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:07.444781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37514-12a4-4e34-bc79-4af0e813df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:07.445160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c37514-12a4-4e34-bc79-4af0e813df81 admin admin] PATH_INFO: `/v3/projects/429bf40a1bb146148eed196610755c32/users/087ec614b86a48128cd9a7ac7bd3ef89/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:07.452049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c37514-12a4-4e34-bc79-4af0e813df81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429bf40a1bb146148eed196610755c32, user_id=087ec614b86a48128cd9a7ac7bd3ef89, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:07.458095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c37514-12a4-4e34-bc79-4af0e813df81 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:07.495958 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1098/2235] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:07 2022] PUT /identity/v3/projects/429bf40a1bb146148eed196610755c32/users/087ec614b86a48128cd9a7ac7bd3ef89/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:07.505793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f985-8efe-443d-9e3e-000984ef034f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:07.506855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f985-8efe-443d-9e3e-000984ef034f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:07.506855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f985-8efe-443d-9e3e-000984ef034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:07.525944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37514-12a4-4e34-bc79-4af0e813df81 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:07.528086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-65c37514-12a4-4e34-bc79-4af0e813df81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:07.554473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0632f985-8efe-443d-9e3e-000984ef034f None None] MFA Rules not processed for user `087ec614b86a48128cd9a7ac7bd3ef89`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:07.556326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0632f985-8efe-443d-9e3e-000984ef034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:07.657906 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1138/2236] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:07.672097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c37514-12a4-4e34-bc79-4af0e813df81 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:07.679461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:07.681943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:07.682392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:07.682874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] PATH_INFO: `/v3/projects/4c6d3a159dbc48a9a1eb3d3d0ed08e20` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:07.684926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6d3a159dbc48a9a1eb3d3d0ed08e20)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:07.688177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:07.762271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6d3a159dbc48a9a1eb3d3d0ed08e20', 'request_id': 'req-90f9d604-53f6-4f4e-8a84-82911415326c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.776023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6d3a159dbc48a9a1eb3d3d0ed08e20', 'request_id': 'req-90f9d604-53f6-4f4e-8a84-82911415326c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.782974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6d3a159dbc48a9a1eb3d3d0ed08e20', 'request_id': 'req-90f9d604-53f6-4f4e-8a84-82911415326c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.795565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] The token cache is being invalidate because project 4c6d3a159dbc48a9a1eb3d3d0ed08e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:07.796032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.797162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-90f9d604-53f6-4f4e-8a84-82911415326c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:07.800366 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1099/2237] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:07 2022] DELETE /identity/v3/projects/4c6d3a159dbc48a9a1eb3d3d0ed08e20 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:07.804456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bd3d-3ac4-48bb-aaf0-1bf821dde6f9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:07.804908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bd3d-3ac4-48bb-aaf0-1bf821dde6f9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:07.805404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647bd3d-3ac4-48bb-aaf0-1bf821dde6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:07.823743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d647bd3d-3ac4-48bb-aaf0-1bf821dde6f9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:07.824988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d647bd3d-3ac4-48bb-aaf0-1bf821dde6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:07.971631 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1139/2238] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:07.979764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f84e86-8b2f-47aa-8553-b359e8883aa9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:07.980083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f84e86-8b2f-47aa-8553-b359e8883aa9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:07.980360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f84e86-8b2f-47aa-8553-b359e8883aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.001334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f9f84e86-8b2f-47aa-8553-b359e8883aa9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:08.003163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f9f84e86-8b2f-47aa-8553-b359e8883aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:08.021233 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1100/2239] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:08.029978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bd3d-3ac4-48bb-aaf0-1bf821dde6f9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.049788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647bd3d-3ac4-48bb-aaf0-1bf821dde6f9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.057700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.058753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.059251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.059703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.062954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:08.063619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.066884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.103189 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1140/2240] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:08.107560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f84e86-8b2f-47aa-8553-b359e8883aa9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.111379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.113517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:08.124260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f84e86-8b2f-47aa-8553-b359e8883aa9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.143091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aa57b-5409-48bc-9ea8-99fe2b1c7d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.145765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aa57b-5409-48bc-9ea8-99fe2b1c7d8b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.147034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aa57b-5409-48bc-9ea8-99fe2b1c7d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.147034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4aa57b-5409-48bc-9ea8-99fe2b1c7d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.147965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4aa57b-5409-48bc-9ea8-99fe2b1c7d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.151782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4aa57b-5409-48bc-9ea8-99fe2b1c7d8b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.236410 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1101/2241] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:08 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:08.237825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aa57b-5409-48bc-9ea8-99fe2b1c7d8b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.244517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f4aa57b-5409-48bc-9ea8-99fe2b1c7d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:08.273654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94a96-e440-435e-a74c-7283954317be admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.352943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4aa57b-5409-48bc-9ea8-99fe2b1c7d8b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.359770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.360833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.361276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.361697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] PATH_INFO: `/v3/projects/44055431d9734f7c99d840d25fc702e4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.363358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44055431d9734f7c99d840d25fc702e4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.366616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.417900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051933e-3016-4aea-bc72-6bfe4c887426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.421415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051933e-3016-4aea-bc72-6bfe4c887426 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.422071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051933e-3016-4aea-bc72-6bfe4c887426 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.422641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051933e-3016-4aea-bc72-6bfe4c887426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.425697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8051933e-3016-4aea-bc72-6bfe4c887426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:08.478382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44055431d9734f7c99d840d25fc702e4', 'request_id': 'req-7cb3c846-3ea3-429e-827f-67a3c4a757f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:08.487340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44055431d9734f7c99d840d25fc702e4', 'request_id': 'req-7cb3c846-3ea3-429e-827f-67a3c4a757f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:08.514366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44055431d9734f7c99d840d25fc702e4', 'request_id': 'req-7cb3c846-3ea3-429e-827f-67a3c4a757f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:08.528799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] The token cache is being invalidate because project 44055431d9734f7c99d840d25fc702e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:08.529504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:08.530493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:08.532588 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1102/2242] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:08 2022] DELETE /identity/v3/projects/44055431d9734f7c99d840d25fc702e4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:08.533609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.536866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:08.550520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051933e-3016-4aea-bc72-6bfe4c887426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.555827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051933e-3016-4aea-bc72-6bfe4c887426 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.571446 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1141/2243] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:08.573146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe11260-28c9-4771-b7f8-837380bbd444 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.573628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe11260-28c9-4771-b7f8-837380bbd444 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.574024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe11260-28c9-4771-b7f8-837380bbd444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.605998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-abe11260-28c9-4771-b7f8-837380bbd444 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:08.607231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-abe11260-28c9-4771-b7f8-837380bbd444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:08.624982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb3c846-3ea3-429e-827f-67a3c4a757f4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.632069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855380e-1ca6-44fd-a848-23b9a489a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.633020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855380e-1ca6-44fd-a848-23b9a489a035 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.633403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855380e-1ca6-44fd-a848-23b9a489a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.633822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855380e-1ca6-44fd-a848-23b9a489a035 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.634657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855380e-1ca6-44fd-a848-23b9a489a035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.636773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855380e-1ca6-44fd-a848-23b9a489a035 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.673638 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1103/2244] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:08 2022] POST /identity/v3/users => generated 302 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:08.679784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855380e-1ca6-44fd-a848-23b9a489a035 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.703805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855380e-1ca6-44fd-a848-23b9a489a035 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.712247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8fb44-db73-44ca-ae27-806447a8229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.713629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8fb44-db73-44ca-ae27-806447a8229e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.714312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8fb44-db73-44ca-ae27-806447a8229e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.715028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8fb44-db73-44ca-ae27-806447a8229e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.715870 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1142/2245] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:08.716251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8fb44-db73-44ca-ae27-806447a8229e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.718493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8fb44-db73-44ca-ae27-806447a8229e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.724119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4bd32-70fd-4883-980d-e9044ef2328c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.724411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4bd32-70fd-4883-980d-e9044ef2328c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.724708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4bd32-70fd-4883-980d-e9044ef2328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.735505 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1104/2246] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:08.741011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8fb44-db73-44ca-ae27-806447a8229e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.755216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8fb44-db73-44ca-ae27-806447a8229e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.761867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135eb3d-78d0-4a99-9373-d4747ac4d4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.762693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135eb3d-78d0-4a99-9373-d4747ac4d4eb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.763081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135eb3d-78d0-4a99-9373-d4747ac4d4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.763472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135eb3d-78d0-4a99-9373-d4747ac4d4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.764375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135eb3d-78d0-4a99-9373-d4747ac4d4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.766232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135eb3d-78d0-4a99-9373-d4747ac4d4eb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.773965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dad4bd32-70fd-4883-980d-e9044ef2328c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:08.775749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dad4bd32-70fd-4883-980d-e9044ef2328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:08.779559 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1105/2247] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:50:08.792478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135eb3d-78d0-4a99-9373-d4747ac4d4eb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.793803 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1143/2248] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:08.795617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4bd32-70fd-4883-980d-e9044ef2328c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.817599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4bd32-70fd-4883-980d-e9044ef2328c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.830744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135eb3d-78d0-4a99-9373-d4747ac4d4eb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.834367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df155f45-a790-423d-a3f4-957bd79e5d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.835030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df155f45-a790-423d-a3f4-957bd79e5d8e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.835439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df155f45-a790-423d-a3f4-957bd79e5d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.835799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df155f45-a790-423d-a3f4-957bd79e5d8e admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.836719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df155f45-a790-423d-a3f4-957bd79e5d8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:08.837034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df155f45-a790-423d-a3f4-957bd79e5d8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.840008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df155f45-a790-423d-a3f4-957bd79e5d8e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.845683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c4ad0-0a82-471a-bdb8-801aead2d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.847160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4ad0-0a82-471a-bdb8-801aead2d44c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.847646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4ad0-0a82-471a-bdb8-801aead2d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.848282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c4ad0-0a82-471a-bdb8-801aead2d44c admin admin] PATH_INFO: `/v3/projects/c71abac018054ac59df8204f06278c20/users/f730effcbf03473fbdb527fa499ec181/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.861578 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1144/2249] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:50:08.866930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df155f45-a790-423d-a3f4-957bd79e5d8e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:08.881196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df155f45-a790-423d-a3f4-957bd79e5d8e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:08.883495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4ad0-0a82-471a-bdb8-801aead2d44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71abac018054ac59df8204f06278c20, user_id=f730effcbf03473fbdb527fa499ec181, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.886665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c4ad0-0a82-471a-bdb8-801aead2d44c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.907108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bbb35-fdaa-428e-a574-3095e2209c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:08.907861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bbb35-fdaa-428e-a574-3095e2209c37 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.908177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bbb35-fdaa-428e-a574-3095e2209c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.908471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bbb35-fdaa-428e-a574-3095e2209c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.909702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bbb35-fdaa-428e-a574-3095e2209c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:08.911630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bbb35-fdaa-428e-a574-3095e2209c37 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:08.913242 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1106/2250] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:08 2022] PUT /identity/v3/projects/c71abac018054ac59df8204f06278c20/users/f730effcbf03473fbdb527fa499ec181/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:08.918428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d4311-1977-4238-9632-5a343b0b09a6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:08.919076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d4311-1977-4238-9632-5a343b0b09a6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:08.919463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d4311-1977-4238-9632-5a343b0b09a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:08.941756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-523d4311-1977-4238-9632-5a343b0b09a6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:08.943189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-523d4311-1977-4238-9632-5a343b0b09a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:08.973321 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1145/2251] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:08 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:08.974393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bbb35-fdaa-428e-a574-3095e2209c37 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:09.038405 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1107/2252] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:09.066081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d4311-1977-4238-9632-5a343b0b09a6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:09.067803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-523d4311-1977-4238-9632-5a343b0b09a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:09.133544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bbb35-fdaa-428e-a574-3095e2209c37 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:09.147280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e3539-8503-4c9c-81a8-e4bb33983187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:09.148056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e3539-8503-4c9c-81a8-e4bb33983187 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.148339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e3539-8503-4c9c-81a8-e4bb33983187 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.148614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e3539-8503-4c9c-81a8-e4bb33983187 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.149303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e3539-8503-4c9c-81a8-e4bb33983187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:09.152077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e3539-8503-4c9c-81a8-e4bb33983187 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:09.173271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d4311-1977-4238-9632-5a343b0b09a6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:09.188217 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1146/2253] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:08 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:09.190508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e3539-8503-4c9c-81a8-e4bb33983187 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:09.193853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-195e3539-8503-4c9c-81a8-e4bb33983187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:09.208136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e3539-8503-4c9c-81a8-e4bb33983187 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:09.215347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:09.216326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.216614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.217028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] PATH_INFO: `/v3/users/bf162265b6ce4c2b9cae7fd968c7e7b1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.218430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf162265b6ce4c2b9cae7fd968c7e7b1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:09.220549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:09.251461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d3b30-16b8-479c-af36-f5224d5f3815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:09.252183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d3b30-16b8-479c-af36-f5224d5f3815 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.252530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d3b30-16b8-479c-af36-f5224d5f3815 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.252841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d3b30-16b8-479c-af36-f5224d5f3815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.274824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d3b30-16b8-479c-af36-f5224d5f3815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:09.277336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d3b30-16b8-479c-af36-f5224d5f3815 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:09.306387 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1108/2254] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:09.310159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d3b30-16b8-479c-af36-f5224d5f3815 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:09.335802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d3b30-16b8-479c-af36-f5224d5f3815 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:09.346274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c1c36-0902-4b5b-936f-5f838213d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:09.348260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1c36-0902-4b5b-936f-5f838213d415 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.348616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1c36-0902-4b5b-936f-5f838213d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.349133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1c36-0902-4b5b-936f-5f838213d415 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.349968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf162265b6ce4c2b9cae7fd968c7e7b1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:09.350433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c1c36-0902-4b5b-936f-5f838213d415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:09.353770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46c1c36-0902-4b5b-936f-5f838213d415 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:09.366471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf162265b6ce4c2b9cae7fd968c7e7b1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:09.368175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf162265b6ce4c2b9cae7fd968c7e7b1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:09.369342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf162265b6ce4c2b9cae7fd968c7e7b1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:09.369473 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1109/2255] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:09.373554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c1c36-0902-4b5b-936f-5f838213d415 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:09.375953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d46c1c36-0902-4b5b-936f-5f838213d415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:09.391342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bbba0455-b81c-4a27-af50-64e63dd0474d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf162265b6ce4c2b9cae7fd968c7e7b1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:09.392210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c1c36-0902-4b5b-936f-5f838213d415 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:09.399881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8f5fd-ef34-42da-8dd5-47d92748dbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:09.401297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8f5fd-ef34-42da-8dd5-47d92748dbfa admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.401592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8f5fd-ef34-42da-8dd5-47d92748dbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.401919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8f5fd-ef34-42da-8dd5-47d92748dbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.402860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8f5fd-ef34-42da-8dd5-47d92748dbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:09.405981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8f5fd-ef34-42da-8dd5-47d92748dbfa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:09.429829 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1110/2256] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:09.431346 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1147/2257] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:09 2022] DELETE /identity/v3/users/bf162265b6ce4c2b9cae7fd968c7e7b1 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:09.438926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752f5e8-6d58-4cc2-93ed-827fafc06f40 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.439357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8f5fd-ef34-42da-8dd5-47d92748dbfa admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:09.439676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752f5e8-6d58-4cc2-93ed-827fafc06f40 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.440166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752f5e8-6d58-4cc2-93ed-827fafc06f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.463581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8f5fd-ef34-42da-8dd5-47d92748dbfa admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:09.484749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a752f5e8-6d58-4cc2-93ed-827fafc06f40 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:09.489640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a752f5e8-6d58-4cc2-93ed-827fafc06f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:09.559833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1c2b-6166-461f-8a96-53a2cace8d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:09.562006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1c2b-6166-461f-8a96-53a2cace8d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.562625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1c2b-6166-461f-8a96-53a2cace8d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.562997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce1c2b-6166-461f-8a96-53a2cace8d48 admin admin] PATH_INFO: `/v3/projects/03e6fe5adef54a9aa265bcf7689416df/users/3e0552b5af0a4a5b8253763a9e67c1c0/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.590725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1c2b-6166-461f-8a96-53a2cace8d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e6fe5adef54a9aa265bcf7689416df, user_id=3e0552b5af0a4a5b8253763a9e67c1c0, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:09.595876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce1c2b-6166-461f-8a96-53a2cace8d48 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:09.621219 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1148/2259] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:09.621623 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1111/2259] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:09 2022] PUT /identity/v3/projects/03e6fe5adef54a9aa265bcf7689416df/users/3e0552b5af0a4a5b8253763a9e67c1c0/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:09.629462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56abb0-16cd-4cb2-af0d-a8779b95fd19 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.629772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56abb0-16cd-4cb2-af0d-a8779b95fd19 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.630118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56abb0-16cd-4cb2-af0d-a8779b95fd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.648393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1c2b-6166-461f-8a96-53a2cace8d48 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:09.650979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-14ce1c2b-6166-461f-8a96-53a2cace8d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:09.678417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7e56abb0-16cd-4cb2-af0d-a8779b95fd19 None None] MFA Rules not processed for user `3e0552b5af0a4a5b8253763a9e67c1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:09.682295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7e56abb0-16cd-4cb2-af0d-a8779b95fd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:09.766405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce1c2b-6166-461f-8a96-53a2cace8d48 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:09.780936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0e4a2-8023-48c3-8323-9b1cf66328ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:09.782278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e4a2-8023-48c3-8323-9b1cf66328ec service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.782942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e4a2-8023-48c3-8323-9b1cf66328ec service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.783236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0e4a2-8023-48c3-8323-9b1cf66328ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.814072 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1149/2260] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:09.823671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56abb0-16cd-4cb2-af0d-a8779b95fd19 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:09.920897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56abb0-16cd-4cb2-af0d-a8779b95fd19 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:09.935660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a749e0-40d0-489e-8997-3b474b34a131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:09.936365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a749e0-40d0-489e-8997-3b474b34a131 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.936650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a749e0-40d0-489e-8997-3b474b34a131 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.936970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a749e0-40d0-489e-8997-3b474b34a131 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.937615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a749e0-40d0-489e-8997-3b474b34a131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:09.939566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a749e0-40d0-489e-8997-3b474b34a131 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:09.944163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0e4a2-8023-48c3-8323-9b1cf66328ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:09.945645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0e4a2-8023-48c3-8323-9b1cf66328ec service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:09.959599 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1112/2261] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:50:09.960910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43738-7fd7-4157-aaee-29841265fd4b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:09.961196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43738-7fd7-4157-aaee-29841265fd4b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:09.961542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d43738-7fd7-4157-aaee-29841265fd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:09.979267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-07d43738-7fd7-4157-aaee-29841265fd4b None None] MFA Rules not processed for user `2bcd816c4f3a495cbe7ce636cf0e2f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:09.980528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-07d43738-7fd7-4157-aaee-29841265fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:10.016048 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1150/2262] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:09 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:10.017050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a749e0-40d0-489e-8997-3b474b34a131 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:10.113285 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1113/2263] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:10.128697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a749e0-40d0-489e-8997-3b474b34a131 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:10.134620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075e701-bed7-4c50-8017-0e86bc91f1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:10.135211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075e701-bed7-4c50-8017-0e86bc91f1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:10.135295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075e701-bed7-4c50-8017-0e86bc91f1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:10.135538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075e701-bed7-4c50-8017-0e86bc91f1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:10.136420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075e701-bed7-4c50-8017-0e86bc91f1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:10.138955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075e701-bed7-4c50-8017-0e86bc91f1a5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:10.192967 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1151/2264] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:10 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:10.202073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d43738-7fd7-4157-aaee-29841265fd4b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:10.235561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d43738-7fd7-4157-aaee-29841265fd4b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:10.251844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9039e-d372-4d09-942c-c098a00a4907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:10.253907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9039e-d372-4d09-942c-c098a00a4907 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:10.254607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9039e-d372-4d09-942c-c098a00a4907 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:10.255041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b9039e-d372-4d09-942c-c098a00a4907 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:10.256015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9039e-d372-4d09-942c-c098a00a4907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:10.258615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b9039e-d372-4d09-942c-c098a00a4907 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:10.319794 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1114/2265] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:10.323564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075e701-bed7-4c50-8017-0e86bc91f1a5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:10.359834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075e701-bed7-4c50-8017-0e86bc91f1a5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:10.390447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c006-0afc-4de5-a0d3-7d890d2a68ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:10.392323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c006-0afc-4de5-a0d3-7d890d2a68ff admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:10.393647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c006-0afc-4de5-a0d3-7d890d2a68ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:10.393944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c006-0afc-4de5-a0d3-7d890d2a68ff admin admin] PATH_INFO: `/v3/projects/811affbf689d4be49e707431ef54575a/users/8847f184c6fb4651a3f02732aacdb2e9/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:10.440810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5c006-0afc-4de5-a0d3-7d890d2a68ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=811affbf689d4be49e707431ef54575a, user_id=8847f184c6fb4651a3f02732aacdb2e9, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:10.443949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5c006-0afc-4de5-a0d3-7d890d2a68ff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:10.462164 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1152/2266] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:10 2022] PUT /identity/v3/projects/811affbf689d4be49e707431ef54575a/users/8847f184c6fb4651a3f02732aacdb2e9/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:10.466297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9039e-d372-4d09-942c-c098a00a4907 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:10.480272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b9039e-d372-4d09-942c-c098a00a4907 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:10.609882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a818f-b3dc-4c5a-ad63-5f92f9878cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:10.616979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a818f-b3dc-4c5a-ad63-5f92f9878cfa admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:10.617767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a818f-b3dc-4c5a-ad63-5f92f9878cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:10.618249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a818f-b3dc-4c5a-ad63-5f92f9878cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:10.620887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a818f-b3dc-4c5a-ad63-5f92f9878cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:10.622934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a818f-b3dc-4c5a-ad63-5f92f9878cfa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:10.648088 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1115/2267] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:10.652338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c006-0afc-4de5-a0d3-7d890d2a68ff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:10.664349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c006-0afc-4de5-a0d3-7d890d2a68ff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:10.670237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07819e42-a8ca-43b0-8571-1aabc633a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:10.671149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07819e42-a8ca-43b0-8571-1aabc633a6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:10.672159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07819e42-a8ca-43b0-8571-1aabc633a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:10.672447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07819e42-a8ca-43b0-8571-1aabc633a6c4 admin admin] PATH_INFO: `/v3/projects/811affbf689d4be49e707431ef54575a/users/8847f184c6fb4651a3f02732aacdb2e9/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:10.675684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07819e42-a8ca-43b0-8571-1aabc633a6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=811affbf689d4be49e707431ef54575a, user_id=8847f184c6fb4651a3f02732aacdb2e9, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:10.679053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07819e42-a8ca-43b0-8571-1aabc633a6c4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:10.698318 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1153/2268] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:10 2022] PUT /identity/v3/projects/811affbf689d4be49e707431ef54575a/users/8847f184c6fb4651a3f02732aacdb2e9/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:10.706641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f74558-8bd5-4ba6-abda-844756a6e52c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:10.707636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f74558-8bd5-4ba6-abda-844756a6e52c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:10.712333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f74558-8bd5-4ba6-abda-844756a6e52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:10.763197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a0f74558-8bd5-4ba6-abda-844756a6e52c None None] MFA Rules not processed for user `8847f184c6fb4651a3f02732aacdb2e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:10.765494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a0f74558-8bd5-4ba6-abda-844756a6e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:10.851182 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1116/2269] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:11.110662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07819e42-a8ca-43b0-8571-1aabc633a6c4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:11.113000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07819e42-a8ca-43b0-8571-1aabc633a6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:11.197562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07819e42-a8ca-43b0-8571-1aabc633a6c4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:11.213834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:11.233311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:11.235002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:11.236059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] PATH_INFO: `/v3/projects/f706e63313f04c51a24cbd952c9059b3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:11.239398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f706e63313f04c51a24cbd952c9059b3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:11.244033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:11.276009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f74558-8bd5-4ba6-abda-844756a6e52c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:11.277476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a0f74558-8bd5-4ba6-abda-844756a6e52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:11.369348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f706e63313f04c51a24cbd952c9059b3', 'request_id': 'req-0e0b65b9-fcba-4f50-aa06-3588e35565e4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.384266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f706e63313f04c51a24cbd952c9059b3', 'request_id': 'req-0e0b65b9-fcba-4f50-aa06-3588e35565e4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.392209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f706e63313f04c51a24cbd952c9059b3', 'request_id': 'req-0e0b65b9-fcba-4f50-aa06-3588e35565e4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.410614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] The token cache is being invalidate because project f706e63313f04c51a24cbd952c9059b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:11.412141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.414656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.416768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1154/2270] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:11 2022] DELETE /identity/v3/projects/f706e63313f04c51a24cbd952c9059b3 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:11.421355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:11.426513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:11.438268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f74558-8bd5-4ba6-abda-844756a6e52c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:11.554795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b65b9-fcba-4f50-aa06-3588e35565e4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:11.559100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd061-4f00-4558-95ce-c2d28454f48c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:11.559990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd061-4f00-4558-95ce-c2d28454f48c service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:11.560426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd061-4f00-4558-95ce-c2d28454f48c service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:11.560888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fedd061-4f00-4558-95ce-c2d28454f48c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:11.563474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4fedd061-4f00-4558-95ce-c2d28454f48c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:11.565922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:11.568092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:11.568381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:11.568653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] PATH_INFO: `/v3/users/087ec614b86a48128cd9a7ac7bd3ef89` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:11.570619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=087ec614b86a48128cd9a7ac7bd3ef89)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:11.573671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:11.633182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedd061-4f00-4558-95ce-c2d28454f48c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:11.634969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fedd061-4f00-4558-95ce-c2d28454f48c service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:11.655287 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1117/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:11.657584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087ec614b86a48128cd9a7ac7bd3ef89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.667870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087ec614b86a48128cd9a7ac7bd3ef89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.668460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087ec614b86a48128cd9a7ac7bd3ef89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.669148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087ec614b86a48128cd9a7ac7bd3ef89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.686836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087ec614b86a48128cd9a7ac7bd3ef89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:11.715438 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1155/2272] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:11 2022] DELETE /identity/v3/users/087ec614b86a48128cd9a7ac7bd3ef89 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:12.435103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd061-4f00-4558-95ce-c2d28454f48c service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:12.447748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fedd061-4f00-4558-95ce-c2d28454f48c service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:12.511734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:12.513780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:12.565707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:12.566775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:12.567242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:12.567675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] PATH_INFO: `/v3/projects/429bf40a1bb146148eed196610755c32` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:12.570682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=429bf40a1bb146148eed196610755c32)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:12.576115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:12.662755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e9e47-ff0e-4367-abb0-9722212a7bc7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:12.681191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429bf40a1bb146148eed196610755c32', 'request_id': 'req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:12.698376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429bf40a1bb146148eed196610755c32', 'request_id': 'req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:12.730245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429bf40a1bb146148eed196610755c32', 'request_id': 'req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:12.759054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be605f9e-4ee6-455e-93c3-68eee242b17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:12.759854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be605f9e-4ee6-455e-93c3-68eee242b17e service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:12.760236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be605f9e-4ee6-455e-93c3-68eee242b17e service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:12.760626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be605f9e-4ee6-455e-93c3-68eee242b17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:12.763445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] The token cache is being invalidate because project 429bf40a1bb146148eed196610755c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:12.763745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:12.765439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be605f9e-4ee6-455e-93c3-68eee242b17e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:12.772573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8fc7ad52-b50d-407f-aee0-3737cc4d2e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:12.774152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1118/2273] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:12 2022] DELETE /identity/v3/projects/429bf40a1bb146148eed196610755c32 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:12.779244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27602b50-60c2-44bc-a61c-1bd21a36b0cb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:12.779532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27602b50-60c2-44bc-a61c-1bd21a36b0cb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:12.780017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27602b50-60c2-44bc-a61c-1bd21a36b0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:12.833176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-27602b50-60c2-44bc-a61c-1bd21a36b0cb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:12.834415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-27602b50-60c2-44bc-a61c-1bd21a36b0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:12.934324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be605f9e-4ee6-455e-93c3-68eee242b17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:12.936744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be605f9e-4ee6-455e-93c3-68eee242b17e service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:12.950941 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1156/2274] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:12.988933 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1119/2275] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:12.998051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe471-1d68-4005-9e83-5233a36cf0bb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:12.998510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe471-1d68-4005-9e83-5233a36cf0bb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:12.998893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfe471-1d68-4005-9e83-5233a36cf0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:13.022942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bebfe471-1d68-4005-9e83-5233a36cf0bb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:13.024626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bebfe471-1d68-4005-9e83-5233a36cf0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:13.038452 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1157/2276] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:13.039668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27602b50-60c2-44bc-a61c-1bd21a36b0cb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:13.050070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27602b50-60c2-44bc-a61c-1bd21a36b0cb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:13.074272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa4a81-11da-4e69-8f0e-49a9b1d55b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:13.075194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa4a81-11da-4e69-8f0e-49a9b1d55b08 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:13.075653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa4a81-11da-4e69-8f0e-49a9b1d55b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:13.076192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa4a81-11da-4e69-8f0e-49a9b1d55b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:13.077493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa4a81-11da-4e69-8f0e-49a9b1d55b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:13.077953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa4a81-11da-4e69-8f0e-49a9b1d55b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:13.079765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa4a81-11da-4e69-8f0e-49a9b1d55b08 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:13.116956 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1120/2277] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:13.121823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfe471-1d68-4005-9e83-5233a36cf0bb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:13.137440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfe471-1d68-4005-9e83-5233a36cf0bb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:13.163137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43001f-f9f0-40ea-9e8e-63b634c4a539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:13.164435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43001f-f9f0-40ea-9e8e-63b634c4a539 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:13.164732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43001f-f9f0-40ea-9e8e-63b634c4a539 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:13.165016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43001f-f9f0-40ea-9e8e-63b634c4a539 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:13.165841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43001f-f9f0-40ea-9e8e-63b634c4a539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:13.169244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43001f-f9f0-40ea-9e8e-63b634c4a539 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:13.284720 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1158/2278] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:13 2022] POST /identity/v3/projects => generated 395 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:13.288195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa4a81-11da-4e69-8f0e-49a9b1d55b08 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:13.306012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa4a81-11da-4e69-8f0e-49a9b1d55b08 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:13.425974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0303cae-37f6-4cde-9517-419f8e20a313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:13.426912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0303cae-37f6-4cde-9517-419f8e20a313 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:13.427426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0303cae-37f6-4cde-9517-419f8e20a313 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:13.427861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0303cae-37f6-4cde-9517-419f8e20a313 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:13.428627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0303cae-37f6-4cde-9517-419f8e20a313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:13.430726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0303cae-37f6-4cde-9517-419f8e20a313 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:13.466582 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1121/2279] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:13 2022] POST /identity/v3/users => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:13.470676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43001f-f9f0-40ea-9e8e-63b634c4a539 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:13.487663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43001f-f9f0-40ea-9e8e-63b634c4a539 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:13.505958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175116f-9eda-4b5d-b1b4-d178ec35af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:13.507055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175116f-9eda-4b5d-b1b4-d178ec35af1e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:13.507445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175116f-9eda-4b5d-b1b4-d178ec35af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:13.508510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175116f-9eda-4b5d-b1b4-d178ec35af1e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:13.509357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175116f-9eda-4b5d-b1b4-d178ec35af1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:13.512802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175116f-9eda-4b5d-b1b4-d178ec35af1e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:13.572646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0303cae-37f6-4cde-9517-419f8e20a313 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:13.584460 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1159/2280] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:13.593813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0303cae-37f6-4cde-9517-419f8e20a313 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:13.617003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b3d8-92d7-40c1-8580-9b1d6d8924c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:13.617933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b3d8-92d7-40c1-8580-9b1d6d8924c4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:13.619255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b3d8-92d7-40c1-8580-9b1d6d8924c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:13.620764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b3d8-92d7-40c1-8580-9b1d6d8924c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:13.625301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b3d8-92d7-40c1-8580-9b1d6d8924c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:13.631545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b3d8-92d7-40c1-8580-9b1d6d8924c4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:13.667309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175116f-9eda-4b5d-b1b4-d178ec35af1e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:13.667721 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1122/2281] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:13.678698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175116f-9eda-4b5d-b1b4-d178ec35af1e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:13.698321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3551-6e5b-46c2-a894-33fddfdb1359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:13.698659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3551-6e5b-46c2-a894-33fddfdb1359 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:13.698923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3551-6e5b-46c2-a894-33fddfdb1359 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:13.699195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f3551-6e5b-46c2-a894-33fddfdb1359 admin admin] PATH_INFO: `/v3/projects/db166ab07bf64518be4f231ca4c864a8/users/bf78f0ee921c46d48d8f7c436f29ed1c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:13.734614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f3551-6e5b-46c2-a894-33fddfdb1359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db166ab07bf64518be4f231ca4c864a8, user_id=bf78f0ee921c46d48d8f7c436f29ed1c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:13.737898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f3551-6e5b-46c2-a894-33fddfdb1359 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:13.763175 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1160/2282] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:13 2022] PUT /identity/v3/projects/db166ab07bf64518be4f231ca4c864a8/users/bf78f0ee921c46d48d8f7c436f29ed1c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:13.774842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb4bb6-831b-4477-b45f-9f012a686c95 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:13.775475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb4bb6-831b-4477-b45f-9f012a686c95 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:13.775975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb4bb6-831b-4477-b45f-9f012a686c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:13.809393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fdfb4bb6-831b-4477-b45f-9f012a686c95 None None] MFA Rules not processed for user `bf78f0ee921c46d48d8f7c436f29ed1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:13.811033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fdfb4bb6-831b-4477-b45f-9f012a686c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:14.016017 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1123/2283] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:14.017303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3551-6e5b-46c2-a894-33fddfdb1359 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:14.160782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f3551-6e5b-46c2-a894-33fddfdb1359 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:14.178736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5209f43-af8b-4285-b089-80dfcfa55edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:14.180857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5209f43-af8b-4285-b089-80dfcfa55edf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:14.181206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5209f43-af8b-4285-b089-80dfcfa55edf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:14.181485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5209f43-af8b-4285-b089-80dfcfa55edf admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:14.183577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5209f43-af8b-4285-b089-80dfcfa55edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:14.189800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5209f43-af8b-4285-b089-80dfcfa55edf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:14.261388 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1161/2284] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:14 2022] POST /identity/v3/projects => generated 393 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:14.262557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb4bb6-831b-4477-b45f-9f012a686c95 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:14.287633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb4bb6-831b-4477-b45f-9f012a686c95 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:14.438057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7bf1-da12-4483-a802-e203e6849269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:14.439005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7bf1-da12-4483-a802-e203e6849269 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:14.439609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7bf1-da12-4483-a802-e203e6849269 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:14.440612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580e7bf1-da12-4483-a802-e203e6849269 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:14.441936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e7bf1-da12-4483-a802-e203e6849269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:14.444370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580e7bf1-da12-4483-a802-e203e6849269 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:14.490440 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1124/2285] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:14 2022] POST /identity/v3/users => generated 303 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:14.494160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5209f43-af8b-4285-b089-80dfcfa55edf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:14.509554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5209f43-af8b-4285-b089-80dfcfa55edf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:14.534113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7bf1-da12-4483-a802-e203e6849269 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:14.536350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-580e7bf1-da12-4483-a802-e203e6849269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:14.551535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdba14a-80f2-4d03-b61a-f8be8d960dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:14.554668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdba14a-80f2-4d03-b61a-f8be8d960dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:14.556536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdba14a-80f2-4d03-b61a-f8be8d960dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:14.556919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdba14a-80f2-4d03-b61a-f8be8d960dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:14.558127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdba14a-80f2-4d03-b61a-f8be8d960dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:14.560743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580e7bf1-da12-4483-a802-e203e6849269 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:14.562665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdba14a-80f2-4d03-b61a-f8be8d960dc9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:14.578454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:14.584688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:14.585274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:14.587014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] PATH_INFO: `/v3/users/3e0552b5af0a4a5b8253763a9e67c1c0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:14.592401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0552b5af0a4a5b8253763a9e67c1c0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:14.597721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:14.632398 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1162/2286] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:14.639144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdba14a-80f2-4d03-b61a-f8be8d960dc9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:14.678670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdba14a-80f2-4d03-b61a-f8be8d960dc9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:14.694912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e691e3f-60fd-4e01-bd0a-34dde10f58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:14.697391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e691e3f-60fd-4e01-bd0a-34dde10f58e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:14.698293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e691e3f-60fd-4e01-bd0a-34dde10f58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:14.700442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e691e3f-60fd-4e01-bd0a-34dde10f58e3 admin admin] PATH_INFO: `/v3/projects/0d5eef689ccc4c78870bf39896d655ca/users/e21f2f56f9f145ef892bb6207214cb27/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:14.720832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e691e3f-60fd-4e01-bd0a-34dde10f58e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5eef689ccc4c78870bf39896d655ca, user_id=e21f2f56f9f145ef892bb6207214cb27, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:14.724464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e691e3f-60fd-4e01-bd0a-34dde10f58e3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:14.727842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0552b5af0a4a5b8253763a9e67c1c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:14.738449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0552b5af0a4a5b8253763a9e67c1c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:14.739253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0552b5af0a4a5b8253763a9e67c1c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:14.741404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0552b5af0a4a5b8253763a9e67c1c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:14.755061 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1163/2287] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:14 2022] PUT /identity/v3/projects/0d5eef689ccc4c78870bf39896d655ca/users/e21f2f56f9f145ef892bb6207214cb27/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:14.757433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e691e3f-60fd-4e01-bd0a-34dde10f58e3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:14.764204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5e691e3f-60fd-4e01-bd0a-34dde10f58e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:14.780309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-91cb6d6b-50f5-4f06-9b3f-83c31ebca4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0552b5af0a4a5b8253763a9e67c1c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:14.806022 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1125/2288] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:14 2022] DELETE /identity/v3/users/3e0552b5af0a4a5b8253763a9e67c1c0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:14.810219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d893d58-70c0-410e-a3b5-27a5b5882c51 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:14.810520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d893d58-70c0-410e-a3b5-27a5b5882c51 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:14.810808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d893d58-70c0-410e-a3b5-27a5b5882c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:14.841895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7d893d58-70c0-410e-a3b5-27a5b5882c51 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:14.843133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d893d58-70c0-410e-a3b5-27a5b5882c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:14.869576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e691e3f-60fd-4e01-bd0a-34dde10f58e3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:14.919643 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1126/2289] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:14.955104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d893d58-70c0-410e-a3b5-27a5b5882c51 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:14.957264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d893d58-70c0-410e-a3b5-27a5b5882c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:14.957619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69838-1b9b-40f2-b3f8-5ca6b8c51209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:14.958451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69838-1b9b-40f2-b3f8-5ca6b8c51209 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:14.958865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69838-1b9b-40f2-b3f8-5ca6b8c51209 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:14.959266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a69838-1b9b-40f2-b3f8-5ca6b8c51209 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:14.960548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a69838-1b9b-40f2-b3f8-5ca6b8c51209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:14.962716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a69838-1b9b-40f2-b3f8-5ca6b8c51209 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:14.978011 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1164/2290] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:14.981832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69838-1b9b-40f2-b3f8-5ca6b8c51209 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:15.000574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a69838-1b9b-40f2-b3f8-5ca6b8c51209 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:15.007385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fcc0-dcb7-45d2-bed6-fb4636ce355f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:15.008630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fcc0-dcb7-45d2-bed6-fb4636ce355f admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:15.008745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fcc0-dcb7-45d2-bed6-fb4636ce355f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:15.009005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fcc0-dcb7-45d2-bed6-fb4636ce355f admin admin] PATH_INFO: `/v3/projects/0d5eef689ccc4c78870bf39896d655ca/users/e21f2f56f9f145ef892bb6207214cb27/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:15.011112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fcc0-dcb7-45d2-bed6-fb4636ce355f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5eef689ccc4c78870bf39896d655ca, user_id=e21f2f56f9f145ef892bb6207214cb27, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:15.017341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fcc0-dcb7-45d2-bed6-fb4636ce355f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:15.054025 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1165/2291] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:14 2022] PUT /identity/v3/projects/0d5eef689ccc4c78870bf39896d655ca/users/e21f2f56f9f145ef892bb6207214cb27/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:15.057848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7dbfb-51dd-4a2d-aa2d-dff035f20594 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:15.058176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7dbfb-51dd-4a2d-aa2d-dff035f20594 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:15.058684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7dbfb-51dd-4a2d-aa2d-dff035f20594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:15.071988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d893d58-70c0-410e-a3b5-27a5b5882c51 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:15.110691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-18b7dbfb-51dd-4a2d-aa2d-dff035f20594 None None] MFA Rules not processed for user `e21f2f56f9f145ef892bb6207214cb27`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:15.112595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-18b7dbfb-51dd-4a2d-aa2d-dff035f20594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:15.186974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21550d39-b7a0-4f35-877f-e1999821a063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:15.187777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21550d39-b7a0-4f35-877f-e1999821a063 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:15.188185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21550d39-b7a0-4f35-877f-e1999821a063 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:15.188569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21550d39-b7a0-4f35-877f-e1999821a063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:15.249537 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1166/2292] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:15.251232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7dbfb-51dd-4a2d-aa2d-dff035f20594 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:15.322592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21550d39-b7a0-4f35-877f-e1999821a063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:15.324579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21550d39-b7a0-4f35-877f-e1999821a063 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:15.337498 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1127/2293] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:15.346783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7dbfb-51dd-4a2d-aa2d-dff035f20594 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:15.359067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8e7b4-c3eb-4ce4-8f98-3fb37ab9df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:15.359758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8e7b4-c3eb-4ce4-8f98-3fb37ab9df89 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:15.360061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8e7b4-c3eb-4ce4-8f98-3fb37ab9df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:15.360330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8e7b4-c3eb-4ce4-8f98-3fb37ab9df89 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:15.361025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8e7b4-c3eb-4ce4-8f98-3fb37ab9df89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:15.365082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f8e7b4-c3eb-4ce4-8f98-3fb37ab9df89 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:15.423762 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1167/2294] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:15 2022] POST /identity/v3/projects => generated 395 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:15.429096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21550d39-b7a0-4f35-877f-e1999821a063 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:15.442925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21550d39-b7a0-4f35-877f-e1999821a063 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:15.537855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bd1d5-d40b-4975-b294-0f3172d62871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:15.537855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd1d5-d40b-4975-b294-0f3172d62871 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:15.537855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd1d5-d40b-4975-b294-0f3172d62871 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:15.537855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bd1d5-d40b-4975-b294-0f3172d62871 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:15.538866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bd1d5-d40b-4975-b294-0f3172d62871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:15.547599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64bd1d5-d40b-4975-b294-0f3172d62871 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:15.575842 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1128/2295] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:15 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:15.579878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8e7b4-c3eb-4ce4-8f98-3fb37ab9df89 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:15.595279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f8e7b4-c3eb-4ce4-8f98-3fb37ab9df89 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:15.603573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cbafa-7e93-406e-a4e2-f4983bd127e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:15.604464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cbafa-7e93-406e-a4e2-f4983bd127e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:15.604827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cbafa-7e93-406e-a4e2-f4983bd127e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:15.605193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cbafa-7e93-406e-a4e2-f4983bd127e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:15.606066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cbafa-7e93-406e-a4e2-f4983bd127e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:15.607802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99cbafa-7e93-406e-a4e2-f4983bd127e0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:15.647747 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1168/2296] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:50:15.652631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bd1d5-d40b-4975-b294-0f3172d62871 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:15.678290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bd1d5-d40b-4975-b294-0f3172d62871 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:15.691238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81897312-16c3-4887-b3b2-9b128ebf5fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:15.692016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81897312-16c3-4887-b3b2-9b128ebf5fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:15.692307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81897312-16c3-4887-b3b2-9b128ebf5fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:15.692585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81897312-16c3-4887-b3b2-9b128ebf5fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:15.693397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81897312-16c3-4887-b3b2-9b128ebf5fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:15.695606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81897312-16c3-4887-b3b2-9b128ebf5fc8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:15.711702 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1129/2297] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:15.715771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cbafa-7e93-406e-a4e2-f4983bd127e0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:15.731449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cbafa-7e93-406e-a4e2-f4983bd127e0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:15.755048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec322e-1a0c-4a37-b450-9fb8e8115eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:15.756078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec322e-1a0c-4a37-b450-9fb8e8115eae admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:15.756405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec322e-1a0c-4a37-b450-9fb8e8115eae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:15.756682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec322e-1a0c-4a37-b450-9fb8e8115eae admin admin] PATH_INFO: `/v3/projects/d299c856afa14e2eb152a3670d6533d0/users/9993c13725164bf585081541f2e94a2a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:15.794924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec322e-1a0c-4a37-b450-9fb8e8115eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d299c856afa14e2eb152a3670d6533d0, user_id=9993c13725164bf585081541f2e94a2a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:15.798874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec322e-1a0c-4a37-b450-9fb8e8115eae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:15.825745 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1169/2298] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:15 2022] PUT /identity/v3/projects/d299c856afa14e2eb152a3670d6533d0/users/9993c13725164bf585081541f2e94a2a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:15.842802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb7d6-4346-4a35-9a0e-8f1c6fd30ac9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:15.843148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb7d6-4346-4a35-9a0e-8f1c6fd30ac9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:15.843610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dfb7d6-4346-4a35-9a0e-8f1c6fd30ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:15.886219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec322e-1a0c-4a37-b450-9fb8e8115eae admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:15.888182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e6ec322e-1a0c-4a37-b450-9fb8e8115eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:15.906356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-87dfb7d6-4346-4a35-9a0e-8f1c6fd30ac9 None None] MFA Rules not processed for user `9993c13725164bf585081541f2e94a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:15.908442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-87dfb7d6-4346-4a35-9a0e-8f1c6fd30ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:16.016134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec322e-1a0c-4a37-b450-9fb8e8115eae admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:16.028972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:16.029852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:16.030182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:16.030572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] PATH_INFO: `/v3/projects/03e6fe5adef54a9aa265bcf7689416df` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:16.031804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e6fe5adef54a9aa265bcf7689416df)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:16.035041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:16.059333 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1130/2299] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:16.119257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e6fe5adef54a9aa265bcf7689416df', 'request_id': 'req-f2d63ac7-3659-45da-9cef-5a811c3bd82a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.140609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e6fe5adef54a9aa265bcf7689416df', 'request_id': 'req-f2d63ac7-3659-45da-9cef-5a811c3bd82a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.149692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e6fe5adef54a9aa265bcf7689416df', 'request_id': 'req-f2d63ac7-3659-45da-9cef-5a811c3bd82a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.164469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] The token cache is being invalidate because project 03e6fe5adef54a9aa265bcf7689416df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:16.164760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.165450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.172669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb7d6-4346-4a35-9a0e-8f1c6fd30ac9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:16.172979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1170/2300] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:15 2022] DELETE /identity/v3/projects/03e6fe5adef54a9aa265bcf7689416df => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:16.184758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dfb7d6-4346-4a35-9a0e-8f1c6fd30ac9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:16.283350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:16.283516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:16.284451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:16.284759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:16.285082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] PATH_INFO: `/v3/users/8847f184c6fb4651a3f02732aacdb2e9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:16.285187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:16.286329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8847f184c6fb4651a3f02732aacdb2e9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:16.288352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:16.360473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8847f184c6fb4651a3f02732aacdb2e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.372879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8847f184c6fb4651a3f02732aacdb2e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.374651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8847f184c6fb4651a3f02732aacdb2e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.375353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8847f184c6fb4651a3f02732aacdb2e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.380234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63ac7-3659-45da-9cef-5a811c3bd82a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:16.388476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eb693-36c6-4218-b217-9c1691ea51c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:16.389625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eb693-36c6-4218-b217-9c1691ea51c4 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:16.390116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eb693-36c6-4218-b217-9c1691ea51c4 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:16.390571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eb693-36c6-4218-b217-9c1691ea51c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:16.392684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f96eb693-36c6-4218-b217-9c1691ea51c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:16.393894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-652fdb3e-c4fd-4502-9078-db630de5fa49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8847f184c6fb4651a3f02732aacdb2e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:16.412777 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1131/2301] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:16 2022] DELETE /identity/v3/users/8847f184c6fb4651a3f02732aacdb2e9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:16.510197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96eb693-36c6-4218-b217-9c1691ea51c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:16.511957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96eb693-36c6-4218-b217-9c1691ea51c4 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:16.524628 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1171/2302] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:16.785226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59d63-b180-4ed6-87eb-105266c54a3a None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:16.785691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59d63-b180-4ed6-87eb-105266c54a3a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:16.786276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc59d63-b180-4ed6-87eb-105266c54a3a None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:16.794026 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1132/2303] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:50:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:50:16.802544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d9a5b-fb9e-4619-8930-1991695cb9de None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:16.803075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d9a5b-fb9e-4619-8930-1991695cb9de None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:16.803075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d9a5b-fb9e-4619-8930-1991695cb9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:16.814538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59d63-b180-4ed6-87eb-105266c54a3a None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:50:16.816846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9dc59d63-b180-4ed6-87eb-105266c54a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:16.849774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-662d9a5b-fb9e-4619-8930-1991695cb9de None None] MFA Rules not processed for user `c9bd4f2793ec48a5b31d081c269a39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:16.853120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-662d9a5b-fb9e-4619-8930-1991695cb9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:17.011251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59d63-b180-4ed6-87eb-105266c54a3a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:17.029845 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1172/2304] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:17.031112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d9a5b-fb9e-4619-8930-1991695cb9de None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:17.034210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-662d9a5b-fb9e-4619-8930-1991695cb9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:17.121213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc59d63-b180-4ed6-87eb-105266c54a3a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:17.127145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410bc4a-b6ff-4177-a6ac-8f7a11426481 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e21f2f56f9f145ef892bb6207214cb27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5eef689ccc4c78870bf39896d655ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:17.128511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410bc4a-b6ff-4177-a6ac-8f7a11426481 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.129035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410bc4a-b6ff-4177-a6ac-8f7a11426481 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.129545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410bc4a-b6ff-4177-a6ac-8f7a11426481 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] PATH_INFO: `/v3/projects/db166ab07bf64518be4f231ca4c864a8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.131541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410bc4a-b6ff-4177-a6ac-8f7a11426481 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorizing `identity:get_project(project_id=db166ab07bf64518be4f231ca4c864a8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:17.134326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410bc4a-b6ff-4177-a6ac-8f7a11426481 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:17.136849 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1133/2305] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:50:16 2022] GET /identity/v3/projects/db166ab07bf64518be4f231ca4c864a8 => generated 395 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:50:17.148424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d9a5b-fb9e-4619-8930-1991695cb9de None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:17.153891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:17.155194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.155479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.155752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] PATH_INFO: `/v3/projects/811affbf689d4be49e707431ef54575a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.159348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=811affbf689d4be49e707431ef54575a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:17.161769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:17.225581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '811affbf689d4be49e707431ef54575a', 'request_id': 'req-f942de57-2eed-45ce-9778-285bf6e41e68'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:17.238670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '811affbf689d4be49e707431ef54575a', 'request_id': 'req-f942de57-2eed-45ce-9778-285bf6e41e68'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:17.246036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '811affbf689d4be49e707431ef54575a', 'request_id': 'req-f942de57-2eed-45ce-9778-285bf6e41e68'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:17.263954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] The token cache is being invalidate because project 811affbf689d4be49e707431ef54575a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:17.264844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:17.266446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f942de57-2eed-45ce-9778-285bf6e41e68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:17.272338 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1173/2306] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:17 2022] DELETE /identity/v3/projects/811affbf689d4be49e707431ef54575a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:17.277340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa65e-f82f-4848-b568-4983550b265e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.277640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa65e-f82f-4848-b568-4983550b265e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.277984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fa65e-f82f-4848-b568-4983550b265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.309047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2f5fa65e-f82f-4848-b568-4983550b265e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:17.310507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f5fa65e-f82f-4848-b568-4983550b265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:17.428662 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1134/2307] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:17.436457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e28b9-518a-4db4-8b10-3bd2a60862fa None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.436833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e28b9-518a-4db4-8b10-3bd2a60862fa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.437212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e28b9-518a-4db4-8b10-3bd2a60862fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.466720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-761e28b9-518a-4db4-8b10-3bd2a60862fa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:17.468029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-761e28b9-518a-4db4-8b10-3bd2a60862fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:17.476978 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1174/2308] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:17.481045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fa65e-f82f-4848-b568-4983550b265e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:17.494767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fa65e-f82f-4848-b568-4983550b265e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:17.499910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168974-f49a-4faa-be2d-a69118671f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:17.500600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168974-f49a-4faa-be2d-a69118671f4e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.500880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168974-f49a-4faa-be2d-a69118671f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.501192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168974-f49a-4faa-be2d-a69118671f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.501900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168974-f49a-4faa-be2d-a69118671f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:17.502210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168974-f49a-4faa-be2d-a69118671f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:17.504512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168974-f49a-4faa-be2d-a69118671f4e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:17.519968 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1135/2309] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:17.523314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e28b9-518a-4db4-8b10-3bd2a60862fa None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:17.538168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e28b9-518a-4db4-8b10-3bd2a60862fa None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:17.544121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980b253-e770-42ef-b128-89a55ebba5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:17.544985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b253-e770-42ef-b128-89a55ebba5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.545420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b253-e770-42ef-b128-89a55ebba5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.545696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980b253-e770-42ef-b128-89a55ebba5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.546387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980b253-e770-42ef-b128-89a55ebba5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:17.548482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980b253-e770-42ef-b128-89a55ebba5c0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:17.578723 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1175/2310] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:17 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:17.583741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168974-f49a-4faa-be2d-a69118671f4e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:17.604341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168974-f49a-4faa-be2d-a69118671f4e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:17.680498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fdcad-d5d3-4b9b-ab83-9de7f6e0d5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:17.681175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fdcad-d5d3-4b9b-ab83-9de7f6e0d5dc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.681645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fdcad-d5d3-4b9b-ab83-9de7f6e0d5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.682592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fdcad-d5d3-4b9b-ab83-9de7f6e0d5dc admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.683302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fdcad-d5d3-4b9b-ab83-9de7f6e0d5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:17.687271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fdcad-d5d3-4b9b-ab83-9de7f6e0d5dc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:17.713658 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1136/2311] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:17 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:17.717536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980b253-e770-42ef-b128-89a55ebba5c0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:17.732781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980b253-e770-42ef-b128-89a55ebba5c0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:17.739561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05a5d6-5ebc-413f-8d16-0b8af34c7b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:17.740398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05a5d6-5ebc-413f-8d16-0b8af34c7b82 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.740530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05a5d6-5ebc-413f-8d16-0b8af34c7b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.740795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05a5d6-5ebc-413f-8d16-0b8af34c7b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.741523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05a5d6-5ebc-413f-8d16-0b8af34c7b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:17.744358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05a5d6-5ebc-413f-8d16-0b8af34c7b82 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:17.761251 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1176/2312] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:17.762497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fdcad-d5d3-4b9b-ab83-9de7f6e0d5dc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:17.775511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fdcad-d5d3-4b9b-ab83-9de7f6e0d5dc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:17.783285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3e704-6bd7-4199-95d3-5a8c06ae959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:17.785390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3e704-6bd7-4199-95d3-5a8c06ae959b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.786380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3e704-6bd7-4199-95d3-5a8c06ae959b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.786873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3e704-6bd7-4199-95d3-5a8c06ae959b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.787886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3e704-6bd7-4199-95d3-5a8c06ae959b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:17.789669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3e704-6bd7-4199-95d3-5a8c06ae959b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:17.802604 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1137/2313] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:17.808341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05a5d6-5ebc-413f-8d16-0b8af34c7b82 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:17.819275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05a5d6-5ebc-413f-8d16-0b8af34c7b82 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:17.824276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c124c2-e990-4157-8c31-bcb72506dab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:17.825389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c124c2-e990-4157-8c31-bcb72506dab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.825552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c124c2-e990-4157-8c31-bcb72506dab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.825710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c124c2-e990-4157-8c31-bcb72506dab7 admin admin] PATH_INFO: `/v3/projects/f97f1206ba6b4e23adf2f28848c33e9a/users/0e5d1d531f55451ba7fb9d6af9769ccd/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.842968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c124c2-e990-4157-8c31-bcb72506dab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97f1206ba6b4e23adf2f28848c33e9a, user_id=0e5d1d531f55451ba7fb9d6af9769ccd, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:17.845701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c124c2-e990-4157-8c31-bcb72506dab7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:17.885815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8378df-e106-4f39-8e7b-85454ed55969 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.886390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8378df-e106-4f39-8e7b-85454ed55969 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.886854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8378df-e106-4f39-8e7b-85454ed55969 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.887778 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1177/2314] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:17 2022] PUT /identity/v3/projects/f97f1206ba6b4e23adf2f28848c33e9a/users/0e5d1d531f55451ba7fb9d6af9769ccd/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:17.889301 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1138/2315] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:50:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:50:17.889428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656acfa2-c7eb-4293-890e-52b93e09d144 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:17.889643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656acfa2-c7eb-4293-890e-52b93e09d144 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:17.889923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656acfa2-c7eb-4293-890e-52b93e09d144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:17.896962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8378df-e106-4f39-8e7b-85454ed55969 None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:50:17.898740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bb8378df-e106-4f39-8e7b-85454ed55969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:17.922131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-656acfa2-c7eb-4293-890e-52b93e09d144 None None] MFA Rules not processed for user `0e5d1d531f55451ba7fb9d6af9769ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:17.923584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-656acfa2-c7eb-4293-890e-52b93e09d144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:18.013984 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1178/2316] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:18.018547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8378df-e106-4f39-8e7b-85454ed55969 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:18.018722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656acfa2-c7eb-4293-890e-52b93e09d144 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:18.021441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bb8378df-e106-4f39-8e7b-85454ed55969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:18.131544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8378df-e106-4f39-8e7b-85454ed55969 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:18.137138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656acfa2-c7eb-4293-890e-52b93e09d144 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:18.138022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bdccf-1d0c-4fa5-a42e-715274f5186e tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e21f2f56f9f145ef892bb6207214cb27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5eef689ccc4c78870bf39896d655ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:18.139703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bdccf-1d0c-4fa5-a42e-715274f5186e tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.140113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bdccf-1d0c-4fa5-a42e-715274f5186e tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.140479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bdccf-1d0c-4fa5-a42e-715274f5186e tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] PATH_INFO: `/v3/projects/db166ab07bf64518be4f231ca4c864a8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.142314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bdccf-1d0c-4fa5-a42e-715274f5186e tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorizing `identity:get_project(project_id=db166ab07bf64518be4f231ca4c864a8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:18.145306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bdccf-1d0c-4fa5-a42e-715274f5186e tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:18.147450 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1139/2317] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:50:17 2022] GET /identity/v3/projects/db166ab07bf64518be4f231ca4c864a8 => generated 395 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:50:18.160238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80991305-750f-43fe-b0c1-e619c0ea086b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:18.161045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80991305-750f-43fe-b0c1-e619c0ea086b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.161332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80991305-750f-43fe-b0c1-e619c0ea086b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.161616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80991305-750f-43fe-b0c1-e619c0ea086b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.162324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80991305-750f-43fe-b0c1-e619c0ea086b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:18.170656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80991305-750f-43fe-b0c1-e619c0ea086b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:18.226480 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1179/2318] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:18 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:18.230512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bdccf-1d0c-4fa5-a42e-715274f5186e tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:18.244099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bdccf-1d0c-4fa5-a42e-715274f5186e tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:18.351113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9e3b7-8171-4d1f-9d14-7a9b9e4523e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:18.351967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9e3b7-8171-4d1f-9d14-7a9b9e4523e8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.352239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9e3b7-8171-4d1f-9d14-7a9b9e4523e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.352514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9e3b7-8171-4d1f-9d14-7a9b9e4523e8 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.353390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9e3b7-8171-4d1f-9d14-7a9b9e4523e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:18.357475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e9e3b7-8171-4d1f-9d14-7a9b9e4523e8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:18.386945 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1140/2319] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:18 2022] POST /identity/v3/users => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:18.390743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80991305-750f-43fe-b0c1-e619c0ea086b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:18.410148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80991305-750f-43fe-b0c1-e619c0ea086b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:18.414976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c8721-e3dc-442c-b83c-da54d858e473 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.415471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c8721-e3dc-442c-b83c-da54d858e473 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.415749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c8721-e3dc-442c-b83c-da54d858e473 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.417884 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1141/2320] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:50:18.423627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c8721-e3dc-442c-b83c-da54d858e473 None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:50:18.425145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3906f-69b5-4e9e-af5d-e5b7f0672e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:18.425814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3906f-69b5-4e9e-af5d-e5b7f0672e9b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.426064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3906f-69b5-4e9e-af5d-e5b7f0672e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.426357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3906f-69b5-4e9e-af5d-e5b7f0672e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.427076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3906f-69b5-4e9e-af5d-e5b7f0672e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:18.428905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3906f-69b5-4e9e-af5d-e5b7f0672e9b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:18.431982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-759c8721-e3dc-442c-b83c-da54d858e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:18.452463 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1180/2321] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:18.457572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3906f-69b5-4e9e-af5d-e5b7f0672e9b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:18.473287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3906f-69b5-4e9e-af5d-e5b7f0672e9b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:18.488744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc8d3f-5dfc-4507-9477-3d6eb71067fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:18.490092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc8d3f-5dfc-4507-9477-3d6eb71067fc admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.491203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc8d3f-5dfc-4507-9477-3d6eb71067fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.491945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc8d3f-5dfc-4507-9477-3d6eb71067fc admin admin] PATH_INFO: `/v3/projects/6005bd92c5fa4f5ea0d062c98c6d0efc/users/0ae90adc9f13440f91aa982f8423ba94/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.515715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc8d3f-5dfc-4507-9477-3d6eb71067fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6005bd92c5fa4f5ea0d062c98c6d0efc, user_id=0ae90adc9f13440f91aa982f8423ba94, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:18.519100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc8d3f-5dfc-4507-9477-3d6eb71067fc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:18.531803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c8721-e3dc-442c-b83c-da54d858e473 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:18.539323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1181/2322] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:18 2022] PUT /identity/v3/projects/6005bd92c5fa4f5ea0d062c98c6d0efc/users/0ae90adc9f13440f91aa982f8423ba94/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:18.540904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc8d3f-5dfc-4507-9477-3d6eb71067fc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:18.624209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc8d3f-5dfc-4507-9477-3d6eb71067fc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:18.631031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e178938-4c69-4419-930d-b8996679b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:18.632650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178938-4c69-4419-930d-b8996679b379 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.633032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178938-4c69-4419-930d-b8996679b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.633396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e178938-4c69-4419-930d-b8996679b379 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.634259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e178938-4c69-4419-930d-b8996679b379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:18.636291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e178938-4c69-4419-930d-b8996679b379 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:18.651461 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1182/2323] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:18.655425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c8721-e3dc-442c-b83c-da54d858e473 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:18.656184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e178938-4c69-4419-930d-b8996679b379 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:18.668614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e178938-4c69-4419-930d-b8996679b379 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:18.676791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ac007-a451-4273-a78e-4565a1a08b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:18.677975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ac007-a451-4273-a78e-4565a1a08b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.678943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ac007-a451-4273-a78e-4565a1a08b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.679361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ac007-a451-4273-a78e-4565a1a08b4a admin admin] PATH_INFO: `/v3/projects/6005bd92c5fa4f5ea0d062c98c6d0efc/users/0ae90adc9f13440f91aa982f8423ba94/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.681940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ac007-a451-4273-a78e-4565a1a08b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6005bd92c5fa4f5ea0d062c98c6d0efc, user_id=0ae90adc9f13440f91aa982f8423ba94, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:18.687474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ac007-a451-4273-a78e-4565a1a08b4a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:18.699611 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1183/2324] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:18 2022] PUT /identity/v3/projects/6005bd92c5fa4f5ea0d062c98c6d0efc/users/0ae90adc9f13440f91aa982f8423ba94/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:18.710450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b7f1b-9916-46e9-9ec6-f341366c5288 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.710737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b7f1b-9916-46e9-9ec6-f341366c5288 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.711008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b7f1b-9916-46e9-9ec6-f341366c5288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.736881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea8af-5979-4650-b88e-3a613aa2fbb2 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e21f2f56f9f145ef892bb6207214cb27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5eef689ccc4c78870bf39896d655ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:18.738031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea8af-5979-4650-b88e-3a613aa2fbb2 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:18.738973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea8af-5979-4650-b88e-3a613aa2fbb2 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:18.739628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea8af-5979-4650-b88e-3a613aa2fbb2 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] PATH_INFO: `/v3/projects/db166ab07bf64518be4f231ca4c864a8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:18.741300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6c5b7f1b-9916-46e9-9ec6-f341366c5288 None None] MFA Rules not processed for user `0ae90adc9f13440f91aa982f8423ba94`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:18.741884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ea8af-5979-4650-b88e-3a613aa2fbb2 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorizing `identity:get_project(project_id=db166ab07bf64518be4f231ca4c864a8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:18.742701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6c5b7f1b-9916-46e9-9ec6-f341366c5288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:18.744460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ea8af-5979-4650-b88e-3a613aa2fbb2 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:18.758339 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1142/2325] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:50:18 2022] GET /identity/v3/projects/db166ab07bf64518be4f231ca4c864a8 => generated 395 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:18.868537 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1184/2326] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:18.964512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea8af-5979-4650-b88e-3a613aa2fbb2 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:19.162988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea8af-5979-4650-b88e-3a613aa2fbb2 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:19.238337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5682bf-8a20-48be-8559-517ef3b91b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:19.238985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5682bf-8a20-48be-8559-517ef3b91b35 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:19.239264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5682bf-8a20-48be-8559-517ef3b91b35 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:19.239538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5682bf-8a20-48be-8559-517ef3b91b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:19.248659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5682bf-8a20-48be-8559-517ef3b91b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:19.249743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5682bf-8a20-48be-8559-517ef3b91b35 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:19.260124 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1143/2327] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:20.342241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b7f1b-9916-46e9-9ec6-f341366c5288 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:20.361112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b7f1b-9916-46e9-9ec6-f341366c5288 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:20.376691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63adb5c-815d-4d99-bc2a-0de9d5d61430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:20.378327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63adb5c-815d-4d99-bc2a-0de9d5d61430 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:20.379094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63adb5c-815d-4d99-bc2a-0de9d5d61430 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:20.379579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63adb5c-815d-4d99-bc2a-0de9d5d61430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:20.384074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f63adb5c-815d-4d99-bc2a-0de9d5d61430 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:20.489136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63adb5c-815d-4d99-bc2a-0de9d5d61430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:20.491449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63adb5c-815d-4d99-bc2a-0de9d5d61430 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:20.520581 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1185/2328] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:21.249576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5682bf-8a20-48be-8559-517ef3b91b35 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:21.392671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5682bf-8a20-48be-8559-517ef3b91b35 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:21.408259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:21.411726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:21.413267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:21.414610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] PATH_INFO: `/v3/users/0e5d1d531f55451ba7fb9d6af9769ccd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:21.418623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5d1d531f55451ba7fb9d6af9769ccd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:21.426774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:21.525013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5d1d531f55451ba7fb9d6af9769ccd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:21.549497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5d1d531f55451ba7fb9d6af9769ccd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:21.550473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5d1d531f55451ba7fb9d6af9769ccd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:21.551260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5d1d531f55451ba7fb9d6af9769ccd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:21.596787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5d1d531f55451ba7fb9d6af9769ccd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:21.615692 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1144/2329] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:21 2022] DELETE /identity/v3/users/0e5d1d531f55451ba7fb9d6af9769ccd => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:21.620381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbe9d4-3090-491b-a912-96b36596980d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:21.621349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbe9d4-3090-491b-a912-96b36596980d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:21.621834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bbe9d4-3090-491b-a912-96b36596980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:21.641288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-59bbe9d4-3090-491b-a912-96b36596980d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:21.642907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-59bbe9d4-3090-491b-a912-96b36596980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:21.712391 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1186/2330] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:21.762492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:21.764187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:21.788806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf2f1-fd2c-4ca0-8fb8-bbf113997f31 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:21.788806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf2f1-fd2c-4ca0-8fb8-bbf113997f31 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:21.789270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcf2f1-fd2c-4ca0-8fb8-bbf113997f31 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:21.791303 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1187/2331] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:50:21.810202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcf2f1-fd2c-4ca0-8fb8-bbf113997f31 None None] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:50:21.812042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-60fcf2f1-fd2c-4ca0-8fb8-bbf113997f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:21.916377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cfcd8-359b-48ca-8e23-f3441196abe9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:21.920854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895a3d3-ddbe-49d4-bac4-02f3a5f86079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:21.921512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895a3d3-ddbe-49d4-bac4-02f3a5f86079 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:21.921895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895a3d3-ddbe-49d4-bac4-02f3a5f86079 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:21.922267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895a3d3-ddbe-49d4-bac4-02f3a5f86079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:21.946067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895a3d3-ddbe-49d4-bac4-02f3a5f86079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:21.948241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895a3d3-ddbe-49d4-bac4-02f3a5f86079 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:21.973423 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1145/2332] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:21.975069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcf2f1-fd2c-4ca0-8fb8-bbf113997f31 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:21.976966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-60fcf2f1-fd2c-4ca0-8fb8-bbf113997f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:22.061815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcf2f1-fd2c-4ca0-8fb8-bbf113997f31 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:22.075348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ceb86a-d94f-4144-a703-50fbdd637361 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e21f2f56f9f145ef892bb6207214cb27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5eef689ccc4c78870bf39896d655ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:22.077975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ceb86a-d94f-4144-a703-50fbdd637361 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:22.078460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ceb86a-d94f-4144-a703-50fbdd637361 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:22.078904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ceb86a-d94f-4144-a703-50fbdd637361 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] PATH_INFO: `/v3/projects/db166ab07bf64518be4f231ca4c864a8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:22.080654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ceb86a-d94f-4144-a703-50fbdd637361 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorizing `identity:get_project(project_id=db166ab07bf64518be4f231ca4c864a8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:22.083517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ceb86a-d94f-4144-a703-50fbdd637361 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:22.086625 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1188/2333] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:50:21 2022] GET /identity/v3/projects/db166ab07bf64518be4f231ca4c864a8 => generated 395 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:50:23.395503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895a3d3-ddbe-49d4-bac4-02f3a5f86079 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:23.433926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895a3d3-ddbe-49d4-bac4-02f3a5f86079 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:23.449526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd63e7-2ba7-4183-b1c9-be79df067da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:23.450167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd63e7-2ba7-4183-b1c9-be79df067da2 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:23.450647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd63e7-2ba7-4183-b1c9-be79df067da2 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:23.451348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd63e7-2ba7-4183-b1c9-be79df067da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:23.454404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-70bd63e7-2ba7-4183-b1c9-be79df067da2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:23.511834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a97b6-7f3f-45df-ba39-2818714b754b None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:23.512390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a97b6-7f3f-45df-ba39-2818714b754b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:23.512390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a97b6-7f3f-45df-ba39-2818714b754b None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:23.514607 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1189/2334] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:50:23.532703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a97b6-7f3f-45df-ba39-2818714b754b None None] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:50:23.534998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4e2a97b6-7f3f-45df-ba39-2818714b754b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:23.571347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a97b6-7f3f-45df-ba39-2818714b754b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:23.595310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a97b6-7f3f-45df-ba39-2818714b754b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:23.600983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d22c0-7129-4139-8cd2-ef99c04dfb09 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e21f2f56f9f145ef892bb6207214cb27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5eef689ccc4c78870bf39896d655ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:23.601837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d22c0-7129-4139-8cd2-ef99c04dfb09 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:23.602559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d22c0-7129-4139-8cd2-ef99c04dfb09 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:23.603031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d22c0-7129-4139-8cd2-ef99c04dfb09 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] PATH_INFO: `/v3/projects/db166ab07bf64518be4f231ca4c864a8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:23.604892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d22c0-7129-4139-8cd2-ef99c04dfb09 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorizing `identity:get_project(project_id=db166ab07bf64518be4f231ca4c864a8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:23.607868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7d22c0-7129-4139-8cd2-ef99c04dfb09 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:23.622675 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1190/2335] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:50:23 2022] GET /identity/v3/projects/db166ab07bf64518be4f231ca4c864a8 => generated 395 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:23.631348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd63e7-2ba7-4183-b1c9-be79df067da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:23.633875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd63e7-2ba7-4183-b1c9-be79df067da2 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:23.659928 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1146/2336] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:24.215788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d22c0-7129-4139-8cd2-ef99c04dfb09 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:24.220268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2e7d22c0-7129-4139-8cd2-ef99c04dfb09 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:24.282042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d22c0-7129-4139-8cd2-ef99c04dfb09 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:24.301278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:24.303005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:24.303523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:24.304032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] PATH_INFO: `/v3/projects/f97f1206ba6b4e23adf2f28848c33e9a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:24.305810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97f1206ba6b4e23adf2f28848c33e9a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:24.310962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:24.419295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97f1206ba6b4e23adf2f28848c33e9a', 'request_id': 'req-3a46fbb9-7259-46f3-99a8-5dd556174f57'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.445387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97f1206ba6b4e23adf2f28848c33e9a', 'request_id': 'req-3a46fbb9-7259-46f3-99a8-5dd556174f57'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.452838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97f1206ba6b4e23adf2f28848c33e9a', 'request_id': 'req-3a46fbb9-7259-46f3-99a8-5dd556174f57'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.467623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] The token cache is being invalidate because project f97f1206ba6b4e23adf2f28848c33e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:24.468520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.470177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a46fbb9-7259-46f3-99a8-5dd556174f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.472759 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1191/2337] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:24 2022] DELETE /identity/v3/projects/f97f1206ba6b4e23adf2f28848c33e9a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:24.476541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd63e7-2ba7-4183-b1c9-be79df067da2 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:24.503707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd63e7-2ba7-4183-b1c9-be79df067da2 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:24.589734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:24.590625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:24.590911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:24.591188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] PATH_INFO: `/v3/users/0ae90adc9f13440f91aa982f8423ba94` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:24.596852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae90adc9f13440f91aa982f8423ba94)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:24.598837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:24.733717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae90adc9f13440f91aa982f8423ba94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.764459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae90adc9f13440f91aa982f8423ba94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.766048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae90adc9f13440f91aa982f8423ba94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.766763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae90adc9f13440f91aa982f8423ba94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.796601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae90adc9f13440f91aa982f8423ba94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:24.826299 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1147/2338] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:24 2022] DELETE /identity/v3/users/0ae90adc9f13440f91aa982f8423ba94 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:25.370257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935dc6f-5f5b-4a00-8817-69e44e42ec8d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:25.370762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935dc6f-5f5b-4a00-8817-69e44e42ec8d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:25.370981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935dc6f-5f5b-4a00-8817-69e44e42ec8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:25.398587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5935dc6f-5f5b-4a00-8817-69e44e42ec8d None None] MFA Rules not processed for user `f730effcbf03473fbdb527fa499ec181`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:25.400648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5935dc6f-5f5b-4a00-8817-69e44e42ec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:25.484722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:25.486459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:25.501431 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1192/2339] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:25.506706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935dc6f-5f5b-4a00-8817-69e44e42ec8d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:25.508871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5935dc6f-5f5b-4a00-8817-69e44e42ec8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:25.707196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca47fd-4f0f-4fda-82a8-62e0e41cc33d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:25.735020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:25.736204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:25.736367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:25.736641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] PATH_INFO: `/v3/users/37247839208e40e7984349f36749bb22` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:25.738750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37247839208e40e7984349f36749bb22)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:25.741678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:25.756395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935dc6f-5f5b-4a00-8817-69e44e42ec8d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:25.762009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3e1e6-a6c2-4f77-b4f5-696914519a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:25.762953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3e1e6-a6c2-4f77-b4f5-696914519a29 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:25.763381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3e1e6-a6c2-4f77-b4f5-696914519a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:25.763830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3e1e6-a6c2-4f77-b4f5-696914519a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:25.764709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3e1e6-a6c2-4f77-b4f5-696914519a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:25.766955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3e1e6-a6c2-4f77-b4f5-696914519a29 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:25.809975 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1193/2340] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:25 2022] POST /identity/v3/projects => generated 401 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:25.812168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795b818-4fa3-4630-b899-bd75ac0864f3 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:25.813963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795b818-4fa3-4630-b899-bd75ac0864f3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:25.815207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795b818-4fa3-4630-b899-bd75ac0864f3 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:25.820563 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1194/2341] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:50:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:50:25.829262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795b818-4fa3-4630-b899-bd75ac0864f3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:25.832732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6795b818-4fa3-4630-b899-bd75ac0864f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:25.843303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37247839208e40e7984349f36749bb22'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:25.858707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37247839208e40e7984349f36749bb22'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:25.859994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37247839208e40e7984349f36749bb22'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:25.860946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37247839208e40e7984349f36749bb22'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:25.878224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37247839208e40e7984349f36749bb22'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:25.900276 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1148/2342] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:25 2022] DELETE /identity/v3/users/37247839208e40e7984349f36749bb22 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:25.901440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:25.903006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:25.947447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795b818-4fa3-4630-b899-bd75ac0864f3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.025637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.026429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.026715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.027051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] PATH_INFO: `/v3/projects/6005bd92c5fa4f5ea0d062c98c6d0efc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.028447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6005bd92c5fa4f5ea0d062c98c6d0efc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.030515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.054825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6a3e4-7243-4384-a937-c2a24a425335 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.061333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.062365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.063034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.063533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.065685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.068504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.097574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6005bd92c5fa4f5ea0d062c98c6d0efc', 'request_id': 'req-9ec0ce32-ea34-4653-baab-4fc7926a41d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:26.101356 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1149/2343] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:25 2022] POST /identity/v3/users => generated 307 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:26.103174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:50:26.105875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:26.110756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6005bd92c5fa4f5ea0d062c98c6d0efc', 'request_id': 'req-9ec0ce32-ea34-4653-baab-4fc7926a41d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:26.125441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6005bd92c5fa4f5ea0d062c98c6d0efc', 'request_id': 'req-9ec0ce32-ea34-4653-baab-4fc7926a41d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:26.143726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] The token cache is being invalidate because project 6005bd92c5fa4f5ea0d062c98c6d0efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:26.144352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:26.145200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec0ce32-ea34-4653-baab-4fc7926a41d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:26.147358 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1195/2344] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:25 2022] DELETE /identity/v3/projects/6005bd92c5fa4f5ea0d062c98c6d0efc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:26.148845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56738629-5fb8-4994-b280-4d4bcead2658 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.149260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56738629-5fb8-4994-b280-4d4bcead2658 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.149633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56738629-5fb8-4994-b280-4d4bcead2658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.179105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-56738629-5fb8-4994-b280-4d4bcead2658 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:26.181079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-56738629-5fb8-4994-b280-4d4bcead2658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:26.199346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.202293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:26.271984 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1196/2345] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:26.271984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56738629-5fb8-4994-b280-4d4bcead2658 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.272515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-56738629-5fb8-4994-b280-4d4bcead2658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:26.288357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56738629-5fb8-4994-b280-4d4bcead2658 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.293991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ccad5-560e-4955-a70f-480010a33e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.295089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ccad5-560e-4955-a70f-480010a33e20 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.295528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ccad5-560e-4955-a70f-480010a33e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.296336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ccad5-560e-4955-a70f-480010a33e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.296831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ccad5-560e-4955-a70f-480010a33e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.299410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ccad5-560e-4955-a70f-480010a33e20 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.303194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97804d3e-1550-48e4-8957-fdcd91085cb5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.312531 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1197/2346] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:26.314065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fab41d-2eb3-44bc-9d83-26052b8c541e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.315112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fab41d-2eb3-44bc-9d83-26052b8c541e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.315727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fab41d-2eb3-44bc-9d83-26052b8c541e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.342084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e9fab41d-2eb3-44bc-9d83-26052b8c541e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:26.345365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e9fab41d-2eb3-44bc-9d83-26052b8c541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:26.362454 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1198/2347] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:26.363607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fab41d-2eb3-44bc-9d83-26052b8c541e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.365169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e9fab41d-2eb3-44bc-9d83-26052b8c541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:26.396616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4684-f2d6-4d63-816a-7095c35ef675 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e21f2f56f9f145ef892bb6207214cb27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d5eef689ccc4c78870bf39896d655ca', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.397737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4684-f2d6-4d63-816a-7095c35ef675 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.398133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4684-f2d6-4d63-816a-7095c35ef675 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.398513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4684-f2d6-4d63-816a-7095c35ef675 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] PATH_INFO: `/v3/projects/d299c856afa14e2eb152a3670d6533d0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.399838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe4684-f2d6-4d63-816a-7095c35ef675 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorizing `identity:get_project(project_id=d299c856afa14e2eb152a3670d6533d0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.402291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe4684-f2d6-4d63-816a-7095c35ef675 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.404522 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1150/2348] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:50:26 2022] GET /identity/v3/projects/d299c856afa14e2eb152a3670d6533d0 => generated 395 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:26.405587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4684-f2d6-4d63-816a-7095c35ef675 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.420022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4684-f2d6-4d63-816a-7095c35ef675 tempest-FlavorsAccessNegativeTestJSON-249256258 tempest-FlavorsAccessNegativeTestJSON-249256258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.425608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fd84e-358c-4933-b30d-aa22a2e54bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.426787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fd84e-358c-4933-b30d-aa22a2e54bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.427337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fd84e-358c-4933-b30d-aa22a2e54bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.427733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fd84e-358c-4933-b30d-aa22a2e54bcb admin admin] PATH_INFO: `/v3/projects/e0273c95d29a40b28247cc2d3f2bd7c2/users/84a254c1a9994724816a8627919f2197/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.444730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fd84e-358c-4933-b30d-aa22a2e54bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0273c95d29a40b28247cc2d3f2bd7c2, user_id=84a254c1a9994724816a8627919f2197, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.447817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fd84e-358c-4933-b30d-aa22a2e54bcb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.473836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fab41d-2eb3-44bc-9d83-26052b8c541e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.482374 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1151/2349] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:26 2022] PUT /identity/v3/projects/e0273c95d29a40b28247cc2d3f2bd7c2/users/84a254c1a9994724816a8627919f2197/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:26.485646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99013-c6eb-42a9-a13a-fe9fcab7f5a4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.487447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99013-c6eb-42a9-a13a-fe9fcab7f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.487971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99013-c6eb-42a9-a13a-fe9fcab7f5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.509500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e3f99013-c6eb-42a9-a13a-fe9fcab7f5a4 None None] MFA Rules not processed for user `4ef943b3272c48aa884a7ff4a7e854d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:26.511742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e3f99013-c6eb-42a9-a13a-fe9fcab7f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:26.575845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b06c4-028e-4394-b8e0-1e4713d952fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.576784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b06c4-028e-4394-b8e0-1e4713d952fa service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.577068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b06c4-028e-4394-b8e0-1e4713d952fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.577561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b06c4-028e-4394-b8e0-1e4713d952fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.599278 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1152/2350] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:26.601267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c78391-5195-475d-94d1-57e0d36a5431 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.601559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c78391-5195-475d-94d1-57e0d36a5431 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.601837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c78391-5195-475d-94d1-57e0d36a5431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.631659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f4c78391-5195-475d-94d1-57e0d36a5431 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:26.632895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f4c78391-5195-475d-94d1-57e0d36a5431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:26.706731 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1153/2351] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:26.707504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c78391-5195-475d-94d1-57e0d36a5431 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.718072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c78391-5195-475d-94d1-57e0d36a5431 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.719103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b06c4-028e-4394-b8e0-1e4713d952fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.721521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b06c4-028e-4394-b8e0-1e4713d952fa service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.724730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6b891-3da9-4cf0-b430-8d5f0bcd2c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.725400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6b891-3da9-4cf0-b430-8d5f0bcd2c31 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.725683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6b891-3da9-4cf0-b430-8d5f0bcd2c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.725953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6b891-3da9-4cf0-b430-8d5f0bcd2c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.726678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6b891-3da9-4cf0-b430-8d5f0bcd2c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.728344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea6b891-3da9-4cf0-b430-8d5f0bcd2c31 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.733712 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1199/2352] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:26.734924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b06c4-028e-4394-b8e0-1e4713d952fa service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.743853 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1154/2353] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:26.744981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6b891-3da9-4cf0-b430-8d5f0bcd2c31 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.750926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b06c4-028e-4394-b8e0-1e4713d952fa service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.756468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f2803-8ca3-4946-be2c-61b6711cce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.757344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f2803-8ca3-4946-be2c-61b6711cce98 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.757793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f2803-8ca3-4946-be2c-61b6711cce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.758219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f2803-8ca3-4946-be2c-61b6711cce98 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.758335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6b891-3da9-4cf0-b430-8d5f0bcd2c31 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.759186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f2803-8ca3-4946-be2c-61b6711cce98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:26.759658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f2803-8ca3-4946-be2c-61b6711cce98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.761899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f2803-8ca3-4946-be2c-61b6711cce98 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.764252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec050e9a-1539-4903-9d21-59df211d3976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.765817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050e9a-1539-4903-9d21-59df211d3976 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.766914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050e9a-1539-4903-9d21-59df211d3976 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.767296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050e9a-1539-4903-9d21-59df211d3976 admin admin] PATH_INFO: `/v3/projects/e0273c95d29a40b28247cc2d3f2bd7c2/users/84a254c1a9994724816a8627919f2197/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.771379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec050e9a-1539-4903-9d21-59df211d3976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0273c95d29a40b28247cc2d3f2bd7c2, user_id=84a254c1a9994724816a8627919f2197, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.775947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec050e9a-1539-4903-9d21-59df211d3976 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.782459 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1200/2354] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:26.787867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f2803-8ca3-4946-be2c-61b6711cce98 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.794582 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1155/2355] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:26 2022] PUT /identity/v3/projects/e0273c95d29a40b28247cc2d3f2bd7c2/users/84a254c1a9994724816a8627919f2197/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:26.805057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f2803-8ca3-4946-be2c-61b6711cce98 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.899954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357f87-0c73-477b-9004-3603a0115f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:26.900918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357f87-0c73-477b-9004-3603a0115f02 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:26.901343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357f87-0c73-477b-9004-3603a0115f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:26.902026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e357f87-0c73-477b-9004-3603a0115f02 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:26.902804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e357f87-0c73-477b-9004-3603a0115f02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:26.905013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e357f87-0c73-477b-9004-3603a0115f02 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:26.951584 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1201/2356] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:26 2022] POST /identity/v3/projects => generated 407 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:26.956388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec050e9a-1539-4903-9d21-59df211d3976 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.969426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec050e9a-1539-4903-9d21-59df211d3976 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:26.989398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357f87-0c73-477b-9004-3603a0115f02 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:26.991620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9e357f87-0c73-477b-9004-3603a0115f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:27.113502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e357f87-0c73-477b-9004-3603a0115f02 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:27.119455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789c5a5-6f03-4833-b29a-60e398cc33b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:27.120955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789c5a5-6f03-4833-b29a-60e398cc33b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:27.123664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789c5a5-6f03-4833-b29a-60e398cc33b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:27.124587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789c5a5-6f03-4833-b29a-60e398cc33b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:27.125673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789c5a5-6f03-4833-b29a-60e398cc33b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:27.129542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789c5a5-6f03-4833-b29a-60e398cc33b5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:27.130345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:27.131487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:27.131828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:27.135962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] PATH_INFO: `/v3/users/bf78f0ee921c46d48d8f7c436f29ed1c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:27.138498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf78f0ee921c46d48d8f7c436f29ed1c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:27.142233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:27.167259 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1156/2357] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:26 2022] POST /identity/v3/users => generated 304 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:27.173842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789c5a5-6f03-4833-b29a-60e398cc33b5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:27.179372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1789c5a5-6f03-4833-b29a-60e398cc33b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:27.199519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789c5a5-6f03-4833-b29a-60e398cc33b5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:27.205669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:27.206930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:27.207416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:27.208196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] PATH_INFO: `/v3/projects/1c87bd15896c4325b42e8eff64041a63` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:27.209820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c87bd15896c4325b42e8eff64041a63)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:27.212287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:27.236311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf78f0ee921c46d48d8f7c436f29ed1c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.255866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf78f0ee921c46d48d8f7c436f29ed1c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.257252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf78f0ee921c46d48d8f7c436f29ed1c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.257892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf78f0ee921c46d48d8f7c436f29ed1c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.271708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf78f0ee921c46d48d8f7c436f29ed1c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.297938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c87bd15896c4325b42e8eff64041a63', 'request_id': 'req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.311556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c87bd15896c4325b42e8eff64041a63', 'request_id': 'req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.322900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c87bd15896c4325b42e8eff64041a63', 'request_id': 'req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.331661 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1202/2358] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:26 2022] DELETE /identity/v3/users/bf78f0ee921c46d48d8f7c436f29ed1c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:27.334656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:27.337326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:27.362722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] The token cache is being invalidate because project 1c87bd15896c4325b42e8eff64041a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:27.364138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.369271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5195d1a9-3d3d-482c-b51b-d3972e7fc3a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.372590 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1157/2359] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:27 2022] DELETE /identity/v3/projects/1c87bd15896c4325b42e8eff64041a63 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:27.374242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665bc15-9478-40b8-bc57-8fcb9984e3f6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:27.375470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665bc15-9478-40b8-bc57-8fcb9984e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:27.375999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665bc15-9478-40b8-bc57-8fcb9984e3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:27.434390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a665bc15-9478-40b8-bc57-8fcb9984e3f6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:27.437375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a665bc15-9478-40b8-bc57-8fcb9984e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:27.510570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06869cf6-74f5-46b6-a6a2-e86f94501280 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:27.535302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726a29-0e0f-4a3e-a9f8-2263c1dbc1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:27.536189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726a29-0e0f-4a3e-a9f8-2263c1dbc1ca admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:27.536562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726a29-0e0f-4a3e-a9f8-2263c1dbc1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:27.537016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726a29-0e0f-4a3e-a9f8-2263c1dbc1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:27.539029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5726a29-0e0f-4a3e-a9f8-2263c1dbc1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:27.544301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5726a29-0e0f-4a3e-a9f8-2263c1dbc1ca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:27.572537 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1203/2360] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:27.575513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726a29-0e0f-4a3e-a9f8-2263c1dbc1ca admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:27.579553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a5726a29-0e0f-4a3e-a9f8-2263c1dbc1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:27.611726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726a29-0e0f-4a3e-a9f8-2263c1dbc1ca admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:27.622051 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1158/2361] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:27.623369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665bc15-9478-40b8-bc57-8fcb9984e3f6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:27.626147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a665bc15-9478-40b8-bc57-8fcb9984e3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:27.644123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:27.645978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:27.647705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:27.648096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] PATH_INFO: `/v3/users/b150f4b276e0447c8957a8c0be6b621f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:27.653283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b150f4b276e0447c8957a8c0be6b621f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:27.656663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:27.657757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665bc15-9478-40b8-bc57-8fcb9984e3f6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:27.682434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0413f-769a-4b1b-a792-03632c1fb47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:27.683135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0413f-769a-4b1b-a792-03632c1fb47a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:27.683421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0413f-769a-4b1b-a792-03632c1fb47a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:27.683701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0413f-769a-4b1b-a792-03632c1fb47a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:27.684481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0413f-769a-4b1b-a792-03632c1fb47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:27.686826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0413f-769a-4b1b-a792-03632c1fb47a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:27.718872 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1159/2362] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:27.720463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0413f-769a-4b1b-a792-03632c1fb47a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:27.724711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c7b0413f-769a-4b1b-a792-03632c1fb47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:27.768183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b150f4b276e0447c8957a8c0be6b621f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.784518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b150f4b276e0447c8957a8c0be6b621f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.785441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b150f4b276e0447c8957a8c0be6b621f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.786856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b150f4b276e0447c8957a8c0be6b621f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.816303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b150f4b276e0447c8957a8c0be6b621f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:27.871506 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1204/2363] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:27 2022] DELETE /identity/v3/users/b150f4b276e0447c8957a8c0be6b621f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:27.872521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:27.873927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:27.891396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0413f-769a-4b1b-a792-03632c1fb47a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:27.979508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22ddbe-283f-4d86-9586-5c0ee66e67c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:27.981718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22ddbe-283f-4d86-9586-5c0ee66e67c8 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:27.983474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22ddbe-283f-4d86-9586-5c0ee66e67c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:27.983961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22ddbe-283f-4d86-9586-5c0ee66e67c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:27.992622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f22ddbe-283f-4d86-9586-5c0ee66e67c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:28.051307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfe281-29ed-4932-bac5-77b983903486 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:28.065052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a3c68-9b6a-4272-a317-b7fc2498787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:28.067687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3c68-9b6a-4272-a317-b7fc2498787b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:28.067988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3c68-9b6a-4272-a317-b7fc2498787b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:28.068274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a3c68-9b6a-4272-a317-b7fc2498787b admin admin] PATH_INFO: `/v3/projects/d6e959c4377840d08da3e8f07a1cafbd/users/9d7a62b406694b6d97a006b75b2814a8/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:28.108147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3c68-9b6a-4272-a317-b7fc2498787b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6e959c4377840d08da3e8f07a1cafbd, user_id=9d7a62b406694b6d97a006b75b2814a8, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:28.110735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a3c68-9b6a-4272-a317-b7fc2498787b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:28.134179 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1205/2364] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:27 2022] PUT /identity/v3/projects/d6e959c4377840d08da3e8f07a1cafbd/users/9d7a62b406694b6d97a006b75b2814a8/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:28.143085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22ddbe-283f-4d86-9586-5c0ee66e67c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:28.144611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809730-b202-406c-a8ab-959e096e4f96 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:28.144909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809730-b202-406c-a8ab-959e096e4f96 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:28.145189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af809730-b202-406c-a8ab-959e096e4f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:28.145595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22ddbe-283f-4d86-9586-5c0ee66e67c8 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:28.157318 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1160/2365] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:28.185105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-af809730-b202-406c-a8ab-959e096e4f96 None None] MFA Rules not processed for user `9d7a62b406694b6d97a006b75b2814a8`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:28.186437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af809730-b202-406c-a8ab-959e096e4f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:28.355986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1206/2366] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:28.356204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22ddbe-283f-4d86-9586-5c0ee66e67c8 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:28.370456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22ddbe-283f-4d86-9586-5c0ee66e67c8 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:28.560809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf4c35-4dfd-46b4-8ba0-eb98f0dc5230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:28.561484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4c35-4dfd-46b4-8ba0-eb98f0dc5230 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:28.561761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4c35-4dfd-46b4-8ba0-eb98f0dc5230 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:28.562394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf4c35-4dfd-46b4-8ba0-eb98f0dc5230 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:28.563279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf4c35-4dfd-46b4-8ba0-eb98f0dc5230 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:28.565977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf4c35-4dfd-46b4-8ba0-eb98f0dc5230 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:28.655008 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1161/2367] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:28 2022] POST /identity/v3/projects => generated 409 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:28.659808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af809730-b202-406c-a8ab-959e096e4f96 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:28.681936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af809730-b202-406c-a8ab-959e096e4f96 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:28.695834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf4c35-4dfd-46b4-8ba0-eb98f0dc5230 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:28.698050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5cbf4c35-4dfd-46b4-8ba0-eb98f0dc5230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:28.800122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf4c35-4dfd-46b4-8ba0-eb98f0dc5230 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:28.815885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:28.818250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:28.819217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5afb-3355-49bf-a433-81f9d60515b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:28.820580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:28.821090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] PATH_INFO: `/v3/projects/efa73746819b44cd8a4f006d97e53cbf` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:28.821733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5afb-3355-49bf-a433-81f9d60515b8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:28.823381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5afb-3355-49bf-a433-81f9d60515b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:28.823885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5afb-3355-49bf-a433-81f9d60515b8 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:28.825090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5afb-3355-49bf-a433-81f9d60515b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:28.827228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa73746819b44cd8a4f006d97e53cbf)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:28.828510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5afb-3355-49bf-a433-81f9d60515b8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:28.829245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:28.872848 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1207/2368] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:28 2022] POST /identity/v3/users => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:28.877767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5afb-3355-49bf-a433-81f9d60515b8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:28.893141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5afb-3355-49bf-a433-81f9d60515b8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:28.900795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52fd11-bf70-48bf-a15c-f13938cdd024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:28.901911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fd11-bf70-48bf-a15c-f13938cdd024 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:28.902743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fd11-bf70-48bf-a15c-f13938cdd024 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:28.903248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52fd11-bf70-48bf-a15c-f13938cdd024 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:28.904417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52fd11-bf70-48bf-a15c-f13938cdd024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:28.907810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52fd11-bf70-48bf-a15c-f13938cdd024 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:28.924230 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1208/2369] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:28.928801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52fd11-bf70-48bf-a15c-f13938cdd024 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:28.950728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa73746819b44cd8a4f006d97e53cbf', 'request_id': 'req-1a085c5a-7d24-4b49-87ea-3e8e839314ae'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:28.961611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52fd11-bf70-48bf-a15c-f13938cdd024 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:28.978780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa73746819b44cd8a4f006d97e53cbf', 'request_id': 'req-1a085c5a-7d24-4b49-87ea-3e8e839314ae'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:28.985271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa73746819b44cd8a4f006d97e53cbf', 'request_id': 'req-1a085c5a-7d24-4b49-87ea-3e8e839314ae'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:29.006914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] The token cache is being invalidate because project efa73746819b44cd8a4f006d97e53cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:29.006914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:29.007867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1a085c5a-7d24-4b49-87ea-3e8e839314ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:29.012318 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1162/2370] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:28 2022] DELETE /identity/v3/projects/efa73746819b44cd8a4f006d97e53cbf => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:29.023554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5035f9-bdb9-4522-ad9b-24de047e07b6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.023554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5035f9-bdb9-4522-ad9b-24de047e07b6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.023554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5035f9-bdb9-4522-ad9b-24de047e07b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.076558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8f5035f9-bdb9-4522-ad9b-24de047e07b6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:29.078024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f5035f9-bdb9-4522-ad9b-24de047e07b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:29.088403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e7f9a-4db0-410d-a43d-32c759603642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.100217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e7f9a-4db0-410d-a43d-32c759603642 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.102760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e7f9a-4db0-410d-a43d-32c759603642 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.103148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e7f9a-4db0-410d-a43d-32c759603642 admin admin] PATH_INFO: `/v3/projects/0402d45814d349ee8dbb5f2beea8721b/users/1312faa266ce42a682bf5695478cbe69/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.106982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1163/2371] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:29.115395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cee80-b57c-4620-8f70-c873ec98fb69 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.115991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cee80-b57c-4620-8f70-c873ec98fb69 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.116447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cee80-b57c-4620-8f70-c873ec98fb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.144520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e7f9a-4db0-410d-a43d-32c759603642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0402d45814d349ee8dbb5f2beea8721b, user_id=1312faa266ce42a682bf5695478cbe69, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.151622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e7f9a-4db0-410d-a43d-32c759603642 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:29.158790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7c2cee80-b57c-4620-8f70-c873ec98fb69 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:29.161269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7c2cee80-b57c-4620-8f70-c873ec98fb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:29.177792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1209/2372] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:28 2022] PUT /identity/v3/projects/0402d45814d349ee8dbb5f2beea8721b/users/1312faa266ce42a682bf5695478cbe69/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:29.181235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e7f9a-4db0-410d-a43d-32c759603642 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.183295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d24e7f9a-4db0-410d-a43d-32c759603642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:29.259744 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1164/2373] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:29.263463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cee80-b57c-4620-8f70-c873ec98fb69 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.268410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e7f9a-4db0-410d-a43d-32c759603642 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:29.273747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d63ecd-f58a-486b-a598-a96b40996768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.273906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cee80-b57c-4620-8f70-c873ec98fb69 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:29.274862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d63ecd-f58a-486b-a598-a96b40996768 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.275307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d63ecd-f58a-486b-a598-a96b40996768 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.275725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d63ecd-f58a-486b-a598-a96b40996768 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.276851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d63ecd-f58a-486b-a598-a96b40996768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.279208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d63ecd-f58a-486b-a598-a96b40996768 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:29.280401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8149a7-9d6a-46db-a93a-8ac0e853d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.281170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8149a7-9d6a-46db-a93a-8ac0e853d0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.281796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8149a7-9d6a-46db-a93a-8ac0e853d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.282263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8149a7-9d6a-46db-a93a-8ac0e853d0e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.283144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8149a7-9d6a-46db-a93a-8ac0e853d0e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:29.283551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8149a7-9d6a-46db-a93a-8ac0e853d0e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.285599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8149a7-9d6a-46db-a93a-8ac0e853d0e6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:29.293651 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1210/2374] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:29.297455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d63ecd-f58a-486b-a598-a96b40996768 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.300085 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1165/2375] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:29.303976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8149a7-9d6a-46db-a93a-8ac0e853d0e6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.311091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d63ecd-f58a-486b-a598-a96b40996768 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:29.318159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63ab72-198f-4847-9162-1284b88b9e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.319200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ab72-198f-4847-9162-1284b88b9e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.319615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ab72-198f-4847-9162-1284b88b9e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.320068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ab72-198f-4847-9162-1284b88b9e3d admin admin] PATH_INFO: `/v3/projects/0402d45814d349ee8dbb5f2beea8721b/users/1312faa266ce42a682bf5695478cbe69/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.324665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63ab72-198f-4847-9162-1284b88b9e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0402d45814d349ee8dbb5f2beea8721b, user_id=1312faa266ce42a682bf5695478cbe69, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.326414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8149a7-9d6a-46db-a93a-8ac0e853d0e6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:29.328817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63ab72-198f-4847-9162-1284b88b9e3d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:29.334630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9957417-39c2-48bf-8b5f-7a58adb40b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.335632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9957417-39c2-48bf-8b5f-7a58adb40b8e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.336094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9957417-39c2-48bf-8b5f-7a58adb40b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.336479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9957417-39c2-48bf-8b5f-7a58adb40b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.337289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9957417-39c2-48bf-8b5f-7a58adb40b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.340601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9957417-39c2-48bf-8b5f-7a58adb40b8e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:29.352157 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1211/2376] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:29 2022] PUT /identity/v3/projects/0402d45814d349ee8dbb5f2beea8721b/users/1312faa266ce42a682bf5695478cbe69/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:29.364981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60acd20-c233-408a-8335-4a114cc5f063 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.365993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60acd20-c233-408a-8335-4a114cc5f063 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.366284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60acd20-c233-408a-8335-4a114cc5f063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.398532 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1166/2377] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:29 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:29.400804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9957417-39c2-48bf-8b5f-7a58adb40b8e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.447652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c60acd20-c233-408a-8335-4a114cc5f063 None None] MFA Rules not processed for user `1312faa266ce42a682bf5695478cbe69`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:29.448922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c60acd20-c233-408a-8335-4a114cc5f063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:29.567514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9957417-39c2-48bf-8b5f-7a58adb40b8e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:29.578246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dd870-0a1d-4eeb-87ba-680dac182641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.579933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dd870-0a1d-4eeb-87ba-680dac182641 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.580504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dd870-0a1d-4eeb-87ba-680dac182641 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.581165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80dd870-0a1d-4eeb-87ba-680dac182641 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.582338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dd870-0a1d-4eeb-87ba-680dac182641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.585834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80dd870-0a1d-4eeb-87ba-680dac182641 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:29.629962 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1167/2378] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:29 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:29.634730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dd870-0a1d-4eeb-87ba-680dac182641 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.647886 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1212/2379] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:29 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:29.655008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60acd20-c233-408a-8335-4a114cc5f063 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.662403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80dd870-0a1d-4eeb-87ba-680dac182641 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:29.670953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadd81e-5bec-4440-9ca7-da34a60921e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.673277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadd81e-5bec-4440-9ca7-da34a60921e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.674344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60acd20-c233-408a-8335-4a114cc5f063 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:29.674814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadd81e-5bec-4440-9ca7-da34a60921e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.675577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadd81e-5bec-4440-9ca7-da34a60921e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.677416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadd81e-5bec-4440-9ca7-da34a60921e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.680768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.682148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.682617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.682731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadd81e-5bec-4440-9ca7-da34a60921e8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:29.683301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] PATH_INFO: `/v3/users/9d7a62b406694b6d97a006b75b2814a8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.685237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7a62b406694b6d97a006b75b2814a8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.688145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:29.716790 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1168/2380] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:29.720492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadd81e-5bec-4440-9ca7-da34a60921e8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.741280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadd81e-5bec-4440-9ca7-da34a60921e8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:29.747134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384d274-aee4-487f-a60b-cc220bef46a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.762056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384d274-aee4-487f-a60b-cc220bef46a1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.763240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384d274-aee4-487f-a60b-cc220bef46a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.763990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384d274-aee4-487f-a60b-cc220bef46a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.766889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384d274-aee4-487f-a60b-cc220bef46a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.772400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7a62b406694b6d97a006b75b2814a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:29.773164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384d274-aee4-487f-a60b-cc220bef46a1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:29.796290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7a62b406694b6d97a006b75b2814a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:29.799628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7a62b406694b6d97a006b75b2814a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:29.801379 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1169/2381] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:29.802493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384d274-aee4-487f-a60b-cc220bef46a1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.805293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7a62b406694b6d97a006b75b2814a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:29.810734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9384d274-aee4-487f-a60b-cc220bef46a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:29.821411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7a62b406694b6d97a006b75b2814a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:29.848780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384d274-aee4-487f-a60b-cc220bef46a1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:29.859481 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1213/2382] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:29 2022] DELETE /identity/v3/users/9d7a62b406694b6d97a006b75b2814a8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:29.860317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:29.867773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:29.869470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:29.870350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:29.870631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:29.870906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] PATH_INFO: `/v3/projects/db166ab07bf64518be4f231ca4c864a8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:29.874880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db166ab07bf64518be4f231ca4c864a8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:29.880691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:30.006794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd02a5e-fd90-4375-8cab-88a4245d25df admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:30.027323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db166ab07bf64518be4f231ca4c864a8', 'request_id': 'req-ec1e0ccf-39cb-48f9-b156-3b6951268198'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.050033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db166ab07bf64518be4f231ca4c864a8', 'request_id': 'req-ec1e0ccf-39cb-48f9-b156-3b6951268198'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.058698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db166ab07bf64518be4f231ca4c864a8', 'request_id': 'req-ec1e0ccf-39cb-48f9-b156-3b6951268198'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.099185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] The token cache is being invalidate because project db166ab07bf64518be4f231ca4c864a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:30.099758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.100674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec1e0ccf-39cb-48f9-b156-3b6951268198 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.105755 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1170/2383] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:29 2022] DELETE /identity/v3/projects/db166ab07bf64518be4f231ca4c864a8 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:30.105755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f269533-c00a-4595-8f9e-9808e5086d43 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:30.105755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f269533-c00a-4595-8f9e-9808e5086d43 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:30.105755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f269533-c00a-4595-8f9e-9808e5086d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:30.133228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6f269533-c00a-4595-8f9e-9808e5086d43 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:30.134366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f269533-c00a-4595-8f9e-9808e5086d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:30.166378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893509e-f92c-43de-9cbd-5f6077463486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:30.169127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893509e-f92c-43de-9cbd-5f6077463486 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:30.170521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893509e-f92c-43de-9cbd-5f6077463486 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:30.171440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893509e-f92c-43de-9cbd-5f6077463486 admin admin] PATH_INFO: `/v3/projects/3aa6068dd8e94d7dbbd6dc1fcc7f236c/users/19597b33d62b4218ad7117bd8a520522/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:30.204512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893509e-f92c-43de-9cbd-5f6077463486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa6068dd8e94d7dbbd6dc1fcc7f236c, user_id=19597b33d62b4218ad7117bd8a520522, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:30.210913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893509e-f92c-43de-9cbd-5f6077463486 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:30.227276 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1171/2384] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:30.228186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f269533-c00a-4595-8f9e-9808e5086d43 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:30.229697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f269533-c00a-4595-8f9e-9808e5086d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:30.240766 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1214/2385] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:29 2022] PUT /identity/v3/projects/3aa6068dd8e94d7dbbd6dc1fcc7f236c/users/19597b33d62b4218ad7117bd8a520522/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:30.241539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893509e-f92c-43de-9cbd-5f6077463486 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:30.244681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d893509e-f92c-43de-9cbd-5f6077463486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:30.261292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f269533-c00a-4595-8f9e-9808e5086d43 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:30.351347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:30.352226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:30.353169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:30.353428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] PATH_INFO: `/v3/users/e21f2f56f9f145ef892bb6207214cb27` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:30.354764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21f2f56f9f145ef892bb6207214cb27)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:30.356784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:30.380776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893509e-f92c-43de-9cbd-5f6077463486 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:30.392894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6985423-60c3-4054-a1ba-5e168866b079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:30.394134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6985423-60c3-4054-a1ba-5e168866b079 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:30.394663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6985423-60c3-4054-a1ba-5e168866b079 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:30.395032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6985423-60c3-4054-a1ba-5e168866b079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:30.429581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6985423-60c3-4054-a1ba-5e168866b079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:30.431149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6985423-60c3-4054-a1ba-5e168866b079 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:30.452170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21f2f56f9f145ef892bb6207214cb27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.463563 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1215/2386] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:30.469077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a0ba-cea3-4792-ba5b-0ceb3b6d7a7f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:30.471146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a0ba-cea3-4792-ba5b-0ceb3b6d7a7f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:30.472879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5a0ba-cea3-4792-ba5b-0ceb3b6d7a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:30.473594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21f2f56f9f145ef892bb6207214cb27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.474443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21f2f56f9f145ef892bb6207214cb27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.475623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21f2f56f9f145ef892bb6207214cb27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.527228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21f2f56f9f145ef892bb6207214cb27'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:30.537415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f3e5a0ba-cea3-4792-ba5b-0ceb3b6d7a7f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:30.540913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f3e5a0ba-cea3-4792-ba5b-0ceb3b6d7a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:30.542803 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1172/2387] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:30 2022] DELETE /identity/v3/users/e21f2f56f9f145ef892bb6207214cb27 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:30.662195 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1216/2388] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:30.711800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:30.713692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:30.777748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d402f2e0-e625-42ed-bef6-787b04742732 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:30.782051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76192ea-25cc-4473-af08-7840a343b18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:30.782766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76192ea-25cc-4473-af08-7840a343b18a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:30.783240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76192ea-25cc-4473-af08-7840a343b18a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:30.783530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76192ea-25cc-4473-af08-7840a343b18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:30.794649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76192ea-25cc-4473-af08-7840a343b18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:30.797840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76192ea-25cc-4473-af08-7840a343b18a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:30.810894 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1173/2389] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:31.295064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5a0ba-cea3-4792-ba5b-0ceb3b6d7a7f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:31.296581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f3e5a0ba-cea3-4792-ba5b-0ceb3b6d7a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:31.314615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5a0ba-cea3-4792-ba5b-0ceb3b6d7a7f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:31.332420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:31.333487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:31.333944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:31.334365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] PATH_INFO: `/v3/projects/d6e959c4377840d08da3e8f07a1cafbd` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:31.335739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6e959c4377840d08da3e8f07a1cafbd)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:31.337879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:31.401057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6e959c4377840d08da3e8f07a1cafbd', 'request_id': 'req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.418777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6e959c4377840d08da3e8f07a1cafbd', 'request_id': 'req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.440534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6e959c4377840d08da3e8f07a1cafbd', 'request_id': 'req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.528357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] The token cache is being invalidate because project d6e959c4377840d08da3e8f07a1cafbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:31.529346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.530428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.542478 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1217/2390] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:31 2022] DELETE /identity/v3/projects/d6e959c4377840d08da3e8f07a1cafbd => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:31.546539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76192ea-25cc-4473-af08-7840a343b18a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:31.561085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76192ea-25cc-4473-af08-7840a343b18a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:31.650165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:31.653826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:31.713201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:31.716288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:31.716576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:31.716860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] PATH_INFO: `/v3/users/1312faa266ce42a682bf5695478cbe69` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:31.723433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1312faa266ce42a682bf5695478cbe69)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:31.726929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:31.798056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9cd5f-68b6-41ab-bf4d-0164f426c8f2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:31.805295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:31.806307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:31.806646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:31.806930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] PATH_INFO: `/v3/projects/0d5eef689ccc4c78870bf39896d655ca` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:31.810604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5eef689ccc4c78870bf39896d655ca)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:31.812814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:31.856752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1312faa266ce42a682bf5695478cbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.883669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1312faa266ce42a682bf5695478cbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.884790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1312faa266ce42a682bf5695478cbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.885677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1312faa266ce42a682bf5695478cbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.913842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1312faa266ce42a682bf5695478cbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.957803 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1174/2391] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:31 2022] DELETE /identity/v3/users/1312faa266ce42a682bf5695478cbe69 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:31.962395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5eef689ccc4c78870bf39896d655ca', 'request_id': 'req-9ec64e54-cd19-4f22-8a20-97b7f172399c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.983484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5eef689ccc4c78870bf39896d655ca', 'request_id': 'req-9ec64e54-cd19-4f22-8a20-97b7f172399c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:31.991810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5eef689ccc4c78870bf39896d655ca', 'request_id': 'req-9ec64e54-cd19-4f22-8a20-97b7f172399c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:32.010363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] The token cache is being invalidate because project 0d5eef689ccc4c78870bf39896d655ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:32.010862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:32.011751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec64e54-cd19-4f22-8a20-97b7f172399c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:32.018115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:32.018735 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1218/2392] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:31 2022] DELETE /identity/v3/projects/0d5eef689ccc4c78870bf39896d655ca => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:32.021135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:32.136900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18832c-23db-4f3a-998e-d8aea68ab24f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:32.142998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:32.144754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:32.145218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:32.145647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] PATH_INFO: `/v3/users/9993c13725164bf585081541f2e94a2a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:32.147205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9993c13725164bf585081541f2e94a2a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:32.150646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:32.250210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9993c13725164bf585081541f2e94a2a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:32.260345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9993c13725164bf585081541f2e94a2a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:32.261698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9993c13725164bf585081541f2e94a2a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:32.262570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9993c13725164bf585081541f2e94a2a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:32.277811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9993c13725164bf585081541f2e94a2a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:32.291909 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1175/2393] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:32 2022] DELETE /identity/v3/users/9993c13725164bf585081541f2e94a2a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:33.211382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079ea72-c0f8-48a5-9d5e-af69fe5609da None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:33.211895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079ea72-c0f8-48a5-9d5e-af69fe5609da None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:33.211895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079ea72-c0f8-48a5-9d5e-af69fe5609da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:33.263432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2079ea72-c0f8-48a5-9d5e-af69fe5609da None None] MFA Rules not processed for user `19597b33d62b4218ad7117bd8a520522`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:33.264947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2079ea72-c0f8-48a5-9d5e-af69fe5609da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:33.278794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:33.281120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:33.394063 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1219/2394] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:33.398864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079ea72-c0f8-48a5-9d5e-af69fe5609da None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:33.400950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2079ea72-c0f8-48a5-9d5e-af69fe5609da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:33.421903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13edb73d-ae85-4d39-90f2-56a7eddf451f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:33.426906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079ea72-c0f8-48a5-9d5e-af69fe5609da None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:33.440644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:33.442119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:33.442868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:33.443335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7ede-09e9-47c2-9528-cb08a958f2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:33.443783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] PATH_INFO: `/v3/projects/d299c856afa14e2eb152a3670d6533d0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:33.443890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7ede-09e9-47c2-9528-cb08a958f2ca admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:33.444180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7ede-09e9-47c2-9528-cb08a958f2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:33.444459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc7ede-09e9-47c2-9528-cb08a958f2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:33.445151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc7ede-09e9-47c2-9528-cb08a958f2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:33.446883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d299c856afa14e2eb152a3670d6533d0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:33.451621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc7ede-09e9-47c2-9528-cb08a958f2ca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:33.453370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:33.509841 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1220/2395] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:33 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:33.510948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7ede-09e9-47c2-9528-cb08a958f2ca admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:33.538335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd299c856afa14e2eb152a3670d6533d0', 'request_id': 'req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.550675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd299c856afa14e2eb152a3670d6533d0', 'request_id': 'req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.558256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd299c856afa14e2eb152a3670d6533d0', 'request_id': 'req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.576759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] The token cache is being invalidate because project d299c856afa14e2eb152a3670d6533d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:33.576954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.577793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a3f0f288-bd00-4ad3-9f0e-0f379e0cc262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.584610 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1176/2396] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:33 2022] DELETE /identity/v3/projects/d299c856afa14e2eb152a3670d6533d0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:33.586089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d8a4-cff1-4e49-9194-f4fd34f6c471 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:33.586572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d8a4-cff1-4e49-9194-f4fd34f6c471 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:33.586995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d8a4-cff1-4e49-9194-f4fd34f6c471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:33.617587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ec57d8a4-cff1-4e49-9194-f4fd34f6c471 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:33.619154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ec57d8a4-cff1-4e49-9194-f4fd34f6c471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:33.670100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc7ede-09e9-47c2-9528-cb08a958f2ca admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:33.737082 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1177/2397] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:33.738479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e78484-4a0e-4ee1-bc9e-7cefda4741b3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:33.738779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e78484-4a0e-4ee1-bc9e-7cefda4741b3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:33.739060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e78484-4a0e-4ee1-bc9e-7cefda4741b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:33.769828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c6e78484-4a0e-4ee1-bc9e-7cefda4741b3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:33.771152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c6e78484-4a0e-4ee1-bc9e-7cefda4741b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:33.790087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac3c22-d10b-4b7b-a90b-86481151a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:33.792080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac3c22-d10b-4b7b-a90b-86481151a3ab admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:33.792368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac3c22-d10b-4b7b-a90b-86481151a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:33.792651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac3c22-d10b-4b7b-a90b-86481151a3ab admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:33.799426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac3c22-d10b-4b7b-a90b-86481151a3ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:33.800200 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1178/2398] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:33.801232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e78484-4a0e-4ee1-bc9e-7cefda4741b3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:33.802925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac3c22-d10b-4b7b-a90b-86481151a3ab admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:33.805001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c6e78484-4a0e-4ee1-bc9e-7cefda4741b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:33.828792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e78484-4a0e-4ee1-bc9e-7cefda4741b3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:33.833207 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1221/2399] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:33 2022] POST /identity/v3/users => generated 298 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:33.834561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac3c22-d10b-4b7b-a90b-86481151a3ab admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:33.840245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:33.843611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:33.844041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:33.846363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] PATH_INFO: `/v3/projects/0402d45814d349ee8dbb5f2beea8721b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:33.848102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0402d45814d349ee8dbb5f2beea8721b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:33.851004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac3c22-d10b-4b7b-a90b-86481151a3ab admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:33.854291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:33.857489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:33.858447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:33.859442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:33.860161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:33.862831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:33.863323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:33.867160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:33.883974 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1222/2400] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:33.893431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:33.895998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:33.921487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c5de-1741-4d6d-a1fb-a065dbda7fbf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:33.931712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0402d45814d349ee8dbb5f2beea8721b', 'request_id': 'req-977988a2-0c98-4a6c-9e1a-e433728f7b15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.946776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0402d45814d349ee8dbb5f2beea8721b', 'request_id': 'req-977988a2-0c98-4a6c-9e1a-e433728f7b15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.961132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0402d45814d349ee8dbb5f2beea8721b', 'request_id': 'req-977988a2-0c98-4a6c-9e1a-e433728f7b15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.988434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] The token cache is being invalidate because project 0402d45814d349ee8dbb5f2beea8721b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:33.988929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.989781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:33.994032 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1179/2401] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:33 2022] DELETE /identity/v3/projects/0402d45814d349ee8dbb5f2beea8721b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:33.995353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:33.998111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:34.008154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cd60f-5dc8-4b36-a7d5-f5e1b2d6c5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.008846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cd60f-5dc8-4b36-a7d5-f5e1b2d6c5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.009130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cd60f-5dc8-4b36-a7d5-f5e1b2d6c5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.009405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cd60f-5dc8-4b36-a7d5-f5e1b2d6c5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.010138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cd60f-5dc8-4b36-a7d5-f5e1b2d6c5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.014618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cd60f-5dc8-4b36-a7d5-f5e1b2d6c5c8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.033792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1223/2402] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:34.033792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0430e41-c568-40c1-8f15-bc3870c057d4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.033792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0430e41-c568-40c1-8f15-bc3870c057d4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.033792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0430e41-c568-40c1-8f15-bc3870c057d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.057869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d0430e41-c568-40c1-8f15-bc3870c057d4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:34.059107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d0430e41-c568-40c1-8f15-bc3870c057d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:34.073797 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1224/2403] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:34.074753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0430e41-c568-40c1-8f15-bc3870c057d4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.077664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d0430e41-c568-40c1-8f15-bc3870c057d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:34.093984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0430e41-c568-40c1-8f15-bc3870c057d4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.100644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236bf927-9cc2-4015-8448-7fbd8d10b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.102652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf927-9cc2-4015-8448-7fbd8d10b472 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.103428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf927-9cc2-4015-8448-7fbd8d10b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.103910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236bf927-9cc2-4015-8448-7fbd8d10b472 admin admin] PATH_INFO: `/v3/projects/1e14c4010d2e4588ab9498cdf0b7904d/users/7005bc45925d42a1854758b05a82978f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.134270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bf927-9cc2-4015-8448-7fbd8d10b472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e14c4010d2e4588ab9498cdf0b7904d, user_id=7005bc45925d42a1854758b05a82978f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.142858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236bf927-9cc2-4015-8448-7fbd8d10b472 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.157480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977988a2-0c98-4a6c-9e1a-e433728f7b15 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.172313 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1225/2404] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:34 2022] PUT /identity/v3/projects/1e14c4010d2e4588ab9498cdf0b7904d/users/7005bc45925d42a1854758b05a82978f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:34.174468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15db7b6-6263-4b42-80b7-9a89b85b0b16 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.174767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15db7b6-6263-4b42-80b7-9a89b85b0b16 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.175044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15db7b6-6263-4b42-80b7-9a89b85b0b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.176187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b795d-b636-4ed4-adbf-4f59cb61a844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.176950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b795d-b636-4ed4-adbf-4f59cb61a844 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.177248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b795d-b636-4ed4-adbf-4f59cb61a844 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.177531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b795d-b636-4ed4-adbf-4f59cb61a844 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.178228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b795d-b636-4ed4-adbf-4f59cb61a844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.180201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b795d-b636-4ed4-adbf-4f59cb61a844 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.208499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a15db7b6-6263-4b42-80b7-9a89b85b0b16 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:34.210241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a15db7b6-6263-4b42-80b7-9a89b85b0b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:34.229570 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1180/2405] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:33 2022] POST /identity/v3/projects => generated 393 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:34.230547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b795d-b636-4ed4-adbf-4f59cb61a844 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.343879 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1226/2406] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:34.344840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15db7b6-6263-4b42-80b7-9a89b85b0b16 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.356439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b795d-b636-4ed4-adbf-4f59cb61a844 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.362951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15db7b6-6263-4b42-80b7-9a89b85b0b16 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.366197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86a9ca-383e-4611-94d4-63e375bc2bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.367242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86a9ca-383e-4611-94d4-63e375bc2bae admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.367688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86a9ca-383e-4611-94d4-63e375bc2bae admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.368144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86a9ca-383e-4611-94d4-63e375bc2bae admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.369302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86a9ca-383e-4611-94d4-63e375bc2bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.371663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86a9ca-383e-4611-94d4-63e375bc2bae admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.378937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7676a-919c-4f31-a8ea-8adbf18e0d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.379116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7676a-919c-4f31-a8ea-8adbf18e0d06 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.384138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7676a-919c-4f31-a8ea-8adbf18e0d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.384788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7676a-919c-4f31-a8ea-8adbf18e0d06 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.386349 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1181/2407] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:34.387573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86a9ca-383e-4611-94d4-63e375bc2bae admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.387693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7676a-919c-4f31-a8ea-8adbf18e0d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.396787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7676a-919c-4f31-a8ea-8adbf18e0d06 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.409899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86a9ca-383e-4611-94d4-63e375bc2bae admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.416834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d5126-714a-49c9-9c06-a0285b5e5d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.417568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d5126-714a-49c9-9c06-a0285b5e5d04 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.417770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d5126-714a-49c9-9c06-a0285b5e5d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.418153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d5126-714a-49c9-9c06-a0285b5e5d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.418757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d5126-714a-49c9-9c06-a0285b5e5d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:34.419122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d5126-714a-49c9-9c06-a0285b5e5d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.420814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d5126-714a-49c9-9c06-a0285b5e5d04 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.456574 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1227/2409] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:34 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:34.456797 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1182/2409] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:34.457582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d5126-714a-49c9-9c06-a0285b5e5d04 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.467229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7676a-919c-4f31-a8ea-8adbf18e0d06 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.490702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d5126-714a-49c9-9c06-a0285b5e5d04 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.493912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7676a-919c-4f31-a8ea-8adbf18e0d06 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.510147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa452ad1-20d2-4397-9055-fc68a7da70d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.512002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa452ad1-20d2-4397-9055-fc68a7da70d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.513320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285600-6c14-4c14-8eab-bda00ef059a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.513841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa452ad1-20d2-4397-9055-fc68a7da70d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.514151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285600-6c14-4c14-8eab-bda00ef059a2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.514508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285600-6c14-4c14-8eab-bda00ef059a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.514853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81285600-6c14-4c14-8eab-bda00ef059a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.515087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa452ad1-20d2-4397-9055-fc68a7da70d0 admin admin] PATH_INFO: `/v3/projects/1e14c4010d2e4588ab9498cdf0b7904d/users/7005bc45925d42a1854758b05a82978f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.515714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81285600-6c14-4c14-8eab-bda00ef059a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.518096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81285600-6c14-4c14-8eab-bda00ef059a2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.521278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa452ad1-20d2-4397-9055-fc68a7da70d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e14c4010d2e4588ab9498cdf0b7904d, user_id=7005bc45925d42a1854758b05a82978f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.524180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa452ad1-20d2-4397-9055-fc68a7da70d0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.547508 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1228/2410] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:34.548766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285600-6c14-4c14-8eab-bda00ef059a2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.558608 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1183/2411] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:34 2022] PUT /identity/v3/projects/1e14c4010d2e4588ab9498cdf0b7904d/users/7005bc45925d42a1854758b05a82978f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:34.559488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa452ad1-20d2-4397-9055-fc68a7da70d0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.574944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81285600-6c14-4c14-8eab-bda00ef059a2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.701525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa452ad1-20d2-4397-9055-fc68a7da70d0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.702433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf4485-4447-46e6-b291-4782fa07d107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.709538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf4485-4447-46e6-b291-4782fa07d107 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.710284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf4485-4447-46e6-b291-4782fa07d107 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.711754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b2f8-2549-4eb2-aeae-9831ebbf71a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.712210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf4485-4447-46e6-b291-4782fa07d107 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.713029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b2f8-2549-4eb2-aeae-9831ebbf71a9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.713302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b2f8-2549-4eb2-aeae-9831ebbf71a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.713585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b2f8-2549-4eb2-aeae-9831ebbf71a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.714417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501b2f8-2549-4eb2-aeae-9831ebbf71a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.716153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501b2f8-2549-4eb2-aeae-9831ebbf71a9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.717630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf4485-4447-46e6-b291-4782fa07d107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.720000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf4485-4447-46e6-b291-4782fa07d107 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.730205 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1184/2412] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:34.744306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b2f8-2549-4eb2-aeae-9831ebbf71a9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.760510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b2f8-2549-4eb2-aeae-9831ebbf71a9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:34.767898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce23e6-ba70-43da-86cc-2a1404f06d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:34.769110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce23e6-ba70-43da-86cc-2a1404f06d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.769540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce23e6-ba70-43da-86cc-2a1404f06d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.769918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce23e6-ba70-43da-86cc-2a1404f06d91 admin admin] PATH_INFO: `/v3/projects/c1f5b332b509479e8b7e00d2d5e27fed/users/8d0099a6ec844dd0bc95ab897b618796/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.797682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce23e6-ba70-43da-86cc-2a1404f06d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f5b332b509479e8b7e00d2d5e27fed, user_id=8d0099a6ec844dd0bc95ab897b618796, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:34.800928 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1229/2413] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:34 2022] POST /identity/v3/projects => generated 393 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:34.802676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ce23e6-ba70-43da-86cc-2a1404f06d91 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:34.804898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf4485-4447-46e6-b291-4782fa07d107 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:34.844707 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1185/2414] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:34 2022] PUT /identity/v3/projects/c1f5b332b509479e8b7e00d2d5e27fed/users/8d0099a6ec844dd0bc95ab897b618796/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:34.856844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63bbf-69ed-4b85-9c3a-7e2378840a4f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:34.857137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63bbf-69ed-4b85-9c3a-7e2378840a4f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:34.857887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63bbf-69ed-4b85-9c3a-7e2378840a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:34.894002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8dc63bbf-69ed-4b85-9c3a-7e2378840a4f None None] MFA Rules not processed for user `8d0099a6ec844dd0bc95ab897b618796`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:34.895463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8dc63bbf-69ed-4b85-9c3a-7e2378840a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:34.948255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf4485-4447-46e6-b291-4782fa07d107 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.093206 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1186/2415] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:35.096323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc63bbf-69ed-4b85-9c3a-7e2378840a4f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.155881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5fc8d-39a3-4094-b305-5058ad7fc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.156942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5fc8d-39a3-4094-b305-5058ad7fc286 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.157336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5fc8d-39a3-4094-b305-5058ad7fc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.157769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5fc8d-39a3-4094-b305-5058ad7fc286 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.160201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5fc8d-39a3-4094-b305-5058ad7fc286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:35.162537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5fc8d-39a3-4094-b305-5058ad7fc286 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:35.210915 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1230/2416] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:34 2022] POST /identity/v3/users => generated 297 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:35.215000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5fc8d-39a3-4094-b305-5058ad7fc286 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.238009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5fc8d-39a3-4094-b305-5058ad7fc286 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.250695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbde83-fef7-424e-a370-1b08e46a64ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.251605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbde83-fef7-424e-a370-1b08e46a64ff admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.252134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbde83-fef7-424e-a370-1b08e46a64ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.252523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbde83-fef7-424e-a370-1b08e46a64ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.253375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbde83-fef7-424e-a370-1b08e46a64ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:35.256177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbde83-fef7-424e-a370-1b08e46a64ff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:35.316118 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1231/2417] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:35.317712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbde83-fef7-424e-a370-1b08e46a64ff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.339114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbde83-fef7-424e-a370-1b08e46a64ff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.345779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7366dbd-ac44-4c15-9820-f291ae2d3cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.348840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7366dbd-ac44-4c15-9820-f291ae2d3cfa admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.352740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc63bbf-69ed-4b85-9c3a-7e2378840a4f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.361330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7366dbd-ac44-4c15-9820-f291ae2d3cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.362042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7366dbd-ac44-4c15-9820-f291ae2d3cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.363562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7366dbd-ac44-4c15-9820-f291ae2d3cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:35.368242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7366dbd-ac44-4c15-9820-f291ae2d3cfa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:35.373218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00e093-2668-41bf-9260-f65cc3302ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.373896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00e093-2668-41bf-9260-f65cc3302ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.374318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00e093-2668-41bf-9260-f65cc3302ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.374604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00e093-2668-41bf-9260-f65cc3302ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.375311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00e093-2668-41bf-9260-f65cc3302ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:35.378477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00e093-2668-41bf-9260-f65cc3302ea0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:35.383464 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1232/2418] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:35.387931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7366dbd-ac44-4c15-9820-f291ae2d3cfa admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.401310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7366dbd-ac44-4c15-9820-f291ae2d3cfa admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.417967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d674e-1f26-49d3-900a-dfbda17078c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.419123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d674e-1f26-49d3-900a-dfbda17078c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.419587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d674e-1f26-49d3-900a-dfbda17078c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.420033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d674e-1f26-49d3-900a-dfbda17078c0 admin admin] PATH_INFO: `/v3/projects/e30490816db249b9af0ffbe3b0feb51d/users/9d4b5ce51a69447d9e623d33360d726b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.452780 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1187/2419] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:35 2022] POST /identity/v3/projects => generated 393 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:35.456632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00e093-2668-41bf-9260-f65cc3302ea0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.462209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d674e-1f26-49d3-900a-dfbda17078c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e30490816db249b9af0ffbe3b0feb51d, user_id=9d4b5ce51a69447d9e623d33360d726b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:35.470076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d674e-1f26-49d3-900a-dfbda17078c0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:35.512305 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1233/2420] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:35 2022] PUT /identity/v3/projects/e30490816db249b9af0ffbe3b0feb51d/users/9d4b5ce51a69447d9e623d33360d726b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:35.514910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55cdf7-c11c-4283-bd22-8ba3d03b7998 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.515148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55cdf7-c11c-4283-bd22-8ba3d03b7998 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.515427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55cdf7-c11c-4283-bd22-8ba3d03b7998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.573804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6b55cdf7-c11c-4283-bd22-8ba3d03b7998 None None] MFA Rules not processed for user `9d4b5ce51a69447d9e623d33360d726b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:35.576335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6b55cdf7-c11c-4283-bd22-8ba3d03b7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:35.590755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00e093-2668-41bf-9260-f65cc3302ea0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.675429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769d8e6-074b-4716-aa1d-84129f274880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.676494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769d8e6-074b-4716-aa1d-84129f274880 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.676797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769d8e6-074b-4716-aa1d-84129f274880 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.677166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769d8e6-074b-4716-aa1d-84129f274880 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.677926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769d8e6-074b-4716-aa1d-84129f274880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:35.680068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769d8e6-074b-4716-aa1d-84129f274880 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:35.685927 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1234/2421] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:35.690838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55cdf7-c11c-4283-bd22-8ba3d03b7998 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.709294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55cdf7-c11c-4283-bd22-8ba3d03b7998 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.715390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c617f-7b35-44b1-856e-50aa13169190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.716409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c617f-7b35-44b1-856e-50aa13169190 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.716836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c617f-7b35-44b1-856e-50aa13169190 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.717382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c617f-7b35-44b1-856e-50aa13169190 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.718368 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1188/2422] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:35 2022] POST /identity/v3/users => generated 303 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:35.718933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c617f-7b35-44b1-856e-50aa13169190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:35.721572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c617f-7b35-44b1-856e-50aa13169190 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:35.724453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769d8e6-074b-4716-aa1d-84129f274880 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.740835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769d8e6-074b-4716-aa1d-84129f274880 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.753117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7168f6-8401-451c-adaf-1ccddd6102ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.756458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7168f6-8401-451c-adaf-1ccddd6102ed admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.756937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7168f6-8401-451c-adaf-1ccddd6102ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.757750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7168f6-8401-451c-adaf-1ccddd6102ed admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.758806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7168f6-8401-451c-adaf-1ccddd6102ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:35.761706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7168f6-8401-451c-adaf-1ccddd6102ed admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:35.781250 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1235/2423] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:35 2022] POST /identity/v3/projects => generated 393 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:35.782143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c617f-7b35-44b1-856e-50aa13169190 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.788223 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1189/2424] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:35.792908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7168f6-8401-451c-adaf-1ccddd6102ed admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.815797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7168f6-8401-451c-adaf-1ccddd6102ed admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.869889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c617f-7b35-44b1-856e-50aa13169190 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.884720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588775e9-bbe5-4172-aa8d-8434f8cdd0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.886465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588775e9-bbe5-4172-aa8d-8434f8cdd0ad admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.887384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588775e9-bbe5-4172-aa8d-8434f8cdd0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.887712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588775e9-bbe5-4172-aa8d-8434f8cdd0ad admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.889942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588775e9-bbe5-4172-aa8d-8434f8cdd0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:35.894669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588775e9-bbe5-4172-aa8d-8434f8cdd0ad admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:35.943976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384c597-fc8d-45de-95e4-637f54e60575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.944947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384c597-fc8d-45de-95e4-637f54e60575 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.945237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384c597-fc8d-45de-95e4-637f54e60575 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.945669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384c597-fc8d-45de-95e4-637f54e60575 admin admin] PATH_INFO: `/v3/projects/93f06d41524b4112be8d67b68e9ebd57/users/869c4bd1321a4461a2d262e875b71362/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.945897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1236/2425] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:35 2022] POST /identity/v3/users => generated 303 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:35.949842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588775e9-bbe5-4172-aa8d-8434f8cdd0ad admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:35.967685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588775e9-bbe5-4172-aa8d-8434f8cdd0ad admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:35.995905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8e46-bf05-4b3d-b937-ddaef80dbc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:35.996700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8e46-bf05-4b3d-b937-ddaef80dbc7a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:35.997044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8e46-bf05-4b3d-b937-ddaef80dbc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:35.997322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf8e46-bf05-4b3d-b937-ddaef80dbc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:35.998182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf8e46-bf05-4b3d-b937-ddaef80dbc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:36.001301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf8e46-bf05-4b3d-b937-ddaef80dbc7a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:36.015660 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1237/2426] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:50:36.021975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8e46-bf05-4b3d-b937-ddaef80dbc7a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:36.038724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384c597-fc8d-45de-95e4-637f54e60575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f06d41524b4112be8d67b68e9ebd57, user_id=869c4bd1321a4461a2d262e875b71362, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:36.042642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384c597-fc8d-45de-95e4-637f54e60575 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:36.058129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf8e46-bf05-4b3d-b937-ddaef80dbc7a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:36.075152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1190/2427] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:35 2022] PUT /identity/v3/projects/93f06d41524b4112be8d67b68e9ebd57/users/869c4bd1321a4461a2d262e875b71362/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:36.079373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384c597-fc8d-45de-95e4-637f54e60575 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:36.193679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4b818-058f-41b7-a669-22908fe3b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:36.195197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4b818-058f-41b7-a669-22908fe3b0a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:36.195548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4b818-058f-41b7-a669-22908fe3b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:36.195889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4b818-058f-41b7-a669-22908fe3b0a4 admin admin] PATH_INFO: `/v3/projects/e5b6eedd55b14effad99ec550bec7352/users/abd276c46af844979e73447cfaa83361/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:36.198897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384c597-fc8d-45de-95e4-637f54e60575 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:36.207546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f7833-2f11-4eea-9f6f-c39907963af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:36.209128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7833-2f11-4eea-9f6f-c39907963af4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:36.209408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7833-2f11-4eea-9f6f-c39907963af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:36.209819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7833-2f11-4eea-9f6f-c39907963af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:36.210685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f7833-2f11-4eea-9f6f-c39907963af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:36.212850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f7833-2f11-4eea-9f6f-c39907963af4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:36.229345 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1191/2428] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:36.230243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f7833-2f11-4eea-9f6f-c39907963af4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:36.235124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4b818-058f-41b7-a669-22908fe3b0a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b6eedd55b14effad99ec550bec7352, user_id=abd276c46af844979e73447cfaa83361, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:36.242612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f7833-2f11-4eea-9f6f-c39907963af4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:36.244691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4b818-058f-41b7-a669-22908fe3b0a4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:36.248135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88834067-82ee-4975-8a08-dae0eac59e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:36.249024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88834067-82ee-4975-8a08-dae0eac59e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:36.249305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88834067-82ee-4975-8a08-dae0eac59e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:36.249581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88834067-82ee-4975-8a08-dae0eac59e32 admin admin] PATH_INFO: `/v3/projects/93f06d41524b4112be8d67b68e9ebd57/users/869c4bd1321a4461a2d262e875b71362/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:36.252220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88834067-82ee-4975-8a08-dae0eac59e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f06d41524b4112be8d67b68e9ebd57, user_id=869c4bd1321a4461a2d262e875b71362, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:36.255058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88834067-82ee-4975-8a08-dae0eac59e32 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:36.266465 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1238/2429] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:36 2022] PUT /identity/v3/projects/e5b6eedd55b14effad99ec550bec7352/users/abd276c46af844979e73447cfaa83361/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:36.270547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4b818-058f-41b7-a669-22908fe3b0a4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:36.271711 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1192/2430] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:36 2022] PUT /identity/v3/projects/93f06d41524b4112be8d67b68e9ebd57/users/869c4bd1321a4461a2d262e875b71362/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:36.289981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2efea8-c458-4d78-9485-623ff237b39f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:36.290445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2efea8-c458-4d78-9485-623ff237b39f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:36.291020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2efea8-c458-4d78-9485-623ff237b39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:36.327691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bd2efea8-c458-4d78-9485-623ff237b39f None None] MFA Rules not processed for user `869c4bd1321a4461a2d262e875b71362`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:36.331384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bd2efea8-c458-4d78-9485-623ff237b39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:36.424617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4b818-058f-41b7-a669-22908fe3b0a4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:36.499826 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1193/2431] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:36.537315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420ce0c-3b7e-42eb-b047-82ff1dd32792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:36.538594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420ce0c-3b7e-42eb-b047-82ff1dd32792 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:36.539022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420ce0c-3b7e-42eb-b047-82ff1dd32792 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:36.539442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420ce0c-3b7e-42eb-b047-82ff1dd32792 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:36.540352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420ce0c-3b7e-42eb-b047-82ff1dd32792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:36.552860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420ce0c-3b7e-42eb-b047-82ff1dd32792 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:36.604093 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1239/2432] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:50:36.612956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2efea8-c458-4d78-9485-623ff237b39f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:36.622510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420ce0c-3b7e-42eb-b047-82ff1dd32792 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:36.634642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420ce0c-3b7e-42eb-b047-82ff1dd32792 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:36.638847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2efea8-c458-4d78-9485-623ff237b39f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:36.647901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:36.648962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:36.649250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:36.649523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] PATH_INFO: `/v3/users/8d0099a6ec844dd0bc95ab897b618796` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:36.651585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0099a6ec844dd0bc95ab897b618796)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:36.653602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:36.654616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6c0b7-d4bc-4b8a-b5c0-f2f48b1979c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:36.655947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6c0b7-d4bc-4b8a-b5c0-f2f48b1979c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:36.657445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6c0b7-d4bc-4b8a-b5c0-f2f48b1979c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:36.659577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6c0b7-d4bc-4b8a-b5c0-f2f48b1979c7 admin admin] PATH_INFO: `/v3/projects/e5b6eedd55b14effad99ec550bec7352/users/abd276c46af844979e73447cfaa83361/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:36.681384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6c0b7-d4bc-4b8a-b5c0-f2f48b1979c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b6eedd55b14effad99ec550bec7352, user_id=abd276c46af844979e73447cfaa83361, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:36.688613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6c0b7-d4bc-4b8a-b5c0-f2f48b1979c7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:36.706393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1194/2433] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:36 2022] PUT /identity/v3/projects/e5b6eedd55b14effad99ec550bec7352/users/abd276c46af844979e73447cfaa83361/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:36.718142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14512da-2421-4c43-bc66-f6ec02aedacc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:36.720157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14512da-2421-4c43-bc66-f6ec02aedacc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:36.721495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14512da-2421-4c43-bc66-f6ec02aedacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:36.755162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0099a6ec844dd0bc95ab897b618796'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:36.764299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c14512da-2421-4c43-bc66-f6ec02aedacc None None] MFA Rules not processed for user `abd276c46af844979e73447cfaa83361`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:36.768045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c14512da-2421-4c43-bc66-f6ec02aedacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:36.771822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0099a6ec844dd0bc95ab897b618796'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:36.781301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0099a6ec844dd0bc95ab897b618796'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:36.782024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0099a6ec844dd0bc95ab897b618796'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:36.798088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e9bc6e42-58ab-4165-b65d-0d736e469984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0099a6ec844dd0bc95ab897b618796'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:36.837274 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1240/2434] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:36 2022] DELETE /identity/v3/users/8d0099a6ec844dd0bc95ab897b618796 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:36.838791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162983-f9db-4119-850e-7d116559ef6d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:36.839153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162983-f9db-4119-850e-7d116559ef6d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:36.839440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162983-f9db-4119-850e-7d116559ef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:36.860597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cd162983-f9db-4119-850e-7d116559ef6d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:36.861779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cd162983-f9db-4119-850e-7d116559ef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:36.914482 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1195/2435] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:36.940896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14512da-2421-4c43-bc66-f6ec02aedacc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:36.943180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c14512da-2421-4c43-bc66-f6ec02aedacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:36.980256 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1241/2436] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:37.002130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162983-f9db-4119-850e-7d116559ef6d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:37.004559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cd162983-f9db-4119-850e-7d116559ef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:37.148269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14512da-2421-4c43-bc66-f6ec02aedacc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:37.164566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162983-f9db-4119-850e-7d116559ef6d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:37.175798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed17ef8-06b7-42a3-9dba-7c1fcb5d27ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:37.176693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed17ef8-06b7-42a3-9dba-7c1fcb5d27ef service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:37.177457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed17ef8-06b7-42a3-9dba-7c1fcb5d27ef service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:37.178958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed17ef8-06b7-42a3-9dba-7c1fcb5d27ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:37.202258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed17ef8-06b7-42a3-9dba-7c1fcb5d27ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:37.203862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed17ef8-06b7-42a3-9dba-7c1fcb5d27ef service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:37.235440 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1242/2437] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:37.236747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6d925-0699-4026-a368-b6fc70dbe65f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:37.237035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6d925-0699-4026-a368-b6fc70dbe65f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:37.237313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6d925-0699-4026-a368-b6fc70dbe65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:37.312888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd46faf-19d1-4abf-b8f5-feb6ee8e7746 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:37.313823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd46faf-19d1-4abf-b8f5-feb6ee8e7746 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:37.314172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd46faf-19d1-4abf-b8f5-feb6ee8e7746 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:37.314525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd46faf-19d1-4abf-b8f5-feb6ee8e7746 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:37.361273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-72a6d925-0699-4026-a368-b6fc70dbe65f None None] MFA Rules not processed for user `7005bc45925d42a1854758b05a82978f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:37.362501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-72a6d925-0699-4026-a368-b6fc70dbe65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:37.404698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd46faf-19d1-4abf-b8f5-feb6ee8e7746 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:37.406752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd46faf-19d1-4abf-b8f5-feb6ee8e7746 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:37.427519 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1196/2438] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:37.536250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a95caa-5538-40f0-bd19-0e43e60744a3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:37.537589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a95caa-5538-40f0-bd19-0e43e60744a3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:37.538307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a95caa-5538-40f0-bd19-0e43e60744a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:37.539684 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1243/2439] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:37.566435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c2a95caa-5538-40f0-bd19-0e43e60744a3 None None] MFA Rules not processed for user `19597b33d62b4218ad7117bd8a520522`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:37.567710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c2a95caa-5538-40f0-bd19-0e43e60744a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:37.714447 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1197/2440] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:37.958997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6d925-0699-4026-a368-b6fc70dbe65f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:37.972932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6d925-0699-4026-a368-b6fc70dbe65f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:37.978767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:37.979581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:37.979971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:37.980245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:37.982138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:37.994207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:37.996050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:38.011649 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1244/2441] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:38.310673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a95caa-5538-40f0-bd19-0e43e60744a3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:38.312649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c2a95caa-5538-40f0-bd19-0e43e60744a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:38.332527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a95caa-5538-40f0-bd19-0e43e60744a3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:38.343104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:38.344800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:38.346495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:38.346941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:38.349358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:38.419074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:38.421138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:38.451033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa7be59-b852-415c-9237-5f9585784cd2 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:38.500952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:38.502389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:38.502672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:38.502948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] PATH_INFO: `/v3/projects/c1f5b332b509479e8b7e00d2d5e27fed` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:38.508431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f5b332b509479e8b7e00d2d5e27fed)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:38.511955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:38.596595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f5b332b509479e8b7e00d2d5e27fed', 'request_id': 'req-8d0f177e-e895-4282-a5d4-3d879651f9b9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.603951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:38.607863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:38.620264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f5b332b509479e8b7e00d2d5e27fed', 'request_id': 'req-8d0f177e-e895-4282-a5d4-3d879651f9b9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.631699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f5b332b509479e8b7e00d2d5e27fed', 'request_id': 'req-8d0f177e-e895-4282-a5d4-3d879651f9b9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.633280 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1198/2442] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:38.654595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:38.656179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:38.663309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] The token cache is being invalidate because project c1f5b332b509479e8b7e00d2d5e27fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:38.664280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.667372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.673889 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1245/2443] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:38 2022] DELETE /identity/v3/projects/c1f5b332b509479e8b7e00d2d5e27fed => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:38.674190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d197fc-af3f-4185-b562-2a72ba57fce7 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:38.675548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:38.680382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:38.775085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:38.775997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:38.776320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:38.776535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] PATH_INFO: `/v3/users/9d4b5ce51a69447d9e623d33360d726b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:38.777878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4b5ce51a69447d9e623d33360d726b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:38.779663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:38.848330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f177e-e895-4282-a5d4-3d879651f9b9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:38.854352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:38.855461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:38.855847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:38.856271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] PATH_INFO: `/v3/users/869c4bd1321a4461a2d262e875b71362` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:38.859791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=869c4bd1321a4461a2d262e875b71362)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:38.864523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:38.884347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4b5ce51a69447d9e623d33360d726b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.902989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4b5ce51a69447d9e623d33360d726b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.903961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4b5ce51a69447d9e623d33360d726b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.904500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4b5ce51a69447d9e623d33360d726b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.929569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ff289ca3-795d-499d-a8e9-32417e754ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4b5ce51a69447d9e623d33360d726b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:38.960224 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1199/2444] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:38 2022] DELETE /identity/v3/users/9d4b5ce51a69447d9e623d33360d726b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:38.965543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f74470-55cb-41dd-a21b-59d0bb024e65 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:38.966623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f74470-55cb-41dd-a21b-59d0bb024e65 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:38.966945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f74470-55cb-41dd-a21b-59d0bb024e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:39.008536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-25f74470-55cb-41dd-a21b-59d0bb024e65 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:39.008691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869c4bd1321a4461a2d262e875b71362'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:39.008785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-25f74470-55cb-41dd-a21b-59d0bb024e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:39.018878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869c4bd1321a4461a2d262e875b71362'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:39.020742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869c4bd1321a4461a2d262e875b71362'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:39.028387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869c4bd1321a4461a2d262e875b71362'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:39.053316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-027fcac8-2af5-4a4c-8e97-11a411d4b372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869c4bd1321a4461a2d262e875b71362'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:39.095539 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1246/2445] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:38 2022] DELETE /identity/v3/users/869c4bd1321a4461a2d262e875b71362 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:39.130585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499ffb6-3e82-449a-a51c-8b014958825e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:39.131049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499ffb6-3e82-449a-a51c-8b014958825e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:39.131495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499ffb6-3e82-449a-a51c-8b014958825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:39.170552 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1200/2446] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:39.190774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f74470-55cb-41dd-a21b-59d0bb024e65 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:39.191173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9499ffb6-3e82-449a-a51c-8b014958825e None None] MFA Rules not processed for user `84a254c1a9994724816a8627919f2197`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:39.192554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9499ffb6-3e82-449a-a51c-8b014958825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:39.192796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-25f74470-55cb-41dd-a21b-59d0bb024e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:39.361833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f74470-55cb-41dd-a21b-59d0bb024e65 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:39.369645 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1247/2447] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:39.463341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201e790-9db9-4efc-beb4-d99711f3812a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:39.464052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e790-9db9-4efc-beb4-d99711f3812a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:39.464376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e790-9db9-4efc-beb4-d99711f3812a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:39.464658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201e790-9db9-4efc-beb4-d99711f3812a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:39.548915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201e790-9db9-4efc-beb4-d99711f3812a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:39.552394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201e790-9db9-4efc-beb4-d99711f3812a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:39.592584 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1201/2448] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:39.692684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499ffb6-3e82-449a-a51c-8b014958825e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:39.695681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9499ffb6-3e82-449a-a51c-8b014958825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:39.802485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499ffb6-3e82-449a-a51c-8b014958825e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:39.816866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d28938-36eb-4359-9aa5-049278bb3362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:39.817534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d28938-36eb-4359-9aa5-049278bb3362 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:39.817820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d28938-36eb-4359-9aa5-049278bb3362 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:39.818107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d28938-36eb-4359-9aa5-049278bb3362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:39.826819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-23d28938-36eb-4359-9aa5-049278bb3362 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:39.907894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201e790-9db9-4efc-beb4-d99711f3812a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:39.909957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a201e790-9db9-4efc-beb4-d99711f3812a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:39.933870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201e790-9db9-4efc-beb4-d99711f3812a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:39.937747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d28938-36eb-4359-9aa5-049278bb3362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:39.941574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d28938-36eb-4359-9aa5-049278bb3362 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:39.946645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:39.947601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:39.947968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:39.948738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] PATH_INFO: `/v3/projects/93f06d41524b4112be8d67b68e9ebd57` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:39.950093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f06d41524b4112be8d67b68e9ebd57)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:39.952436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:39.981210 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1248/2449] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:39 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:40.058484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f06d41524b4112be8d67b68e9ebd57', 'request_id': 'req-6345abc0-8a30-43f9-8f8f-535dfd3085ed'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.070350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f06d41524b4112be8d67b68e9ebd57', 'request_id': 'req-6345abc0-8a30-43f9-8f8f-535dfd3085ed'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.077496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f06d41524b4112be8d67b68e9ebd57', 'request_id': 'req-6345abc0-8a30-43f9-8f8f-535dfd3085ed'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.094244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] The token cache is being invalidate because project 93f06d41524b4112be8d67b68e9ebd57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:40.094576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.097150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.101690 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1202/2450] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:39 2022] DELETE /identity/v3/projects/93f06d41524b4112be8d67b68e9ebd57 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:40.106810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d9d59-aefb-4947-9da1-db862fd59da8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.107787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d9d59-aefb-4947-9da1-db862fd59da8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.108375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d9d59-aefb-4947-9da1-db862fd59da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.134884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fa6d9d59-aefb-4947-9da1-db862fd59da8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:40.136183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fa6d9d59-aefb-4947-9da1-db862fd59da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:40.220235 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1249/2451] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:40.222189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:40.223650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:40.229202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425a9a-7576-4b2b-842c-e32954a176a8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.229656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425a9a-7576-4b2b-842c-e32954a176a8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.229971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425a9a-7576-4b2b-842c-e32954a176a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.255565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c7425a9a-7576-4b2b-842c-e32954a176a8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:40.257430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c7425a9a-7576-4b2b-842c-e32954a176a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:40.271745 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1250/2452] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:40.273401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7425a9a-7576-4b2b-842c-e32954a176a8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:40.284954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7425a9a-7576-4b2b-842c-e32954a176a8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:40.295270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e8fde-1426-4142-8715-ada003854643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:40.296304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8fde-1426-4142-8715-ada003854643 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.296819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8fde-1426-4142-8715-ada003854643 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.297273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e8fde-1426-4142-8715-ada003854643 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.298942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e8fde-1426-4142-8715-ada003854643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:40.299600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e8fde-1426-4142-8715-ada003854643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:40.302919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e8fde-1426-4142-8715-ada003854643 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:40.325996 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1251/2453] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:40.328426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e8fde-1426-4142-8715-ada003854643 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:40.349999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e8fde-1426-4142-8715-ada003854643 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:40.356118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559eaf3-6819-4024-9855-f32152a5bf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:40.356702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559eaf3-6819-4024-9855-f32152a5bf5c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.357689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559eaf3-6819-4024-9855-f32152a5bf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.358015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559eaf3-6819-4024-9855-f32152a5bf5c admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.358984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559eaf3-6819-4024-9855-f32152a5bf5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:40.364701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559eaf3-6819-4024-9855-f32152a5bf5c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:40.370112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345abc0-8a30-43f9-8f8f-535dfd3085ed admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:40.389818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f530aa-2cc2-47a7-ba9d-f95183a365c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:40.390490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f530aa-2cc2-47a7-ba9d-f95183a365c2 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.390774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f530aa-2cc2-47a7-ba9d-f95183a365c2 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.391050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f530aa-2cc2-47a7-ba9d-f95183a365c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.396679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-17f530aa-2cc2-47a7-ba9d-f95183a365c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:40.434200 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1252/2454] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:40 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:40.439667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559eaf3-6819-4024-9855-f32152a5bf5c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:40.442646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b559eaf3-6819-4024-9855-f32152a5bf5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:40.535630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f530aa-2cc2-47a7-ba9d-f95183a365c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:40.537194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f530aa-2cc2-47a7-ba9d-f95183a365c2 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:40.543031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559eaf3-6819-4024-9855-f32152a5bf5c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:40.553129 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1203/2455] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:40.555070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f530aa-2cc2-47a7-ba9d-f95183a365c2 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:40.569688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:40.571647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f530aa-2cc2-47a7-ba9d-f95183a365c2 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:40.575797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.577194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.578381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] PATH_INFO: `/v3/projects/e30490816db249b9af0ffbe3b0feb51d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.580329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916cadd-3747-4486-ab19-757c3c2c33b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:40.581887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916cadd-3747-4486-ab19-757c3c2c33b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.583894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e30490816db249b9af0ffbe3b0feb51d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:40.588995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:40.593807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916cadd-3747-4486-ab19-757c3c2c33b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.594996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e916cadd-3747-4486-ab19-757c3c2c33b0 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.598313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916cadd-3747-4486-ab19-757c3c2c33b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:40.601965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e916cadd-3747-4486-ab19-757c3c2c33b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:40.652985 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1204/2456] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:40 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:40.656586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916cadd-3747-4486-ab19-757c3c2c33b0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:40.687546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e916cadd-3747-4486-ab19-757c3c2c33b0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:40.714058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e30490816db249b9af0ffbe3b0feb51d', 'request_id': 'req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.725683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e30490816db249b9af0ffbe3b0feb51d', 'request_id': 'req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.734490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e30490816db249b9af0ffbe3b0feb51d', 'request_id': 'req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.750333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] The token cache is being invalidate because project e30490816db249b9af0ffbe3b0feb51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:40.750859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.752533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:40.755629 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1253/2457] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:40 2022] DELETE /identity/v3/projects/e30490816db249b9af0ffbe3b0feb51d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:40.767404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:40.772763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:40.813363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f289c7-670a-47b6-90ba-23d3ea1fb904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:40.814668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f289c7-670a-47b6-90ba-23d3ea1fb904 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.815022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f289c7-670a-47b6-90ba-23d3ea1fb904 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.815370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f289c7-670a-47b6-90ba-23d3ea1fb904 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.816279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f289c7-670a-47b6-90ba-23d3ea1fb904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:40.818047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f289c7-670a-47b6-90ba-23d3ea1fb904 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:40.848333 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1205/2458] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:40.849363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f289c7-670a-47b6-90ba-23d3ea1fb904 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:40.852693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42f289c7-670a-47b6-90ba-23d3ea1fb904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:40.872061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f289c7-670a-47b6-90ba-23d3ea1fb904 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:40.885204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803ccc-85e1-489f-a4fa-5ee70d1e3f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:40.886070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803ccc-85e1-489f-a4fa-5ee70d1e3f57 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.886534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803ccc-85e1-489f-a4fa-5ee70d1e3f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.887092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803ccc-85e1-489f-a4fa-5ee70d1e3f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.887985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e803ccc-85e1-489f-a4fa-5ee70d1e3f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:40.889971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e803ccc-85e1-489f-a4fa-5ee70d1e3f57 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:40.900578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da564e-7fd0-4c51-96bb-bc7bfe63ed6e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:40.909183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:40.910260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.910543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.910822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] PATH_INFO: `/v3/users/abd276c46af844979e73447cfaa83361` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.912097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd276c46af844979e73447cfaa83361)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:40.914167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:40.915141 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1206/2459] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:40.919163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803ccc-85e1-489f-a4fa-5ee70d1e3f57 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:40.942661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803ccc-85e1-489f-a4fa-5ee70d1e3f57 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:40.957036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9187c6-ee81-4303-9fb8-ee6d372c8ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:40.958117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9187c6-ee81-4303-9fb8-ee6d372c8ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:40.958572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9187c6-ee81-4303-9fb8-ee6d372c8ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:40.959016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9187c6-ee81-4303-9fb8-ee6d372c8ef6 admin admin] PATH_INFO: `/v3/projects/8893a94e58754a0f8eb2a1daf51a7c13/users/4279baa3e2434b7ab69cfd7fc7045380/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:40.996497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9187c6-ee81-4303-9fb8-ee6d372c8ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8893a94e58754a0f8eb2a1daf51a7c13, user_id=4279baa3e2434b7ab69cfd7fc7045380, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:41.000303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9187c6-ee81-4303-9fb8-ee6d372c8ef6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:41.029759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd276c46af844979e73447cfaa83361'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:41.048870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd276c46af844979e73447cfaa83361'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:41.048870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd276c46af844979e73447cfaa83361'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:41.048870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd276c46af844979e73447cfaa83361'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:41.050296 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1207/2460] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:40 2022] PUT /identity/v3/projects/8893a94e58754a0f8eb2a1daf51a7c13/users/4279baa3e2434b7ab69cfd7fc7045380/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:41.053494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dbc6f-886a-471a-a3ca-57ec2717d0be None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:41.054321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dbc6f-886a-471a-a3ca-57ec2717d0be None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:41.055026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dbc6f-886a-471a-a3ca-57ec2717d0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:41.067689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-efac4847-508a-432a-94be-e1b033d2e7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd276c46af844979e73447cfaa83361'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:41.100054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ef2dbc6f-886a-471a-a3ca-57ec2717d0be None None] MFA Rules not processed for user `4279baa3e2434b7ab69cfd7fc7045380`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:41.105250 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1254/2461] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:40 2022] DELETE /identity/v3/users/abd276c46af844979e73447cfaa83361 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:41.105409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ef2dbc6f-886a-471a-a3ca-57ec2717d0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:41.172701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784317-4da1-40d5-93b9-e45c2fbd3201 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:41.174113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784317-4da1-40d5-93b9-e45c2fbd3201 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:41.174113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08784317-4da1-40d5-93b9-e45c2fbd3201 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:41.176278 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1255/2462] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:50:41.186300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13aadd-5118-40cb-9223-e9e1f74c5e2b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:41.186759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13aadd-5118-40cb-9223-e9e1f74c5e2b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:41.187631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13aadd-5118-40cb-9223-e9e1f74c5e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:41.262863 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1208/2463] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:41.263817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dbc6f-886a-471a-a3ca-57ec2717d0be None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:41.265978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0d13aadd-5118-40cb-9223-e9e1f74c5e2b None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:41.268356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0d13aadd-5118-40cb-9223-e9e1f74c5e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:41.270554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ef2dbc6f-886a-471a-a3ca-57ec2717d0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:41.426229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dbc6f-886a-471a-a3ca-57ec2717d0be None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:41.433208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebbc46-f1e9-4215-9d47-cfb5848c1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:41.434040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebbc46-f1e9-4215-9d47-cfb5848c1d5b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:41.434481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebbc46-f1e9-4215-9d47-cfb5848c1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:41.434898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebbc46-f1e9-4215-9d47-cfb5848c1d5b admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:41.435783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebbc46-f1e9-4215-9d47-cfb5848c1d5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:41.437862 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1256/2464] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:50:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:41.444435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebbc46-f1e9-4215-9d47-cfb5848c1d5b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:41.482471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13aadd-5118-40cb-9223-e9e1f74c5e2b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:41.484066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0d13aadd-5118-40cb-9223-e9e1f74c5e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:41.505650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13aadd-5118-40cb-9223-e9e1f74c5e2b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:41.514684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9931b4-c7a9-4a37-8528-153ba70b2bfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:41.516136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9931b4-c7a9-4a37-8528-153ba70b2bfb service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:41.516420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9931b4-c7a9-4a37-8528-153ba70b2bfb service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:41.516726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9931b4-c7a9-4a37-8528-153ba70b2bfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:41.522670 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1209/2465] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:41 2022] POST /identity/v3/projects => generated 373 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:41.525456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebbc46-f1e9-4215-9d47-cfb5848c1d5b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:41.537278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9931b4-c7a9-4a37-8528-153ba70b2bfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:41.538880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9931b4-c7a9-4a37-8528-153ba70b2bfb service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:41.557446 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1257/2466] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:50:41.711593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebbc46-f1e9-4215-9d47-cfb5848c1d5b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:41.719249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb010-9540-4819-8c68-0e6579b7070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:41.721734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb010-9540-4819-8c68-0e6579b7070a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:41.722661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb010-9540-4819-8c68-0e6579b7070a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:41.723158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb010-9540-4819-8c68-0e6579b7070a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:41.724732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeb010-9540-4819-8c68-0e6579b7070a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:41.728001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeb010-9540-4819-8c68-0e6579b7070a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:41.773300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9931b4-c7a9-4a37-8528-153ba70b2bfb service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:41.787712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1210/2467] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:41 2022] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:41.790830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9931b4-c7a9-4a37-8528-153ba70b2bfb service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:41.823330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab3341-6995-4475-9364-d791278d7192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:41.825782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3341-6995-4475-9364-d791278d7192 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:41.826519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3341-6995-4475-9364-d791278d7192 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:41.826809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab3341-6995-4475-9364-d791278d7192 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:41.828287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab3341-6995-4475-9364-d791278d7192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:41.833871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab3341-6995-4475-9364-d791278d7192 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:41.861147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb010-9540-4819-8c68-0e6579b7070a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:41.872563 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1258/2468] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:41.874451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb010-9540-4819-8c68-0e6579b7070a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:41.883846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3350-dac2-4174-89c9-3d087dc3c835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:41.884875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3350-dac2-4174-89c9-3d087dc3c835 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:41.885156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3350-dac2-4174-89c9-3d087dc3c835 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:41.885474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f3350-dac2-4174-89c9-3d087dc3c835 admin admin] PATH_INFO: `/v3/projects/8401f2b237974638bf37788f38ead073/users/1fd3d3e7e5a74fb9b2bb973ab2767be6/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:41.910711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3350-dac2-4174-89c9-3d087dc3c835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8401f2b237974638bf37788f38ead073, user_id=1fd3d3e7e5a74fb9b2bb973ab2767be6, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:41.914120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f3350-dac2-4174-89c9-3d087dc3c835 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:41.932931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab3341-6995-4475-9364-d791278d7192 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:41.935079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3eab3341-6995-4475-9364-d791278d7192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:41.964025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab3341-6995-4475-9364-d791278d7192 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:41.967681 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1211/2469] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:41 2022] PUT /identity/v3/projects/8401f2b237974638bf37788f38ead073/users/1fd3d3e7e5a74fb9b2bb973ab2767be6/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:41.968684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3350-dac2-4174-89c9-3d087dc3c835 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:42.122364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f3350-dac2-4174-89c9-3d087dc3c835 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:42.143385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec08185-8280-4516-9711-006e84190c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:42.144128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec08185-8280-4516-9711-006e84190c1c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.147683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec08185-8280-4516-9711-006e84190c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.148719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec08185-8280-4516-9711-006e84190c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.149441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec08185-8280-4516-9711-006e84190c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:42.150407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:42.151273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.151548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.151815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] PATH_INFO: `/v3/projects/e5b6eedd55b14effad99ec550bec7352` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.154065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec08185-8280-4516-9711-006e84190c1c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:42.156281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b6eedd55b14effad99ec550bec7352)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:42.160905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:42.182783 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1212/2470] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:42.183735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec08185-8280-4516-9711-006e84190c1c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:42.198755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec08185-8280-4516-9711-006e84190c1c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:42.206559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a903937-25e6-4e9c-8083-c108c9189cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:42.207875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a903937-25e6-4e9c-8083-c108c9189cac admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.208200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a903937-25e6-4e9c-8083-c108c9189cac admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.208625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a903937-25e6-4e9c-8083-c108c9189cac admin admin] PATH_INFO: `/v3/projects/8401f2b237974638bf37788f38ead073/users/1fd3d3e7e5a74fb9b2bb973ab2767be6/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.210809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a903937-25e6-4e9c-8083-c108c9189cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8401f2b237974638bf37788f38ead073, user_id=1fd3d3e7e5a74fb9b2bb973ab2767be6, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:42.213832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a903937-25e6-4e9c-8083-c108c9189cac admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:42.229447 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1213/2471] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:42 2022] PUT /identity/v3/projects/8401f2b237974638bf37788f38ead073/users/1fd3d3e7e5a74fb9b2bb973ab2767be6/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:42.243689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eb103-1e52-4a08-a372-06b6c309c8da None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.243689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eb103-1e52-4a08-a372-06b6c309c8da None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.243689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50eb103-1e52-4a08-a372-06b6c309c8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.289805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b50eb103-1e52-4a08-a372-06b6c309c8da None None] MFA Rules not processed for user `1fd3d3e7e5a74fb9b2bb973ab2767be6`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:42.291543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b50eb103-1e52-4a08-a372-06b6c309c8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:42.302730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b6eedd55b14effad99ec550bec7352', 'request_id': 'req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:42.327253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b6eedd55b14effad99ec550bec7352', 'request_id': 'req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:42.342364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b6eedd55b14effad99ec550bec7352', 'request_id': 'req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:42.368553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] The token cache is being invalidate because project e5b6eedd55b14effad99ec550bec7352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:42.368765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:42.373005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6571ef1-0113-4bd0-bda8-3f8e3bbeb49b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:42.378121 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1259/2472] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:41 2022] DELETE /identity/v3/projects/e5b6eedd55b14effad99ec550bec7352 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:42.385681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f165c4-98a6-4ac4-a33c-ef531b2e15d4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.385980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f165c4-98a6-4ac4-a33c-ef531b2e15d4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.386261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f165c4-98a6-4ac4-a33c-ef531b2e15d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.402274 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1214/2473] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:42.445543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e4f165c4-98a6-4ac4-a33c-ef531b2e15d4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:42.451061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e4f165c4-98a6-4ac4-a33c-ef531b2e15d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:42.512275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966c566-04ec-43e3-9fe4-ed0ab337ff3c None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.513081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966c566-04ec-43e3-9fe4-ed0ab337ff3c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.513579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966c566-04ec-43e3-9fe4-ed0ab337ff3c None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.517623 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1215/2474] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:50:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:50:42.523545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf6f1f-f471-421c-a592-cfe99850c608 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.523844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf6f1f-f471-421c-a592-cfe99850c608 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.524218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf6f1f-f471-421c-a592-cfe99850c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.558632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5fcf6f1f-f471-421c-a592-cfe99850c608 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:42.560238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5fcf6f1f-f471-421c-a592-cfe99850c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:42.598012 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1260/2475] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:42.607142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5cd52-2bdf-4df8-a352-b322371d2450 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.607456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5cd52-2bdf-4df8-a352-b322371d2450 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.608489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5cd52-2bdf-4df8-a352-b322371d2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.651578 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1216/2476] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:42.673942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf6f1f-f471-421c-a592-cfe99850c608 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:42.676744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5fcf6f1f-f471-421c-a592-cfe99850c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:42.685236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-52e5cd52-2bdf-4df8-a352-b322371d2450 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:42.693089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-52e5cd52-2bdf-4df8-a352-b322371d2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:42.693712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf6f1f-f471-421c-a592-cfe99850c608 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:42.701609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a813e-6c9c-4e7d-aea3-03e8c27b81fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:42.702708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a813e-6c9c-4e7d-aea3-03e8c27b81fb service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.703078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a813e-6c9c-4e7d-aea3-03e8c27b81fb service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.703582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a813e-6c9c-4e7d-aea3-03e8c27b81fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.714180 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1261/2477] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:42.718714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a813e-6c9c-4e7d-aea3-03e8c27b81fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:42.719087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5cd52-2bdf-4df8-a352-b322371d2450 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:42.721478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a813e-6c9c-4e7d-aea3-03e8c27b81fb service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:42.743013 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1217/2478] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:50:42.749273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e5cd52-2bdf-4df8-a352-b322371d2450 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:42.754921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7383-e029-42be-9701-994db3b0c092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:42.755594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7383-e029-42be-9701-994db3b0c092 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.755875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7383-e029-42be-9701-994db3b0c092 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.756217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f7383-e029-42be-9701-994db3b0c092 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.756975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f7383-e029-42be-9701-994db3b0c092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:42.757261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f7383-e029-42be-9701-994db3b0c092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:42.758923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f7383-e029-42be-9701-994db3b0c092 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:42.818450 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1262/2479] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:50:42.823469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a813e-6c9c-4e7d-aea3-03e8c27b81fb service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:42.842434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a813e-6c9c-4e7d-aea3-03e8c27b81fb service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:42.848121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ecda7-178b-41e9-90b8-9d72ad4cc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:42.849618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ecda7-178b-41e9-90b8-9d72ad4cc938 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:42.849618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ecda7-178b-41e9-90b8-9d72ad4cc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:42.849618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ecda7-178b-41e9-90b8-9d72ad4cc938 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:42.850332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ecda7-178b-41e9-90b8-9d72ad4cc938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:42.852586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ecda7-178b-41e9-90b8-9d72ad4cc938 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:42.903902 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1218/2480] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:42 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:42.909722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7383-e029-42be-9701-994db3b0c092 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:42.935884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f7383-e029-42be-9701-994db3b0c092 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:43.045909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720e9cf-b7c7-4434-a765-154bce2eca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:43.046582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720e9cf-b7c7-4434-a765-154bce2eca7f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:43.046866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720e9cf-b7c7-4434-a765-154bce2eca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:43.047142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720e9cf-b7c7-4434-a765-154bce2eca7f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:43.047829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720e9cf-b7c7-4434-a765-154bce2eca7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:43.050723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720e9cf-b7c7-4434-a765-154bce2eca7f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:43.092618 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1263/2481] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:42 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:43.097400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ecda7-178b-41e9-90b8-9d72ad4cc938 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:43.121521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ecda7-178b-41e9-90b8-9d72ad4cc938 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:43.128342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d375eb-c166-43e5-ba82-6547da9d1b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:43.129109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d375eb-c166-43e5-ba82-6547da9d1b52 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:43.129330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d375eb-c166-43e5-ba82-6547da9d1b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:43.129607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d375eb-c166-43e5-ba82-6547da9d1b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:43.130331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d375eb-c166-43e5-ba82-6547da9d1b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:43.132056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d375eb-c166-43e5-ba82-6547da9d1b52 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:43.149276 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1219/2482] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:43.153315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720e9cf-b7c7-4434-a765-154bce2eca7f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:43.171387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720e9cf-b7c7-4434-a765-154bce2eca7f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:43.177503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3ce4b-4c9d-4c5c-a886-8863f39cab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:43.178245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ce4b-4c9d-4c5c-a886-8863f39cab9d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:43.178592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ce4b-4c9d-4c5c-a886-8863f39cab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:43.178927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3ce4b-4c9d-4c5c-a886-8863f39cab9d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:43.179717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3ce4b-4c9d-4c5c-a886-8863f39cab9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:43.181751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3ce4b-4c9d-4c5c-a886-8863f39cab9d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:43.197022 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1264/2483] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:43.202532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d375eb-c166-43e5-ba82-6547da9d1b52 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:43.217712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d375eb-c166-43e5-ba82-6547da9d1b52 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:43.228789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360ff03-c4ef-4b4f-8093-c444fe068a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:43.229878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360ff03-c4ef-4b4f-8093-c444fe068a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:43.230419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360ff03-c4ef-4b4f-8093-c444fe068a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:43.230419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360ff03-c4ef-4b4f-8093-c444fe068a49 admin admin] PATH_INFO: `/v3/projects/4a56761e1c4f400788db6793667fe7b9/users/ee4e4af078764044baad8a944fccecf1/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:43.258961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360ff03-c4ef-4b4f-8093-c444fe068a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a56761e1c4f400788db6793667fe7b9, user_id=ee4e4af078764044baad8a944fccecf1, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:43.263807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360ff03-c4ef-4b4f-8093-c444fe068a49 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:43.284632 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1220/2484] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:43 2022] PUT /identity/v3/projects/4a56761e1c4f400788db6793667fe7b9/users/ee4e4af078764044baad8a944fccecf1/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:43.290368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468efab-1bd2-455b-8817-f7f2d6c41003 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:43.290684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468efab-1bd2-455b-8817-f7f2d6c41003 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:43.290960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468efab-1bd2-455b-8817-f7f2d6c41003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:43.320706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5468efab-1bd2-455b-8817-f7f2d6c41003 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:43.321809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5468efab-1bd2-455b-8817-f7f2d6c41003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:43.416060 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1265/2485] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:43.428773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360ff03-c4ef-4b4f-8093-c444fe068a49 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:43.430720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8360ff03-c4ef-4b4f-8093-c444fe068a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:43.519433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360ff03-c4ef-4b4f-8093-c444fe068a49 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:43.524428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695738e-bf55-4119-9aa4-77b3ba9f238b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:43.525692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695738e-bf55-4119-9aa4-77b3ba9f238b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:43.525997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695738e-bf55-4119-9aa4-77b3ba9f238b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:43.526273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695738e-bf55-4119-9aa4-77b3ba9f238b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:43.537494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695738e-bf55-4119-9aa4-77b3ba9f238b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:43.539014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695738e-bf55-4119-9aa4-77b3ba9f238b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:43.568016 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1221/2486] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:44.527605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468efab-1bd2-455b-8817-f7f2d6c41003 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:44.529801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5468efab-1bd2-455b-8817-f7f2d6c41003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:44.669995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468efab-1bd2-455b-8817-f7f2d6c41003 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:44.680472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83959f-e3b5-4e06-a80d-1554525c54a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:44.684965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83959f-e3b5-4e06-a80d-1554525c54a9 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:44.685959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83959f-e3b5-4e06-a80d-1554525c54a9 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:44.686387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83959f-e3b5-4e06-a80d-1554525c54a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:44.688846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce83959f-e3b5-4e06-a80d-1554525c54a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:44.842255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83959f-e3b5-4e06-a80d-1554525c54a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:44.844433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83959f-e3b5-4e06-a80d-1554525c54a9 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:44.858182 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1266/2487] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:47.260016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695738e-bf55-4119-9aa4-77b3ba9f238b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:47.261558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6695738e-bf55-4119-9aa4-77b3ba9f238b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:47.295484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695738e-bf55-4119-9aa4-77b3ba9f238b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:47.325831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:47.326746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:47.329738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:47.330082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] PATH_INFO: `/v3/users/4279baa3e2434b7ab69cfd7fc7045380` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:47.343692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4279baa3e2434b7ab69cfd7fc7045380)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:47.354450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:47.448147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4279baa3e2434b7ab69cfd7fc7045380'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:47.466177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4279baa3e2434b7ab69cfd7fc7045380'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:47.466811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4279baa3e2434b7ab69cfd7fc7045380'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:47.467531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4279baa3e2434b7ab69cfd7fc7045380'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:47.505294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4279baa3e2434b7ab69cfd7fc7045380'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:47.542990 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1222/2488] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:47 2022] DELETE /identity/v3/users/4279baa3e2434b7ab69cfd7fc7045380 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:47.547996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2560a0a-a1a7-436d-826b-55d7f9292372 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:47.548509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2560a0a-a1a7-436d-826b-55d7f9292372 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:47.548740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2560a0a-a1a7-436d-826b-55d7f9292372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:47.574305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e2560a0a-a1a7-436d-826b-55d7f9292372 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:47.577848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e2560a0a-a1a7-436d-826b-55d7f9292372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:47.661793 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1267/2489] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:47.689933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:47.691496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:47.841112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc9eeef-3d5a-43d0-9904-a37634a19dc2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:47.846042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fae0-04a7-4273-94d7-474752516b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:47.847567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fae0-04a7-4273-94d7-474752516b7e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:47.849677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fae0-04a7-4273-94d7-474752516b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:47.850596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389fae0-04a7-4273-94d7-474752516b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:47.872841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389fae0-04a7-4273-94d7-474752516b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:47.874622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389fae0-04a7-4273-94d7-474752516b7e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:47.909910 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1223/2490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:48.888624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2560a0a-a1a7-436d-826b-55d7f9292372 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:48.890563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e2560a0a-a1a7-436d-826b-55d7f9292372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:48.922392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2560a0a-a1a7-436d-826b-55d7f9292372 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:48.948689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:48.953406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:48.955615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:48.955956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] PATH_INFO: `/v3/projects/8893a94e58754a0f8eb2a1daf51a7c13` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:48.963567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8893a94e58754a0f8eb2a1daf51a7c13)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:48.970477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:49.120645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8893a94e58754a0f8eb2a1daf51a7c13', 'request_id': 'req-20887a47-d434-48e6-bb09-f44f07da8f58'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.132772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8893a94e58754a0f8eb2a1daf51a7c13', 'request_id': 'req-20887a47-d434-48e6-bb09-f44f07da8f58'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.143337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8893a94e58754a0f8eb2a1daf51a7c13', 'request_id': 'req-20887a47-d434-48e6-bb09-f44f07da8f58'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.161964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] The token cache is being invalidate because project 8893a94e58754a0f8eb2a1daf51a7c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:49.162495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.163345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-20887a47-d434-48e6-bb09-f44f07da8f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.168220 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1268/2491] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:48 2022] DELETE /identity/v3/projects/8893a94e58754a0f8eb2a1daf51a7c13 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:49.169259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fae0-04a7-4273-94d7-474752516b7e service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:49.180530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389fae0-04a7-4273-94d7-474752516b7e service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:49.312953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:49.316329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:49.316958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:49.317445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] PATH_INFO: `/v3/users/1fd3d3e7e5a74fb9b2bb973ab2767be6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:49.319477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd3d3e7e5a74fb9b2bb973ab2767be6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:49.324995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:49.474765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f2de-a7b0-4e96-8033-ace5d48f9f2c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:49.476407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f2de-a7b0-4e96-8033-ace5d48f9f2c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:49.476854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f2de-a7b0-4e96-8033-ace5d48f9f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:49.515907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd3d3e7e5a74fb9b2bb973ab2767be6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.518262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-daa7f2de-a7b0-4e96-8033-ace5d48f9f2c None None] MFA Rules not processed for user `f730effcbf03473fbdb527fa499ec181`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:49.529271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-daa7f2de-a7b0-4e96-8033-ace5d48f9f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:49.533344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd3d3e7e5a74fb9b2bb973ab2767be6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.536876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd3d3e7e5a74fb9b2bb973ab2767be6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.538953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd3d3e7e5a74fb9b2bb973ab2767be6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.576981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd3d3e7e5a74fb9b2bb973ab2767be6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:49.604012 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1224/2492] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:49 2022] DELETE /identity/v3/users/1fd3d3e7e5a74fb9b2bb973ab2767be6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:50:49.707856 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1269/2493] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:50.367754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:50.369249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:50.464258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39091380-f424-4fc5-9737-931db52a7f74 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:50.471642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:50.472600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:50.472889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:50.473172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] PATH_INFO: `/v3/projects/8401f2b237974638bf37788f38ead073` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:50.474378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8401f2b237974638bf37788f38ead073)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:50.476409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:50.564770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748856-4402-4744-bfa5-0bde45380c32 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:50.565327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748856-4402-4744-bfa5-0bde45380c32 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:50.565327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d748856-4402-4744-bfa5-0bde45380c32 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:50.567061 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1270/2494] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:50:50.572572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0095a-b4e1-40e1-9e53-80d28754e15f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:50.573063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0095a-b4e1-40e1-9e53-80d28754e15f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:50.573503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0095a-b4e1-40e1-9e53-80d28754e15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:50.613450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-20f0095a-b4e1-40e1-9e53-80d28754e15f None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:50.615252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-20f0095a-b4e1-40e1-9e53-80d28754e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:50.635465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8401f2b237974638bf37788f38ead073', 'request_id': 'req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:50.645240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8401f2b237974638bf37788f38ead073', 'request_id': 'req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:50.660084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8401f2b237974638bf37788f38ead073', 'request_id': 'req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:50.676500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] The token cache is being invalidate because project 8401f2b237974638bf37788f38ead073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:50.677385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:50.679035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d4b13c9-8245-4b98-9a2c-c495c4c1f251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:50.686043 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1225/2495] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:50 2022] DELETE /identity/v3/projects/8401f2b237974638bf37788f38ead073 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:50.692064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec8d35-d413-46b5-ae96-0eda8cde01df None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:50.692826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec8d35-d413-46b5-ae96-0eda8cde01df None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:50.693296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec8d35-d413-46b5-ae96-0eda8cde01df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:50.722637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4eec8d35-d413-46b5-ae96-0eda8cde01df None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:50.724291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4eec8d35-d413-46b5-ae96-0eda8cde01df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:50.740005 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1271/2496] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:50:50.764903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0095a-b4e1-40e1-9e53-80d28754e15f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:50.767538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-20f0095a-b4e1-40e1-9e53-80d28754e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:50.790650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0095a-b4e1-40e1-9e53-80d28754e15f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:50.811838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54079333-0c49-4a74-846c-784fa742e1cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:50.818728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54079333-0c49-4a74-846c-784fa742e1cc service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:50.819333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54079333-0c49-4a74-846c-784fa742e1cc service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:50.820674 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1226/2497] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:50.821343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54079333-0c49-4a74-846c-784fa742e1cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:50.831342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507a05-706e-4b37-9d14-cf0dd2c8b33a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:50.831888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507a05-706e-4b37-9d14-cf0dd2c8b33a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:50.833621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9507a05-706e-4b37-9d14-cf0dd2c8b33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:50.855055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54079333-0c49-4a74-846c-784fa742e1cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:50.861339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54079333-0c49-4a74-846c-784fa742e1cc service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:50.871790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c9507a05-706e-4b37-9d14-cf0dd2c8b33a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:50.873332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c9507a05-706e-4b37-9d14-cf0dd2c8b33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:50.886932 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1272/2498] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:50.896981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54079333-0c49-4a74-846c-784fa742e1cc service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:50.901549 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1227/2499] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:50.913118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54079333-0c49-4a74-846c-784fa742e1cc service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:50.919059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e975-5078-4af6-9603-aea754fc7416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:50.920309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e975-5078-4af6-9603-aea754fc7416 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:50.920934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e975-5078-4af6-9603-aea754fc7416 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:50.921420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149e975-5078-4af6-9603-aea754fc7416 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:50.923215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e975-5078-4af6-9603-aea754fc7416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:50.923717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e975-5078-4af6-9603-aea754fc7416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:50.925574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149e975-5078-4af6-9603-aea754fc7416 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:50.947521 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1273/2500] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:50:50.952522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9507a05-706e-4b37-9d14-cf0dd2c8b33a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:50.963023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9507a05-706e-4b37-9d14-cf0dd2c8b33a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:50.968792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad2428-acf6-45cc-98dd-14345381ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:50.969622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad2428-acf6-45cc-98dd-14345381ee74 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:50.969915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad2428-acf6-45cc-98dd-14345381ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:50.970193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad2428-acf6-45cc-98dd-14345381ee74 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:50.971580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad2428-acf6-45cc-98dd-14345381ee74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:50.979849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ad2428-acf6-45cc-98dd-14345381ee74 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:51.051360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e975-5078-4af6-9603-aea754fc7416 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:51.051795 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1228/2501] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:50 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:51.066581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149e975-5078-4af6-9603-aea754fc7416 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:51.236293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf998d-d629-4d1f-94d1-b67333a4c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:51.237270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf998d-d629-4d1f-94d1-b67333a4c669 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:51.237640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf998d-d629-4d1f-94d1-b67333a4c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:51.238178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf998d-d629-4d1f-94d1-b67333a4c669 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:51.239056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf998d-d629-4d1f-94d1-b67333a4c669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:51.254951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf998d-d629-4d1f-94d1-b67333a4c669 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:51.320481 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1274/2502] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:51 2022] POST /identity/v3/users => generated 303 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:51.323735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad2428-acf6-45cc-98dd-14345381ee74 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:51.340333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad2428-acf6-45cc-98dd-14345381ee74 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:51.345642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285c7ba-893a-42e4-b57e-396f2bcc207d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:51.346557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285c7ba-893a-42e4-b57e-396f2bcc207d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:51.346804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285c7ba-893a-42e4-b57e-396f2bcc207d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:51.347090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285c7ba-893a-42e4-b57e-396f2bcc207d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:51.348355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285c7ba-893a-42e4-b57e-396f2bcc207d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:51.350527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285c7ba-893a-42e4-b57e-396f2bcc207d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:51.372185 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1229/2503] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:51.373120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf998d-d629-4d1f-94d1-b67333a4c669 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:51.392866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf998d-d629-4d1f-94d1-b67333a4c669 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:51.399465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c64cb3b-f6d7-49be-840c-bbd35a1bfcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:51.400544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64cb3b-f6d7-49be-840c-bbd35a1bfcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:51.401218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64cb3b-f6d7-49be-840c-bbd35a1bfcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:51.401549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c64cb3b-f6d7-49be-840c-bbd35a1bfcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:51.402283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64cb3b-f6d7-49be-840c-bbd35a1bfcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:51.403936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c64cb3b-f6d7-49be-840c-bbd35a1bfcd5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:51.415414 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1275/2504] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:50:51.421013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285c7ba-893a-42e4-b57e-396f2bcc207d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:51.432488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285c7ba-893a-42e4-b57e-396f2bcc207d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:51.438686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330135ac-778f-4554-99f6-9c85f3208f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:51.440406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330135ac-778f-4554-99f6-9c85f3208f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:51.440922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330135ac-778f-4554-99f6-9c85f3208f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:51.441427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330135ac-778f-4554-99f6-9c85f3208f5d admin admin] PATH_INFO: `/v3/projects/42758b0b02434b76b69d5dea22bd5945/users/f435557ffd274e2b9cc4d00ee67c5622/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:51.465999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330135ac-778f-4554-99f6-9c85f3208f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=42758b0b02434b76b69d5dea22bd5945, user_id=f435557ffd274e2b9cc4d00ee67c5622, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:51.469382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330135ac-778f-4554-99f6-9c85f3208f5d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:51.511764 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1230/2505] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:51 2022] PUT /identity/v3/projects/42758b0b02434b76b69d5dea22bd5945/users/f435557ffd274e2b9cc4d00ee67c5622/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:51.525737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e68c22-ff81-4167-9781-d7f7fae575d4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:51.526461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e68c22-ff81-4167-9781-d7f7fae575d4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:51.526747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e68c22-ff81-4167-9781-d7f7fae575d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:51.579429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-93e68c22-ff81-4167-9781-d7f7fae575d4 None None] MFA Rules not processed for user `f435557ffd274e2b9cc4d00ee67c5622`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:51.581312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-93e68c22-ff81-4167-9781-d7f7fae575d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:51.748689 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1276/2506] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:51.753876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330135ac-778f-4554-99f6-9c85f3208f5d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:51.909028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330135ac-778f-4554-99f6-9c85f3208f5d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:51.916840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6478f-e088-4f09-88a8-b164ab572026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:51.917803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6478f-e088-4f09-88a8-b164ab572026 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:51.918269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6478f-e088-4f09-88a8-b164ab572026 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:51.918732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6478f-e088-4f09-88a8-b164ab572026 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:51.919634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6478f-e088-4f09-88a8-b164ab572026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:51.923549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6478f-e088-4f09-88a8-b164ab572026 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:51.962684 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1231/2507] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:51 2022] POST /identity/v3/projects => generated 409 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:51.967952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e68c22-ff81-4167-9781-d7f7fae575d4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:51.981423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e68c22-ff81-4167-9781-d7f7fae575d4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:52.119436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b4b62-cc04-4aec-b2d7-b208e5be3d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:52.121016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4b62-cc04-4aec-b2d7-b208e5be3d56 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:52.121506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4b62-cc04-4aec-b2d7-b208e5be3d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:52.121999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b4b62-cc04-4aec-b2d7-b208e5be3d56 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:52.123882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b4b62-cc04-4aec-b2d7-b208e5be3d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:52.128388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b4b62-cc04-4aec-b2d7-b208e5be3d56 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:52.188080 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1277/2508] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:51 2022] POST /identity/v3/users => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:52.189368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6478f-e088-4f09-88a8-b164ab572026 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:52.216799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6478f-e088-4f09-88a8-b164ab572026 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:52.225616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a20dc-a0f2-4090-bf4c-6cf97a33dde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:52.226345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a20dc-a0f2-4090-bf4c-6cf97a33dde9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:52.226690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a20dc-a0f2-4090-bf4c-6cf97a33dde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:52.227175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a20dc-a0f2-4090-bf4c-6cf97a33dde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:52.229157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a20dc-a0f2-4090-bf4c-6cf97a33dde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:52.230902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a20dc-a0f2-4090-bf4c-6cf97a33dde9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:52.255010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b4b62-cc04-4aec-b2d7-b208e5be3d56 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:52.264169 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1232/2509] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:52.269341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b4b62-cc04-4aec-b2d7-b208e5be3d56 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:52.282656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab73b1-3bcd-4b88-ad78-fbc4e022ec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:52.284476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab73b1-3bcd-4b88-ad78-fbc4e022ec93 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:52.284830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab73b1-3bcd-4b88-ad78-fbc4e022ec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:52.285105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab73b1-3bcd-4b88-ad78-fbc4e022ec93 admin admin] PATH_INFO: `/v3/projects/1bb2466befd84e639d0a7cecb62b754d/users/166e66653e904a1691a335b1cb3d405e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:52.323268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab73b1-3bcd-4b88-ad78-fbc4e022ec93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb2466befd84e639d0a7cecb62b754d, user_id=166e66653e904a1691a335b1cb3d405e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:52.326410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab73b1-3bcd-4b88-ad78-fbc4e022ec93 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:52.349763 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1278/2510] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:52 2022] PUT /identity/v3/projects/1bb2466befd84e639d0a7cecb62b754d/users/166e66653e904a1691a335b1cb3d405e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:52.354097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a20dc-a0f2-4090-bf4c-6cf97a33dde9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:52.370027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a20dc-a0f2-4090-bf4c-6cf97a33dde9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:52.487365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26191cb-7dd4-42dd-bfda-87961d4d44b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:52.488301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26191cb-7dd4-42dd-bfda-87961d4d44b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:52.488769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26191cb-7dd4-42dd-bfda-87961d4d44b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:52.489311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26191cb-7dd4-42dd-bfda-87961d4d44b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:52.491428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26191cb-7dd4-42dd-bfda-87961d4d44b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:52.493292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26191cb-7dd4-42dd-bfda-87961d4d44b6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:52.505844 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1233/2511] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:50:52.510299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab73b1-3bcd-4b88-ad78-fbc4e022ec93 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:52.529717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab73b1-3bcd-4b88-ad78-fbc4e022ec93 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:52.542288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af724db6-8f87-4185-ae9d-87427e2a4613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:52.544295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af724db6-8f87-4185-ae9d-87427e2a4613 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:52.544800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af724db6-8f87-4185-ae9d-87427e2a4613 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:52.545271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af724db6-8f87-4185-ae9d-87427e2a4613 admin admin] PATH_INFO: `/v3/projects/1bb2466befd84e639d0a7cecb62b754d/users/166e66653e904a1691a335b1cb3d405e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:52.560962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af724db6-8f87-4185-ae9d-87427e2a4613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb2466befd84e639d0a7cecb62b754d, user_id=166e66653e904a1691a335b1cb3d405e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:52.573685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af724db6-8f87-4185-ae9d-87427e2a4613 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:52.603183 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1279/2512] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:50:52 2022] PUT /identity/v3/projects/1bb2466befd84e639d0a7cecb62b754d/users/166e66653e904a1691a335b1cb3d405e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:52.608557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ed0e-32c9-487b-9876-d84fc5b347a9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:52.609957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ed0e-32c9-487b-9876-d84fc5b347a9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:52.612102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05ed0e-32c9-487b-9876-d84fc5b347a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:52.665372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0c05ed0e-32c9-487b-9876-d84fc5b347a9 None None] MFA Rules not processed for user `166e66653e904a1691a335b1cb3d405e`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:52.666615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0c05ed0e-32c9-487b-9876-d84fc5b347a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:52.897067 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1234/2513] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:52.981844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af724db6-8f87-4185-ae9d-87427e2a4613 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:52.984531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af724db6-8f87-4185-ae9d-87427e2a4613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:53.144528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af724db6-8f87-4185-ae9d-87427e2a4613 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:53.154503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735dabd-32a8-47f1-a246-119350b9e77f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:53.155544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735dabd-32a8-47f1-a246-119350b9e77f service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:53.156250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735dabd-32a8-47f1-a246-119350b9e77f service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:53.157904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735dabd-32a8-47f1-a246-119350b9e77f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:53.171352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735dabd-32a8-47f1-a246-119350b9e77f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:53.173526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735dabd-32a8-47f1-a246-119350b9e77f service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:53.192102 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1280/2514] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:53.262791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05ed0e-32c9-487b-9876-d84fc5b347a9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:53.284170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05ed0e-32c9-487b-9876-d84fc5b347a9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:53.296900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d039e-167a-45e2-8868-d8e7b98c850e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:53.298432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d039e-167a-45e2-8868-d8e7b98c850e service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:53.301147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d039e-167a-45e2-8868-d8e7b98c850e service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:53.301685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d039e-167a-45e2-8868-d8e7b98c850e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:53.389361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d039e-167a-45e2-8868-d8e7b98c850e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:53.391560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d039e-167a-45e2-8868-d8e7b98c850e service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:53.402943 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1235/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:53 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:54.789771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735dabd-32a8-47f1-a246-119350b9e77f service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:54.918543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735dabd-32a8-47f1-a246-119350b9e77f service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:54.925626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:54.926610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:54.926961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:54.927303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] PATH_INFO: `/v3/users/f435557ffd274e2b9cc4d00ee67c5622` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:54.928673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f435557ffd274e2b9cc4d00ee67c5622)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:54.930697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:55.002288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f435557ffd274e2b9cc4d00ee67c5622'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:55.020011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f435557ffd274e2b9cc4d00ee67c5622'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:55.021017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f435557ffd274e2b9cc4d00ee67c5622'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:55.022288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f435557ffd274e2b9cc4d00ee67c5622'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:55.040462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f435557ffd274e2b9cc4d00ee67c5622'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:55.063977 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1281/2516] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:54 2022] DELETE /identity/v3/users/f435557ffd274e2b9cc4d00ee67c5622 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:55.067679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccdeab-206c-445b-8ce3-acad0cb1b976 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:55.068379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccdeab-206c-445b-8ce3-acad0cb1b976 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:55.068657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ccdeab-206c-445b-8ce3-acad0cb1b976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:55.088346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-54ccdeab-206c-445b-8ce3-acad0cb1b976 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:55.089604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-54ccdeab-206c-445b-8ce3-acad0cb1b976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:55.191278 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1236/2517] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:55.213232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:55.219227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:55.402798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bb738-cd6b-494a-bd94-15aaa593428e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:55.409145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06dff5-b4ce-4527-99cf-0d9538d2e12e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:55.410570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06dff5-b4ce-4527-99cf-0d9538d2e12e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:55.410879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06dff5-b4ce-4527-99cf-0d9538d2e12e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:55.411132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a06dff5-b4ce-4527-99cf-0d9538d2e12e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:55.426035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06dff5-b4ce-4527-99cf-0d9538d2e12e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:55.427471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a06dff5-b4ce-4527-99cf-0d9538d2e12e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:55.447156 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1282/2518] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:55.585251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429a7d1-3df6-4390-a4af-fd678b02f52c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:55.586464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429a7d1-3df6-4390-a4af-fd678b02f52c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:55.587347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429a7d1-3df6-4390-a4af-fd678b02f52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:55.631049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a429a7d1-3df6-4390-a4af-fd678b02f52c None None] MFA Rules not processed for user `ee4e4af078764044baad8a944fccecf1`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:55.632623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a429a7d1-3df6-4390-a4af-fd678b02f52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:55.718552 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1237/2519] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:56.108309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06dff5-b4ce-4527-99cf-0d9538d2e12e service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:56.110556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2a06dff5-b4ce-4527-99cf-0d9538d2e12e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:56.190517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a06dff5-b4ce-4527-99cf-0d9538d2e12e service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:56.196499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03b376-92ef-43f2-97d1-d58ef228e3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:56.197174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b376-92ef-43f2-97d1-d58ef228e3a9 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:56.197458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b376-92ef-43f2-97d1-d58ef228e3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:56.197740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03b376-92ef-43f2-97d1-d58ef228e3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:56.207124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03b376-92ef-43f2-97d1-d58ef228e3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:56.209064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03b376-92ef-43f2-97d1-d58ef228e3a9 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:56.232357 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1283/2520] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:50:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:50:57.308187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429a7d1-3df6-4390-a4af-fd678b02f52c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:57.310019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a429a7d1-3df6-4390-a4af-fd678b02f52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:57.337924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429a7d1-3df6-4390-a4af-fd678b02f52c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:57.354691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:57.355573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:57.355852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:57.356155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] PATH_INFO: `/v3/projects/42758b0b02434b76b69d5dea22bd5945` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:57.357444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42758b0b02434b76b69d5dea22bd5945)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:57.359489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:57.463231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42758b0b02434b76b69d5dea22bd5945', 'request_id': 'req-427b0348-2325-4533-b71e-2e86556a8026'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.478430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42758b0b02434b76b69d5dea22bd5945', 'request_id': 'req-427b0348-2325-4533-b71e-2e86556a8026'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.489792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42758b0b02434b76b69d5dea22bd5945', 'request_id': 'req-427b0348-2325-4533-b71e-2e86556a8026'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.507238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] The token cache is being invalidate because project 42758b0b02434b76b69d5dea22bd5945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:57.507801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.509247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.515541 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1238/2521] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:57 2022] DELETE /identity/v3/projects/42758b0b02434b76b69d5dea22bd5945 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:57.517675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03b376-92ef-43f2-97d1-d58ef228e3a9 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:57.554123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03b376-92ef-43f2-97d1-d58ef228e3a9 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:57.687332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:57.688902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:57.689177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:57.689457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] PATH_INFO: `/v3/users/166e66653e904a1691a335b1cb3d405e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:57.694977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=166e66653e904a1691a335b1cb3d405e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:57.703705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:57.856060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166e66653e904a1691a335b1cb3d405e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.870781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166e66653e904a1691a335b1cb3d405e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.872402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166e66653e904a1691a335b1cb3d405e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.873590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166e66653e904a1691a335b1cb3d405e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.886922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0b1f9413-3cf8-476a-98b0-7658bb2af7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166e66653e904a1691a335b1cb3d405e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:57.939393 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1284/2522] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:50:57 2022] DELETE /identity/v3/users/166e66653e904a1691a335b1cb3d405e => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:59.092917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:59.094474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:59.110871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b0348-2325-4533-b71e-2e86556a8026 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:59.216284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:59.217348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:59.217922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:59.218349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] PATH_INFO: `/v3/projects/1bb2466befd84e639d0a7cecb62b754d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:59.223534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb2466befd84e639d0a7cecb62b754d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:59.226457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:59.320667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb2466befd84e639d0a7cecb62b754d', 'request_id': 'req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:59.335741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb2466befd84e639d0a7cecb62b754d', 'request_id': 'req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:59.355871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb2466befd84e639d0a7cecb62b754d', 'request_id': 'req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:59.379685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] The token cache is being invalidate because project 1bb2466befd84e639d0a7cecb62b754d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:50:59.381580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:59.385158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfe7b148-4f67-4a4b-8716-5c5b1ebc1b02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:50:59.395452 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1239/2523] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:50:59 2022] DELETE /identity/v3/projects/1bb2466befd84e639d0a7cecb62b754d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:50:59.397558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22880d-36ce-43ad-9e52-5cffc7a76ffb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:59.398024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22880d-36ce-43ad-9e52-5cffc7a76ffb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:59.398119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22880d-36ce-43ad-9e52-5cffc7a76ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:59.443705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7f22880d-36ce-43ad-9e52-5cffc7a76ffb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:59.445217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7f22880d-36ce-43ad-9e52-5cffc7a76ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:59.524993 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1285/2524] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:59.532936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5c25e-4cda-41b1-b83e-c1d2183e2629 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:59.533254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5c25e-4cda-41b1-b83e-c1d2183e2629 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:59.533525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5c25e-4cda-41b1-b83e-c1d2183e2629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:59.562023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c5d5c25e-4cda-41b1-b83e-c1d2183e2629 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:50:59.565888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c5d5c25e-4cda-41b1-b83e-c1d2183e2629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:50:59.584479 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1240/2525] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:50:59.584882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22880d-36ce-43ad-9e52-5cffc7a76ffb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:59.598714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22880d-36ce-43ad-9e52-5cffc7a76ffb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:59.604099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761ff9a-b50f-4ac4-9ebc-1a0042e19904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:59.605357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761ff9a-b50f-4ac4-9ebc-1a0042e19904 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:59.606309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761ff9a-b50f-4ac4-9ebc-1a0042e19904 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:59.606751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761ff9a-b50f-4ac4-9ebc-1a0042e19904 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:59.607784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761ff9a-b50f-4ac4-9ebc-1a0042e19904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:50:59.608287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761ff9a-b50f-4ac4-9ebc-1a0042e19904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:59.612442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761ff9a-b50f-4ac4-9ebc-1a0042e19904 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:59.634947 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1286/2526] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:50:59.639478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5c25e-4cda-41b1-b83e-c1d2183e2629 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:59.662150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5c25e-4cda-41b1-b83e-c1d2183e2629 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:59.674865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b1731-4a3d-48ef-b9c1-a950804662df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:59.677224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b1731-4a3d-48ef-b9c1-a950804662df admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:59.677744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b1731-4a3d-48ef-b9c1-a950804662df admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:59.678512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b1731-4a3d-48ef-b9c1-a950804662df admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:59.681308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b1731-4a3d-48ef-b9c1-a950804662df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:59.686093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b1731-4a3d-48ef-b9c1-a950804662df admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:59.750972 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1241/2527] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:50:59 2022] POST /identity/v3/projects => generated 409 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:50:59.751345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761ff9a-b50f-4ac4-9ebc-1a0042e19904 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:59.762286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761ff9a-b50f-4ac4-9ebc-1a0042e19904 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:59.834548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eda72-d77b-40ee-9df1-3fd4d213d121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:59.835658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eda72-d77b-40ee-9df1-3fd4d213d121 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:59.836606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eda72-d77b-40ee-9df1-3fd4d213d121 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:59.837065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108eda72-d77b-40ee-9df1-3fd4d213d121 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:59.838719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eda72-d77b-40ee-9df1-3fd4d213d121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:59.842631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108eda72-d77b-40ee-9df1-3fd4d213d121 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:59.878225 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1287/2528] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:50:59 2022] POST /identity/v3/users => generated 305 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:50:59.883451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b1731-4a3d-48ef-b9c1-a950804662df admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:59.900537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b1731-4a3d-48ef-b9c1-a950804662df admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:50:59.906070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27c0e6-6d4b-4f60-b6ea-73613ee90c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:50:59.907401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c0e6-6d4b-4f60-b6ea-73613ee90c16 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:50:59.907538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c0e6-6d4b-4f60-b6ea-73613ee90c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:50:59.907872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27c0e6-6d4b-4f60-b6ea-73613ee90c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:50:59.908628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27c0e6-6d4b-4f60-b6ea-73613ee90c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:50:59.910220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27c0e6-6d4b-4f60-b6ea-73613ee90c16 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:50:59.953895 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1242/2529] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:50:59.955868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eda72-d77b-40ee-9df1-3fd4d213d121 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:50:59.978330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108eda72-d77b-40ee-9df1-3fd4d213d121 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:00.010826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62971180-7059-44bb-b1f1-2c43f4648816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:00.011605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62971180-7059-44bb-b1f1-2c43f4648816 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:00.012939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62971180-7059-44bb-b1f1-2c43f4648816 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:00.015144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62971180-7059-44bb-b1f1-2c43f4648816 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:00.016474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62971180-7059-44bb-b1f1-2c43f4648816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:00.019399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62971180-7059-44bb-b1f1-2c43f4648816 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:00.052057 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1288/2530] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:00.056795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27c0e6-6d4b-4f60-b6ea-73613ee90c16 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:00.071721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27c0e6-6d4b-4f60-b6ea-73613ee90c16 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:00.087286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d982e15-f2e1-4d31-8f43-95c29aa884b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:00.088374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982e15-f2e1-4d31-8f43-95c29aa884b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:00.089938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982e15-f2e1-4d31-8f43-95c29aa884b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:00.091535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982e15-f2e1-4d31-8f43-95c29aa884b2 admin admin] PATH_INFO: `/v3/projects/7f94d873110d4ecea9d0fb0a8a4bc894/users/8a305a2bbad0435aae633817fb21b0b4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:00.128736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d982e15-f2e1-4d31-8f43-95c29aa884b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f94d873110d4ecea9d0fb0a8a4bc894, user_id=8a305a2bbad0435aae633817fb21b0b4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:00.132687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d982e15-f2e1-4d31-8f43-95c29aa884b2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:00.159287 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1243/2531] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:00 2022] PUT /identity/v3/projects/7f94d873110d4ecea9d0fb0a8a4bc894/users/8a305a2bbad0435aae633817fb21b0b4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:00.171093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8deb73-0411-4fcf-a1a7-60d71008ce9c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:00.171486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8deb73-0411-4fcf-a1a7-60d71008ce9c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:00.171831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8deb73-0411-4fcf-a1a7-60d71008ce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:00.205926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0c8deb73-0411-4fcf-a1a7-60d71008ce9c None None] MFA Rules not processed for user `8a305a2bbad0435aae633817fb21b0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:00.207524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0c8deb73-0411-4fcf-a1a7-60d71008ce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:00.310402 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1289/2532] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:00.314598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d982e15-f2e1-4d31-8f43-95c29aa884b2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:00.440482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d982e15-f2e1-4d31-8f43-95c29aa884b2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:00.449693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f652c-7e6a-481f-9a6b-4047b1bf4ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:00.450558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f652c-7e6a-481f-9a6b-4047b1bf4ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:00.450838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f652c-7e6a-481f-9a6b-4047b1bf4ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:00.451113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f652c-7e6a-481f-9a6b-4047b1bf4ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:00.451935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f652c-7e6a-481f-9a6b-4047b1bf4ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:00.458767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f652c-7e6a-481f-9a6b-4047b1bf4ce9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:00.517935 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1244/2533] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:00 2022] POST /identity/v3/projects => generated 411 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:51:00.519166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8deb73-0411-4fcf-a1a7-60d71008ce9c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:00.534136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8deb73-0411-4fcf-a1a7-60d71008ce9c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:00.615890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c5b50-44c2-4001-a855-e542c02d891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:00.616639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c5b50-44c2-4001-a855-e542c02d891b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:00.616947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c5b50-44c2-4001-a855-e542c02d891b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:00.617413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c5b50-44c2-4001-a855-e542c02d891b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:00.618557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c5b50-44c2-4001-a855-e542c02d891b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:00.624178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c5b50-44c2-4001-a855-e542c02d891b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:00.642414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76d24-4a1a-4f89-aac6-1a8b4217340e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:00.642760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76d24-4a1a-4f89-aac6-1a8b4217340e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:00.643015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f76d24-4a1a-4f89-aac6-1a8b4217340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:00.665250 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1290/2534] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:00 2022] POST /identity/v3/users => generated 312 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:00.670214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-49f76d24-4a1a-4f89-aac6-1a8b4217340e None None] MFA Rules not processed for user `2bcd816c4f3a495cbe7ce636cf0e2f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:00.670919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c5b50-44c2-4001-a855-e542c02d891b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:00.671441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49f76d24-4a1a-4f89-aac6-1a8b4217340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:00.684441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c5b50-44c2-4001-a855-e542c02d891b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:00.690604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a1e9-57e3-4b7c-a596-933121771d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:00.691368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a1e9-57e3-4b7c-a596-933121771d17 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:00.691868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a1e9-57e3-4b7c-a596-933121771d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:00.692322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1a1e9-57e3-4b7c-a596-933121771d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:00.693661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a1e9-57e3-4b7c-a596-933121771d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:00.696236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1a1e9-57e3-4b7c-a596-933121771d17 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:00.713267 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1291/2535] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:00.718707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a1e9-57e3-4b7c-a596-933121771d17 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:00.731109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1a1e9-57e3-4b7c-a596-933121771d17 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:00.743656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91625507-d1f9-44ce-afa4-0224df6060a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:00.745076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91625507-d1f9-44ce-afa4-0224df6060a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:00.745537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91625507-d1f9-44ce-afa4-0224df6060a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:00.745964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91625507-d1f9-44ce-afa4-0224df6060a6 admin admin] PATH_INFO: `/v3/projects/c2b96200343e454187eb999a70612e90/users/31fa93a116fb448593a0c03f4ffced36/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:00.766863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91625507-d1f9-44ce-afa4-0224df6060a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b96200343e454187eb999a70612e90, user_id=31fa93a116fb448593a0c03f4ffced36, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:00.771446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91625507-d1f9-44ce-afa4-0224df6060a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:00.797846 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1245/2536] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:00.807859 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1292/2537] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:00 2022] PUT /identity/v3/projects/c2b96200343e454187eb999a70612e90/users/31fa93a116fb448593a0c03f4ffced36/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:00.815200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f76d24-4a1a-4f89-aac6-1a8b4217340e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:00.830530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f76d24-4a1a-4f89-aac6-1a8b4217340e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:00.917627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca6f31-eaf6-4e91-98b0-8514ba343979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:00.918853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca6f31-eaf6-4e91-98b0-8514ba343979 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:00.919142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca6f31-eaf6-4e91-98b0-8514ba343979 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:00.919465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca6f31-eaf6-4e91-98b0-8514ba343979 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:00.920615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca6f31-eaf6-4e91-98b0-8514ba343979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:00.922060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca6f31-eaf6-4e91-98b0-8514ba343979 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:00.959786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91625507-d1f9-44ce-afa4-0224df6060a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:00.972027 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1246/2538] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:00.982957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91625507-d1f9-44ce-afa4-0224df6060a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:01.005483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692d1d6-b71d-4a5d-9abc-4650d7a38092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:01.006408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692d1d6-b71d-4a5d-9abc-4650d7a38092 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:01.006688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692d1d6-b71d-4a5d-9abc-4650d7a38092 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:01.006962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692d1d6-b71d-4a5d-9abc-4650d7a38092 admin admin] PATH_INFO: `/v3/projects/c2b96200343e454187eb999a70612e90/users/31fa93a116fb448593a0c03f4ffced36/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:01.013477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692d1d6-b71d-4a5d-9abc-4650d7a38092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b96200343e454187eb999a70612e90, user_id=31fa93a116fb448593a0c03f4ffced36, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:01.013770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692d1d6-b71d-4a5d-9abc-4650d7a38092 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:01.043905 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1293/2539] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:00 2022] PUT /identity/v3/projects/c2b96200343e454187eb999a70612e90/users/31fa93a116fb448593a0c03f4ffced36/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:01.054220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e5bf3-d41c-4b12-bb1a-0c8f4074e69b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:01.054514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e5bf3-d41c-4b12-bb1a-0c8f4074e69b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:01.054801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e5bf3-d41c-4b12-bb1a-0c8f4074e69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:01.115516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-300e5bf3-d41c-4b12-bb1a-0c8f4074e69b None None] MFA Rules not processed for user `31fa93a116fb448593a0c03f4ffced36`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:01.118657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-300e5bf3-d41c-4b12-bb1a-0c8f4074e69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:01.255438 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1247/2540] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:01.428416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a84934-6dfb-4523-ad28-11527480e6ea None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:01.428713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a84934-6dfb-4523-ad28-11527480e6ea None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:01.428999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a84934-6dfb-4523-ad28-11527480e6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:01.448479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-86a84934-6dfb-4523-ad28-11527480e6ea None None] MFA Rules not processed for user `c9bd4f2793ec48a5b31d081c269a39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:01.449668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-86a84934-6dfb-4523-ad28-11527480e6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:01.520614 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1294/2541] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:01.969842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e5bf3-d41c-4b12-bb1a-0c8f4074e69b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:01.971380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-300e5bf3-d41c-4b12-bb1a-0c8f4074e69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:02.053967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e5bf3-d41c-4b12-bb1a-0c8f4074e69b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:02.063604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1303a-ff68-4698-8462-982baa028952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:02.064335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1303a-ff68-4698-8462-982baa028952 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:02.064619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1303a-ff68-4698-8462-982baa028952 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:02.064893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1303a-ff68-4698-8462-982baa028952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:02.075737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1303a-ff68-4698-8462-982baa028952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:02.077550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1303a-ff68-4698-8462-982baa028952 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:02.088603 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1248/2542] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:01 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:02.888088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a84934-6dfb-4523-ad28-11527480e6ea None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:02.916508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a84934-6dfb-4523-ad28-11527480e6ea None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:02.926052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9e357-0ba9-46f3-ac6a-ddd84251fa1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:02.926904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e357-0ba9-46f3-ac6a-ddd84251fa1c service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:02.927362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e357-0ba9-46f3-ac6a-ddd84251fa1c service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:02.927803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9e357-0ba9-46f3-ac6a-ddd84251fa1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:03.080564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9e357-0ba9-46f3-ac6a-ddd84251fa1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:03.082755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9e357-0ba9-46f3-ac6a-ddd84251fa1c service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:03.095250 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1295/2543] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:02 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:04.026128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1303a-ff68-4698-8462-982baa028952 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:04.108765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1303a-ff68-4698-8462-982baa028952 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:04.119404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:04.121847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:04.122554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:04.123046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] PATH_INFO: `/v3/users/8a305a2bbad0435aae633817fb21b0b4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:04.125523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a305a2bbad0435aae633817fb21b0b4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:04.128014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:04.218979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a305a2bbad0435aae633817fb21b0b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:04.229099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a305a2bbad0435aae633817fb21b0b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:04.230249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a305a2bbad0435aae633817fb21b0b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:04.231138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a305a2bbad0435aae633817fb21b0b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:04.251508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a305a2bbad0435aae633817fb21b0b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:04.272815 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1249/2544] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:04 2022] DELETE /identity/v3/users/8a305a2bbad0435aae633817fb21b0b4 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:04.277955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183b31e-0dd2-47e8-8147-611d9126b8e4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:04.278415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183b31e-0dd2-47e8-8147-611d9126b8e4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:04.278508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183b31e-0dd2-47e8-8147-611d9126b8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:04.306804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7183b31e-0dd2-47e8-8147-611d9126b8e4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:04.308086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7183b31e-0dd2-47e8-8147-611d9126b8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:04.377358 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1296/2545] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:04.391961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:04.394359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:04.496859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab916fd-6e2a-4625-90bc-e68c1c94ec1c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:04.502434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f712086-26f9-4c55-9bc3-20e7939f39ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:04.503233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f712086-26f9-4c55-9bc3-20e7939f39ce service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:04.504925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f712086-26f9-4c55-9bc3-20e7939f39ce service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:04.505311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f712086-26f9-4c55-9bc3-20e7939f39ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:04.537742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f712086-26f9-4c55-9bc3-20e7939f39ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:04.545211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f712086-26f9-4c55-9bc3-20e7939f39ce service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:04.563972 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1250/2546] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:05.323640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183b31e-0dd2-47e8-8147-611d9126b8e4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:05.325951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7183b31e-0dd2-47e8-8147-611d9126b8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:05.341235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183b31e-0dd2-47e8-8147-611d9126b8e4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:05.347939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:05.348844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:05.349385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:05.349726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] PATH_INFO: `/v3/projects/7f94d873110d4ecea9d0fb0a8a4bc894` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:05.356483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f94d873110d4ecea9d0fb0a8a4bc894)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:05.359240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:05.423594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f94d873110d4ecea9d0fb0a8a4bc894', 'request_id': 'req-2b70b963-b71b-4b85-bbaa-6dc3df720a53'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.436426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f94d873110d4ecea9d0fb0a8a4bc894', 'request_id': 'req-2b70b963-b71b-4b85-bbaa-6dc3df720a53'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.444665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f94d873110d4ecea9d0fb0a8a4bc894', 'request_id': 'req-2b70b963-b71b-4b85-bbaa-6dc3df720a53'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.460302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] The token cache is being invalidate because project 7f94d873110d4ecea9d0fb0a8a4bc894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:05.460895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.462053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.463742 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1297/2547] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:05 2022] DELETE /identity/v3/projects/7f94d873110d4ecea9d0fb0a8a4bc894 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:51:05.467865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f712086-26f9-4c55-9bc3-20e7939f39ce service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:05.481753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f712086-26f9-4c55-9bc3-20e7939f39ce service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:05.556939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:05.558701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:05.559259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:05.559433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] PATH_INFO: `/v3/users/31fa93a116fb448593a0c03f4ffced36` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:05.562980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fa93a116fb448593a0c03f4ffced36)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:05.566837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:05.654751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fa93a116fb448593a0c03f4ffced36'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.670095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fa93a116fb448593a0c03f4ffced36'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.670909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fa93a116fb448593a0c03f4ffced36'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.672463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fa93a116fb448593a0c03f4ffced36'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.692446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-934343b1-75f1-4a4e-a135-9d9918bfd35b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fa93a116fb448593a0c03f4ffced36'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:05.711364 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1251/2548] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:05 2022] DELETE /identity/v3/users/31fa93a116fb448593a0c03f4ffced36 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:06.547001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:06.549548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:06.568667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70b963-b71b-4b85-bbaa-6dc3df720a53 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:06.652022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:06.653257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:06.653645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:06.654022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] PATH_INFO: `/v3/projects/c2b96200343e454187eb999a70612e90` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:06.655355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b96200343e454187eb999a70612e90)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:06.658420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:06.723289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b96200343e454187eb999a70612e90', 'request_id': 'req-6810cceb-66f3-4768-8508-bc79fa3786d4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:06.738084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b96200343e454187eb999a70612e90', 'request_id': 'req-6810cceb-66f3-4768-8508-bc79fa3786d4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:06.747104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b96200343e454187eb999a70612e90', 'request_id': 'req-6810cceb-66f3-4768-8508-bc79fa3786d4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:06.760160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] The token cache is being invalidate because project c2b96200343e454187eb999a70612e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:06.760585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:06.762535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6810cceb-66f3-4768-8508-bc79fa3786d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:06.764656 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1298/2549] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:06 2022] DELETE /identity/v3/projects/c2b96200343e454187eb999a70612e90 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:06.769890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05239ac-a1c3-4d05-a4d8-54d993fd4dd3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:06.770413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05239ac-a1c3-4d05-a4d8-54d993fd4dd3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:06.770651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05239ac-a1c3-4d05-a4d8-54d993fd4dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:06.790768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d05239ac-a1c3-4d05-a4d8-54d993fd4dd3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:06.792256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d05239ac-a1c3-4d05-a4d8-54d993fd4dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:06.861506 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1252/2550] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:51:06.871231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c06c8-0942-4f3b-a09c-383e3dafb156 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:06.872049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c06c8-0942-4f3b-a09c-383e3dafb156 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:06.872637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c06c8-0942-4f3b-a09c-383e3dafb156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:06.900775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-484c06c8-0942-4f3b-a09c-383e3dafb156 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:06.902471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-484c06c8-0942-4f3b-a09c-383e3dafb156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:06.911709 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1299/2551] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:51:06.916350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05239ac-a1c3-4d05-a4d8-54d993fd4dd3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:06.927413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05239ac-a1c3-4d05-a4d8-54d993fd4dd3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:06.937056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04893c1b-5c33-4d5c-8914-c0bd20d26f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:06.938396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04893c1b-5c33-4d5c-8914-c0bd20d26f50 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:06.938687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04893c1b-5c33-4d5c-8914-c0bd20d26f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:06.938965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04893c1b-5c33-4d5c-8914-c0bd20d26f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:06.939708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04893c1b-5c33-4d5c-8914-c0bd20d26f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:51:06.940056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04893c1b-5c33-4d5c-8914-c0bd20d26f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:06.941940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04893c1b-5c33-4d5c-8914-c0bd20d26f50 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:06.959830 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1253/2552] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:51:06.964926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c06c8-0942-4f3b-a09c-383e3dafb156 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:06.976966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c06c8-0942-4f3b-a09c-383e3dafb156 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:06.982394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a55005-04a0-4a8c-af56-c36f552dc325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:06.983053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55005-04a0-4a8c-af56-c36f552dc325 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:06.983355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55005-04a0-4a8c-af56-c36f552dc325 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:06.983621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a55005-04a0-4a8c-af56-c36f552dc325 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:06.984547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a55005-04a0-4a8c-af56-c36f552dc325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:06.986897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a55005-04a0-4a8c-af56-c36f552dc325 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.030038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04893c1b-5c33-4d5c-8914-c0bd20d26f50 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.042150 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1300/2553] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:06 2022] POST /identity/v3/projects => generated 393 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:07.044536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04893c1b-5c33-4d5c-8914-c0bd20d26f50 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.115381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d38466-73d2-43fe-897b-764066ff6de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.116178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d38466-73d2-43fe-897b-764066ff6de2 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.116536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d38466-73d2-43fe-897b-764066ff6de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.117046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d38466-73d2-43fe-897b-764066ff6de2 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.117847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d38466-73d2-43fe-897b-764066ff6de2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.120167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d38466-73d2-43fe-897b-764066ff6de2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.168033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a55005-04a0-4a8c-af56-c36f552dc325 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.170031 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1254/2554] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:07 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:07.188661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a55005-04a0-4a8c-af56-c36f552dc325 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.196980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0dc3d-69e1-4d44-ad37-109a4c930ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.197865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dc3d-69e1-4d44-ad37-109a4c930ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.198139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dc3d-69e1-4d44-ad37-109a4c930ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.198418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dc3d-69e1-4d44-ad37-109a4c930ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.199164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0dc3d-69e1-4d44-ad37-109a4c930ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.202660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0dc3d-69e1-4d44-ad37-109a4c930ce7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.215961 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1301/2555] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:51:07.219673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d38466-73d2-43fe-897b-764066ff6de2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.232042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d38466-73d2-43fe-897b-764066ff6de2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.237926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4cac4-e6ea-4b79-8922-a32c98bbadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.238604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4cac4-e6ea-4b79-8922-a32c98bbadc7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.238896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4cac4-e6ea-4b79-8922-a32c98bbadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.239179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4cac4-e6ea-4b79-8922-a32c98bbadc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.239936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4cac4-e6ea-4b79-8922-a32c98bbadc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.241594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4cac4-e6ea-4b79-8922-a32c98bbadc7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.256687 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1255/2556] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:51:07.257828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0dc3d-69e1-4d44-ad37-109a4c930ce7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.268498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0dc3d-69e1-4d44-ad37-109a4c930ce7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.273969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91988c-e8c0-4374-bc27-6b88771e8b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.275050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91988c-e8c0-4374-bc27-6b88771e8b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.275339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91988c-e8c0-4374-bc27-6b88771e8b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.275748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91988c-e8c0-4374-bc27-6b88771e8b43 admin admin] PATH_INFO: `/v3/projects/54c513bf41bd4101914b82a4b39e4030/users/0d404d270f3a41c9bb725f0ea552c76c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.294546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91988c-e8c0-4374-bc27-6b88771e8b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54c513bf41bd4101914b82a4b39e4030, user_id=0d404d270f3a41c9bb725f0ea552c76c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.299157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91988c-e8c0-4374-bc27-6b88771e8b43 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.324028 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1302/2557] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:07 2022] PUT /identity/v3/projects/54c513bf41bd4101914b82a4b39e4030/users/0d404d270f3a41c9bb725f0ea552c76c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:51:07.330244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73825a8-8da9-47f5-b36e-d777aec339ce None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.331018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73825a8-8da9-47f5-b36e-d777aec339ce None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.331018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73825a8-8da9-47f5-b36e-d777aec339ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.368920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f73825a8-8da9-47f5-b36e-d777aec339ce None None] MFA Rules not processed for user `0d404d270f3a41c9bb725f0ea552c76c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:07.370303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f73825a8-8da9-47f5-b36e-d777aec339ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:07.452300 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1256/2558] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:07.453957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91988c-e8c0-4374-bc27-6b88771e8b43 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.531668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91988c-e8c0-4374-bc27-6b88771e8b43 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.538798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf36d04-8a7b-4ef1-9501-02b33a7c9065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.539568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf36d04-8a7b-4ef1-9501-02b33a7c9065 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.539956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf36d04-8a7b-4ef1-9501-02b33a7c9065 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.540226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf36d04-8a7b-4ef1-9501-02b33a7c9065 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.540922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf36d04-8a7b-4ef1-9501-02b33a7c9065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.542830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf36d04-8a7b-4ef1-9501-02b33a7c9065 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.576153 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1303/2559] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:07 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:07.580526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73825a8-8da9-47f5-b36e-d777aec339ce None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.592632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73825a8-8da9-47f5-b36e-d777aec339ce None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.681954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831174c-352a-4b81-a701-d0f0282663df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.682943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831174c-352a-4b81-a701-d0f0282663df admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.683136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831174c-352a-4b81-a701-d0f0282663df admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.683482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831174c-352a-4b81-a701-d0f0282663df admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.684336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831174c-352a-4b81-a701-d0f0282663df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.686411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831174c-352a-4b81-a701-d0f0282663df admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.709200 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1257/2560] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:07 2022] POST /identity/v3/users => generated 302 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:07.712952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf36d04-8a7b-4ef1-9501-02b33a7c9065 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.724327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf36d04-8a7b-4ef1-9501-02b33a7c9065 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.730347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648e20-9450-488c-a3a6-b8eaba89c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.731340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648e20-9450-488c-a3a6-b8eaba89c0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.731624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648e20-9450-488c-a3a6-b8eaba89c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.732101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648e20-9450-488c-a3a6-b8eaba89c0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.732827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f648e20-9450-488c-a3a6-b8eaba89c0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.735072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f648e20-9450-488c-a3a6-b8eaba89c0b7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.749648 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1304/2561] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:07.759317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831174c-352a-4b81-a701-d0f0282663df admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.778694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831174c-352a-4b81-a701-d0f0282663df admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.792412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d5ebd-d325-484d-87aa-5c825b2ea5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.793669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d5ebd-d325-484d-87aa-5c825b2ea5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.793955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d5ebd-d325-484d-87aa-5c825b2ea5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.794226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304d5ebd-d325-484d-87aa-5c825b2ea5ef admin admin] PATH_INFO: `/v3/projects/5f9568ff04cd433681d4880791b17641/users/a78b588860a949218668f7ef82a625d3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.816594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d5ebd-d325-484d-87aa-5c825b2ea5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9568ff04cd433681d4880791b17641, user_id=a78b588860a949218668f7ef82a625d3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.819502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304d5ebd-d325-484d-87aa-5c825b2ea5ef admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.838706 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1258/2562] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:07 2022] PUT /identity/v3/projects/5f9568ff04cd433681d4880791b17641/users/a78b588860a949218668f7ef82a625d3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:07.842996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648e20-9450-488c-a3a6-b8eaba89c0b7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.854596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648e20-9450-488c-a3a6-b8eaba89c0b7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.934229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4939e-95a1-4254-8e1f-34b1a8bc5667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.934647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4939e-95a1-4254-8e1f-34b1a8bc5667 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.934945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4939e-95a1-4254-8e1f-34b1a8bc5667 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.935221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4939e-95a1-4254-8e1f-34b1a8bc5667 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.936033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4939e-95a1-4254-8e1f-34b1a8bc5667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.937756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4939e-95a1-4254-8e1f-34b1a8bc5667 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.950850 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1305/2563] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:07.953597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d5ebd-d325-484d-87aa-5c825b2ea5ef admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:07.964516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304d5ebd-d325-484d-87aa-5c825b2ea5ef admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:07.971359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1d77c-2afd-4b26-85f8-6343faff93d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:07.972365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1d77c-2afd-4b26-85f8-6343faff93d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:07.972881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1d77c-2afd-4b26-85f8-6343faff93d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:07.973231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1d77c-2afd-4b26-85f8-6343faff93d4 admin admin] PATH_INFO: `/v3/projects/5f9568ff04cd433681d4880791b17641/users/a78b588860a949218668f7ef82a625d3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:07.975628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1d77c-2afd-4b26-85f8-6343faff93d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9568ff04cd433681d4880791b17641, user_id=a78b588860a949218668f7ef82a625d3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:07.978408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1d77c-2afd-4b26-85f8-6343faff93d4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:07.991665 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1259/2564] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:07 2022] PUT /identity/v3/projects/5f9568ff04cd433681d4880791b17641/users/a78b588860a949218668f7ef82a625d3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:08.002841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed2444-1813-49ef-9cc2-3935cadaf5fb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:08.003470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed2444-1813-49ef-9cc2-3935cadaf5fb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:08.003951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed2444-1813-49ef-9cc2-3935cadaf5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:08.042141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e0ed2444-1813-49ef-9cc2-3935cadaf5fb None None] MFA Rules not processed for user `a78b588860a949218668f7ef82a625d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:08.043753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e0ed2444-1813-49ef-9cc2-3935cadaf5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:08.123785 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1306/2565] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:08.207728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8ad7c-64a9-4a35-9fc3-613df5db5f1a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:08.208108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8ad7c-64a9-4a35-9fc3-613df5db5f1a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:08.208301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8ad7c-64a9-4a35-9fc3-613df5db5f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:08.211761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed2444-1813-49ef-9cc2-3935cadaf5fb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:08.213268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e0ed2444-1813-49ef-9cc2-3935cadaf5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:08.238131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8ae8ad7c-64a9-4a35-9fc3-613df5db5f1a None None] MFA Rules not processed for user `0d404d270f3a41c9bb725f0ea552c76c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:08.239343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8ae8ad7c-64a9-4a35-9fc3-613df5db5f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:08.325513 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1260/2566] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:08.344855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed2444-1813-49ef-9cc2-3935cadaf5fb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:08.350715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:08.351447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:08.351798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:08.352288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:08.355109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:08.431688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:08.433270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:08.443536 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1307/2567] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:51:08.857689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8ad7c-64a9-4a35-9fc3-613df5db5f1a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:08.860389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8ae8ad7c-64a9-4a35-9fc3-613df5db5f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:08.880770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8ad7c-64a9-4a35-9fc3-613df5db5f1a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:08.886653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e5d14-b37e-4a6a-a2e6-325a49ed4e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:08.887494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5d14-b37e-4a6a-a2e6-325a49ed4e11 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:08.888007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5d14-b37e-4a6a-a2e6-325a49ed4e11 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:08.888230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e5d14-b37e-4a6a-a2e6-325a49ed4e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:08.898301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e5d14-b37e-4a6a-a2e6-325a49ed4e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:08.899954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e5d14-b37e-4a6a-a2e6-325a49ed4e11 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:08.916098 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1261/2568] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:51:20.916608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:20.918134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:21.052031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c353a913-d07e-4810-b9bb-190d213c6af9 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:21.057885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:21.059171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:21.059613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:21.060696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] PATH_INFO: `/v3/users/ee4e4af078764044baad8a944fccecf1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:21.062844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4e4af078764044baad8a944fccecf1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:21.065837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:21.144362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4e4af078764044baad8a944fccecf1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.157461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4e4af078764044baad8a944fccecf1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.158981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4e4af078764044baad8a944fccecf1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.159754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4e4af078764044baad8a944fccecf1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.171184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4e4af078764044baad8a944fccecf1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.224533 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1308/2569] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:20 2022] DELETE /identity/v3/users/ee4e4af078764044baad8a944fccecf1 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:21.332502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111c32-6563-4599-b178-d3e8ada4ec29 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:21.333103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111c32-6563-4599-b178-d3e8ada4ec29 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:21.333103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111c32-6563-4599-b178-d3e8ada4ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:21.355731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f1111c32-6563-4599-b178-d3e8ada4ec29 None None] MFA Rules not processed for user `4ef943b3272c48aa884a7ff4a7e854d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:21.357350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f1111c32-6563-4599-b178-d3e8ada4ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:21.425875 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1262/2570] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:21.675739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:21.677441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:21.805557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d277e0-127e-46ad-ac55-4a3f9609636a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:21.805557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:21.806289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:21.806706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:21.807131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] PATH_INFO: `/v3/projects/4a56761e1c4f400788db6793667fe7b9` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:21.808466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a56761e1c4f400788db6793667fe7b9)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:21.810875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:21.878639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a56761e1c4f400788db6793667fe7b9', 'request_id': 'req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.890116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a56761e1c4f400788db6793667fe7b9', 'request_id': 'req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.896708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a56761e1c4f400788db6793667fe7b9', 'request_id': 'req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.912136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] The token cache is being invalidate because project 4a56761e1c4f400788db6793667fe7b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:21.912425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.914447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:21.915590 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1309/2571] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:21 2022] DELETE /identity/v3/projects/4a56761e1c4f400788db6793667fe7b9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:21.922208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862bab-f3f1-4ade-b5e6-fc3dae3a05bb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:21.922796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862bab-f3f1-4ade-b5e6-fc3dae3a05bb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:21.923766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c862bab-f3f1-4ade-b5e6-fc3dae3a05bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:21.939335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:21.940850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:21.950967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4c862bab-f3f1-4ade-b5e6-fc3dae3a05bb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:21.952310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4c862bab-f3f1-4ade-b5e6-fc3dae3a05bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:22.035037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641b4cb-6b1f-43b4-a16c-31d34b9c6c0b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.040749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.041656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.041942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.042217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] PATH_INFO: `/v3/users/19597b33d62b4218ad7117bd8a520522` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.065631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] RBAC: Authorizing `identity:delete_user(user_id=19597b33d62b4218ad7117bd8a520522)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.068029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.076543 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1263/2572] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:22.084990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7412d-e1d5-40b2-bacb-80cd61101f8e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.085681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7412d-e1d5-40b2-bacb-80cd61101f8e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.086552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7412d-e1d5-40b2-bacb-80cd61101f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.117237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fac7412d-e1d5-40b2-bacb-80cd61101f8e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:22.118730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fac7412d-e1d5-40b2-bacb-80cd61101f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:22.130659 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1264/2573] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:51:22.133066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19597b33d62b4218ad7117bd8a520522'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.134738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7412d-e1d5-40b2-bacb-80cd61101f8e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:22.141974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19597b33d62b4218ad7117bd8a520522'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.142688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19597b33d62b4218ad7117bd8a520522'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.143480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19597b33d62b4218ad7117bd8a520522'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.145644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7412d-e1d5-40b2-bacb-80cd61101f8e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.150929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.151634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.152143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.152337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.152453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19597b33d62b4218ad7117bd8a520522'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.153019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:51:22.153326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.156780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.170399 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1265/2574] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:51:22.175634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:22.177880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:22.178478 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1310/2575] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:21 2022] DELETE /identity/v3/users/19597b33d62b4218ad7117bd8a520522 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:51:22.192317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054386a4-a624-4087-803a-8a3a9ec96875 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.261784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98613d-4926-467f-b07f-5204d69af2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.262447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98613d-4926-467f-b07f-5204d69af2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.262725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98613d-4926-467f-b07f-5204d69af2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.262998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98613d-4926-467f-b07f-5204d69af2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.263809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98613d-4926-467f-b07f-5204d69af2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.266426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98613d-4926-467f-b07f-5204d69af2b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.297146 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1266/2576] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:22 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:51:22.298679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:22.310480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f875e2-c7bf-45f3-b18a-e66d14c873be admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.370385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98613d-4926-467f-b07f-5204d69af2b0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:22.372145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5b98613d-4926-467f-b07f-5204d69af2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:22.379762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a82b8b-8d44-4967-ae34-1e406a543216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.380995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a82b8b-8d44-4967-ae34-1e406a543216 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.381573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a82b8b-8d44-4967-ae34-1e406a543216 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.382197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a82b8b-8d44-4967-ae34-1e406a543216 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.383282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a82b8b-8d44-4967-ae34-1e406a543216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.385308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a82b8b-8d44-4967-ae34-1e406a543216 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.434970 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1311/2577] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:22 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:22.437128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a82b8b-8d44-4967-ae34-1e406a543216 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:22.451402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a82b8b-8d44-4967-ae34-1e406a543216 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.466362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f84d5-b2ee-4a4c-8ee5-2e9157f7fcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.467174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f84d5-b2ee-4a4c-8ee5-2e9157f7fcac admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.467484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f84d5-b2ee-4a4c-8ee5-2e9157f7fcac admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.469503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f84d5-b2ee-4a4c-8ee5-2e9157f7fcac admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.470834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f84d5-b2ee-4a4c-8ee5-2e9157f7fcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.473394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f84d5-b2ee-4a4c-8ee5-2e9157f7fcac admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.490630 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1312/2578] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:22.491940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f84d5-b2ee-4a4c-8ee5-2e9157f7fcac admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:22.513601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f84d5-b2ee-4a4c-8ee5-2e9157f7fcac admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.520856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98613d-4926-467f-b07f-5204d69af2b0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.521039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e22c1d-117d-46c6-93cb-ffe67e32c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.521841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e22c1d-117d-46c6-93cb-ffe67e32c3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.522388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e22c1d-117d-46c6-93cb-ffe67e32c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.522791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e22c1d-117d-46c6-93cb-ffe67e32c3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.523656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e22c1d-117d-46c6-93cb-ffe67e32c3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.526179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e22c1d-117d-46c6-93cb-ffe67e32c3d7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.529950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.531431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.531908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.532278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] PATH_INFO: `/v3/projects/3aa6068dd8e94d7dbbd6dc1fcc7f236c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.533797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa6068dd8e94d7dbbd6dc1fcc7f236c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.537598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.541432 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1313/2579] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:22.545040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e22c1d-117d-46c6-93cb-ffe67e32c3d7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:22.563349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e22c1d-117d-46c6-93cb-ffe67e32c3d7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.570871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f40c8-e398-4cfc-8a7a-1b585532ba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.572101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f40c8-e398-4cfc-8a7a-1b585532ba93 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.572460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f40c8-e398-4cfc-8a7a-1b585532ba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.572808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f40c8-e398-4cfc-8a7a-1b585532ba93 admin admin] PATH_INFO: `/v3/projects/60d45f79e7e74256970478d54e49d034/users/4eb49b548d3745a7ba0ceecc1030f94f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.595717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f40c8-e398-4cfc-8a7a-1b585532ba93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d45f79e7e74256970478d54e49d034, user_id=4eb49b548d3745a7ba0ceecc1030f94f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.599181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f40c8-e398-4cfc-8a7a-1b585532ba93 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.622033 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1314/2580] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:22 2022] PUT /identity/v3/projects/60d45f79e7e74256970478d54e49d034/users/4eb49b548d3745a7ba0ceecc1030f94f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:51:22.634130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeace9b6-ac47-4f11-bea8-a393603160e4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.635085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeace9b6-ac47-4f11-bea8-a393603160e4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.636106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeace9b6-ac47-4f11-bea8-a393603160e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.650883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'request_id': 'req-e08bed80-2478-4967-87fa-8379ab419842'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.666867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'request_id': 'req-e08bed80-2478-4967-87fa-8379ab419842'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.682746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa6068dd8e94d7dbbd6dc1fcc7f236c', 'request_id': 'req-e08bed80-2478-4967-87fa-8379ab419842'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.688090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-aeace9b6-ac47-4f11-bea8-a393603160e4 None None] MFA Rules not processed for user `4eb49b548d3745a7ba0ceecc1030f94f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:22.689725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aeace9b6-ac47-4f11-bea8-a393603160e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:22.697958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] The token cache is being invalidate because project 3aa6068dd8e94d7dbbd6dc1fcc7f236c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:22.698252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.698932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.700965 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1267/2581] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:22 2022] DELETE /identity/v3/projects/3aa6068dd8e94d7dbbd6dc1fcc7f236c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:51:22.705931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:22.708199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:22.791390 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1315/2582] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:22.800441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeace9b6-ac47-4f11-bea8-a393603160e4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:22.801827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aeace9b6-ac47-4f11-bea8-a393603160e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:22.821051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08bed80-2478-4967-87fa-8379ab419842 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.827158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.828562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.828835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.829292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] PATH_INFO: `/v3/users/7005bc45925d42a1854758b05a82978f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.831482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7005bc45925d42a1854758b05a82978f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.834172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.889330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeace9b6-ac47-4f11-bea8-a393603160e4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:22.893647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7005bc45925d42a1854758b05a82978f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.896674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c46e01-8639-4468-b2e3-a24f8fa29ab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:22.897462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c46e01-8639-4468-b2e3-a24f8fa29ab0 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.897859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c46e01-8639-4468-b2e3-a24f8fa29ab0 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.898342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c46e01-8639-4468-b2e3-a24f8fa29ab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.901588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7005bc45925d42a1854758b05a82978f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.902527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7005bc45925d42a1854758b05a82978f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.903251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7005bc45925d42a1854758b05a82978f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.906899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c46e01-8639-4468-b2e3-a24f8fa29ab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:22.908873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c46e01-8639-4468-b2e3-a24f8fa29ab0 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:22.917958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1316/2583] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:22.920176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d76ad5aa-645c-47f4-9ce2-bd4e578ce184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7005bc45925d42a1854758b05a82978f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:22.934418 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1268/2584] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:22 2022] DELETE /identity/v3/users/7005bc45925d42a1854758b05a82978f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:22.976815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0241b-3176-409f-a6ad-bc01e307b675 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.977382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0241b-3176-409f-a6ad-bc01e307b675 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.977626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0241b-3176-409f-a6ad-bc01e307b675 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:22.979645 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1317/2585] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:51:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:51:22.985651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fad63-3e3e-4c3d-9d51-f27e18f55b57 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:22.986016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fad63-3e3e-4c3d-9d51-f27e18f55b57 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:22.986459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fad63-3e3e-4c3d-9d51-f27e18f55b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.008281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-728fad63-3e3e-4c3d-9d51-f27e18f55b57 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:23.008505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-728fad63-3e3e-4c3d-9d51-f27e18f55b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:23.092849 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1269/2586] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:51:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:23.118162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0241b-3176-409f-a6ad-bc01e307b675 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:23.120103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-60d0241b-3176-409f-a6ad-bc01e307b675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:23.156571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0241b-3176-409f-a6ad-bc01e307b675 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:23.166441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d22f3-e9bb-4ed9-ad25-2c5b9003941a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:23.166441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d22f3-e9bb-4ed9-ad25-2c5b9003941a service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.166441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d22f3-e9bb-4ed9-ad25-2c5b9003941a service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.166441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d22f3-e9bb-4ed9-ad25-2c5b9003941a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.168813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fad63-3e3e-4c3d-9d51-f27e18f55b57 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:23.169173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-728fad63-3e3e-4c3d-9d51-f27e18f55b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:23.188762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d22f3-e9bb-4ed9-ad25-2c5b9003941a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:23.190589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d22f3-e9bb-4ed9-ad25-2c5b9003941a service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:23.215032 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1318/2587] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:23.276936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fad63-3e3e-4c3d-9d51-f27e18f55b57 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:23.282354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:23.283295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.283663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.284073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] PATH_INFO: `/v3/projects/1e14c4010d2e4588ab9498cdf0b7904d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.285404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e14c4010d2e4588ab9498cdf0b7904d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:23.287694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:23.375007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e14c4010d2e4588ab9498cdf0b7904d', 'request_id': 'req-1ca722e8-32c2-4094-ad5a-b9680325d306'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:23.387612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e14c4010d2e4588ab9498cdf0b7904d', 'request_id': 'req-1ca722e8-32c2-4094-ad5a-b9680325d306'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:23.399028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e14c4010d2e4588ab9498cdf0b7904d', 'request_id': 'req-1ca722e8-32c2-4094-ad5a-b9680325d306'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:23.420100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] The token cache is being invalidate because project 1e14c4010d2e4588ab9498cdf0b7904d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:23.420749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:23.422272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ca722e8-32c2-4094-ad5a-b9680325d306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:23.424345 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1270/2588] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:23 2022] DELETE /identity/v3/projects/1e14c4010d2e4588ab9498cdf0b7904d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:23.429339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e56f9-93da-4556-9bf5-4b04b9ef2600 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.429633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e56f9-93da-4556-9bf5-4b04b9ef2600 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.429917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e56f9-93da-4556-9bf5-4b04b9ef2600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.451810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b42e56f9-93da-4556-9bf5-4b04b9ef2600 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:23.453633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b42e56f9-93da-4556-9bf5-4b04b9ef2600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:23.544343 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1319/2589] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:23.552767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a8e4-4d42-4b67-8b03-10070c1943bb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.553053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a8e4-4d42-4b67-8b03-10070c1943bb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.553332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9a8e4-4d42-4b67-8b03-10070c1943bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.573984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-76f9a8e4-4d42-4b67-8b03-10070c1943bb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:23.575965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-76f9a8e4-4d42-4b67-8b03-10070c1943bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:23.588971 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1271/2590] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:23.595242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e56f9-93da-4556-9bf5-4b04b9ef2600 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:23.608089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e56f9-93da-4556-9bf5-4b04b9ef2600 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:23.614501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c7f08-56ca-408b-a797-2f3310c19043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:23.615255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c7f08-56ca-408b-a797-2f3310c19043 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.615572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c7f08-56ca-408b-a797-2f3310c19043 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.615882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c7f08-56ca-408b-a797-2f3310c19043 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.616757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c7f08-56ca-408b-a797-2f3310c19043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:51:23.617038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c7f08-56ca-408b-a797-2f3310c19043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:23.618858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c7f08-56ca-408b-a797-2f3310c19043 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:23.638650 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1320/2591] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:51:23.641861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9a8e4-4d42-4b67-8b03-10070c1943bb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:23.653396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9a8e4-4d42-4b67-8b03-10070c1943bb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:23.658555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b90a-95fd-4c36-b5dc-18b0a5359571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:23.659204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b90a-95fd-4c36-b5dc-18b0a5359571 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.659487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b90a-95fd-4c36-b5dc-18b0a5359571 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.659756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4b90a-95fd-4c36-b5dc-18b0a5359571 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.660480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4b90a-95fd-4c36-b5dc-18b0a5359571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:23.662398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4b90a-95fd-4c36-b5dc-18b0a5359571 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:23.691056 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1272/2592] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:23 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:51:23.695029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c7f08-56ca-408b-a797-2f3310c19043 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:23.706407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c7f08-56ca-408b-a797-2f3310c19043 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:23.770778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbb08e-3867-47b3-be38-dc165700bfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:23.771483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbb08e-3867-47b3-be38-dc165700bfb8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.771782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbb08e-3867-47b3-be38-dc165700bfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.772113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdbb08e-3867-47b3-be38-dc165700bfb8 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.772902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbb08e-3867-47b3-be38-dc165700bfb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:23.775043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdbb08e-3867-47b3-be38-dc165700bfb8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:23.801415 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1321/2593] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:23 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:51:23.807985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b90a-95fd-4c36-b5dc-18b0a5359571 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:23.820995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4b90a-95fd-4c36-b5dc-18b0a5359571 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:23.826359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ff1d9-266d-4416-bb92-159236422183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:23.827903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ff1d9-266d-4416-bb92-159236422183 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.828401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ff1d9-266d-4416-bb92-159236422183 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.828852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ff1d9-266d-4416-bb92-159236422183 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.829734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ff1d9-266d-4416-bb92-159236422183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:23.831654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847ff1d9-266d-4416-bb92-159236422183 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:23.845333 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1273/2594] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:23.848644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbb08e-3867-47b3-be38-dc165700bfb8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:23.861831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdbb08e-3867-47b3-be38-dc165700bfb8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:23.878131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fd51f-f3a6-4757-ba8c-9e0f25f08d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:23.878881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd51f-f3a6-4757-ba8c-9e0f25f08d9f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.879168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd51f-f3a6-4757-ba8c-9e0f25f08d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.879519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fd51f-f3a6-4757-ba8c-9e0f25f08d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.880553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fd51f-f3a6-4757-ba8c-9e0f25f08d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:23.882840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fd51f-f3a6-4757-ba8c-9e0f25f08d9f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:23.898139 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1322/2595] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:23.902083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ff1d9-266d-4416-bb92-159236422183 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:23.913804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ff1d9-266d-4416-bb92-159236422183 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:23.920912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64df2ed7-7e6a-4d23-bf04-bea39adc20c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:23.921948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2ed7-7e6a-4d23-bf04-bea39adc20c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.922321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2ed7-7e6a-4d23-bf04-bea39adc20c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.922730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64df2ed7-7e6a-4d23-bf04-bea39adc20c0 admin admin] PATH_INFO: `/v3/projects/1268255d93eb46f48a57bf0d06ee3ecc/users/fb38b777a506403195df678fba42da02/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:23.943104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df2ed7-7e6a-4d23-bf04-bea39adc20c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1268255d93eb46f48a57bf0d06ee3ecc, user_id=fb38b777a506403195df678fba42da02, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:23.948977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64df2ed7-7e6a-4d23-bf04-bea39adc20c0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:23.968355 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1274/2596] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:23 2022] PUT /identity/v3/projects/1268255d93eb46f48a57bf0d06ee3ecc/users/fb38b777a506403195df678fba42da02/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:23.976798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8324e3-cb29-4cc9-a8c7-34d4e2cfaa5d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:23.977089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8324e3-cb29-4cc9-a8c7-34d4e2cfaa5d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:23.977624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8324e3-cb29-4cc9-a8c7-34d4e2cfaa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:24.005794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-aa8324e3-cb29-4cc9-a8c7-34d4e2cfaa5d None None] MFA Rules not processed for user `fb38b777a506403195df678fba42da02`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:24.007667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aa8324e3-cb29-4cc9-a8c7-34d4e2cfaa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:24.074930 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1323/2597] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:24.515315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786345-8339-4218-9942-7774e139b64e None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:24.517268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786345-8339-4218-9942-7774e139b64e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:24.517712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6786345-8339-4218-9942-7774e139b64e None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:24.520764 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1275/2598] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:51:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:51:24.528962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94518a-57f0-48a9-917f-dfe9be7c8501 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:24.529259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94518a-57f0-48a9-917f-dfe9be7c8501 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:24.529541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94518a-57f0-48a9-917f-dfe9be7c8501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:24.554420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8b94518a-57f0-48a9-917f-dfe9be7c8501 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:24.555720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8b94518a-57f0-48a9-917f-dfe9be7c8501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:24.714565 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1324/2599] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:51:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:24.740013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786345-8339-4218-9942-7774e139b64e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:24.742290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e6786345-8339-4218-9942-7774e139b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:24.768550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6786345-8339-4218-9942-7774e139b64e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:24.776999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62ca6a-5a3e-499a-8a11-b03019e2d8d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:24.777666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62ca6a-5a3e-499a-8a11-b03019e2d8d0 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:24.777950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62ca6a-5a3e-499a-8a11-b03019e2d8d0 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:24.778227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62ca6a-5a3e-499a-8a11-b03019e2d8d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:24.806286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62ca6a-5a3e-499a-8a11-b03019e2d8d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:24.808195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62ca6a-5a3e-499a-8a11-b03019e2d8d0 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:24.819703 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1276/2600] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:24.889624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94518a-57f0-48a9-917f-dfe9be7c8501 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:24.891244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8b94518a-57f0-48a9-917f-dfe9be7c8501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:24.979378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94518a-57f0-48a9-917f-dfe9be7c8501 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:24.990439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d02d81-d0f6-4aca-9da8-c7c4b68aaf0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:24.991986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d02d81-d0f6-4aca-9da8-c7c4b68aaf0a service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:24.992538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d02d81-d0f6-4aca-9da8-c7c4b68aaf0a service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:24.993159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d02d81-d0f6-4aca-9da8-c7c4b68aaf0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:25.007767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d02d81-d0f6-4aca-9da8-c7c4b68aaf0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:25.009699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d02d81-d0f6-4aca-9da8-c7c4b68aaf0a service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:25.026695 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1325/2601] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:26.158354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62ca6a-5a3e-499a-8a11-b03019e2d8d0 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:26.172006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62ca6a-5a3e-499a-8a11-b03019e2d8d0 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:26.177535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01759160-5174-4155-85bd-d9bb128c6edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:26.178178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01759160-5174-4155-85bd-d9bb128c6edf service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:26.178660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01759160-5174-4155-85bd-d9bb128c6edf service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:26.178926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01759160-5174-4155-85bd-d9bb128c6edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:26.180913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-01759160-5174-4155-85bd-d9bb128c6edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:26.245247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01759160-5174-4155-85bd-d9bb128c6edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:26.247564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01759160-5174-4155-85bd-d9bb128c6edf service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:26.264352 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1277/2602] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:26.291521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296e7b8-7f50-4092-b20e-9c719546309d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:26.292064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296e7b8-7f50-4092-b20e-9c719546309d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:26.292064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c296e7b8-7f50-4092-b20e-9c719546309d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:26.317432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c296e7b8-7f50-4092-b20e-9c719546309d None None] MFA Rules not processed for user `0d404d270f3a41c9bb725f0ea552c76c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:26.318689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c296e7b8-7f50-4092-b20e-9c719546309d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:26.403059 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1326/2603] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:27.831841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01759160-5174-4155-85bd-d9bb128c6edf service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:27.907778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01759160-5174-4155-85bd-d9bb128c6edf service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:27.913225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:27.914323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:27.914782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:27.915203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] PATH_INFO: `/v3/users/fb38b777a506403195df678fba42da02` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:27.916558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb38b777a506403195df678fba42da02)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:27.918694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:27.982159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb38b777a506403195df678fba42da02'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:27.992127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb38b777a506403195df678fba42da02'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:27.993191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb38b777a506403195df678fba42da02'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:27.994030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb38b777a506403195df678fba42da02'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:28.017658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb38b777a506403195df678fba42da02'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:28.040277 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1278/2604] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:27 2022] DELETE /identity/v3/users/fb38b777a506403195df678fba42da02 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:28.045124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de5e0-b9ba-4a98-8754-21335f9146ea None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:28.046949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de5e0-b9ba-4a98-8754-21335f9146ea None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:28.047560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905de5e0-b9ba-4a98-8754-21335f9146ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:28.075598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-905de5e0-b9ba-4a98-8754-21335f9146ea None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:28.076966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-905de5e0-b9ba-4a98-8754-21335f9146ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:28.148155 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1327/2605] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:28.158730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:28.160192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:28.230790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45ad56-f82d-49b5-9c6e-affe9ce4935d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:28.235191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c60f51-3ea0-40ea-98c1-3fcbc9c77b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:28.235618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c60f51-3ea0-40ea-98c1-3fcbc9c77b3f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:28.236070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c60f51-3ea0-40ea-98c1-3fcbc9c77b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:28.236446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c60f51-3ea0-40ea-98c1-3fcbc9c77b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:28.254357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c60f51-3ea0-40ea-98c1-3fcbc9c77b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:28.255856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c60f51-3ea0-40ea-98c1-3fcbc9c77b3f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:28.266712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1279/2606] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:28.785966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905de5e0-b9ba-4a98-8754-21335f9146ea None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:28.788153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-905de5e0-b9ba-4a98-8754-21335f9146ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:28.800905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905de5e0-b9ba-4a98-8754-21335f9146ea None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:28.808333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:28.809593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:28.810200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:28.810901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] PATH_INFO: `/v3/projects/1268255d93eb46f48a57bf0d06ee3ecc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:28.814262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1268255d93eb46f48a57bf0d06ee3ecc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:28.816444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:28.886882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1268255d93eb46f48a57bf0d06ee3ecc', 'request_id': 'req-767ae8a8-06e5-46b8-9900-989ef471b795'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:28.900295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1268255d93eb46f48a57bf0d06ee3ecc', 'request_id': 'req-767ae8a8-06e5-46b8-9900-989ef471b795'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:28.909124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1268255d93eb46f48a57bf0d06ee3ecc', 'request_id': 'req-767ae8a8-06e5-46b8-9900-989ef471b795'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:28.921584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] The token cache is being invalidate because project 1268255d93eb46f48a57bf0d06ee3ecc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:28.922108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:28.922962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-767ae8a8-06e5-46b8-9900-989ef471b795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:28.925133 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1328/2607] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:28 2022] DELETE /identity/v3/projects/1268255d93eb46f48a57bf0d06ee3ecc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:28.938242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3dee-203b-496b-9cd3-9f9eef914c41 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:28.939138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3dee-203b-496b-9cd3-9f9eef914c41 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:28.939565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3dee-203b-496b-9cd3-9f9eef914c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:28.960184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b4dd3dee-203b-496b-9cd3-9f9eef914c41 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:28.961644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b4dd3dee-203b-496b-9cd3-9f9eef914c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:29.054986 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1280/2608] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:29.062810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfe821-2933-4b87-8f69-34d3cdc11eb6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.063662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfe821-2933-4b87-8f69-34d3cdc11eb6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.064145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfe821-2933-4b87-8f69-34d3cdc11eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.099169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5ecfe821-2933-4b87-8f69-34d3cdc11eb6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:29.101429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5ecfe821-2933-4b87-8f69-34d3cdc11eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:29.107278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd3dee-203b-496b-9cd3-9f9eef914c41 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:29.109813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b4dd3dee-203b-496b-9cd3-9f9eef914c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:29.119412 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1329/2609] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:29.126617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfe821-2933-4b87-8f69-34d3cdc11eb6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:29.136696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd3dee-203b-496b-9cd3-9f9eef914c41 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:29.140684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfe821-2933-4b87-8f69-34d3cdc11eb6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:29.145042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:29.146200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.146638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.148239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] PATH_INFO: `/v3/users/4eb49b548d3745a7ba0ceecc1030f94f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.151329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7272a-3c12-4a32-add1-427049269adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:29.152246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7272a-3c12-4a32-add1-427049269adf admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.152587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7272a-3c12-4a32-add1-427049269adf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.152874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7272a-3c12-4a32-add1-427049269adf admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.153715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7272a-3c12-4a32-add1-427049269adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:51:29.153871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eb49b548d3745a7ba0ceecc1030f94f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:29.154079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7272a-3c12-4a32-add1-427049269adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:29.156214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:29.157165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7272a-3c12-4a32-add1-427049269adf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:29.178942 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1330/2610] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:51:29.180061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7272a-3c12-4a32-add1-427049269adf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:29.194326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7272a-3c12-4a32-add1-427049269adf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:29.201711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a886e-a4c7-4fc6-80d6-0141536eecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:29.203258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a886e-a4c7-4fc6-80d6-0141536eecf4 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.203748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a886e-a4c7-4fc6-80d6-0141536eecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.204217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a886e-a4c7-4fc6-80d6-0141536eecf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.205339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a886e-a4c7-4fc6-80d6-0141536eecf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:29.208302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a886e-a4c7-4fc6-80d6-0141536eecf4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:29.249622 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1331/2611] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:29 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:29.250636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eb49b548d3745a7ba0ceecc1030f94f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:29.251550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a886e-a4c7-4fc6-80d6-0141536eecf4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:29.267515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eb49b548d3745a7ba0ceecc1030f94f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:29.268536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eb49b548d3745a7ba0ceecc1030f94f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:29.269430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eb49b548d3745a7ba0ceecc1030f94f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:29.293810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-12d81f84-848e-4467-93fe-657b4f569822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eb49b548d3745a7ba0ceecc1030f94f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:29.311945 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1281/2612] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:29 2022] DELETE /identity/v3/users/4eb49b548d3745a7ba0ceecc1030f94f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:51:29.321350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a72ed-8444-4651-858d-c60c21d61e0a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.321782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a72ed-8444-4651-858d-c60c21d61e0a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.322344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a72ed-8444-4651-858d-c60c21d61e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.339228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a886e-a4c7-4fc6-80d6-0141536eecf4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:29.364681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3a6a72ed-8444-4651-858d-c60c21d61e0a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:29.365902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a6a72ed-8444-4651-858d-c60c21d61e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:29.499363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1aa21-5cfc-4c83-9077-9e71c680b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:29.500070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1aa21-5cfc-4c83-9077-9e71c680b374 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.500365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1aa21-5cfc-4c83-9077-9e71c680b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.500636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1aa21-5cfc-4c83-9077-9e71c680b374 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.501433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1aa21-5cfc-4c83-9077-9e71c680b374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:29.503274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1aa21-5cfc-4c83-9077-9e71c680b374 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:29.531158 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1282/2613] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:29.551098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a72ed-8444-4651-858d-c60c21d61e0a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:29.553094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a6a72ed-8444-4651-858d-c60c21d61e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:29.561006 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1332/2614] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:29 2022] POST /identity/v3/users => generated 290 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:29.562822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1aa21-5cfc-4c83-9077-9e71c680b374 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:29.565981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f1b1aa21-5cfc-4c83-9077-9e71c680b374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:29.608747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1aa21-5cfc-4c83-9077-9e71c680b374 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:29.614801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cdc97-b96a-4ab4-8990-17ccbe374e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:29.616154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cdc97-b96a-4ab4-8990-17ccbe374e83 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.617160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cdc97-b96a-4ab4-8990-17ccbe374e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.617610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cdc97-b96a-4ab4-8990-17ccbe374e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.618548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cdc97-b96a-4ab4-8990-17ccbe374e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:29.621925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865cdc97-b96a-4ab4-8990-17ccbe374e83 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:29.640902 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1333/2615] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:29.642341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cdc97-b96a-4ab4-8990-17ccbe374e83 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:29.658845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cdc97-b96a-4ab4-8990-17ccbe374e83 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:29.665386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4a7c2-7bee-43ac-b8aa-422218a81606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:29.666607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4a7c2-7bee-43ac-b8aa-422218a81606 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.667642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4a7c2-7bee-43ac-b8aa-422218a81606 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.668831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4a7c2-7bee-43ac-b8aa-422218a81606 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.669741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4a7c2-7bee-43ac-b8aa-422218a81606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:29.672881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4a7c2-7bee-43ac-b8aa-422218a81606 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:29.697094 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1334/2616] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:29.697785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a72ed-8444-4651-858d-c60c21d61e0a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:29.698603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4a7c2-7bee-43ac-b8aa-422218a81606 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:29.708439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a2d90-f2a2-4996-8386-78ca0ae27c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:29.709108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a2d90-f2a2-4996-8386-78ca0ae27c9a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.709389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a2d90-f2a2-4996-8386-78ca0ae27c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.710067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a2d90-f2a2-4996-8386-78ca0ae27c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.731567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a2d90-f2a2-4996-8386-78ca0ae27c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:29.733424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3a2d90-f2a2-4996-8386-78ca0ae27c9a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:29.733998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4a7c2-7bee-43ac-b8aa-422218a81606 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:29.739335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a244-8bf7-4bb8-b345-226510237036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:29.744153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a244-8bf7-4bb8-b345-226510237036 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.744626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a244-8bf7-4bb8-b345-226510237036 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.745063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6a244-8bf7-4bb8-b345-226510237036 admin admin] PATH_INFO: `/v3/projects/299001bd661045f59e40ea0fac0af324/users/0520acbd176641c2b46226fa3febe61a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.745428 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1283/2617] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:51:29.764037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a244-8bf7-4bb8-b345-226510237036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299001bd661045f59e40ea0fac0af324, user_id=0520acbd176641c2b46226fa3febe61a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:29.768032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6a244-8bf7-4bb8-b345-226510237036 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:29.800779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8403-db9a-4c8c-b90f-d9d23c4a23ce None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:29.801215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8403-db9a-4c8c-b90f-d9d23c4a23ce None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:29.801733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe8403-db9a-4c8c-b90f-d9d23c4a23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:29.802504 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1335/2618] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:29 2022] PUT /identity/v3/projects/299001bd661045f59e40ea0fac0af324/users/0520acbd176641c2b46226fa3febe61a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:29.841127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cdfe8403-db9a-4c8c-b90f-d9d23c4a23ce None None] MFA Rules not processed for user `0520acbd176641c2b46226fa3febe61a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:29.845659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cdfe8403-db9a-4c8c-b90f-d9d23c4a23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:30.033307 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1284/2619] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:30.048622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a244-8bf7-4bb8-b345-226510237036 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:30.054653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ace6a244-8bf7-4bb8-b345-226510237036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:30.152682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6a244-8bf7-4bb8-b345-226510237036 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:30.157320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb28e6-6f57-46c4-9a78-f9b5a304b12b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:30.157984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb28e6-6f57-46c4-9a78-f9b5a304b12b service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:30.158272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb28e6-6f57-46c4-9a78-f9b5a304b12b service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:30.158552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb28e6-6f57-46c4-9a78-f9b5a304b12b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:30.169947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb28e6-6f57-46c4-9a78-f9b5a304b12b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:30.171617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb28e6-6f57-46c4-9a78-f9b5a304b12b service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:30.188381 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1336/2620] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:30.343627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4a7d-be48-4202-a4e5-27082dfdf74c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:30.343988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4a7d-be48-4202-a4e5-27082dfdf74c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:30.344750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae4a7d-be48-4202-a4e5-27082dfdf74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:30.409305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2fae4a7d-be48-4202-a4e5-27082dfdf74c None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:30.410741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2fae4a7d-be48-4202-a4e5-27082dfdf74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:30.491376 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1285/2621] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:51:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:30.547018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb28e6-6f57-46c4-9a78-f9b5a304b12b service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:30.548477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b1bb28e6-6f57-46c4-9a78-f9b5a304b12b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:30.760109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb28e6-6f57-46c4-9a78-f9b5a304b12b service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:30.768228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a64c23-7b15-4d4d-bf04-40a487796550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:30.769181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a64c23-7b15-4d4d-bf04-40a487796550 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:30.769893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a64c23-7b15-4d4d-bf04-40a487796550 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:30.770329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a64c23-7b15-4d4d-bf04-40a487796550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:30.772999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4a7d-be48-4202-a4e5-27082dfdf74c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:30.774952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2fae4a7d-be48-4202-a4e5-27082dfdf74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:30.781743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a64c23-7b15-4d4d-bf04-40a487796550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:30.793517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a64c23-7b15-4d4d-bf04-40a487796550 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:30.822069 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1337/2622] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:51:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:30.917371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae4a7d-be48-4202-a4e5-27082dfdf74c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:30.926800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:30.928311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:30.928910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:30.929289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] PATH_INFO: `/v3/projects/60d45f79e7e74256970478d54e49d034` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:30.930920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d45f79e7e74256970478d54e49d034)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:30.933577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:31.018962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d45f79e7e74256970478d54e49d034', 'request_id': 'req-7fa4aace-b564-4403-88a3-aa1874c15c5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:31.035077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d45f79e7e74256970478d54e49d034', 'request_id': 'req-7fa4aace-b564-4403-88a3-aa1874c15c5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:31.052922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d45f79e7e74256970478d54e49d034', 'request_id': 'req-7fa4aace-b564-4403-88a3-aa1874c15c5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:31.075226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] The token cache is being invalidate because project 60d45f79e7e74256970478d54e49d034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:31.075561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:31.077639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fa4aace-b564-4403-88a3-aa1874c15c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:31.079463 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1286/2623] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:30 2022] DELETE /identity/v3/projects/60d45f79e7e74256970478d54e49d034 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:31.088167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0073b-64e5-463a-ad7a-57385beeb441 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:31.088980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0073b-64e5-463a-ad7a-57385beeb441 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:31.089411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0073b-64e5-463a-ad7a-57385beeb441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:31.150683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-19a0073b-64e5-463a-ad7a-57385beeb441 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:31.152447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-19a0073b-64e5-463a-ad7a-57385beeb441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:31.323086 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1338/2624] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:31.331667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6527-d482-4799-9e91-2cc83e444e84 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:31.333286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6527-d482-4799-9e91-2cc83e444e84 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:31.333604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6527-d482-4799-9e91-2cc83e444e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:31.363182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-804e6527-d482-4799-9e91-2cc83e444e84 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:31.364829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-804e6527-d482-4799-9e91-2cc83e444e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:31.382398 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1287/2625] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:51:31.386234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0073b-64e5-463a-ad7a-57385beeb441 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:31.405875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0073b-64e5-463a-ad7a-57385beeb441 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:31.413489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b76c17-306e-4775-a003-e70479cb0c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:31.414490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b76c17-306e-4775-a003-e70479cb0c31 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:31.415014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b76c17-306e-4775-a003-e70479cb0c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:31.415739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b76c17-306e-4775-a003-e70479cb0c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:31.416602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b76c17-306e-4775-a003-e70479cb0c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:51:31.417009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b76c17-306e-4775-a003-e70479cb0c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:31.423944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b76c17-306e-4775-a003-e70479cb0c31 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:31.452617 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1339/2626] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:51:31.456810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6527-d482-4799-9e91-2cc83e444e84 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:31.476829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6527-d482-4799-9e91-2cc83e444e84 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:31.490646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a94ebb-ae63-4fc5-b843-58bd95a33d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:31.491608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a94ebb-ae63-4fc5-b843-58bd95a33d99 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:31.492372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a94ebb-ae63-4fc5-b843-58bd95a33d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:31.492927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a94ebb-ae63-4fc5-b843-58bd95a33d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:31.493848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a94ebb-ae63-4fc5-b843-58bd95a33d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:31.496959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a94ebb-ae63-4fc5-b843-58bd95a33d99 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:31.541867 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1288/2627] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:31 2022] POST /identity/v3/projects => generated 395 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:31.547092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b76c17-306e-4775-a003-e70479cb0c31 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:31.568435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b76c17-306e-4775-a003-e70479cb0c31 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:31.690164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f735-bdce-45e3-bfc0-bebdfa2f2ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:31.690849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f735-bdce-45e3-bfc0-bebdfa2f2ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:31.691139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f735-bdce-45e3-bfc0-bebdfa2f2ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:31.691416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f735-bdce-45e3-bfc0-bebdfa2f2ff5 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:31.693354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f735-bdce-45e3-bfc0-bebdfa2f2ff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:31.695098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476f735-bdce-45e3-bfc0-bebdfa2f2ff5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:31.742637 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1340/2628] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:31 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:31.746350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a94ebb-ae63-4fc5-b843-58bd95a33d99 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:31.757845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a94ebb-ae63-4fc5-b843-58bd95a33d99 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:31.763262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938882a5-1a8e-4220-bf5d-fc48dd21dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:31.764174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938882a5-1a8e-4220-bf5d-fc48dd21dbaa admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:31.769853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938882a5-1a8e-4220-bf5d-fc48dd21dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:31.769853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938882a5-1a8e-4220-bf5d-fc48dd21dbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:31.770807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938882a5-1a8e-4220-bf5d-fc48dd21dbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:31.772632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938882a5-1a8e-4220-bf5d-fc48dd21dbaa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:31.785829 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1289/2629] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:51:31.789566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f735-bdce-45e3-bfc0-bebdfa2f2ff5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:31.809582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f735-bdce-45e3-bfc0-bebdfa2f2ff5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:31.815883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17b99d-0456-4c11-81b2-4c85a1ae7a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:31.816869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17b99d-0456-4c11-81b2-4c85a1ae7a4c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:31.817635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17b99d-0456-4c11-81b2-4c85a1ae7a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:31.818135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17b99d-0456-4c11-81b2-4c85a1ae7a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:31.819057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17b99d-0456-4c11-81b2-4c85a1ae7a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:31.821709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af17b99d-0456-4c11-81b2-4c85a1ae7a4c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:31.835026 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1341/2630] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:51:31.839058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938882a5-1a8e-4220-bf5d-fc48dd21dbaa admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:31.851812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938882a5-1a8e-4220-bf5d-fc48dd21dbaa admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:31.861669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b74e7-eb15-4632-9023-f0f6ac8c07e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:31.862904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b74e7-eb15-4632-9023-f0f6ac8c07e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:31.863369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b74e7-eb15-4632-9023-f0f6ac8c07e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:31.863866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b74e7-eb15-4632-9023-f0f6ac8c07e5 admin admin] PATH_INFO: `/v3/projects/9b09e96f559e4f2c9918ac9e12e4dd1b/users/8e677e10e3b0488fbb92e802a96eaf0d/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:31.883047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b74e7-eb15-4632-9023-f0f6ac8c07e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b09e96f559e4f2c9918ac9e12e4dd1b, user_id=8e677e10e3b0488fbb92e802a96eaf0d, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:31.886250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b74e7-eb15-4632-9023-f0f6ac8c07e5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:31.909481 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1290/2631] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:31 2022] PUT /identity/v3/projects/9b09e96f559e4f2c9918ac9e12e4dd1b/users/8e677e10e3b0488fbb92e802a96eaf0d/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:31.914579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e3af0-45b3-45b9-9eb5-4a2b24447ce0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:31.915460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e3af0-45b3-45b9-9eb5-4a2b24447ce0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:31.915958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e3af0-45b3-45b9-9eb5-4a2b24447ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:31.938837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-005e3af0-45b3-45b9-9eb5-4a2b24447ce0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:31.941233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-005e3af0-45b3-45b9-9eb5-4a2b24447ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:32.028134 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1342/2632] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:32.049901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b74e7-eb15-4632-9023-f0f6ac8c07e5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:32.052157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d31b74e7-eb15-4632-9023-f0f6ac8c07e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:32.187526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b74e7-eb15-4632-9023-f0f6ac8c07e5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:32.192026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69949e6-3aaa-4fff-8c22-7b9a1925d074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:32.192362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69949e6-3aaa-4fff-8c22-7b9a1925d074 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:32.192692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69949e6-3aaa-4fff-8c22-7b9a1925d074 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:32.192995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69949e6-3aaa-4fff-8c22-7b9a1925d074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:32.203141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69949e6-3aaa-4fff-8c22-7b9a1925d074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:32.204720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69949e6-3aaa-4fff-8c22-7b9a1925d074 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:32.217834 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1291/2633] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:33.487141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ae423-68a1-41ed-ab95-5b7eb0f5af40 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:33.488011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ae423-68a1-41ed-ab95-5b7eb0f5af40 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:33.488437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ae423-68a1-41ed-ab95-5b7eb0f5af40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:33.520322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-af9ae423-68a1-41ed-ab95-5b7eb0f5af40 None None] MFA Rules not processed for user `8e677e10e3b0488fbb92e802a96eaf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:33.521917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af9ae423-68a1-41ed-ab95-5b7eb0f5af40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:33.604547 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1343/2634] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:33.635436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69949e6-3aaa-4fff-8c22-7b9a1925d074 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:33.636890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e69949e6-3aaa-4fff-8c22-7b9a1925d074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:33.724109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69949e6-3aaa-4fff-8c22-7b9a1925d074 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:33.729650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c8fb1-6555-4869-94be-ce9c40b43e5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:33.730210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c8fb1-6555-4869-94be-ce9c40b43e5e service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:33.730542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c8fb1-6555-4869-94be-ce9c40b43e5e service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:33.730766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c8fb1-6555-4869-94be-ce9c40b43e5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:33.739173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c8fb1-6555-4869-94be-ce9c40b43e5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:33.740796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c8fb1-6555-4869-94be-ce9c40b43e5e service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:33.751799 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1292/2635] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:35.047126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ae423-68a1-41ed-ab95-5b7eb0f5af40 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:35.059833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ae423-68a1-41ed-ab95-5b7eb0f5af40 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:35.065208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:35.066439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:35.066720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:35.067054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] PATH_INFO: `/v3/users/8e677e10e3b0488fbb92e802a96eaf0d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:35.068285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e677e10e3b0488fbb92e802a96eaf0d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:35.070207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:35.116220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e677e10e3b0488fbb92e802a96eaf0d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.124777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e677e10e3b0488fbb92e802a96eaf0d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.125625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e677e10e3b0488fbb92e802a96eaf0d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.126444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e677e10e3b0488fbb92e802a96eaf0d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.136129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2b504f33-7fc7-4f24-8811-42d680f0956d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e677e10e3b0488fbb92e802a96eaf0d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.161236 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1344/2636] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:35 2022] DELETE /identity/v3/users/8e677e10e3b0488fbb92e802a96eaf0d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:35.381408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c8fb1-6555-4869-94be-ce9c40b43e5e service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:35.403454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c8fb1-6555-4869-94be-ce9c40b43e5e service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:35.479992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:35.480967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:35.481345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:35.481714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] PATH_INFO: `/v3/projects/9b09e96f559e4f2c9918ac9e12e4dd1b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:35.483097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b09e96f559e4f2c9918ac9e12e4dd1b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:35.485256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:35.552141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b09e96f559e4f2c9918ac9e12e4dd1b', 'request_id': 'req-2735d94c-5281-46be-80f9-afc4fc18d3b5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.563727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b09e96f559e4f2c9918ac9e12e4dd1b', 'request_id': 'req-2735d94c-5281-46be-80f9-afc4fc18d3b5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.571679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b09e96f559e4f2c9918ac9e12e4dd1b', 'request_id': 'req-2735d94c-5281-46be-80f9-afc4fc18d3b5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.588877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] The token cache is being invalidate because project 9b09e96f559e4f2c9918ac9e12e4dd1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:35.589168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.590237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2735d94c-5281-46be-80f9-afc4fc18d3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:35.592001 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1293/2637] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:35 2022] DELETE /identity/v3/projects/9b09e96f559e4f2c9918ac9e12e4dd1b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:35.597036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430696c-0777-4213-96d2-022ed898cc88 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:35.597498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430696c-0777-4213-96d2-022ed898cc88 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:35.597933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430696c-0777-4213-96d2-022ed898cc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:35.619743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f430696c-0777-4213-96d2-022ed898cc88 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:35.624123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f430696c-0777-4213-96d2-022ed898cc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:35.716603 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1345/2638] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:35.724683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1a104-1cc1-462c-9083-ffa64da77703 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:35.725181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1a104-1cc1-462c-9083-ffa64da77703 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:35.725636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1a104-1cc1-462c-9083-ffa64da77703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:35.747344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8db1a104-1cc1-462c-9083-ffa64da77703 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:35.749556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8db1a104-1cc1-462c-9083-ffa64da77703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:35.761418 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1294/2639] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:35.765472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430696c-0777-4213-96d2-022ed898cc88 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:35.775894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f430696c-0777-4213-96d2-022ed898cc88 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:35.780806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f69bf-70f6-45c8-8e53-ee961d9ee96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:35.782757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f69bf-70f6-45c8-8e53-ee961d9ee96a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:35.783248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f69bf-70f6-45c8-8e53-ee961d9ee96a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:35.783708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f69bf-70f6-45c8-8e53-ee961d9ee96a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:35.784916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f69bf-70f6-45c8-8e53-ee961d9ee96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:51:35.785636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f69bf-70f6-45c8-8e53-ee961d9ee96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:35.787625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f69bf-70f6-45c8-8e53-ee961d9ee96a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:35.802267 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1346/2640] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:51:35.807089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1a104-1cc1-462c-9083-ffa64da77703 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:35.818892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1a104-1cc1-462c-9083-ffa64da77703 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:35.825091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd23b8-9718-4bfc-a2ea-adc9e3c7b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:35.825752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd23b8-9718-4bfc-a2ea-adc9e3c7b9ad admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:35.826036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd23b8-9718-4bfc-a2ea-adc9e3c7b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:35.826295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd23b8-9718-4bfc-a2ea-adc9e3c7b9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:35.827048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd23b8-9718-4bfc-a2ea-adc9e3c7b9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:35.829132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd23b8-9718-4bfc-a2ea-adc9e3c7b9ad admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:35.868080 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1295/2641] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:35 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:35.873056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f69bf-70f6-45c8-8e53-ee961d9ee96a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:35.887003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f69bf-70f6-45c8-8e53-ee961d9ee96a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:35.985562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4ee74-3881-4e62-b0cb-2d61036faa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:35.987179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ee74-3881-4e62-b0cb-2d61036faa62 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:35.988448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ee74-3881-4e62-b0cb-2d61036faa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:35.989037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4ee74-3881-4e62-b0cb-2d61036faa62 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:35.990034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4ee74-3881-4e62-b0cb-2d61036faa62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:35.992278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b4ee74-3881-4e62-b0cb-2d61036faa62 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:36.052881 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1347/2642] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:35 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:36.057136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd23b8-9718-4bfc-a2ea-adc9e3c7b9ad admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:36.072861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd23b8-9718-4bfc-a2ea-adc9e3c7b9ad admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:36.083752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472f452-d255-4fa7-9567-d9d4a0bf12fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:36.084463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472f452-d255-4fa7-9567-d9d4a0bf12fb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:36.084750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472f452-d255-4fa7-9567-d9d4a0bf12fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:36.085028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472f452-d255-4fa7-9567-d9d4a0bf12fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:36.085770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472f452-d255-4fa7-9567-d9d4a0bf12fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:36.087389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472f452-d255-4fa7-9567-d9d4a0bf12fb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:36.102482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4ee74-3881-4e62-b0cb-2d61036faa62 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:36.107429 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1296/2643] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:36.112741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4ee74-3881-4e62-b0cb-2d61036faa62 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:36.117531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526553d-1879-4909-ae4b-7d88d64656a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:36.118393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526553d-1879-4909-ae4b-7d88d64656a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:36.118668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526553d-1879-4909-ae4b-7d88d64656a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:36.118942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526553d-1879-4909-ae4b-7d88d64656a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:36.119663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526553d-1879-4909-ae4b-7d88d64656a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:36.121311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526553d-1879-4909-ae4b-7d88d64656a3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:36.137299 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1348/2644] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:36.141981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472f452-d255-4fa7-9567-d9d4a0bf12fb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:36.152660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472f452-d255-4fa7-9567-d9d4a0bf12fb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:36.158663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383262-a0c1-4f1b-a816-38262f46beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:36.159723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383262-a0c1-4f1b-a816-38262f46beb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:36.160259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383262-a0c1-4f1b-a816-38262f46beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:36.160636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43383262-a0c1-4f1b-a816-38262f46beb4 admin admin] PATH_INFO: `/v3/projects/473aa792ab1045a9bc717a9a66f15afd/users/b5effd8428df4616865ee71160f53594/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:36.182670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383262-a0c1-4f1b-a816-38262f46beb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473aa792ab1045a9bc717a9a66f15afd, user_id=b5effd8428df4616865ee71160f53594, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:36.184945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43383262-a0c1-4f1b-a816-38262f46beb4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:36.199888 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1297/2645] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:36 2022] PUT /identity/v3/projects/473aa792ab1045a9bc717a9a66f15afd/users/b5effd8428df4616865ee71160f53594/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:36.205813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747838-4f53-4a5c-bab2-bfb5198b9995 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:36.206209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747838-4f53-4a5c-bab2-bfb5198b9995 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:36.206456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a747838-4f53-4a5c-bab2-bfb5198b9995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:36.230459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6a747838-4f53-4a5c-bab2-bfb5198b9995 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:36.231666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6a747838-4f53-4a5c-bab2-bfb5198b9995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:36.314032 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1349/2646] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:36.325487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383262-a0c1-4f1b-a816-38262f46beb4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:36.328018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-43383262-a0c1-4f1b-a816-38262f46beb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:36.403788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43383262-a0c1-4f1b-a816-38262f46beb4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:36.408770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920782a-d10d-4ca1-ae79-7f217e26153c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:36.409559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920782a-d10d-4ca1-ae79-7f217e26153c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:36.409942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920782a-d10d-4ca1-ae79-7f217e26153c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:36.410307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920782a-d10d-4ca1-ae79-7f217e26153c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:36.420993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920782a-d10d-4ca1-ae79-7f217e26153c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:36.422569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920782a-d10d-4ca1-ae79-7f217e26153c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:36.434590 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1298/2647] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:36.836231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161c303-0207-4696-a646-8ddac1d13077 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:36.839482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161c303-0207-4696-a646-8ddac1d13077 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:36.840120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161c303-0207-4696-a646-8ddac1d13077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:36.861730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d161c303-0207-4696-a646-8ddac1d13077 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:36.863180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d161c303-0207-4696-a646-8ddac1d13077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:36.938997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1350/2648] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:51:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:51:36.957413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920782a-d10d-4ca1-ae79-7f217e26153c service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:36.958821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9920782a-d10d-4ca1-ae79-7f217e26153c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:37.066281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920782a-d10d-4ca1-ae79-7f217e26153c service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:37.068596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4097341-8c55-4f03-a4ab-4804dcff4551 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.069376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4097341-8c55-4f03-a4ab-4804dcff4551 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.069837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4097341-8c55-4f03-a4ab-4804dcff4551 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.072314 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1351/2649] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:51:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:51:37.082240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf218-5317-4a9b-91ae-6fcd290b69ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:37.083668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf218-5317-4a9b-91ae-6fcd290b69ec service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.084350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf218-5317-4a9b-91ae-6fcd290b69ec service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.084942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cf218-5317-4a9b-91ae-6fcd290b69ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.089087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44c53-0e1d-42f9-9c01-de48b5cc2e5d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.089595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44c53-0e1d-42f9-9c01-de48b5cc2e5d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.090178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e44c53-0e1d-42f9-9c01-de48b5cc2e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.121301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cf218-5317-4a9b-91ae-6fcd290b69ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:37.124701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e3e44c53-0e1d-42f9-9c01-de48b5cc2e5d None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:37.129188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e3e44c53-0e1d-42f9-9c01-de48b5cc2e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:37.140408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cf218-5317-4a9b-91ae-6fcd290b69ec service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:37.172707 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1299/2650] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:51:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:51:37.232311 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1352/2651] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:37.256070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf218-5317-4a9b-91ae-6fcd290b69ec service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:37.257774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b78cf218-5317-4a9b-91ae-6fcd290b69ec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:37.285217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cf218-5317-4a9b-91ae-6fcd290b69ec service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:37.293977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32cf21b-208e-482f-b379-8000a765728a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:37.294829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cf21b-208e-482f-b379-8000a765728a service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.295836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cf21b-208e-482f-b379-8000a765728a service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.296327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32cf21b-208e-482f-b379-8000a765728a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.314201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cf21b-208e-482f-b379-8000a765728a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:37.316106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32cf21b-208e-482f-b379-8000a765728a service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:37.328940 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1300/2652] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:37.415719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e44c53-0e1d-42f9-9c01-de48b5cc2e5d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:37.417198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e3e44c53-0e1d-42f9-9c01-de48b5cc2e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:37.431880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e44c53-0e1d-42f9-9c01-de48b5cc2e5d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:37.438200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:37.439169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.439526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.440227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] PATH_INFO: `/v3/users/0520acbd176641c2b46226fa3febe61a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.441519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0520acbd176641c2b46226fa3febe61a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:37.443462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:37.518628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0520acbd176641c2b46226fa3febe61a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:37.527627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0520acbd176641c2b46226fa3febe61a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:37.528034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0520acbd176641c2b46226fa3febe61a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:37.530734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0520acbd176641c2b46226fa3febe61a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:37.550862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed66e362-af32-4708-bd48-f0c93a31c99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0520acbd176641c2b46226fa3febe61a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:37.554773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf781-cdb8-43ca-ab62-88d399aae7be None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.556193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf781-cdb8-43ca-ab62-88d399aae7be None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.556494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bf781-cdb8-43ca-ab62-88d399aae7be None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.561443 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1301/2653] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:51:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:51:37.567836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da659c-e458-4ffd-8b00-5a855eb288fb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.568168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da659c-e458-4ffd-8b00-5a855eb288fb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.568421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da659c-e458-4ffd-8b00-5a855eb288fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.594289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-72da659c-e458-4ffd-8b00-5a855eb288fb None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:37.595851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-72da659c-e458-4ffd-8b00-5a855eb288fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:37.610369 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1353/2654] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:37 2022] DELETE /identity/v3/users/0520acbd176641c2b46226fa3febe61a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:37.612300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2015e0-21b4-4e9b-90bf-905c947fa374 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.612595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2015e0-21b4-4e9b-90bf-905c947fa374 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.613232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2015e0-21b4-4e9b-90bf-905c947fa374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.652906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9a2015e0-21b4-4e9b-90bf-905c947fa374 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:37.657377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9a2015e0-21b4-4e9b-90bf-905c947fa374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:37.750092 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1302/2655] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:37.761627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cc919-1573-4138-b419-c71ff842dfd6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.762147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cc919-1573-4138-b419-c71ff842dfd6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.762596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cc919-1573-4138-b419-c71ff842dfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.767515 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1354/2656] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:51:37.788179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2015e0-21b4-4e9b-90bf-905c947fa374 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:37.789779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9a2015e0-21b4-4e9b-90bf-905c947fa374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:37.805229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8b4cc919-1573-4138-b419-c71ff842dfd6 None None] MFA Rules not processed for user `b5effd8428df4616865ee71160f53594`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:37.806979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8b4cc919-1573-4138-b419-c71ff842dfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:37.898300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2015e0-21b4-4e9b-90bf-905c947fa374 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:37.900604 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1303/2657] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:37.901924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cc919-1573-4138-b419-c71ff842dfd6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:37.904720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4dd342-5fb4-4d05-a740-a78253e0c8a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:37.905533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dd342-5fb4-4d05-a740-a78253e0c8a8 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.905958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dd342-5fb4-4d05-a740-a78253e0c8a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.906244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dd342-5fb4-4d05-a740-a78253e0c8a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.920844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cc919-1573-4138-b419-c71ff842dfd6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:37.925499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f0731-8bb6-48cd-a58a-526d8f3e7a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:37.926360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0731-8bb6-48cd-a58a-526d8f3e7a18 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.926906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0731-8bb6-48cd-a58a-526d8f3e7a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.927285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0731-8bb6-48cd-a58a-526d8f3e7a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:37.943002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f0731-8bb6-48cd-a58a-526d8f3e7a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:37.944807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f0731-8bb6-48cd-a58a-526d8f3e7a18 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:37.960597 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1304/2658] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:37.973512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e61f7-49e4-4477-abcf-2f8d57dfa3df None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:37.973960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e61f7-49e4-4477-abcf-2f8d57dfa3df None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:37.975535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e61f7-49e4-4477-abcf-2f8d57dfa3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:38.038898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b57e61f7-49e4-4477-abcf-2f8d57dfa3df None None] MFA Rules not processed for user `b5effd8428df4616865ee71160f53594`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:38.040432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b57e61f7-49e4-4477-abcf-2f8d57dfa3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:38.051666 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1305/2659] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:51:38.064088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e61f7-49e4-4477-abcf-2f8d57dfa3df None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:38.065488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b57e61f7-49e4-4477-abcf-2f8d57dfa3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:38.069335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4dd342-5fb4-4d05-a740-a78253e0c8a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:38.069817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4dd342-5fb4-4d05-a740-a78253e0c8a8 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:38.082115 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1355/2660] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:38.091449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e61f7-49e4-4477-abcf-2f8d57dfa3df None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:38.101646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869297b-922b-4ce0-a056-c3d642cf76b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:38.102409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869297b-922b-4ce0-a056-c3d642cf76b8 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:38.102696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869297b-922b-4ce0-a056-c3d642cf76b8 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:38.102976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869297b-922b-4ce0-a056-c3d642cf76b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:38.112599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869297b-922b-4ce0-a056-c3d642cf76b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:38.114218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869297b-922b-4ce0-a056-c3d642cf76b8 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:38.128564 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1306/2661] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:38.684370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4dd342-5fb4-4d05-a740-a78253e0c8a8 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:38.687135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0b4dd342-5fb4-4d05-a740-a78253e0c8a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:38.722092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4dd342-5fb4-4d05-a740-a78253e0c8a8 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:38.727644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:38.728771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:38.729126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:38.729834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] PATH_INFO: `/v3/projects/299001bd661045f59e40ea0fac0af324` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:38.754489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] RBAC: Authorizing `identity:delete_project(project_id=299001bd661045f59e40ea0fac0af324)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:38.758644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:38.836647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299001bd661045f59e40ea0fac0af324', 'request_id': 'req-c2600051-04e6-4ad8-8089-60cc15eb526c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:38.847457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299001bd661045f59e40ea0fac0af324', 'request_id': 'req-c2600051-04e6-4ad8-8089-60cc15eb526c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:38.854793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299001bd661045f59e40ea0fac0af324', 'request_id': 'req-c2600051-04e6-4ad8-8089-60cc15eb526c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:38.867451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] The token cache is being invalidate because project 299001bd661045f59e40ea0fac0af324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:38.867831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:38.868600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2600051-04e6-4ad8-8089-60cc15eb526c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:38.870347 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1356/2662] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:38 2022] DELETE /identity/v3/projects/299001bd661045f59e40ea0fac0af324 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:38.877900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3cd6-5572-45a9-9b29-17538f0fdfbc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:38.878805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3cd6-5572-45a9-9b29-17538f0fdfbc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:38.879369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e3cd6-5572-45a9-9b29-17538f0fdfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:38.903781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-715e3cd6-5572-45a9-9b29-17538f0fdfbc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:38.905671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-715e3cd6-5572-45a9-9b29-17538f0fdfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:38.974843 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1307/2663] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:39.046186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b56a-4466-4316-8f21-3a3c4c16d574 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:39.046884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b56a-4466-4316-8f21-3a3c4c16d574 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:39.047174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4b56a-4466-4316-8f21-3a3c4c16d574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:39.073116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f6d4b56a-4466-4316-8f21-3a3c4c16d574 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:39.075411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f6d4b56a-4466-4316-8f21-3a3c4c16d574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:39.093338 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1357/2664] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:39.097589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3cd6-5572-45a9-9b29-17538f0fdfbc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:39.110562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e3cd6-5572-45a9-9b29-17538f0fdfbc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:39.128857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c13301-a805-48cf-9b45-3864b2b336ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:39.134959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c13301-a805-48cf-9b45-3864b2b336ca admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:39.135340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c13301-a805-48cf-9b45-3864b2b336ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:39.135739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c13301-a805-48cf-9b45-3864b2b336ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:39.136764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c13301-a805-48cf-9b45-3864b2b336ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:51:39.137142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c13301-a805-48cf-9b45-3864b2b336ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:39.139976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c13301-a805-48cf-9b45-3864b2b336ca admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:39.161966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1308/2665] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:51:39.166858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4b56a-4466-4316-8f21-3a3c4c16d574 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:39.190754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4b56a-4466-4316-8f21-3a3c4c16d574 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:39.215659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a566d90-cbb6-403c-801e-a25cbffbfd33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:39.220165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a566d90-cbb6-403c-801e-a25cbffbfd33 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:39.220817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a566d90-cbb6-403c-801e-a25cbffbfd33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:39.222817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a566d90-cbb6-403c-801e-a25cbffbfd33 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:39.223878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a566d90-cbb6-403c-801e-a25cbffbfd33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:39.227125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a566d90-cbb6-403c-801e-a25cbffbfd33 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:39.300447 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1358/2666] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:39 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:39.305013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c13301-a805-48cf-9b45-3864b2b336ca admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:39.317016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c13301-a805-48cf-9b45-3864b2b336ca admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:39.400340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6fa2-7ca3-45c7-9e36-5950b5c51542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:39.401278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6fa2-7ca3-45c7-9e36-5950b5c51542 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:39.401826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6fa2-7ca3-45c7-9e36-5950b5c51542 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:39.402277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6fa2-7ca3-45c7-9e36-5950b5c51542 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:39.403469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6fa2-7ca3-45c7-9e36-5950b5c51542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:39.407190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6fa2-7ca3-45c7-9e36-5950b5c51542 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:39.432280 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1309/2667] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:39 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:39.436139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a566d90-cbb6-403c-801e-a25cbffbfd33 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:39.447394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a566d90-cbb6-403c-801e-a25cbffbfd33 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:39.453834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a050cba-05d4-431a-96a9-403eb601c3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:39.454289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a050cba-05d4-431a-96a9-403eb601c3ff admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:39.454579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a050cba-05d4-431a-96a9-403eb601c3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:39.454865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a050cba-05d4-431a-96a9-403eb601c3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:39.455721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a050cba-05d4-431a-96a9-403eb601c3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:39.457480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a050cba-05d4-431a-96a9-403eb601c3ff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:39.470834 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1359/2668] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:39.475075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6fa2-7ca3-45c7-9e36-5950b5c51542 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:39.488041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6fa2-7ca3-45c7-9e36-5950b5c51542 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:39.493379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74ede2-3194-4ef9-bd99-0d63c8cc1b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:39.494107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74ede2-3194-4ef9-bd99-0d63c8cc1b92 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:39.494410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74ede2-3194-4ef9-bd99-0d63c8cc1b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:39.494696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74ede2-3194-4ef9-bd99-0d63c8cc1b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:39.497120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74ede2-3194-4ef9-bd99-0d63c8cc1b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:39.499368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74ede2-3194-4ef9-bd99-0d63c8cc1b92 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:39.512300 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1310/2669] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:39.517478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a050cba-05d4-431a-96a9-403eb601c3ff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:39.531014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a050cba-05d4-431a-96a9-403eb601c3ff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:39.536671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0374cc-ec59-4ffa-bffe-d2229f27f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:39.538236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0374cc-ec59-4ffa-bffe-d2229f27f8df admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:39.538704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0374cc-ec59-4ffa-bffe-d2229f27f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:39.539071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0374cc-ec59-4ffa-bffe-d2229f27f8df admin admin] PATH_INFO: `/v3/projects/2aa3ac21589f496b83c20104323f4bb2/users/b188ca4deda94cec85da4582a37fea72/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:39.559703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0374cc-ec59-4ffa-bffe-d2229f27f8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa3ac21589f496b83c20104323f4bb2, user_id=b188ca4deda94cec85da4582a37fea72, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:39.562805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0374cc-ec59-4ffa-bffe-d2229f27f8df admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:39.597073 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1360/2670] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:39 2022] PUT /identity/v3/projects/2aa3ac21589f496b83c20104323f4bb2/users/b188ca4deda94cec85da4582a37fea72/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:39.602520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76957bf-679b-4e3a-a8a7-80fcd840eb79 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:39.602948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76957bf-679b-4e3a-a8a7-80fcd840eb79 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:39.604991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76957bf-679b-4e3a-a8a7-80fcd840eb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:39.628327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d76957bf-679b-4e3a-a8a7-80fcd840eb79 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:39.629787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d76957bf-679b-4e3a-a8a7-80fcd840eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:39.746680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0374cc-ec59-4ffa-bffe-d2229f27f8df admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:39.748117 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1311/2671] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:39.749243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8e0374cc-ec59-4ffa-bffe-d2229f27f8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:39.904860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0374cc-ec59-4ffa-bffe-d2229f27f8df admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:39.912264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a3b6-2123-4df3-921a-4782d37a780f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:39.912931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a3b6-2123-4df3-921a-4782d37a780f service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:39.913216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a3b6-2123-4df3-921a-4782d37a780f service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:39.913495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a3b6-2123-4df3-921a-4782d37a780f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:39.927693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465a3b6-2123-4df3-921a-4782d37a780f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:39.929511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465a3b6-2123-4df3-921a-4782d37a780f service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:39.941963 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1361/2672] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:41.187252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bccb0-d86a-4f8b-83d4-f4f19bdab04a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:41.193558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bccb0-d86a-4f8b-83d4-f4f19bdab04a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:41.194064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bccb0-d86a-4f8b-83d4-f4f19bdab04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:41.250565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ef7bccb0-d86a-4f8b-83d4-f4f19bdab04a None None] MFA Rules not processed for user `b188ca4deda94cec85da4582a37fea72`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:41.253093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ef7bccb0-d86a-4f8b-83d4-f4f19bdab04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:41.374540 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1312/2673] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:41.387727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5a131-a146-4364-b51a-ea08e8270c86 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:41.388309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5a131-a146-4364-b51a-ea08e8270c86 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:41.388424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5a131-a146-4364-b51a-ea08e8270c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:41.425902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2cf5a131-a146-4364-b51a-ea08e8270c86 None None] MFA Rules not processed for user `b188ca4deda94cec85da4582a37fea72`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:41.427437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2cf5a131-a146-4364-b51a-ea08e8270c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:41.437679 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1362/2674] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:41.540800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bccb0-d86a-4f8b-83d4-f4f19bdab04a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:41.542278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ef7bccb0-d86a-4f8b-83d4-f4f19bdab04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:41.629629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bccb0-d86a-4f8b-83d4-f4f19bdab04a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:41.635334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1358ea-81d1-462b-bb38-26d8179d01aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:41.636020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1358ea-81d1-462b-bb38-26d8179d01aa service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:41.636311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1358ea-81d1-462b-bb38-26d8179d01aa service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:41.636595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1358ea-81d1-462b-bb38-26d8179d01aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:41.646487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1358ea-81d1-462b-bb38-26d8179d01aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:41.648135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1358ea-81d1-462b-bb38-26d8179d01aa service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:41.659006 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1313/2675] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:44.864290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4285e-1c59-411a-8ca8-70efa2833917 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:44.865149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4285e-1c59-411a-8ca8-70efa2833917 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:44.865583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4285e-1c59-411a-8ca8-70efa2833917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:44.891780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0fb4285e-1c59-411a-8ca8-70efa2833917 None None] MFA Rules not processed for user `2bcd816c4f3a495cbe7ce636cf0e2f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:44.893280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0fb4285e-1c59-411a-8ca8-70efa2833917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:44.980236 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1363/2676] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:49.256564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1358ea-81d1-462b-bb38-26d8179d01aa service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:49.259604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0b1358ea-81d1-462b-bb38-26d8179d01aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:49.426507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1358ea-81d1-462b-bb38-26d8179d01aa service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:49.452434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:49.454022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:49.454498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:49.455182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:49.462501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:49.505659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:49.507299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:49.547044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1314/2677] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:54.943567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4285e-1c59-411a-8ca8-70efa2833917 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:54.958554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4285e-1c59-411a-8ca8-70efa2833917 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:54.965779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b89f5-5e8b-4fe1-b6ed-10c590e7da24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:54.966795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b89f5-5e8b-4fe1-b6ed-10c590e7da24 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:54.967313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b89f5-5e8b-4fe1-b6ed-10c590e7da24 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:54.967793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b89f5-5e8b-4fe1-b6ed-10c590e7da24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:54.973062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-068b89f5-5e8b-4fe1-b6ed-10c590e7da24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:54.992938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b89f5-5e8b-4fe1-b6ed-10c590e7da24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:54.994788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b89f5-5e8b-4fe1-b6ed-10c590e7da24 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:55.012834 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1364/2678] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:55.015507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:55.017284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:55.035510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb7639-e80c-4381-bbfd-3524696db40b service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:55.043600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:55.043834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:55.044236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:55.045035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] PATH_INFO: `/v3/users/35af62292f65400bb9626ea4e897fbd6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:55.046571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35af62292f65400bb9626ea4e897fbd6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:55.048786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:55.115070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35af62292f65400bb9626ea4e897fbd6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.126859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35af62292f65400bb9626ea4e897fbd6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.127844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35af62292f65400bb9626ea4e897fbd6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.130562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35af62292f65400bb9626ea4e897fbd6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.147662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35af62292f65400bb9626ea4e897fbd6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.171127 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1315/2679] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:55 2022] DELETE /identity/v3/users/35af62292f65400bb9626ea4e897fbd6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:55.175514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed468746-80ae-4209-950e-8b2797178823 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:55.175887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed468746-80ae-4209-950e-8b2797178823 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:55.176418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed468746-80ae-4209-950e-8b2797178823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:55.197775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ed468746-80ae-4209-950e-8b2797178823 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:55.199384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ed468746-80ae-4209-950e-8b2797178823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:55.270870 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1365/2680] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:55.280115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:55.281620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:55.341085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8705a-ac0b-4e77-829a-992514d81fb5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:55.345425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c253f10-d0e0-4090-a83b-00afebe6aa86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:55.346073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c253f10-d0e0-4090-a83b-00afebe6aa86 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:55.346357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c253f10-d0e0-4090-a83b-00afebe6aa86 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:55.346637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c253f10-d0e0-4090-a83b-00afebe6aa86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:55.359372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c253f10-d0e0-4090-a83b-00afebe6aa86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:55.361150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c253f10-d0e0-4090-a83b-00afebe6aa86 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:55.371909 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1316/2681] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:55.604718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed468746-80ae-4209-950e-8b2797178823 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:55.606341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ed468746-80ae-4209-950e-8b2797178823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:55.633994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed468746-80ae-4209-950e-8b2797178823 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:55.655785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:55.656960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:55.657249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:55.657497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] PATH_INFO: `/v3/projects/9695bc9bf47e4da7bd4c4636a4900f72` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:55.659167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9695bc9bf47e4da7bd4c4636a4900f72)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:55.661153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:55.743453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9695bc9bf47e4da7bd4c4636a4900f72', 'request_id': 'req-c297aed1-3508-4ab2-a90f-897afc8b991e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.758015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9695bc9bf47e4da7bd4c4636a4900f72', 'request_id': 'req-c297aed1-3508-4ab2-a90f-897afc8b991e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.770668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9695bc9bf47e4da7bd4c4636a4900f72', 'request_id': 'req-c297aed1-3508-4ab2-a90f-897afc8b991e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.803194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] The token cache is being invalidate because project 9695bc9bf47e4da7bd4c4636a4900f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:55.803572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.805612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c297aed1-3508-4ab2-a90f-897afc8b991e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:55.812471 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1366/2682] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:55 2022] DELETE /identity/v3/projects/9695bc9bf47e4da7bd4c4636a4900f72 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:55.813160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c253f10-d0e0-4090-a83b-00afebe6aa86 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:55.830770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c253f10-d0e0-4090-a83b-00afebe6aa86 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:55.902312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76ec3-1026-44a9-a7c4-5eed13e1662a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:55.908920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76ec3-1026-44a9-a7c4-5eed13e1662a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:55.909943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76ec3-1026-44a9-a7c4-5eed13e1662a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:55.944920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:55.945909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:55.946214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:55.946467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] PATH_INFO: `/v3/users/60fcdbe869484a3885af345b9c06f54a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:55.948240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] RBAC: Authorizing `identity:delete_user(user_id=60fcdbe869484a3885af345b9c06f54a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:55.950044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bec76ec3-1026-44a9-a7c4-5eed13e1662a None None] MFA Rules not processed for user `b188ca4deda94cec85da4582a37fea72`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:55.950590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:55.956004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bec76ec3-1026-44a9-a7c4-5eed13e1662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:56.036644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60fcdbe869484a3885af345b9c06f54a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.045330 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1367/2683] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:56.046615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec76ec3-1026-44a9-a7c4-5eed13e1662a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:56.048462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bec76ec3-1026-44a9-a7c4-5eed13e1662a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:56.057298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60fcdbe869484a3885af345b9c06f54a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.057951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60fcdbe869484a3885af345b9c06f54a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.059266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60fcdbe869484a3885af345b9c06f54a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.066117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec76ec3-1026-44a9-a7c4-5eed13e1662a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:56.070920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:56.071855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:56.072178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:56.072456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] PATH_INFO: `/v3/users/0d404d270f3a41c9bb725f0ea552c76c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:56.074163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d404d270f3a41c9bb725f0ea552c76c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:56.076331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:56.114948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d82fa6c7-f960-4b62-9ad0-0e8d5a33d28a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60fcdbe869484a3885af345b9c06f54a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.145412 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1317/2684] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:55 2022] DELETE /identity/v3/users/60fcdbe869484a3885af345b9c06f54a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:51:56.169864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d404d270f3a41c9bb725f0ea552c76c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.181257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d404d270f3a41c9bb725f0ea552c76c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.182867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d404d270f3a41c9bb725f0ea552c76c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.184085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d404d270f3a41c9bb725f0ea552c76c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.201776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c2d2-79ee-467b-80b1-9a12e8745cc0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:56.202405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c2d2-79ee-467b-80b1-9a12e8745cc0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:56.203009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c2d2-79ee-467b-80b1-9a12e8745cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:56.222793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e816504e-94e8-49c6-911a-38d5f86577db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d404d270f3a41c9bb725f0ea552c76c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.237935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f392c2d2-79ee-467b-80b1-9a12e8745cc0 None None] MFA Rules not processed for user `f730effcbf03473fbdb527fa499ec181`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:56.240295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f392c2d2-79ee-467b-80b1-9a12e8745cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:56.250456 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1368/2685] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:56 2022] DELETE /identity/v3/users/0d404d270f3a41c9bb725f0ea552c76c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:56.254928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527517d-a6a7-4808-9d6a-55f264ff3e4d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:56.255225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527517d-a6a7-4808-9d6a-55f264ff3e4d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:56.255506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527517d-a6a7-4808-9d6a-55f264ff3e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:56.328292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c527517d-a6a7-4808-9d6a-55f264ff3e4d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:56.336038 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1318/2686] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:56.336660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c527517d-a6a7-4808-9d6a-55f264ff3e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:56.423260 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1369/2687] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:56.449971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c2d2-79ee-467b-80b1-9a12e8745cc0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:56.453137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f392c2d2-79ee-467b-80b1-9a12e8745cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:56.560676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c2d2-79ee-467b-80b1-9a12e8745cc0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:56.627672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaaaab7-2239-4173-9533-3f4edb29cd90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:56.629497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaaab7-2239-4173-9533-3f4edb29cd90 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:56.629791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaaab7-2239-4173-9533-3f4edb29cd90 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:56.630077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaaaab7-2239-4173-9533-3f4edb29cd90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:56.644849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaaab7-2239-4173-9533-3f4edb29cd90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:56.646282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaaaab7-2239-4173-9533-3f4edb29cd90 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:56.660365 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1319/2688] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:51:56.721125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527517d-a6a7-4808-9d6a-55f264ff3e4d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:56.723333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c527517d-a6a7-4808-9d6a-55f264ff3e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:56.741151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527517d-a6a7-4808-9d6a-55f264ff3e4d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:56.754244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:56.755105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:56.755386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:56.755821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] PATH_INFO: `/v3/projects/6e8b97f48c9c407ca0d3bbed488586cb` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:56.757724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8b97f48c9c407ca0d3bbed488586cb)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:56.763510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:56.848290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8b97f48c9c407ca0d3bbed488586cb', 'request_id': 'req-196d2f83-a1a6-4a13-aa16-976d998f1049'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.858660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8b97f48c9c407ca0d3bbed488586cb', 'request_id': 'req-196d2f83-a1a6-4a13-aa16-976d998f1049'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.868071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8b97f48c9c407ca0d3bbed488586cb', 'request_id': 'req-196d2f83-a1a6-4a13-aa16-976d998f1049'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.899085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] The token cache is being invalidate because project 6e8b97f48c9c407ca0d3bbed488586cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:56.900002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.904498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-196d2f83-a1a6-4a13-aa16-976d998f1049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:56.907232 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1370/2689] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:56 2022] DELETE /identity/v3/projects/6e8b97f48c9c407ca0d3bbed488586cb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:56.913428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1710c-41a3-4a6c-95c0-3430fed6f264 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:56.913715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1710c-41a3-4a6c-95c0-3430fed6f264 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:56.914074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1710c-41a3-4a6c-95c0-3430fed6f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:56.954217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-42a1710c-41a3-4a6c-95c0-3430fed6f264 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:56.955638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42a1710c-41a3-4a6c-95c0-3430fed6f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:57.064398 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1320/2690] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:57.072254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777edda-706c-443e-b7ee-82657efaf0a1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.072819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777edda-706c-443e-b7ee-82657efaf0a1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.072819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777edda-706c-443e-b7ee-82657efaf0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.101855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7777edda-706c-443e-b7ee-82657efaf0a1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:57.103075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7777edda-706c-443e-b7ee-82657efaf0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:57.120227 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1371/2691] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:57.121729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1710c-41a3-4a6c-95c0-3430fed6f264 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:57.137304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777edda-706c-443e-b7ee-82657efaf0a1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:57.140889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1710c-41a3-4a6c-95c0-3430fed6f264 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:57.143482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7777edda-706c-443e-b7ee-82657efaf0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:57.165575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043c75e-f75e-4040-8bee-8b233fc8b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:57.166616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c75e-f75e-4040-8bee-8b233fc8b22d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.166983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c75e-f75e-4040-8bee-8b233fc8b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.167270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043c75e-f75e-4040-8bee-8b233fc8b22d admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.168698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043c75e-f75e-4040-8bee-8b233fc8b22d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:51:57.169330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043c75e-f75e-4040-8bee-8b233fc8b22d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:57.171022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043c75e-f75e-4040-8bee-8b233fc8b22d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:57.185961 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1321/2692] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:51:57.186744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777edda-706c-443e-b7ee-82657efaf0a1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:57.191173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043c75e-f75e-4040-8bee-8b233fc8b22d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:57.204670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:57.207414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.210172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.211161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] PATH_INFO: `/v3/projects/54c513bf41bd4101914b82a4b39e4030` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.215805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54c513bf41bd4101914b82a4b39e4030)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:57.221626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:57.223389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043c75e-f75e-4040-8bee-8b233fc8b22d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:57.270615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19485633-0de3-455e-93fa-a2c533c652f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:57.271295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19485633-0de3-455e-93fa-a2c533c652f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.275134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19485633-0de3-455e-93fa-a2c533c652f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.275434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19485633-0de3-455e-93fa-a2c533c652f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.276195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19485633-0de3-455e-93fa-a2c533c652f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:57.280602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19485633-0de3-455e-93fa-a2c533c652f6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:57.354684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c513bf41bd4101914b82a4b39e4030', 'request_id': 'req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.373282 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1322/2693] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:57 2022] POST /identity/v3/projects => generated 395 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:57.374046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c513bf41bd4101914b82a4b39e4030', 'request_id': 'req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.375101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19485633-0de3-455e-93fa-a2c533c652f6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:57.380268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c513bf41bd4101914b82a4b39e4030', 'request_id': 'req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.403131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] The token cache is being invalidate because project 54c513bf41bd4101914b82a4b39e4030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:57.403459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.405054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.417653 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1372/2694] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:57 2022] DELETE /identity/v3/projects/54c513bf41bd4101914b82a4b39e4030 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:57.422555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:57.424013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:57.478470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19485633-0de3-455e-93fa-a2c533c652f6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:57.501668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29d48a-3dae-4192-a248-9e46f1972c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:57.503297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29d48a-3dae-4192-a248-9e46f1972c80 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.505204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29d48a-3dae-4192-a248-9e46f1972c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.505494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29d48a-3dae-4192-a248-9e46f1972c80 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.506267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29d48a-3dae-4192-a248-9e46f1972c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:57.508281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29d48a-3dae-4192-a248-9e46f1972c80 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:57.561503 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1323/2695] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:57 2022] POST /identity/v3/users => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:57.565948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29d48a-3dae-4192-a248-9e46f1972c80 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:57.566283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f0a3-5bd6-497f-b349-9f83f205a1e8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:57.568868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4a29d48a-3dae-4192-a248-9e46f1972c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:57.582225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:57.583443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.584738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.585294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] PATH_INFO: `/v3/users/a78b588860a949218668f7ef82a625d3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.588189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] RBAC: Authorizing `identity:delete_user(user_id=a78b588860a949218668f7ef82a625d3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:57.595138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:57.612202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29d48a-3dae-4192-a248-9e46f1972c80 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:57.643835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c526b9-4abf-465d-b229-d0d2ae1feb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:57.646176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c526b9-4abf-465d-b229-d0d2ae1feb27 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.649690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c526b9-4abf-465d-b229-d0d2ae1feb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.652148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c526b9-4abf-465d-b229-d0d2ae1feb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.653037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c526b9-4abf-465d-b229-d0d2ae1feb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:57.659793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c526b9-4abf-465d-b229-d0d2ae1feb27 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:57.691784 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1324/2696] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:57.693421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c526b9-4abf-465d-b229-d0d2ae1feb27 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:57.721222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c526b9-4abf-465d-b229-d0d2ae1feb27 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:57.727711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666488a5-5f57-4286-8496-43bb511578d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:57.728642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666488a5-5f57-4286-8496-43bb511578d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.729100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666488a5-5f57-4286-8496-43bb511578d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.729620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666488a5-5f57-4286-8496-43bb511578d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.731069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78b588860a949218668f7ef82a625d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.732364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666488a5-5f57-4286-8496-43bb511578d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:57.735220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666488a5-5f57-4286-8496-43bb511578d5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:57.743466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78b588860a949218668f7ef82a625d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.744272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78b588860a949218668f7ef82a625d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.745334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78b588860a949218668f7ef82a625d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.759522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9234fcb7-3a8c-4df5-8341-a32a3a7840de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78b588860a949218668f7ef82a625d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:57.762812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1325/2697] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:57.763858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666488a5-5f57-4286-8496-43bb511578d5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:57.772540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-666488a5-5f57-4286-8496-43bb511578d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:57.792471 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1373/2698] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:51:57 2022] DELETE /identity/v3/users/a78b588860a949218668f7ef82a625d3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:51:57.799830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666488a5-5f57-4286-8496-43bb511578d5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:57.924936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec7ab0-c4e8-420d-8c21-e9cc27f8a953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:57.925991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec7ab0-c4e8-420d-8c21-e9cc27f8a953 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.926500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec7ab0-c4e8-420d-8c21-e9cc27f8a953 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.926892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec7ab0-c4e8-420d-8c21-e9cc27f8a953 admin admin] PATH_INFO: `/v3/projects/fa6eaf7923064ac9837391c71a0d85a2/users/7f795eae56d941ffaa55d9cd8438bee7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.963663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb6a55-9d11-45d5-bb02-c40da9371be0 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.964344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb6a55-9d11-45d5-bb02-c40da9371be0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.964777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb6a55-9d11-45d5-bb02-c40da9371be0 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.968154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec7ab0-c4e8-420d-8c21-e9cc27f8a953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6eaf7923064ac9837391c71a0d85a2, user_id=7f795eae56d941ffaa55d9cd8438bee7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:57.968858 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1374/2699] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:51:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:51:57.971129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec7ab0-c4e8-420d-8c21-e9cc27f8a953 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:57.991720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7d6c7-ce60-4ce6-9b29-87b3e4b3d831 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:57.992287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7d6c7-ce60-4ce6-9b29-87b3e4b3d831 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:57.992758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7d6c7-ce60-4ce6-9b29-87b3e4b3d831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:57.993934 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1326/2700] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:57 2022] PUT /identity/v3/projects/fa6eaf7923064ac9837391c71a0d85a2/users/7f795eae56d941ffaa55d9cd8438bee7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:58.016900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335daf4-2884-4214-8caa-f66ff8cee9bc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:58.017169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335daf4-2884-4214-8caa-f66ff8cee9bc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:58.017449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335daf4-2884-4214-8caa-f66ff8cee9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:58.055413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4335daf4-2884-4214-8caa-f66ff8cee9bc None None] MFA Rules not processed for user `7f795eae56d941ffaa55d9cd8438bee7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:58.057824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4335daf4-2884-4214-8caa-f66ff8cee9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:58.076355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-16d7d6c7-ce60-4ce6-9b29-87b3e4b3d831 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:58.081137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-16d7d6c7-ce60-4ce6-9b29-87b3e4b3d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:58.187660 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1327/2701] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:51:58.195737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335daf4-2884-4214-8caa-f66ff8cee9bc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:58.238400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1375/2702] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:51:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:51:58.269861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7d6c7-ce60-4ce6-9b29-87b3e4b3d831 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:58.273066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-16d7d6c7-ce60-4ce6-9b29-87b3e4b3d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:58.298438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7d6c7-ce60-4ce6-9b29-87b3e4b3d831 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:58.308223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335daf4-2884-4214-8caa-f66ff8cee9bc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:58.315349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191776ee-55c9-40fc-8024-6f91b67fb874 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:58.316036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9882e-318d-4f52-a40f-7b397829afcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:58.316884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9882e-318d-4f52-a40f-7b397829afcc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:58.317249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9882e-318d-4f52-a40f-7b397829afcc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:58.317598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9882e-318d-4f52-a40f-7b397829afcc admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:58.317854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191776ee-55c9-40fc-8024-6f91b67fb874 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:58.318908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191776ee-55c9-40fc-8024-6f91b67fb874 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:58.319096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9882e-318d-4f52-a40f-7b397829afcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:58.319481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191776ee-55c9-40fc-8024-6f91b67fb874 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:58.321262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9882e-318d-4f52-a40f-7b397829afcc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:58.352844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191776ee-55c9-40fc-8024-6f91b67fb874 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:58.358047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191776ee-55c9-40fc-8024-6f91b67fb874 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:58.401330 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1328/2703] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:58 2022] POST /identity/v3/projects => generated 393 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:58.402797 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1376/2704] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:51:58.404430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9882e-318d-4f52-a40f-7b397829afcc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:58.505600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191776ee-55c9-40fc-8024-6f91b67fb874 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:58.508507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-191776ee-55c9-40fc-8024-6f91b67fb874 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:58.553903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191776ee-55c9-40fc-8024-6f91b67fb874 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:58.560657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9882e-318d-4f52-a40f-7b397829afcc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:58.574335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:58.580878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:58.581179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:58.582555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34783b63-5228-47ea-bbd0-f56dbb478a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:58.583252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34783b63-5228-47ea-bbd0-f56dbb478a95 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:58.583540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34783b63-5228-47ea-bbd0-f56dbb478a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:58.584929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34783b63-5228-47ea-bbd0-f56dbb478a95 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:58.585651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34783b63-5228-47ea-bbd0-f56dbb478a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:58.587682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34783b63-5228-47ea-bbd0-f56dbb478a95 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:58.589564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] PATH_INFO: `/v3/projects/5f9568ff04cd433681d4880791b17641` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:58.592728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9568ff04cd433681d4880791b17641)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:58.602723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:58.660062 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1329/2705] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:58 2022] POST /identity/v3/users => generated 303 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:58.664824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34783b63-5228-47ea-bbd0-f56dbb478a95 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:58.692579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34783b63-5228-47ea-bbd0-f56dbb478a95 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:58.709472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa7477-5ab3-4f88-86d9-4ed928fc05ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:58.710153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa7477-5ab3-4f88-86d9-4ed928fc05ae admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:58.710445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa7477-5ab3-4f88-86d9-4ed928fc05ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:58.710722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa7477-5ab3-4f88-86d9-4ed928fc05ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:58.712648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa7477-5ab3-4f88-86d9-4ed928fc05ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:58.714387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa7477-5ab3-4f88-86d9-4ed928fc05ae admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:58.729459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9568ff04cd433681d4880791b17641', 'request_id': 'req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:58.732985 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1330/2706] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:58.740911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa7477-5ab3-4f88-86d9-4ed928fc05ae admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:58.744172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9568ff04cd433681d4880791b17641', 'request_id': 'req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:58.754765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9568ff04cd433681d4880791b17641', 'request_id': 'req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:58.757906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa7477-5ab3-4f88-86d9-4ed928fc05ae admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:58.775228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] The token cache is being invalidate because project 5f9568ff04cd433681d4880791b17641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:51:58.776108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:58.777193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9314b3b1-7bdc-4247-81ec-d650abf1ccd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:51:58.779700 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1377/2707] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:51:58 2022] DELETE /identity/v3/projects/5f9568ff04cd433681d4880791b17641 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:58.786215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f9a78-f89f-4ead-b9ac-1b4cf99202fd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:58.786413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f9a78-f89f-4ead-b9ac-1b4cf99202fd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:58.786929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f9a78-f89f-4ead-b9ac-1b4cf99202fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:58.850066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c1ff9-8c42-44bb-b2a6-ddb51272ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:58.852461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c1ff9-8c42-44bb-b2a6-ddb51272ad75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:58.854042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c1ff9-8c42-44bb-b2a6-ddb51272ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:58.854657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c1ff9-8c42-44bb-b2a6-ddb51272ad75 admin admin] PATH_INFO: `/v3/projects/13d4506ff7e64918a538cfc3e9b00429/users/34ec31e6dbb84139b523fe7a5bd86d9b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:58.857581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b87f9a78-f89f-4ead-b9ac-1b4cf99202fd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:58.868845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b87f9a78-f89f-4ead-b9ac-1b4cf99202fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:58.894878 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1378/2708] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:58.895881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c1ff9-8c42-44bb-b2a6-ddb51272ad75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d4506ff7e64918a538cfc3e9b00429, user_id=34ec31e6dbb84139b523fe7a5bd86d9b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:58.896767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ecabd-778b-4b24-aa1d-5684796d68c6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:58.897055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ecabd-778b-4b24-aa1d-5684796d68c6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:58.897624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847ecabd-778b-4b24-aa1d-5684796d68c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:58.899039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c1ff9-8c42-44bb-b2a6-ddb51272ad75 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:58.926309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-847ecabd-778b-4b24-aa1d-5684796d68c6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:58.927944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-847ecabd-778b-4b24-aa1d-5684796d68c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:58.933318 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1331/2709] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:58 2022] PUT /identity/v3/projects/13d4506ff7e64918a538cfc3e9b00429/users/34ec31e6dbb84139b523fe7a5bd86d9b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:58.937361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c1ff9-8c42-44bb-b2a6-ddb51272ad75 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:58.941997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-362c1ff9-8c42-44bb-b2a6-ddb51272ad75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:59.070153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c1ff9-8c42-44bb-b2a6-ddb51272ad75 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:59.070868 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1379/2710] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:59.080265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ecabd-778b-4b24-aa1d-5684796d68c6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:59.086690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4713b-62c3-4766-860b-c2ec34786dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:59.094064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4713b-62c3-4766-860b-c2ec34786dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.094358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4713b-62c3-4766-860b-c2ec34786dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.094640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4713b-62c3-4766-860b-c2ec34786dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.097434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4713b-62c3-4766-860b-c2ec34786dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:59.101362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4713b-62c3-4766-860b-c2ec34786dc2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:59.122679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847ecabd-778b-4b24-aa1d-5684796d68c6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:59.134715 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1332/2711] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:59.136311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e986df8-fe84-4539-b434-93f912cb388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:59.137556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e986df8-fe84-4539-b434-93f912cb388a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.138014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e986df8-fe84-4539-b434-93f912cb388a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.138436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e986df8-fe84-4539-b434-93f912cb388a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.139671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4713b-62c3-4766-860b-c2ec34786dc2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:59.140954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e986df8-fe84-4539-b434-93f912cb388a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:51:59.163579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e986df8-fe84-4539-b434-93f912cb388a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:59.165257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4713b-62c3-4766-860b-c2ec34786dc2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:59.167106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e986df8-fe84-4539-b434-93f912cb388a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:59.182448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fcea9-ebc9-4835-be18-dbb087d6623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:59.186274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fcea9-ebc9-4835-be18-dbb087d6623f admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.186274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fcea9-ebc9-4835-be18-dbb087d6623f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.186274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542fcea9-ebc9-4835-be18-dbb087d6623f admin admin] PATH_INFO: `/v3/projects/13d4506ff7e64918a538cfc3e9b00429/users/34ec31e6dbb84139b523fe7a5bd86d9b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.190073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fcea9-ebc9-4835-be18-dbb087d6623f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d4506ff7e64918a538cfc3e9b00429, user_id=34ec31e6dbb84139b523fe7a5bd86d9b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:59.192140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542fcea9-ebc9-4835-be18-dbb087d6623f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:59.216460 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1380/2712] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:51:59.216460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71628467-277e-428e-ac57-c9e0c0b6a605 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.216460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71628467-277e-428e-ac57-c9e0c0b6a605 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.216460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71628467-277e-428e-ac57-c9e0c0b6a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.247840 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1333/2713] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:59 2022] PUT /identity/v3/projects/13d4506ff7e64918a538cfc3e9b00429/users/34ec31e6dbb84139b523fe7a5bd86d9b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:51:59.250297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fcea9-ebc9-4835-be18-dbb087d6623f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:59.267234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-71628467-277e-428e-ac57-c9e0c0b6a605 None None] MFA Rules not processed for user `b188ca4deda94cec85da4582a37fea72`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:59.273684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-71628467-277e-428e-ac57-c9e0c0b6a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:59.395178 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1381/2714] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:59.397245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ff3d-4d91-47c5-84dc-4003a70deb82 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.397797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ff3d-4d91-47c5-84dc-4003a70deb82 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.401472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399ff3d-4d91-47c5-84dc-4003a70deb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.428539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542fcea9-ebc9-4835-be18-dbb087d6623f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:59.448730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956db96a-e245-4465-8a27-005b0aff0579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:59.449417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db96a-e245-4465-8a27-005b0aff0579 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.449707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db96a-e245-4465-8a27-005b0aff0579 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.449992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956db96a-e245-4465-8a27-005b0aff0579 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.451388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956db96a-e245-4465-8a27-005b0aff0579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:59.453464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956db96a-e245-4465-8a27-005b0aff0579 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:59.457505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4399ff3d-4d91-47c5-84dc-4003a70deb82 None None] MFA Rules not processed for user `34ec31e6dbb84139b523fe7a5bd86d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:51:59.458874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4399ff3d-4d91-47c5-84dc-4003a70deb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:59.523699 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1334/2715] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:51:59 2022] POST /identity/v3/projects => generated 397 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:59.528159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956db96a-e245-4465-8a27-005b0aff0579 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:59.560218 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1382/2716] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:51:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:51:59.574521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399ff3d-4d91-47c5-84dc-4003a70deb82 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:59.576095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4399ff3d-4d91-47c5-84dc-4003a70deb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:51:59.624525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956db96a-e245-4465-8a27-005b0aff0579 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:59.641840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7cfb6-acc8-4d70-931f-8b2236795782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:59.642540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7cfb6-acc8-4d70-931f-8b2236795782 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.642971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7cfb6-acc8-4d70-931f-8b2236795782 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.645235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7cfb6-acc8-4d70-931f-8b2236795782 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.646659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7cfb6-acc8-4d70-931f-8b2236795782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:59.648950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7cfb6-acc8-4d70-931f-8b2236795782 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:59.707599 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1335/2717] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:51:59 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:51:59.710418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7cfb6-acc8-4d70-931f-8b2236795782 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:59.735656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399ff3d-4d91-47c5-84dc-4003a70deb82 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:59.744700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7cfb6-acc8-4d70-931f-8b2236795782 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:59.758092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f7b2-c489-438d-a899-b19e0608c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:59.759951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f7b2-c489-438d-a899-b19e0608c31f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.761100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f7b2-c489-438d-a899-b19e0608c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.761564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f7b2-c489-438d-a899-b19e0608c31f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.764295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5f7b2-c489-438d-a899-b19e0608c31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:59.766135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5f7b2-c489-438d-a899-b19e0608c31f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:59.798622 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1336/2718] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:59.803412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f7b2-c489-438d-a899-b19e0608c31f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:59.829603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f7b2-c489-438d-a899-b19e0608c31f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:59.850395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a207c4-9eb7-4e68-8a38-adec35edd102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:59.851348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a207c4-9eb7-4e68-8a38-adec35edd102 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.863209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a207c4-9eb7-4e68-8a38-adec35edd102 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.863603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a207c4-9eb7-4e68-8a38-adec35edd102 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.870553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a207c4-9eb7-4e68-8a38-adec35edd102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:51:59.876703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a207c4-9eb7-4e68-8a38-adec35edd102 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:51:59.901284 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1337/2719] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:51:59.901960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c98b3d-5391-44fd-bc61-7e81e615e06e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:59.903159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c98b3d-5391-44fd-bc61-7e81e615e06e service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.904354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c98b3d-5391-44fd-bc61-7e81e615e06e service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.904710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c98b3d-5391-44fd-bc61-7e81e615e06e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:51:59.908833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a207c4-9eb7-4e68-8a38-adec35edd102 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:51:59.960263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a207c4-9eb7-4e68-8a38-adec35edd102 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:51:59.972503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9493b-4634-4921-96f2-eeabf01f8c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:51:59.977491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9493b-4634-4921-96f2-eeabf01f8c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:51:59.977780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9493b-4634-4921-96f2-eeabf01f8c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:51:59.979330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9493b-4634-4921-96f2-eeabf01f8c02 admin admin] PATH_INFO: `/v3/projects/d6be1f9d2cf4446c9e936785fc70de17/users/e0d8624aaea84e50bdb942487d921f81/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:00.018666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9493b-4634-4921-96f2-eeabf01f8c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6be1f9d2cf4446c9e936785fc70de17, user_id=e0d8624aaea84e50bdb942487d921f81, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:00.029362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9493b-4634-4921-96f2-eeabf01f8c02 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:00.049265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c98b3d-5391-44fd-bc61-7e81e615e06e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:00.051190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c98b3d-5391-44fd-bc61-7e81e615e06e service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:00.053576 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1338/2720] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:51:59 2022] PUT /identity/v3/projects/d6be1f9d2cf4446c9e936785fc70de17/users/e0d8624aaea84e50bdb942487d921f81/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:52:00.059489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906c948-e3b3-4a75-805e-c224f98770cf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:00.061380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906c948-e3b3-4a75-805e-c224f98770cf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:00.062944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0906c948-e3b3-4a75-805e-c224f98770cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:00.064872 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1383/2721] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:51:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:00.092136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0906c948-e3b3-4a75-805e-c224f98770cf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:00.094033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0906c948-e3b3-4a75-805e-c224f98770cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:00.220462 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1339/2722] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:52:00.232115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c98b3d-5391-44fd-bc61-7e81e615e06e service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:00.234350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-91c98b3d-5391-44fd-bc61-7e81e615e06e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:00.436825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c98b3d-5391-44fd-bc61-7e81e615e06e service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:00.566759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e52192-c6e7-4337-98a2-b1e4caf04b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:00.567599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e52192-c6e7-4337-98a2-b1e4caf04b06 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:00.568173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e52192-c6e7-4337-98a2-b1e4caf04b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:00.568651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e52192-c6e7-4337-98a2-b1e4caf04b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:00.586135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e52192-c6e7-4337-98a2-b1e4caf04b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:00.589670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e52192-c6e7-4337-98a2-b1e4caf04b06 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:00.609308 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1384/2723] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:02.465804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906c948-e3b3-4a75-805e-c224f98770cf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:02.467368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0906c948-e3b3-4a75-805e-c224f98770cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:02.724758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0906c948-e3b3-4a75-805e-c224f98770cf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:02.754292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8228c3-2a20-438f-ae2e-377d6725dcec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:02.755424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8228c3-2a20-438f-ae2e-377d6725dcec service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:02.755954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8228c3-2a20-438f-ae2e-377d6725dcec service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:02.758884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8228c3-2a20-438f-ae2e-377d6725dcec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:02.784367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7a8228c3-2a20-438f-ae2e-377d6725dcec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:02.885288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8228c3-2a20-438f-ae2e-377d6725dcec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:02.887157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8228c3-2a20-438f-ae2e-377d6725dcec service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:02.904879 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1340/2724] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:02.933015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e52192-c6e7-4337-98a2-b1e4caf04b06 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:02.944913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e52192-c6e7-4337-98a2-b1e4caf04b06 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:02.967033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:02.968367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:02.968649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:02.968927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] PATH_INFO: `/v3/users/7f795eae56d941ffaa55d9cd8438bee7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:02.977075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f795eae56d941ffaa55d9cd8438bee7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:02.979072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:03.175003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f795eae56d941ffaa55d9cd8438bee7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:03.192712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f795eae56d941ffaa55d9cd8438bee7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:03.193464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f795eae56d941ffaa55d9cd8438bee7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:03.194107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f795eae56d941ffaa55d9cd8438bee7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:03.205733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f795eae56d941ffaa55d9cd8438bee7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:03.249354 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1385/2725] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:52:02 2022] DELETE /identity/v3/users/7f795eae56d941ffaa55d9cd8438bee7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:03.253740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42827388-5e5a-48af-9948-b35958879eb1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:03.254053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42827388-5e5a-48af-9948-b35958879eb1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:03.254386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42827388-5e5a-48af-9948-b35958879eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:03.309162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-42827388-5e5a-48af-9948-b35958879eb1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:03.311225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42827388-5e5a-48af-9948-b35958879eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:03.524975 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1341/2726] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:03.554913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:03.558308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:03.729324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593d5ba-53ca-47e8-85ad-341a24985514 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:03.734800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2692f9-e27f-41c0-a7d3-81762670c9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:03.735790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2692f9-e27f-41c0-a7d3-81762670c9bf service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:03.736506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2692f9-e27f-41c0-a7d3-81762670c9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:03.737009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2692f9-e27f-41c0-a7d3-81762670c9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:03.751628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2692f9-e27f-41c0-a7d3-81762670c9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:03.753701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2692f9-e27f-41c0-a7d3-81762670c9bf service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:03.766339 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1386/2727] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:05.646223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42827388-5e5a-48af-9948-b35958879eb1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:05.649861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42827388-5e5a-48af-9948-b35958879eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:05.678752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42827388-5e5a-48af-9948-b35958879eb1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:05.697961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:05.700879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:05.701369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:05.701835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] PATH_INFO: `/v3/projects/fa6eaf7923064ac9837391c71a0d85a2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:05.703315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6eaf7923064ac9837391c71a0d85a2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:05.705994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:05.801823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6eaf7923064ac9837391c71a0d85a2', 'request_id': 'req-748a3349-7612-43e5-87da-d2d998ec1044'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:05.832789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6eaf7923064ac9837391c71a0d85a2', 'request_id': 'req-748a3349-7612-43e5-87da-d2d998ec1044'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:05.847443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6eaf7923064ac9837391c71a0d85a2', 'request_id': 'req-748a3349-7612-43e5-87da-d2d998ec1044'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:05.881732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] The token cache is being invalidate because project fa6eaf7923064ac9837391c71a0d85a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:52:05.882047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:05.883979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-748a3349-7612-43e5-87da-d2d998ec1044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:05.887159 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1342/2728] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:52:05 2022] DELETE /identity/v3/projects/fa6eaf7923064ac9837391c71a0d85a2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:05.890762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2692f9-e27f-41c0-a7d3-81762670c9bf service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:05.902214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2692f9-e27f-41c0-a7d3-81762670c9bf service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:05.939362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970137ab-1cd0-442c-be7f-67359cdcf5e8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:05.939910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970137ab-1cd0-442c-be7f-67359cdcf5e8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:05.940489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970137ab-1cd0-442c-be7f-67359cdcf5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:05.986095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-970137ab-1cd0-442c-be7f-67359cdcf5e8 None None] MFA Rules not processed for user `c9bd4f2793ec48a5b31d081c269a39c2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:05.989755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-970137ab-1cd0-442c-be7f-67359cdcf5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:06.006271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:06.008013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:06.008495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:06.008835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] PATH_INFO: `/v3/users/34ec31e6dbb84139b523fe7a5bd86d9b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:06.010228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ec31e6dbb84139b523fe7a5bd86d9b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:06.014155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:06.111522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ec31e6dbb84139b523fe7a5bd86d9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:06.112293 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1343/2729] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:06.119846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ec31e6dbb84139b523fe7a5bd86d9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:06.121000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ec31e6dbb84139b523fe7a5bd86d9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:06.121650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ec31e6dbb84139b523fe7a5bd86d9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:06.135882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-537232d5-476d-4169-bd33-0e4bb523e314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ec31e6dbb84139b523fe7a5bd86d9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:06.160458 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1387/2730] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:52:05 2022] DELETE /identity/v3/users/34ec31e6dbb84139b523fe7a5bd86d9b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:52:07.849781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970137ab-1cd0-442c-be7f-67359cdcf5e8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:07.851467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-970137ab-1cd0-442c-be7f-67359cdcf5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:07.879538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970137ab-1cd0-442c-be7f-67359cdcf5e8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:07.972040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:07.973079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:07.973433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:07.973781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] PATH_INFO: `/v3/projects/13d4506ff7e64918a538cfc3e9b00429` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:07.976596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d4506ff7e64918a538cfc3e9b00429)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:07.978783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:08.089663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d4506ff7e64918a538cfc3e9b00429', 'request_id': 'req-8d102f71-76c4-4dec-8c14-abbef177a8de'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:08.104762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d4506ff7e64918a538cfc3e9b00429', 'request_id': 'req-8d102f71-76c4-4dec-8c14-abbef177a8de'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:08.122553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d4506ff7e64918a538cfc3e9b00429', 'request_id': 'req-8d102f71-76c4-4dec-8c14-abbef177a8de'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:08.139524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] The token cache is being invalidate because project 13d4506ff7e64918a538cfc3e9b00429 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:52:08.139965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:08.140800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d102f71-76c4-4dec-8c14-abbef177a8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:08.142716 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1344/2731] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:52:07 2022] DELETE /identity/v3/projects/13d4506ff7e64918a538cfc3e9b00429 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:08.148030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e683ab-7086-44f8-9505-035e46f6ba9d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:08.148549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e683ab-7086-44f8-9505-035e46f6ba9d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:08.148549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e683ab-7086-44f8-9505-035e46f6ba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:08.212046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b8e683ab-7086-44f8-9505-035e46f6ba9d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:08.213599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b8e683ab-7086-44f8-9505-035e46f6ba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:08.335125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29331fa5-b1c3-40e3-98f5-37a0c4f7db83 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:08.335707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29331fa5-b1c3-40e3-98f5-37a0c4f7db83 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:08.336218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29331fa5-b1c3-40e3-98f5-37a0c4f7db83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:08.337748 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1388/2732] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:08.391266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-29331fa5-b1c3-40e3-98f5-37a0c4f7db83 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:08.392240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-29331fa5-b1c3-40e3-98f5-37a0c4f7db83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:08.415188 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1345/2733] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:08.416586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e683ab-7086-44f8-9505-035e46f6ba9d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:08.433591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e683ab-7086-44f8-9505-035e46f6ba9d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:08.444965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f46d1d-4a84-4aa5-82b0-82341a355a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:08.445363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f46d1d-4a84-4aa5-82b0-82341a355a26 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:08.445708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f46d1d-4a84-4aa5-82b0-82341a355a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:08.445931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f46d1d-4a84-4aa5-82b0-82341a355a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:08.446758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f46d1d-4a84-4aa5-82b0-82341a355a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:52:08.446968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f46d1d-4a84-4aa5-82b0-82341a355a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:08.449156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f46d1d-4a84-4aa5-82b0-82341a355a26 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:08.494751 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1389/2734] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:52:08.498988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29331fa5-b1c3-40e3-98f5-37a0c4f7db83 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:08.518319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29331fa5-b1c3-40e3-98f5-37a0c4f7db83 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:08.523545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b988ef2-498f-4de1-94fa-724930bd7704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:08.524239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b988ef2-498f-4de1-94fa-724930bd7704 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:08.524521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b988ef2-498f-4de1-94fa-724930bd7704 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:08.524795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b988ef2-498f-4de1-94fa-724930bd7704 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:08.525487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b988ef2-498f-4de1-94fa-724930bd7704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:08.527546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b988ef2-498f-4de1-94fa-724930bd7704 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:08.584294 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1346/2735] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:52:08 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:52:08.588244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f46d1d-4a84-4aa5-82b0-82341a355a26 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:08.602470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f46d1d-4a84-4aa5-82b0-82341a355a26 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:08.763149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb404324-df6b-4c55-a2f4-5f57636b9220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:08.765162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb404324-df6b-4c55-a2f4-5f57636b9220 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:08.766020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb404324-df6b-4c55-a2f4-5f57636b9220 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:08.766370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb404324-df6b-4c55-a2f4-5f57636b9220 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:08.768331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb404324-df6b-4c55-a2f4-5f57636b9220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:08.775239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb404324-df6b-4c55-a2f4-5f57636b9220 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:08.822802 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1390/2736] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:52:08 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:52:08.824441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b988ef2-498f-4de1-94fa-724930bd7704 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:08.846986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b988ef2-498f-4de1-94fa-724930bd7704 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:08.855844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016567-226d-423d-9496-f5653921a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:08.856522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016567-226d-423d-9496-f5653921a10c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:08.856776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016567-226d-423d-9496-f5653921a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:08.857276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc016567-226d-423d-9496-f5653921a10c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:08.858408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc016567-226d-423d-9496-f5653921a10c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:08.860955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc016567-226d-423d-9496-f5653921a10c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:08.884135 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1347/2737] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:52:08.888282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb404324-df6b-4c55-a2f4-5f57636b9220 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:08.900058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb404324-df6b-4c55-a2f4-5f57636b9220 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:08.906092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc0e082-1979-4774-8c11-8ad71251ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:08.908347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0e082-1979-4774-8c11-8ad71251ce37 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:08.908837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0e082-1979-4774-8c11-8ad71251ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:08.909317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc0e082-1979-4774-8c11-8ad71251ce37 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:08.910871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0e082-1979-4774-8c11-8ad71251ce37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:08.914299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc0e082-1979-4774-8c11-8ad71251ce37 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:08.940206 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1391/2738] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:52:08.944464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016567-226d-423d-9496-f5653921a10c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:08.957211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc016567-226d-423d-9496-f5653921a10c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:08.985078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d84f64-709b-41ba-8755-5b4e64c62fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:08.986035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d84f64-709b-41ba-8755-5b4e64c62fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:08.986315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d84f64-709b-41ba-8755-5b4e64c62fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:08.986744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d84f64-709b-41ba-8755-5b4e64c62fd0 admin admin] PATH_INFO: `/v3/projects/d7b7b7e274924321ab663566b06fcf38/users/14c580ce88b74633832c6be6d3e08a47/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:09.038307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d84f64-709b-41ba-8755-5b4e64c62fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b7b7e274924321ab663566b06fcf38, user_id=14c580ce88b74633832c6be6d3e08a47, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:09.041061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d84f64-709b-41ba-8755-5b4e64c62fd0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:09.072370 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1348/2739] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:52:08 2022] PUT /identity/v3/projects/d7b7b7e274924321ab663566b06fcf38/users/14c580ce88b74633832c6be6d3e08a47/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:09.083254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa7ea-580b-49e6-9eba-16a25c512972 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:09.083740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa7ea-580b-49e6-9eba-16a25c512972 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:09.084151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295fa7ea-580b-49e6-9eba-16a25c512972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:09.134245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-295fa7ea-580b-49e6-9eba-16a25c512972 None None] MFA Rules not processed for user `14c580ce88b74633832c6be6d3e08a47`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:09.135775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-295fa7ea-580b-49e6-9eba-16a25c512972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:09.263492 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1392/2740] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:09.268028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d84f64-709b-41ba-8755-5b4e64c62fd0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:09.415584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d84f64-709b-41ba-8755-5b4e64c62fd0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:09.425611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eb8ae-0836-4d28-970f-61f9f517fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:09.430627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb8ae-0836-4d28-970f-61f9f517fe07 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:09.431160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb8ae-0836-4d28-970f-61f9f517fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:09.431656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eb8ae-0836-4d28-970f-61f9f517fe07 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:09.435215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eb8ae-0836-4d28-970f-61f9f517fe07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:09.440042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eb8ae-0836-4d28-970f-61f9f517fe07 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:09.501267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa7ea-580b-49e6-9eba-16a25c512972 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:09.502181 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1349/2741] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:52:09 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:52:09.538831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295fa7ea-580b-49e6-9eba-16a25c512972 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:09.663071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae8b7ba-f711-47ac-ac03-2c791f355c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:09.663997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8b7ba-f711-47ac-ac03-2c791f355c3b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:09.664429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8b7ba-f711-47ac-ac03-2c791f355c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:09.664845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae8b7ba-f711-47ac-ac03-2c791f355c3b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:09.665654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8b7ba-f711-47ac-ac03-2c791f355c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:09.671728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae8b7ba-f711-47ac-ac03-2c791f355c3b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:09.736134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eb8ae-0836-4d28-970f-61f9f517fe07 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:09.739081 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1393/2742] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:52:09 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:52:09.757835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eb8ae-0836-4d28-970f-61f9f517fe07 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:09.770917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d63c04-bb3b-4cc1-a901-cb3744d2dc5a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:09.771482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d63c04-bb3b-4cc1-a901-cb3744d2dc5a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:09.772044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d63c04-bb3b-4cc1-a901-cb3744d2dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:09.773296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954569c8-efc6-4660-9cb7-5a8299909d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:09.773977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954569c8-efc6-4660-9cb7-5a8299909d94 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:09.774264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954569c8-efc6-4660-9cb7-5a8299909d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:09.774548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954569c8-efc6-4660-9cb7-5a8299909d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:09.776089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954569c8-efc6-4660-9cb7-5a8299909d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:09.777713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954569c8-efc6-4660-9cb7-5a8299909d94 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:09.803263 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1350/2743] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:52:09.805255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954569c8-efc6-4660-9cb7-5a8299909d94 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:09.806669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-53d63c04-bb3b-4cc1-a901-cb3744d2dc5a None None] MFA Rules not processed for user `e0d8624aaea84e50bdb942487d921f81`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:09.808263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-53d63c04-bb3b-4cc1-a901-cb3744d2dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:09.856678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954569c8-efc6-4660-9cb7-5a8299909d94 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:09.876583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5eef6-6efe-46c2-a8de-7a9d3dcb9a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:09.880623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5eef6-6efe-46c2-a8de-7a9d3dcb9a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:09.881111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5eef6-6efe-46c2-a8de-7a9d3dcb9a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:09.881711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5eef6-6efe-46c2-a8de-7a9d3dcb9a3c admin admin] PATH_INFO: `/v3/projects/d30a03c5713342daa6f922851e1acc1a/users/bf4db3ea241a4a3a81cdd3fe4aa97dcf/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:09.920737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5eef6-6efe-46c2-a8de-7a9d3dcb9a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30a03c5713342daa6f922851e1acc1a, user_id=bf4db3ea241a4a3a81cdd3fe4aa97dcf, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:09.925484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5eef6-6efe-46c2-a8de-7a9d3dcb9a3c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:09.961096 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1351/2744] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:52:09 2022] PUT /identity/v3/projects/d30a03c5713342daa6f922851e1acc1a/users/bf4db3ea241a4a3a81cdd3fe4aa97dcf/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:09.964012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5eef6-6efe-46c2-a8de-7a9d3dcb9a3c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:10.039189 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1394/2745] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:10.043002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849f45-b51d-4bf2-a28e-356cd97e908f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:10.043420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849f45-b51d-4bf2-a28e-356cd97e908f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:10.043768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849f45-b51d-4bf2-a28e-356cd97e908f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:10.075478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-89849f45-b51d-4bf2-a28e-356cd97e908f None None] MFA Rules not processed for user `e0d8624aaea84e50bdb942487d921f81`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:10.076742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-89849f45-b51d-4bf2-a28e-356cd97e908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:10.118860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5eef6-6efe-46c2-a8de-7a9d3dcb9a3c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:10.129300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdf359-7c35-495f-9153-fcde78d560db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:10.130037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdf359-7c35-495f-9153-fcde78d560db admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:10.130421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdf359-7c35-495f-9153-fcde78d560db admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:10.130797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fdf359-7c35-495f-9153-fcde78d560db admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:10.131621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdf359-7c35-495f-9153-fcde78d560db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:10.136710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fdf359-7c35-495f-9153-fcde78d560db admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:10.161776 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1352/2746] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:52:10.165619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdf359-7c35-495f-9153-fcde78d560db admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:10.178223 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1395/2747] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:52:10.184809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849f45-b51d-4bf2-a28e-356cd97e908f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:10.186084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fdf359-7c35-495f-9153-fcde78d560db admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:10.186439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-89849f45-b51d-4bf2-a28e-356cd97e908f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:10.191563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18b1321-b395-433f-8adf-256501d82894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:10.192545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1321-b395-433f-8adf-256501d82894 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:10.192830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1321-b395-433f-8adf-256501d82894 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:10.193110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18b1321-b395-433f-8adf-256501d82894 admin admin] PATH_INFO: `/v3/projects/d30a03c5713342daa6f922851e1acc1a/users/bf4db3ea241a4a3a81cdd3fe4aa97dcf/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:10.195133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b1321-b395-433f-8adf-256501d82894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30a03c5713342daa6f922851e1acc1a, user_id=bf4db3ea241a4a3a81cdd3fe4aa97dcf, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:10.198620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18b1321-b395-433f-8adf-256501d82894 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:10.210534 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1353/2748] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:52:10 2022] PUT /identity/v3/projects/d30a03c5713342daa6f922851e1acc1a/users/bf4db3ea241a4a3a81cdd3fe4aa97dcf/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:10.241545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1e7a7-f2e2-4829-8ef9-b885be1bb213 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:10.242568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1e7a7-f2e2-4829-8ef9-b885be1bb213 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:10.242914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b1e7a7-f2e2-4829-8ef9-b885be1bb213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:10.295177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849f45-b51d-4bf2-a28e-356cd97e908f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:10.302682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e5b1e7a7-f2e2-4829-8ef9-b885be1bb213 None None] MFA Rules not processed for user `bf4db3ea241a4a3a81cdd3fe4aa97dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:10.303855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e5b1e7a7-f2e2-4829-8ef9-b885be1bb213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:10.386012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873508d-23ab-4c53-8c6a-f3098f052bf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:10.387430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873508d-23ab-4c53-8c6a-f3098f052bf3 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:10.387874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873508d-23ab-4c53-8c6a-f3098f052bf3 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:10.388359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873508d-23ab-4c53-8c6a-f3098f052bf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:10.431288 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1354/2749] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:52:10.445605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf15daf-3b77-4810-966c-54f86e1f4cd0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:10.445917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf15daf-3b77-4810-966c-54f86e1f4cd0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:10.446167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf15daf-3b77-4810-966c-54f86e1f4cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:10.484986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9bf15daf-3b77-4810-966c-54f86e1f4cd0 None None] MFA Rules not processed for user `14c580ce88b74633832c6be6d3e08a47`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:10.486017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9bf15daf-3b77-4810-966c-54f86e1f4cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:10.504063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873508d-23ab-4c53-8c6a-f3098f052bf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:10.506927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873508d-23ab-4c53-8c6a-f3098f052bf3 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:10.523793 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1396/2750] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:10.605600 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1355/2751] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:52:10.777253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873508d-23ab-4c53-8c6a-f3098f052bf3 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:10.779364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2873508d-23ab-4c53-8c6a-f3098f052bf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:10.804157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873508d-23ab-4c53-8c6a-f3098f052bf3 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:10.812264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03478143-20c6-4750-bf5a-04b100a128c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:10.812976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478143-20c6-4750-bf5a-04b100a128c9 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:10.813650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478143-20c6-4750-bf5a-04b100a128c9 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:10.813948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03478143-20c6-4750-bf5a-04b100a128c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:10.825324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03478143-20c6-4750-bf5a-04b100a128c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:10.826941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03478143-20c6-4750-bf5a-04b100a128c9 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:10.856949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1397/2752] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:28.866931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532fb32-ca98-4bdd-be34-536c1bdfaa73 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:28.868300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532fb32-ca98-4bdd-be34-536c1bdfaa73 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:28.868905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532fb32-ca98-4bdd-be34-536c1bdfaa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:28.902985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8532fb32-ca98-4bdd-be34-536c1bdfaa73 None None] MFA Rules not processed for user `b188ca4deda94cec85da4582a37fea72`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:28.905177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8532fb32-ca98-4bdd-be34-536c1bdfaa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:29.012207 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1356/2753] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:30.825142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd725a-1c23-4ccb-bf0d-f119b5e43de1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:30.825657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd725a-1c23-4ccb-bf0d-f119b5e43de1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:30.825850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd725a-1c23-4ccb-bf0d-f119b5e43de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:30.850420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-95dd725a-1c23-4ccb-bf0d-f119b5e43de1 None None] MFA Rules not processed for user `e0d8624aaea84e50bdb942487d921f81`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:30.851601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-95dd725a-1c23-4ccb-bf0d-f119b5e43de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:30.864919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333a38-5642-47e7-aa74-caf87dd8c066 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:30.865887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333a38-5642-47e7-aa74-caf87dd8c066 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:30.866379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f333a38-5642-47e7-aa74-caf87dd8c066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:30.867338 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1398/2754] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:30.895106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0f333a38-5642-47e7-aa74-caf87dd8c066 None None] MFA Rules not processed for user `4ef943b3272c48aa884a7ff4a7e854d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:30.909731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0f333a38-5642-47e7-aa74-caf87dd8c066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:31.012151 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1357/2755] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:52:32.479251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd725a-1c23-4ccb-bf0d-f119b5e43de1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:32.497091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd725a-1c23-4ccb-bf0d-f119b5e43de1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:32.505504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b114681-9812-47a3-9ca8-1ff627efa9dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:32.506353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b114681-9812-47a3-9ca8-1ff627efa9dd service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:32.506846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b114681-9812-47a3-9ca8-1ff627efa9dd service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:32.507144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b114681-9812-47a3-9ca8-1ff627efa9dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:32.521008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b114681-9812-47a3-9ca8-1ff627efa9dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:32.522666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b114681-9812-47a3-9ca8-1ff627efa9dd service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:32.534660 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1399/2756] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:38.069369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f333a38-5642-47e7-aa74-caf87dd8c066 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:38.154124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f333a38-5642-47e7-aa74-caf87dd8c066 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:38.159391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:38.160368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:38.160656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:38.160941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] PATH_INFO: `/v3/users/14c580ce88b74633832c6be6d3e08a47` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:38.162852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c580ce88b74633832c6be6d3e08a47)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:38.165578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:38.234791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c580ce88b74633832c6be6d3e08a47'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:38.246861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c580ce88b74633832c6be6d3e08a47'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:38.247698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c580ce88b74633832c6be6d3e08a47'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:38.248445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c580ce88b74633832c6be6d3e08a47'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:38.261211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c580ce88b74633832c6be6d3e08a47'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:38.285835 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1358/2757] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:52:38 2022] DELETE /identity/v3/users/14c580ce88b74633832c6be6d3e08a47 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:38.290474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b63d98-6ada-4409-b61d-4666f56c31df None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:38.291490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b63d98-6ada-4409-b61d-4666f56c31df None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:38.292475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b63d98-6ada-4409-b61d-4666f56c31df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:38.316551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e1b63d98-6ada-4409-b61d-4666f56c31df None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:38.317848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e1b63d98-6ada-4409-b61d-4666f56c31df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:38.418907 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1400/2758] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:38.428911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:38.430375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:38.509636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba313e65-c4f9-4e9e-8515-850bf3ecc9ba admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:38.514672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091327-768e-4ab8-a1c1-9d845d97a5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:38.515417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091327-768e-4ab8-a1c1-9d845d97a5ab service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:38.515864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091327-768e-4ab8-a1c1-9d845d97a5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:38.516246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af091327-768e-4ab8-a1c1-9d845d97a5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:38.530075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091327-768e-4ab8-a1c1-9d845d97a5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:38.531692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af091327-768e-4ab8-a1c1-9d845d97a5ab service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:38.545704 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1359/2759] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:39.369554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b63d98-6ada-4409-b61d-4666f56c31df None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:39.375097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e1b63d98-6ada-4409-b61d-4666f56c31df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:39.390078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b63d98-6ada-4409-b61d-4666f56c31df None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:39.395304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:39.396315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:39.396510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:39.396950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] PATH_INFO: `/v3/projects/d7b7b7e274924321ab663566b06fcf38` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:39.398306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b7b7e274924321ab663566b06fcf38)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:39.401711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:39.489470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b7b7e274924321ab663566b06fcf38', 'request_id': 'req-4e066903-26b6-4ace-bb04-1896590e06d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.502866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b7b7e274924321ab663566b06fcf38', 'request_id': 'req-4e066903-26b6-4ace-bb04-1896590e06d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.510945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b7b7e274924321ab663566b06fcf38', 'request_id': 'req-4e066903-26b6-4ace-bb04-1896590e06d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.523958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] The token cache is being invalidate because project d7b7b7e274924321ab663566b06fcf38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:52:39.525393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.526280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.528993 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1401/2760] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:52:39 2022] DELETE /identity/v3/projects/d7b7b7e274924321ab663566b06fcf38 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:39.532658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091327-768e-4ab8-a1c1-9d845d97a5ab service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:39.545279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af091327-768e-4ab8-a1c1-9d845d97a5ab service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:39.642871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:39.643895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:39.644300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:39.644651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] PATH_INFO: `/v3/users/bf4db3ea241a4a3a81cdd3fe4aa97dcf` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:39.645957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4db3ea241a4a3a81cdd3fe4aa97dcf)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:39.648107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:39.718232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4db3ea241a4a3a81cdd3fe4aa97dcf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.734985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4db3ea241a4a3a81cdd3fe4aa97dcf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.737779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4db3ea241a4a3a81cdd3fe4aa97dcf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.738484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4db3ea241a4a3a81cdd3fe4aa97dcf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.752550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aaadabb5-d18d-424b-a122-a45b8043a347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4db3ea241a4a3a81cdd3fe4aa97dcf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:39.765445 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1360/2761] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:52:39 2022] DELETE /identity/v3/users/bf4db3ea241a4a3a81cdd3fe4aa97dcf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:40.292270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:40.293879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:40.312651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e066903-26b6-4ace-bb04-1896590e06d5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:40.392105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:40.393105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.393452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.393795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] PATH_INFO: `/v3/projects/d30a03c5713342daa6f922851e1acc1a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:40.395052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30a03c5713342daa6f922851e1acc1a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:40.397465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:40.488537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30a03c5713342daa6f922851e1acc1a', 'request_id': 'req-d749230a-8ec4-4e4e-9ef7-92974e438dd2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:40.503675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30a03c5713342daa6f922851e1acc1a', 'request_id': 'req-d749230a-8ec4-4e4e-9ef7-92974e438dd2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:40.522734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30a03c5713342daa6f922851e1acc1a', 'request_id': 'req-d749230a-8ec4-4e4e-9ef7-92974e438dd2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:40.526100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b19c-afb3-4e46-899c-3c5b55b342e2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.527136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b19c-afb3-4e46-899c-3c5b55b342e2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.527519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76b19c-afb3-4e46-899c-3c5b55b342e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:40.548706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] The token cache is being invalidate because project d30a03c5713342daa6f922851e1acc1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:52:40.548911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7b76b19c-afb3-4e46-899c-3c5b55b342e2 None None] MFA Rules not processed for user `b5effd8428df4616865ee71160f53594`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:40.549372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:40.549653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d749230a-8ec4-4e4e-9ef7-92974e438dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:40.550113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7b76b19c-afb3-4e46-899c-3c5b55b342e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:40.551615 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1402/2762] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:52:40 2022] DELETE /identity/v3/projects/d30a03c5713342daa6f922851e1acc1a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:52:40.559540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2acc87-15d3-4873-b1c8-841602d61f87 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.559725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2acc87-15d3-4873-b1c8-841602d61f87 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.559931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2acc87-15d3-4873-b1c8-841602d61f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:40.581327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4a2acc87-15d3-4873-b1c8-841602d61f87 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:40.582606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4a2acc87-15d3-4873-b1c8-841602d61f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:40.613157 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1361/2763] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:40.661813 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1403/2764] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:40.664490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422f76-05c2-47b2-96f2-e9f1273fe860 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.664935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422f76-05c2-47b2-96f2-e9f1273fe860 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.665234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de422f76-05c2-47b2-96f2-e9f1273fe860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:40.688448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-de422f76-05c2-47b2-96f2-e9f1273fe860 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:40.689894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-de422f76-05c2-47b2-96f2-e9f1273fe860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:40.699064 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1362/2765] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:40.703472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2acc87-15d3-4873-b1c8-841602d61f87 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:40.713319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2acc87-15d3-4873-b1c8-841602d61f87 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:40.718176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dcba8-fec1-471f-97a0-a64fdde48d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:40.718838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dcba8-fec1-471f-97a0-a64fdde48d42 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.719123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dcba8-fec1-471f-97a0-a64fdde48d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.719403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dcba8-fec1-471f-97a0-a64fdde48d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:40.720178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dcba8-fec1-471f-97a0-a64fdde48d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:52:40.720491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dcba8-fec1-471f-97a0-a64fdde48d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:40.722184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dcba8-fec1-471f-97a0-a64fdde48d42 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:40.740787 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1404/2766] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:52:40.742296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422f76-05c2-47b2-96f2-e9f1273fe860 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:40.753011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de422f76-05c2-47b2-96f2-e9f1273fe860 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:40.758125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0dbf0-a5d1-442a-b323-69688ad3faac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:40.758783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0dbf0-a5d1-442a-b323-69688ad3faac admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.759062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0dbf0-a5d1-442a-b323-69688ad3faac admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.759335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0dbf0-a5d1-442a-b323-69688ad3faac admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:40.760064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0dbf0-a5d1-442a-b323-69688ad3faac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:40.762610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0dbf0-a5d1-442a-b323-69688ad3faac admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:40.795424 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1363/2767] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:52:40 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:52:40.796680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dcba8-fec1-471f-97a0-a64fdde48d42 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:40.806838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dcba8-fec1-471f-97a0-a64fdde48d42 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:40.866317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47362d39-ae74-4269-9146-ed96276bf2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:40.866990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47362d39-ae74-4269-9146-ed96276bf2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.867285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47362d39-ae74-4269-9146-ed96276bf2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.867528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47362d39-ae74-4269-9146-ed96276bf2a0 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:40.868247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47362d39-ae74-4269-9146-ed96276bf2a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:40.870748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47362d39-ae74-4269-9146-ed96276bf2a0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:40.896271 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1405/2768] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:52:40 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:52:40.899870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0dbf0-a5d1-442a-b323-69688ad3faac admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:40.910223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0dbf0-a5d1-442a-b323-69688ad3faac admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:40.915818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b287-b077-43d3-ae3f-2ae3f21a1545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:40.916727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b287-b077-43d3-ae3f-2ae3f21a1545 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.917843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b287-b077-43d3-ae3f-2ae3f21a1545 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.918473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee4b287-b077-43d3-ae3f-2ae3f21a1545 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:40.919578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4b287-b077-43d3-ae3f-2ae3f21a1545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:40.921534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee4b287-b077-43d3-ae3f-2ae3f21a1545 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:40.934555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1364/2769] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:52:40.938339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47362d39-ae74-4269-9146-ed96276bf2a0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:40.949276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47362d39-ae74-4269-9146-ed96276bf2a0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:40.954053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814b9d4-123b-4289-b083-79458f0a2d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:40.954810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814b9d4-123b-4289-b083-79458f0a2d78 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.955156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814b9d4-123b-4289-b083-79458f0a2d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.955501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814b9d4-123b-4289-b083-79458f0a2d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:40.956318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814b9d4-123b-4289-b083-79458f0a2d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:40.957992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814b9d4-123b-4289-b083-79458f0a2d78 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:40.971233 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1406/2770] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:52:40.975221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b287-b077-43d3-ae3f-2ae3f21a1545 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:40.985928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee4b287-b077-43d3-ae3f-2ae3f21a1545 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:40.992183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d29f4-5f3e-40e5-976a-d08e245b0806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:40.993080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d29f4-5f3e-40e5-976a-d08e245b0806 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:40.993371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d29f4-5f3e-40e5-976a-d08e245b0806 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:40.993921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d29f4-5f3e-40e5-976a-d08e245b0806 admin admin] PATH_INFO: `/v3/projects/ded55fa29e38427a9306edfee6ca165e/users/ace2bfce35e543e7b53db4ba90395816/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:41.012265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d29f4-5f3e-40e5-976a-d08e245b0806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded55fa29e38427a9306edfee6ca165e, user_id=ace2bfce35e543e7b53db4ba90395816, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:41.015698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d29f4-5f3e-40e5-976a-d08e245b0806 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:41.037351 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1365/2771] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:52:40 2022] PUT /identity/v3/projects/ded55fa29e38427a9306edfee6ca165e/users/ace2bfce35e543e7b53db4ba90395816/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:52:41.042818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c3bd-4886-46df-b42b-4bcb7a46cb2d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:41.043746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c3bd-4886-46df-b42b-4bcb7a46cb2d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:41.044285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c3bd-4886-46df-b42b-4bcb7a46cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:41.066793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7cb1c3bd-4886-46df-b42b-4bcb7a46cb2d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:41.068471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7cb1c3bd-4886-46df-b42b-4bcb7a46cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:41.137945 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1407/2772] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:52:41.145146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d29f4-5f3e-40e5-976a-d08e245b0806 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:41.147012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2d4d29f4-5f3e-40e5-976a-d08e245b0806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:41.211583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d29f4-5f3e-40e5-976a-d08e245b0806 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:41.215049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe20ac5-3587-4722-b894-2e26b048f412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:41.215778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20ac5-3587-4722-b894-2e26b048f412 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:41.216292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20ac5-3587-4722-b894-2e26b048f412 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:41.216426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe20ac5-3587-4722-b894-2e26b048f412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:41.226258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe20ac5-3587-4722-b894-2e26b048f412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:41.227855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe20ac5-3587-4722-b894-2e26b048f412 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:41.251193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1366/2773] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:52:42.980522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1205d0-e591-4706-83e6-0b519d428ecb None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:42.981002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1205d0-e591-4706-83e6-0b519d428ecb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:42.981089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1205d0-e591-4706-83e6-0b519d428ecb None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:42.983056 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1408/2774] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:52:42.991520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d81824-5e74-471d-8b5c-ab613c3b99a5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:42.992534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d81824-5e74-471d-8b5c-ab613c3b99a5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:42.993193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d81824-5e74-471d-8b5c-ab613c3b99a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:43.031570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e2d81824-5e74-471d-8b5c-ab613c3b99a5 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:43.033257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e2d81824-5e74-471d-8b5c-ab613c3b99a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:43.150700 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1367/2775] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:52:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:52:43.179143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1205d0-e591-4706-83e6-0b519d428ecb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:43.180860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6d1205d0-e591-4706-83e6-0b519d428ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:43.207970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1205d0-e591-4706-83e6-0b519d428ecb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:43.223332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33cd6bf-97a7-4cca-8b84-6580327df1b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:43.224173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cd6bf-97a7-4cca-8b84-6580327df1b7 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:43.224362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cd6bf-97a7-4cca-8b84-6580327df1b7 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:43.224640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33cd6bf-97a7-4cca-8b84-6580327df1b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:43.248024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cd6bf-97a7-4cca-8b84-6580327df1b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:43.249943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33cd6bf-97a7-4cca-8b84-6580327df1b7 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:43.273070 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1409/2776] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:52:47.373785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b783-f5dc-478b-9794-11628d7d2e96 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:47.374280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b783-f5dc-478b-9794-11628d7d2e96 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:47.374378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3b783-f5dc-478b-9794-11628d7d2e96 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:47.376158 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1368/2777] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:52:47.385035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ad477-99eb-4eed-8fbd-129afab93871 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:47.385533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ad477-99eb-4eed-8fbd-129afab93871 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:47.385647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ad477-99eb-4eed-8fbd-129afab93871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:47.409986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e91ad477-99eb-4eed-8fbd-129afab93871 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:47.411678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e91ad477-99eb-4eed-8fbd-129afab93871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:47.426788 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1410/2778] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:52:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:47.453835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3b783-f5dc-478b-9794-11628d7d2e96 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:47.456654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-20a3b783-f5dc-478b-9794-11628d7d2e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:47.494662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3b783-f5dc-478b-9794-11628d7d2e96 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:47.504859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1e4a-70da-4dbb-8791-9af3e3d71b1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:47.507452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1e4a-70da-4dbb-8791-9af3e3d71b1a service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:47.507830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1e4a-70da-4dbb-8791-9af3e3d71b1a service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:47.508579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b1e4a-70da-4dbb-8791-9af3e3d71b1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:47.529717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b1e4a-70da-4dbb-8791-9af3e3d71b1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:47.532330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b1e4a-70da-4dbb-8791-9af3e3d71b1a service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:47.550011 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1369/2779] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:50.204954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a007-378b-4a95-b9de-aae78fca7366 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:50.205518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a007-378b-4a95-b9de-aae78fca7366 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:50.205518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3a007-378b-4a95-b9de-aae78fca7366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:50.236714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-28e3a007-378b-4a95-b9de-aae78fca7366 None None] MFA Rules not processed for user `ace2bfce35e543e7b53db4ba90395816`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:50.238058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-28e3a007-378b-4a95-b9de-aae78fca7366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:50.339355 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1411/2780] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:52:50.345989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1e4a-70da-4dbb-8791-9af3e3d71b1a service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:50.347501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-af7b1e4a-70da-4dbb-8791-9af3e3d71b1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:50.423808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b1e4a-70da-4dbb-8791-9af3e3d71b1a service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:50.429489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6087f-8eff-4d40-a9e4-acd4df26a566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:50.430133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6087f-8eff-4d40-a9e4-acd4df26a566 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:50.430423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6087f-8eff-4d40-a9e4-acd4df26a566 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:50.430700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6087f-8eff-4d40-a9e4-acd4df26a566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:50.439211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6087f-8eff-4d40-a9e4-acd4df26a566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:50.440856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6087f-8eff-4d40-a9e4-acd4df26a566 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:50.451026 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1370/2781] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:51.971247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783697a4-f9d5-4aac-ba13-8f273057f1af None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:51.971850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783697a4-f9d5-4aac-ba13-8f273057f1af None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:51.971984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783697a4-f9d5-4aac-ba13-8f273057f1af None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:51.974415 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1412/2782] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:52:51.981359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92a175-261d-4f83-9217-3c6db8d5afb4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:51.981868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92a175-261d-4f83-9217-3c6db8d5afb4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:51.982513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92a175-261d-4f83-9217-3c6db8d5afb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:52.018148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3b92a175-261d-4f83-9217-3c6db8d5afb4 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:52.019472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3b92a175-261d-4f83-9217-3c6db8d5afb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:52.049169 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1371/2783] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:52:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:52:52.071671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783697a4-f9d5-4aac-ba13-8f273057f1af None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:52.109061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783697a4-f9d5-4aac-ba13-8f273057f1af None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:52.134303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02705a71-604d-444d-ad04-206815c5f805 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:52.134900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02705a71-604d-444d-ad04-206815c5f805 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:52.135229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02705a71-604d-444d-ad04-206815c5f805 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:52.135505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02705a71-604d-444d-ad04-206815c5f805 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:52.165253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02705a71-604d-444d-ad04-206815c5f805 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:52.168755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02705a71-604d-444d-ad04-206815c5f805 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:52.199456 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1413/2784] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:52.794437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228f027-196d-4410-9f33-2ff7061efd30 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:52.794724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228f027-196d-4410-9f33-2ff7061efd30 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:52.795381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228f027-196d-4410-9f33-2ff7061efd30 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:52.797725 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1372/2785] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 20:52:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:52:52.806028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f3282-b44a-4df0-a453-8ed1f5ba6018 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:52.806655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f3282-b44a-4df0-a453-8ed1f5ba6018 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:52.807626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f3282-b44a-4df0-a453-8ed1f5ba6018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:52.842668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-034f3282-b44a-4df0-a453-8ed1f5ba6018 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:52.843874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-034f3282-b44a-4df0-a453-8ed1f5ba6018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:52.872449 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1414/2786] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 20:52:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:52.900175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228f027-196d-4410-9f33-2ff7061efd30 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:52.933036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228f027-196d-4410-9f33-2ff7061efd30 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:52.941971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba72fb-f2b6-4a1a-a3b6-a9e7a1ee6c1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:52.942841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba72fb-f2b6-4a1a-a3b6-a9e7a1ee6c1d service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:52.943620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba72fb-f2b6-4a1a-a3b6-a9e7a1ee6c1d service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:52.944092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba72fb-f2b6-4a1a-a3b6-a9e7a1ee6c1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:52.956028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba72fb-f2b6-4a1a-a3b6-a9e7a1ee6c1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:52.958086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba72fb-f2b6-4a1a-a3b6-a9e7a1ee6c1d service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:53.005679 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1373/2787] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:52:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:52:55.460694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5d4f-b881-4343-84c6-e9f62b791ddd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:55.461247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5d4f-b881-4343-84c6-e9f62b791ddd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:55.461247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c5d4f-b881-4343-84c6-e9f62b791ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:55.500381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bb6c5d4f-b881-4343-84c6-e9f62b791ddd None None] MFA Rules not processed for user `b188ca4deda94cec85da4582a37fea72`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:52:55.501626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bb6c5d4f-b881-4343-84c6-e9f62b791ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:52:55.613422 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1415/2788] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:52:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:52:59.431155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba72fb-f2b6-4a1a-a3b6-a9e7a1ee6c1d service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:52:59.448575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba72fb-f2b6-4a1a-a3b6-a9e7a1ee6c1d service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:52:59.455657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:52:59.468514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:52:59.470559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:52:59.471126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] PATH_INFO: `/v3/users/ace2bfce35e543e7b53db4ba90395816` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:52:59.474596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace2bfce35e543e7b53db4ba90395816)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:52:59.477988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:52:59.539628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace2bfce35e543e7b53db4ba90395816'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:59.550986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace2bfce35e543e7b53db4ba90395816'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:59.551849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace2bfce35e543e7b53db4ba90395816'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:59.552810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace2bfce35e543e7b53db4ba90395816'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:59.568743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3290b172-b505-4f79-aa67-09bf0be9d6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace2bfce35e543e7b53db4ba90395816'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:52:59.582386 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1374/2789] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:52:59 2022] DELETE /identity/v3/users/ace2bfce35e543e7b53db4ba90395816 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:00.262629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c5d4f-b881-4343-84c6-e9f62b791ddd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:00.276473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c5d4f-b881-4343-84c6-e9f62b791ddd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:00.380625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:00.381535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:00.381799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:00.382319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] PATH_INFO: `/v3/projects/ded55fa29e38427a9306edfee6ca165e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:00.384316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded55fa29e38427a9306edfee6ca165e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:00.387121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:00.456124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded55fa29e38427a9306edfee6ca165e', 'request_id': 'req-975f6366-43e1-4569-b80c-968a4e742c89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:00.469615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded55fa29e38427a9306edfee6ca165e', 'request_id': 'req-975f6366-43e1-4569-b80c-968a4e742c89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:00.480616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded55fa29e38427a9306edfee6ca165e', 'request_id': 'req-975f6366-43e1-4569-b80c-968a4e742c89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:00.496128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] The token cache is being invalidate because project ded55fa29e38427a9306edfee6ca165e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:00.496764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:00.497925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-975f6366-43e1-4569-b80c-968a4e742c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:00.500435 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1416/2790] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:00 2022] DELETE /identity/v3/projects/ded55fa29e38427a9306edfee6ca165e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:00.505465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c483228-a006-489d-a253-1fab8c9700e0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:00.506296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c483228-a006-489d-a253-1fab8c9700e0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:00.506760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c483228-a006-489d-a253-1fab8c9700e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:00.533378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7c483228-a006-489d-a253-1fab8c9700e0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:00.534911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7c483228-a006-489d-a253-1fab8c9700e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:00.615911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1375/2791] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:53:00.625664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1abf28-70bb-4aa2-8540-ccf3f5f41c94 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:00.626018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1abf28-70bb-4aa2-8540-ccf3f5f41c94 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:00.626364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1abf28-70bb-4aa2-8540-ccf3f5f41c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:00.651082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-af1abf28-70bb-4aa2-8540-ccf3f5f41c94 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:00.653052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af1abf28-70bb-4aa2-8540-ccf3f5f41c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:00.664496 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1417/2792] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:00.668746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c483228-a006-489d-a253-1fab8c9700e0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:00.689828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c483228-a006-489d-a253-1fab8c9700e0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:00.700207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef56e-2356-40e5-8b1e-d0f26620c41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:00.701021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef56e-2356-40e5-8b1e-d0f26620c41d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:00.701999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef56e-2356-40e5-8b1e-d0f26620c41d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:00.702519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ef56e-2356-40e5-8b1e-d0f26620c41d admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:00.703682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ef56e-2356-40e5-8b1e-d0f26620c41d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:53:00.704253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ef56e-2356-40e5-8b1e-d0f26620c41d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:00.707424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ef56e-2356-40e5-8b1e-d0f26620c41d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:00.720678 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1376/2793] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:53:00.725327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1abf28-70bb-4aa2-8540-ccf3f5f41c94 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:00.736119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1abf28-70bb-4aa2-8540-ccf3f5f41c94 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:00.741959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4b43d-bbc6-45e8-a170-a99f2d40847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:00.743303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4b43d-bbc6-45e8-a170-a99f2d40847b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:00.743622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4b43d-bbc6-45e8-a170-a99f2d40847b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:00.744144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4b43d-bbc6-45e8-a170-a99f2d40847b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:00.745138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4b43d-bbc6-45e8-a170-a99f2d40847b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:00.747262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4b43d-bbc6-45e8-a170-a99f2d40847b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:00.783676 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1418/2794] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:00 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:00.787597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef56e-2356-40e5-8b1e-d0f26620c41d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:00.798563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ef56e-2356-40e5-8b1e-d0f26620c41d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:00.870022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67f8fb-f283-4250-aafa-bd4288a55e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:00.870804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67f8fb-f283-4250-aafa-bd4288a55e28 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:00.871184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67f8fb-f283-4250-aafa-bd4288a55e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:00.871562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67f8fb-f283-4250-aafa-bd4288a55e28 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:00.872591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67f8fb-f283-4250-aafa-bd4288a55e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:00.874630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67f8fb-f283-4250-aafa-bd4288a55e28 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:00.909252 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1377/2795] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:00 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:00.913318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4b43d-bbc6-45e8-a170-a99f2d40847b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:00.926404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4b43d-bbc6-45e8-a170-a99f2d40847b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:00.943683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38922c-3ce1-4474-9226-666c51f13fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:00.944664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38922c-3ce1-4474-9226-666c51f13fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:00.945105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38922c-3ce1-4474-9226-666c51f13fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:00.945527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38922c-3ce1-4474-9226-666c51f13fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:00.946647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38922c-3ce1-4474-9226-666c51f13fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:00.949094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38922c-3ce1-4474-9226-666c51f13fb2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:00.960561 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1419/2796] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:00.964311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67f8fb-f283-4250-aafa-bd4288a55e28 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:00.980184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67f8fb-f283-4250-aafa-bd4288a55e28 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:00.986128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17022592-feb7-47be-bde7-357fb791c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:00.987158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17022592-feb7-47be-bde7-357fb791c471 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:00.987616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17022592-feb7-47be-bde7-357fb791c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:00.988085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17022592-feb7-47be-bde7-357fb791c471 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:00.988954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17022592-feb7-47be-bde7-357fb791c471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:00.990723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17022592-feb7-47be-bde7-357fb791c471 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:01.005765 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1378/2797] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:01.014974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38922c-3ce1-4474-9226-666c51f13fb2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:01.039809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38922c-3ce1-4474-9226-666c51f13fb2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:01.053681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f29db7-90f7-44d3-9594-aac34a0a78c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:01.054677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29db7-90f7-44d3-9594-aac34a0a78c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:01.054962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29db7-90f7-44d3-9594-aac34a0a78c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:01.055233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f29db7-90f7-44d3-9594-aac34a0a78c7 admin admin] PATH_INFO: `/v3/projects/739cffc409bf4c9b831ae68701acafb1/users/493cfcb9e1b744aaba45b2a48c7306f4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:01.074379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f29db7-90f7-44d3-9594-aac34a0a78c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=739cffc409bf4c9b831ae68701acafb1, user_id=493cfcb9e1b744aaba45b2a48c7306f4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:01.077273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f29db7-90f7-44d3-9594-aac34a0a78c7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:01.110592 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1420/2798] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:01 2022] PUT /identity/v3/projects/739cffc409bf4c9b831ae68701acafb1/users/493cfcb9e1b744aaba45b2a48c7306f4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:53:01.121740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d053e-e188-47db-be62-b4044b466b7c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:01.121949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d053e-e188-47db-be62-b4044b466b7c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:01.122216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d053e-e188-47db-be62-b4044b466b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:01.173957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7c7d053e-e188-47db-be62-b4044b466b7c None None] MFA Rules not processed for user `493cfcb9e1b744aaba45b2a48c7306f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:01.175833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7c7d053e-e188-47db-be62-b4044b466b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:01.286329 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1379/2799] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:01.299257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f29db7-90f7-44d3-9594-aac34a0a78c7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:01.303093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-81f29db7-90f7-44d3-9594-aac34a0a78c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:01.387551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f29db7-90f7-44d3-9594-aac34a0a78c7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:01.391353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2849a-589b-4af5-8515-1f7b127216db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:01.392186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2849a-589b-4af5-8515-1f7b127216db service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:01.392467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2849a-589b-4af5-8515-1f7b127216db service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:01.392741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2849a-589b-4af5-8515-1f7b127216db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:01.416033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2849a-589b-4af5-8515-1f7b127216db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:01.418213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2849a-589b-4af5-8515-1f7b127216db service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:01.430738 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1421/2800] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:02.591101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a6f42-b3aa-4282-8738-f3215a9ea008 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:02.592134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a6f42-b3aa-4282-8738-f3215a9ea008 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:02.592776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a6f42-b3aa-4282-8738-f3215a9ea008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:02.614561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-008a6f42-b3aa-4282-8738-f3215a9ea008 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:02.616298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-008a6f42-b3aa-4282-8738-f3215a9ea008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:02.719612 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1380/2801] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:53:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:53:02.896428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2849a-589b-4af5-8515-1f7b127216db service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:02.897976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6de2849a-589b-4af5-8515-1f7b127216db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:03.007478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2849a-589b-4af5-8515-1f7b127216db service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:03.014497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4c43-4692-4927-9012-ea9754a1753a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:03.015526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4c43-4692-4927-9012-ea9754a1753a service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:03.016051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4c43-4692-4927-9012-ea9754a1753a service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:03.016725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a4c43-4692-4927-9012-ea9754a1753a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:03.028973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a4c43-4692-4927-9012-ea9754a1753a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:03.031260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a4c43-4692-4927-9012-ea9754a1753a service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:03.043321 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1422/2802] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:53:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:05.950754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6d485-3f55-4c5a-89b4-c6e9120c4978 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:05.951289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6d485-3f55-4c5a-89b4-c6e9120c4978 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:05.951289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6d485-3f55-4c5a-89b4-c6e9120c4978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:05.972930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-38f6d485-3f55-4c5a-89b4-c6e9120c4978 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:05.974074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-38f6d485-3f55-4c5a-89b4-c6e9120c4978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:05.994585 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1381/2803] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:53:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:05.994817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4c43-4692-4927-9012-ea9754a1753a service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:06.010597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a4c43-4692-4927-9012-ea9754a1753a service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:06.016586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7859c47-c96f-4d79-8f63-0c1cba3dc686 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:06.017539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7859c47-c96f-4d79-8f63-0c1cba3dc686 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:06.018308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7859c47-c96f-4d79-8f63-0c1cba3dc686 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:06.018922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7859c47-c96f-4d79-8f63-0c1cba3dc686 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:06.045087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7859c47-c96f-4d79-8f63-0c1cba3dc686 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:06.048177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7859c47-c96f-4d79-8f63-0c1cba3dc686 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:06.059694 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1423/2804] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:53:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:53:08.510188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea7858-dbea-48c9-8a62-99ad60321c5b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:08.510779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea7858-dbea-48c9-8a62-99ad60321c5b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:08.510779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea7858-dbea-48c9-8a62-99ad60321c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:08.533029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-22ea7858-dbea-48c9-8a62-99ad60321c5b None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:08.534279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-22ea7858-dbea-48c9-8a62-99ad60321c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:08.548086 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1382/2805] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:53:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:08.569742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7859c47-c96f-4d79-8f63-0c1cba3dc686 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:08.590914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7859c47-c96f-4d79-8f63-0c1cba3dc686 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:08.602159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5791b-e8f9-4150-a119-4e98c64f1404 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:08.603438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5791b-e8f9-4150-a119-4e98c64f1404 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:08.604605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5791b-e8f9-4150-a119-4e98c64f1404 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:08.605145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5791b-e8f9-4150-a119-4e98c64f1404 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:08.615841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5791b-e8f9-4150-a119-4e98c64f1404 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:08.617653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5791b-e8f9-4150-a119-4e98c64f1404 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:08.631396 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1424/2806] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:53:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:53:09.362650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056cc0-6f24-4ebf-ac77-093d6d8ffd8c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:09.363890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056cc0-6f24-4ebf-ac77-093d6d8ffd8c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:09.364470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d056cc0-6f24-4ebf-ac77-093d6d8ffd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:09.425939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9d056cc0-6f24-4ebf-ac77-093d6d8ffd8c None None] MFA Rules not processed for user `493cfcb9e1b744aaba45b2a48c7306f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:09.429013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d056cc0-6f24-4ebf-ac77-093d6d8ffd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:09.463990 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1383/2807] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:10.318258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8957-52a9-4636-8e73-b0650e152a6b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:10.318807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8957-52a9-4636-8e73-b0650e152a6b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:10.318807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec8957-52a9-4636-8e73-b0650e152a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:10.338418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ccec8957-52a9-4636-8e73-b0650e152a6b None None] MFA Rules not processed for user `493cfcb9e1b744aaba45b2a48c7306f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:10.339838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ccec8957-52a9-4636-8e73-b0650e152a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:10.351192 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1425/2808] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:11.867222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf1bf-408b-4e3b-b092-4a6088ec7709 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:11.868381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf1bf-408b-4e3b-b092-4a6088ec7709 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:11.869750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf1bf-408b-4e3b-b092-4a6088ec7709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:11.895331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9d9cf1bf-408b-4e3b-b092-4a6088ec7709 None None] MFA Rules not processed for user `b188ca4deda94cec85da4582a37fea72`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:11.897132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d9cf1bf-408b-4e3b-b092-4a6088ec7709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:12.007292 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1384/2809] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:53:26.732594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8957-52a9-4636-8e73-b0650e152a6b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:26.735017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ccec8957-52a9-4636-8e73-b0650e152a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:26.897274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec8957-52a9-4636-8e73-b0650e152a6b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:26.903965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:26.905159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:26.905723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:26.906313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] PATH_INFO: `/v3/users/2bcd816c4f3a495cbe7ce636cf0e2f8a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:26.908025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bcd816c4f3a495cbe7ce636cf0e2f8a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:26.911698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:27.058165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bcd816c4f3a495cbe7ce636cf0e2f8a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:27.085454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bcd816c4f3a495cbe7ce636cf0e2f8a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:27.086202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bcd816c4f3a495cbe7ce636cf0e2f8a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:27.086813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bcd816c4f3a495cbe7ce636cf0e2f8a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:27.104437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bcd816c4f3a495cbe7ce636cf0e2f8a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:27.185770 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1426/2810] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:26 2022] DELETE /identity/v3/users/2bcd816c4f3a495cbe7ce636cf0e2f8a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:27.963241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf1bf-408b-4e3b-b092-4a6088ec7709 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:27.984330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf1bf-408b-4e3b-b092-4a6088ec7709 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:28.115638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:28.117559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:28.117842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:28.118320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] PATH_INFO: `/v3/projects/cac9d686cedf4368ae6e500602e64596` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:28.122346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac9d686cedf4368ae6e500602e64596)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:28.126909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:28.213243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac9d686cedf4368ae6e500602e64596', 'request_id': 'req-3b78f343-9b37-4350-bcc9-da989f97f2f2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.229450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac9d686cedf4368ae6e500602e64596', 'request_id': 'req-3b78f343-9b37-4350-bcc9-da989f97f2f2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.240861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac9d686cedf4368ae6e500602e64596', 'request_id': 'req-3b78f343-9b37-4350-bcc9-da989f97f2f2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.256365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] The token cache is being invalidate because project cac9d686cedf4368ae6e500602e64596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:28.256808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.258937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.262823 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1385/2811] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:27 2022] DELETE /identity/v3/projects/cac9d686cedf4368ae6e500602e64596 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:28.266767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:28.268411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:28.288846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515e78cf-e7cb-49a3-b032-7c0a08bfbf3f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:28.372650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:28.374018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:28.374580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:28.375075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] PATH_INFO: `/v3/users/a230769b24b244818bf8259559d5ebf4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:28.377833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a230769b24b244818bf8259559d5ebf4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:28.382574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:28.471327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a230769b24b244818bf8259559d5ebf4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.480990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a230769b24b244818bf8259559d5ebf4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.482474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a230769b24b244818bf8259559d5ebf4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.483217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a230769b24b244818bf8259559d5ebf4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.495084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67042728-320c-4eb3-acdb-9b959eeeb82f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a230769b24b244818bf8259559d5ebf4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.520635 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1427/2812] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:28 2022] DELETE /identity/v3/users/a230769b24b244818bf8259559d5ebf4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:28.747051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:28.748756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:28.771833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78f343-9b37-4350-bcc9-da989f97f2f2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:28.844683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:28.845447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:28.845727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:28.845997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] PATH_INFO: `/v3/projects/e1a411b39e0e48a6b4db8a57265e3e1f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:28.847169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a411b39e0e48a6b4db8a57265e3e1f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:28.849142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:28.904501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a411b39e0e48a6b4db8a57265e3e1f', 'request_id': 'req-76acb724-8ce3-41ae-8fab-0bb795bc5d72'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.912711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a411b39e0e48a6b4db8a57265e3e1f', 'request_id': 'req-76acb724-8ce3-41ae-8fab-0bb795bc5d72'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.919149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a411b39e0e48a6b4db8a57265e3e1f', 'request_id': 'req-76acb724-8ce3-41ae-8fab-0bb795bc5d72'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.930837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] The token cache is being invalidate because project e1a411b39e0e48a6b4db8a57265e3e1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:28.931128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.931878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-76acb724-8ce3-41ae-8fab-0bb795bc5d72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:28.933688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1386/2813] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:28 2022] DELETE /identity/v3/projects/e1a411b39e0e48a6b4db8a57265e3e1f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:28.938685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ab0f-0148-4c7a-a0cd-06b4be6b0754 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:28.939065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ab0f-0148-4c7a-a0cd-06b4be6b0754 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:28.939413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ab0f-0148-4c7a-a0cd-06b4be6b0754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:28.958239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4616ab0f-0148-4c7a-a0cd-06b4be6b0754 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:28.959500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4616ab0f-0148-4c7a-a0cd-06b4be6b0754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:29.018631 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1428/2814] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:53:29.026896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e76c-de8c-484d-b203-396dd748d9df None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.027298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e76c-de8c-484d-b203-396dd748d9df None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.027505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459e76c-de8c-484d-b203-396dd748d9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.046273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5459e76c-de8c-484d-b203-396dd748d9df None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:29.047989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5459e76c-de8c-484d-b203-396dd748d9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:29.060386 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1387/2815] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:29.061265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616ab0f-0148-4c7a-a0cd-06b4be6b0754 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.076821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616ab0f-0148-4c7a-a0cd-06b4be6b0754 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.082069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88deea-6b58-459f-9d77-b6b383dcb703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.082984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88deea-6b58-459f-9d77-b6b383dcb703 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.083453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88deea-6b58-459f-9d77-b6b383dcb703 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.083950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88deea-6b58-459f-9d77-b6b383dcb703 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.085447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88deea-6b58-459f-9d77-b6b383dcb703 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:53:29.085958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88deea-6b58-459f-9d77-b6b383dcb703 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.088490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88deea-6b58-459f-9d77-b6b383dcb703 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.103374 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1429/2816] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:53:29.108276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e76c-de8c-484d-b203-396dd748d9df None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.121130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459e76c-de8c-484d-b203-396dd748d9df None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.126169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b357a-65d5-464d-8af7-f69b8b382397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.127059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b357a-65d5-464d-8af7-f69b8b382397 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.127699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b357a-65d5-464d-8af7-f69b8b382397 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.128208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b357a-65d5-464d-8af7-f69b8b382397 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.128924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b357a-65d5-464d-8af7-f69b8b382397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.131345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b357a-65d5-464d-8af7-f69b8b382397 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.165391 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1388/2817] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:29 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:29.167619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88deea-6b58-459f-9d77-b6b383dcb703 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.179330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88deea-6b58-459f-9d77-b6b383dcb703 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.261325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368bf37-cdf7-4ccc-a2cd-5415869c4884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.262224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368bf37-cdf7-4ccc-a2cd-5415869c4884 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.262529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368bf37-cdf7-4ccc-a2cd-5415869c4884 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.262789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368bf37-cdf7-4ccc-a2cd-5415869c4884 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.263538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368bf37-cdf7-4ccc-a2cd-5415869c4884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.265451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368bf37-cdf7-4ccc-a2cd-5415869c4884 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.301183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b357a-65d5-464d-8af7-f69b8b382397 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.308085 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1430/2818] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:29 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:53:29.314556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b357a-65d5-464d-8af7-f69b8b382397 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.319313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab4ef8-6680-4170-aa21-6aacbbbe8ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.320055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab4ef8-6680-4170-aa21-6aacbbbe8ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.320721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab4ef8-6680-4170-aa21-6aacbbbe8ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.321571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab4ef8-6680-4170-aa21-6aacbbbe8ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.323511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab4ef8-6680-4170-aa21-6aacbbbe8ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.325411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab4ef8-6680-4170-aa21-6aacbbbe8ca9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.338545 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1389/2819] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:53:29.342717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368bf37-cdf7-4ccc-a2cd-5415869c4884 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.354099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368bf37-cdf7-4ccc-a2cd-5415869c4884 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.358694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd7787-0be3-4c98-89d6-19f4007a37b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.359353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7787-0be3-4c98-89d6-19f4007a37b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.360091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7787-0be3-4c98-89d6-19f4007a37b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.361074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd7787-0be3-4c98-89d6-19f4007a37b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.362070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd7787-0be3-4c98-89d6-19f4007a37b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.364580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd7787-0be3-4c98-89d6-19f4007a37b6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.378768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1431/2820] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:29.380093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab4ef8-6680-4170-aa21-6aacbbbe8ca9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.391604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab4ef8-6680-4170-aa21-6aacbbbe8ca9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.396832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37833ce8-9238-4e31-a1df-6ea39fe93b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.397740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37833ce8-9238-4e31-a1df-6ea39fe93b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.398020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37833ce8-9238-4e31-a1df-6ea39fe93b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.398685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37833ce8-9238-4e31-a1df-6ea39fe93b2d admin admin] PATH_INFO: `/v3/projects/a72b734ba0244ebe8dc6aae0a9f46e09/users/8f1da996e385476aaaebde05831ce66e/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.419644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37833ce8-9238-4e31-a1df-6ea39fe93b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72b734ba0244ebe8dc6aae0a9f46e09, user_id=8f1da996e385476aaaebde05831ce66e, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.422356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37833ce8-9238-4e31-a1df-6ea39fe93b2d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.450236 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1390/2821] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:29 2022] PUT /identity/v3/projects/a72b734ba0244ebe8dc6aae0a9f46e09/users/8f1da996e385476aaaebde05831ce66e/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:29.455790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6867-1d41-4984-a389-e50d930342a7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.456123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6867-1d41-4984-a389-e50d930342a7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.456380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e6867-1d41-4984-a389-e50d930342a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.493430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-046e6867-1d41-4984-a389-e50d930342a7 None None] MFA Rules not processed for user `8f1da996e385476aaaebde05831ce66e`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:29.495155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-046e6867-1d41-4984-a389-e50d930342a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:29.608878 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1432/2822] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:29.610338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37833ce8-9238-4e31-a1df-6ea39fe93b2d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.704235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37833ce8-9238-4e31-a1df-6ea39fe93b2d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.710854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e9e03-5f18-42c7-939a-d30b52e3dd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.711530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e9e03-5f18-42c7-939a-d30b52e3dd95 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.711871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e9e03-5f18-42c7-939a-d30b52e3dd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.712247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e9e03-5f18-42c7-939a-d30b52e3dd95 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.713590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e9e03-5f18-42c7-939a-d30b52e3dd95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.716325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e9e03-5f18-42c7-939a-d30b52e3dd95 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.764553 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1391/2823] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:29 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:29.768206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e6867-1d41-4984-a389-e50d930342a7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.782058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e6867-1d41-4984-a389-e50d930342a7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.868860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a478ac-2469-40ef-a123-7a084fd04a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.869487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a478ac-2469-40ef-a123-7a084fd04a6d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.869746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a478ac-2469-40ef-a123-7a084fd04a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.870024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a478ac-2469-40ef-a123-7a084fd04a6d admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.870710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a478ac-2469-40ef-a123-7a084fd04a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.872743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a478ac-2469-40ef-a123-7a084fd04a6d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.892844 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1433/2824] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:29 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:53:29.896825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e9e03-5f18-42c7-939a-d30b52e3dd95 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.907755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e9e03-5f18-42c7-939a-d30b52e3dd95 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.912489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9136c-60b7-43b6-b186-67784c9a82d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.913143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9136c-60b7-43b6-b186-67784c9a82d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.913427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9136c-60b7-43b6-b186-67784c9a82d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.913703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9136c-60b7-43b6-b186-67784c9a82d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.914417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9136c-60b7-43b6-b186-67784c9a82d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.916212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9136c-60b7-43b6-b186-67784c9a82d3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.927351 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1392/2825] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:53:29.931074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a478ac-2469-40ef-a123-7a084fd04a6d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:29.944617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a478ac-2469-40ef-a123-7a084fd04a6d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:29.951138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0c761-f5ac-4139-9af8-4e132aca1e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:29.952911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c761-f5ac-4139-9af8-4e132aca1e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:29.953431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c761-f5ac-4139-9af8-4e132aca1e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:29.953757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0c761-f5ac-4139-9af8-4e132aca1e08 admin admin] PATH_INFO: `/v3/projects/9a257529852c4930b30cc4178af44eec/users/07401095dce844d090b53911f1b2259f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:29.977032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0c761-f5ac-4139-9af8-4e132aca1e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a257529852c4930b30cc4178af44eec, user_id=07401095dce844d090b53911f1b2259f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:29.979800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0c761-f5ac-4139-9af8-4e132aca1e08 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:29.996068 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1434/2826] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:29 2022] PUT /identity/v3/projects/9a257529852c4930b30cc4178af44eec/users/07401095dce844d090b53911f1b2259f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:30.000177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9136c-60b7-43b6-b186-67784c9a82d3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:30.011816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9136c-60b7-43b6-b186-67784c9a82d3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:30.079190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede97892-b7c6-4dba-81e0-1b05c76b2bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:30.080157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97892-b7c6-4dba-81e0-1b05c76b2bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:30.080922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97892-b7c6-4dba-81e0-1b05c76b2bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:30.081212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede97892-b7c6-4dba-81e0-1b05c76b2bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:30.082198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede97892-b7c6-4dba-81e0-1b05c76b2bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:30.083876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede97892-b7c6-4dba-81e0-1b05c76b2bd1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:30.097655 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1393/2827] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:30.098506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0c761-f5ac-4139-9af8-4e132aca1e08 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:30.109949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0c761-f5ac-4139-9af8-4e132aca1e08 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:30.115133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b605c3-9ebc-475a-b0bf-4eb9d65c9f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:30.116278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b605c3-9ebc-475a-b0bf-4eb9d65c9f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:30.116630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b605c3-9ebc-475a-b0bf-4eb9d65c9f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:30.116980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b605c3-9ebc-475a-b0bf-4eb9d65c9f91 admin admin] PATH_INFO: `/v3/projects/9a257529852c4930b30cc4178af44eec/users/07401095dce844d090b53911f1b2259f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:30.119807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b605c3-9ebc-475a-b0bf-4eb9d65c9f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a257529852c4930b30cc4178af44eec, user_id=07401095dce844d090b53911f1b2259f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:30.122440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b605c3-9ebc-475a-b0bf-4eb9d65c9f91 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:30.133941 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1435/2828] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:30 2022] PUT /identity/v3/projects/9a257529852c4930b30cc4178af44eec/users/07401095dce844d090b53911f1b2259f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:53:30.144579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306179c-b176-4aec-be50-4a78415a7e99 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:30.144870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306179c-b176-4aec-be50-4a78415a7e99 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:30.145334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306179c-b176-4aec-be50-4a78415a7e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:30.185892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7306179c-b176-4aec-be50-4a78415a7e99 None None] MFA Rules not processed for user `07401095dce844d090b53911f1b2259f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:30.187414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7306179c-b176-4aec-be50-4a78415a7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:30.264429 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1394/2829] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:30.276388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b605c3-9ebc-475a-b0bf-4eb9d65c9f91 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:30.278112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-50b605c3-9ebc-475a-b0bf-4eb9d65c9f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:30.363013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b605c3-9ebc-475a-b0bf-4eb9d65c9f91 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:30.371104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee25b38-2cda-422c-9433-f8757a99f81f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:30.371777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee25b38-2cda-422c-9433-f8757a99f81f service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:30.372151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee25b38-2cda-422c-9433-f8757a99f81f service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:30.372490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee25b38-2cda-422c-9433-f8757a99f81f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:30.382661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee25b38-2cda-422c-9433-f8757a99f81f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:30.384446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee25b38-2cda-422c-9433-f8757a99f81f service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:30.395978 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1436/2830] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:31.158299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306179c-b176-4aec-be50-4a78415a7e99 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:31.274437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306179c-b176-4aec-be50-4a78415a7e99 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:31.282385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:31.283991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:31.284285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:31.284568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] PATH_INFO: `/v3/users/8f1da996e385476aaaebde05831ce66e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:31.286048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1da996e385476aaaebde05831ce66e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:31.288482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:31.376412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1da996e385476aaaebde05831ce66e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:31.402753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1da996e385476aaaebde05831ce66e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:31.403421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1da996e385476aaaebde05831ce66e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:31.404127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1da996e385476aaaebde05831ce66e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:31.440337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1da996e385476aaaebde05831ce66e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:31.458288 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1395/2831] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:31 2022] DELETE /identity/v3/users/8f1da996e385476aaaebde05831ce66e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:31.460337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caab0b-98fb-47a1-8f3a-f0ac86e75441 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:31.460814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caab0b-98fb-47a1-8f3a-f0ac86e75441 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:31.461036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9caab0b-98fb-47a1-8f3a-f0ac86e75441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:31.498716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f9caab0b-98fb-47a1-8f3a-f0ac86e75441 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:31.499991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f9caab0b-98fb-47a1-8f3a-f0ac86e75441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:31.579428 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1437/2832] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:31.591678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:31.593679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:31.654920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405a88f-a552-4d53-a873-b79596da81f8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:31.677467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc483dc-cc1c-42e8-a2f8-666e8b41f4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:31.678053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc483dc-cc1c-42e8-a2f8-666e8b41f4ad service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:31.678332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc483dc-cc1c-42e8-a2f8-666e8b41f4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:31.678652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc483dc-cc1c-42e8-a2f8-666e8b41f4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:31.692290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc483dc-cc1c-42e8-a2f8-666e8b41f4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:31.693867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc483dc-cc1c-42e8-a2f8-666e8b41f4ad service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:31.721383 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1396/2833] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:32.226953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caab0b-98fb-47a1-8f3a-f0ac86e75441 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:32.231318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f9caab0b-98fb-47a1-8f3a-f0ac86e75441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:32.252550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9caab0b-98fb-47a1-8f3a-f0ac86e75441 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:32.279693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:32.280599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:32.281056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:32.281491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] PATH_INFO: `/v3/projects/a72b734ba0244ebe8dc6aae0a9f46e09` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:32.282895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72b734ba0244ebe8dc6aae0a9f46e09)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:32.286256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:32.397914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72b734ba0244ebe8dc6aae0a9f46e09', 'request_id': 'req-d87776ae-d71c-425b-8f75-ce75dde6438d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.409023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72b734ba0244ebe8dc6aae0a9f46e09', 'request_id': 'req-d87776ae-d71c-425b-8f75-ce75dde6438d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.442759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72b734ba0244ebe8dc6aae0a9f46e09', 'request_id': 'req-d87776ae-d71c-425b-8f75-ce75dde6438d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.499311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] The token cache is being invalidate because project a72b734ba0244ebe8dc6aae0a9f46e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:32.500810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.501866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d87776ae-d71c-425b-8f75-ce75dde6438d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.505094 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1438/2834] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:32 2022] DELETE /identity/v3/projects/a72b734ba0244ebe8dc6aae0a9f46e09 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:32.512842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc483dc-cc1c-42e8-a2f8-666e8b41f4ad service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:32.529597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc483dc-cc1c-42e8-a2f8-666e8b41f4ad service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:32.598636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b783-2b42-4aa6-93b4-7d8e0cd0f088 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:32.598924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b783-2b42-4aa6-93b4-7d8e0cd0f088 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:32.599472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4b783-2b42-4aa6-93b4-7d8e0cd0f088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:32.632130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-36d4b783-2b42-4aa6-93b4-7d8e0cd0f088 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:32.634221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-36d4b783-2b42-4aa6-93b4-7d8e0cd0f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:32.648614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:32.650642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:32.651047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:32.651405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] PATH_INFO: `/v3/users/07401095dce844d090b53911f1b2259f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:32.659665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07401095dce844d090b53911f1b2259f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:32.661931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:32.748375 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1439/2835] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:53:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:32.751160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07401095dce844d090b53911f1b2259f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.762980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b783-2b42-4aa6-93b4-7d8e0cd0f088 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:32.764282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07401095dce844d090b53911f1b2259f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.766758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07401095dce844d090b53911f1b2259f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.768603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-36d4b783-2b42-4aa6-93b4-7d8e0cd0f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:32.769362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07401095dce844d090b53911f1b2259f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.794958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07401095dce844d090b53911f1b2259f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:32.809698 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1397/2836] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:32 2022] DELETE /identity/v3/users/07401095dce844d090b53911f1b2259f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:32.899816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4b783-2b42-4aa6-93b4-7d8e0cd0f088 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:33.056981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb9673-6c1f-4ef2-91ea-5d3beda22e80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:33.057670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb9673-6c1f-4ef2-91ea-5d3beda22e80 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:33.057961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb9673-6c1f-4ef2-91ea-5d3beda22e80 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:33.060890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb9673-6c1f-4ef2-91ea-5d3beda22e80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:33.065559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82cb9673-6c1f-4ef2-91ea-5d3beda22e80 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:33.185565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb9673-6c1f-4ef2-91ea-5d3beda22e80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:33.191944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb9673-6c1f-4ef2-91ea-5d3beda22e80 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:33.211070 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1440/2837] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:53:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:53:33.391083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:33.392719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:33.670280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0845765-a870-4af6-a691-1d2c8ef81e56 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:33.697024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:33.698769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:33.714243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:33.714797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] PATH_INFO: `/v3/projects/9a257529852c4930b30cc4178af44eec` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:33.716883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a257529852c4930b30cc4178af44eec)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:33.719272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:33.889799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a257529852c4930b30cc4178af44eec', 'request_id': 'req-37998051-c9ce-4884-a382-02fe451d0aaa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:33.909727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a257529852c4930b30cc4178af44eec', 'request_id': 'req-37998051-c9ce-4884-a382-02fe451d0aaa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:33.916552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a257529852c4930b30cc4178af44eec', 'request_id': 'req-37998051-c9ce-4884-a382-02fe451d0aaa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:33.939331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] The token cache is being invalidate because project 9a257529852c4930b30cc4178af44eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:33.939804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:33.943300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-37998051-c9ce-4884-a382-02fe451d0aaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:33.947005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1398/2838] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:33 2022] DELETE /identity/v3/projects/9a257529852c4930b30cc4178af44eec => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:33.953817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a3db-327b-4f64-90da-e918ebb4f83a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:33.954395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a3db-327b-4f64-90da-e918ebb4f83a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:33.955007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00a3db-327b-4f64-90da-e918ebb4f83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:33.995403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2d00a3db-327b-4f64-90da-e918ebb4f83a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:33.997212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2d00a3db-327b-4f64-90da-e918ebb4f83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:34.146938 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1441/2839] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:34.155873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd72696-7d7b-49a6-8f5e-47dcc582352f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:34.156555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd72696-7d7b-49a6-8f5e-47dcc582352f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:34.156997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd72696-7d7b-49a6-8f5e-47dcc582352f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:34.198524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4bd72696-7d7b-49a6-8f5e-47dcc582352f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:34.200829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4bd72696-7d7b-49a6-8f5e-47dcc582352f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:34.220323 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1399/2840] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:34.224392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00a3db-327b-4f64-90da-e918ebb4f83a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:34.238790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00a3db-327b-4f64-90da-e918ebb4f83a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:34.255091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee0541-c7a5-4a14-b28f-16c5b4149dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:34.255695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee0541-c7a5-4a14-b28f-16c5b4149dfb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:34.256002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee0541-c7a5-4a14-b28f-16c5b4149dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:34.256280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee0541-c7a5-4a14-b28f-16c5b4149dfb admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:34.257014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee0541-c7a5-4a14-b28f-16c5b4149dfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:53:34.257321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee0541-c7a5-4a14-b28f-16c5b4149dfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:34.258953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee0541-c7a5-4a14-b28f-16c5b4149dfb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:34.296118 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1442/2841] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:53:34.300602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd72696-7d7b-49a6-8f5e-47dcc582352f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:34.311133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd72696-7d7b-49a6-8f5e-47dcc582352f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:34.330635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46cf9d-2b60-45b4-aabb-9a48d4ede425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:34.331325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46cf9d-2b60-45b4-aabb-9a48d4ede425 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:34.331616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46cf9d-2b60-45b4-aabb-9a48d4ede425 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:34.331897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46cf9d-2b60-45b4-aabb-9a48d4ede425 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:34.333379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46cf9d-2b60-45b4-aabb-9a48d4ede425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:34.335406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46cf9d-2b60-45b4-aabb-9a48d4ede425 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:34.391722 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1400/2842] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:34 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:34.396154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee0541-c7a5-4a14-b28f-16c5b4149dfb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:34.407776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee0541-c7a5-4a14-b28f-16c5b4149dfb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:34.554836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8b30-5a69-4356-a1a0-9a8c9b3902c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:34.555898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8b30-5a69-4356-a1a0-9a8c9b3902c3 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:34.556966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8b30-5a69-4356-a1a0-9a8c9b3902c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:34.557514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8b30-5a69-4356-a1a0-9a8c9b3902c3 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:34.558441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8b30-5a69-4356-a1a0-9a8c9b3902c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:34.560839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8b30-5a69-4356-a1a0-9a8c9b3902c3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:34.612383 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1443/2843] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:34 2022] POST /identity/v3/users => generated 300 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:34.623826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46cf9d-2b60-45b4-aabb-9a48d4ede425 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:34.639746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46cf9d-2b60-45b4-aabb-9a48d4ede425 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:34.662196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfabe8f-9bd2-43ae-b679-62d7b59c4531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:34.662935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfabe8f-9bd2-43ae-b679-62d7b59c4531 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:34.663221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfabe8f-9bd2-43ae-b679-62d7b59c4531 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:34.663552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfabe8f-9bd2-43ae-b679-62d7b59c4531 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:34.664309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfabe8f-9bd2-43ae-b679-62d7b59c4531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:34.666830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfabe8f-9bd2-43ae-b679-62d7b59c4531 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:34.698851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8b30-5a69-4356-a1a0-9a8c9b3902c3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:34.711353 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1401/2844] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:53:34.712275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8b30-5a69-4356-a1a0-9a8c9b3902c3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:34.743010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27890f-75be-4ef1-8483-35846988d3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:34.743700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27890f-75be-4ef1-8483-35846988d3ae admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:34.744544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27890f-75be-4ef1-8483-35846988d3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:34.744820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27890f-75be-4ef1-8483-35846988d3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:34.745550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27890f-75be-4ef1-8483-35846988d3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:34.747647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27890f-75be-4ef1-8483-35846988d3ae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:34.777235 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1444/2845] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:34.781377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfabe8f-9bd2-43ae-b679-62d7b59c4531 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:34.792986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfabe8f-9bd2-43ae-b679-62d7b59c4531 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:34.807654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a7a3f-0bfd-43aa-8232-4ce8145f739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:34.808656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a7a3f-0bfd-43aa-8232-4ce8145f739a admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:34.808975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a7a3f-0bfd-43aa-8232-4ce8145f739a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:34.809322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a7a3f-0bfd-43aa-8232-4ce8145f739a admin admin] PATH_INFO: `/v3/projects/694d75f444f945149291f9eff6970f64/users/3eb4893093f84e1da21b867505d1f75e/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:34.844837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a7a3f-0bfd-43aa-8232-4ce8145f739a admin admin] RBAC: Authorizing `identity:create_grant(project_id=694d75f444f945149291f9eff6970f64, user_id=3eb4893093f84e1da21b867505d1f75e, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:34.849306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a7a3f-0bfd-43aa-8232-4ce8145f739a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:34.892317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1402/2846] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:34 2022] PUT /identity/v3/projects/694d75f444f945149291f9eff6970f64/users/3eb4893093f84e1da21b867505d1f75e/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:34.906474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd54b7-8183-474e-bb8f-1c1f8b049ecf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:34.907030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd54b7-8183-474e-bb8f-1c1f8b049ecf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:34.907708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd54b7-8183-474e-bb8f-1c1f8b049ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:34.964829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e3fd54b7-8183-474e-bb8f-1c1f8b049ecf None None] MFA Rules not processed for user `3eb4893093f84e1da21b867505d1f75e`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:34.966761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e3fd54b7-8183-474e-bb8f-1c1f8b049ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:35.136826 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1445/2847] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:35.141765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a7a3f-0bfd-43aa-8232-4ce8145f739a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:35.254112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a7a3f-0bfd-43aa-8232-4ce8145f739a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:35.262579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882b4ed-a8a4-42cc-9baf-9dab0d7988ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:35.264736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882b4ed-a8a4-42cc-9baf-9dab0d7988ab admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:35.265185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882b4ed-a8a4-42cc-9baf-9dab0d7988ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:35.265616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882b4ed-a8a4-42cc-9baf-9dab0d7988ab admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:35.266475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882b4ed-a8a4-42cc-9baf-9dab0d7988ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:35.268615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882b4ed-a8a4-42cc-9baf-9dab0d7988ab admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:35.327531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd54b7-8183-474e-bb8f-1c1f8b049ecf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:35.339851 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1403/2848] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:35 2022] POST /identity/v3/projects => generated 403 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:53:35.343155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd54b7-8183-474e-bb8f-1c1f8b049ecf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:35.482732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132a81-6fb8-4f41-a815-64f8266e4af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:35.485053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132a81-6fb8-4f41-a815-64f8266e4af2 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:35.485354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132a81-6fb8-4f41-a815-64f8266e4af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:35.485643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132a81-6fb8-4f41-a815-64f8266e4af2 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:35.486358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54132a81-6fb8-4f41-a815-64f8266e4af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:35.488405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54132a81-6fb8-4f41-a815-64f8266e4af2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:35.570789 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1446/2849] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:35 2022] POST /identity/v3/users => generated 308 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:53:35.573188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882b4ed-a8a4-42cc-9baf-9dab0d7988ab admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:35.593487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882b4ed-a8a4-42cc-9baf-9dab0d7988ab admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:35.634276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d26ba-dce4-4b52-8032-a23e3e1d6141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:35.635027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d26ba-dce4-4b52-8032-a23e3e1d6141 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:35.635318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d26ba-dce4-4b52-8032-a23e3e1d6141 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:35.635600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d26ba-dce4-4b52-8032-a23e3e1d6141 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:35.646286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d26ba-dce4-4b52-8032-a23e3e1d6141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:35.649421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d26ba-dce4-4b52-8032-a23e3e1d6141 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:35.666978 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1404/2850] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:35.671119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132a81-6fb8-4f41-a815-64f8266e4af2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:35.690725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132a81-6fb8-4f41-a815-64f8266e4af2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:35.699218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332d577-cd06-46ff-850e-b12f391202c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:35.700768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332d577-cd06-46ff-850e-b12f391202c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:35.701096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332d577-cd06-46ff-850e-b12f391202c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:35.701668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332d577-cd06-46ff-850e-b12f391202c1 admin admin] PATH_INFO: `/v3/projects/5d7490a21876449d9f0eb73136adbb0e/users/b1b471ef761344299f4864ea649cf3d0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:35.738636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332d577-cd06-46ff-850e-b12f391202c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7490a21876449d9f0eb73136adbb0e, user_id=b1b471ef761344299f4864ea649cf3d0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:35.742260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b332d577-cd06-46ff-850e-b12f391202c1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:35.771324 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1447/2851] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:35 2022] PUT /identity/v3/projects/5d7490a21876449d9f0eb73136adbb0e/users/b1b471ef761344299f4864ea649cf3d0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:35.772841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d26ba-dce4-4b52-8032-a23e3e1d6141 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:35.792739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d26ba-dce4-4b52-8032-a23e3e1d6141 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:35.873173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf0337-1be5-447a-b788-e9cccaa29e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:35.875363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf0337-1be5-447a-b788-e9cccaa29e32 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:35.876673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf0337-1be5-447a-b788-e9cccaa29e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:35.877151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf0337-1be5-447a-b788-e9cccaa29e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:35.878136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf0337-1be5-447a-b788-e9cccaa29e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:35.880326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf0337-1be5-447a-b788-e9cccaa29e32 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:35.896186 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1405/2852] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:35.900916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332d577-cd06-46ff-850e-b12f391202c1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:35.923062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332d577-cd06-46ff-850e-b12f391202c1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:35.935466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540edba-683e-479d-ae0a-0b7a95d896eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:35.937945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540edba-683e-479d-ae0a-0b7a95d896eb admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:35.938450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540edba-683e-479d-ae0a-0b7a95d896eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:35.938887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540edba-683e-479d-ae0a-0b7a95d896eb admin admin] PATH_INFO: `/v3/projects/5d7490a21876449d9f0eb73136adbb0e/users/b1b471ef761344299f4864ea649cf3d0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:35.943225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540edba-683e-479d-ae0a-0b7a95d896eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d7490a21876449d9f0eb73136adbb0e, user_id=b1b471ef761344299f4864ea649cf3d0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:35.948908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540edba-683e-479d-ae0a-0b7a95d896eb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:35.973500 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1448/2853] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:35 2022] PUT /identity/v3/projects/5d7490a21876449d9f0eb73136adbb0e/users/b1b471ef761344299f4864ea649cf3d0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:35.983373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda9ca-62df-4ddc-8023-74a9b265c42e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:35.983749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda9ca-62df-4ddc-8023-74a9b265c42e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:35.983978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eda9ca-62df-4ddc-8023-74a9b265c42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:36.048046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-60eda9ca-62df-4ddc-8023-74a9b265c42e None None] MFA Rules not processed for user `b1b471ef761344299f4864ea649cf3d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:36.049676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-60eda9ca-62df-4ddc-8023-74a9b265c42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:36.194327 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1406/2854] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:36.857254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540edba-683e-479d-ae0a-0b7a95d896eb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:36.859562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5540edba-683e-479d-ae0a-0b7a95d896eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:36.996081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540edba-683e-479d-ae0a-0b7a95d896eb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:37.012263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8981c1-f7db-4eda-889d-02eb7cf73a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:37.013184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8981c1-f7db-4eda-889d-02eb7cf73a6f service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:37.013593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8981c1-f7db-4eda-889d-02eb7cf73a6f service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:37.013890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8981c1-f7db-4eda-889d-02eb7cf73a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:37.075210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8981c1-f7db-4eda-889d-02eb7cf73a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:37.081765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8981c1-f7db-4eda-889d-02eb7cf73a6f service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:37.120302 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1449/2855] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:38.583317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eda9ca-62df-4ddc-8023-74a9b265c42e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:38.605701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eda9ca-62df-4ddc-8023-74a9b265c42e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:38.620471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38174e-aa7b-4126-a5ec-70209f214169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:38.621447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38174e-aa7b-4126-a5ec-70209f214169 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:38.623237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38174e-aa7b-4126-a5ec-70209f214169 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:38.625453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38174e-aa7b-4126-a5ec-70209f214169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:38.751778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38174e-aa7b-4126-a5ec-70209f214169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:38.753437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38174e-aa7b-4126-a5ec-70209f214169 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:38.793937 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1407/2856] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:38.819741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8981c1-f7db-4eda-889d-02eb7cf73a6f service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:39.016602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8981c1-f7db-4eda-889d-02eb7cf73a6f service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:39.036778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:39.039190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:39.040143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:39.040573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] PATH_INFO: `/v3/users/3eb4893093f84e1da21b867505d1f75e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:39.046996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb4893093f84e1da21b867505d1f75e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:39.049170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:39.167008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb4893093f84e1da21b867505d1f75e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:39.183765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb4893093f84e1da21b867505d1f75e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:39.184808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb4893093f84e1da21b867505d1f75e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:39.185804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb4893093f84e1da21b867505d1f75e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:39.220216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb4893093f84e1da21b867505d1f75e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:39.280672 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1450/2857] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:38 2022] DELETE /identity/v3/users/3eb4893093f84e1da21b867505d1f75e => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:39.285057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248009-f03c-4cec-8960-9cf43ba3abf8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:39.285347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248009-f03c-4cec-8960-9cf43ba3abf8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:39.285622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91248009-f03c-4cec-8960-9cf43ba3abf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:39.345688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-91248009-f03c-4cec-8960-9cf43ba3abf8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:39.356724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-91248009-f03c-4cec-8960-9cf43ba3abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:39.553797 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1408/2858] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:39.582962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:39.585376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:39.734523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522aa8b-9024-4617-bfaf-c35873bb1e9d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:39.749225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e179b4b-ca66-40c3-a378-31afc679253d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:39.750711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e179b4b-ca66-40c3-a378-31afc679253d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:39.753537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e179b4b-ca66-40c3-a378-31afc679253d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:39.753994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e179b4b-ca66-40c3-a378-31afc679253d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:39.783045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e179b4b-ca66-40c3-a378-31afc679253d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:39.789394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e179b4b-ca66-40c3-a378-31afc679253d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:39.823151 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1451/2859] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:40.131092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248009-f03c-4cec-8960-9cf43ba3abf8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:40.132269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-91248009-f03c-4cec-8960-9cf43ba3abf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:40.155663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e179b4b-ca66-40c3-a378-31afc679253d service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:40.158839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3e179b4b-ca66-40c3-a378-31afc679253d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:40.159156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91248009-f03c-4cec-8960-9cf43ba3abf8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:40.186761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:40.187656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:40.187957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:40.188243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] PATH_INFO: `/v3/users/f730effcbf03473fbdb527fa499ec181` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:40.195044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f730effcbf03473fbdb527fa499ec181)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:40.197880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:40.199194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e179b4b-ca66-40c3-a378-31afc679253d service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:40.216180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:40.217648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:40.218518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:40.219025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] PATH_INFO: `/v3/users/e0d8624aaea84e50bdb942487d921f81` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:40.223455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d8624aaea84e50bdb942487d921f81)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:40.227671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:40.350288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f730effcbf03473fbdb527fa499ec181'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.375594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f730effcbf03473fbdb527fa499ec181'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.375594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f730effcbf03473fbdb527fa499ec181'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.376508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f730effcbf03473fbdb527fa499ec181'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.387727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d8624aaea84e50bdb942487d921f81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.406999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d8624aaea84e50bdb942487d921f81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.410051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d8624aaea84e50bdb942487d921f81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.411403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d8624aaea84e50bdb942487d921f81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.423801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f730effcbf03473fbdb527fa499ec181'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.434590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d8624aaea84e50bdb942487d921f81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:40.470558 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1409/2860] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:40 2022] DELETE /identity/v3/users/f730effcbf03473fbdb527fa499ec181 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:40.483124 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1452/2861] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:40 2022] DELETE /identity/v3/users/e0d8624aaea84e50bdb942487d921f81 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:41.270282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:41.271869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:41.274164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:41.274296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:41.370236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeadf7e-c0c2-4b99-af11-75938f194320 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:41.485052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54132114-95a1-440a-b4fb-6845cc8cdf76 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:41.513352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:41.514677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:41.515148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:41.515638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] PATH_INFO: `/v3/projects/d6be1f9d2cf4446c9e936785fc70de17` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:41.520038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6be1f9d2cf4446c9e936785fc70de17)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:41.528991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:41.541770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:41.542832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:41.543116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:41.543389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] PATH_INFO: `/v3/projects/c71abac018054ac59df8204f06278c20` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:41.544814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71abac018054ac59df8204f06278c20)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:41.547042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:41.646950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6be1f9d2cf4446c9e936785fc70de17', 'request_id': 'req-35fffdc2-d42a-47ef-bce4-659308651462'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.665549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71abac018054ac59df8204f06278c20', 'request_id': 'req-780197f6-f3c3-4ae4-9a27-a976653be9f9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.666672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6be1f9d2cf4446c9e936785fc70de17', 'request_id': 'req-35fffdc2-d42a-47ef-bce4-659308651462'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.680905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6be1f9d2cf4446c9e936785fc70de17', 'request_id': 'req-35fffdc2-d42a-47ef-bce4-659308651462'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.689189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71abac018054ac59df8204f06278c20', 'request_id': 'req-780197f6-f3c3-4ae4-9a27-a976653be9f9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.705945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71abac018054ac59df8204f06278c20', 'request_id': 'req-780197f6-f3c3-4ae4-9a27-a976653be9f9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.708280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] The token cache is being invalidate because project d6be1f9d2cf4446c9e936785fc70de17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:41.708804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.709691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.714812 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1453/2862] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:41 2022] DELETE /identity/v3/projects/d6be1f9d2cf4446c9e936785fc70de17 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:41.717474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:41.722558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:41.736220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] The token cache is being invalidate because project c71abac018054ac59df8204f06278c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:41.736581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.737395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780197f6-f3c3-4ae4-9a27-a976653be9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:41.743552 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1410/2863] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:41 2022] DELETE /identity/v3/projects/c71abac018054ac59df8204f06278c20 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:41.745255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc9cc7-c8c9-445b-9cf9-01af371b2346 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:41.745433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc9cc7-c8c9-445b-9cf9-01af371b2346 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:41.745677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc9cc7-c8c9-445b-9cf9-01af371b2346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:41.792173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-36dc9cc7-c8c9-445b-9cf9-01af371b2346 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:41.793384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-36dc9cc7-c8c9-445b-9cf9-01af371b2346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:41.854757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fffdc2-d42a-47ef-bce4-659308651462 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:41.925849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:41.926996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:41.927471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:41.928151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] PATH_INFO: `/v3/projects/694d75f444f945149291f9eff6970f64` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:41.930103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=694d75f444f945149291f9eff6970f64)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:41.933140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:41.950209 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1411/2864] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:41.953467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc9cc7-c8c9-445b-9cf9-01af371b2346 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:41.957028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-36dc9cc7-c8c9-445b-9cf9-01af371b2346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:41.993831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc9cc7-c8c9-445b-9cf9-01af371b2346 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:42.007461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:42.008577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:42.008901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:42.018030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] PATH_INFO: `/v3/users/84a254c1a9994724816a8627919f2197` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:42.022078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a254c1a9994724816a8627919f2197)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:42.024423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694d75f444f945149291f9eff6970f64', 'request_id': 'req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.039583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:42.050881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694d75f444f945149291f9eff6970f64', 'request_id': 'req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.062831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694d75f444f945149291f9eff6970f64', 'request_id': 'req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.086256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] The token cache is being invalidate because project 694d75f444f945149291f9eff6970f64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:42.086540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.087892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b66c52f8-1dc8-4a84-a723-35ad7cdf80b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.094988 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1454/2865] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:41 2022] DELETE /identity/v3/projects/694d75f444f945149291f9eff6970f64 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:42.095196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384ed1a-bd3c-4b2d-a139-f2631dbc74ae None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:42.095455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384ed1a-bd3c-4b2d-a139-f2631dbc74ae None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:42.095788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384ed1a-bd3c-4b2d-a139-f2631dbc74ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:42.135576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a254c1a9994724816a8627919f2197'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.140180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6384ed1a-bd3c-4b2d-a139-f2631dbc74ae None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:42.141400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6384ed1a-bd3c-4b2d-a139-f2631dbc74ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:42.159753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a254c1a9994724816a8627919f2197'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.160944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a254c1a9994724816a8627919f2197'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.167094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a254c1a9994724816a8627919f2197'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.189246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a254c1a9994724816a8627919f2197'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.212800 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1412/2866] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:41 2022] DELETE /identity/v3/users/84a254c1a9994724816a8627919f2197 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:42.216416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:42.220223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:42.245636 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1455/2867] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:42.248572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384ed1a-bd3c-4b2d-a139-f2631dbc74ae None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:42.261876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384ed1a-bd3c-4b2d-a139-f2631dbc74ae None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:42.337226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56166ca-0d1d-4aa9-b2c7-e90c92192e33 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:42.345186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:42.346538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:42.347322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:42.347763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] PATH_INFO: `/v3/users/b1b471ef761344299f4864ea649cf3d0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:42.349798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1b471ef761344299f4864ea649cf3d0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:42.352572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:42.423695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc26f36-d556-4852-9d92-c8afc8e09e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:42.424510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc26f36-d556-4852-9d92-c8afc8e09e6a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:42.424796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc26f36-d556-4852-9d92-c8afc8e09e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:42.425075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc26f36-d556-4852-9d92-c8afc8e09e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:42.427147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc26f36-d556-4852-9d92-c8afc8e09e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:53:42.427332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc26f36-d556-4852-9d92-c8afc8e09e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:42.430791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc26f36-d556-4852-9d92-c8afc8e09e6a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:42.448682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1b471ef761344299f4864ea649cf3d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.449409 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1456/2868] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:53:42.456381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc26f36-d556-4852-9d92-c8afc8e09e6a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:42.464521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1b471ef761344299f4864ea649cf3d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.465320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1b471ef761344299f4864ea649cf3d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.466027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1b471ef761344299f4864ea649cf3d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.473326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc26f36-d556-4852-9d92-c8afc8e09e6a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:42.486931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1b471ef761344299f4864ea649cf3d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:42.493654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02f779-7af7-42a5-80c0-cef8445ed597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:42.497283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02f779-7af7-42a5-80c0-cef8445ed597 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:42.497856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02f779-7af7-42a5-80c0-cef8445ed597 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:42.498322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02f779-7af7-42a5-80c0-cef8445ed597 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:42.500992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02f779-7af7-42a5-80c0-cef8445ed597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:42.506152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02f779-7af7-42a5-80c0-cef8445ed597 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:42.526798 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1413/2869] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:42 2022] DELETE /identity/v3/users/b1b471ef761344299f4864ea649cf3d0 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:42.571107 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1457/2870] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:42 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:42.573634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:42.580724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:42.762082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c13c6-ae04-4684-b647-0f38d8e9bcb1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:42.847815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac13b-b552-4470-93dd-575bbb8c4a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:42.849007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac13b-b552-4470-93dd-575bbb8c4a83 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:42.849440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac13b-b552-4470-93dd-575bbb8c4a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:42.849959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edac13b-b552-4470-93dd-575bbb8c4a83 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:42.850791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edac13b-b552-4470-93dd-575bbb8c4a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:42.852988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edac13b-b552-4470-93dd-575bbb8c4a83 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:42.881038 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1414/2871] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:42 2022] POST /identity/v3/users => generated 287 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:42.882204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02f779-7af7-42a5-80c0-cef8445ed597 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:42.899851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02f779-7af7-42a5-80c0-cef8445ed597 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:42.908977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6b5e7-cae5-4aad-9a8a-2534b81aa9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:42.909999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6b5e7-cae5-4aad-9a8a-2534b81aa9ed admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:42.910417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6b5e7-cae5-4aad-9a8a-2534b81aa9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:42.910826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6b5e7-cae5-4aad-9a8a-2534b81aa9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:42.911953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6b5e7-cae5-4aad-9a8a-2534b81aa9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:42.914233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6b5e7-cae5-4aad-9a8a-2534b81aa9ed admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:42.937676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac13b-b552-4470-93dd-575bbb8c4a83 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:42.952773 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1458/2872] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:42.955177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edac13b-b552-4470-93dd-575bbb8c4a83 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:42.963897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502211e6-d10a-4095-b0f4-91c131937bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:42.964852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502211e6-d10a-4095-b0f4-91c131937bff admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:42.965287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502211e6-d10a-4095-b0f4-91c131937bff admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:42.965709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502211e6-d10a-4095-b0f4-91c131937bff admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:42.966621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502211e6-d10a-4095-b0f4-91c131937bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:42.968707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502211e6-d10a-4095-b0f4-91c131937bff admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:42.987417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6b5e7-cae5-4aad-9a8a-2534b81aa9ed admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:42.995442 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1415/2873] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:43.000107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6b5e7-cae5-4aad-9a8a-2534b81aa9ed admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:43.012979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c96fa-a2da-4325-8a21-3d0167720483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:43.014079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c96fa-a2da-4325-8a21-3d0167720483 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:43.014535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c96fa-a2da-4325-8a21-3d0167720483 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:43.014993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c96fa-a2da-4325-8a21-3d0167720483 admin admin] PATH_INFO: `/v3/projects/ced52873fc7241779d52c0fb66e56bae/users/8ec5c027b8a84b9cb85214bec04168af/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:43.037857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c96fa-a2da-4325-8a21-3d0167720483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced52873fc7241779d52c0fb66e56bae, user_id=8ec5c027b8a84b9cb85214bec04168af, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:43.041521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366c96fa-a2da-4325-8a21-3d0167720483 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:43.081934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0b5e1-d810-4edd-8ee3-a7fa7dee5630 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:43.082928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0b5e1-d810-4edd-8ee3-a7fa7dee5630 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:43.083286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0b5e1-d810-4edd-8ee3-a7fa7dee5630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:43.085282 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1459/2874] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:42 2022] PUT /identity/v3/projects/ced52873fc7241779d52c0fb66e56bae/users/8ec5c027b8a84b9cb85214bec04168af/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:53:43.107669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7bd0b5e1-d810-4edd-8ee3-a7fa7dee5630 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:43.108866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7bd0b5e1-d810-4edd-8ee3-a7fa7dee5630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:43.182797 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1416/2875] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:43.206917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c96fa-a2da-4325-8a21-3d0167720483 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:43.210444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-366c96fa-a2da-4325-8a21-3d0167720483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:43.302609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366c96fa-a2da-4325-8a21-3d0167720483 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:43.309637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62812f-7d09-4683-bd73-935b9b1cd0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:43.310980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62812f-7d09-4683-bd73-935b9b1cd0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:43.311337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62812f-7d09-4683-bd73-935b9b1cd0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:43.311615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62812f-7d09-4683-bd73-935b9b1cd0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:43.328281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62812f-7d09-4683-bd73-935b9b1cd0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:43.330242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62812f-7d09-4683-bd73-935b9b1cd0d1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:43.350286 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1460/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:43.391085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0b5e1-d810-4edd-8ee3-a7fa7dee5630 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:43.393156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7bd0b5e1-d810-4edd-8ee3-a7fa7dee5630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:43.419099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0b5e1-d810-4edd-8ee3-a7fa7dee5630 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:43.435906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:43.437472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:43.437800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:43.438070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] PATH_INFO: `/v3/projects/e0273c95d29a40b28247cc2d3f2bd7c2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:43.440585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0273c95d29a40b28247cc2d3f2bd7c2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:43.442688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:43.498523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62812f-7d09-4683-bd73-935b9b1cd0d1 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:43.510261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cd62812f-7d09-4683-bd73-935b9b1cd0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:43.534251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62812f-7d09-4683-bd73-935b9b1cd0d1 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:43.549837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:43.555493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:43.557085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:43.557436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] PATH_INFO: `/v3/projects/5d7490a21876449d9f0eb73136adbb0e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:43.561727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d7490a21876449d9f0eb73136adbb0e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:43.564144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:43.615669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0273c95d29a40b28247cc2d3f2bd7c2', 'request_id': 'req-e77b752e-5cfb-418d-9815-59bc4ba1405c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.636047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0273c95d29a40b28247cc2d3f2bd7c2', 'request_id': 'req-e77b752e-5cfb-418d-9815-59bc4ba1405c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.646065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0273c95d29a40b28247cc2d3f2bd7c2', 'request_id': 'req-e77b752e-5cfb-418d-9815-59bc4ba1405c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.684350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] The token cache is being invalidate because project e0273c95d29a40b28247cc2d3f2bd7c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:43.692422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.698269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e77b752e-5cfb-418d-9815-59bc4ba1405c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.700366 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1417/2877] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:43 2022] DELETE /identity/v3/projects/e0273c95d29a40b28247cc2d3f2bd7c2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:43.705850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e886b1f-67dc-419b-bea4-e20a095604f6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:43.706128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e886b1f-67dc-419b-bea4-e20a095604f6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:43.706412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e886b1f-67dc-419b-bea4-e20a095604f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:43.739845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d7490a21876449d9f0eb73136adbb0e', 'request_id': 'req-8674e794-522b-4bea-a956-d87a5babba98'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.757658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d7490a21876449d9f0eb73136adbb0e', 'request_id': 'req-8674e794-522b-4bea-a956-d87a5babba98'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.762798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6e886b1f-67dc-419b-bea4-e20a095604f6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:43.764123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6e886b1f-67dc-419b-bea4-e20a095604f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:43.770425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d7490a21876449d9f0eb73136adbb0e', 'request_id': 'req-8674e794-522b-4bea-a956-d87a5babba98'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.816457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] The token cache is being invalidate because project 5d7490a21876449d9f0eb73136adbb0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:43.822572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.829338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8674e794-522b-4bea-a956-d87a5babba98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:43.831292 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1461/2878] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:43 2022] DELETE /identity/v3/projects/5d7490a21876449d9f0eb73136adbb0e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:53:43.840865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1cc1-8e77-4e63-9578-339d54f4e07f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:43.841421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1cc1-8e77-4e63-9578-339d54f4e07f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:43.841724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c1cc1-8e77-4e63-9578-339d54f4e07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:43.912334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5a9c1cc1-8e77-4e63-9578-339d54f4e07f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:43.915361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5a9c1cc1-8e77-4e63-9578-339d54f4e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:43.965614 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1418/2879] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:53:43.975564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9ad4-1c09-4a3e-af0a-583cb53be18a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:43.976065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9ad4-1c09-4a3e-af0a-583cb53be18a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:43.976445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a9ad4-1c09-4a3e-af0a-583cb53be18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.016090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8c7a9ad4-1c09-4a3e-af0a-583cb53be18a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:44.023058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8c7a9ad4-1c09-4a3e-af0a-583cb53be18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:44.044955 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1419/2880] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:44.048693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9ad4-1c09-4a3e-af0a-583cb53be18a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.066596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a9ad4-1c09-4a3e-af0a-583cb53be18a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.080351 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1462/2881] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:44.082642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3309cf-0fba-4bb6-91ae-b85cb09658e3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.083583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3309cf-0fba-4bb6-91ae-b85cb09658e3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.084387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3309cf-0fba-4bb6-91ae-b85cb09658e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.086700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06580-80fc-49a6-bc6c-c6a979c22a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.088531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06580-80fc-49a6-bc6c-c6a979c22a1b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.090897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06580-80fc-49a6-bc6c-c6a979c22a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.091945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c06580-80fc-49a6-bc6c-c6a979c22a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.093556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c06580-80fc-49a6-bc6c-c6a979c22a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:53:44.095375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c06580-80fc-49a6-bc6c-c6a979c22a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.098917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c06580-80fc-49a6-bc6c-c6a979c22a1b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.136911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1420/2882] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:53:44.137916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06580-80fc-49a6-bc6c-c6a979c22a1b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.138844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ec3309cf-0fba-4bb6-91ae-b85cb09658e3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:44.140331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ec3309cf-0fba-4bb6-91ae-b85cb09658e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:44.149868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c06580-80fc-49a6-bc6c-c6a979c22a1b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.156809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c719f1-4d42-4d67-9431-edf73bf508bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.157904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c719f1-4d42-4d67-9431-edf73bf508bb admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.158358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c719f1-4d42-4d67-9431-edf73bf508bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.158713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c719f1-4d42-4d67-9431-edf73bf508bb admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.159628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c719f1-4d42-4d67-9431-edf73bf508bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.162103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c719f1-4d42-4d67-9431-edf73bf508bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.166929 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1463/2883] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:44.168369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3309cf-0fba-4bb6-91ae-b85cb09658e3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.189540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3309cf-0fba-4bb6-91ae-b85cb09658e3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.205036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891ec7-ae7f-40e6-a7a7-acb1a02cacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.206373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891ec7-ae7f-40e6-a7a7-acb1a02cacb7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.206760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891ec7-ae7f-40e6-a7a7-acb1a02cacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.207143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c891ec7-ae7f-40e6-a7a7-acb1a02cacb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.208524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891ec7-ae7f-40e6-a7a7-acb1a02cacb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:53:44.209099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891ec7-ae7f-40e6-a7a7-acb1a02cacb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.216291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c891ec7-ae7f-40e6-a7a7-acb1a02cacb7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.241917 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1464/2884] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:53:44.246325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891ec7-ae7f-40e6-a7a7-acb1a02cacb7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.246814 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1421/2885] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:44 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:44.248206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c719f1-4d42-4d67-9431-edf73bf508bb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.274777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c891ec7-ae7f-40e6-a7a7-acb1a02cacb7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.394349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2aa2f-ac2b-41d2-8c93-a436130eabd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.394943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2aa2f-ac2b-41d2-8c93-a436130eabd2 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.395227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2aa2f-ac2b-41d2-8c93-a436130eabd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.395504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2aa2f-ac2b-41d2-8c93-a436130eabd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.402686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2aa2f-ac2b-41d2-8c93-a436130eabd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.405905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2aa2f-ac2b-41d2-8c93-a436130eabd2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.452552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c719f1-4d42-4d67-9431-edf73bf508bb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.480074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721464f7-6ea5-404d-8138-a79610860703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.481419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721464f7-6ea5-404d-8138-a79610860703 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.483700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721464f7-6ea5-404d-8138-a79610860703 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.483700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721464f7-6ea5-404d-8138-a79610860703 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.485157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721464f7-6ea5-404d-8138-a79610860703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.490090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721464f7-6ea5-404d-8138-a79610860703 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.491905 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1465/2886] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:44 2022] POST /identity/v3/projects => generated 389 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:53:44.496059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2aa2f-ac2b-41d2-8c93-a436130eabd2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.553065 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1422/2887] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:44 2022] POST /identity/v3/users => generated 290 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:53:44.554294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721464f7-6ea5-404d-8138-a79610860703 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.581982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721464f7-6ea5-404d-8138-a79610860703 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.639715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2aa2f-ac2b-41d2-8c93-a436130eabd2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.651576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847d67-15c0-4d2e-a513-39cad772bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.652245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847d67-15c0-4d2e-a513-39cad772bd3b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.652557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847d67-15c0-4d2e-a513-39cad772bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.652890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28847d67-15c0-4d2e-a513-39cad772bd3b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.653625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847d67-15c0-4d2e-a513-39cad772bd3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.655638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28847d67-15c0-4d2e-a513-39cad772bd3b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.690915 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1466/2888] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:44 2022] POST /identity/v3/users => generated 295 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:44.693422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847d67-15c0-4d2e-a513-39cad772bd3b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.701056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188bb4a-f1b1-48fb-845c-d8ebb712dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.701956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188bb4a-f1b1-48fb-845c-d8ebb712dc7b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.702307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188bb4a-f1b1-48fb-845c-d8ebb712dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.702882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188bb4a-f1b1-48fb-845c-d8ebb712dc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.703982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188bb4a-f1b1-48fb-845c-d8ebb712dc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.705670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188bb4a-f1b1-48fb-845c-d8ebb712dc7b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.715858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28847d67-15c0-4d2e-a513-39cad772bd3b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.728135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4a5d5-c667-4fa1-8c29-5953e89b8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.729654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4a5d5-c667-4fa1-8c29-5953e89b8237 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.730713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4a5d5-c667-4fa1-8c29-5953e89b8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.733432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4a5d5-c667-4fa1-8c29-5953e89b8237 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.734232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4a5d5-c667-4fa1-8c29-5953e89b8237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.736498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4a5d5-c667-4fa1-8c29-5953e89b8237 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.742252 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1423/2889] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:44.747383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188bb4a-f1b1-48fb-845c-d8ebb712dc7b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.766079 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1467/2890] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:44.766939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188bb4a-f1b1-48fb-845c-d8ebb712dc7b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.770709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4a5d5-c667-4fa1-8c29-5953e89b8237 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.794036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4a5d5-c667-4fa1-8c29-5953e89b8237 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.794471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412937-c81c-427c-b277-09e29f1416b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.797339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412937-c81c-427c-b277-09e29f1416b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.797818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412937-c81c-427c-b277-09e29f1416b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.798164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c412937-c81c-427c-b277-09e29f1416b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.798973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412937-c81c-427c-b277-09e29f1416b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.808359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c412937-c81c-427c-b277-09e29f1416b8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.822187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b86dd-ee05-49ae-9a35-d64bfd69bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.824813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b86dd-ee05-49ae-9a35-d64bfd69bc19 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.825696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b86dd-ee05-49ae-9a35-d64bfd69bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.827029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b86dd-ee05-49ae-9a35-d64bfd69bc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.830783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b86dd-ee05-49ae-9a35-d64bfd69bc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.835254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b86dd-ee05-49ae-9a35-d64bfd69bc19 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:44.854096 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1424/2891] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:44.858767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412937-c81c-427c-b277-09e29f1416b8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:44.883034 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1468/2892] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:44.885891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a4590-15a7-491d-804e-1502e9561998 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.886401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a4590-15a7-491d-804e-1502e9561998 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.892181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a4590-15a7-491d-804e-1502e9561998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.896737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c412937-c81c-427c-b277-09e29f1416b8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:44.915282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f05d1-9c4e-4f77-95cc-296c9d6857bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:44.919735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f05d1-9c4e-4f77-95cc-296c9d6857bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:44.920039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f05d1-9c4e-4f77-95cc-296c9d6857bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:44.920337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f05d1-9c4e-4f77-95cc-296c9d6857bb admin admin] PATH_INFO: `/v3/projects/bfa5dcec6e7d4a3ca5830d410cd40004/users/a281db4f515240cba83ca41694e107e9/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:44.939399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-097a4590-15a7-491d-804e-1502e9561998 None None] MFA Rules not processed for user `b188ca4deda94cec85da4582a37fea72`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:44.940866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-097a4590-15a7-491d-804e-1502e9561998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:44.956602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f05d1-9c4e-4f77-95cc-296c9d6857bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfa5dcec6e7d4a3ca5830d410cd40004, user_id=a281db4f515240cba83ca41694e107e9, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:44.959296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f05d1-9c4e-4f77-95cc-296c9d6857bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:45.017115 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1425/2893] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:44 2022] PUT /identity/v3/projects/bfa5dcec6e7d4a3ca5830d410cd40004/users/a281db4f515240cba83ca41694e107e9/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:45.019277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f05d1-9c4e-4f77-95cc-296c9d6857bb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:45.027396 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1469/2894] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:45.030362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4135eb-3131-410b-aa7f-51ebd5ba3cff None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:45.030691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4135eb-3131-410b-aa7f-51ebd5ba3cff None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:45.031014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4135eb-3131-410b-aa7f-51ebd5ba3cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:45.143691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2c4135eb-3131-410b-aa7f-51ebd5ba3cff None None] MFA Rules not processed for user `a281db4f515240cba83ca41694e107e9`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:45.148722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2c4135eb-3131-410b-aa7f-51ebd5ba3cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:45.211578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f05d1-9c4e-4f77-95cc-296c9d6857bb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:45.235171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266fbbd-660d-4051-96b5-d7189f5f154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:45.236991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266fbbd-660d-4051-96b5-d7189f5f154d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:45.237608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266fbbd-660d-4051-96b5-d7189f5f154d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:45.238102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266fbbd-660d-4051-96b5-d7189f5f154d admin admin] PATH_INFO: `/v3/projects/f93125ac1a714e3ca18236ff7794ca6c/users/c99375ab58bf4a24adf07b75d7e6caf2/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:45.270934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266fbbd-660d-4051-96b5-d7189f5f154d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93125ac1a714e3ca18236ff7794ca6c, user_id=c99375ab58bf4a24adf07b75d7e6caf2, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:45.274730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266fbbd-660d-4051-96b5-d7189f5f154d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:45.314822 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1426/2895] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:45 2022] PUT /identity/v3/projects/f93125ac1a714e3ca18236ff7794ca6c/users/c99375ab58bf4a24adf07b75d7e6caf2/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:45.316535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a88e-9d25-4432-b4b9-9bbfa6f8652a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:45.316831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a88e-9d25-4432-b4b9-9bbfa6f8652a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:45.317111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16a88e-9d25-4432-b4b9-9bbfa6f8652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:45.355875 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1470/2896] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:45.358045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4135eb-3131-410b-aa7f-51ebd5ba3cff None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:45.360568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cf16a88e-9d25-4432-b4b9-9bbfa6f8652a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:45.362727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf16a88e-9d25-4432-b4b9-9bbfa6f8652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:45.381987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4135eb-3131-410b-aa7f-51ebd5ba3cff None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:45.536709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec00e5-5196-4690-aabf-c290e82aeb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:45.538129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec00e5-5196-4690-aabf-c290e82aeb3e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:45.538129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec00e5-5196-4690-aabf-c290e82aeb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:45.538129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec00e5-5196-4690-aabf-c290e82aeb3e admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:45.538415 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1427/2897] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:45.542980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec00e5-5196-4690-aabf-c290e82aeb3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:45.544976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec00e5-5196-4690-aabf-c290e82aeb3e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:45.558279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16a88e-9d25-4432-b4b9-9bbfa6f8652a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:45.559780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf16a88e-9d25-4432-b4b9-9bbfa6f8652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:45.616315 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1471/2898] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:45 2022] POST /identity/v3/projects => generated 379 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:45.620862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec00e5-5196-4690-aabf-c290e82aeb3e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:45.670282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16a88e-9d25-4432-b4b9-9bbfa6f8652a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:45.781076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec00e5-5196-4690-aabf-c290e82aeb3e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:45.792860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9742ef2-ec60-45f5-957e-33ac6a747168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:45.793592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742ef2-ec60-45f5-957e-33ac6a747168 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:45.793878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742ef2-ec60-45f5-957e-33ac6a747168 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:45.794151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9742ef2-ec60-45f5-957e-33ac6a747168 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:45.794893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9742ef2-ec60-45f5-957e-33ac6a747168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:45.798416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9742ef2-ec60-45f5-957e-33ac6a747168 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:45.848015 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1472/2899] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:45 2022] POST /identity/v3/users => generated 296 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:45.852871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9742ef2-ec60-45f5-957e-33ac6a747168 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:45.865655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163a5d5-6d94-420e-bae3-737315a03a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:45.866289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163a5d5-6d94-420e-bae3-737315a03a4f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:45.866577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163a5d5-6d94-420e-bae3-737315a03a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:45.866857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f163a5d5-6d94-420e-bae3-737315a03a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:45.867790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9742ef2-ec60-45f5-957e-33ac6a747168 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:45.881563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec692d-67d2-426d-9df2-7110dadd71d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:45.882259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec692d-67d2-426d-9df2-7110dadd71d1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:45.882543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec692d-67d2-426d-9df2-7110dadd71d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:45.882825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec692d-67d2-426d-9df2-7110dadd71d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:45.883978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec692d-67d2-426d-9df2-7110dadd71d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:45.887864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec692d-67d2-426d-9df2-7110dadd71d1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:45.898146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163a5d5-6d94-420e-bae3-737315a03a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:45.899653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f163a5d5-6d94-420e-bae3-737315a03a4f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:45.913453 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1473/2900] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:45.917680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec692d-67d2-426d-9df2-7110dadd71d1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:45.926521 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1428/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:45.938611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec692d-67d2-426d-9df2-7110dadd71d1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:45.952064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadf32-f927-4d98-8c78-99180c941ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:45.953051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadf32-f927-4d98-8c78-99180c941ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:45.953338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadf32-f927-4d98-8c78-99180c941ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:45.953623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efadf32-f927-4d98-8c78-99180c941ffb admin admin] PATH_INFO: `/v3/projects/3d6b64f510a54a2b9e1b1b1e3ae18058/users/b80418e07d724126b727bf8c76627b30/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:45.958770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163a5d5-6d94-420e-bae3-737315a03a4f service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:45.958992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f163a5d5-6d94-420e-bae3-737315a03a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:45.977969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f163a5d5-6d94-420e-bae3-737315a03a4f service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:45.983937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efadf32-f927-4d98-8c78-99180c941ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6b64f510a54a2b9e1b1b1e3ae18058, user_id=b80418e07d724126b727bf8c76627b30, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:45.984067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:45.985111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:45.985253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:45.985432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] PATH_INFO: `/v3/users/c9bd4f2793ec48a5b31d081c269a39c2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:45.987229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efadf32-f927-4d98-8c78-99180c941ffb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:45.987355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bd4f2793ec48a5b31d081c269a39c2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:45.988638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:46.028395 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1474/2902] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:45 2022] PUT /identity/v3/projects/3d6b64f510a54a2b9e1b1b1e3ae18058/users/b80418e07d724126b727bf8c76627b30/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:46.032303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadf32-f927-4d98-8c78-99180c941ffb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:46.084937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bd4f2793ec48a5b31d081c269a39c2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:46.104881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bd4f2793ec48a5b31d081c269a39c2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:46.105872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bd4f2793ec48a5b31d081c269a39c2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:46.106689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bd4f2793ec48a5b31d081c269a39c2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:46.146722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bd4f2793ec48a5b31d081c269a39c2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:46.180137 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1429/2903] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:45 2022] DELETE /identity/v3/users/c9bd4f2793ec48a5b31d081c269a39c2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:53:46.188900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efadf32-f927-4d98-8c78-99180c941ffb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:46.270118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54536f-2f2d-49a5-9ecc-1c590790fef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:46.272140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54536f-2f2d-49a5-9ecc-1c590790fef4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:46.272536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54536f-2f2d-49a5-9ecc-1c590790fef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:46.272949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54536f-2f2d-49a5-9ecc-1c590790fef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:46.273808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54536f-2f2d-49a5-9ecc-1c590790fef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:46.276292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff54536f-2f2d-49a5-9ecc-1c590790fef4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:46.292683 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1475/2904] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:46.294416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:46.296014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:46.324694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7d9e6-6062-480e-a055-ed42cd7ab08f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:46.334239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b7f3f-8e61-4eba-a53c-482096c83a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:46.335165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b7f3f-8e61-4eba-a53c-482096c83a4c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:46.335451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b7f3f-8e61-4eba-a53c-482096c83a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:46.335826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b7f3f-8e61-4eba-a53c-482096c83a4c admin admin] PATH_INFO: `/v3/projects/3d6b64f510a54a2b9e1b1b1e3ae18058/users/b80418e07d724126b727bf8c76627b30/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:46.338217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b7f3f-8e61-4eba-a53c-482096c83a4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d6b64f510a54a2b9e1b1b1e3ae18058, user_id=b80418e07d724126b727bf8c76627b30, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:46.341894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b7f3f-8e61-4eba-a53c-482096c83a4c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:46.386868 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1430/2905] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:46 2022] PUT /identity/v3/projects/3d6b64f510a54a2b9e1b1b1e3ae18058/users/b80418e07d724126b727bf8c76627b30/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:46.390446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbb19-55e0-4738-9159-0228a9fd107d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:46.391299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbb19-55e0-4738-9159-0228a9fd107d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:46.391607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cbb19-55e0-4738-9159-0228a9fd107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:46.457141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3c4cbb19-55e0-4738-9159-0228a9fd107d None None] MFA Rules not processed for user `b80418e07d724126b727bf8c76627b30`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:46.458931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c4cbb19-55e0-4738-9159-0228a9fd107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:46.607559 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1476/2906] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:46.758094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b7f3f-8e61-4eba-a53c-482096c83a4c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:46.760474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f19b7f3f-8e61-4eba-a53c-482096c83a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:46.972382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbb19-55e0-4738-9159-0228a9fd107d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:46.974474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c4cbb19-55e0-4738-9159-0228a9fd107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:47.001345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b7f3f-8e61-4eba-a53c-482096c83a4c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:47.019953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ef5ba-de2c-4dc0-a680-797b0b801069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:47.020654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ef5ba-de2c-4dc0-a680-797b0b801069 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:47.020927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ef5ba-de2c-4dc0-a680-797b0b801069 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:47.021209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ef5ba-de2c-4dc0-a680-797b0b801069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:47.046279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ef5ba-de2c-4dc0-a680-797b0b801069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:47.048004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ef5ba-de2c-4dc0-a680-797b0b801069 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:47.072558 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1431/2907] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:47.173448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cbb19-55e0-4738-9159-0228a9fd107d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:47.203452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:47.204617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:47.205014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:47.205223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] PATH_INFO: `/v3/projects/cf51b08278d246e498f59455e299ba89` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:47.206701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf51b08278d246e498f59455e299ba89)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:47.211230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:47.281434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf51b08278d246e498f59455e299ba89', 'request_id': 'req-47e93961-5104-4fd0-afce-5e237b0be023'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.303234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf51b08278d246e498f59455e299ba89', 'request_id': 'req-47e93961-5104-4fd0-afce-5e237b0be023'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.315080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf51b08278d246e498f59455e299ba89', 'request_id': 'req-47e93961-5104-4fd0-afce-5e237b0be023'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.360381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] The token cache is being invalidate because project cf51b08278d246e498f59455e299ba89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:47.360682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.362584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47e93961-5104-4fd0-afce-5e237b0be023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.370376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ef5ba-de2c-4dc0-a680-797b0b801069 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:47.371223 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1477/2908] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:46 2022] DELETE /identity/v3/projects/cf51b08278d246e498f59455e299ba89 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:53:47.389071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ef5ba-de2c-4dc0-a680-797b0b801069 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:47.453057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a14e33-369d-4ac8-8199-afe36e0d4704 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:47.453391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a14e33-369d-4ac8-8199-afe36e0d4704 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:47.453833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a14e33-369d-4ac8-8199-afe36e0d4704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:47.493637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c5a14e33-369d-4ac8-8199-afe36e0d4704 None None] MFA Rules not processed for user `b5effd8428df4616865ee71160f53594`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:47.498488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c5a14e33-369d-4ac8-8199-afe36e0d4704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:47.548493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:47.550946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:47.551332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:47.551711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] PATH_INFO: `/v3/users/7affcca9509940fba9479bdabcc9fc2f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:47.557160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7affcca9509940fba9479bdabcc9fc2f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:47.559939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:47.642928 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1478/2909] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:53:47.645111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc375f-1c42-4bbe-8fa4-3ae28385eae0 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:47.645624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc375f-1c42-4bbe-8fa4-3ae28385eae0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:47.645983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc375f-1c42-4bbe-8fa4-3ae28385eae0 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:47.647900 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1479/2910] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:53:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:53:47.655761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc375f-1c42-4bbe-8fa4-3ae28385eae0 None None] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:53:47.660277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-14bc375f-1c42-4bbe-8fa4-3ae28385eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:47.671749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7affcca9509940fba9479bdabcc9fc2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.700245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7affcca9509940fba9479bdabcc9fc2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.700925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7affcca9509940fba9479bdabcc9fc2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.701611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7affcca9509940fba9479bdabcc9fc2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.773777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64f77e0b-52a0-4d47-86f5-fc2cea9f76b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7affcca9509940fba9479bdabcc9fc2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:47.857863 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1432/2911] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:47 2022] DELETE /identity/v3/users/7affcca9509940fba9479bdabcc9fc2f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:47.871137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc375f-1c42-4bbe-8fa4-3ae28385eae0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:47.875669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-14bc375f-1c42-4bbe-8fa4-3ae28385eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:47.954479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51d920-3b98-4bdc-844a-095286d7b386 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:47.956482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51d920-3b98-4bdc-844a-095286d7b386 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:47.957087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f51d920-3b98-4bdc-844a-095286d7b386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:48.039061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc375f-1c42-4bbe-8fa4-3ae28385eae0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:48.097095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5f51d920-3b98-4bdc-844a-095286d7b386 None None] MFA Rules not processed for user `c99375ab58bf4a24adf07b75d7e6caf2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:48.098500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5f51d920-3b98-4bdc-844a-095286d7b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:48.184730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488d721-2fe8-4c0b-9af4-b2cb9a4490ed tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80418e07d724126b727bf8c76627b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6b64f510a54a2b9e1b1b1e3ae18058', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:48.185621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d721-2fe8-4c0b-9af4-b2cb9a4490ed tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:48.185910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d721-2fe8-4c0b-9af4-b2cb9a4490ed tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:48.186190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d721-2fe8-4c0b-9af4-b2cb9a4490ed tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] PATH_INFO: `/v3/projects/bfa5dcec6e7d4a3ca5830d410cd40004` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:48.187503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488d721-2fe8-4c0b-9af4-b2cb9a4490ed tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] RBAC: Authorizing `identity:get_project(project_id=bfa5dcec6e7d4a3ca5830d410cd40004)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:48.189651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488d721-2fe8-4c0b-9af4-b2cb9a4490ed tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:48.193771 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1480/2912] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:53:47 2022] GET /identity/v3/projects/bfa5dcec6e7d4a3ca5830d410cd40004 => generated 379 bytes in 537 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:53:48.322676 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1433/2913] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:53:48.323720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe554b-d174-4a51-ab5c-548baaf9eb01 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:48.324041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe554b-d174-4a51-ab5c-548baaf9eb01 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:48.324327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe554b-d174-4a51-ab5c-548baaf9eb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:48.357541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fffe554b-d174-4a51-ab5c-548baaf9eb01 None None] MFA Rules not processed for user `c99375ab58bf4a24adf07b75d7e6caf2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:48.363363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fffe554b-d174-4a51-ab5c-548baaf9eb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:48.410020 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1481/2914] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:48.752792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51d920-3b98-4bdc-844a-095286d7b386 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:48.754159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5f51d920-3b98-4bdc-844a-095286d7b386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:48.960794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f51d920-3b98-4bdc-844a-095286d7b386 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:48.976706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f011fee-5e1a-4377-9bea-3e9196c019e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:48.979940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f011fee-5e1a-4377-9bea-3e9196c019e9 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:48.980465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f011fee-5e1a-4377-9bea-3e9196c019e9 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:48.981173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f011fee-5e1a-4377-9bea-3e9196c019e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:48.984662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7f011fee-5e1a-4377-9bea-3e9196c019e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:49.122533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f011fee-5e1a-4377-9bea-3e9196c019e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:49.124520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f011fee-5e1a-4377-9bea-3e9196c019e9 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:49.133169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe554b-d174-4a51-ab5c-548baaf9eb01 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:49.136124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fffe554b-d174-4a51-ab5c-548baaf9eb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:49.140099 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1434/2915] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:49.227327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f011fee-5e1a-4377-9bea-3e9196c019e9 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:49.257205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f011fee-5e1a-4377-9bea-3e9196c019e9 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:49.291501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc21a89-a892-4c63-8d47-5351798c21cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:49.293764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21a89-a892-4c63-8d47-5351798c21cd service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:49.294061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21a89-a892-4c63-8d47-5351798c21cd service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:49.294339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc21a89-a892-4c63-8d47-5351798c21cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:49.360070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc21a89-a892-4c63-8d47-5351798c21cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:49.368169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc21a89-a892-4c63-8d47-5351798c21cd service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:49.417185 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1435/2916] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:53:49.450563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe554b-d174-4a51-ab5c-548baaf9eb01 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:49.463366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:49.465582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:49.466592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:49.467515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] PATH_INFO: `/v3/projects/ae20fc40138243ac8c0bade1ecc3340b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:49.470853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae20fc40138243ac8c0bade1ecc3340b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:49.487505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:49.643738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae20fc40138243ac8c0bade1ecc3340b', 'request_id': 'req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:49.673275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae20fc40138243ac8c0bade1ecc3340b', 'request_id': 'req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:49.682381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae20fc40138243ac8c0bade1ecc3340b', 'request_id': 'req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:49.699952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] The token cache is being invalidate because project ae20fc40138243ac8c0bade1ecc3340b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:49.700602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:49.701557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5d84a2d-2482-4ade-a0f2-d6cc9ac37d04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:49.704049 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1482/2917] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:49 2022] DELETE /identity/v3/projects/ae20fc40138243ac8c0bade1ecc3340b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:49.708607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f039d-7a3c-4edd-becb-a6e3005356e7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:49.708901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f039d-7a3c-4edd-becb-a6e3005356e7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:49.709192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f039d-7a3c-4edd-becb-a6e3005356e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:49.777626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-543f039d-7a3c-4edd-becb-a6e3005356e7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:49.781222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-543f039d-7a3c-4edd-becb-a6e3005356e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:49.934302 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1436/2918] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:49.942722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed572f-227b-4dfe-88c6-465b1144b124 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:49.943103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed572f-227b-4dfe-88c6-465b1144b124 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:49.943447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed572f-227b-4dfe-88c6-465b1144b124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:49.980134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b0ed572f-227b-4dfe-88c6-465b1144b124 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:49.982519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b0ed572f-227b-4dfe-88c6-465b1144b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:49.996066 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1483/2919] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:49.999626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f039d-7a3c-4edd-becb-a6e3005356e7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:50.032896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f039d-7a3c-4edd-becb-a6e3005356e7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:50.039383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80c97-8a68-4ce3-a2b7-ba18919761bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:50.040116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80c97-8a68-4ce3-a2b7-ba18919761bf admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:50.040479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80c97-8a68-4ce3-a2b7-ba18919761bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:50.041491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d80c97-8a68-4ce3-a2b7-ba18919761bf admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:50.042353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d80c97-8a68-4ce3-a2b7-ba18919761bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:53:50.042708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d80c97-8a68-4ce3-a2b7-ba18919761bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:50.045473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d80c97-8a68-4ce3-a2b7-ba18919761bf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:50.061880 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1437/2920] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:53:50.065859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed572f-227b-4dfe-88c6-465b1144b124 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:50.079259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed572f-227b-4dfe-88c6-465b1144b124 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:50.088507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1201111-0063-43a3-910f-48545b57c4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:50.089224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1201111-0063-43a3-910f-48545b57c4cf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:50.089582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1201111-0063-43a3-910f-48545b57c4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:50.089928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1201111-0063-43a3-910f-48545b57c4cf admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:50.090703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1201111-0063-43a3-910f-48545b57c4cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:50.092908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1201111-0063-43a3-910f-48545b57c4cf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:50.158796 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1484/2921] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:50 2022] POST /identity/v3/projects => generated 359 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:53:50.162874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80c97-8a68-4ce3-a2b7-ba18919761bf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:50.177328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d80c97-8a68-4ce3-a2b7-ba18919761bf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:50.275056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ba841-95ea-4354-9d83-4e2dbb50d938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:50.276654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ba841-95ea-4354-9d83-4e2dbb50d938 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:50.279154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ba841-95ea-4354-9d83-4e2dbb50d938 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:50.279154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ba841-95ea-4354-9d83-4e2dbb50d938 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:50.279154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ba841-95ea-4354-9d83-4e2dbb50d938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:50.280828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ba841-95ea-4354-9d83-4e2dbb50d938 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:50.309977 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1438/2922] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:50 2022] POST /identity/v3/users => generated 280 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:50.313622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1201111-0063-43a3-910f-48545b57c4cf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:50.331804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1201111-0063-43a3-910f-48545b57c4cf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:50.343813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea0eb1-0da9-493e-83c0-c9af38e9dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:50.345284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea0eb1-0da9-493e-83c0-c9af38e9dda2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:50.346740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea0eb1-0da9-493e-83c0-c9af38e9dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:50.347112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea0eb1-0da9-493e-83c0-c9af38e9dda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:50.348783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea0eb1-0da9-493e-83c0-c9af38e9dda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:50.354701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea0eb1-0da9-493e-83c0-c9af38e9dda2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:50.410499 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1485/2923] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:50.413752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ba841-95ea-4354-9d83-4e2dbb50d938 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:50.427948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ba841-95ea-4354-9d83-4e2dbb50d938 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:50.445952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32ea58-d252-45a4-a823-ea1ac3e4b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:50.451058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d8711-4049-4801-91f8-85eefd0c0686 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:50.451596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d8711-4049-4801-91f8-85eefd0c0686 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:50.452023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d8711-4049-4801-91f8-85eefd0c0686 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:50.454346 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1486/2924] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:53:50.456517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32ea58-d252-45a4-a823-ea1ac3e4b8ab admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:50.456918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32ea58-d252-45a4-a823-ea1ac3e4b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:50.457299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32ea58-d252-45a4-a823-ea1ac3e4b8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:50.458863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32ea58-d252-45a4-a823-ea1ac3e4b8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:50.466549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d8711-4049-4801-91f8-85eefd0c0686 None None] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:53:50.468516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ba2d8711-4049-4801-91f8-85eefd0c0686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:50.476872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32ea58-d252-45a4-a823-ea1ac3e4b8ab admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:50.511103 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1439/2925] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:50.515724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32ea58-d252-45a4-a823-ea1ac3e4b8ab admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:50.536963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32ea58-d252-45a4-a823-ea1ac3e4b8ab admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:50.552894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdb3e8-d399-47b5-af01-6f7d4b9c23a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:50.554388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdb3e8-d399-47b5-af01-6f7d4b9c23a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:50.554899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdb3e8-d399-47b5-af01-6f7d4b9c23a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:50.555514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdb3e8-d399-47b5-af01-6f7d4b9c23a9 admin admin] PATH_INFO: `/v3/projects/3d4990f498504130aa9ffff8332aace0/users/0b64324a40a14f1ba30223e7ac775b96/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:50.585337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d8711-4049-4801-91f8-85eefd0c0686 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:50.591373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ba2d8711-4049-4801-91f8-85eefd0c0686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:50.598765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdb3e8-d399-47b5-af01-6f7d4b9c23a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4990f498504130aa9ffff8332aace0, user_id=0b64324a40a14f1ba30223e7ac775b96, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:50.605939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdb3e8-d399-47b5-af01-6f7d4b9c23a9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:50.636183 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1440/2926] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:50 2022] PUT /identity/v3/projects/3d4990f498504130aa9ffff8332aace0/users/0b64324a40a14f1ba30223e7ac775b96/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:50.646460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c443b1-fde6-465f-8156-59ad9280d49b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:50.646952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c443b1-fde6-465f-8156-59ad9280d49b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:50.647368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c443b1-fde6-465f-8156-59ad9280d49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:50.699626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d8711-4049-4801-91f8-85eefd0c0686 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:50.721982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b5c443b1-fde6-465f-8156-59ad9280d49b None None] MFA Rules not processed for user `0b64324a40a14f1ba30223e7ac775b96`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:50.723443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b5c443b1-fde6-465f-8156-59ad9280d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:50.804071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680d31b-3831-4576-a21d-67ed74688b2e tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80418e07d724126b727bf8c76627b30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3d6b64f510a54a2b9e1b1b1e3ae18058', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:50.804953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680d31b-3831-4576-a21d-67ed74688b2e tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:50.805433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680d31b-3831-4576-a21d-67ed74688b2e tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:50.805731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680d31b-3831-4576-a21d-67ed74688b2e tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] PATH_INFO: `/v3/projects/bfa5dcec6e7d4a3ca5830d410cd40004` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:50.808317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680d31b-3831-4576-a21d-67ed74688b2e tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] RBAC: Authorizing `identity:get_project(project_id=bfa5dcec6e7d4a3ca5830d410cd40004)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:50.810787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680d31b-3831-4576-a21d-67ed74688b2e tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:50.813838 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1487/2927] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:53:50 2022] GET /identity/v3/projects/bfa5dcec6e7d4a3ca5830d410cd40004 => generated 379 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:53:50.912035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680d31b-3831-4576-a21d-67ed74688b2e tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:50.925870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1441/2928] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:50 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:53:51.088689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680d31b-3831-4576-a21d-67ed74688b2e tempest-FlavorsAccessTestJSON-2138214551 tempest-FlavorsAccessTestJSON-2138214551-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:51.096081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba57c-9b5d-4977-a748-00af13bc25dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:51.097017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba57c-9b5d-4977-a748-00af13bc25dc admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:51.097732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba57c-9b5d-4977-a748-00af13bc25dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:51.098172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ba57c-9b5d-4977-a748-00af13bc25dc admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:51.099068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ba57c-9b5d-4977-a748-00af13bc25dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:51.101203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ba57c-9b5d-4977-a748-00af13bc25dc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:51.172006 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1488/2929] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:53:50 2022] POST /identity/v3/projects => generated 361 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:51.177286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c443b1-fde6-465f-8156-59ad9280d49b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:51.254832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c443b1-fde6-465f-8156-59ad9280d49b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:51.421615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6eacb3-b1da-4523-906d-14ad9b50ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:51.422920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6eacb3-b1da-4523-906d-14ad9b50ec0d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:51.423414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6eacb3-b1da-4523-906d-14ad9b50ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:51.423895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6eacb3-b1da-4523-906d-14ad9b50ec0d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:51.425475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6eacb3-b1da-4523-906d-14ad9b50ec0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:51.429604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6eacb3-b1da-4523-906d-14ad9b50ec0d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:51.485032 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1442/2930] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:53:51 2022] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:53:51.486180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba57c-9b5d-4977-a748-00af13bc25dc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:51.499451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ba57c-9b5d-4977-a748-00af13bc25dc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:51.529904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4736b-541e-4a29-8322-14992e68035d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:51.530737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4736b-541e-4a29-8322-14992e68035d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:51.531605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4736b-541e-4a29-8322-14992e68035d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:51.533394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4736b-541e-4a29-8322-14992e68035d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:51.534276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4736b-541e-4a29-8322-14992e68035d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:51.537848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4736b-541e-4a29-8322-14992e68035d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:51.589910 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1489/2931] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:51.619506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6eacb3-b1da-4523-906d-14ad9b50ec0d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:51.682756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6eacb3-b1da-4523-906d-14ad9b50ec0d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:51.703871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dc213-9a29-4d54-ab8b-6df831d924e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:51.705155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dc213-9a29-4d54-ab8b-6df831d924e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:51.705155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dc213-9a29-4d54-ab8b-6df831d924e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:51.705155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dc213-9a29-4d54-ab8b-6df831d924e4 admin admin] PATH_INFO: `/v3/projects/d3ba3c5a276c43dfbc0a5d2bf6acd535/users/90491c73e86344deb208ff9a8290004b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:51.758425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dc213-9a29-4d54-ab8b-6df831d924e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ba3c5a276c43dfbc0a5d2bf6acd535, user_id=90491c73e86344deb208ff9a8290004b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:51.762754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dc213-9a29-4d54-ab8b-6df831d924e4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:51.801440 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1443/2932] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:51 2022] PUT /identity/v3/projects/d3ba3c5a276c43dfbc0a5d2bf6acd535/users/90491c73e86344deb208ff9a8290004b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:51.803736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4736b-541e-4a29-8322-14992e68035d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:51.818292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4736b-541e-4a29-8322-14992e68035d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:51.927126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fb1b6-4672-44bd-8309-4bbbf5f34bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:51.928635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fb1b6-4672-44bd-8309-4bbbf5f34bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:51.928927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fb1b6-4672-44bd-8309-4bbbf5f34bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:51.929211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fb1b6-4672-44bd-8309-4bbbf5f34bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:51.929956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fb1b6-4672-44bd-8309-4bbbf5f34bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:51.932858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fb1b6-4672-44bd-8309-4bbbf5f34bb3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:51.948994 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1490/2933] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:53:51.950405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dc213-9a29-4d54-ab8b-6df831d924e4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:51.963707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dc213-9a29-4d54-ab8b-6df831d924e4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:51.981619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289d5c2-eed8-4c68-82c8-0c8751836b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:51.982536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289d5c2-eed8-4c68-82c8-0c8751836b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:51.982821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289d5c2-eed8-4c68-82c8-0c8751836b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:51.983104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289d5c2-eed8-4c68-82c8-0c8751836b30 admin admin] PATH_INFO: `/v3/projects/d3ba3c5a276c43dfbc0a5d2bf6acd535/users/90491c73e86344deb208ff9a8290004b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:51.989031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289d5c2-eed8-4c68-82c8-0c8751836b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ba3c5a276c43dfbc0a5d2bf6acd535, user_id=90491c73e86344deb208ff9a8290004b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:51.991284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289d5c2-eed8-4c68-82c8-0c8751836b30 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:52.017651 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1444/2934] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:53:51 2022] PUT /identity/v3/projects/d3ba3c5a276c43dfbc0a5d2bf6acd535/users/90491c73e86344deb208ff9a8290004b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:52.028477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd905-bdbf-4a8b-bd8c-6016376c7bfa None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:52.029080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd905-bdbf-4a8b-bd8c-6016376c7bfa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:52.029519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd905-bdbf-4a8b-bd8c-6016376c7bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:52.102184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-74ffd905-bdbf-4a8b-bd8c-6016376c7bfa None None] MFA Rules not processed for user `90491c73e86344deb208ff9a8290004b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:52.104705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-74ffd905-bdbf-4a8b-bd8c-6016376c7bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:52.197945 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1491/2935] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:52 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:52.469079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289d5c2-eed8-4c68-82c8-0c8751836b30 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:52.629364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289d5c2-eed8-4c68-82c8-0c8751836b30 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:52.649535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd913-4248-4ad2-ae11-1f1229ccdcda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:52.653994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd913-4248-4ad2-ae11-1f1229ccdcda service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:52.655601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd913-4248-4ad2-ae11-1f1229ccdcda service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:52.655905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cd913-4248-4ad2-ae11-1f1229ccdcda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:52.691657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cd913-4248-4ad2-ae11-1f1229ccdcda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:52.694385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26cd913-4248-4ad2-ae11-1f1229ccdcda service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:52.708186 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1445/2936] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:52 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:54.899120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd905-bdbf-4a8b-bd8c-6016376c7bfa None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:55.061560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd913-4248-4ad2-ae11-1f1229ccdcda service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:55.063724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a26cd913-4248-4ad2-ae11-1f1229ccdcda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:55.145278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd905-bdbf-4a8b-bd8c-6016376c7bfa None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:55.157572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:55.158855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:55.159394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:55.161414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] PATH_INFO: `/v3/users/0b64324a40a14f1ba30223e7ac775b96` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:55.164263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b64324a40a14f1ba30223e7ac775b96)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:55.170009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:55.261871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b64324a40a14f1ba30223e7ac775b96'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.271853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b64324a40a14f1ba30223e7ac775b96'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.272734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26cd913-4248-4ad2-ae11-1f1229ccdcda service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:55.274152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b64324a40a14f1ba30223e7ac775b96'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.275203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b64324a40a14f1ba30223e7ac775b96'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.284735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:55.286855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:55.287609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:55.288394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] PATH_INFO: `/v3/users/a281db4f515240cba83ca41694e107e9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:55.290502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a281db4f515240cba83ca41694e107e9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:55.293984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:55.295989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9631e5c7-6e5d-48e8-bcfe-a7f568d136d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b64324a40a14f1ba30223e7ac775b96'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.338440 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1492/2937] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:54 2022] DELETE /identity/v3/users/0b64324a40a14f1ba30223e7ac775b96 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:55.343351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a91428-5c1c-4045-a365-9c2da86ab5f0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:55.346676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a91428-5c1c-4045-a365-9c2da86ab5f0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:55.347096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a91428-5c1c-4045-a365-9c2da86ab5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:55.392665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-20a91428-5c1c-4045-a365-9c2da86ab5f0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:55.395338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-20a91428-5c1c-4045-a365-9c2da86ab5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:55.421603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a281db4f515240cba83ca41694e107e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.433560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a281db4f515240cba83ca41694e107e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.434713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a281db4f515240cba83ca41694e107e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.435650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a281db4f515240cba83ca41694e107e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.458145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-44e3061a-3e63-4f7f-93e2-674fee30ee8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a281db4f515240cba83ca41694e107e9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:55.491353 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1446/2938] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:55 2022] DELETE /identity/v3/users/a281db4f515240cba83ca41694e107e9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:53:55.498040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8266-c8a2-4750-a609-ad96649a4daa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:55.498684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8266-c8a2-4750-a609-ad96649a4daa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:55.499696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b8266-c8a2-4750-a609-ad96649a4daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:55.535822 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1493/2939] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:55.548795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a38b8266-c8a2-4750-a609-ad96649a4daa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:53:55.550203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a38b8266-c8a2-4750-a609-ad96649a4daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:55.605361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a91428-5c1c-4045-a365-9c2da86ab5f0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:55.607065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-20a91428-5c1c-4045-a365-9c2da86ab5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:55.734591 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1447/2940] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:53:55.766946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a91428-5c1c-4045-a365-9c2da86ab5f0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:55.769213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8266-c8a2-4750-a609-ad96649a4daa None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:55.935808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf409-9aa5-45f9-b76f-f33081d225eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:55.936569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf409-9aa5-45f9-b76f-f33081d225eb service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:55.937076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf409-9aa5-45f9-b76f-f33081d225eb service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:55.937369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bf409-9aa5-45f9-b76f-f33081d225eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:55.960888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf409-9aa5-45f9-b76f-f33081d225eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:55.960888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bf409-9aa5-45f9-b76f-f33081d225eb service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:55.973111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b8266-c8a2-4750-a609-ad96649a4daa None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:55.974380 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1494/2941] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:55.998938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ad928-b237-4221-969f-3e8ca67baec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:55.999877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ad928-b237-4221-969f-3e8ca67baec8 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:56.000049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ad928-b237-4221-969f-3e8ca67baec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:56.000280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ad928-b237-4221-969f-3e8ca67baec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:56.064724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ad928-b237-4221-969f-3e8ca67baec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:56.071786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ad928-b237-4221-969f-3e8ca67baec8 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:56.133307 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1448/2942] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:53:58.642147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf409-9aa5-45f9-b76f-f33081d225eb service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:58.644263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9d5bf409-9aa5-45f9-b76f-f33081d225eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:58.670296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bf409-9aa5-45f9-b76f-f33081d225eb service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:58.698532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:58.703178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:58.703178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:58.703178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] PATH_INFO: `/v3/projects/3d4990f498504130aa9ffff8332aace0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:58.705392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4990f498504130aa9ffff8332aace0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:58.707386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:58.803682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4990f498504130aa9ffff8332aace0', 'request_id': 'req-035f8712-d0b3-4c85-886e-0b258d0a5bfc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:58.818584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4990f498504130aa9ffff8332aace0', 'request_id': 'req-035f8712-d0b3-4c85-886e-0b258d0a5bfc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:58.834424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4990f498504130aa9ffff8332aace0', 'request_id': 'req-035f8712-d0b3-4c85-886e-0b258d0a5bfc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:58.849952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] The token cache is being invalidate because project 3d4990f498504130aa9ffff8332aace0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:58.851229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:58.852328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:58.854672 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1495/2943] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:58 2022] DELETE /identity/v3/projects/3d4990f498504130aa9ffff8332aace0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:58.858583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ad928-b237-4221-969f-3e8ca67baec8 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:58.887283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ad928-b237-4221-969f-3e8ca67baec8 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:58.923640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:58.925119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:59.082757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:59.083861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:59.084260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:59.084870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] PATH_INFO: `/v3/users/90491c73e86344deb208ff9a8290004b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:59.088245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] RBAC: Authorizing `identity:delete_user(user_id=90491c73e86344deb208ff9a8290004b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:59.092485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:59.094297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f8712-d0b3-4c85-886e-0b258d0a5bfc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:59.100932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:59.101912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:59.102204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:59.102481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] PATH_INFO: `/v3/projects/bfa5dcec6e7d4a3ca5830d410cd40004` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:59.105185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfa5dcec6e7d4a3ca5830d410cd40004)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:59.107366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:59.199705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90491c73e86344deb208ff9a8290004b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.221525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90491c73e86344deb208ff9a8290004b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.224870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90491c73e86344deb208ff9a8290004b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.227815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90491c73e86344deb208ff9a8290004b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.250095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfa5dcec6e7d4a3ca5830d410cd40004', 'request_id': 'req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.268248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfa5dcec6e7d4a3ca5830d410cd40004', 'request_id': 'req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.271874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90491c73e86344deb208ff9a8290004b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.284706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfa5dcec6e7d4a3ca5830d410cd40004', 'request_id': 'req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.302897 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1449/2944] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:58 2022] DELETE /identity/v3/users/90491c73e86344deb208ff9a8290004b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:53:59.321542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] The token cache is being invalidate because project bfa5dcec6e7d4a3ca5830d410cd40004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:53:59.322343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.324342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.328479 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1496/2945] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:53:58 2022] DELETE /identity/v3/projects/bfa5dcec6e7d4a3ca5830d410cd40004 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:53:59.335727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:53:59.337260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:53:59.471781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58739060-78a5-4737-b24c-ba953fa56caf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:53:59.478854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:53:59.479844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:53:59.480269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:53:59.480620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] PATH_INFO: `/v3/users/b80418e07d724126b727bf8c76627b30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:53:59.482232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80418e07d724126b727bf8c76627b30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:53:59.484305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:53:59.581739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80418e07d724126b727bf8c76627b30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.603106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80418e07d724126b727bf8c76627b30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.606626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80418e07d724126b727bf8c76627b30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.607793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80418e07d724126b727bf8c76627b30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.633225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80418e07d724126b727bf8c76627b30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:53:59.647388 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1450/2946] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:53:59 2022] DELETE /identity/v3/users/b80418e07d724126b727bf8c76627b30 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:00.900758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:00.902690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:01.045822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9551a4f3-cc3b-4a47-b0f5-317ab919fb9c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:01.078126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:01.079762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:01.218766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:01.220203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.220879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.221658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] PATH_INFO: `/v3/projects/d3ba3c5a276c43dfbc0a5d2bf6acd535` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.227697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9f13e-8ad3-4f1e-b38d-e95a6db27d12 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:01.233603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ba3c5a276c43dfbc0a5d2bf6acd535)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:01.236659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:01.241087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:01.242104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.242393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.243126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] PATH_INFO: `/v3/projects/3d6b64f510a54a2b9e1b1b1e3ae18058` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.244568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d6b64f510a54a2b9e1b1b1e3ae18058)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:01.247862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:01.306406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ba3c5a276c43dfbc0a5d2bf6acd535', 'request_id': 'req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.325177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d6b64f510a54a2b9e1b1b1e3ae18058', 'request_id': 'req-99aa3e83-edb1-4780-b810-caefbc050b6f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.334372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ba3c5a276c43dfbc0a5d2bf6acd535', 'request_id': 'req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.348481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ba3c5a276c43dfbc0a5d2bf6acd535', 'request_id': 'req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.350742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d6b64f510a54a2b9e1b1b1e3ae18058', 'request_id': 'req-99aa3e83-edb1-4780-b810-caefbc050b6f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.368702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d6b64f510a54a2b9e1b1b1e3ae18058', 'request_id': 'req-99aa3e83-edb1-4780-b810-caefbc050b6f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.377534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] The token cache is being invalidate because project d3ba3c5a276c43dfbc0a5d2bf6acd535 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:01.379818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.381105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd10a7d4-d8ec-4b14-bdbb-84d027b73ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.385275 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1497/2947] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:00 2022] DELETE /identity/v3/projects/d3ba3c5a276c43dfbc0a5d2bf6acd535 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:01.395892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] The token cache is being invalidate because project 3d6b64f510a54a2b9e1b1b1e3ae18058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:01.397745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.398756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99aa3e83-edb1-4780-b810-caefbc050b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:01.400814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27df18-a72b-429e-949d-2c276c7bd143 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.401504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27df18-a72b-429e-949d-2c276c7bd143 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.401945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a27df18-a72b-429e-949d-2c276c7bd143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.403553 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1451/2948] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:01 2022] DELETE /identity/v3/projects/3d6b64f510a54a2b9e1b1b1e3ae18058 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:01.410108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75f27-1a31-448e-b57f-916349b826b8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.410407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75f27-1a31-448e-b57f-916349b826b8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.410688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c75f27-1a31-448e-b57f-916349b826b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.429854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2a27df18-a72b-429e-949d-2c276c7bd143 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:01.432378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2a27df18-a72b-429e-949d-2c276c7bd143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:01.450861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-38c75f27-1a31-448e-b57f-916349b826b8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:01.452137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-38c75f27-1a31-448e-b57f-916349b826b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:01.504593 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1498/2949] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:01.512525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cb52a-fac6-497c-aba9-b15911b4e783 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.512961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cb52a-fac6-497c-aba9-b15911b4e783 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.513432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cb52a-fac6-497c-aba9-b15911b4e783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.536517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e79cb52a-fac6-497c-aba9-b15911b4e783 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:01.539611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e79cb52a-fac6-497c-aba9-b15911b4e783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:01.568810 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1452/2950] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:01.577029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759724-ac2e-44b4-8aca-e96132cb0820 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.577677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759724-ac2e-44b4-8aca-e96132cb0820 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.577677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0759724-ac2e-44b4-8aca-e96132cb0820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.588648 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1499/2951] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:01.592631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cb52a-fac6-497c-aba9-b15911b4e783 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:01.611615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cb52a-fac6-497c-aba9-b15911b4e783 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:01.618173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b0759724-ac2e-44b4-8aca-e96132cb0820 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:01.619461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b0759724-ac2e-44b4-8aca-e96132cb0820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:01.625487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566f9d9-96d1-4364-84b2-4bf542c4964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:01.626400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566f9d9-96d1-4364-84b2-4bf542c4964a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.626856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566f9d9-96d1-4364-84b2-4bf542c4964a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.627134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566f9d9-96d1-4364-84b2-4bf542c4964a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.627870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566f9d9-96d1-4364-84b2-4bf542c4964a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:01.628196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566f9d9-96d1-4364-84b2-4bf542c4964a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:01.635748 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1453/2952] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:01.636136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566f9d9-96d1-4364-84b2-4bf542c4964a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:01.637257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0759724-ac2e-44b4-8aca-e96132cb0820 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:01.649377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0759724-ac2e-44b4-8aca-e96132cb0820 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:01.656080 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1500/2953] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:01.660370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566f9d9-96d1-4364-84b2-4bf542c4964a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:01.661073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002de37-35ec-4782-9183-e05fbdb3fe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:01.662519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002de37-35ec-4782-9183-e05fbdb3fe80 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.663853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002de37-35ec-4782-9183-e05fbdb3fe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.664169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002de37-35ec-4782-9183-e05fbdb3fe80 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.665307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002de37-35ec-4782-9183-e05fbdb3fe80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:01.666262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002de37-35ec-4782-9183-e05fbdb3fe80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:01.668016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002de37-35ec-4782-9183-e05fbdb3fe80 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:01.682164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566f9d9-96d1-4364-84b2-4bf542c4964a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:01.692401 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1454/2954] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:01.695454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbf78c-af1b-48c3-bba1-500ca7dfe088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:01.695936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbf78c-af1b-48c3-bba1-500ca7dfe088 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.697148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002de37-35ec-4782-9183-e05fbdb3fe80 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:01.698257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbf78c-af1b-48c3-bba1-500ca7dfe088 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.698546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbf78c-af1b-48c3-bba1-500ca7dfe088 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.699258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbf78c-af1b-48c3-bba1-500ca7dfe088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:01.701431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbf78c-af1b-48c3-bba1-500ca7dfe088 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:01.710821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002de37-35ec-4782-9183-e05fbdb3fe80 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:01.717847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db920eb6-0ffa-4103-83b9-13f2a68db241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:01.718413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920eb6-0ffa-4103-83b9-13f2a68db241 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.718794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920eb6-0ffa-4103-83b9-13f2a68db241 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.719117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db920eb6-0ffa-4103-83b9-13f2a68db241 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.719819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db920eb6-0ffa-4103-83b9-13f2a68db241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:01.722834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db920eb6-0ffa-4103-83b9-13f2a68db241 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:01.766411 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1455/2955] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:01 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:01.770813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db920eb6-0ffa-4103-83b9-13f2a68db241 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:01.784436 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1501/2956] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:01 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:01.786258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbf78c-af1b-48c3-bba1-500ca7dfe088 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:01.888367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db920eb6-0ffa-4103-83b9-13f2a68db241 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:01.907277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbf78c-af1b-48c3-bba1-500ca7dfe088 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:01.915013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec65e-68d1-4bcd-b4fe-b06036187792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:01.916617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec65e-68d1-4bcd-b4fe-b06036187792 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.917131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec65e-68d1-4bcd-b4fe-b06036187792 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.917614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ec65e-68d1-4bcd-b4fe-b06036187792 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.918928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec65e-68d1-4bcd-b4fe-b06036187792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:01.921572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ec65e-68d1-4bcd-b4fe-b06036187792 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:01.968013 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1502/2957] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:01 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:01.968961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec65e-68d1-4bcd-b4fe-b06036187792 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:01.980185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ec65e-68d1-4bcd-b4fe-b06036187792 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:01.986516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357795cd-14e6-4945-a225-35d11ef2a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:01.987565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357795cd-14e6-4945-a225-35d11ef2a9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.988086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357795cd-14e6-4945-a225-35d11ef2a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.988518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357795cd-14e6-4945-a225-35d11ef2a9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.989681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357795cd-14e6-4945-a225-35d11ef2a9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:01.991799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357795cd-14e6-4945-a225-35d11ef2a9e4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:01.994027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5b8ce-5e40-467b-a95b-1f02863ac711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:01.995159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b8ce-5e40-467b-a95b-1f02863ac711 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:01.995585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b8ce-5e40-467b-a95b-1f02863ac711 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:01.997059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5b8ce-5e40-467b-a95b-1f02863ac711 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:01.997912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5b8ce-5e40-467b-a95b-1f02863ac711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.000844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5b8ce-5e40-467b-a95b-1f02863ac711 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.020617 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1503/2958] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:02.022596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357795cd-14e6-4945-a225-35d11ef2a9e4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.040610 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1456/2959] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:01 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:02.049018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5b8ce-5e40-467b-a95b-1f02863ac711 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.051687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357795cd-14e6-4945-a225-35d11ef2a9e4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.057448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4308e-5d5d-4b5d-9d34-fcbf815ff825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.058380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4308e-5d5d-4b5d-9d34-fcbf815ff825 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.058848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4308e-5d5d-4b5d-9d34-fcbf815ff825 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.059837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4308e-5d5d-4b5d-9d34-fcbf815ff825 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.060612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5b8ce-5e40-467b-a95b-1f02863ac711 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.061003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4308e-5d5d-4b5d-9d34-fcbf815ff825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.063090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4308e-5d5d-4b5d-9d34-fcbf815ff825 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.065772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f5a5f-4077-4d78-9166-48cd976683e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.066768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f5a5f-4077-4d78-9166-48cd976683e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.067054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f5a5f-4077-4d78-9166-48cd976683e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.067329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f5a5f-4077-4d78-9166-48cd976683e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.068089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f5a5f-4077-4d78-9166-48cd976683e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.069698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f5a5f-4077-4d78-9166-48cd976683e8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.077822 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1504/2960] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:02.084324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4308e-5d5d-4b5d-9d34-fcbf815ff825 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.086764 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1457/2961] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:02.088407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f5a5f-4077-4d78-9166-48cd976683e8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.100155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f5a5f-4077-4d78-9166-48cd976683e8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.100476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4308e-5d5d-4b5d-9d34-fcbf815ff825 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.105005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506c6b9-63a9-4f64-abc3-077c06edc1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.105682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506c6b9-63a9-4f64-abc3-077c06edc1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.106002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506c6b9-63a9-4f64-abc3-077c06edc1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.106284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1506c6b9-63a9-4f64-abc3-077c06edc1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.107087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738c8cd-0db2-4841-8fd8-98536ec3c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.107226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506c6b9-63a9-4f64-abc3-077c06edc1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.108871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1506c6b9-63a9-4f64-abc3-077c06edc1f9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.109298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738c8cd-0db2-4841-8fd8-98536ec3c285 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.109676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738c8cd-0db2-4841-8fd8-98536ec3c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.110074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738c8cd-0db2-4841-8fd8-98536ec3c285 admin admin] PATH_INFO: `/v3/projects/39273eada056495685094a0e70a466b7/users/e6181a81f9194855aac72edb457045ef/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.123102 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1458/2962] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:02.124284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506c6b9-63a9-4f64-abc3-077c06edc1f9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.136267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1506c6b9-63a9-4f64-abc3-077c06edc1f9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.136575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738c8cd-0db2-4841-8fd8-98536ec3c285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39273eada056495685094a0e70a466b7, user_id=e6181a81f9194855aac72edb457045ef, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.139435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738c8cd-0db2-4841-8fd8-98536ec3c285 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.141206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54eee62-5e1b-4996-a17c-aeb7b7773b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.142185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eee62-5e1b-4996-a17c-aeb7b7773b38 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.142759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eee62-5e1b-4996-a17c-aeb7b7773b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.143018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54eee62-5e1b-4996-a17c-aeb7b7773b38 admin admin] PATH_INFO: `/v3/projects/1de3ee23ad854cd3aed820396ed8bd53/users/b1109e52939e48759e11f26461e05a5a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.156583 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1505/2963] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:02 2022] PUT /identity/v3/projects/39273eada056495685094a0e70a466b7/users/e6181a81f9194855aac72edb457045ef/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:54:02.169027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163cab4-2876-4236-a90c-ae71d69d9029 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.169742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163cab4-2876-4236-a90c-ae71d69d9029 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.169742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163cab4-2876-4236-a90c-ae71d69d9029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.171085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eee62-5e1b-4996-a17c-aeb7b7773b38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1de3ee23ad854cd3aed820396ed8bd53, user_id=b1109e52939e48759e11f26461e05a5a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.174164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54eee62-5e1b-4996-a17c-aeb7b7773b38 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.189347 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1459/2964] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:02 2022] PUT /identity/v3/projects/1de3ee23ad854cd3aed820396ed8bd53/users/b1109e52939e48759e11f26461e05a5a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:02.198270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9163cab4-2876-4236-a90c-ae71d69d9029 None None] MFA Rules not processed for user `e6181a81f9194855aac72edb457045ef`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:02.199570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9163cab4-2876-4236-a90c-ae71d69d9029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:02.202974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c10ff-92a2-4edb-b4a7-ec49874c087c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.203327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c10ff-92a2-4edb-b4a7-ec49874c087c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.203669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c10ff-92a2-4edb-b4a7-ec49874c087c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.233468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ba9c10ff-92a2-4edb-b4a7-ec49874c087c None None] MFA Rules not processed for user `b1109e52939e48759e11f26461e05a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:02.235819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba9c10ff-92a2-4edb-b4a7-ec49874c087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:02.285209 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1506/2965] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:02.289586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163cab4-2876-4236-a90c-ae71d69d9029 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.321169 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1460/2966] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:02.326237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c10ff-92a2-4edb-b4a7-ec49874c087c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.397708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163cab4-2876-4236-a90c-ae71d69d9029 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.400735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c10ff-92a2-4edb-b4a7-ec49874c087c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.403449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c46f0b-2fad-4157-93d4-128cd162e2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.404962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c46f0b-2fad-4157-93d4-128cd162e2cb admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.405494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c46f0b-2fad-4157-93d4-128cd162e2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.405977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c46f0b-2fad-4157-93d4-128cd162e2cb admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.407303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c46f0b-2fad-4157-93d4-128cd162e2cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.409697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c46f0b-2fad-4157-93d4-128cd162e2cb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.448034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962fced-e319-4b6f-aa19-b572682fd164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.449324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962fced-e319-4b6f-aa19-b572682fd164 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.449610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962fced-e319-4b6f-aa19-b572682fd164 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.449869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962fced-e319-4b6f-aa19-b572682fd164 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.452726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962fced-e319-4b6f-aa19-b572682fd164 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.456740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962fced-e319-4b6f-aa19-b572682fd164 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.459826 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1507/2967] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:02 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:54:02.464992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c46f0b-2fad-4157-93d4-128cd162e2cb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.515496 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1461/2968] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:02 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:54:02.517094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962fced-e319-4b6f-aa19-b572682fd164 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.601693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962fced-e319-4b6f-aa19-b572682fd164 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.609448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191491b9-90d6-4950-b09e-fcbd1f4d7ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.610287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191491b9-90d6-4950-b09e-fcbd1f4d7ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.611244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191491b9-90d6-4950-b09e-fcbd1f4d7ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.611638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191491b9-90d6-4950-b09e-fcbd1f4d7ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.612467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191491b9-90d6-4950-b09e-fcbd1f4d7ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.615022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191491b9-90d6-4950-b09e-fcbd1f4d7ac2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.635842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c46f0b-2fad-4157-93d4-128cd162e2cb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.643971 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1462/2969] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:02 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:02.648441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191491b9-90d6-4950-b09e-fcbd1f4d7ac2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.648596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07652-2120-4eb0-92ec-96425ada26d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.649215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07652-2120-4eb0-92ec-96425ada26d5 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.649604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07652-2120-4eb0-92ec-96425ada26d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.649885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d07652-2120-4eb0-92ec-96425ada26d5 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.650608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d07652-2120-4eb0-92ec-96425ada26d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.652611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d07652-2120-4eb0-92ec-96425ada26d5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.663035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191491b9-90d6-4950-b09e-fcbd1f4d7ac2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.671654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8a02f-191f-4487-b79e-59e67200e794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.672648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8a02f-191f-4487-b79e-59e67200e794 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.672927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8a02f-191f-4487-b79e-59e67200e794 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.673227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8a02f-191f-4487-b79e-59e67200e794 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.674243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8a02f-191f-4487-b79e-59e67200e794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.676461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8a02f-191f-4487-b79e-59e67200e794 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.694493 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1508/2970] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:02 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:02.695832 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1463/2971] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:02.696028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07652-2120-4eb0-92ec-96425ada26d5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.700483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8a02f-191f-4487-b79e-59e67200e794 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.710170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d07652-2120-4eb0-92ec-96425ada26d5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.716242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9fc5-0e68-4093-ae75-3282547c742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.717080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9fc5-0e68-4093-ae75-3282547c742b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.717468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9fc5-0e68-4093-ae75-3282547c742b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.717836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee9fc5-0e68-4093-ae75-3282547c742b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.719224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9fc5-0e68-4093-ae75-3282547c742b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.721013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee9fc5-0e68-4093-ae75-3282547c742b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.735745 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1509/2972] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:02.739731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9fc5-0e68-4093-ae75-3282547c742b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.745553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8a02f-191f-4487-b79e-59e67200e794 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.760430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee9fc5-0e68-4093-ae75-3282547c742b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.767134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465429e0-ceba-417b-b3e8-779a1e4ef2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.768124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465429e0-ceba-417b-b3e8-779a1e4ef2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.768415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465429e0-ceba-417b-b3e8-779a1e4ef2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.768690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465429e0-ceba-417b-b3e8-779a1e4ef2d3 admin admin] PATH_INFO: `/v3/projects/6bc06c9265914d5d9a2bcfb444000b58/users/c0c91597b44944b8907105600638a6e3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.779592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80315af3-8858-4698-bd84-2cc8bd61df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.780518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80315af3-8858-4698-bd84-2cc8bd61df1d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.780798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80315af3-8858-4698-bd84-2cc8bd61df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.781072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80315af3-8858-4698-bd84-2cc8bd61df1d admin admin] PATH_INFO: `/v3/projects/c1b0cc0fe8514a5c97449c1803081e1d/users/d213adeea4a24f4ebdaee8e152919ef1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.796388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465429e0-ceba-417b-b3e8-779a1e4ef2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc06c9265914d5d9a2bcfb444000b58, user_id=c0c91597b44944b8907105600638a6e3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.801502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465429e0-ceba-417b-b3e8-779a1e4ef2d3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.819655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80315af3-8858-4698-bd84-2cc8bd61df1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b0cc0fe8514a5c97449c1803081e1d, user_id=d213adeea4a24f4ebdaee8e152919ef1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.824500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80315af3-8858-4698-bd84-2cc8bd61df1d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:02.831110 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1464/2973] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:02 2022] PUT /identity/v3/projects/6bc06c9265914d5d9a2bcfb444000b58/users/c0c91597b44944b8907105600638a6e3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:02.835525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465429e0-ceba-417b-b3e8-779a1e4ef2d3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.848992 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1510/2974] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:02 2022] PUT /identity/v3/projects/c1b0cc0fe8514a5c97449c1803081e1d/users/d213adeea4a24f4ebdaee8e152919ef1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:02.860371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80315af3-8858-4698-bd84-2cc8bd61df1d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:02.913729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465429e0-ceba-417b-b3e8-779a1e4ef2d3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.973301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80315af3-8858-4698-bd84-2cc8bd61df1d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:02.981770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cda626-868c-4eeb-8d68-645a6c9b14d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:02.982785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cda626-868c-4eeb-8d68-645a6c9b14d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:02.983265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cda626-868c-4eeb-8d68-645a6c9b14d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:02.984230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cda626-868c-4eeb-8d68-645a6c9b14d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:02.986218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cda626-868c-4eeb-8d68-645a6c9b14d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:02.988741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cda626-868c-4eeb-8d68-645a6c9b14d7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:03.022885 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1511/2975] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:03.030770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cda626-868c-4eeb-8d68-645a6c9b14d7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:03.041016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39448ccc-64ba-4ed3-bbd9-154b6288b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:03.041699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39448ccc-64ba-4ed3-bbd9-154b6288b0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.041979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39448ccc-64ba-4ed3-bbd9-154b6288b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.042252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39448ccc-64ba-4ed3-bbd9-154b6288b0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.042983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39448ccc-64ba-4ed3-bbd9-154b6288b0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:03.044651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39448ccc-64ba-4ed3-bbd9-154b6288b0b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:03.049713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cda626-868c-4eeb-8d68-645a6c9b14d7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:03.054757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43031d0e-a4d3-4477-8681-77d059b0eeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:03.057437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031d0e-a4d3-4477-8681-77d059b0eeb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.057905 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1465/2976] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:03.058981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031d0e-a4d3-4477-8681-77d059b0eeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.059262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031d0e-a4d3-4477-8681-77d059b0eeb9 admin admin] PATH_INFO: `/v3/projects/c1b0cc0fe8514a5c97449c1803081e1d/users/d213adeea4a24f4ebdaee8e152919ef1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.061529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43031d0e-a4d3-4477-8681-77d059b0eeb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b0cc0fe8514a5c97449c1803081e1d, user_id=d213adeea4a24f4ebdaee8e152919ef1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:03.061982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39448ccc-64ba-4ed3-bbd9-154b6288b0b0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:03.066086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43031d0e-a4d3-4477-8681-77d059b0eeb9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:03.088896 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1512/2977] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:03 2022] PUT /identity/v3/projects/c1b0cc0fe8514a5c97449c1803081e1d/users/d213adeea4a24f4ebdaee8e152919ef1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:03.094548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39448ccc-64ba-4ed3-bbd9-154b6288b0b0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:03.107400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6727-f62c-4da9-8568-fe46e1af9bda None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.108283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6727-f62c-4da9-8568-fe46e1af9bda None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.108614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6727-f62c-4da9-8568-fe46e1af9bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.153292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-de8f6727-f62c-4da9-8568-fe46e1af9bda None None] MFA Rules not processed for user `d213adeea4a24f4ebdaee8e152919ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:03.154558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-de8f6727-f62c-4da9-8568-fe46e1af9bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:03.180248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4f914-b7dd-43d5-b655-05715fc96487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:03.181848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f914-b7dd-43d5-b655-05715fc96487 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.182228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f914-b7dd-43d5-b655-05715fc96487 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.183206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4f914-b7dd-43d5-b655-05715fc96487 admin admin] PATH_INFO: `/v3/projects/6bc06c9265914d5d9a2bcfb444000b58/users/c0c91597b44944b8907105600638a6e3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.185043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f914-b7dd-43d5-b655-05715fc96487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc06c9265914d5d9a2bcfb444000b58, user_id=c0c91597b44944b8907105600638a6e3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:03.187831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4f914-b7dd-43d5-b655-05715fc96487 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:03.209381 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1466/2978] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:03 2022] PUT /identity/v3/projects/6bc06c9265914d5d9a2bcfb444000b58/users/c0c91597b44944b8907105600638a6e3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:03.211093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf7d88-2417-4c9b-aa0b-656bf2c64add None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.211382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf7d88-2417-4c9b-aa0b-656bf2c64add None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.211661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf7d88-2417-4c9b-aa0b-656bf2c64add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.275241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-19bf7d88-2417-4c9b-aa0b-656bf2c64add None None] MFA Rules not processed for user `c0c91597b44944b8907105600638a6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:03.275577 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1513/2979] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:03.277270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-19bf7d88-2417-4c9b-aa0b-656bf2c64add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:03.282039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6727-f62c-4da9-8568-fe46e1af9bda None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:03.312865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6727-f62c-4da9-8568-fe46e1af9bda None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:03.376351 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1467/2980] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:03.401721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c4b78-e62e-4dda-a16e-fe6c16b3444a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.402010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c4b78-e62e-4dda-a16e-fe6c16b3444a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.402288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c4b78-e62e-4dda-a16e-fe6c16b3444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.426450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ad7c4b78-e62e-4dda-a16e-fe6c16b3444a None None] MFA Rules not processed for user `b1109e52939e48759e11f26461e05a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:03.427268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ad7c4b78-e62e-4dda-a16e-fe6c16b3444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:03.430139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b71124-1880-4325-86a2-fe1f651f2bb0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:03.433275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b71124-1880-4325-86a2-fe1f651f2bb0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.433741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b71124-1880-4325-86a2-fe1f651f2bb0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.434176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b71124-1880-4325-86a2-fe1f651f2bb0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.436239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b71124-1880-4325-86a2-fe1f651f2bb0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:03.437246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b71124-1880-4325-86a2-fe1f651f2bb0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:03.442238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b71124-1880-4325-86a2-fe1f651f2bb0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:03.466446 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1514/2981] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:03.470046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b71124-1880-4325-86a2-fe1f651f2bb0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:03.495009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b71124-1880-4325-86a2-fe1f651f2bb0 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:03.501912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc844-5edc-4072-bd00-1b1e243485ed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:03.502583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc844-5edc-4072-bd00-1b1e243485ed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.502865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc844-5edc-4072-bd00-1b1e243485ed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.503140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffc844-5edc-4072-bd00-1b1e243485ed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.503840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffc844-5edc-4072-bd00-1b1e243485ed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:03.507207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffc844-5edc-4072-bd00-1b1e243485ed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:03.515092 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1468/2982] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:03.581187 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1515/2983] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:03 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:03.585405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c4b78-e62e-4dda-a16e-fe6c16b3444a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:03.598627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c4b78-e62e-4dda-a16e-fe6c16b3444a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:03.702648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ea5cf-b4e7-40b9-9478-47ad9188ba8e tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:03.703406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ea5cf-b4e7-40b9-9478-47ad9188ba8e tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.703704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ea5cf-b4e7-40b9-9478-47ad9188ba8e tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.704241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ea5cf-b4e7-40b9-9478-47ad9188ba8e tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.705361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ea5cf-b4e7-40b9-9478-47ad9188ba8e tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:03.705685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ea5cf-b4e7-40b9-9478-47ad9188ba8e tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:03.709599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ea5cf-b4e7-40b9-9478-47ad9188ba8e tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:03.740067 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1469/2984] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:03.883562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc844-5edc-4072-bd00-1b1e243485ed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:03.885831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0cffc844-5edc-4072-bd00-1b1e243485ed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:03.897518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca019d04-3b9e-4568-bb52-38336d304c15 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:03.897803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca019d04-3b9e-4568-bb52-38336d304c15 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:03.898081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca019d04-3b9e-4568-bb52-38336d304c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:03.926310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ca019d04-3b9e-4568-bb52-38336d304c15 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:03.928148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ca019d04-3b9e-4568-bb52-38336d304c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:04.043497 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1470/2985] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:54:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:04.068153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca019d04-3b9e-4568-bb52-38336d304c15 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:04.069926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ca019d04-3b9e-4568-bb52-38336d304c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:04.136540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffc844-5edc-4072-bd00-1b1e243485ed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:04.148092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12fc31-18ff-48ce-8a89-097b15cefd54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:04.148784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12fc31-18ff-48ce-8a89-097b15cefd54 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:04.149168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12fc31-18ff-48ce-8a89-097b15cefd54 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:04.149472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12fc31-18ff-48ce-8a89-097b15cefd54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:04.256339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca019d04-3b9e-4568-bb52-38336d304c15 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:04.263695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9372014-47ba-45af-9d17-322a33a835e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:04.265336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9372014-47ba-45af-9d17-322a33a835e3 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:04.266026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9372014-47ba-45af-9d17-322a33a835e3 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:04.266522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9372014-47ba-45af-9d17-322a33a835e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:04.277282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12fc31-18ff-48ce-8a89-097b15cefd54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:04.277891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9372014-47ba-45af-9d17-322a33a835e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:04.279464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12fc31-18ff-48ce-8a89-097b15cefd54 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:04.280276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9372014-47ba-45af-9d17-322a33a835e3 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:04.303394 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1471/2986] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:54:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:54:04.307383 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1516/2987] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:04.445395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9372014-47ba-45af-9d17-322a33a835e3 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:04.447235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e9372014-47ba-45af-9d17-322a33a835e3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:04.450106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13e315-3239-4506-bbe7-747c00f553e1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:04.450401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13e315-3239-4506-bbe7-747c00f553e1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:04.450687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13e315-3239-4506-bbe7-747c00f553e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:04.481067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9372014-47ba-45af-9d17-322a33a835e3 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:04.490547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1a2b2-9366-4d11-9483-e1c3c4166342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:04.491465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1a2b2-9366-4d11-9483-e1c3c4166342 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:04.491968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1a2b2-9366-4d11-9483-e1c3c4166342 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:04.492420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1a2b2-9366-4d11-9483-e1c3c4166342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:04.502722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1a2b2-9366-4d11-9483-e1c3c4166342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:04.505402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1a2b2-9366-4d11-9483-e1c3c4166342 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:04.518076 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1472/2988] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:04.535044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2f13e315-3239-4506-bbe7-747c00f553e1 None None] MFA Rules not processed for user `8ec5c027b8a84b9cb85214bec04168af`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:04.536391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2f13e315-3239-4506-bbe7-747c00f553e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:04.539959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3c21-1838-438c-a9a0-0a4eb3d92aae None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:04.541612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3c21-1838-438c-a9a0-0a4eb3d92aae None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:04.542089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3c21-1838-438c-a9a0-0a4eb3d92aae None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:04.548202 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1473/2989] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:04.555323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3c21-1838-438c-a9a0-0a4eb3d92aae None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:04.600804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3c21-1838-438c-a9a0-0a4eb3d92aae None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:04.621323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3c21-1838-438c-a9a0-0a4eb3d92aae None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:04.639705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763aa4c4-daf8-421c-a19a-82550dec8c25 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:04.642780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa4c4-daf8-421c-a19a-82550dec8c25 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:04.643075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa4c4-daf8-421c-a19a-82550dec8c25 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:04.644530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763aa4c4-daf8-421c-a19a-82550dec8c25 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/aa8a62109f93435083b317c2eac1be80` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:04.647056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aa4c4-daf8-421c-a19a-82550dec8c25 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=aa8a62109f93435083b317c2eac1be80)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:04.650650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763aa4c4-daf8-421c-a19a-82550dec8c25 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:04.652998 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1474/2990] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:04 2022] GET /identity/v3/projects/aa8a62109f93435083b317c2eac1be80 => generated 371 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:04.741077 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1517/2991] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:05.225094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aafa34-7840-44d3-8d3e-04398f98c2b3 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:05.225639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aafa34-7840-44d3-8d3e-04398f98c2b3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:05.226105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aafa34-7840-44d3-8d3e-04398f98c2b3 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:05.228590 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1475/2992] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:05.234269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13e315-3239-4506-bbe7-747c00f553e1 None None] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:05.250341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13e315-3239-4506-bbe7-747c00f553e1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:05.261979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13e315-3239-4506-bbe7-747c00f553e1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:05.267942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed6488-4754-4399-9e3c-14c70e4b76aa tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:05.269034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed6488-4754-4399-9e3c-14c70e4b76aa tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:05.269405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed6488-4754-4399-9e3c-14c70e4b76aa tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:05.269663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed6488-4754-4399-9e3c-14c70e4b76aa tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/aa8a62109f93435083b317c2eac1be80` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:05.271188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed6488-4754-4399-9e3c-14c70e4b76aa tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=aa8a62109f93435083b317c2eac1be80)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:05.273614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed6488-4754-4399-9e3c-14c70e4b76aa tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:05.288317 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1518/2993] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:05 2022] GET /identity/v3/projects/aa8a62109f93435083b317c2eac1be80 => generated 371 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:05.468252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aafa34-7840-44d3-8d3e-04398f98c2b3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:05.492626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aafa34-7840-44d3-8d3e-04398f98c2b3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:05.511208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c783da-ce38-4063-9bc2-7b4de68a0da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:05.512821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c783da-ce38-4063-9bc2-7b4de68a0da4 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:05.515062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c783da-ce38-4063-9bc2-7b4de68a0da4 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:05.515531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c783da-ce38-4063-9bc2-7b4de68a0da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:05.538367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c783da-ce38-4063-9bc2-7b4de68a0da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:05.542995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c783da-ce38-4063-9bc2-7b4de68a0da4 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:05.570375 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1476/2994] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:06.953919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18059d0-8f49-4b6c-abb2-7053bf4004ac None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:06.954488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18059d0-8f49-4b6c-abb2-7053bf4004ac None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:06.954488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18059d0-8f49-4b6c-abb2-7053bf4004ac None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:06.956237 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1519/2995] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:06.965043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c783da-ce38-4063-9bc2-7b4de68a0da4 service nova] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:06.981556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c783da-ce38-4063-9bc2-7b4de68a0da4 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:06.996736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c783da-ce38-4063-9bc2-7b4de68a0da4 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:07.017393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc34692-55c2-43c6-922c-09cdb1ae23be tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:07.027073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc34692-55c2-43c6-922c-09cdb1ae23be tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:07.027553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc34692-55c2-43c6-922c-09cdb1ae23be tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:07.028047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc34692-55c2-43c6-922c-09cdb1ae23be tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/aa8a62109f93435083b317c2eac1be80` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:07.030179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc34692-55c2-43c6-922c-09cdb1ae23be tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=aa8a62109f93435083b317c2eac1be80)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:07.032711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc34692-55c2-43c6-922c-09cdb1ae23be tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:07.048268 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1477/2996] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:06 2022] GET /identity/v3/projects/aa8a62109f93435083b317c2eac1be80 => generated 371 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:07.061048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18059d0-8f49-4b6c-abb2-7053bf4004ac None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:07.084720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18059d0-8f49-4b6c-abb2-7053bf4004ac None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:07.092512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:07.093367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:07.093651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:07.093929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/aa8a62109f93435083b317c2eac1be80` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:07.100482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aa8a62109f93435083b317c2eac1be80)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:07.106341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:07.221405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa8a62109f93435083b317c2eac1be80', 'request_id': 'req-9cefb791-8dd5-4b5e-93af-f17a4bebe507'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:07.245863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa8a62109f93435083b317c2eac1be80', 'request_id': 'req-9cefb791-8dd5-4b5e-93af-f17a4bebe507'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:07.262476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa8a62109f93435083b317c2eac1be80', 'request_id': 'req-9cefb791-8dd5-4b5e-93af-f17a4bebe507'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:07.313341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] The token cache is being invalidate because project aa8a62109f93435083b317c2eac1be80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:07.313640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:07.315196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:07.318707 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1520/2997] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:07 2022] DELETE /identity/v3/projects/aa8a62109f93435083b317c2eac1be80 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:08.385841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c089-9e84-491c-a54b-2625e4647905 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:08.386412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c089-9e84-491c-a54b-2625e4647905 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:08.386759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2c089-9e84-491c-a54b-2625e4647905 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:08.389146 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1478/2998] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:08.403236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:08.405753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:08.609523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:08.612624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:08.732840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefb791-8dd5-4b5e-93af-f17a4bebe507 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:08.739666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd6126-cfa3-4016-b909-5dabc140cc6c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:08.740928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd6126-cfa3-4016-b909-5dabc140cc6c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:08.741447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd6126-cfa3-4016-b909-5dabc140cc6c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:08.741935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bd6126-cfa3-4016-b909-5dabc140cc6c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/39273eada056495685094a0e70a466b7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:08.743380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd6126-cfa3-4016-b909-5dabc140cc6c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=39273eada056495685094a0e70a466b7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:08.746704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bd6126-cfa3-4016-b909-5dabc140cc6c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:08.764094 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1521/2999] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:08 2022] GET /identity/v3/projects/39273eada056495685094a0e70a466b7 => generated 373 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:08.768922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c089-9e84-491c-a54b-2625e4647905 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:08.790822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2c089-9e84-491c-a54b-2625e4647905 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:08.802336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005efda-b3f6-4ff0-a88b-990fe28fbb54 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:08.803901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005efda-b3f6-4ff0-a88b-990fe28fbb54 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:08.808144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005efda-b3f6-4ff0-a88b-990fe28fbb54 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:08.808721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005efda-b3f6-4ff0-a88b-990fe28fbb54 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:08.809698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005efda-b3f6-4ff0-a88b-990fe28fbb54 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:08.810258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005efda-b3f6-4ff0-a88b-990fe28fbb54 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:08.813829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005efda-b3f6-4ff0-a88b-990fe28fbb54 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:08.845831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd6126-cfa3-4016-b909-5dabc140cc6c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:08.846602 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1479/3000] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:08.857781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bd6126-cfa3-4016-b909-5dabc140cc6c tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:08.887438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1d3f-947a-47b6-bafb-48ae48d50669 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:08.888737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1d3f-947a-47b6-bafb-48ae48d50669 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:08.892093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1d3f-947a-47b6-bafb-48ae48d50669 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:08.892699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a1d3f-947a-47b6-bafb-48ae48d50669 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:08.893924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a1d3f-947a-47b6-bafb-48ae48d50669 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:08.898659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a1d3f-947a-47b6-bafb-48ae48d50669 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:08.945319 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1522/3001] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:08 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:08.950540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005efda-b3f6-4ff0-a88b-990fe28fbb54 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:08.965396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005efda-b3f6-4ff0-a88b-990fe28fbb54 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:09.128818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:09.129658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:09.130046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:09.130475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:09.131706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:09.133828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:09.136290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:09.166941 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1480/3002] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:10.048650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1d3f-947a-47b6-bafb-48ae48d50669 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:10.052291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-192a1d3f-947a-47b6-bafb-48ae48d50669 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:10.219442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a1d3f-947a-47b6-bafb-48ae48d50669 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:10.226094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64df51e-716a-4402-9ce1-92e0b5b02bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:10.227189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64df51e-716a-4402-9ce1-92e0b5b02bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:10.227722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64df51e-716a-4402-9ce1-92e0b5b02bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:10.228888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64df51e-716a-4402-9ce1-92e0b5b02bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:10.242579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e64df51e-716a-4402-9ce1-92e0b5b02bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:10.394137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64df51e-716a-4402-9ce1-92e0b5b02bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:10.395587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64df51e-716a-4402-9ce1-92e0b5b02bd1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:10.420671 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1523/3003] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:10.801948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:10.845944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:10.890723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc24e0-6be5-491e-92e3-eb389f8bbce7 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:10.940205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:10.941710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:10.944232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:10.944741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:10.949562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:10.967744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:10.970407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:10.984419 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1481/3004] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:11.107416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec39ec-c9ec-4d83-86fe-42fdb3ad98ce None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:11.109449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec39ec-c9ec-4d83-86fe-42fdb3ad98ce None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:11.109898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ec39ec-c9ec-4d83-86fe-42fdb3ad98ce None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:11.112177 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1524/3005] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:11.128715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:11.130845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:11.182709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:11.231116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db0a09-b30f-476a-be2b-db7615994a66 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:11.257619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de1c6d-a4e3-4528-9e26-c5e15a03c7cb tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:11.258565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de1c6d-a4e3-4528-9e26-c5e15a03c7cb tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:11.258882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de1c6d-a4e3-4528-9e26-c5e15a03c7cb tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:11.259165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de1c6d-a4e3-4528-9e26-c5e15a03c7cb tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/8c7f858a6afd4998950d168a0c489bf3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:11.261231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de1c6d-a4e3-4528-9e26-c5e15a03c7cb tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c7f858a6afd4998950d168a0c489bf3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:11.263497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de1c6d-a4e3-4528-9e26-c5e15a03c7cb tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:11.265707 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1482/3006] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:11 2022] GET /identity/v3/projects/8c7f858a6afd4998950d168a0c489bf3 => generated 369 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:12.483777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d7bc7-7a17-4862-8347-5453d87bd6a9 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:12.484430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d7bc7-7a17-4862-8347-5453d87bd6a9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:12.484430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d7bc7-7a17-4862-8347-5453d87bd6a9 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:12.489921 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1525/3007] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:12.496918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de1c6d-a4e3-4528-9e26-c5e15a03c7cb tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:12.515448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de1c6d-a4e3-4528-9e26-c5e15a03c7cb tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:12.532283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de1c6d-a4e3-4528-9e26-c5e15a03c7cb tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:12.539504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e9acf-9d4d-4eb8-8c13-9252a30e0766 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:12.541298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9acf-9d4d-4eb8-8c13-9252a30e0766 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:12.541794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9acf-9d4d-4eb8-8c13-9252a30e0766 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:12.543095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9acf-9d4d-4eb8-8c13-9252a30e0766 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/8c7f858a6afd4998950d168a0c489bf3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:12.544744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e9acf-9d4d-4eb8-8c13-9252a30e0766 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c7f858a6afd4998950d168a0c489bf3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:12.547098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e9acf-9d4d-4eb8-8c13-9252a30e0766 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:12.576187 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1483/3008] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:12 2022] GET /identity/v3/projects/8c7f858a6afd4998950d168a0c489bf3 => generated 369 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:12.616254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d7bc7-7a17-4862-8347-5453d87bd6a9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:12.637693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d7bc7-7a17-4862-8347-5453d87bd6a9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:12.654418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e43bc-1e82-47d4-a65b-dda4fef45ed6 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:12.655737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e43bc-1e82-47d4-a65b-dda4fef45ed6 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:12.656233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e43bc-1e82-47d4-a65b-dda4fef45ed6 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:12.656680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e43bc-1e82-47d4-a65b-dda4fef45ed6 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:12.657631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e43bc-1e82-47d4-a65b-dda4fef45ed6 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:12.660360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e43bc-1e82-47d4-a65b-dda4fef45ed6 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:12.662219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e43bc-1e82-47d4-a65b-dda4fef45ed6 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:12.695158 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1526/3009] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:12.697899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e9acf-9d4d-4eb8-8c13-9252a30e0766 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:12.715130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e9acf-9d4d-4eb8-8c13-9252a30e0766 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:12.728949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626f2c-7a55-4fc8-811c-974e8ff793b1 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:12.729643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626f2c-7a55-4fc8-811c-974e8ff793b1 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:12.729930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626f2c-7a55-4fc8-811c-974e8ff793b1 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:12.730263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626f2c-7a55-4fc8-811c-974e8ff793b1 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:12.730979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01626f2c-7a55-4fc8-811c-974e8ff793b1 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:12.735583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01626f2c-7a55-4fc8-811c-974e8ff793b1 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:12.774003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e43bc-1e82-47d4-a65b-dda4fef45ed6 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:12.784675 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1484/3010] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:12 2022] POST /identity/v3/users => generated 381 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:12.793606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e43bc-1e82-47d4-a65b-dda4fef45ed6 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:12.808751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:12.809454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:12.809739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:12.810015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:12.810743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:12.811051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:12.812770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:12.841876 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1527/3011] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:13.020248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f72b00-7e19-4111-b96f-8fe220e3dcc4 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:13.020536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f72b00-7e19-4111-b96f-8fe220e3dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:13.020811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f72b00-7e19-4111-b96f-8fe220e3dcc4 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:13.022878 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1485/3012] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:13.043434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:13.067510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:13.086244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343780b-d28c-4224-b77a-92f0531b94c4 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:13.094329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49753d-61a3-45af-9a35-fcea8fc47183 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:13.095625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49753d-61a3-45af-9a35-fcea8fc47183 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:13.096117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49753d-61a3-45af-9a35-fcea8fc47183 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:13.096551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49753d-61a3-45af-9a35-fcea8fc47183 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/8c7f858a6afd4998950d168a0c489bf3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:13.098074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49753d-61a3-45af-9a35-fcea8fc47183 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c7f858a6afd4998950d168a0c489bf3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:13.102158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49753d-61a3-45af-9a35-fcea8fc47183 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:13.114859 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1528/3013] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:13 2022] GET /identity/v3/projects/8c7f858a6afd4998950d168a0c489bf3 => generated 369 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:13.848057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61794d-8ff4-4e7d-9563-0659cf5f1dc8 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:13.848903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61794d-8ff4-4e7d-9563-0659cf5f1dc8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:13.849361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a61794d-8ff4-4e7d-9563-0659cf5f1dc8 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:13.851559 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1486/3014] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:13.857596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49753d-61a3-45af-9a35-fcea8fc47183 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:13.871038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49753d-61a3-45af-9a35-fcea8fc47183 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:13.886766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49753d-61a3-45af-9a35-fcea8fc47183 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:13.901489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb1ec-a90a-4d51-84db-c075f122836a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:13.903838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb1ec-a90a-4d51-84db-c075f122836a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:13.904350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb1ec-a90a-4d51-84db-c075f122836a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:13.904878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edb1ec-a90a-4d51-84db-c075f122836a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/8c7f858a6afd4998950d168a0c489bf3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:13.906284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edb1ec-a90a-4d51-84db-c075f122836a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=8c7f858a6afd4998950d168a0c489bf3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:13.910853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edb1ec-a90a-4d51-84db-c075f122836a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:13.913438 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1529/3015] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:13 2022] GET /identity/v3/projects/8c7f858a6afd4998950d168a0c489bf3 => generated 369 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:13.951730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61794d-8ff4-4e7d-9563-0659cf5f1dc8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:13.968861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a61794d-8ff4-4e7d-9563-0659cf5f1dc8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:13.974575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:13.975504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:13.975792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:13.976099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/users/bff382a2b81f4c74af38f4ee2d4bb779` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:14.010742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bff382a2b81f4c74af38f4ee2d4bb779)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:14.013100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:14.101959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bff382a2b81f4c74af38f4ee2d4bb779'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.116751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bff382a2b81f4c74af38f4ee2d4bb779'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.120459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bff382a2b81f4c74af38f4ee2d4bb779'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.123271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bff382a2b81f4c74af38f4ee2d4bb779'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.144851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c344e5f6-7395-4983-a80a-9b63a79ee9ca tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bff382a2b81f4c74af38f4ee2d4bb779'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.164012 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1487/3016] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:13 2022] DELETE /identity/v3/users/bff382a2b81f4c74af38f4ee2d4bb779 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:14.168782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb1ec-a90a-4d51-84db-c075f122836a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:14.170475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f8edb1ec-a90a-4d51-84db-c075f122836a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:14.188483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edb1ec-a90a-4d51-84db-c075f122836a tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:14.290476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:14.292104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:14.292393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:14.292673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/8c7f858a6afd4998950d168a0c489bf3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:14.294052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8c7f858a6afd4998950d168a0c489bf3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:14.296012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:14.357327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c7f858a6afd4998950d168a0c489bf3', 'request_id': 'req-061fa9f8-7be2-4010-a91a-bdad6c97baed'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.385347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c7f858a6afd4998950d168a0c489bf3', 'request_id': 'req-061fa9f8-7be2-4010-a91a-bdad6c97baed'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.399113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c7f858a6afd4998950d168a0c489bf3', 'request_id': 'req-061fa9f8-7be2-4010-a91a-bdad6c97baed'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.425518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] The token cache is being invalidate because project 8c7f858a6afd4998950d168a0c489bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:14.432583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.434668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:14.436459 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1530/3017] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:14 2022] DELETE /identity/v3/projects/8c7f858a6afd4998950d168a0c489bf3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:15.029082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5fbd-6192-4e2b-917a-6c869933dc93 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:15.029516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5fbd-6192-4e2b-917a-6c869933dc93 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:15.029637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d5fbd-6192-4e2b-917a-6c869933dc93 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:15.032539 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1488/3018] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:15.038157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:15.039602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:15.142841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:15.144269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:15.228181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fa9f8-7be2-4010-a91a-bdad6c97baed tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:15.237016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe65b4-9304-4b09-8227-d58325b03a37 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:15.237997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe65b4-9304-4b09-8227-d58325b03a37 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:15.238290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe65b4-9304-4b09-8227-d58325b03a37 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:15.238570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe65b4-9304-4b09-8227-d58325b03a37 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/39273eada056495685094a0e70a466b7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:15.240119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe65b4-9304-4b09-8227-d58325b03a37 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=39273eada056495685094a0e70a466b7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:15.242280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe65b4-9304-4b09-8227-d58325b03a37 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:15.251678 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1531/3019] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:15 2022] GET /identity/v3/projects/39273eada056495685094a0e70a466b7 => generated 373 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:15.752712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efc522-a0a7-41db-926f-6e311f8237d8 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:15.753257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efc522-a0a7-41db-926f-6e311f8237d8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:15.753727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efc522-a0a7-41db-926f-6e311f8237d8 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:15.755979 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1489/3020] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:15.761543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe65b4-9304-4b09-8227-d58325b03a37 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:15.784846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe65b4-9304-4b09-8227-d58325b03a37 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:15.825902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe65b4-9304-4b09-8227-d58325b03a37 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:15.837757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e6d5-0a3f-45f4-a237-6ea0a112edb8 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:15.838626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e6d5-0a3f-45f4-a237-6ea0a112edb8 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:15.838903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e6d5-0a3f-45f4-a237-6ea0a112edb8 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:15.839174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e6d5-0a3f-45f4-a237-6ea0a112edb8 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/39273eada056495685094a0e70a466b7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:15.840510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e6d5-0a3f-45f4-a237-6ea0a112edb8 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=39273eada056495685094a0e70a466b7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:15.847987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e6d5-0a3f-45f4-a237-6ea0a112edb8 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:15.860504 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1532/3021] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:15 2022] GET /identity/v3/projects/39273eada056495685094a0e70a466b7 => generated 373 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:16.423746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efc522-a0a7-41db-926f-6e311f8237d8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:16.429688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d4efc522-a0a7-41db-926f-6e311f8237d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:16.616449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efc522-a0a7-41db-926f-6e311f8237d8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:16.623926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:16.624778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:16.625144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:16.625487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:16.627588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:16.640260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:16.644075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:16.664156 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1490/3022] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:16.984210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e286aaf-2eca-4a67-8788-e798eb928f78 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:16.985074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e286aaf-2eca-4a67-8788-e798eb928f78 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:16.985509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e286aaf-2eca-4a67-8788-e798eb928f78 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:16.987951 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1533/3023] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:54:17.002003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:17.035693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:17.047864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee5ca7-5bb7-499f-8998-6d9a292587f0 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:17.052772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e40d1-ccdd-4d98-8c5b-2b079cc9b691 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213adeea4a24f4ebdaee8e152919ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1b0cc0fe8514a5c97449c1803081e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:17.053623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e40d1-ccdd-4d98-8c5b-2b079cc9b691 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:17.054194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e40d1-ccdd-4d98-8c5b-2b079cc9b691 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:17.054485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e40d1-ccdd-4d98-8c5b-2b079cc9b691 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] PATH_INFO: `/v3/projects/39273eada056495685094a0e70a466b7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:17.055956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e40d1-ccdd-4d98-8c5b-2b079cc9b691 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorizing `identity:get_project(project_id=39273eada056495685094a0e70a466b7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:17.071378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e40d1-ccdd-4d98-8c5b-2b079cc9b691 tempest-QuotasAdminTestJSON-434562934 tempest-QuotasAdminTestJSON-434562934-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:17.073723 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1491/3024] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:17 2022] GET /identity/v3/projects/39273eada056495685094a0e70a466b7 => generated 373 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:17.578310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e286aaf-2eca-4a67-8788-e798eb928f78 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:17.580306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8e286aaf-2eca-4a67-8788-e798eb928f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:17.714614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e286aaf-2eca-4a67-8788-e798eb928f78 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:17.724446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:17.725871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:17.726521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:17.726806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] PATH_INFO: `/v3/users/e6181a81f9194855aac72edb457045ef` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:17.728179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6181a81f9194855aac72edb457045ef)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:17.730430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:17.823198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6181a81f9194855aac72edb457045ef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:17.839369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6181a81f9194855aac72edb457045ef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:17.841141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6181a81f9194855aac72edb457045ef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:17.844993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6181a81f9194855aac72edb457045ef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:17.867095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6181a81f9194855aac72edb457045ef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:17.904152 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1534/3025] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:17 2022] DELETE /identity/v3/users/e6181a81f9194855aac72edb457045ef => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:17.908279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776681a-4d4a-4edb-82e9-0333c147cbb1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:17.908842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776681a-4d4a-4edb-82e9-0333c147cbb1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:17.909054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2776681a-4d4a-4edb-82e9-0333c147cbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:17.953901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2776681a-4d4a-4edb-82e9-0333c147cbb1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:17.958287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2776681a-4d4a-4edb-82e9-0333c147cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:17.991883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:17.993643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:18.111132 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1492/3026] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:18.128918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776681a-4d4a-4edb-82e9-0333c147cbb1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:18.130310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2776681a-4d4a-4edb-82e9-0333c147cbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:18.160872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbd1db-aa17-426f-ae46-8a2554c9d9ef admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:18.170575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:18.171634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:18.172252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:18.172868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:18.175541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:18.189270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:18.190907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:18.202815 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1535/3027] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:54:18.236916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2776681a-4d4a-4edb-82e9-0333c147cbb1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:18.244988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008af74-94e3-46fa-8dcd-601402e3458e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:18.245820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008af74-94e3-46fa-8dcd-601402e3458e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:18.246104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008af74-94e3-46fa-8dcd-601402e3458e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:18.246378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008af74-94e3-46fa-8dcd-601402e3458e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:18.259644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008af74-94e3-46fa-8dcd-601402e3458e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:18.269611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008af74-94e3-46fa-8dcd-601402e3458e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:18.293208 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1493/3028] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:54:18.802921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:18.804424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:18.839576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd60d668-661a-4123-93b5-d218f844d518 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:18.851496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:18.852563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:18.853035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:18.853559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] PATH_INFO: `/v3/projects/39273eada056495685094a0e70a466b7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:18.854954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39273eada056495685094a0e70a466b7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:18.857091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:18.956105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39273eada056495685094a0e70a466b7', 'request_id': 'req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:18.972456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39273eada056495685094a0e70a466b7', 'request_id': 'req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:18.981822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39273eada056495685094a0e70a466b7', 'request_id': 'req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:18.999474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] The token cache is being invalidate because project 39273eada056495685094a0e70a466b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:19.000073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:19.000475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:19.002831 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1536/3029] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:18 2022] DELETE /identity/v3/projects/39273eada056495685094a0e70a466b7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:19.006490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008af74-94e3-46fa-8dcd-601402e3458e service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:19.026211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008af74-94e3-46fa-8dcd-601402e3458e service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:19.125987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:19.127226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:19.127718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:19.128222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] PATH_INFO: `/v3/users/d213adeea4a24f4ebdaee8e152919ef1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:19.130536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d213adeea4a24f4ebdaee8e152919ef1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:19.133571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:19.202091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd213adeea4a24f4ebdaee8e152919ef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:19.214329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd213adeea4a24f4ebdaee8e152919ef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:19.215116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd213adeea4a24f4ebdaee8e152919ef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:19.216748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd213adeea4a24f4ebdaee8e152919ef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:19.241244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f7194d69-e593-42ce-a734-634dc6c9bad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd213adeea4a24f4ebdaee8e152919ef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:19.266349 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1494/3030] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:19 2022] DELETE /identity/v3/users/d213adeea4a24f4ebdaee8e152919ef1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:20.003052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:20.004781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:20.045982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd25210-5ae4-4dfa-a21d-6a85a2297e80 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:20.194731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:20.195841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:20.196316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:20.196770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] PATH_INFO: `/v3/projects/c1b0cc0fe8514a5c97449c1803081e1d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:20.199090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b0cc0fe8514a5c97449c1803081e1d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:20.201959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:20.274895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b0cc0fe8514a5c97449c1803081e1d', 'request_id': 'req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:20.293229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b0cc0fe8514a5c97449c1803081e1d', 'request_id': 'req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:20.300225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b0cc0fe8514a5c97449c1803081e1d', 'request_id': 'req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:20.313827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] The token cache is being invalidate because project c1b0cc0fe8514a5c97449c1803081e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:20.314315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:20.315051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c3ef73d-9ce5-4777-b3ed-dd267b428a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:20.323564 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1537/3031] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:20 2022] DELETE /identity/v3/projects/c1b0cc0fe8514a5c97449c1803081e1d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:20.324921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45cf3-1dc2-40d8-b64c-7b768d87f108 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:20.325414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45cf3-1dc2-40d8-b64c-7b768d87f108 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:20.325516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45cf3-1dc2-40d8-b64c-7b768d87f108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:20.348466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2ef45cf3-1dc2-40d8-b64c-7b768d87f108 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:20.349689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2ef45cf3-1dc2-40d8-b64c-7b768d87f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:20.506350 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1495/3032] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:20.515754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13808d8f-611e-4642-a75a-8f710bc0f7fe None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:20.516118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13808d8f-611e-4642-a75a-8f710bc0f7fe None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:20.516344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13808d8f-611e-4642-a75a-8f710bc0f7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:20.550778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-13808d8f-611e-4642-a75a-8f710bc0f7fe None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:20.552696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-13808d8f-611e-4642-a75a-8f710bc0f7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:20.565837 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1538/3033] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:20.570417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45cf3-1dc2-40d8-b64c-7b768d87f108 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:20.592920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45cf3-1dc2-40d8-b64c-7b768d87f108 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:20.598579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e69e8-29ec-44e5-b300-2094170f70e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:20.599529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e69e8-29ec-44e5-b300-2094170f70e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:20.600123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e69e8-29ec-44e5-b300-2094170f70e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:20.600589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e69e8-29ec-44e5-b300-2094170f70e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:20.602113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e69e8-29ec-44e5-b300-2094170f70e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:20.602749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e69e8-29ec-44e5-b300-2094170f70e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:20.605483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e69e8-29ec-44e5-b300-2094170f70e6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:20.637656 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1496/3034] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:20.642465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13808d8f-611e-4642-a75a-8f710bc0f7fe None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:20.658506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13808d8f-611e-4642-a75a-8f710bc0f7fe None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:20.663714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a62ca-ad75-40ab-88cc-8df20f914e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:20.664488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a62ca-ad75-40ab-88cc-8df20f914e18 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:20.664751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a62ca-ad75-40ab-88cc-8df20f914e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:20.665032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a62ca-ad75-40ab-88cc-8df20f914e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:20.666272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a62ca-ad75-40ab-88cc-8df20f914e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:20.668222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a62ca-ad75-40ab-88cc-8df20f914e18 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:20.738038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e69e8-29ec-44e5-b300-2094170f70e6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:20.741253 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1539/3035] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:20 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:20.758493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e69e8-29ec-44e5-b300-2094170f70e6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:20.887889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747737df-92b5-4244-ac4d-4228923985c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:20.888612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747737df-92b5-4244-ac4d-4228923985c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:20.888900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747737df-92b5-4244-ac4d-4228923985c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:20.889183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747737df-92b5-4244-ac4d-4228923985c8 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:20.890016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747737df-92b5-4244-ac4d-4228923985c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:20.892291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747737df-92b5-4244-ac4d-4228923985c8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:20.924343 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1497/3036] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:20 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:54:20.928751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a62ca-ad75-40ab-88cc-8df20f914e18 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:20.960175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a62ca-ad75-40ab-88cc-8df20f914e18 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:20.965958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd41e2c-c0b8-419f-904c-187cc216d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:20.966892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd41e2c-c0b8-419f-904c-187cc216d5cb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:20.967380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd41e2c-c0b8-419f-904c-187cc216d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:20.972221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd41e2c-c0b8-419f-904c-187cc216d5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:20.976668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd41e2c-c0b8-419f-904c-187cc216d5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:20.986855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd41e2c-c0b8-419f-904c-187cc216d5cb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:21.005269 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1540/3037] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:54:21.011493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747737df-92b5-4244-ac4d-4228923985c8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:21.037642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747737df-92b5-4244-ac4d-4228923985c8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:21.043097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2fd23-01f4-437e-ba69-89b5d5dd2e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:21.044148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2fd23-01f4-437e-ba69-89b5d5dd2e57 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:21.044690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2fd23-01f4-437e-ba69-89b5d5dd2e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:21.045185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2fd23-01f4-437e-ba69-89b5d5dd2e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:21.046295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2fd23-01f4-437e-ba69-89b5d5dd2e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:21.049067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2fd23-01f4-437e-ba69-89b5d5dd2e57 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:21.064016 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1498/3038] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:21.069454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd41e2c-c0b8-419f-904c-187cc216d5cb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:21.088107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd41e2c-c0b8-419f-904c-187cc216d5cb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:21.093374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023665c0-6e80-4d09-be90-5825f2a1315b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:21.094963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023665c0-6e80-4d09-be90-5825f2a1315b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:21.095408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023665c0-6e80-4d09-be90-5825f2a1315b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:21.095886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023665c0-6e80-4d09-be90-5825f2a1315b admin admin] PATH_INFO: `/v3/projects/28e51fbb6333452b84c0c77d29b423b0/users/57e806dbaedc49e395b7d6b374ca2fec/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:21.147700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023665c0-6e80-4d09-be90-5825f2a1315b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e51fbb6333452b84c0c77d29b423b0, user_id=57e806dbaedc49e395b7d6b374ca2fec, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:21.150821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023665c0-6e80-4d09-be90-5825f2a1315b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:21.174854 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1541/3039] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:21 2022] PUT /identity/v3/projects/28e51fbb6333452b84c0c77d29b423b0/users/57e806dbaedc49e395b7d6b374ca2fec/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:21.179766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bc37b-43dc-4e07-9da5-8665ef36430d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:21.180091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bc37b-43dc-4e07-9da5-8665ef36430d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:21.180358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bc37b-43dc-4e07-9da5-8665ef36430d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:21.202899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-382bc37b-43dc-4e07-9da5-8665ef36430d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:21.204151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-382bc37b-43dc-4e07-9da5-8665ef36430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:21.293639 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1499/3040] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:21.335266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023665c0-6e80-4d09-be90-5825f2a1315b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:21.337511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-023665c0-6e80-4d09-be90-5825f2a1315b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:21.487136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023665c0-6e80-4d09-be90-5825f2a1315b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:21.496404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bdc28-b76a-4adc-b795-20be03477cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:21.497900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bdc28-b76a-4adc-b795-20be03477cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:21.499478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bdc28-b76a-4adc-b795-20be03477cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:21.499846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1bdc28-b76a-4adc-b795-20be03477cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:21.524896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bdc28-b76a-4adc-b795-20be03477cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:21.526899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1bdc28-b76a-4adc-b795-20be03477cc3 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:21.549658 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1542/3041] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:22.579396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bc37b-43dc-4e07-9da5-8665ef36430d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:22.581053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-382bc37b-43dc-4e07-9da5-8665ef36430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:22.808790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bc37b-43dc-4e07-9da5-8665ef36430d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:22.841099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d76d18-abf8-4a40-9657-b8f9bda9fe97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:22.842366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d76d18-abf8-4a40-9657-b8f9bda9fe97 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:22.842813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d76d18-abf8-4a40-9657-b8f9bda9fe97 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:22.843186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d76d18-abf8-4a40-9657-b8f9bda9fe97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:22.846900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f9d76d18-abf8-4a40-9657-b8f9bda9fe97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:22.884227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d76d18-abf8-4a40-9657-b8f9bda9fe97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:22.885859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d76d18-abf8-4a40-9657-b8f9bda9fe97 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:22.898537 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1500/3042] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:23.073597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bdc28-b76a-4adc-b795-20be03477cc3 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:23.075017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9b1bdc28-b76a-4adc-b795-20be03477cc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:23.092089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1bdc28-b76a-4adc-b795-20be03477cc3 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:23.113031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:23.115428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:23.115956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:23.116436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] PATH_INFO: `/v3/users/4ef943b3272c48aa884a7ff4a7e854d0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:23.118457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef943b3272c48aa884a7ff4a7e854d0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:23.122072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:23.229035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef943b3272c48aa884a7ff4a7e854d0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:23.239784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef943b3272c48aa884a7ff4a7e854d0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:23.241297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef943b3272c48aa884a7ff4a7e854d0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:23.241967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef943b3272c48aa884a7ff4a7e854d0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:23.257183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef943b3272c48aa884a7ff4a7e854d0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:23.310285 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1543/3043] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:23 2022] DELETE /identity/v3/users/4ef943b3272c48aa884a7ff4a7e854d0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:23.311959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bc5af-0062-497d-aeaa-0a83d704d828 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:23.312248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bc5af-0062-497d-aeaa-0a83d704d828 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:23.312524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5bc5af-0062-497d-aeaa-0a83d704d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:23.336386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3a5bc5af-0062-497d-aeaa-0a83d704d828 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:23.338181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a5bc5af-0062-497d-aeaa-0a83d704d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:23.470731 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1501/3044] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:23.491579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:23.493067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:23.619796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67868e6-193a-47de-8984-30ed6cceade3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:23.625102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947ba7b-0a8c-4f5d-ad4c-59569fb375ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:23.626172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947ba7b-0a8c-4f5d-ad4c-59569fb375ef service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:23.627013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947ba7b-0a8c-4f5d-ad4c-59569fb375ef service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:23.627507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947ba7b-0a8c-4f5d-ad4c-59569fb375ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:23.641221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947ba7b-0a8c-4f5d-ad4c-59569fb375ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:23.643335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947ba7b-0a8c-4f5d-ad4c-59569fb375ef service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:23.669600 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1544/3045] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:54:23.989719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5bc5af-0062-497d-aeaa-0a83d704d828 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:23.991801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a5bc5af-0062-497d-aeaa-0a83d704d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:24.143289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5bc5af-0062-497d-aeaa-0a83d704d828 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:24.152372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af286-088e-4331-8f4e-027097570f93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:24.153466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af286-088e-4331-8f4e-027097570f93 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:24.154344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af286-088e-4331-8f4e-027097570f93 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:24.160190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85af286-088e-4331-8f4e-027097570f93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:24.170505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f85af286-088e-4331-8f4e-027097570f93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:24.336546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85af286-088e-4331-8f4e-027097570f93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:24.341806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85af286-088e-4331-8f4e-027097570f93 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:24.366497 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1502/3046] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:25.273884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947ba7b-0a8c-4f5d-ad4c-59569fb375ef service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:25.275979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e947ba7b-0a8c-4f5d-ad4c-59569fb375ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:25.293791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947ba7b-0a8c-4f5d-ad4c-59569fb375ef service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:25.318716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:25.322515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:25.323096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:25.324209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] PATH_INFO: `/v3/projects/70c93c47827247b8b178018931efb9a4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:25.339201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c93c47827247b8b178018931efb9a4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:25.342395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:25.453449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c93c47827247b8b178018931efb9a4', 'request_id': 'req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.469644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c93c47827247b8b178018931efb9a4', 'request_id': 'req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.487204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c93c47827247b8b178018931efb9a4', 'request_id': 'req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.505605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] The token cache is being invalidate because project 70c93c47827247b8b178018931efb9a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:25.506049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.506970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-03e32263-d1f4-4b10-85fe-4c9ddb3a5baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.511711 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1545/3047] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:25 2022] DELETE /identity/v3/projects/70c93c47827247b8b178018931efb9a4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:25.513286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af286-088e-4331-8f4e-027097570f93 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:25.532188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85af286-088e-4331-8f4e-027097570f93 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:25.644221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:25.645401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:25.645736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:25.646297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] PATH_INFO: `/v3/users/9cb9502357fd45fd99a17d6df3061dbd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:25.648039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb9502357fd45fd99a17d6df3061dbd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:25.651017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:25.742142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb9502357fd45fd99a17d6df3061dbd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.756320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb9502357fd45fd99a17d6df3061dbd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.757819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb9502357fd45fd99a17d6df3061dbd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.759242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb9502357fd45fd99a17d6df3061dbd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.791603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb9502357fd45fd99a17d6df3061dbd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:25.817405 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1503/3048] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:25 2022] DELETE /identity/v3/users/9cb9502357fd45fd99a17d6df3061dbd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:25.950076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c87f-d8e1-4e80-b6cb-2063290c69d6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:25.950456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c87f-d8e1-4e80-b6cb-2063290c69d6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:25.950629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c87f-d8e1-4e80-b6cb-2063290c69d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:25.988846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c601c87f-d8e1-4e80-b6cb-2063290c69d6 None None] MFA Rules not processed for user `b1109e52939e48759e11f26461e05a5a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:25.992674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c601c87f-d8e1-4e80-b6cb-2063290c69d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:26.106179 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1546/3049] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:26.738389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:26.740645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:26.752977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a00fbe-4b59-4c6b-8604-98472e116ab4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:26.753870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a00fbe-4b59-4c6b-8604-98472e116ab4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:26.754442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a00fbe-4b59-4c6b-8604-98472e116ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:26.800036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-28a00fbe-4b59-4c6b-8604-98472e116ab4 None None] MFA Rules not processed for user `b188ca4deda94cec85da4582a37fea72`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:26.802703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-28a00fbe-4b59-4c6b-8604-98472e116ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:26.823147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560f0d1-a5dc-47cc-8cb1-58a38a93c2fb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:26.835570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:26.836911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:26.837395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:26.838388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] PATH_INFO: `/v3/projects/06bf78b652a0421f83c99b220ce334c6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:26.840451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06bf78b652a0421f83c99b220ce334c6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:26.843451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:26.907223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06bf78b652a0421f83c99b220ce334c6', 'request_id': 'req-a68fa73d-881f-435a-9ab5-1de23df60444'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:26.919090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06bf78b652a0421f83c99b220ce334c6', 'request_id': 'req-a68fa73d-881f-435a-9ab5-1de23df60444'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:26.937909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06bf78b652a0421f83c99b220ce334c6', 'request_id': 'req-a68fa73d-881f-435a-9ab5-1de23df60444'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:26.983340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] The token cache is being invalidate because project 06bf78b652a0421f83c99b220ce334c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:26.984329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:26.986443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a68fa73d-881f-435a-9ab5-1de23df60444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:26.994852 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1504/3050] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:26 2022] DELETE /identity/v3/projects/06bf78b652a0421f83c99b220ce334c6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:27.002891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e9900-f6e6-4d0c-a8fd-627b400c8cde None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:27.005493 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1547/3051] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:27.005674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e9900-f6e6-4d0c-a8fd-627b400c8cde None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:27.006435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08e9900-f6e6-4d0c-a8fd-627b400c8cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:27.034662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a00fbe-4b59-4c6b-8604-98472e116ab4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:27.037736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-28a00fbe-4b59-4c6b-8604-98472e116ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:27.092451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b08e9900-f6e6-4d0c-a8fd-627b400c8cde None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:27.106165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b08e9900-f6e6-4d0c-a8fd-627b400c8cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:27.301672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a00fbe-4b59-4c6b-8604-98472e116ab4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:27.397330 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1505/3052] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:27.398883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce3901-2d2f-4eab-be21-e4cd49fc08da None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:27.401027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce3901-2d2f-4eab-be21-e4cd49fc08da None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:27.401391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce3901-2d2f-4eab-be21-e4cd49fc08da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:27.414951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdc73a-a837-4618-99fd-a1c1d9acac4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:27.416815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdc73a-a837-4618-99fd-a1c1d9acac4d service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:27.417260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdc73a-a837-4618-99fd-a1c1d9acac4d service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:27.417713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdc73a-a837-4618-99fd-a1c1d9acac4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:27.419841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0bbdc73a-a837-4618-99fd-a1c1d9acac4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:27.434899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdc73a-a837-4618-99fd-a1c1d9acac4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:27.437399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbdc73a-a837-4618-99fd-a1c1d9acac4d service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:27.450834 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1548/3053] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:27.465062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e3ce3901-2d2f-4eab-be21-e4cd49fc08da None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:27.469286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e3ce3901-2d2f-4eab-be21-e4cd49fc08da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:27.505725 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1506/3054] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:27.509897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdc73a-a837-4618-99fd-a1c1d9acac4d service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:27.525574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdc73a-a837-4618-99fd-a1c1d9acac4d service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:27.544999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:27.546060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:27.550921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:27.551533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:27.552475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:27.555893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:27.561525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:27.607971 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1549/3055] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:27.612647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce3901-2d2f-4eab-be21-e4cd49fc08da None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:27.625466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce3901-2d2f-4eab-be21-e4cd49fc08da None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:27.641505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8892-39ca-44c7-82d6-4c10fe8f79a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:27.642564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8892-39ca-44c7-82d6-4c10fe8f79a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:27.642846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8892-39ca-44c7-82d6-4c10fe8f79a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:27.643322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8892-39ca-44c7-82d6-4c10fe8f79a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:27.644413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d8892-39ca-44c7-82d6-4c10fe8f79a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:27.648022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d8892-39ca-44c7-82d6-4c10fe8f79a6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:27.727897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:27.731068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:27.785789 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1507/3056] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:27 2022] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:27.788277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8892-39ca-44c7-82d6-4c10fe8f79a6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:27.911285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f6d1a-412a-44f7-baf5-8fcebc316f6c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:27.982480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8892-39ca-44c7-82d6-4c10fe8f79a6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:27.993690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb447e49-480e-4e87-98fc-f5d2ad2ab5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:27.994411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447e49-480e-4e87-98fc-f5d2ad2ab5ee admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:27.994702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447e49-480e-4e87-98fc-f5d2ad2ab5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:27.994979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447e49-480e-4e87-98fc-f5d2ad2ab5ee admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:27.996053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb447e49-480e-4e87-98fc-f5d2ad2ab5ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:27.998648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb447e49-480e-4e87-98fc-f5d2ad2ab5ee admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:28.008259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98657d0-e14f-4c7f-9df4-319acbd839eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:28.009079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98657d0-e14f-4c7f-9df4-319acbd839eb service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:28.009514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98657d0-e14f-4c7f-9df4-319acbd839eb service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:28.010022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98657d0-e14f-4c7f-9df4-319acbd839eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:28.014684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c98657d0-e14f-4c7f-9df4-319acbd839eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:28.047874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98657d0-e14f-4c7f-9df4-319acbd839eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:28.050958 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1508/3057] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:27 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:28.051388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98657d0-e14f-4c7f-9df4-319acbd839eb service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:28.052190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb447e49-480e-4e87-98fc-f5d2ad2ab5ee admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:28.068194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb447e49-480e-4e87-98fc-f5d2ad2ab5ee admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:28.078569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee45b2-cbe1-47e2-93a2-d33d80355b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:28.079121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee45b2-cbe1-47e2-93a2-d33d80355b48 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:28.079449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee45b2-cbe1-47e2-93a2-d33d80355b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:28.079731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbee45b2-cbe1-47e2-93a2-d33d80355b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:28.080591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee45b2-cbe1-47e2-93a2-d33d80355b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:28.084962 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1550/3058] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:28.102317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbee45b2-cbe1-47e2-93a2-d33d80355b48 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:28.129236 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1509/3059] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:28.133270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98657d0-e14f-4c7f-9df4-319acbd839eb service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:28.157207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98657d0-e14f-4c7f-9df4-319acbd839eb service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:28.171852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9ce5b1-be63-474e-863e-893d23a69333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:28.172758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ce5b1-be63-474e-863e-893d23a69333 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:28.173454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ce5b1-be63-474e-863e-893d23a69333 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:28.173943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9ce5b1-be63-474e-863e-893d23a69333 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:28.175269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ce5b1-be63-474e-863e-893d23a69333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:28.178361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9ce5b1-be63-474e-863e-893d23a69333 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:28.199605 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1551/3060] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:28.203737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee45b2-cbe1-47e2-93a2-d33d80355b48 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:28.216777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbee45b2-cbe1-47e2-93a2-d33d80355b48 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:28.232192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03994627-68d2-4953-bc8d-57ebdbf9e890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:28.233111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994627-68d2-4953-bc8d-57ebdbf9e890 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:28.233967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994627-68d2-4953-bc8d-57ebdbf9e890 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:28.233967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994627-68d2-4953-bc8d-57ebdbf9e890 admin admin] PATH_INFO: `/v3/projects/125dde1def47434d9222fd7f0d182dcb/users/2a465f35b981441bb8af8611d80344d9/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:28.274437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03994627-68d2-4953-bc8d-57ebdbf9e890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=125dde1def47434d9222fd7f0d182dcb, user_id=2a465f35b981441bb8af8611d80344d9, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:28.300357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03994627-68d2-4953-bc8d-57ebdbf9e890 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:28.341174 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1510/3061] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:28 2022] PUT /identity/v3/projects/125dde1def47434d9222fd7f0d182dcb/users/2a465f35b981441bb8af8611d80344d9/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:28.352493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5f92-f394-4074-9d23-330b07284354 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:28.352791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5f92-f394-4074-9d23-330b07284354 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:28.353151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d5f92-f394-4074-9d23-330b07284354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:28.440003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-149d5f92-f394-4074-9d23-330b07284354 None None] MFA Rules not processed for user `2a465f35b981441bb8af8611d80344d9`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:28.453267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-149d5f92-f394-4074-9d23-330b07284354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:28.636265 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1552/3062] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:28.640517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03994627-68d2-4953-bc8d-57ebdbf9e890 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:28.795957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03994627-68d2-4953-bc8d-57ebdbf9e890 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:28.809470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a329950-2210-48f8-98ca-f59e1aa74c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:28.810213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a329950-2210-48f8-98ca-f59e1aa74c1e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:28.811009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a329950-2210-48f8-98ca-f59e1aa74c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:28.811298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a329950-2210-48f8-98ca-f59e1aa74c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:28.812103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a329950-2210-48f8-98ca-f59e1aa74c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:28.815071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a329950-2210-48f8-98ca-f59e1aa74c1e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:28.832276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d5f92-f394-4074-9d23-330b07284354 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:28.834273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-149d5f92-f394-4074-9d23-330b07284354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:28.875299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d5f92-f394-4074-9d23-330b07284354 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:28.888888 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1511/3063] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:28 2022] POST /identity/v3/projects => generated 373 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:28.889920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a329950-2210-48f8-98ca-f59e1aa74c1e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:28.891005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:28.892402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:28.892867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:28.893301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] PATH_INFO: `/v3/users/b5effd8428df4616865ee71160f53594` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:28.895245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5effd8428df4616865ee71160f53594)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:28.899135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:28.995818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5effd8428df4616865ee71160f53594'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.012136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5effd8428df4616865ee71160f53594'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.012907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5effd8428df4616865ee71160f53594'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.015227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5effd8428df4616865ee71160f53594'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.029096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a329950-2210-48f8-98ca-f59e1aa74c1e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:29.038942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdace2-065b-4fbe-ba57-b46e58a49601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:29.044619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5effd8428df4616865ee71160f53594'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.045190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdace2-065b-4fbe-ba57-b46e58a49601 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:29.046202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdace2-065b-4fbe-ba57-b46e58a49601 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:29.046699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdace2-065b-4fbe-ba57-b46e58a49601 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:29.050182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdace2-065b-4fbe-ba57-b46e58a49601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:29.055717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdace2-065b-4fbe-ba57-b46e58a49601 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:29.085949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1553/3064] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:28 2022] DELETE /identity/v3/users/b5effd8428df4616865ee71160f53594 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:29.113244 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1512/3065] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:28 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:29.117511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:29.119609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:29.254256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d5f28-1095-4f79-8152-ffd41aa1cf2c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:29.268269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65c63-5b5f-4776-9751-93b915d811e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:29.268965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65c63-5b5f-4776-9751-93b915d811e0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:29.269246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65c63-5b5f-4776-9751-93b915d811e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:29.269521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65c63-5b5f-4776-9751-93b915d811e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:29.270254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65c63-5b5f-4776-9751-93b915d811e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:29.271874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65c63-5b5f-4776-9751-93b915d811e0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:29.299352 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1554/3066] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:29.305662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdace2-065b-4fbe-ba57-b46e58a49601 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:29.324118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdace2-065b-4fbe-ba57-b46e58a49601 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:29.336212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abf255-96d7-40fc-aef9-f517377bccd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:29.338535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abf255-96d7-40fc-aef9-f517377bccd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:29.339730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abf255-96d7-40fc-aef9-f517377bccd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:29.341889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abf255-96d7-40fc-aef9-f517377bccd0 admin admin] PATH_INFO: `/v3/projects/d14b753c857947358a96cf83d284c6de/users/5e25e9b97812487782c4b856465c0a30/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:29.386421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abf255-96d7-40fc-aef9-f517377bccd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14b753c857947358a96cf83d284c6de, user_id=5e25e9b97812487782c4b856465c0a30, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:29.394094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abf255-96d7-40fc-aef9-f517377bccd0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:29.435128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65c63-5b5f-4776-9751-93b915d811e0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:29.436924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5ce65c63-5b5f-4776-9751-93b915d811e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:29.440933 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1513/3067] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:29 2022] PUT /identity/v3/projects/d14b753c857947358a96cf83d284c6de/users/5e25e9b97812487782c4b856465c0a30/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:29.444327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abf255-96d7-40fc-aef9-f517377bccd0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:29.462359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65c63-5b5f-4776-9751-93b915d811e0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:29.616853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:29.618151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:29.618436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:29.618759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] PATH_INFO: `/v3/projects/473aa792ab1045a9bc717a9a66f15afd` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:29.626072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473aa792ab1045a9bc717a9a66f15afd)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:29.628692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:29.669250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abf255-96d7-40fc-aef9-f517377bccd0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:29.702078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e125569-2d8f-409c-bf50-6c1fed2daaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:29.702788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e125569-2d8f-409c-bf50-6c1fed2daaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:29.703078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e125569-2d8f-409c-bf50-6c1fed2daaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:29.703405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e125569-2d8f-409c-bf50-6c1fed2daaf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:29.713074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e125569-2d8f-409c-bf50-6c1fed2daaf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:29.725230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e125569-2d8f-409c-bf50-6c1fed2daaf5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:29.756604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473aa792ab1045a9bc717a9a66f15afd', 'request_id': 'req-f87a0da7-8cf1-44af-9c5e-8441a7497a59'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.763581 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1514/3068] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:29.773435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e125569-2d8f-409c-bf50-6c1fed2daaf5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:29.778442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473aa792ab1045a9bc717a9a66f15afd', 'request_id': 'req-f87a0da7-8cf1-44af-9c5e-8441a7497a59'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.788924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473aa792ab1045a9bc717a9a66f15afd', 'request_id': 'req-f87a0da7-8cf1-44af-9c5e-8441a7497a59'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.810600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] The token cache is being invalidate because project 473aa792ab1045a9bc717a9a66f15afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:29.811296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.811800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f87a0da7-8cf1-44af-9c5e-8441a7497a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:29.813693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e125569-2d8f-409c-bf50-6c1fed2daaf5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:29.814198 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1555/3069] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:29 2022] DELETE /identity/v3/projects/473aa792ab1045a9bc717a9a66f15afd => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:29.819444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456499a-36f4-472b-9d9e-6423c6d5a981 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:29.819844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456499a-36f4-472b-9d9e-6423c6d5a981 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:29.820790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456499a-36f4-472b-9d9e-6423c6d5a981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:29.865108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5456499a-36f4-472b-9d9e-6423c6d5a981 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:29.866482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5456499a-36f4-472b-9d9e-6423c6d5a981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:29.940323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f9c15-c6fe-4f5d-9203-d5c373ff1ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:29.941862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f9c15-c6fe-4f5d-9203-d5c373ff1ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:29.942308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f9c15-c6fe-4f5d-9203-d5c373ff1ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:29.942752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f9c15-c6fe-4f5d-9203-d5c373ff1ce6 admin admin] PATH_INFO: `/v3/projects/d14b753c857947358a96cf83d284c6de/users/5e25e9b97812487782c4b856465c0a30/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:29.945428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f9c15-c6fe-4f5d-9203-d5c373ff1ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14b753c857947358a96cf83d284c6de, user_id=5e25e9b97812487782c4b856465c0a30, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:29.951001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f9c15-c6fe-4f5d-9203-d5c373ff1ce6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:29.970849 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1515/3070] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:29 2022] PUT /identity/v3/projects/d14b753c857947358a96cf83d284c6de/users/5e25e9b97812487782c4b856465c0a30/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:29.981670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89355a6-65a3-4406-b35e-d953a49586a2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:29.982288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89355a6-65a3-4406-b35e-d953a49586a2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:29.983211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89355a6-65a3-4406-b35e-d953a49586a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.015531 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1556/3071] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:30.023838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003de2e6-8ba6-4b7f-93c4-a8de7484ae32 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.024271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003de2e6-8ba6-4b7f-93c4-a8de7484ae32 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.024646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003de2e6-8ba6-4b7f-93c4-a8de7484ae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.095367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b89355a6-65a3-4406-b35e-d953a49586a2 None None] MFA Rules not processed for user `5e25e9b97812487782c4b856465c0a30`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:30.100127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-003de2e6-8ba6-4b7f-93c4-a8de7484ae32 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:30.100299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b89355a6-65a3-4406-b35e-d953a49586a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:30.101537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-003de2e6-8ba6-4b7f-93c4-a8de7484ae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:30.271420 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1557/3072] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:30.275394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003de2e6-8ba6-4b7f-93c4-a8de7484ae32 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.297710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003de2e6-8ba6-4b7f-93c4-a8de7484ae32 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:30.312473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eadca0-49e4-45b3-95a4-4b58a087a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:30.313235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eadca0-49e4-45b3-95a4-4b58a087a2ee admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.313516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eadca0-49e4-45b3-95a4-4b58a087a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.313788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eadca0-49e4-45b3-95a4-4b58a087a2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.314523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eadca0-49e4-45b3-95a4-4b58a087a2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:30.314769 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1516/3073] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:30.314991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eadca0-49e4-45b3-95a4-4b58a087a2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:30.316454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eadca0-49e4-45b3-95a4-4b58a087a2ee admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:30.326456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89355a6-65a3-4406-b35e-d953a49586a2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.343760 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1558/3074] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:30.348230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eadca0-49e4-45b3-95a4-4b58a087a2ee admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.358529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89355a6-65a3-4406-b35e-d953a49586a2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:30.365328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cc66a-9477-4062-ab50-1981122ebb44 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:30.366009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cc66a-9477-4062-ab50-1981122ebb44 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.366300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cc66a-9477-4062-ab50-1981122ebb44 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.366585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cc66a-9477-4062-ab50-1981122ebb44 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.368430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cc66a-9477-4062-ab50-1981122ebb44 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:30.369178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cc66a-9477-4062-ab50-1981122ebb44 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:30.371193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cc66a-9477-4062-ab50-1981122ebb44 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:30.372764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eadca0-49e4-45b3-95a4-4b58a087a2ee admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:30.388132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc092d7-b535-45a4-9ed4-a303b68cd62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:30.389076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc092d7-b535-45a4-9ed4-a303b68cd62a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.389541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc092d7-b535-45a4-9ed4-a303b68cd62a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.389983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc092d7-b535-45a4-9ed4-a303b68cd62a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.390832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc092d7-b535-45a4-9ed4-a303b68cd62a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:30.396310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc092d7-b535-45a4-9ed4-a303b68cd62a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:30.406736 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1517/3075] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:30.408101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cc66a-9477-4062-ab50-1981122ebb44 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.462208 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1559/3076] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:30 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:54:30.462495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cc66a-9477-4062-ab50-1981122ebb44 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:30.463802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc092d7-b535-45a4-9ed4-a303b68cd62a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.596458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc092d7-b535-45a4-9ed4-a303b68cd62a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:30.609796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2474-bd1d-456b-b493-c0bd8e824fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:30.610554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2474-bd1d-456b-b493-c0bd8e824fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.610796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2474-bd1d-456b-b493-c0bd8e824fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.611019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2474-bd1d-456b-b493-c0bd8e824fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.611707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2474-bd1d-456b-b493-c0bd8e824fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:30.612040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee53d2-f575-4fae-8148-fe76ae0bb1a0 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:30.612727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee53d2-f575-4fae-8148-fe76ae0bb1a0 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.613014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee53d2-f575-4fae-8148-fe76ae0bb1a0 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.613291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee53d2-f575-4fae-8148-fe76ae0bb1a0 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.613773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2474-bd1d-456b-b493-c0bd8e824fd6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:30.613975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee53d2-f575-4fae-8148-fe76ae0bb1a0 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:30.615907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee53d2-f575-4fae-8148-fe76ae0bb1a0 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:30.644288 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1560/3077] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:30 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:30.645400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2474-bd1d-456b-b493-c0bd8e824fd6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.659773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2474-bd1d-456b-b493-c0bd8e824fd6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:30.667216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6309d-9785-4e57-9965-e7da0ac90c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:30.668510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6309d-9785-4e57-9965-e7da0ac90c3b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.668804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6309d-9785-4e57-9965-e7da0ac90c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.669140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6309d-9785-4e57-9965-e7da0ac90c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.670156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6309d-9785-4e57-9965-e7da0ac90c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:30.671832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6309d-9785-4e57-9965-e7da0ac90c3b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:30.695820 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1561/3078] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:30.697653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6309d-9785-4e57-9965-e7da0ac90c3b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.722037 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1518/3079] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:30 2022] POST /identity/v3/projects => generated 371 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:30.723293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee53d2-f575-4fae-8148-fe76ae0bb1a0 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.736703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6309d-9785-4e57-9965-e7da0ac90c3b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:30.819994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee53d2-f575-4fae-8148-fe76ae0bb1a0 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:30.826659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:30.828684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.829827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.830359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.831374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:30.832010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:30.833919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:30.850640 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1519/3080] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:30.859850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe969d2-6d10-49ab-be3a-e7ae58e4cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:30.861191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe969d2-6d10-49ab-be3a-e7ae58e4cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.863151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.865303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:30.870154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe969d2-6d10-49ab-be3a-e7ae58e4cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.871451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe969d2-6d10-49ab-be3a-e7ae58e4cf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:30.873575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe969d2-6d10-49ab-be3a-e7ae58e4cf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:30.878201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe969d2-6d10-49ab-be3a-e7ae58e4cf31 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:30.913970 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1562/3081] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:30.918226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe969d2-6d10-49ab-be3a-e7ae58e4cf31 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:30.958321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe969d2-6d10-49ab-be3a-e7ae58e4cf31 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:30.973417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bbf00-0b39-4362-b344-3be7096c24e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:30.974324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bbf00-0b39-4362-b344-3be7096c24e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:30.974593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bbf00-0b39-4362-b344-3be7096c24e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:30.975044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bbf00-0b39-4362-b344-3be7096c24e4 admin admin] PATH_INFO: `/v3/projects/032c3519ef0d4b99891f8fe4e48a2fb8/users/e9e5b428b7b341a5a253addfd9493158/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:31.035286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bbf00-0b39-4362-b344-3be7096c24e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032c3519ef0d4b99891f8fe4e48a2fb8, user_id=e9e5b428b7b341a5a253addfd9493158, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:31.038038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bbf00-0b39-4362-b344-3be7096c24e4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:31.065719 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1563/3082] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:30 2022] PUT /identity/v3/projects/032c3519ef0d4b99891f8fe4e48a2fb8/users/e9e5b428b7b341a5a253addfd9493158/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:31.068801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24f36-8ca9-4726-a483-be8fc3af1269 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:31.069297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24f36-8ca9-4726-a483-be8fc3af1269 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:31.070207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24f36-8ca9-4726-a483-be8fc3af1269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:31.091255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf909f-6504-457c-848c-ec387a9f3641 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:31.109612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-03f24f36-8ca9-4726-a483-be8fc3af1269 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:31.112945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-03f24f36-8ca9-4726-a483-be8fc3af1269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:31.194766 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1564/3083] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:31.246457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf28fe-2a78-4ccd-b173-960c8a63532e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:31.247175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf28fe-2a78-4ccd-b173-960c8a63532e service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:31.247462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf28fe-2a78-4ccd-b173-960c8a63532e service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:31.247951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf28fe-2a78-4ccd-b173-960c8a63532e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:31.259797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24f36-8ca9-4726-a483-be8fc3af1269 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:31.262412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-03f24f36-8ca9-4726-a483-be8fc3af1269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:31.339716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf28fe-2a78-4ccd-b173-960c8a63532e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:31.342208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf28fe-2a78-4ccd-b173-960c8a63532e service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:31.363289 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1520/3084] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:31.386875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a192-b6fa-434e-ac7a-fbc334513890 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:31.388100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a192-b6fa-434e-ac7a-fbc334513890 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:31.388807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0a192-b6fa-434e-ac7a-fbc334513890 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:31.392368 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1521/3085] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:31.397288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0a192-b6fa-434e-ac7a-fbc334513890 None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:31.404015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24f36-8ca9-4726-a483-be8fc3af1269 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:31.417296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5c5ef-6157-4da1-a0bf-5eea0167020b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:31.417977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c5ef-6157-4da1-a0bf-5eea0167020b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:31.418277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c5ef-6157-4da1-a0bf-5eea0167020b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:31.419480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5c5ef-6157-4da1-a0bf-5eea0167020b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:31.433480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0a192-b6fa-434e-ac7a-fbc334513890 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:31.442017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5c5ef-6157-4da1-a0bf-5eea0167020b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:31.443739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5c5ef-6157-4da1-a0bf-5eea0167020b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:31.466245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0a192-b6fa-434e-ac7a-fbc334513890 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:31.469551 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1565/3086] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:54:31.471078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:31.472796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:31.473174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:31.473710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/projects/352a377d0a424d8b945698841f95a8ce` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:31.475187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:get_project(project_id=352a377d0a424d8b945698841f95a8ce)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:31.478743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:31.517074 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1522/3087] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:31 2022] GET /identity/v3/projects/352a377d0a424d8b945698841f95a8ce => generated 371 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:31.787541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e5524-73e1-4d10-924c-597ac72a42ae None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:31.787884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e5524-73e1-4d10-924c-597ac72a42ae None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:31.789470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e5524-73e1-4d10-924c-597ac72a42ae None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:31.791153 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1566/3088] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:31.797009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:31.803317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:31.833188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:31.861428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635e4a1-a088-44a7-9dc1-39506abdf6f7 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:31.876904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20294-9746-49b3-a272-62bab76664d3 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:31.877784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20294-9746-49b3-a272-62bab76664d3 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:31.878071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20294-9746-49b3-a272-62bab76664d3 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:31.878347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad20294-9746-49b3-a272-62bab76664d3 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/projects/352a377d0a424d8b945698841f95a8ce` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:31.880638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20294-9746-49b3-a272-62bab76664d3 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:get_project(project_id=352a377d0a424d8b945698841f95a8ce)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:31.884224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad20294-9746-49b3-a272-62bab76664d3 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:31.887991 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1523/3089] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:31 2022] GET /identity/v3/projects/352a377d0a424d8b945698841f95a8ce => generated 371 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:31.959077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e5524-73e1-4d10-924c-597ac72a42ae None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:31.982474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e5524-73e1-4d10-924c-597ac72a42ae None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:31.993957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b484187-1ed4-48b9-aefd-6d1a91d1fe24 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:31.995162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484187-1ed4-48b9-aefd-6d1a91d1fe24 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:31.995886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484187-1ed4-48b9-aefd-6d1a91d1fe24 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:31.996442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b484187-1ed4-48b9-aefd-6d1a91d1fe24 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:31.998285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b484187-1ed4-48b9-aefd-6d1a91d1fe24 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:31.998850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b484187-1ed4-48b9-aefd-6d1a91d1fe24 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:32.001163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b484187-1ed4-48b9-aefd-6d1a91d1fe24 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:32.034172 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1567/3090] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:32.037659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20294-9746-49b3-a272-62bab76664d3 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:32.062314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad20294-9746-49b3-a272-62bab76664d3 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:32.078428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98675ff0-8821-4a0c-9817-8aac1343bd5a tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:32.079974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98675ff0-8821-4a0c-9817-8aac1343bd5a tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:32.080595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98675ff0-8821-4a0c-9817-8aac1343bd5a tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:32.081626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98675ff0-8821-4a0c-9817-8aac1343bd5a tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:32.082473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98675ff0-8821-4a0c-9817-8aac1343bd5a tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:32.086035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98675ff0-8821-4a0c-9817-8aac1343bd5a tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:32.138832 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1524/3091] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:32 2022] POST /identity/v3/users => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:32.140997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b484187-1ed4-48b9-aefd-6d1a91d1fe24 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:32.175838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b484187-1ed4-48b9-aefd-6d1a91d1fe24 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:32.193620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:32.195608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:32.198543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:32.198832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:32.200254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:32.200584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:32.207560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:32.256989 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1568/3092] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:32.274690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c612f-4d89-4fd4-b397-4f692a829f83 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:32.275048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c612f-4d89-4fd4-b397-4f692a829f83 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:32.275334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c612f-4d89-4fd4-b397-4f692a829f83 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:32.278143 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1525/3093] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:54:32.282979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:32.302180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:32.324852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69bf7-f85d-43d1-b373-652c1c261cd8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:32.337310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0b19-d2de-4401-999b-6b2020096787 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:32.342194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0b19-d2de-4401-999b-6b2020096787 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:32.342475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0b19-d2de-4401-999b-6b2020096787 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:32.344515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c0b19-d2de-4401-999b-6b2020096787 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/projects/352a377d0a424d8b945698841f95a8ce` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:32.348113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c0b19-d2de-4401-999b-6b2020096787 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:get_project(project_id=352a377d0a424d8b945698841f95a8ce)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:32.352035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c0b19-d2de-4401-999b-6b2020096787 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:32.355593 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1569/3094] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:32 2022] GET /identity/v3/projects/352a377d0a424d8b945698841f95a8ce => generated 371 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:32.358761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055fd19-1293-45ff-849b-09590f3a8e4a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:32.359459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055fd19-1293-45ff-849b-09590f3a8e4a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:32.359892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055fd19-1293-45ff-849b-09590f3a8e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:32.391707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a055fd19-1293-45ff-849b-09590f3a8e4a None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:32.402507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a055fd19-1293-45ff-849b-09590f3a8e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:32.562553 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1526/3095] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:54:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:32.583721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0b19-d2de-4401-999b-6b2020096787 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:32.586294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bd3c0b19-d2de-4401-999b-6b2020096787 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:32.767041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d86f8a-5154-49a6-9cd4-7beaf85cf835 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:32.767374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d86f8a-5154-49a6-9cd4-7beaf85cf835 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:32.767638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d86f8a-5154-49a6-9cd4-7beaf85cf835 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:32.769795 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1527/3096] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:54:32.777729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d86f8a-5154-49a6-9cd4-7beaf85cf835 None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:54:32.778199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c0b19-d2de-4401-999b-6b2020096787 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:32.790601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414f40b-7738-4efb-a1ae-f8cf0ab53853 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:32.791275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414f40b-7738-4efb-a1ae-f8cf0ab53853 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:32.791562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414f40b-7738-4efb-a1ae-f8cf0ab53853 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:32.791843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414f40b-7738-4efb-a1ae-f8cf0ab53853 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:32.818114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414f40b-7738-4efb-a1ae-f8cf0ab53853 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:32.818353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d86f8a-5154-49a6-9cd4-7beaf85cf835 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:32.819841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414f40b-7738-4efb-a1ae-f8cf0ab53853 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:32.848745 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1570/3097] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:54:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:54:32.892915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d86f8a-5154-49a6-9cd4-7beaf85cf835 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:32.908184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d3090-dd91-4567-a485-1ee6187dcb2b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:32.909695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d3090-dd91-4567-a485-1ee6187dcb2b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:32.910146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d3090-dd91-4567-a485-1ee6187dcb2b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:32.911437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d3090-dd91-4567-a485-1ee6187dcb2b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/projects/352a377d0a424d8b945698841f95a8ce` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:32.921173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d3090-dd91-4567-a485-1ee6187dcb2b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:get_project(project_id=352a377d0a424d8b945698841f95a8ce)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:32.925160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10d3090-dd91-4567-a485-1ee6187dcb2b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:32.943685 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1528/3098] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:54:32 2022] GET /identity/v3/projects/352a377d0a424d8b945698841f95a8ce => generated 371 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:54:33.011739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414f40b-7738-4efb-a1ae-f8cf0ab53853 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:33.037445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414f40b-7738-4efb-a1ae-f8cf0ab53853 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:33.080239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:33.082402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:33.082582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:33.085064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/users/44efec53e0ca41d6b928582bf7a73c7a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:33.131642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:delete_user(user_id=44efec53e0ca41d6b928582bf7a73c7a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:33.137551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:33.279842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44efec53e0ca41d6b928582bf7a73c7a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.298522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44efec53e0ca41d6b928582bf7a73c7a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.299529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44efec53e0ca41d6b928582bf7a73c7a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.300746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44efec53e0ca41d6b928582bf7a73c7a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.328166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44efec53e0ca41d6b928582bf7a73c7a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.359161 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1571/3099] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:33 2022] DELETE /identity/v3/users/44efec53e0ca41d6b928582bf7a73c7a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:33.360321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d3090-dd91-4567-a485-1ee6187dcb2b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:33.362292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b10d3090-dd91-4567-a485-1ee6187dcb2b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:33.393575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d3090-dd91-4567-a485-1ee6187dcb2b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:33.473134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:33.475372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:33.622228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e25e9b97812487782c4b856465c0a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd14b753c857947358a96cf83d284c6de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:33.623112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:33.623507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:33.623656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] PATH_INFO: `/v3/projects/352a377d0a424d8b945698841f95a8ce` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:33.641591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorizing `identity:delete_project(project_id=352a377d0a424d8b945698841f95a8ce)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:33.656312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:33.773207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9336a2f-effa-49d0-bddf-8e4873bb9f8b tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:33.794265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:33.801036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:33.802173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:33.804068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] PATH_INFO: `/v3/users/8ec5c027b8a84b9cb85214bec04168af` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:33.809496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec5c027b8a84b9cb85214bec04168af)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:33.816537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:33.849285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '352a377d0a424d8b945698841f95a8ce', 'request_id': 'req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.879556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '352a377d0a424d8b945698841f95a8ce', 'request_id': 'req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.888617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '352a377d0a424d8b945698841f95a8ce', 'request_id': 'req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.950430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] The token cache is being invalidate because project 352a377d0a424d8b945698841f95a8ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:33.951169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.952041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.953938 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1529/3100] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:33 2022] DELETE /identity/v3/projects/352a377d0a424d8b945698841f95a8ce => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:33.959044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:33.960692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:33.974842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec5c027b8a84b9cb85214bec04168af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.990835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec5c027b8a84b9cb85214bec04168af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.992682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec5c027b8a84b9cb85214bec04168af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:33.994756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec5c027b8a84b9cb85214bec04168af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:34.021896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea08142-5aa5-4d15-9cab-8a133a7e3fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec5c027b8a84b9cb85214bec04168af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:34.076406 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1572/3101] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:33 2022] DELETE /identity/v3/users/8ec5c027b8a84b9cb85214bec04168af => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:34.152803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa58bdc-02d8-4b46-ab06-e0f175fa9cf8 tempest-QuotasAdminTestV257-553795166 tempest-QuotasAdminTestV257-553795166-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:34.284371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:34.285473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:34.285917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:34.286367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] PATH_INFO: `/v3/users/2a465f35b981441bb8af8611d80344d9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:34.287987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a465f35b981441bb8af8611d80344d9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:34.299685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:34.466142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a465f35b981441bb8af8611d80344d9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:34.481694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a465f35b981441bb8af8611d80344d9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:34.482648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a465f35b981441bb8af8611d80344d9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:34.483460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a465f35b981441bb8af8611d80344d9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:34.496448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a465f35b981441bb8af8611d80344d9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:34.510418 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1530/3102] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:33 2022] DELETE /identity/v3/users/2a465f35b981441bb8af8611d80344d9 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:54:34.516540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9d46c-fefe-457a-abed-79ee1a9ca7c7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:34.517043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9d46c-fefe-457a-abed-79ee1a9ca7c7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:34.517240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9d46c-fefe-457a-abed-79ee1a9ca7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:34.551303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-07a9d46c-fefe-457a-abed-79ee1a9ca7c7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:34.552621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07a9d46c-fefe-457a-abed-79ee1a9ca7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:34.835477 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1573/3103] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:34.940948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:34.942410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:35.075174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f614aee5-95ed-479e-896f-fd1e6b68b422 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:35.095124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d846-727a-4ef0-841d-71880513224e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:35.096019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d846-727a-4ef0-841d-71880513224e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:35.096496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d846-727a-4ef0-841d-71880513224e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:35.096931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d846-727a-4ef0-841d-71880513224e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:35.134735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70d846-727a-4ef0-841d-71880513224e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:35.140701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70d846-727a-4ef0-841d-71880513224e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:35.167903 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1531/3104] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:35.480753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9d46c-fefe-457a-abed-79ee1a9ca7c7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:35.482586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07a9d46c-fefe-457a-abed-79ee1a9ca7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:35.504524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9d46c-fefe-457a-abed-79ee1a9ca7c7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:35.520780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:35.521682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:35.524134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:35.524445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] PATH_INFO: `/v3/projects/ced52873fc7241779d52c0fb66e56bae` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:35.530185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced52873fc7241779d52c0fb66e56bae)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:35.534358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:35.680573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced52873fc7241779d52c0fb66e56bae', 'request_id': 'req-97532072-21d5-41a4-b468-9a9d2889b513'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:35.706033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced52873fc7241779d52c0fb66e56bae', 'request_id': 'req-97532072-21d5-41a4-b468-9a9d2889b513'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:35.718191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced52873fc7241779d52c0fb66e56bae', 'request_id': 'req-97532072-21d5-41a4-b468-9a9d2889b513'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:35.762965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] The token cache is being invalidate because project ced52873fc7241779d52c0fb66e56bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:35.767730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:35.772656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97532072-21d5-41a4-b468-9a9d2889b513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:35.775742 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1574/3105] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:35 2022] DELETE /identity/v3/projects/ced52873fc7241779d52c0fb66e56bae => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:35.780835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a184507-646e-4a80-bc0c-581d2b128a3a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:35.781259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a184507-646e-4a80-bc0c-581d2b128a3a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:35.781655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a184507-646e-4a80-bc0c-581d2b128a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:35.824566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8a184507-646e-4a80-bc0c-581d2b128a3a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:35.830288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8a184507-646e-4a80-bc0c-581d2b128a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:35.983576 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1532/3106] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:35.991904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffcd83-bdff-4a41-b93d-62804070ce4a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:35.992224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffcd83-bdff-4a41-b93d-62804070ce4a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:35.992715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffcd83-bdff-4a41-b93d-62804070ce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:36.030763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-97ffcd83-bdff-4a41-b93d-62804070ce4a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:36.032298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-97ffcd83-bdff-4a41-b93d-62804070ce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:36.064221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1575/3107] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:36.068637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a184507-646e-4a80-bc0c-581d2b128a3a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:36.084921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a184507-646e-4a80-bc0c-581d2b128a3a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:36.102194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f816-663a-4bc7-b595-972306c0b926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:36.105263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f816-663a-4bc7-b595-972306c0b926 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:36.106415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f816-663a-4bc7-b595-972306c0b926 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:36.120486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f816-663a-4bc7-b595-972306c0b926 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:36.123602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f816-663a-4bc7-b595-972306c0b926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:36.125348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f816-663a-4bc7-b595-972306c0b926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:36.129405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f816-663a-4bc7-b595-972306c0b926 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:36.149920 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1533/3108] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:36.154021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffcd83-bdff-4a41-b93d-62804070ce4a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:36.165904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffcd83-bdff-4a41-b93d-62804070ce4a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:36.175998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fadb7-6a86-41fb-9e78-30dfd3a58d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:36.177847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fadb7-6a86-41fb-9e78-30dfd3a58d9c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:36.178478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fadb7-6a86-41fb-9e78-30dfd3a58d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:36.179311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fadb7-6a86-41fb-9e78-30dfd3a58d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:36.180308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fadb7-6a86-41fb-9e78-30dfd3a58d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:36.183972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fadb7-6a86-41fb-9e78-30dfd3a58d9c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:36.268294 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1576/3109] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:36 2022] POST /identity/v3/projects => generated 395 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:36.270748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f816-663a-4bc7-b595-972306c0b926 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:36.300737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f816-663a-4bc7-b595-972306c0b926 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:36.500716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348bc683-b510-4787-bc9b-368170e00d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:36.501489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bc683-b510-4787-bc9b-368170e00d79 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:36.501849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bc683-b510-4787-bc9b-368170e00d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:36.502220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348bc683-b510-4787-bc9b-368170e00d79 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:36.503102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bc683-b510-4787-bc9b-368170e00d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:36.508472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348bc683-b510-4787-bc9b-368170e00d79 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:36.572850 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1534/3110] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:36 2022] POST /identity/v3/users => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:36.574093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fadb7-6a86-41fb-9e78-30dfd3a58d9c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:36.596344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fadb7-6a86-41fb-9e78-30dfd3a58d9c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:36.606628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1cb04-26a0-4ec6-a58a-7a67b5df2162 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:36.607579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1cb04-26a0-4ec6-a58a-7a67b5df2162 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:36.608000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff1cb04-26a0-4ec6-a58a-7a67b5df2162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:36.650764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0ba2d-1d62-4d0f-a153-b03f315a487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:36.652081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0ba2d-1d62-4d0f-a153-b03f315a487e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:36.652602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0ba2d-1d62-4d0f-a153-b03f315a487e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:36.653375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0ba2d-1d62-4d0f-a153-b03f315a487e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:36.654362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0ba2d-1d62-4d0f-a153-b03f315a487e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:36.667536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0ba2d-1d62-4d0f-a153-b03f315a487e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:36.689442 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1577/3111] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:36.690799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0ba2d-1d62-4d0f-a153-b03f315a487e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:36.708033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0ba2d-1d62-4d0f-a153-b03f315a487e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:36.733404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f0ae3-bcd2-4868-94aa-311f0734710d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:36.734672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f0ae3-bcd2-4868-94aa-311f0734710d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:36.735187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f0ae3-bcd2-4868-94aa-311f0734710d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:36.735721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f0ae3-bcd2-4868-94aa-311f0734710d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:36.736688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f0ae3-bcd2-4868-94aa-311f0734710d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:36.740631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f0ae3-bcd2-4868-94aa-311f0734710d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:36.769991 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1578/3112] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:36.770980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f0ae3-bcd2-4868-94aa-311f0734710d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:36.776993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7ff1cb04-26a0-4ec6-a58a-7a67b5df2162 None None] MFA Rules not processed for user `e9e5b428b7b341a5a253addfd9493158`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:36.778512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7ff1cb04-26a0-4ec6-a58a-7a67b5df2162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:36.781951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f0ae3-bcd2-4868-94aa-311f0734710d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:36.793404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee39966d-303d-4256-8dee-c843be4b7f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:36.794309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39966d-303d-4256-8dee-c843be4b7f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:36.794588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39966d-303d-4256-8dee-c843be4b7f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:36.794865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee39966d-303d-4256-8dee-c843be4b7f6e admin admin] PATH_INFO: `/v3/projects/c3314f9aa9dd4e6bb0769adc87c04436/users/97136aa03bec4904af1a2f5bf487bd16/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:36.833572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39966d-303d-4256-8dee-c843be4b7f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3314f9aa9dd4e6bb0769adc87c04436, user_id=97136aa03bec4904af1a2f5bf487bd16, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:36.836338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee39966d-303d-4256-8dee-c843be4b7f6e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:36.864476 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1579/3113] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:36 2022] PUT /identity/v3/projects/c3314f9aa9dd4e6bb0769adc87c04436/users/97136aa03bec4904af1a2f5bf487bd16/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:36.875559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3d410-0c74-4edd-aaf9-8173c056c147 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:36.875760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3d410-0c74-4edd-aaf9-8173c056c147 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:36.876049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d3d410-0c74-4edd-aaf9-8173c056c147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:36.950126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f3d3d410-0c74-4edd-aaf9-8173c056c147 None None] MFA Rules not processed for user `97136aa03bec4904af1a2f5bf487bd16`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:36.951395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f3d3d410-0c74-4edd-aaf9-8173c056c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:36.961881 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1535/3114] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:36.964117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19df2-f6c1-4793-935e-f01bb9998f63 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:36.964414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19df2-f6c1-4793-935e-f01bb9998f63 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:36.964705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db19df2-f6c1-4793-935e-f01bb9998f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:37.000619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7db19df2-f6c1-4793-935e-f01bb9998f63 None None] MFA Rules not processed for user `e9e5b428b7b341a5a253addfd9493158`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:37.003059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7db19df2-f6c1-4793-935e-f01bb9998f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:37.102968 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1536/3115] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:37.102968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03350a22-f4e5-46d4-9f69-4cfbae9ac8ae None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:37.102968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03350a22-f4e5-46d4-9f69-4cfbae9ac8ae None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:37.102968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03350a22-f4e5-46d4-9f69-4cfbae9ac8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:37.110395 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1580/3116] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:37.135707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-03350a22-f4e5-46d4-9f69-4cfbae9ac8ae None None] MFA Rules not processed for user `57e806dbaedc49e395b7d6b374ca2fec`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:37.137185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-03350a22-f4e5-46d4-9f69-4cfbae9ac8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:37.176099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3d410-0c74-4edd-aaf9-8173c056c147 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:37.177832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f3d3d410-0c74-4edd-aaf9-8173c056c147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:37.251904 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1537/3117] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:37.256412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03350a22-f4e5-46d4-9f69-4cfbae9ac8ae None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:37.259102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-03350a22-f4e5-46d4-9f69-4cfbae9ac8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:37.327554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d3d410-0c74-4edd-aaf9-8173c056c147 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:37.342347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd30f89-6ebd-41f9-bf3a-497f6101cad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:37.343588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd30f89-6ebd-41f9-bf3a-497f6101cad8 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:37.344221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd30f89-6ebd-41f9-bf3a-497f6101cad8 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:37.345413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd30f89-6ebd-41f9-bf3a-497f6101cad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:37.367243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd30f89-6ebd-41f9-bf3a-497f6101cad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:37.373381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd30f89-6ebd-41f9-bf3a-497f6101cad8 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:37.404777 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1581/3118] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:37.426173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03350a22-f4e5-46d4-9f69-4cfbae9ac8ae None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:37.433892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68ae97-0856-4e17-8209-05d2e6597eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:37.434586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68ae97-0856-4e17-8209-05d2e6597eee admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:37.435654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68ae97-0856-4e17-8209-05d2e6597eee admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:37.436036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68ae97-0856-4e17-8209-05d2e6597eee admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:37.436745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68ae97-0856-4e17-8209-05d2e6597eee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:37.440296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68ae97-0856-4e17-8209-05d2e6597eee admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:37.489751 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1538/3119] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:37 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:37.493477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd30f89-6ebd-41f9-bf3a-497f6101cad8 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:37.507669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd30f89-6ebd-41f9-bf3a-497f6101cad8 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:37.686783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff392a-d0f7-4832-9667-48080b76b23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:37.688786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff392a-d0f7-4832-9667-48080b76b23b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:37.690104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff392a-d0f7-4832-9667-48080b76b23b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:37.691100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff392a-d0f7-4832-9667-48080b76b23b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:37.693132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff392a-d0f7-4832-9667-48080b76b23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:37.697467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff392a-d0f7-4832-9667-48080b76b23b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:37.763811 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1582/3120] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:37 2022] POST /identity/v3/users => generated 299 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:37.768110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68ae97-0856-4e17-8209-05d2e6597eee admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:37.802038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68ae97-0856-4e17-8209-05d2e6597eee admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:37.829232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0804289-d03b-4f68-a006-016dba280fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:37.829928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0804289-d03b-4f68-a006-016dba280fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:37.830214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0804289-d03b-4f68-a006-016dba280fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:37.836304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0804289-d03b-4f68-a006-016dba280fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:37.839306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0804289-d03b-4f68-a006-016dba280fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:37.862006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0804289-d03b-4f68-a006-016dba280fd3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:37.890186 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1539/3121] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:37.894406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff392a-d0f7-4832-9667-48080b76b23b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:37.913589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff392a-d0f7-4832-9667-48080b76b23b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:37.921891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448d1a6-4b98-4bff-a6cd-7289849f4485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:37.922890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448d1a6-4b98-4bff-a6cd-7289849f4485 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:37.923197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448d1a6-4b98-4bff-a6cd-7289849f4485 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:37.923482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448d1a6-4b98-4bff-a6cd-7289849f4485 admin admin] PATH_INFO: `/v3/projects/45240caf3c574054979eb351e9f6865d/users/039ceef8239c4ae79af0b85e35b0d776/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:37.962456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448d1a6-4b98-4bff-a6cd-7289849f4485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45240caf3c574054979eb351e9f6865d, user_id=039ceef8239c4ae79af0b85e35b0d776, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:37.965394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448d1a6-4b98-4bff-a6cd-7289849f4485 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:37.996369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0804289-d03b-4f68-a006-016dba280fd3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:37.997290 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1583/3122] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:37 2022] PUT /identity/v3/projects/45240caf3c574054979eb351e9f6865d/users/039ceef8239c4ae79af0b85e35b0d776/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:38.010474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0804289-d03b-4f68-a006-016dba280fd3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:38.132669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5ce5a-62a2-4680-af96-bb21e9129a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:38.133406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5ce5a-62a2-4680-af96-bb21e9129a49 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:38.133616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5ce5a-62a2-4680-af96-bb21e9129a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:38.133893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5ce5a-62a2-4680-af96-bb21e9129a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:38.134676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5ce5a-62a2-4680-af96-bb21e9129a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:38.136349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5ce5a-62a2-4680-af96-bb21e9129a49 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:38.168129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448d1a6-4b98-4bff-a6cd-7289849f4485 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:38.168547 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1540/3123] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:38.186370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448d1a6-4b98-4bff-a6cd-7289849f4485 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:38.198846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f2f9-a3a1-4493-ba98-1b2b25b03f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:38.200467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f2f9-a3a1-4493-ba98-1b2b25b03f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:38.202169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f2f9-a3a1-4493-ba98-1b2b25b03f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:38.202577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f2f9-a3a1-4493-ba98-1b2b25b03f45 admin admin] PATH_INFO: `/v3/projects/45240caf3c574054979eb351e9f6865d/users/039ceef8239c4ae79af0b85e35b0d776/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:38.248268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f2f9-a3a1-4493-ba98-1b2b25b03f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45240caf3c574054979eb351e9f6865d, user_id=039ceef8239c4ae79af0b85e35b0d776, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:38.275508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f2f9-a3a1-4493-ba98-1b2b25b03f45 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:38.290361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5ce5a-62a2-4680-af96-bb21e9129a49 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:38.292301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-52f5ce5a-62a2-4680-af96-bb21e9129a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:38.302767 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1584/3124] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:38 2022] PUT /identity/v3/projects/45240caf3c574054979eb351e9f6865d/users/039ceef8239c4ae79af0b85e35b0d776/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:38.304161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f2f9-a3a1-4493-ba98-1b2b25b03f45 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:38.312074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bd08f2f9-a3a1-4493-ba98-1b2b25b03f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:38.332508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5ce5a-62a2-4680-af96-bb21e9129a49 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:38.572905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:38.573791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:38.574073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:38.574337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] PATH_INFO: `/v3/projects/125dde1def47434d9222fd7f0d182dcb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:38.577243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=125dde1def47434d9222fd7f0d182dcb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:38.581792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:38.685057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f2f9-a3a1-4493-ba98-1b2b25b03f45 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:38.691120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125dde1def47434d9222fd7f0d182dcb', 'request_id': 'req-b6024521-2ecd-4d06-b674-fc87a1038407'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:38.715116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125dde1def47434d9222fd7f0d182dcb', 'request_id': 'req-b6024521-2ecd-4d06-b674-fc87a1038407'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:38.721168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125dde1def47434d9222fd7f0d182dcb', 'request_id': 'req-b6024521-2ecd-4d06-b674-fc87a1038407'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:38.745606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] The token cache is being invalidate because project 125dde1def47434d9222fd7f0d182dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:38.745820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:38.748305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:38.757117 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1541/3125] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:38 2022] DELETE /identity/v3/projects/125dde1def47434d9222fd7f0d182dcb => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:54:38.758270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:38.760235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:38.909630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba2098-12da-43aa-8acd-1169a9f46913 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:38.910262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba2098-12da-43aa-8acd-1169a9f46913 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:38.910262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba2098-12da-43aa-8acd-1169a9f46913 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:38.910663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba2098-12da-43aa-8acd-1169a9f46913 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:38.910842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6024521-2ecd-4d06-b674-fc87a1038407 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:38.914498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-75ba2098-12da-43aa-8acd-1169a9f46913 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:38.927794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:38.928673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:38.928943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:38.929219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] PATH_INFO: `/v3/users/5e25e9b97812487782c4b856465c0a30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:38.930482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e25e9b97812487782c4b856465c0a30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:38.933062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:39.097092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e25e9b97812487782c4b856465c0a30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:39.116473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e25e9b97812487782c4b856465c0a30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:39.118987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e25e9b97812487782c4b856465c0a30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:39.121666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e25e9b97812487782c4b856465c0a30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:39.146226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e25e9b97812487782c4b856465c0a30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:39.157168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba2098-12da-43aa-8acd-1169a9f46913 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:39.164717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba2098-12da-43aa-8acd-1169a9f46913 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:39.196380 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1542/3126] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:38 2022] DELETE /identity/v3/users/5e25e9b97812487782c4b856465c0a30 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:54:39.201157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:39.201393 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1585/3127] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 898 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:39.203359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:39.358162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b511ead-fe6a-4d2b-8df2-b068da0627f7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:39.362363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:39.363150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:39.363428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:39.364158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:39.365951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:39.378387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:39.379997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:39.391317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1543/3128] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:41.591734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba2098-12da-43aa-8acd-1169a9f46913 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:41.615965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba2098-12da-43aa-8acd-1169a9f46913 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:41.828596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:41.830047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:41.830047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:41.830047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] PATH_INFO: `/v3/projects/d14b753c857947358a96cf83d284c6de` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:41.830047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14b753c857947358a96cf83d284c6de)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:41.859605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:42.073449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14b753c857947358a96cf83d284c6de', 'request_id': 'req-e5520d3a-1245-4519-a6ff-545b951c0194'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.096511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14b753c857947358a96cf83d284c6de', 'request_id': 'req-e5520d3a-1245-4519-a6ff-545b951c0194'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.101662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:42.104690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:42.123548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14b753c857947358a96cf83d284c6de', 'request_id': 'req-e5520d3a-1245-4519-a6ff-545b951c0194'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.143330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e518e558-4b5e-4d25-8290-93bba4e3f8df service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:42.153679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] The token cache is being invalidate because project d14b753c857947358a96cf83d284c6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:42.156264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.160005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e5520d3a-1245-4519-a6ff-545b951c0194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.162768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1586/3129] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:41 2022] DELETE /identity/v3/projects/d14b753c857947358a96cf83d284c6de => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:42.170013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75ab96-7b39-412d-bfdb-7637e75e090a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:42.171299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75ab96-7b39-412d-bfdb-7637e75e090a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:42.171942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75ab96-7b39-412d-bfdb-7637e75e090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:42.218299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3e75ab96-7b39-412d-bfdb-7637e75e090a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:42.222792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3e75ab96-7b39-412d-bfdb-7637e75e090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:42.304118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:42.306883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:42.307202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:42.309968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] PATH_INFO: `/v3/users/97136aa03bec4904af1a2f5bf487bd16` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:42.313094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97136aa03bec4904af1a2f5bf487bd16)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:42.319746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:42.405976 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1587/3130] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:42.414358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc027c-e212-4be8-bdcc-351322677330 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:42.414693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc027c-e212-4be8-bdcc-351322677330 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:42.415063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc027c-e212-4be8-bdcc-351322677330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:42.470689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97136aa03bec4904af1a2f5bf487bd16'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.476187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2ddc027c-e212-4be8-bdcc-351322677330 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:42.478774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2ddc027c-e212-4be8-bdcc-351322677330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:42.486587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97136aa03bec4904af1a2f5bf487bd16'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.487598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97136aa03bec4904af1a2f5bf487bd16'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.488783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97136aa03bec4904af1a2f5bf487bd16'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.510913 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1588/3131] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:42.515305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc027c-e212-4be8-bdcc-351322677330 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:42.525915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e3af076-b491-4f20-a921-c4d0a9f3bbf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97136aa03bec4904af1a2f5bf487bd16'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:42.548924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc027c-e212-4be8-bdcc-351322677330 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:42.568580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a2b5-2987-48c0-bd1e-e5ecf95b210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:42.569393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a2b5-2987-48c0-bd1e-e5ecf95b210b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:42.569743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a2b5-2987-48c0-bd1e-e5ecf95b210b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:42.570220 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1544/3132] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:42 2022] DELETE /identity/v3/users/97136aa03bec4904af1a2f5bf487bd16 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:42.570395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057a2b5-2987-48c0-bd1e-e5ecf95b210b admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:42.571363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057a2b5-2987-48c0-bd1e-e5ecf95b210b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:42.572559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057a2b5-2987-48c0-bd1e-e5ecf95b210b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:42.576005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f519269-2cb6-437f-9c3d-f9df22e13acb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:42.576367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f519269-2cb6-437f-9c3d-f9df22e13acb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:42.576714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f519269-2cb6-437f-9c3d-f9df22e13acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:42.585822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057a2b5-2987-48c0-bd1e-e5ecf95b210b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:42.623479 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1589/3133] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:42.624676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a2b5-2987-48c0-bd1e-e5ecf95b210b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:42.627589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7f519269-2cb6-437f-9c3d-f9df22e13acb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:42.636420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7f519269-2cb6-437f-9c3d-f9df22e13acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:42.653998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057a2b5-2987-48c0-bd1e-e5ecf95b210b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:42.817254 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1545/3134] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:42.823349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27ee2-1298-4201-abfc-0269c2f54569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:42.824412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27ee2-1298-4201-abfc-0269c2f54569 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:42.824927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27ee2-1298-4201-abfc-0269c2f54569 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:42.825410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e27ee2-1298-4201-abfc-0269c2f54569 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:42.826331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e27ee2-1298-4201-abfc-0269c2f54569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:42.829503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e27ee2-1298-4201-abfc-0269c2f54569 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:42.860584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f519269-2cb6-437f-9c3d-f9df22e13acb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:42.861995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7f519269-2cb6-437f-9c3d-f9df22e13acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:42.865640 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1590/3135] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:42 2022] POST /identity/v3/projects => generated 373 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:42.871883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27ee2-1298-4201-abfc-0269c2f54569 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:42.988726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f519269-2cb6-437f-9c3d-f9df22e13acb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:43.023837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e27ee2-1298-4201-abfc-0269c2f54569 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:43.042952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff9d44-0466-438c-93be-747654bdce2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:43.043858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff9d44-0466-438c-93be-747654bdce2c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:43.046393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff9d44-0466-438c-93be-747654bdce2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:43.046680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff9d44-0466-438c-93be-747654bdce2c admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:43.047387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff9d44-0466-438c-93be-747654bdce2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:43.049432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff9d44-0466-438c-93be-747654bdce2c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:43.104088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59779ce1-fdd2-4881-a876-ab1dac88764a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:43.108357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59779ce1-fdd2-4881-a876-ab1dac88764a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:43.110731 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1591/3136] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:42 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:43.111860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff9d44-0466-438c-93be-747654bdce2c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:43.112087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59779ce1-fdd2-4881-a876-ab1dac88764a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:43.112381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59779ce1-fdd2-4881-a876-ab1dac88764a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:43.122305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5dff9d44-0466-438c-93be-747654bdce2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:43.138554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59779ce1-fdd2-4881-a876-ab1dac88764a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:43.140061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59779ce1-fdd2-4881-a876-ab1dac88764a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:43.155771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff9d44-0466-438c-93be-747654bdce2c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:43.165212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:43.166565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:43.166846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:43.167121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] PATH_INFO: `/v3/users/c99375ab58bf4a24adf07b75d7e6caf2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:43.169546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c99375ab58bf4a24adf07b75d7e6caf2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:43.171494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:43.181025 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1546/3137] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:43.187147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59779ce1-fdd2-4881-a876-ab1dac88764a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:43.219220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59779ce1-fdd2-4881-a876-ab1dac88764a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:43.242108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e0005-f73c-44e7-a384-567f261f7bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:43.242776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e0005-f73c-44e7-a384-567f261f7bbe admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:43.243255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e0005-f73c-44e7-a384-567f261f7bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:43.244333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e0005-f73c-44e7-a384-567f261f7bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:43.245227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e0005-f73c-44e7-a384-567f261f7bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:43.251801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e0005-f73c-44e7-a384-567f261f7bbe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:43.274034 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1547/3138] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:43.277913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c99375ab58bf4a24adf07b75d7e6caf2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:43.278894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e0005-f73c-44e7-a384-567f261f7bbe admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:43.291530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c99375ab58bf4a24adf07b75d7e6caf2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:43.293326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c99375ab58bf4a24adf07b75d7e6caf2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:43.295580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c99375ab58bf4a24adf07b75d7e6caf2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:43.299779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e0005-f73c-44e7-a384-567f261f7bbe admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:43.314664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf0b6d-1bb1-454c-ab10-c3a5588ab4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:43.315340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf0b6d-1bb1-454c-ab10-c3a5588ab4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:43.315588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c99375ab58bf4a24adf07b75d7e6caf2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:43.316283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf0b6d-1bb1-454c-ab10-c3a5588ab4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:43.316716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf0b6d-1bb1-454c-ab10-c3a5588ab4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:43.317882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf0b6d-1bb1-454c-ab10-c3a5588ab4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:43.322850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf0b6d-1bb1-454c-ab10-c3a5588ab4b8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:43.348964 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1592/3139] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:54:43 2022] DELETE /identity/v3/users/c99375ab58bf4a24adf07b75d7e6caf2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:43.357551 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1548/3140] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:54:43.362119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:43.374557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:43.523348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1db3d-d05a-462e-82cf-048d11b8a969 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:43.529860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c82f80-a5c6-4eee-bf34-a2a61604b312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:43.530776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c82f80-a5c6-4eee-bf34-a2a61604b312 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:43.531356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c82f80-a5c6-4eee-bf34-a2a61604b312 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:43.531642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c82f80-a5c6-4eee-bf34-a2a61604b312 admin admin] PATH_INFO: `/v3/projects/f1a4be7864234e8f93a10896a309e6ad/users/5d3b74fb605347bcbe8359165aaa0c6f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:43.551393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c82f80-a5c6-4eee-bf34-a2a61604b312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a4be7864234e8f93a10896a309e6ad, user_id=5d3b74fb605347bcbe8359165aaa0c6f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:43.554792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c82f80-a5c6-4eee-bf34-a2a61604b312 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:43.585784 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1593/3141] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:43 2022] PUT /identity/v3/projects/f1a4be7864234e8f93a10896a309e6ad/users/5d3b74fb605347bcbe8359165aaa0c6f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:43.602810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce895168-987a-4d30-8032-0040647e07cb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:43.603604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce895168-987a-4d30-8032-0040647e07cb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:43.604190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce895168-987a-4d30-8032-0040647e07cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:43.669690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ce895168-987a-4d30-8032-0040647e07cb None None] MFA Rules not processed for user `5d3b74fb605347bcbe8359165aaa0c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:43.676434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ce895168-987a-4d30-8032-0040647e07cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:43.847090 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1549/3142] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:43.852056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c82f80-a5c6-4eee-bf34-a2a61604b312 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:43.974048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce895168-987a-4d30-8032-0040647e07cb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:43.976422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ce895168-987a-4d30-8032-0040647e07cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:44.030014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c82f80-a5c6-4eee-bf34-a2a61604b312 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:44.046549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69273f5-0de4-431f-a77d-b657cfdc027d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:44.047766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69273f5-0de4-431f-a77d-b657cfdc027d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.050122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69273f5-0de4-431f-a77d-b657cfdc027d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.050541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69273f5-0de4-431f-a77d-b657cfdc027d admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.053275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69273f5-0de4-431f-a77d-b657cfdc027d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:44.057645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69273f5-0de4-431f-a77d-b657cfdc027d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:44.146780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1594/3143] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:43 2022] POST /identity/v3/projects => generated 373 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:54:44.152070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69273f5-0de4-431f-a77d-b657cfdc027d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:44.173106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce895168-987a-4d30-8032-0040647e07cb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:44.315539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69273f5-0de4-431f-a77d-b657cfdc027d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:44.327261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b600b1-35be-4642-be99-a32f74eae501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:44.332573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b600b1-35be-4642-be99-a32f74eae501 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.332858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b600b1-35be-4642-be99-a32f74eae501 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.333142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b600b1-35be-4642-be99-a32f74eae501 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.333845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b600b1-35be-4642-be99-a32f74eae501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:44.335796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b600b1-35be-4642-be99-a32f74eae501 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:44.336461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:44.337621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.338062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.338495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] PATH_INFO: `/v3/projects/f93125ac1a714e3ca18236ff7794ca6c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.340262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93125ac1a714e3ca18236ff7794ca6c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:44.343400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:44.392659 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1595/3144] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:44 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:44.396657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b600b1-35be-4642-be99-a32f74eae501 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:44.421332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b600b1-35be-4642-be99-a32f74eae501 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:44.433037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93125ac1a714e3ca18236ff7794ca6c', 'request_id': 'req-70fe394c-7990-437c-a100-78f68116380b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:44.464446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93125ac1a714e3ca18236ff7794ca6c', 'request_id': 'req-70fe394c-7990-437c-a100-78f68116380b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:44.483188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93125ac1a714e3ca18236ff7794ca6c', 'request_id': 'req-70fe394c-7990-437c-a100-78f68116380b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:44.499491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] The token cache is being invalidate because project f93125ac1a714e3ca18236ff7794ca6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:44.499791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:44.500946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-70fe394c-7990-437c-a100-78f68116380b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:44.508491 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1550/3145] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:43 2022] DELETE /identity/v3/projects/f93125ac1a714e3ca18236ff7794ca6c => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:44.510677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337663-66a7-4db9-9774-f443faee1858 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.510970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337663-66a7-4db9-9774-f443faee1858 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.511620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337663-66a7-4db9-9774-f443faee1858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.539374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a6337663-66a7-4db9-9774-f443faee1858 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:44.541354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a6337663-66a7-4db9-9774-f443faee1858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:44.636748 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1551/3146] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:44.638277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60406-8f26-4f3c-9c8f-339df579fc8d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.638569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60406-8f26-4f3c-9c8f-339df579fc8d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.638856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e60406-8f26-4f3c-9c8f-339df579fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.660991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e0e60406-8f26-4f3c-9c8f-339df579fc8d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:44.662216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e0e60406-8f26-4f3c-9c8f-339df579fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:44.676276 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1552/3147] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:44.677708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e60406-8f26-4f3c-9c8f-339df579fc8d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:44.690621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e60406-8f26-4f3c-9c8f-339df579fc8d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:44.703975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cd358-e4c2-4517-bc0a-7ddad1548aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:44.706547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cd358-e4c2-4517-bc0a-7ddad1548aed admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.706547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cd358-e4c2-4517-bc0a-7ddad1548aed admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.706810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cd358-e4c2-4517-bc0a-7ddad1548aed admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.707530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad0dc-cceb-4ab7-9ace-df69a3da0185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:44.708203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cd358-e4c2-4517-bc0a-7ddad1548aed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:44.709095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cd358-e4c2-4517-bc0a-7ddad1548aed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:44.710786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cd358-e4c2-4517-bc0a-7ddad1548aed admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:44.713077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad0dc-cceb-4ab7-9ace-df69a3da0185 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.716620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad0dc-cceb-4ab7-9ace-df69a3da0185 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.717051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ad0dc-cceb-4ab7-9ace-df69a3da0185 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.725712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ad0dc-cceb-4ab7-9ace-df69a3da0185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:44.728847 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1553/3148] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:44.729801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cd358-e4c2-4517-bc0a-7ddad1548aed admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:44.732684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ad0dc-cceb-4ab7-9ace-df69a3da0185 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:44.740716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cd358-e4c2-4517-bc0a-7ddad1548aed admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:44.745988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc3b4-d92d-499f-b679-e9b1e8498450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:44.746647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc3b4-d92d-499f-b679-e9b1e8498450 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.746931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc3b4-d92d-499f-b679-e9b1e8498450 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.747201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fc3b4-d92d-499f-b679-e9b1e8498450 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.747896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fc3b4-d92d-499f-b679-e9b1e8498450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:44.750400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fc3b4-d92d-499f-b679-e9b1e8498450 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:44.782382 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1596/3149] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:54:44.783467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad0dc-cceb-4ab7-9ace-df69a3da0185 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:44.798457 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1554/3150] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:44 2022] POST /identity/v3/projects => generated 381 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:44.800855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc3b4-d92d-499f-b679-e9b1e8498450 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:44.802471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-257ad0dc-cceb-4ab7-9ace-df69a3da0185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:44.854345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ad0dc-cceb-4ab7-9ace-df69a3da0185 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:44.897197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fc3b4-d92d-499f-b679-e9b1e8498450 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:44.900280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99bbad-7b9e-4aaf-8c91-314eea5c34e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:44.901183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99bbad-7b9e-4aaf-8c91-314eea5c34e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.901493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99bbad-7b9e-4aaf-8c91-314eea5c34e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.901740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99bbad-7b9e-4aaf-8c91-314eea5c34e0 admin admin] PATH_INFO: `/v3/projects/42645a8397f54100955f168da56a7a19/users/61a638f949a143d98b68286357b0a5d5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.906277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34c506-c33a-45eb-bdb3-3b919820b761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:44.907222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c506-c33a-45eb-bdb3-3b919820b761 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:44.907736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c506-c33a-45eb-bdb3-3b919820b761 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:44.911793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34c506-c33a-45eb-bdb3-3b919820b761 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:44.912972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34c506-c33a-45eb-bdb3-3b919820b761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:44.915173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34c506-c33a-45eb-bdb3-3b919820b761 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:44.956383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99bbad-7b9e-4aaf-8c91-314eea5c34e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42645a8397f54100955f168da56a7a19, user_id=61a638f949a143d98b68286357b0a5d5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:44.959109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99bbad-7b9e-4aaf-8c91-314eea5c34e0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:44.962878 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1555/3151] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:44 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:44.970946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34c506-c33a-45eb-bdb3-3b919820b761 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:44.995529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34c506-c33a-45eb-bdb3-3b919820b761 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:45.014333 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1597/3152] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:44 2022] PUT /identity/v3/projects/42645a8397f54100955f168da56a7a19/users/61a638f949a143d98b68286357b0a5d5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:45.015347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99bbad-7b9e-4aaf-8c91-314eea5c34e0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:45.025338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7b99bbad-7b9e-4aaf-8c91-314eea5c34e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:45.115812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a303b3-9be5-4ca8-9396-bba615ee1a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:45.117000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a303b3-9be5-4ca8-9396-bba615ee1a50 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:45.117200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a303b3-9be5-4ca8-9396-bba615ee1a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:45.117407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a303b3-9be5-4ca8-9396-bba615ee1a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:45.118335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a303b3-9be5-4ca8-9396-bba615ee1a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:45.120068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a303b3-9be5-4ca8-9396-bba615ee1a50 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:45.135789 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1556/3153] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:45.139832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a303b3-9be5-4ca8-9396-bba615ee1a50 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:45.154467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a303b3-9be5-4ca8-9396-bba615ee1a50 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:45.161324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5a4d-707e-47bc-8149-89142d395e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:45.162119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5a4d-707e-47bc-8149-89142d395e9c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:45.162451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5a4d-707e-47bc-8149-89142d395e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:45.162732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a5a4d-707e-47bc-8149-89142d395e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:45.163595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a5a4d-707e-47bc-8149-89142d395e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:45.166876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a5a4d-707e-47bc-8149-89142d395e9c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:45.220184 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1557/3154] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:45.222767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5a4d-707e-47bc-8149-89142d395e9c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:45.253554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99bbad-7b9e-4aaf-8c91-314eea5c34e0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:45.255708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a5a4d-707e-47bc-8149-89142d395e9c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:45.267952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:45.268845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:45.279815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae8989-024f-438f-a501-c6f246141316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:45.280796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae8989-024f-438f-a501-c6f246141316 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:45.281299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae8989-024f-438f-a501-c6f246141316 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:45.283117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae8989-024f-438f-a501-c6f246141316 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:45.283655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:45.284080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] PATH_INFO: `/v3/projects/c3314f9aa9dd4e6bb0769adc87c04436` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:45.286112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae8989-024f-438f-a501-c6f246141316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:45.291319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3314f9aa9dd4e6bb0769adc87c04436)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:45.294169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae8989-024f-438f-a501-c6f246141316 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:45.300734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:45.329347 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1558/3155] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:45.331769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae8989-024f-438f-a501-c6f246141316 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:45.335314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f6ae8989-024f-438f-a501-c6f246141316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:45.422206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3314f9aa9dd4e6bb0769adc87c04436', 'request_id': 'req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:45.438332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3314f9aa9dd4e6bb0769adc87c04436', 'request_id': 'req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:45.449388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3314f9aa9dd4e6bb0769adc87c04436', 'request_id': 'req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:45.485353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] The token cache is being invalidate because project c3314f9aa9dd4e6bb0769adc87c04436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:54:45.486766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:45.493758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:54:45.498333 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1598/3156] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:54:45 2022] DELETE /identity/v3/projects/c3314f9aa9dd4e6bb0769adc87c04436 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:45.501257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:45.503729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:45.582157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae8989-024f-438f-a501-c6f246141316 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:45.666835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7edd0-b53f-49ae-9f6f-19930fa7b9b5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:45.678130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b56dd-b314-4ccc-adb4-5553d4d69251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:45.681459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b56dd-b314-4ccc-adb4-5553d4d69251 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:45.681788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b56dd-b314-4ccc-adb4-5553d4d69251 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:45.682059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b56dd-b314-4ccc-adb4-5553d4d69251 admin admin] PATH_INFO: `/v3/projects/42645a8397f54100955f168da56a7a19/users/61a638f949a143d98b68286357b0a5d5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:45.687515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b56dd-b314-4ccc-adb4-5553d4d69251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42645a8397f54100955f168da56a7a19, user_id=61a638f949a143d98b68286357b0a5d5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:45.698408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b56dd-b314-4ccc-adb4-5553d4d69251 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:45.738143 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1599/3157] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:45 2022] PUT /identity/v3/projects/42645a8397f54100955f168da56a7a19/users/61a638f949a143d98b68286357b0a5d5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:45.738143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b56dd-b314-4ccc-adb4-5553d4d69251 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:45.740113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c82b56dd-b314-4ccc-adb4-5553d4d69251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:45.811897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01962a36-f331-423a-a386-929a8a058995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:45.812504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962a36-f331-423a-a386-929a8a058995 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:45.812795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962a36-f331-423a-a386-929a8a058995 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:45.813076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01962a36-f331-423a-a386-929a8a058995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:45.824863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-01962a36-f331-423a-a386-929a8a058995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:45.871732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01962a36-f331-423a-a386-929a8a058995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:45.873420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01962a36-f331-423a-a386-929a8a058995 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:45.914425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b56dd-b314-4ccc-adb4-5553d4d69251 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:45.927155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6420bdd-5cb1-4548-b8ac-4dbbc75e6e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:45.928913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420bdd-5cb1-4548-b8ac-4dbbc75e6e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:45.929201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420bdd-5cb1-4548-b8ac-4dbbc75e6e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:45.929483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6420bdd-5cb1-4548-b8ac-4dbbc75e6e61 admin admin] PATH_INFO: `/v3/projects/c1854d29eeb64bb4b5851d72ac8dddab/users/d6067a3bcd1e4ccb808323697704fea2/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:45.945987 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1559/3158] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:45.947866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e4c1-b29e-4e1a-a3bd-292ab59fb4a5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:45.948186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e4c1-b29e-4e1a-a3bd-292ab59fb4a5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:45.948470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4e4c1-b29e-4e1a-a3bd-292ab59fb4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:45.976688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420bdd-5cb1-4548-b8ac-4dbbc75e6e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1854d29eeb64bb4b5851d72ac8dddab, user_id=d6067a3bcd1e4ccb808323697704fea2, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:45.985002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6420bdd-5cb1-4548-b8ac-4dbbc75e6e61 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:46.034110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b4e4e4c1-b29e-4e1a-a3bd-292ab59fb4a5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:46.035371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b4e4e4c1-b29e-4e1a-a3bd-292ab59fb4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:46.075238 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1600/3159] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:45 2022] PUT /identity/v3/projects/c1854d29eeb64bb4b5851d72ac8dddab/users/d6067a3bcd1e4ccb808323697704fea2/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:46.085156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f852799-2da5-4024-8021-5328dce0eb91 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:46.085445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f852799-2da5-4024-8021-5328dce0eb91 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:46.085722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f852799-2da5-4024-8021-5328dce0eb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:46.152176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2f852799-2da5-4024-8021-5328dce0eb91 None None] MFA Rules not processed for user `61a638f949a143d98b68286357b0a5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:46.154877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2f852799-2da5-4024-8021-5328dce0eb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:46.250999 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1560/3160] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:46.255963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927ecf3-e65f-4b22-9eba-1d80eb4990e1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:46.256286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927ecf3-e65f-4b22-9eba-1d80eb4990e1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:46.256572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927ecf3-e65f-4b22-9eba-1d80eb4990e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:46.311681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8927ecf3-e65f-4b22-9eba-1d80eb4990e1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:46.316679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8927ecf3-e65f-4b22-9eba-1d80eb4990e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:46.339171 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1561/3161] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:46.340977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fb51e-a330-4b69-8658-61a71daa9347 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:46.345024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fb51e-a330-4b69-8658-61a71daa9347 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:46.345336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fb51e-a330-4b69-8658-61a71daa9347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:46.350802 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1601/3162] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:46.373021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840b5ec-d041-4c33-9a0c-10f927f08db0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:46.373444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840b5ec-d041-4c33-9a0c-10f927f08db0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:46.373813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840b5ec-d041-4c33-9a0c-10f927f08db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:46.397308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d02fb51e-a330-4b69-8658-61a71daa9347 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:46.398535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d02fb51e-a330-4b69-8658-61a71daa9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:46.414534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9840b5ec-d041-4c33-9a0c-10f927f08db0 None None] MFA Rules not processed for user `5d3b74fb605347bcbe8359165aaa0c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:46.425790 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1562/3163] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:46.426024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9840b5ec-d041-4c33-9a0c-10f927f08db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:46.426119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fb51e-a330-4b69-8658-61a71daa9347 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:46.427028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d02fb51e-a330-4b69-8658-61a71daa9347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:46.514445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fb51e-a330-4b69-8658-61a71daa9347 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:46.524979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce91323-6890-4e20-a839-87793796ec6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:46.525707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce91323-6890-4e20-a839-87793796ec6e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:46.525998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce91323-6890-4e20-a839-87793796ec6e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:46.526277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce91323-6890-4e20-a839-87793796ec6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:46.547559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce91323-6890-4e20-a839-87793796ec6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:46.549247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce91323-6890-4e20-a839-87793796ec6e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:46.561338 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1563/3164] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:46.562291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce91323-6890-4e20-a839-87793796ec6e service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:46.572173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce91323-6890-4e20-a839-87793796ec6e service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:46.573104 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1602/3165] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:46.583520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03232d27-76a5-4f56-8bcb-c70caa5ed37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:46.584761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03232d27-76a5-4f56-8bcb-c70caa5ed37b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:46.585068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03232d27-76a5-4f56-8bcb-c70caa5ed37b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:46.585351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03232d27-76a5-4f56-8bcb-c70caa5ed37b admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:46.586089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03232d27-76a5-4f56-8bcb-c70caa5ed37b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:54:46.586400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03232d27-76a5-4f56-8bcb-c70caa5ed37b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:46.589329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03232d27-76a5-4f56-8bcb-c70caa5ed37b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:46.606691 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1564/3166] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:54:46.608735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840b5ec-d041-4c33-9a0c-10f927f08db0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:46.632153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840b5ec-d041-4c33-9a0c-10f927f08db0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:46.642124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088f3f6-a6a4-462d-9503-8d1f53a5febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:46.642801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088f3f6-a6a4-462d-9503-8d1f53a5febc admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:46.643083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088f3f6-a6a4-462d-9503-8d1f53a5febc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:46.643774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088f3f6-a6a4-462d-9503-8d1f53a5febc admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:46.644497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088f3f6-a6a4-462d-9503-8d1f53a5febc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:46.647817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088f3f6-a6a4-462d-9503-8d1f53a5febc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:46.711458 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1603/3167] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:54:46 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:46.715698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03232d27-76a5-4f56-8bcb-c70caa5ed37b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:46.734007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03232d27-76a5-4f56-8bcb-c70caa5ed37b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:46.806221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088f3f6-a6a4-462d-9503-8d1f53a5febc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:46.808338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9088f3f6-a6a4-462d-9503-8d1f53a5febc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:46.906483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69c454-0653-42c5-983c-b0577b75bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:46.907159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69c454-0653-42c5-983c-b0577b75bed4 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:46.907439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69c454-0653-42c5-983c-b0577b75bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:46.907713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69c454-0653-42c5-983c-b0577b75bed4 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:46.908436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69c454-0653-42c5-983c-b0577b75bed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:46.910384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69c454-0653-42c5-983c-b0577b75bed4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:46.958970 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1565/3168] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:54:46 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:54:46.959890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69c454-0653-42c5-983c-b0577b75bed4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:46.988373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69c454-0653-42c5-983c-b0577b75bed4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:46.994551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088f3f6-a6a4-462d-9503-8d1f53a5febc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:46.996213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf2f5a-8926-4f81-83fd-81e934eec638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:46.996887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf2f5a-8926-4f81-83fd-81e934eec638 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:46.997167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf2f5a-8926-4f81-83fd-81e934eec638 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:46.997440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf2f5a-8926-4f81-83fd-81e934eec638 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:46.998160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf2f5a-8926-4f81-83fd-81e934eec638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:46.999776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf2f5a-8926-4f81-83fd-81e934eec638 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:47.001396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70808e96-fdf0-463d-9867-eb6ac20b9811 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:47.002316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70808e96-fdf0-463d-9867-eb6ac20b9811 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:47.002819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70808e96-fdf0-463d-9867-eb6ac20b9811 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:47.003103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70808e96-fdf0-463d-9867-eb6ac20b9811 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:47.023691 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1566/3169] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:47.027715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf2f5a-8926-4f81-83fd-81e934eec638 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:47.028865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-70808e96-fdf0-463d-9867-eb6ac20b9811 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:47.049251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf2f5a-8926-4f81-83fd-81e934eec638 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:47.064234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3219a89-58cf-4e5c-a4dc-166fb0a10769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:47.064928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3219a89-58cf-4e5c-a4dc-166fb0a10769 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:47.065228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3219a89-58cf-4e5c-a4dc-166fb0a10769 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:47.065500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3219a89-58cf-4e5c-a4dc-166fb0a10769 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:47.066230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3219a89-58cf-4e5c-a4dc-166fb0a10769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:47.070655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3219a89-58cf-4e5c-a4dc-166fb0a10769 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:47.113474 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1567/3170] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:54:47.114071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3219a89-58cf-4e5c-a4dc-166fb0a10769 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:47.127228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70808e96-fdf0-463d-9867-eb6ac20b9811 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:47.129526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70808e96-fdf0-463d-9867-eb6ac20b9811 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:47.136213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3219a89-58cf-4e5c-a4dc-166fb0a10769 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:47.162593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e16941-0a85-41a3-a8c9-b608507cbbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:47.163895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16941-0a85-41a3-a8c9-b608507cbbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:47.164241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16941-0a85-41a3-a8c9-b608507cbbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:47.164598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e16941-0a85-41a3-a8c9-b608507cbbc4 admin admin] PATH_INFO: `/v3/projects/b2f47185eafd43c3a0a4a7cbfb9d679d/users/864b039c62424775834b1294a6725d80/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:47.170076 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1604/3171] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:47.242179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e16941-0a85-41a3-a8c9-b608507cbbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2f47185eafd43c3a0a4a7cbfb9d679d, user_id=864b039c62424775834b1294a6725d80, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:47.252312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e16941-0a85-41a3-a8c9-b608507cbbc4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:47.311253 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1568/3172] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:54:47 2022] PUT /identity/v3/projects/b2f47185eafd43c3a0a4a7cbfb9d679d/users/864b039c62424775834b1294a6725d80/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:54:47.312664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d1e1a-d2a5-453f-b087-0a883d5466b0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:47.313244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d1e1a-d2a5-453f-b087-0a883d5466b0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:47.313757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d1e1a-d2a5-453f-b087-0a883d5466b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:47.400435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c60d1e1a-d2a5-453f-b087-0a883d5466b0 None None] MFA Rules not processed for user `864b039c62424775834b1294a6725d80`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:47.401796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c60d1e1a-d2a5-453f-b087-0a883d5466b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:47.600419 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1605/3173] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:47.603144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ec9ca-4b5b-4945-8d62-f78ff85ae646 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:47.603518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ec9ca-4b5b-4945-8d62-f78ff85ae646 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:47.603807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ec9ca-4b5b-4945-8d62-f78ff85ae646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:47.647272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-666ec9ca-4b5b-4945-8d62-f78ff85ae646 None None] MFA Rules not processed for user `864b039c62424775834b1294a6725d80`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:47.648529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-666ec9ca-4b5b-4945-8d62-f78ff85ae646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:47.664491 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1569/3174] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:47.965366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d1e1a-d2a5-453f-b087-0a883d5466b0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:48.117261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d1e1a-d2a5-453f-b087-0a883d5466b0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:48.125158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa99de-8d1d-47c8-b021-438f1135e32a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:48.125984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa99de-8d1d-47c8-b021-438f1135e32a service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:48.126239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa99de-8d1d-47c8-b021-438f1135e32a service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:48.126663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa99de-8d1d-47c8-b021-438f1135e32a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:48.137594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa99de-8d1d-47c8-b021-438f1135e32a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:48.139449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa99de-8d1d-47c8-b021-438f1135e32a service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:48.153731 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1606/3175] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:50.016621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d769c-6d86-46f7-984d-0c99889430ed None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:50.017183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d769c-6d86-46f7-984d-0c99889430ed None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:50.017183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d769c-6d86-46f7-984d-0c99889430ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:50.068609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-345d769c-6d86-46f7-984d-0c99889430ed None None] MFA Rules not processed for user `d6067a3bcd1e4ccb808323697704fea2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:50.069850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-345d769c-6d86-46f7-984d-0c99889430ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:50.250590 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1570/3176] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:54:50.256404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe8f22-51ce-46c0-a172-058a31276bed None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:50.256975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe8f22-51ce-46c0-a172-058a31276bed None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:50.256975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe8f22-51ce-46c0-a172-058a31276bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:50.293905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-47fe8f22-51ce-46c0-a172-058a31276bed None None] MFA Rules not processed for user `d6067a3bcd1e4ccb808323697704fea2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:50.296298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-47fe8f22-51ce-46c0-a172-058a31276bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:50.305762 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1607/3177] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:51.055083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d769c-6d86-46f7-984d-0c99889430ed None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:51.057417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-345d769c-6d86-46f7-984d-0c99889430ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:51.087115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d769c-6d86-46f7-984d-0c99889430ed None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:51.097821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4563ea-c379-4690-b0b7-bd35bc6e4ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:51.100257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4563ea-c379-4690-b0b7-bd35bc6e4ee0 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:51.100701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4563ea-c379-4690-b0b7-bd35bc6e4ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:51.101475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4563ea-c379-4690-b0b7-bd35bc6e4ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:51.116703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4563ea-c379-4690-b0b7-bd35bc6e4ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:51.118696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4563ea-c379-4690-b0b7-bd35bc6e4ee0 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:51.151801 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1571/3178] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:52.119613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe8f22-51ce-46c0-a172-058a31276bed None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:52.285670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe8f22-51ce-46c0-a172-058a31276bed None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:52.299318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:52.300822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:52.301184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:52.301539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:52.308442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:52.328245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:52.330542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:52.350334 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1608/3179] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:54:53.392225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4c5d8-68ae-4a26-b584-e2f371ffab71 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:53.393164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4c5d8-68ae-4a26-b584-e2f371ffab71 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:53.394468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4c5d8-68ae-4a26-b584-e2f371ffab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:53.479418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bdb4c5d8-68ae-4a26-b584-e2f371ffab71 None None] MFA Rules not processed for user `039ceef8239c4ae79af0b85e35b0d776`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:54:53.480673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bdb4c5d8-68ae-4a26-b584-e2f371ffab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:53.648612 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1572/3180] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:54:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:54:53.662774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:54:53.664311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:54:53.898702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ca18-8315-475c-9f4c-8787fdb758ad service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:54:53.904541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cb0a9-8df6-47ac-b6a9-1cffc4fa0d2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:54:53.905889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cb0a9-8df6-47ac-b6a9-1cffc4fa0d2d service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:54:53.906389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cb0a9-8df6-47ac-b6a9-1cffc4fa0d2d service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:54:53.906897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700cb0a9-8df6-47ac-b6a9-1cffc4fa0d2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:54:53.919005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cb0a9-8df6-47ac-b6a9-1cffc4fa0d2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:54:53.921224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700cb0a9-8df6-47ac-b6a9-1cffc4fa0d2d service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:54:53.936198 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1609/3181] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:54:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:07.570539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d995fe7-5da2-4174-91f5-d0adbb162eb4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:07.572379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d995fe7-5da2-4174-91f5-d0adbb162eb4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:07.573520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d995fe7-5da2-4174-91f5-d0adbb162eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:07.593389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2d995fe7-5da2-4174-91f5-d0adbb162eb4 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:07.594776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2d995fe7-5da2-4174-91f5-d0adbb162eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:07.699863 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1573/3182] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:55:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:07.743561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cb0a9-8df6-47ac-b6a9-1cffc4fa0d2d service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:07.747200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-700cb0a9-8df6-47ac-b6a9-1cffc4fa0d2d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:07.885662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700cb0a9-8df6-47ac-b6a9-1cffc4fa0d2d service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:07.893625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480267-cc70-4b86-9adf-b5bc4063638b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:07.894667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480267-cc70-4b86-9adf-b5bc4063638b service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:07.895159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480267-cc70-4b86-9adf-b5bc4063638b service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:07.895658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20480267-cc70-4b86-9adf-b5bc4063638b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:07.911318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480267-cc70-4b86-9adf-b5bc4063638b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:07.913442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20480267-cc70-4b86-9adf-b5bc4063638b service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:07.928280 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1610/3183] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:08.177404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f220c-4a4e-4d44-846b-7d0028a135a0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:08.177992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f220c-4a4e-4d44-846b-7d0028a135a0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:08.178375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f220c-4a4e-4d44-846b-7d0028a135a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:08.204552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-702f220c-4a4e-4d44-846b-7d0028a135a0 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:08.206045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-702f220c-4a4e-4d44-846b-7d0028a135a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:08.217294 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1574/3184] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:08.232940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480267-cc70-4b86-9adf-b5bc4063638b service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:08.245056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20480267-cc70-4b86-9adf-b5bc4063638b service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:08.251031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91105943-af2d-463e-b999-277ef5fcbb64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:08.251957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91105943-af2d-463e-b999-277ef5fcbb64 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:08.252430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91105943-af2d-463e-b999-277ef5fcbb64 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:08.252905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91105943-af2d-463e-b999-277ef5fcbb64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:08.265239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91105943-af2d-463e-b999-277ef5fcbb64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:08.267822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91105943-af2d-463e-b999-277ef5fcbb64 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:08.279810 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1611/3185] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:08.431279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ea6f-99a3-4ed2-a06e-27d81b203ffd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:08.431860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ea6f-99a3-4ed2-a06e-27d81b203ffd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:08.432392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ea6f-99a3-4ed2-a06e-27d81b203ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:08.473321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a033ea6f-99a3-4ed2-a06e-27d81b203ffd None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:08.485865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a033ea6f-99a3-4ed2-a06e-27d81b203ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:08.503621 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1575/3186] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:55:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:08.533109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91105943-af2d-463e-b999-277ef5fcbb64 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:08.550413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91105943-af2d-463e-b999-277ef5fcbb64 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:08.568421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a31e4-f456-4d5b-9e05-e9b806df2a9d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:08.569643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a31e4-f456-4d5b-9e05-e9b806df2a9d service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:08.570088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a31e4-f456-4d5b-9e05-e9b806df2a9d service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:08.570571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a31e4-f456-4d5b-9e05-e9b806df2a9d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:08.586481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a31e4-f456-4d5b-9e05-e9b806df2a9d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:08.589098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a31e4-f456-4d5b-9e05-e9b806df2a9d service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:08.608499 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1612/3187] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:09.900936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033ea6f-99a3-4ed2-a06e-27d81b203ffd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:09.903092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a033ea6f-99a3-4ed2-a06e-27d81b203ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:09.943742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138a4f8-750c-44e0-a19c-51dd7579fdab None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:09.944688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138a4f8-750c-44e0-a19c-51dd7579fdab None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:09.945123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138a4f8-750c-44e0-a19c-51dd7579fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:09.964980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8138a4f8-750c-44e0-a19c-51dd7579fdab None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:09.966491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8138a4f8-750c-44e0-a19c-51dd7579fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:09.975219 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1613/3188] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:55:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:55:09.994149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138a4f8-750c-44e0-a19c-51dd7579fdab None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:09.998602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033ea6f-99a3-4ed2-a06e-27d81b203ffd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:10.003563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:10.004830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:10.005111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:10.005398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] PATH_INFO: `/v3/users/b1109e52939e48759e11f26461e05a5a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:10.007131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1109e52939e48759e11f26461e05a5a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:10.010012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:10.017174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138a4f8-750c-44e0-a19c-51dd7579fdab None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:10.030442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53296268-359b-4139-8f94-be139c2a1fc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:10.031104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53296268-359b-4139-8f94-be139c2a1fc4 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:10.031390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53296268-359b-4139-8f94-be139c2a1fc4 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:10.031675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53296268-359b-4139-8f94-be139c2a1fc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:10.042069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53296268-359b-4139-8f94-be139c2a1fc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:10.044132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53296268-359b-4139-8f94-be139c2a1fc4 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:10.058797 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1614/3189] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:10.081391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1109e52939e48759e11f26461e05a5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.090383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1109e52939e48759e11f26461e05a5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.091064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1109e52939e48759e11f26461e05a5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.091765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1109e52939e48759e11f26461e05a5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.106148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1109e52939e48759e11f26461e05a5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.126688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1576/3190] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:09 2022] DELETE /identity/v3/users/b1109e52939e48759e11f26461e05a5a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:10.131585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269ba46-472c-4959-aa73-31671b9eaa62 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:10.131878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269ba46-472c-4959-aa73-31671b9eaa62 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:10.132185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269ba46-472c-4959-aa73-31671b9eaa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:10.151354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a269ba46-472c-4959-aa73-31671b9eaa62 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:10.153149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a269ba46-472c-4959-aa73-31671b9eaa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:10.235992 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1615/3191] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:10.248100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:10.250876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:10.327890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a47690-658c-4647-afa6-dd103c7f30e8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:10.332819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e1e83-8b67-4f59-a447-eb3fdee7cd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:10.333770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1e83-8b67-4f59-a447-eb3fdee7cd40 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:10.334232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1e83-8b67-4f59-a447-eb3fdee7cd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:10.334751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e1e83-8b67-4f59-a447-eb3fdee7cd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:10.345964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e1e83-8b67-4f59-a447-eb3fdee7cd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:10.347439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e1e83-8b67-4f59-a447-eb3fdee7cd40 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:10.357894 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1577/3192] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:55:10.604265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269ba46-472c-4959-aa73-31671b9eaa62 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:10.608086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a269ba46-472c-4959-aa73-31671b9eaa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:10.624085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269ba46-472c-4959-aa73-31671b9eaa62 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:10.667274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:10.671015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:10.673218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:10.673698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] PATH_INFO: `/v3/projects/1de3ee23ad854cd3aed820396ed8bd53` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:10.679171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1de3ee23ad854cd3aed820396ed8bd53)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:10.684477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:10.787427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1de3ee23ad854cd3aed820396ed8bd53', 'request_id': 'req-cdef361c-4ff8-41e9-bae6-77952107111e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.809580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1de3ee23ad854cd3aed820396ed8bd53', 'request_id': 'req-cdef361c-4ff8-41e9-bae6-77952107111e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.819863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1de3ee23ad854cd3aed820396ed8bd53', 'request_id': 'req-cdef361c-4ff8-41e9-bae6-77952107111e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.851010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] The token cache is being invalidate because project 1de3ee23ad854cd3aed820396ed8bd53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:10.851010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.851010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:10.858832 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1616/3193] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:10 2022] DELETE /identity/v3/projects/1de3ee23ad854cd3aed820396ed8bd53 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:10.863891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e1e83-8b67-4f59-a447-eb3fdee7cd40 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:10.875424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e1e83-8b67-4f59-a447-eb3fdee7cd40 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:10.998097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:10.999063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:10.999416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:10.999903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] PATH_INFO: `/v3/users/c0c91597b44944b8907105600638a6e3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:11.007712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0c91597b44944b8907105600638a6e3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:11.012675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:11.105623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0c91597b44944b8907105600638a6e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.124170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0c91597b44944b8907105600638a6e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.124956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0c91597b44944b8907105600638a6e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.125680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0c91597b44944b8907105600638a6e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.141552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0c91597b44944b8907105600638a6e3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.159295 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1578/3194] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:10 2022] DELETE /identity/v3/users/c0c91597b44944b8907105600638a6e3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:11.536687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:11.539379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:11.568117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef361c-4ff8-41e9-bae6-77952107111e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:11.691132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:11.692364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:11.692840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:11.693277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] PATH_INFO: `/v3/projects/6bc06c9265914d5d9a2bcfb444000b58` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:11.700847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc06c9265914d5d9a2bcfb444000b58)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:11.704531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:11.705776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:11.707523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:11.736650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cd685-4633-4620-be2a-30a9b5643ec2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:11.742952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:11.745042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:11.745779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:11.746183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] PATH_INFO: `/v3/users/e9e5b428b7b341a5a253addfd9493158` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:11.747754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e5b428b7b341a5a253addfd9493158)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:11.750728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:11.774981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc06c9265914d5d9a2bcfb444000b58', 'request_id': 'req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.785705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc06c9265914d5d9a2bcfb444000b58', 'request_id': 'req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.796191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc06c9265914d5d9a2bcfb444000b58', 'request_id': 'req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.809102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] The token cache is being invalidate because project 6bc06c9265914d5d9a2bcfb444000b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:11.809392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.810078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d823ea4-f90c-4028-a7a2-8e0f5da48c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.815673 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1617/3195] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:11 2022] DELETE /identity/v3/projects/6bc06c9265914d5d9a2bcfb444000b58 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:11.817368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f68d4-14ca-4be2-86ab-cc6c56f8b1b1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:11.817660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f68d4-14ca-4be2-86ab-cc6c56f8b1b1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:11.817942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f68d4-14ca-4be2-86ab-cc6c56f8b1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:11.825568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e5b428b7b341a5a253addfd9493158'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.837818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e5b428b7b341a5a253addfd9493158'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.838862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e5b428b7b341a5a253addfd9493158'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.839683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e5b428b7b341a5a253addfd9493158'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.841051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-129f68d4-14ca-4be2-86ab-cc6c56f8b1b1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:11.842360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-129f68d4-14ca-4be2-86ab-cc6c56f8b1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:11.854364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e519220-1f18-4052-b557-c8e0814ac71f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e5b428b7b341a5a253addfd9493158'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:11.874099 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1579/3196] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:11 2022] DELETE /identity/v3/users/e9e5b428b7b341a5a253addfd9493158 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:11.912550 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1618/3197] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:11.920764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09e0f0-d36b-417f-9dc5-7c9b1a85b301 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:11.921709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09e0f0-d36b-417f-9dc5-7c9b1a85b301 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:11.922190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09e0f0-d36b-417f-9dc5-7c9b1a85b301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:11.950187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9a09e0f0-d36b-417f-9dc5-7c9b1a85b301 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:11.951471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9a09e0f0-d36b-417f-9dc5-7c9b1a85b301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:12.030983 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1580/3198] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:55:12.034914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f68d4-14ca-4be2-86ab-cc6c56f8b1b1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.046156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f68d4-14ca-4be2-86ab-cc6c56f8b1b1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.055452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.057173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.057696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.057972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.058704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:55:12.059015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.060975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.085118 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1619/3199] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:55:12.086464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09e0f0-d36b-417f-9dc5-7c9b1a85b301 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.100872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09e0f0-d36b-417f-9dc5-7c9b1a85b301 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.112079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00af7c-4dc2-4c44-96b7-c30873156f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.113125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00af7c-4dc2-4c44-96b7-c30873156f13 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.113411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00af7c-4dc2-4c44-96b7-c30873156f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.113689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00af7c-4dc2-4c44-96b7-c30873156f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.114432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00af7c-4dc2-4c44-96b7-c30873156f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.116568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00af7c-4dc2-4c44-96b7-c30873156f13 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.157824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.160804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:12.175703 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1581/3200] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:12 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:12.179776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00af7c-4dc2-4c44-96b7-c30873156f13 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.193546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea21c6b-9b3d-4943-a8e0-b5f8e645be1a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.318330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.341984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.342154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.342489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] PATH_INFO: `/v3/projects/032c3519ef0d4b99891f8fe4e48a2fb8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.348221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] RBAC: Authorizing `identity:delete_project(project_id=032c3519ef0d4b99891f8fe4e48a2fb8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.350350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00af7c-4dc2-4c44-96b7-c30873156f13 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.352690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.358012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8e923-d096-42cb-8d6a-e95622420e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.358843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8e923-d096-42cb-8d6a-e95622420e87 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.358982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8e923-d096-42cb-8d6a-e95622420e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.362399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8e923-d096-42cb-8d6a-e95622420e87 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.362399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8e923-d096-42cb-8d6a-e95622420e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.362399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8e923-d096-42cb-8d6a-e95622420e87 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.388136 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1582/3201] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:12 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:55:12.392304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8e923-d096-42cb-8d6a-e95622420e87 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.402879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8e923-d096-42cb-8d6a-e95622420e87 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.408429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe67053-786c-42e7-aa1e-483367893dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.409093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67053-786c-42e7-aa1e-483367893dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.409401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67053-786c-42e7-aa1e-483367893dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.410770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe67053-786c-42e7-aa1e-483367893dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.412254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe67053-786c-42e7-aa1e-483367893dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.420275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe67053-786c-42e7-aa1e-483367893dd9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.442682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032c3519ef0d4b99891f8fe4e48a2fb8', 'request_id': 'req-9232f1d2-fe45-43fa-86ef-22bbbec07add'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:12.455105 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1583/3202] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:12.456326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe67053-786c-42e7-aa1e-483367893dd9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.459163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032c3519ef0d4b99891f8fe4e48a2fb8', 'request_id': 'req-9232f1d2-fe45-43fa-86ef-22bbbec07add'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:12.471133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032c3519ef0d4b99891f8fe4e48a2fb8', 'request_id': 'req-9232f1d2-fe45-43fa-86ef-22bbbec07add'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:12.477019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe67053-786c-42e7-aa1e-483367893dd9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.502433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] The token cache is being invalidate because project 032c3519ef0d4b99891f8fe4e48a2fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:12.502729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:12.503771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9232f1d2-fe45-43fa-86ef-22bbbec07add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:12.518222 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1620/3203] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:12 2022] DELETE /identity/v3/projects/032c3519ef0d4b99891f8fe4e48a2fb8 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:12.519782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b05c4-0cbe-470f-aca5-e12861a52081 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.520109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b05c4-0cbe-470f-aca5-e12861a52081 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.520394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b05c4-0cbe-470f-aca5-e12861a52081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.557357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85014-93fc-49b2-a452-22edeb65d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.558348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85014-93fc-49b2-a452-22edeb65d64e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.558627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85014-93fc-49b2-a452-22edeb65d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.558898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef85014-93fc-49b2-a452-22edeb65d64e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.559619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85014-93fc-49b2-a452-22edeb65d64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.561287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef85014-93fc-49b2-a452-22edeb65d64e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.567508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ef5b05c4-0cbe-470f-aca5-e12861a52081 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:12.568995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ef5b05c4-0cbe-470f-aca5-e12861a52081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:12.574213 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1584/3204] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:12.578638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85014-93fc-49b2-a452-22edeb65d64e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.584804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fef85014-93fc-49b2-a452-22edeb65d64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:12.601139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef85014-93fc-49b2-a452-22edeb65d64e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.606537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdf63b-06ed-4fd6-a3d7-744e35fc3d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.607431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdf63b-06ed-4fd6-a3d7-744e35fc3d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.608089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdf63b-06ed-4fd6-a3d7-744e35fc3d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.608863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdf63b-06ed-4fd6-a3d7-744e35fc3d81 admin admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181/users/80c37dca7eb34ef096e6d9093ad313b9/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.610982 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1621/3205] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:12.612831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead678b-b223-4ebf-a1a7-ec57294b48c1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.613337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead678b-b223-4ebf-a1a7-ec57294b48c1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.613949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead678b-b223-4ebf-a1a7-ec57294b48c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.644404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdf63b-06ed-4fd6-a3d7-744e35fc3d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc0a8152d814a5590cbc9be7c230181, user_id=80c37dca7eb34ef096e6d9093ad313b9, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.647346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdf63b-06ed-4fd6-a3d7-744e35fc3d81 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.653402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5ead678b-b223-4ebf-a1a7-ec57294b48c1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:12.654630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5ead678b-b223-4ebf-a1a7-ec57294b48c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:12.673311 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1585/3206] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:12 2022] PUT /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181/users/80c37dca7eb34ef096e6d9093ad313b9/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:55:12.684242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722ce3-a603-4a52-b657-2fdaeaae0692 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.684803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722ce3-a603-4a52-b657-2fdaeaae0692 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.685165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea722ce3-a603-4a52-b657-2fdaeaae0692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.787494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ea722ce3-a603-4a52-b657-2fdaeaae0692 None None] MFA Rules not processed for user `80c37dca7eb34ef096e6d9093ad313b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:12.793868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ea722ce3-a603-4a52-b657-2fdaeaae0692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:12.802050 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1622/3207] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:12.803909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead678b-b223-4ebf-a1a7-ec57294b48c1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.822905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead678b-b223-4ebf-a1a7-ec57294b48c1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.840848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c53e40-ded8-41bd-8422-8e2ee6d52e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.841523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c53e40-ded8-41bd-8422-8e2ee6d52e0e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.841802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c53e40-ded8-41bd-8422-8e2ee6d52e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.842075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c53e40-ded8-41bd-8422-8e2ee6d52e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.842878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c53e40-ded8-41bd-8422-8e2ee6d52e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:55:12.843187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c53e40-ded8-41bd-8422-8e2ee6d52e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.844953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c53e40-ded8-41bd-8422-8e2ee6d52e0e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.889752 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1623/3208] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:55:12.891068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c53e40-ded8-41bd-8422-8e2ee6d52e0e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.917643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c53e40-ded8-41bd-8422-8e2ee6d52e0e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.923953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c5a1-a964-472d-9523-dd923c08c04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.925021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c5a1-a964-472d-9523-dd923c08c04d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.925394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c5a1-a964-472d-9523-dd923c08c04d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.925766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959c5a1-a964-472d-9523-dd923c08c04d admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.926556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959c5a1-a964-472d-9523-dd923c08c04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.929062 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1586/3209] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:12.929240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959c5a1-a964-472d-9523-dd923c08c04d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.930024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea722ce3-a603-4a52-b657-2fdaeaae0692 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:12.954838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea722ce3-a603-4a52-b657-2fdaeaae0692 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:12.968864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cce65-9ff1-4733-b79c-d10a50505205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:12.969751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cce65-9ff1-4733-b79c-d10a50505205 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:12.970210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cce65-9ff1-4733-b79c-d10a50505205 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:12.970663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452cce65-9ff1-4733-b79c-d10a50505205 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:12.972365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cce65-9ff1-4733-b79c-d10a50505205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:12.985778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452cce65-9ff1-4733-b79c-d10a50505205 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:12.998596 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1624/3210] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:12 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:13.002748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c5a1-a964-472d-9523-dd923c08c04d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.083030 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1587/3211] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:12 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:13.089353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cce65-9ff1-4733-b79c-d10a50505205 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.132160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959c5a1-a964-472d-9523-dd923c08c04d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:13.214369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee980-bd4e-4aa0-895a-d9c6321ef5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:13.215384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee980-bd4e-4aa0-895a-d9c6321ef5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.215905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee980-bd4e-4aa0-895a-d9c6321ef5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.216483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee980-bd4e-4aa0-895a-d9c6321ef5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.217516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacee980-bd4e-4aa0-895a-d9c6321ef5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:13.219745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacee980-bd4e-4aa0-895a-d9c6321ef5b6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:13.250953 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1625/3212] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:13 2022] POST /identity/v3/users => generated 296 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:55:13.255582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee980-bd4e-4aa0-895a-d9c6321ef5b6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.270175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee980-bd4e-4aa0-895a-d9c6321ef5b6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:13.277074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a33ee6-0d02-4a2b-8ff5-76462b5b88d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:13.277934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a33ee6-0d02-4a2b-8ff5-76462b5b88d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.278323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a33ee6-0d02-4a2b-8ff5-76462b5b88d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.278744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a33ee6-0d02-4a2b-8ff5-76462b5b88d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.279650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a33ee6-0d02-4a2b-8ff5-76462b5b88d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:13.281941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a33ee6-0d02-4a2b-8ff5-76462b5b88d6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:13.296238 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1626/3213] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:55:13.301874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a33ee6-0d02-4a2b-8ff5-76462b5b88d6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.333286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452cce65-9ff1-4733-b79c-d10a50505205 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:13.342018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a33ee6-0d02-4a2b-8ff5-76462b5b88d6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:13.349946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ba848-ba43-49dc-9911-fc1dfa89f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:13.355376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02ecc-b7e0-4574-9bf5-5819f3986510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:13.356197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02ecc-b7e0-4574-9bf5-5819f3986510 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.356633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02ecc-b7e0-4574-9bf5-5819f3986510 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.357013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02ecc-b7e0-4574-9bf5-5819f3986510 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.357743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ba848-ba43-49dc-9911-fc1dfa89f7b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.358403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ba848-ba43-49dc-9911-fc1dfa89f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.358403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ba848-ba43-49dc-9911-fc1dfa89f7b5 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.358656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af02ecc-b7e0-4574-9bf5-5819f3986510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:13.359023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ba848-ba43-49dc-9911-fc1dfa89f7b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:13.363206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af02ecc-b7e0-4574-9bf5-5819f3986510 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:13.364728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ba848-ba43-49dc-9911-fc1dfa89f7b5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:13.391871 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1627/3214] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:13.394839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02ecc-b7e0-4574-9bf5-5819f3986510 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.418745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02ecc-b7e0-4574-9bf5-5819f3986510 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:13.429152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1588/3215] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:13 2022] POST /identity/v3/users => generated 298 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:13.430319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845778a-0033-451c-8bcb-493562640295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:13.432489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845778a-0033-451c-8bcb-493562640295 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.432778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ba848-ba43-49dc-9911-fc1dfa89f7b5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.439225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845778a-0033-451c-8bcb-493562640295 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.439225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845778a-0033-451c-8bcb-493562640295 admin admin] PATH_INFO: `/v3/projects/6fee503421884a52b75aae2ae940aad0/users/c8d2e97047c1481eb9916e203d2d8cba/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.459232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ba848-ba43-49dc-9911-fc1dfa89f7b5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:13.471753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfade9-9b59-4ddb-8eea-02a58f63d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:13.472663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfade9-9b59-4ddb-8eea-02a58f63d718 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.473072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfade9-9b59-4ddb-8eea-02a58f63d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.473488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfade9-9b59-4ddb-8eea-02a58f63d718 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.474390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfade9-9b59-4ddb-8eea-02a58f63d718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:13.474787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845778a-0033-451c-8bcb-493562640295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fee503421884a52b75aae2ae940aad0, user_id=c8d2e97047c1481eb9916e203d2d8cba, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:13.478580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfade9-9b59-4ddb-8eea-02a58f63d718 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:13.482347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6845778a-0033-451c-8bcb-493562640295 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:13.518059 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1628/3216] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:13 2022] PUT /identity/v3/projects/6fee503421884a52b75aae2ae940aad0/users/c8d2e97047c1481eb9916e203d2d8cba/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:13.518272 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1589/3217] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:13.518415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845778a-0033-451c-8bcb-493562640295 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.523206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17610db-4624-4a10-bbab-9ab04bff0805 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.523748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17610db-4624-4a10-bbab-9ab04bff0805 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.524284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17610db-4624-4a10-bbab-9ab04bff0805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.567044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d17610db-4624-4a10-bbab-9ab04bff0805 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:13.573362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d17610db-4624-4a10-bbab-9ab04bff0805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:13.687628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845778a-0033-451c-8bcb-493562640295 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:13.699093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cce4c-b900-4291-ada5-ad8a2323ef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:13.700189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cce4c-b900-4291-ada5-ad8a2323ef40 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.700661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cce4c-b900-4291-ada5-ad8a2323ef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.700780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485cce4c-b900-4291-ada5-ad8a2323ef40 admin admin] PATH_INFO: `/v3/projects/ce1dfe90fc3d4894aa892032cba5c317/users/425d5678358a4f63bf585612162b4003/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.719702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cce4c-b900-4291-ada5-ad8a2323ef40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1dfe90fc3d4894aa892032cba5c317, user_id=425d5678358a4f63bf585612162b4003, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:13.720688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1590/3218] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:13.723906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d259e1-3c54-46d8-bbbd-8b3772210991 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.723906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d259e1-3c54-46d8-bbbd-8b3772210991 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.723906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d259e1-3c54-46d8-bbbd-8b3772210991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.724193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485cce4c-b900-4291-ada5-ad8a2323ef40 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:13.749752 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1629/3219] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:13 2022] PUT /identity/v3/projects/ce1dfe90fc3d4894aa892032cba5c317/users/425d5678358a4f63bf585612162b4003/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:13.754564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cce4c-b900-4291-ada5-ad8a2323ef40 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.775407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f7d259e1-3c54-46d8-bbbd-8b3772210991 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:13.778838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f7d259e1-3c54-46d8-bbbd-8b3772210991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:13.922714 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1591/3220] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:55:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:13.923637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d259e1-3c54-46d8-bbbd-8b3772210991 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.926186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f7d259e1-3c54-46d8-bbbd-8b3772210991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:13.944617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485cce4c-b900-4291-ada5-ad8a2323ef40 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:13.956348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e9862-2709-438c-9a18-4af04a018e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:13.957199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9862-2709-438c-9a18-4af04a018e1a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:13.957578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9862-2709-438c-9a18-4af04a018e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:13.958350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e9862-2709-438c-9a18-4af04a018e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:13.960330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e9862-2709-438c-9a18-4af04a018e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:13.965537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e9862-2709-438c-9a18-4af04a018e1a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:13.988666 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1630/3221] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:13.988666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e9862-2709-438c-9a18-4af04a018e1a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:13.991790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8a3e9862-2709-438c-9a18-4af04a018e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:14.063694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d259e1-3c54-46d8-bbbd-8b3772210991 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:14.069368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d0487-e31f-4a1a-87e1-06d65359c7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:14.070424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d0487-e31f-4a1a-87e1-06d65359c7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:14.070549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d0487-e31f-4a1a-87e1-06d65359c7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:14.070731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d0487-e31f-4a1a-87e1-06d65359c7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:14.091000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d0487-e31f-4a1a-87e1-06d65359c7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:14.098044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d0487-e31f-4a1a-87e1-06d65359c7f6 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:14.119669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e9862-2709-438c-9a18-4af04a018e1a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:14.121830 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1592/3222] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:14.122717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d0487-e31f-4a1a-87e1-06d65359c7f6 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:14.126927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feffb7c8-010a-4615-aab3-d1ee28d74238 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:14.128445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb7c8-010a-4615-aab3-d1ee28d74238 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:14.129113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb7c8-010a-4615-aab3-d1ee28d74238 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:14.129853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feffb7c8-010a-4615-aab3-d1ee28d74238 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:14.141189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d0487-e31f-4a1a-87e1-06d65359c7f6 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:14.142470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffb7c8-010a-4615-aab3-d1ee28d74238 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:14.144486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feffb7c8-010a-4615-aab3-d1ee28d74238 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:14.158378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112be6e9-ecb1-411d-9cc5-966d72731ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:14.159368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112be6e9-ecb1-411d-9cc5-966d72731ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:14.159657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112be6e9-ecb1-411d-9cc5-966d72731ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:14.160032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112be6e9-ecb1-411d-9cc5-966d72731ef9 admin admin] PATH_INFO: `/v3/projects/ce1dfe90fc3d4894aa892032cba5c317/users/425d5678358a4f63bf585612162b4003/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:14.164759 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1631/3223] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:14.164983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112be6e9-ecb1-411d-9cc5-966d72731ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1dfe90fc3d4894aa892032cba5c317, user_id=425d5678358a4f63bf585612162b4003, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:14.167553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112be6e9-ecb1-411d-9cc5-966d72731ef9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:14.193840 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1593/3224] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:14 2022] PUT /identity/v3/projects/ce1dfe90fc3d4894aa892032cba5c317/users/425d5678358a4f63bf585612162b4003/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:14.204545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caf5a9-f93d-42dc-8efc-add0ddad8cf7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:14.205086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caf5a9-f93d-42dc-8efc-add0ddad8cf7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:14.205632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87caf5a9-f93d-42dc-8efc-add0ddad8cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:14.287382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-87caf5a9-f93d-42dc-8efc-add0ddad8cf7 None None] MFA Rules not processed for user `425d5678358a4f63bf585612162b4003`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:14.292715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-87caf5a9-f93d-42dc-8efc-add0ddad8cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:14.464873 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1632/3225] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:14.804655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112be6e9-ecb1-411d-9cc5-966d72731ef9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:14.806419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-112be6e9-ecb1-411d-9cc5-966d72731ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:14.982672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112be6e9-ecb1-411d-9cc5-966d72731ef9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:14.994479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebb83f-935d-4bf1-a3c4-4d900826a7e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:14.995154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebb83f-935d-4bf1-a3c4-4d900826a7e0 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:14.996171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebb83f-935d-4bf1-a3c4-4d900826a7e0 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:14.996452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ebb83f-935d-4bf1-a3c4-4d900826a7e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:15.014067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebb83f-935d-4bf1-a3c4-4d900826a7e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:15.015956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ebb83f-935d-4bf1-a3c4-4d900826a7e0 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:15.039700 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1594/3226] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:15.045762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce98f-c5f0-4b4c-8c42-8befb33f97d9 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:15.046272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce98f-c5f0-4b4c-8c42-8befb33f97d9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:15.046400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ce98f-c5f0-4b4c-8c42-8befb33f97d9 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:15.048684 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1633/3227] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:55:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:55:15.061084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebb83f-935d-4bf1-a3c4-4d900826a7e0 service nova] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:55:15.078964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebb83f-935d-4bf1-a3c4-4d900826a7e0 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:15.092306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ebb83f-935d-4bf1-a3c4-4d900826a7e0 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:15.112344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95e99a-0729-449b-9e87-7e7f9c0b62a7 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425d5678358a4f63bf585612162b4003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1dfe90fc3d4894aa892032cba5c317', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:15.113613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95e99a-0729-449b-9e87-7e7f9c0b62a7 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:15.114133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95e99a-0729-449b-9e87-7e7f9c0b62a7 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:15.114610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95e99a-0729-449b-9e87-7e7f9c0b62a7 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:15.115872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95e99a-0729-449b-9e87-7e7f9c0b62a7 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorizing `identity:get_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:15.121570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95e99a-0729-449b-9e87-7e7f9c0b62a7 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:15.127836 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1595/3228] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:55:15 2022] GET /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 383 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:15.877909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4baf1-e59b-4916-be22-3928216ec42a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:15.878336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4baf1-e59b-4916-be22-3928216ec42a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:15.878622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd4baf1-e59b-4916-be22-3928216ec42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:15.934757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3dd4baf1-e59b-4916-be22-3928216ec42a None None] MFA Rules not processed for user `c8d2e97047c1481eb9916e203d2d8cba`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:15.936022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3dd4baf1-e59b-4916-be22-3928216ec42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:16.028331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306281ce-60be-4989-ab13-30b39eb8586c None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:16.028627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306281ce-60be-4989-ab13-30b39eb8586c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:16.028912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306281ce-60be-4989-ab13-30b39eb8586c None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:16.031027 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1596/3229] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:55:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:55:16.041824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306281ce-60be-4989-ab13-30b39eb8586c None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:55:16.055709 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1634/3230] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:16.058640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405840-3015-4df4-87b7-27a758f14ba1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:16.059037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405840-3015-4df4-87b7-27a758f14ba1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:16.059415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405840-3015-4df4-87b7-27a758f14ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:16.075340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306281ce-60be-4989-ab13-30b39eb8586c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:16.093270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-08405840-3015-4df4-87b7-27a758f14ba1 None None] MFA Rules not processed for user `c8d2e97047c1481eb9916e203d2d8cba`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:16.094762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-08405840-3015-4df4-87b7-27a758f14ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:16.101003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306281ce-60be-4989-ab13-30b39eb8586c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:16.106295 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1635/3231] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:16.116488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bcfc0-0340-4708-983d-e0535e64dd98 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425d5678358a4f63bf585612162b4003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1dfe90fc3d4894aa892032cba5c317', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:16.117776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bcfc0-0340-4708-983d-e0535e64dd98 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:16.118319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bcfc0-0340-4708-983d-e0535e64dd98 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:16.118894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bcfc0-0340-4708-983d-e0535e64dd98 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:16.120385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bcfc0-0340-4708-983d-e0535e64dd98 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorizing `identity:get_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:16.122967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bcfc0-0340-4708-983d-e0535e64dd98 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:16.125358 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1597/3232] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:55:16 2022] GET /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 383 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:55:16.287697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae6003-0744-48f4-96bd-a1f86db22138 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:16.288008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae6003-0744-48f4-96bd-a1f86db22138 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:16.288292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae6003-0744-48f4-96bd-a1f86db22138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:16.318602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2eae6003-0744-48f4-96bd-a1f86db22138 None None] MFA Rules not processed for user `80c37dca7eb34ef096e6d9093ad313b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:16.319793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2eae6003-0744-48f4-96bd-a1f86db22138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:16.369218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bcfc0-0340-4708-983d-e0535e64dd98 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:16.396687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bcfc0-0340-4708-983d-e0535e64dd98 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:16.408969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80612cbf-1cc0-42af-b780-f13ccc9dc931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:16.410144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612cbf-1cc0-42af-b780-f13ccc9dc931 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:16.410434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612cbf-1cc0-42af-b780-f13ccc9dc931 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:16.410718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612cbf-1cc0-42af-b780-f13ccc9dc931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:16.433659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80612cbf-1cc0-42af-b780-f13ccc9dc931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:16.435563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80612cbf-1cc0-42af-b780-f13ccc9dc931 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:16.457637 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1598/3233] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:16.466654 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1636/3234] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:17.479174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80612cbf-1cc0-42af-b780-f13ccc9dc931 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:17.481302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-80612cbf-1cc0-42af-b780-f13ccc9dc931 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:17.578995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80612cbf-1cc0-42af-b780-f13ccc9dc931 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:17.584573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:17.586019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:17.586562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:17.587056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] PATH_INFO: `/v3/users/d6067a3bcd1e4ccb808323697704fea2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:17.591482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6067a3bcd1e4ccb808323697704fea2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:17.594227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:17.679946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6067a3bcd1e4ccb808323697704fea2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:17.688611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6067a3bcd1e4ccb808323697704fea2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:17.689318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6067a3bcd1e4ccb808323697704fea2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:17.690808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6067a3bcd1e4ccb808323697704fea2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:17.715164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f3e9217-0174-4c5e-bafe-1b58f7368abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6067a3bcd1e4ccb808323697704fea2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:17.731655 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1599/3235] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:17 2022] DELETE /identity/v3/users/d6067a3bcd1e4ccb808323697704fea2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:18.028024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae6003-0744-48f4-96bd-a1f86db22138 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:18.053098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae6003-0744-48f4-96bd-a1f86db22138 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:18.207464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:18.209055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:18.209629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:18.210852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] PATH_INFO: `/v3/projects/c1854d29eeb64bb4b5851d72ac8dddab` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:18.212980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1854d29eeb64bb4b5851d72ac8dddab)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:18.215230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:18.277498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1854d29eeb64bb4b5851d72ac8dddab', 'request_id': 'req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:18.291193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1854d29eeb64bb4b5851d72ac8dddab', 'request_id': 'req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:18.298731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1854d29eeb64bb4b5851d72ac8dddab', 'request_id': 'req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:18.313456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] The token cache is being invalidate because project c1854d29eeb64bb4b5851d72ac8dddab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:18.314303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:18.315185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5a5383c8-38dc-4a5a-9a72-3bf2ceb64d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:18.320980 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1637/3236] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:18 2022] DELETE /identity/v3/projects/c1854d29eeb64bb4b5851d72ac8dddab => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:18.322506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e45ad-9c3e-4c60-a9cc-9b334a87fa24 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:18.323047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e45ad-9c3e-4c60-a9cc-9b334a87fa24 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:18.323331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e45ad-9c3e-4c60-a9cc-9b334a87fa24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:18.363547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-596e45ad-9c3e-4c60-a9cc-9b334a87fa24 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:18.364796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-596e45ad-9c3e-4c60-a9cc-9b334a87fa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:18.492888 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1600/3237] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:18.495965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d566b73-c3f3-4cd2-a2c4-31d6251fffef None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:18.497234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d566b73-c3f3-4cd2-a2c4-31d6251fffef None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:18.497514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d566b73-c3f3-4cd2-a2c4-31d6251fffef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:18.529655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7d566b73-c3f3-4cd2-a2c4-31d6251fffef None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:18.533814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7d566b73-c3f3-4cd2-a2c4-31d6251fffef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:18.547488 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1638/3238] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:18.551803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e45ad-9c3e-4c60-a9cc-9b334a87fa24 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:18.564177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e45ad-9c3e-4c60-a9cc-9b334a87fa24 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:18.569752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606fbc8-a7dd-46af-a63f-220ab791f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:18.570529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606fbc8-a7dd-46af-a63f-220ab791f8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:18.570890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606fbc8-a7dd-46af-a63f-220ab791f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:18.572467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606fbc8-a7dd-46af-a63f-220ab791f8d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:18.573634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606fbc8-a7dd-46af-a63f-220ab791f8d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:55:18.574018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606fbc8-a7dd-46af-a63f-220ab791f8d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:18.576210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2606fbc8-a7dd-46af-a63f-220ab791f8d3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:18.596028 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1601/3239] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:18.597545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d566b73-c3f3-4cd2-a2c4-31d6251fffef None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:18.619164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d566b73-c3f3-4cd2-a2c4-31d6251fffef None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:18.629353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d7f7d-833f-449a-93e1-5594e8b007a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:18.630948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d7f7d-833f-449a-93e1-5594e8b007a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:18.631549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d7f7d-833f-449a-93e1-5594e8b007a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:18.632162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d7f7d-833f-449a-93e1-5594e8b007a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:18.633570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d7f7d-833f-449a-93e1-5594e8b007a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:18.640876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d7f7d-833f-449a-93e1-5594e8b007a2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:18.691950 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1639/3240] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:18 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:18.696245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606fbc8-a7dd-46af-a63f-220ab791f8d3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:18.760033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2606fbc8-a7dd-46af-a63f-220ab791f8d3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:18.817474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f8d0-664e-4e9a-bb75-545991cd83d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:18.824111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f8d0-664e-4e9a-bb75-545991cd83d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:18.824522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f8d0-664e-4e9a-bb75-545991cd83d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:18.824827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f8d0-664e-4e9a-bb75-545991cd83d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:18.825607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641f8d0-664e-4e9a-bb75-545991cd83d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:18.827789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641f8d0-664e-4e9a-bb75-545991cd83d8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:18.855490 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1602/3241] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:18 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:18.859281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d7f7d-833f-449a-93e1-5594e8b007a2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:18.877594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d7f7d-833f-449a-93e1-5594e8b007a2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:18.904745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdaf0b-45de-4573-8c6c-c6ec4cf6241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:18.905460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdaf0b-45de-4573-8c6c-c6ec4cf6241c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:18.905788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdaf0b-45de-4573-8c6c-c6ec4cf6241c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:18.906077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdaf0b-45de-4573-8c6c-c6ec4cf6241c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:18.906798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdaf0b-45de-4573-8c6c-c6ec4cf6241c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:18.908699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdaf0b-45de-4573-8c6c-c6ec4cf6241c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:18.926782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f8d0-664e-4e9a-bb75-545991cd83d8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:18.939675 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1640/3242] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:18.958367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f8d0-664e-4e9a-bb75-545991cd83d8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:18.963280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c70fed-c98d-452f-abf8-6b98d4ef61f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:18.963997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70fed-c98d-452f-abf8-6b98d4ef61f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:18.964262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70fed-c98d-452f-abf8-6b98d4ef61f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:18.964536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70fed-c98d-452f-abf8-6b98d4ef61f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:18.965259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c70fed-c98d-452f-abf8-6b98d4ef61f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:18.966865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c70fed-c98d-452f-abf8-6b98d4ef61f4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:18.993990 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1603/3243] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:55:18.996045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdaf0b-45de-4573-8c6c-c6ec4cf6241c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:19.016255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdaf0b-45de-4573-8c6c-c6ec4cf6241c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:19.020815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639733b0-bc12-4135-b678-80d0b04696f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:19.021689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639733b0-bc12-4135-b678-80d0b04696f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:19.021969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639733b0-bc12-4135-b678-80d0b04696f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:19.022247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639733b0-bc12-4135-b678-80d0b04696f4 admin admin] PATH_INFO: `/v3/projects/4dadd4e8f76f462b9f22b4211c7d5d47/users/c748958cc2c64a5c9f7af16cae37c969/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:19.059770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639733b0-bc12-4135-b678-80d0b04696f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dadd4e8f76f462b9f22b4211c7d5d47, user_id=c748958cc2c64a5c9f7af16cae37c969, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:19.063214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639733b0-bc12-4135-b678-80d0b04696f4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:19.092889 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1641/3244] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:18 2022] PUT /identity/v3/projects/4dadd4e8f76f462b9f22b4211c7d5d47/users/c748958cc2c64a5c9f7af16cae37c969/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:55:19.095051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d4ca4-20de-4185-901c-8ab3001acbf2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:19.095378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d4ca4-20de-4185-901c-8ab3001acbf2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:19.095664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d4ca4-20de-4185-901c-8ab3001acbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:19.129023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-904d4ca4-20de-4185-901c-8ab3001acbf2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:19.130244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-904d4ca4-20de-4185-901c-8ab3001acbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:19.251054 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1604/3245] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:19.260445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639733b0-bc12-4135-b678-80d0b04696f4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:19.262218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-639733b0-bc12-4135-b678-80d0b04696f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:19.356883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639733b0-bc12-4135-b678-80d0b04696f4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:19.361163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a8c99-39e9-4a07-bb4a-a145e1dbd1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:19.361859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a8c99-39e9-4a07-bb4a-a145e1dbd1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:19.362203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a8c99-39e9-4a07-bb4a-a145e1dbd1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:19.362543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a8c99-39e9-4a07-bb4a-a145e1dbd1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:19.377706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a8c99-39e9-4a07-bb4a-a145e1dbd1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:19.379422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a8c99-39e9-4a07-bb4a-a145e1dbd1c0 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:19.395006 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1642/3246] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:20.379213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d7fe5-b172-40a3-8c7f-ed9482a86f43 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:20.379821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d7fe5-b172-40a3-8c7f-ed9482a86f43 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:20.379821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d7fe5-b172-40a3-8c7f-ed9482a86f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:20.431983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ba6d7fe5-b172-40a3-8c7f-ed9482a86f43 None None] MFA Rules not processed for user `c748958cc2c64a5c9f7af16cae37c969`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:20.433266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba6d7fe5-b172-40a3-8c7f-ed9482a86f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:20.578427 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1605/3247] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:22.273760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a8c99-39e9-4a07-bb4a-a145e1dbd1c0 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:22.275706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-733a8c99-39e9-4a07-bb4a-a145e1dbd1c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:22.374811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a8c99-39e9-4a07-bb4a-a145e1dbd1c0 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:22.382354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c155a-b8e3-4c6f-a8ad-bed89a804e47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:22.382997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c155a-b8e3-4c6f-a8ad-bed89a804e47 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:22.383337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c155a-b8e3-4c6f-a8ad-bed89a804e47 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:22.383618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c155a-b8e3-4c6f-a8ad-bed89a804e47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:22.385506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-803c155a-b8e3-4c6f-a8ad-bed89a804e47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:22.455370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c155a-b8e3-4c6f-a8ad-bed89a804e47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:22.457192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c155a-b8e3-4c6f-a8ad-bed89a804e47 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:22.468648 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1643/3248] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:22.967976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d7fe5-b172-40a3-8c7f-ed9482a86f43 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:22.970557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba6d7fe5-b172-40a3-8c7f-ed9482a86f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:22.995795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d7fe5-b172-40a3-8c7f-ed9482a86f43 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:23.007178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c155a-b8e3-4c6f-a8ad-bed89a804e47 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:23.018728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f860c-63e6-432a-be1a-138b74929201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:23.019599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f860c-63e6-432a-be1a-138b74929201 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:23.019895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f860c-63e6-432a-be1a-138b74929201 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:23.020211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f860c-63e6-432a-be1a-138b74929201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:23.031475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c155a-b8e3-4c6f-a8ad-bed89a804e47 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:23.042363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f860c-63e6-432a-be1a-138b74929201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:23.044066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:23.044952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f860c-63e6-432a-be1a-138b74929201 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:23.045259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:23.045688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:23.046262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:23.048538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:23.058248 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1606/3249] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:23.171485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:23.173534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:23.218812 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1644/3250] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:55:23.493199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46391f-ab46-42ca-a2a4-b9d0b4e64bbd None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:23.494024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46391f-ab46-42ca-a2a4-b9d0b4e64bbd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:23.494309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af46391f-ab46-42ca-a2a4-b9d0b4e64bbd None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:23.496407 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1607/3251] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:55:23.501141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:55:23.521962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:23.525979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:23.662880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268ccf2-b804-4669-b1fe-a037f89aef5c service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:23.693803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d090-fb63-4ff2-a657-13fc84dc782b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425d5678358a4f63bf585612162b4003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1dfe90fc3d4894aa892032cba5c317', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:23.694607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d090-fb63-4ff2-a657-13fc84dc782b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:23.694892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d090-fb63-4ff2-a657-13fc84dc782b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:23.695168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415d090-fb63-4ff2-a657-13fc84dc782b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:23.702440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415d090-fb63-4ff2-a657-13fc84dc782b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorizing `identity:get_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:23.704903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415d090-fb63-4ff2-a657-13fc84dc782b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:23.706652 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1645/3252] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:55:23 2022] GET /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 383 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:23.934313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a36dd-97d2-4efd-8392-f73ad3299f5a None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:23.935083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a36dd-97d2-4efd-8392-f73ad3299f5a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:23.935581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a36dd-97d2-4efd-8392-f73ad3299f5a None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:23.937731 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1608/3253] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:55:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:55:23.957821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d090-fb63-4ff2-a657-13fc84dc782b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:55:23.992248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d090-fb63-4ff2-a657-13fc84dc782b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:24.034887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415d090-fb63-4ff2-a657-13fc84dc782b tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:24.040553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f5a57-c8a9-433a-b6f3-9a0192b2e836 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425d5678358a4f63bf585612162b4003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1dfe90fc3d4894aa892032cba5c317', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:24.041439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f5a57-c8a9-433a-b6f3-9a0192b2e836 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:24.041782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f5a57-c8a9-433a-b6f3-9a0192b2e836 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:24.042052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f5a57-c8a9-433a-b6f3-9a0192b2e836 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:24.044348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f5a57-c8a9-433a-b6f3-9a0192b2e836 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorizing `identity:get_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:24.049269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f5a57-c8a9-433a-b6f3-9a0192b2e836 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:24.052447 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1646/3254] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:55:23 2022] GET /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 383 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:24.318582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb25d-72b3-46ec-a237-2dcdfe9568f8 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:24.319456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb25d-72b3-46ec-a237-2dcdfe9568f8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:24.319946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb25d-72b3-46ec-a237-2dcdfe9568f8 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:24.323473 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1609/3255] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:55:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:55:24.329507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f5a57-c8a9-433a-b6f3-9a0192b2e836 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:55:24.345554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f5a57-c8a9-433a-b6f3-9a0192b2e836 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:24.370998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f5a57-c8a9-433a-b6f3-9a0192b2e836 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:24.391562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b71dca-4aff-4a5a-9ff8-0be570fc2dd5 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425d5678358a4f63bf585612162b4003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1dfe90fc3d4894aa892032cba5c317', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:24.392470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b71dca-4aff-4a5a-9ff8-0be570fc2dd5 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:24.392756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b71dca-4aff-4a5a-9ff8-0be570fc2dd5 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:24.393034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b71dca-4aff-4a5a-9ff8-0be570fc2dd5 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:24.394259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b71dca-4aff-4a5a-9ff8-0be570fc2dd5 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorizing `identity:get_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:24.396712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b71dca-4aff-4a5a-9ff8-0be570fc2dd5 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:24.402551 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1647/3256] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:55:24 2022] GET /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 383 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:24.541501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0b2f2-327e-4f02-98f3-fe644eb22e9d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:24.541789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0b2f2-327e-4f02-98f3-fe644eb22e9d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:24.542262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0b2f2-327e-4f02-98f3-fe644eb22e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:24.580592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-49f0b2f2-327e-4f02-98f3-fe644eb22e9d None None] MFA Rules not processed for user `80c37dca7eb34ef096e6d9093ad313b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:24.582129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49f0b2f2-327e-4f02-98f3-fe644eb22e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:24.599040 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1610/3257] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:25.846659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0684d-58d1-4687-823f-8a604eeed840 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:25.847166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0684d-58d1-4687-823f-8a604eeed840 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:25.847454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0684d-58d1-4687-823f-8a604eeed840 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:25.849775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1648/3258] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:55:25.855442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0b2f2-327e-4f02-98f3-fe644eb22e9d None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:55:25.870824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0b2f2-327e-4f02-98f3-fe644eb22e9d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:25.883183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0b2f2-327e-4f02-98f3-fe644eb22e9d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:25.891139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deb578-8c9e-46d4-aed1-d648a2602117 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425d5678358a4f63bf585612162b4003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1dfe90fc3d4894aa892032cba5c317', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:25.892789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deb578-8c9e-46d4-aed1-d648a2602117 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:25.893327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deb578-8c9e-46d4-aed1-d648a2602117 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:25.893855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56deb578-8c9e-46d4-aed1-d648a2602117 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:25.897125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56deb578-8c9e-46d4-aed1-d648a2602117 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorizing `identity:get_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:25.901128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56deb578-8c9e-46d4-aed1-d648a2602117 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:25.912900 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1611/3259] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:55:25 2022] GET /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 383 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:26.150433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b3fa-6c8a-444f-8e29-4743616e8367 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:26.151071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b3fa-6c8a-444f-8e29-4743616e8367 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:26.151418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07b3fa-6c8a-444f-8e29-4743616e8367 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:26.153410 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1649/3260] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:55:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:55:26.163702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deb578-8c9e-46d4-aed1-d648a2602117 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:55:26.190128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deb578-8c9e-46d4-aed1-d648a2602117 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:26.224802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56deb578-8c9e-46d4-aed1-d648a2602117 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:26.240054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76c8e8-92a3-4bc3-b5cb-c77c4d334073 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425d5678358a4f63bf585612162b4003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1dfe90fc3d4894aa892032cba5c317', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:26.243418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76c8e8-92a3-4bc3-b5cb-c77c4d334073 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:26.244821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76c8e8-92a3-4bc3-b5cb-c77c4d334073 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:26.245310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76c8e8-92a3-4bc3-b5cb-c77c4d334073 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:26.247081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76c8e8-92a3-4bc3-b5cb-c77c4d334073 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorizing `identity:get_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:26.250365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d76c8e8-92a3-4bc3-b5cb-c77c4d334073 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:26.254032 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1612/3261] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:55:26 2022] GET /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 383 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:55:26.385980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d8952-1f94-4a99-8162-be5339fdb12b None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:26.386579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d8952-1f94-4a99-8162-be5339fdb12b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:26.386866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d8952-1f94-4a99-8162-be5339fdb12b None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:26.388765 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1650/3262] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:55:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:55:26.394630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76c8e8-92a3-4bc3-b5cb-c77c4d334073 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:55:26.408028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76c8e8-92a3-4bc3-b5cb-c77c4d334073 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:26.419258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d76c8e8-92a3-4bc3-b5cb-c77c4d334073 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:26.424476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892eaf2b-c023-4d14-95d5-47b7ffc05666 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425d5678358a4f63bf585612162b4003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1dfe90fc3d4894aa892032cba5c317', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:26.425759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eaf2b-c023-4d14-95d5-47b7ffc05666 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:26.426300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eaf2b-c023-4d14-95d5-47b7ffc05666 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:26.426819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eaf2b-c023-4d14-95d5-47b7ffc05666 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:26.428285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eaf2b-c023-4d14-95d5-47b7ffc05666 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorizing `identity:get_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:26.430705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eaf2b-c023-4d14-95d5-47b7ffc05666 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:26.433378 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1613/3263] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:55:26 2022] GET /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 383 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:26.561156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ceaa-6ae3-41fa-9b6d-cf0ea14221a5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:26.561445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ceaa-6ae3-41fa-9b6d-cf0ea14221a5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:26.561723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ceaa-6ae3-41fa-9b6d-cf0ea14221a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:26.605041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2870ceaa-6ae3-41fa-9b6d-cf0ea14221a5 None None] MFA Rules not processed for user `80c37dca7eb34ef096e6d9093ad313b9`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:26.608354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2870ceaa-6ae3-41fa-9b6d-cf0ea14221a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:26.622870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4bbc4-23ab-4d78-8361-11cd7c9b32e4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:26.623411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4bbc4-23ab-4d78-8361-11cd7c9b32e4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:26.624126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e4bbc4-23ab-4d78-8361-11cd7c9b32e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:26.629597 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1651/3264] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:26.646467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-74e4bbc4-23ab-4d78-8361-11cd7c9b32e4 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:26.647896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-74e4bbc4-23ab-4d78-8361-11cd7c9b32e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:26.712530 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1614/3265] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:26.736031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ceaa-6ae3-41fa-9b6d-cf0ea14221a5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:26.737587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2870ceaa-6ae3-41fa-9b6d-cf0ea14221a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:26.867902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ceaa-6ae3-41fa-9b6d-cf0ea14221a5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:26.875606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dfaa2-7282-42c8-9172-f5284fe472e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:26.876692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dfaa2-7282-42c8-9172-f5284fe472e5 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:26.877193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dfaa2-7282-42c8-9172-f5284fe472e5 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:26.877821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dfaa2-7282-42c8-9172-f5284fe472e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:26.890321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dfaa2-7282-42c8-9172-f5284fe472e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:26.893329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dfaa2-7282-42c8-9172-f5284fe472e5 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:26.907808 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1652/3266] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:26.910748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91af53-20a8-4c31-8961-1e5189c1a13a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:26.911170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91af53-20a8-4c31-8961-1e5189c1a13a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:26.911381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c91af53-20a8-4c31-8961-1e5189c1a13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:26.936895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3c91af53-20a8-4c31-8961-1e5189c1a13a None None] MFA Rules not processed for user `57e806dbaedc49e395b7d6b374ca2fec`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:26.938157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3c91af53-20a8-4c31-8961-1e5189c1a13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:26.947249 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1615/3267] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:55:27.756993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9746a6-2c37-45e1-ad7d-f6071b125c6e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:27.757407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9746a6-2c37-45e1-ad7d-f6071b125c6e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:27.757913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9746a6-2c37-45e1-ad7d-f6071b125c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:27.777854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3c9746a6-2c37-45e1-ad7d-f6071b125c6e None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:27.779163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c9746a6-2c37-45e1-ad7d-f6071b125c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:27.787622 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1653/3268] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:55:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:27.801851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91af53-20a8-4c31-8961-1e5189c1a13a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:27.817860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c91af53-20a8-4c31-8961-1e5189c1a13a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:27.823643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d03f52-45b0-4986-906e-f2fe9e2d1c20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:27.824442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d03f52-45b0-4986-906e-f2fe9e2d1c20 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:27.824797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d03f52-45b0-4986-906e-f2fe9e2d1c20 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:27.825142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d03f52-45b0-4986-906e-f2fe9e2d1c20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:27.834233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d03f52-45b0-4986-906e-f2fe9e2d1c20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:27.836199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d03f52-45b0-4986-906e-f2fe9e2d1c20 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:27.854717 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1616/3269] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:28.282098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f553b-ac57-4f23-8b2d-468bfe707887 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:28.283080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f553b-ac57-4f23-8b2d-468bfe707887 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:28.283361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f553b-ac57-4f23-8b2d-468bfe707887 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:28.285143 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1654/3270] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:55:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:55:28.290859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d03f52-45b0-4986-906e-f2fe9e2d1c20 service swift] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:55:28.305642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d03f52-45b0-4986-906e-f2fe9e2d1c20 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:28.317460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d03f52-45b0-4986-906e-f2fe9e2d1c20 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:28.323652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb8e1-2af5-4892-b420-9c8b52482350 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '425d5678358a4f63bf585612162b4003', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1dfe90fc3d4894aa892032cba5c317', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:28.325467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb8e1-2af5-4892-b420-9c8b52482350 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:28.325981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb8e1-2af5-4892-b420-9c8b52482350 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:28.326477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ddb8e1-2af5-4892-b420-9c8b52482350 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:28.328184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddb8e1-2af5-4892-b420-9c8b52482350 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorizing `identity:get_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:28.330472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ddb8e1-2af5-4892-b420-9c8b52482350 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:28.342483 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1617/3271] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:55:28 2022] GET /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 383 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:28.504742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb589f4-a2e8-48ef-9038-c052a0504ba0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:28.505622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb589f4-a2e8-48ef-9038-c052a0504ba0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:28.505981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb589f4-a2e8-48ef-9038-c052a0504ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:28.549639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-afb589f4-a2e8-48ef-9038-c052a0504ba0 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:28.551323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-afb589f4-a2e8-48ef-9038-c052a0504ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:28.562351 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1655/3272] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:55:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:28.580969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb8e1-2af5-4892-b420-9c8b52482350 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:28.597199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ddb8e1-2af5-4892-b420-9c8b52482350 tempest-QuotasAdminNegativeTest-1001248879 tempest-QuotasAdminNegativeTest-1001248879-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:28.607723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3734a1-2f20-4590-915a-67d28e20d633 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:28.608505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3734a1-2f20-4590-915a-67d28e20d633 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:28.608801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3734a1-2f20-4590-915a-67d28e20d633 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:28.609764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3734a1-2f20-4590-915a-67d28e20d633 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:28.624144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3734a1-2f20-4590-915a-67d28e20d633 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:28.625649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3734a1-2f20-4590-915a-67d28e20d633 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:28.656151 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1618/3273] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:55:28.835950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb589f4-a2e8-48ef-9038-c052a0504ba0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:28.841154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-afb589f4-a2e8-48ef-9038-c052a0504ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:28.866335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3734a1-2f20-4590-915a-67d28e20d633 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:28.867899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7a3734a1-2f20-4590-915a-67d28e20d633 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:28.884613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb589f4-a2e8-48ef-9038-c052a0504ba0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:28.891774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3734a1-2f20-4590-915a-67d28e20d633 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:28.906994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:28.908642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:28.909016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:28.909306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] PATH_INFO: `/v3/users/493cfcb9e1b744aaba45b2a48c7306f4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:28.911170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=493cfcb9e1b744aaba45b2a48c7306f4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:28.916636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:28.919026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:28.919958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:28.920309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:28.920585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] PATH_INFO: `/v3/users/80c37dca7eb34ef096e6d9093ad313b9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:28.923236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c37dca7eb34ef096e6d9093ad313b9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:28.925338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:29.013693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c37dca7eb34ef096e6d9093ad313b9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.025920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c37dca7eb34ef096e6d9093ad313b9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.027895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c37dca7eb34ef096e6d9093ad313b9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.029733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c37dca7eb34ef096e6d9093ad313b9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.032002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '493cfcb9e1b744aaba45b2a48c7306f4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.039120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '493cfcb9e1b744aaba45b2a48c7306f4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.039820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '493cfcb9e1b744aaba45b2a48c7306f4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.041188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '493cfcb9e1b744aaba45b2a48c7306f4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.047847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5a44470c-01cd-4c5f-a472-34b66a823617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c37dca7eb34ef096e6d9093ad313b9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.050018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5033215d-164c-4593-a511-901e51302e3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '493cfcb9e1b744aaba45b2a48c7306f4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.068926 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1619/3274] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:28 2022] DELETE /identity/v3/users/80c37dca7eb34ef096e6d9093ad313b9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:29.070599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee199f-c77b-497b-b731-3299cc2196ea None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.071066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee199f-c77b-497b-b731-3299cc2196ea None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.071545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee199f-c77b-497b-b731-3299cc2196ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.077031 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1656/3275] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:28 2022] DELETE /identity/v3/users/493cfcb9e1b744aaba45b2a48c7306f4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:29.078748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd782d5-66df-4ba7-9a95-bab00d1fdb29 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.079885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd782d5-66df-4ba7-9a95-bab00d1fdb29 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.080368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd782d5-66df-4ba7-9a95-bab00d1fdb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.092647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7fee199f-c77b-497b-b731-3299cc2196ea None None] MFA Rules not processed for user `c748958cc2c64a5c9f7af16cae37c969`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:29.093996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7fee199f-c77b-497b-b731-3299cc2196ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.112162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7dd782d5-66df-4ba7-9a95-bab00d1fdb29 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:29.113611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7dd782d5-66df-4ba7-9a95-bab00d1fdb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.176464 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1620/3276] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:29.183312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe9b5-bf3a-45b7-8221-142439a9c446 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.183677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe9b5-bf3a-45b7-8221-142439a9c446 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.184053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffe9b5-bf3a-45b7-8221-142439a9c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.213763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b7ffe9b5-bf3a-45b7-8221-142439a9c446 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:29.214953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b7ffe9b5-bf3a-45b7-8221-142439a9c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.217980 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1657/3277] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:29.224264 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1621/3278] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:29.229346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd782d5-66df-4ba7-9a95-bab00d1fdb29 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:29.230826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7dd782d5-66df-4ba7-9a95-bab00d1fdb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.237633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffe9b5-bf3a-45b7-8221-142439a9c446 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:29.241118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b7ffe9b5-bf3a-45b7-8221-142439a9c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.330338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd782d5-66df-4ba7-9a95-bab00d1fdb29 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:29.333143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffe9b5-bf3a-45b7-8221-142439a9c446 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:29.335082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe6b59-e5ab-41bb-a29d-7fd96f179bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:29.335954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe6b59-e5ab-41bb-a29d-7fd96f179bfa service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.336231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe6b59-e5ab-41bb-a29d-7fd96f179bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.336838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe6b59-e5ab-41bb-a29d-7fd96f179bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.340190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ceccad-c18b-4827-b97e-7838cbafe5e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:29.340908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceccad-c18b-4827-b97e-7838cbafe5e3 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.341263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceccad-c18b-4827-b97e-7838cbafe5e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.341607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceccad-c18b-4827-b97e-7838cbafe5e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.348453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe6b59-e5ab-41bb-a29d-7fd96f179bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:29.350105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe6b59-e5ab-41bb-a29d-7fd96f179bfa service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:29.351609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ceccad-c18b-4827-b97e-7838cbafe5e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:29.354030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ceccad-c18b-4827-b97e-7838cbafe5e3 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:29.363309 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1658/3279] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:55:29.365658 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1622/3280] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:29.388866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8b1ba-c53f-406f-b6e3-d981ffd5d709 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.389215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8b1ba-c53f-406f-b6e3-d981ffd5d709 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.389435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8b1ba-c53f-406f-b6e3-d981ffd5d709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.414156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cab8b1ba-c53f-406f-b6e3-d981ffd5d709 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:29.416873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cab8b1ba-c53f-406f-b6e3-d981ffd5d709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.509207 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1659/3281] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:29.529180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ceccad-c18b-4827-b97e-7838cbafe5e3 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:29.533268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-90ceccad-c18b-4827-b97e-7838cbafe5e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.604133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8b1ba-c53f-406f-b6e3-d981ffd5d709 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:29.610712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cab8b1ba-c53f-406f-b6e3-d981ffd5d709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.633711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ceccad-c18b-4827-b97e-7838cbafe5e3 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:29.640644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1f9fb-879c-48c0-b4f1-dccd6aca6a42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:29.641319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1f9fb-879c-48c0-b4f1-dccd6aca6a42 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.641683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1f9fb-879c-48c0-b4f1-dccd6aca6a42 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.642094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1f9fb-879c-48c0-b4f1-dccd6aca6a42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.646154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8b1ba-c53f-406f-b6e3-d981ffd5d709 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:29.652441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1f9fb-879c-48c0-b4f1-dccd6aca6a42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:29.653665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:29.654319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1f9fb-879c-48c0-b4f1-dccd6aca6a42 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:29.655108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.655580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.657505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] PATH_INFO: `/v3/projects/739cffc409bf4c9b831ae68701acafb1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.659215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=739cffc409bf4c9b831ae68701acafb1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:29.662619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:29.663949 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1623/3282] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:55:29.756228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739cffc409bf4c9b831ae68701acafb1', 'request_id': 'req-1f74a09d-0e0e-4f90-ae94-bffe832e3429'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.769328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739cffc409bf4c9b831ae68701acafb1', 'request_id': 'req-1f74a09d-0e0e-4f90-ae94-bffe832e3429'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.779357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739cffc409bf4c9b831ae68701acafb1', 'request_id': 'req-1f74a09d-0e0e-4f90-ae94-bffe832e3429'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.786171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adf890-c874-44c6-ae08-8cb89fd4a823 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.786463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adf890-c874-44c6-ae08-8cb89fd4a823 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.787304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45adf890-c874-44c6-ae08-8cb89fd4a823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.794117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] The token cache is being invalidate because project 739cffc409bf4c9b831ae68701acafb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:29.794524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.795201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f74a09d-0e0e-4f90-ae94-bffe832e3429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:29.796989 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1660/3283] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:29 2022] DELETE /identity/v3/projects/739cffc409bf4c9b831ae68701acafb1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:29.802119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36891d6-432d-4a76-95a9-58659b4d49cf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.802408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36891d6-432d-4a76-95a9-58659b4d49cf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.802869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36891d6-432d-4a76-95a9-58659b4d49cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.813417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-45adf890-c874-44c6-ae08-8cb89fd4a823 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:29.814626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-45adf890-c874-44c6-ae08-8cb89fd4a823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.827221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c36891d6-432d-4a76-95a9-58659b4d49cf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:29.828828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c36891d6-432d-4a76-95a9-58659b4d49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.898089 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1624/3284] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:55:29.908617 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1661/3285] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:55:29.915450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adf890-c874-44c6-ae08-8cb89fd4a823 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:29.915450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-45adf890-c874-44c6-ae08-8cb89fd4a823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.921941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc42d0-0450-45fd-86c1-687f0eb6079c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:29.922523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc42d0-0450-45fd-86c1-687f0eb6079c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:29.922805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc42d0-0450-45fd-86c1-687f0eb6079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:29.952350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a6cc42d0-0450-45fd-86c1-687f0eb6079c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:29.956416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a6cc42d0-0450-45fd-86c1-687f0eb6079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:29.986841 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1662/3286] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:29.992773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc42d0-0450-45fd-86c1-687f0eb6079c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:30.017602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc42d0-0450-45fd-86c1-687f0eb6079c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:30.032732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401118-4944-4c3b-ad63-048614aaf0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:30.034217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401118-4944-4c3b-ad63-048614aaf0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:30.034542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401118-4944-4c3b-ad63-048614aaf0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:30.034856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401118-4944-4c3b-ad63-048614aaf0e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:30.035704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67401118-4944-4c3b-ad63-048614aaf0e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:55:30.041817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67401118-4944-4c3b-ad63-048614aaf0e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:30.044433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67401118-4944-4c3b-ad63-048614aaf0e7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:30.074731 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1663/3287] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:30.075931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401118-4944-4c3b-ad63-048614aaf0e7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:30.082471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45adf890-c874-44c6-ae08-8cb89fd4a823 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:30.089519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c600cf-1cff-4f41-b02e-6bb7182b0a7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:30.090202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c600cf-1cff-4f41-b02e-6bb7182b0a7f service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:30.090490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c600cf-1cff-4f41-b02e-6bb7182b0a7f service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:30.090760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c600cf-1cff-4f41-b02e-6bb7182b0a7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:30.095434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401118-4944-4c3b-ad63-048614aaf0e7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:30.104061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea6b1c-9f51-478b-8d7e-ce72cd552611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:30.104498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea6b1c-9f51-478b-8d7e-ce72cd552611 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:30.104784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea6b1c-9f51-478b-8d7e-ce72cd552611 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:30.105448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea6b1c-9f51-478b-8d7e-ce72cd552611 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:30.106221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c600cf-1cff-4f41-b02e-6bb7182b0a7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:30.106685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea6b1c-9f51-478b-8d7e-ce72cd552611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:30.108743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c600cf-1cff-4f41-b02e-6bb7182b0a7f service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:30.109057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea6b1c-9f51-478b-8d7e-ce72cd552611 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:30.120884 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1625/3288] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:55:30.163071 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1664/3289] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:30 2022] POST /identity/v3/projects => generated 399 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:30.167690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c600cf-1cff-4f41-b02e-6bb7182b0a7f service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:30.190123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c600cf-1cff-4f41-b02e-6bb7182b0a7f service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:30.329873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1a4ed-f23f-4312-b337-e927baa6142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:30.344306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1a4ed-f23f-4312-b337-e927baa6142b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:30.345308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1a4ed-f23f-4312-b337-e927baa6142b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:30.347077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1a4ed-f23f-4312-b337-e927baa6142b admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:30.348909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1a4ed-f23f-4312-b337-e927baa6142b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:30.355702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1a4ed-f23f-4312-b337-e927baa6142b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:30.387800 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1626/3290] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:30 2022] POST /identity/v3/users => generated 300 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:30.392153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea6b1c-9f51-478b-8d7e-ce72cd552611 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:30.418532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea6b1c-9f51-478b-8d7e-ce72cd552611 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:30.423780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5610a5-d263-4ce7-8f3d-f6f14492372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:30.424732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5610a5-d263-4ce7-8f3d-f6f14492372a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:30.425223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5610a5-d263-4ce7-8f3d-f6f14492372a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:30.425695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5610a5-d263-4ce7-8f3d-f6f14492372a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:30.426586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5610a5-d263-4ce7-8f3d-f6f14492372a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:30.429517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5610a5-d263-4ce7-8f3d-f6f14492372a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:30.454893 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1665/3291] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:30.459420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1a4ed-f23f-4312-b337-e927baa6142b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:30.480502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1a4ed-f23f-4312-b337-e927baa6142b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:30.504084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a4082-94ac-4b68-9bd1-5cb3ceb9e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:30.505115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a4082-94ac-4b68-9bd1-5cb3ceb9e970 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:30.505620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a4082-94ac-4b68-9bd1-5cb3ceb9e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:30.506154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a4082-94ac-4b68-9bd1-5cb3ceb9e970 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:30.507333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a4082-94ac-4b68-9bd1-5cb3ceb9e970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:30.510022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a4082-94ac-4b68-9bd1-5cb3ceb9e970 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:30.536025 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1627/3292] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:30.538396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5610a5-d263-4ce7-8f3d-f6f14492372a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:30.552807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5610a5-d263-4ce7-8f3d-f6f14492372a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:30.570584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a106b2a-f783-489d-9536-2ea3abd885b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:30.574669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a106b2a-f783-489d-9536-2ea3abd885b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:30.577953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a106b2a-f783-489d-9536-2ea3abd885b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:30.578615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a106b2a-f783-489d-9536-2ea3abd885b9 admin admin] PATH_INFO: `/v3/projects/335ff061c84744549d2671a9a14007c1/users/09a1e46480af4050919a41db0e02c545/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:30.639373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a106b2a-f783-489d-9536-2ea3abd885b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=335ff061c84744549d2671a9a14007c1, user_id=09a1e46480af4050919a41db0e02c545, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:30.669584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a106b2a-f783-489d-9536-2ea3abd885b9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:30.726116 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1666/3293] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:30 2022] PUT /identity/v3/projects/335ff061c84744549d2671a9a14007c1/users/09a1e46480af4050919a41db0e02c545/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:55:30.726797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13aec9-88c3-4a57-ba1f-cf3abbbd5b88 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:30.727326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13aec9-88c3-4a57-ba1f-cf3abbbd5b88 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:30.728502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13aec9-88c3-4a57-ba1f-cf3abbbd5b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:30.836440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3d13aec9-88c3-4a57-ba1f-cf3abbbd5b88 None None] MFA Rules not processed for user `09a1e46480af4050919a41db0e02c545`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:30.844530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3d13aec9-88c3-4a57-ba1f-cf3abbbd5b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:31.033158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a106b2a-f783-489d-9536-2ea3abd885b9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:31.035990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7a106b2a-f783-489d-9536-2ea3abd885b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:31.185002 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1628/3294] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:31.288923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13aec9-88c3-4a57-ba1f-cf3abbbd5b88 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:31.291197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3d13aec9-88c3-4a57-ba1f-cf3abbbd5b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:31.325030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a106b2a-f783-489d-9536-2ea3abd885b9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:31.343196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:31.344094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:31.344377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:31.345157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] PATH_INFO: `/v3/projects/7cc0a8152d814a5590cbc9be7c230181` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:31.347769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc0a8152d814a5590cbc9be7c230181)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:31.349821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:31.433173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc0a8152d814a5590cbc9be7c230181', 'request_id': 'req-47ead67c-1551-4b56-87cf-00e12e0a5f20'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.444649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc0a8152d814a5590cbc9be7c230181', 'request_id': 'req-47ead67c-1551-4b56-87cf-00e12e0a5f20'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.457130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc0a8152d814a5590cbc9be7c230181', 'request_id': 'req-47ead67c-1551-4b56-87cf-00e12e0a5f20'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.481401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] The token cache is being invalidate because project 7cc0a8152d814a5590cbc9be7c230181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:31.481811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.483888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.488843 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1667/3295] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:31 2022] DELETE /identity/v3/projects/7cc0a8152d814a5590cbc9be7c230181 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:55:31.490671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:31.495747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:31.523489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13aec9-88c3-4a57-ba1f-cf3abbbd5b88 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:31.678380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:31.679306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:31.679753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:31.680256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:31.688051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:31.758584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ead67c-1551-4b56-87cf-00e12e0a5f20 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:31.775835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:31.777494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:31.777886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:31.778167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] PATH_INFO: `/v3/users/425d5678358a4f63bf585612162b4003` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:31.781547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425d5678358a4f63bf585612162b4003)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:31.785260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:31.839010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:31.841270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:31.856541 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1629/3296] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:55:31.869414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425d5678358a4f63bf585612162b4003'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.897630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425d5678358a4f63bf585612162b4003'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.898382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425d5678358a4f63bf585612162b4003'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.899083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425d5678358a4f63bf585612162b4003'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.909264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:31.911554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:31.942807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8519f71f-c69f-4950-b629-bb8f63b966c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425d5678358a4f63bf585612162b4003'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:31.950824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b334c1-a882-4d0c-ae47-c39cdf7f94f3 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:31.968734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:31.972209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:31.972512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:31.974085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] PATH_INFO: `/v3/users/09a1e46480af4050919a41db0e02c545` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:31.981069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a1e46480af4050919a41db0e02c545)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:31.989389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:32.007308 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1668/3297] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:31 2022] DELETE /identity/v3/users/425d5678358a4f63bf585612162b4003 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:32.177293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a1e46480af4050919a41db0e02c545'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:32.203569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a1e46480af4050919a41db0e02c545'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:32.205239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a1e46480af4050919a41db0e02c545'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:32.205996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a1e46480af4050919a41db0e02c545'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:32.251112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a1e46480af4050919a41db0e02c545'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:32.295282 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1630/3298] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:31 2022] DELETE /identity/v3/users/09a1e46480af4050919a41db0e02c545 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:32.299558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300496b-49b2-4d7f-910e-a48f83781533 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:32.300169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300496b-49b2-4d7f-910e-a48f83781533 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:32.300551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300496b-49b2-4d7f-910e-a48f83781533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:32.366415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3300496b-49b2-4d7f-910e-a48f83781533 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:32.369594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3300496b-49b2-4d7f-910e-a48f83781533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:32.644348 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1669/3299] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:32.706343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:32.708192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:32.838197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebbab90-7cc1-402d-ac48-18fe7be13f3c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:32.844515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a0f5b-d5ad-4060-924e-40af6847f23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:32.845482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a0f5b-d5ad-4060-924e-40af6847f23b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:32.845998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a0f5b-d5ad-4060-924e-40af6847f23b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:32.846646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a0f5b-d5ad-4060-924e-40af6847f23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:32.870542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a0f5b-d5ad-4060-924e-40af6847f23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:32.873864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a0f5b-d5ad-4060-924e-40af6847f23b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:32.893472 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1631/3300] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:33.287056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300496b-49b2-4d7f-910e-a48f83781533 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:33.288882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3300496b-49b2-4d7f-910e-a48f83781533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:33.307312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300496b-49b2-4d7f-910e-a48f83781533 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:33.315687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:33.317580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:33.318089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:33.319441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] PATH_INFO: `/v3/projects/ce1dfe90fc3d4894aa892032cba5c317` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:33.323546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1dfe90fc3d4894aa892032cba5c317)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:33.328540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:33.487611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1dfe90fc3d4894aa892032cba5c317', 'request_id': 'req-977f1a00-3fd1-448d-bcb4-dd05f0be656f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:33.498995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1dfe90fc3d4894aa892032cba5c317', 'request_id': 'req-977f1a00-3fd1-448d-bcb4-dd05f0be656f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:33.521721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1dfe90fc3d4894aa892032cba5c317', 'request_id': 'req-977f1a00-3fd1-448d-bcb4-dd05f0be656f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:33.557842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] The token cache is being invalidate because project ce1dfe90fc3d4894aa892032cba5c317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:33.558132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:33.560981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-977f1a00-3fd1-448d-bcb4-dd05f0be656f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:33.564564 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1670/3301] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:33 2022] DELETE /identity/v3/projects/ce1dfe90fc3d4894aa892032cba5c317 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:33.570238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9882d-f790-4192-8e83-96801b08235f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:33.572135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9882d-f790-4192-8e83-96801b08235f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:33.573068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9882d-f790-4192-8e83-96801b08235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:33.625155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-62a9882d-f790-4192-8e83-96801b08235f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:33.625417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-62a9882d-f790-4192-8e83-96801b08235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:33.799332 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1632/3302] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:33.808068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a0cd3-8627-493c-a46b-1c4577a44ca5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:33.808597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a0cd3-8627-493c-a46b-1c4577a44ca5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:33.808597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a0cd3-8627-493c-a46b-1c4577a44ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:33.861527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-591a0cd3-8627-493c-a46b-1c4577a44ca5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:33.864905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-591a0cd3-8627-493c-a46b-1c4577a44ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:33.898742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9882d-f790-4192-8e83-96801b08235f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:33.913139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9882d-f790-4192-8e83-96801b08235f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:33.914056 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1671/3303] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:55:33.941085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:33.941538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:33.941870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:33.942167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:33.942911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:55:33.943954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:33.946582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:34.006692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a0cd3-8627-493c-a46b-1c4577a44ca5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:34.008295 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1633/3304] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:55:34.032458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a0cd3-8627-493c-a46b-1c4577a44ca5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:34.054056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613e063-2ccd-43b2-8564-a5fb2500be8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:34.055159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613e063-2ccd-43b2-8564-a5fb2500be8a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.055645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613e063-2ccd-43b2-8564-a5fb2500be8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.056180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613e063-2ccd-43b2-8564-a5fb2500be8a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.057658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613e063-2ccd-43b2-8564-a5fb2500be8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:34.059791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a613e063-2ccd-43b2-8564-a5fb2500be8a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:34.092629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:34.095334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:34.123261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b33b3-6161-4ec9-86d7-7a4ba0268966 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:34.147332 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1672/3305] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:34 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:34.148494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613e063-2ccd-43b2-8564-a5fb2500be8a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:34.152452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:34.153854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.159522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.160222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] PATH_INFO: `/v3/projects/335ff061c84744549d2671a9a14007c1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.169354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=335ff061c84744549d2671a9a14007c1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:34.173749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:34.342371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613e063-2ccd-43b2-8564-a5fb2500be8a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:34.354998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00fe53-a776-4152-96c0-5f565ab71448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:34.355940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00fe53-a776-4152-96c0-5f565ab71448 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.356673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00fe53-a776-4152-96c0-5f565ab71448 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.357107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00fe53-a776-4152-96c0-5f565ab71448 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.357977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00fe53-a776-4152-96c0-5f565ab71448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:34.360119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00fe53-a776-4152-96c0-5f565ab71448 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:34.397342 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1673/3306] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:34 2022] POST /identity/v3/users => generated 292 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:34.402057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00fe53-a776-4152-96c0-5f565ab71448 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:34.446034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00fe53-a776-4152-96c0-5f565ab71448 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:34.469538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '335ff061c84744549d2671a9a14007c1', 'request_id': 'req-f28d04cc-e2e6-4074-a529-a6f0856364d5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:34.502684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '335ff061c84744549d2671a9a14007c1', 'request_id': 'req-f28d04cc-e2e6-4074-a529-a6f0856364d5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:34.520174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '335ff061c84744549d2671a9a14007c1', 'request_id': 'req-f28d04cc-e2e6-4074-a529-a6f0856364d5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:34.552977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] The token cache is being invalidate because project 335ff061c84744549d2671a9a14007c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:34.553276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:34.556629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f28d04cc-e2e6-4074-a529-a6f0856364d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:34.563728 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1634/3307] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:34 2022] DELETE /identity/v3/projects/335ff061c84744549d2671a9a14007c1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:55:34.579098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860fd0a-20af-497a-8e55-e9b8c231a1ba None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.579307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860fd0a-20af-497a-8e55-e9b8c231a1ba None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.579586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860fd0a-20af-497a-8e55-e9b8c231a1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.600340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be97b7-cc9b-4a4c-a140-1ae13594e6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:34.601363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be97b7-cc9b-4a4c-a140-1ae13594e6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.601839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be97b7-cc9b-4a4c-a140-1ae13594e6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.602824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be97b7-cc9b-4a4c-a140-1ae13594e6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.603970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be97b7-cc9b-4a4c-a140-1ae13594e6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:34.608066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be97b7-cc9b-4a4c-a140-1ae13594e6c6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:34.630870 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1674/3308] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:55:34.635138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be97b7-cc9b-4a4c-a140-1ae13594e6c6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:34.642367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8860fd0a-20af-497a-8e55-e9b8c231a1ba None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:34.642759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-13be97b7-cc9b-4a4c-a140-1ae13594e6c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:34.645725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8860fd0a-20af-497a-8e55-e9b8c231a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:34.662431 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1635/3309] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:34.670993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be97b7-cc9b-4a4c-a140-1ae13594e6c6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:34.676992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95d8bf-e75a-43eb-9ec6-bc15e54b7891 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.677445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95d8bf-e75a-43eb-9ec6-bc15e54b7891 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.677679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95d8bf-e75a-43eb-9ec6-bc15e54b7891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.684600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fab05e-6bd4-47c3-9064-4d57a8b110af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:34.685606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fab05e-6bd4-47c3-9064-4d57a8b110af admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.686151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fab05e-6bd4-47c3-9064-4d57a8b110af admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.686645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fab05e-6bd4-47c3-9064-4d57a8b110af admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.687381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fab05e-6bd4-47c3-9064-4d57a8b110af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:34.690816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fab05e-6bd4-47c3-9064-4d57a8b110af admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:34.721053 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1675/3310] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:34.725333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fab05e-6bd4-47c3-9064-4d57a8b110af admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:34.733514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4c95d8bf-e75a-43eb-9ec6-bc15e54b7891 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:34.738531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4c95d8bf-e75a-43eb-9ec6-bc15e54b7891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:34.741214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fab05e-6bd4-47c3-9064-4d57a8b110af admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:34.755616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1cdc5-0403-484b-a0a8-2f4df6c6e196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:34.756605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1cdc5-0403-484b-a0a8-2f4df6c6e196 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.756886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1cdc5-0403-484b-a0a8-2f4df6c6e196 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.757165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1cdc5-0403-484b-a0a8-2f4df6c6e196 admin admin] PATH_INFO: `/v3/projects/a8e2bb0e3958483d90176ec061c32ca8/users/4c8199b3248742a7ba0d0cb6570c7058/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.767680 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1636/3311] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:34.771844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95d8bf-e75a-43eb-9ec6-bc15e54b7891 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:34.790856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95d8bf-e75a-43eb-9ec6-bc15e54b7891 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:34.793161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1cdc5-0403-484b-a0a8-2f4df6c6e196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e2bb0e3958483d90176ec061c32ca8, user_id=4c8199b3248742a7ba0d0cb6570c7058, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:34.807115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b1cdc5-0403-484b-a0a8-2f4df6c6e196 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:34.807695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafecc13-7cec-40a6-9236-f42eb9dc4a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:34.810130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafecc13-7cec-40a6-9236-f42eb9dc4a62 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.810582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafecc13-7cec-40a6-9236-f42eb9dc4a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.811782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafecc13-7cec-40a6-9236-f42eb9dc4a62 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.812721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafecc13-7cec-40a6-9236-f42eb9dc4a62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:55:34.814316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafecc13-7cec-40a6-9236-f42eb9dc4a62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:34.818461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafecc13-7cec-40a6-9236-f42eb9dc4a62 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:34.844725 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1676/3312] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:34 2022] PUT /identity/v3/projects/a8e2bb0e3958483d90176ec061c32ca8/users/4c8199b3248742a7ba0d0cb6570c7058/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:55:34.880882 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1637/3313] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:34.884669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1cdc5-0403-484b-a0a8-2f4df6c6e196 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:34.925966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf2111-0640-485d-a43a-3320a7b74a71 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:34.926500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf2111-0640-485d-a43a-3320a7b74a71 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:34.926940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf2111-0640-485d-a43a-3320a7b74a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:34.977449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6aaf2111-0640-485d-a43a-3320a7b74a71 None None] MFA Rules not processed for user `4c8199b3248742a7ba0d0cb6570c7058`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:34.979941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6aaf2111-0640-485d-a43a-3320a7b74a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:35.047615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b1cdc5-0403-484b-a0a8-2f4df6c6e196 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.064602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a3537-7423-431e-b1f4-c41df4587650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:35.065268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a3537-7423-431e-b1f4-c41df4587650 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:35.065543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a3537-7423-431e-b1f4-c41df4587650 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:35.065973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a3537-7423-431e-b1f4-c41df4587650 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:35.068054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a3537-7423-431e-b1f4-c41df4587650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:35.069410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a3537-7423-431e-b1f4-c41df4587650 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:35.135179 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1677/3314] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:34 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:35.139374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a3537-7423-431e-b1f4-c41df4587650 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:35.149120 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1638/3315] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:55:35.151267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf2111-0640-485d-a43a-3320a7b74a71 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:35.183530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf2111-0640-485d-a43a-3320a7b74a71 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.313276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a3537-7423-431e-b1f4-c41df4587650 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.328063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587149-6af0-4ff1-b270-1b864e456b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:35.328760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587149-6af0-4ff1-b270-1b864e456b18 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:35.331030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587149-6af0-4ff1-b270-1b864e456b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:35.333867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587149-6af0-4ff1-b270-1b864e456b18 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:35.335988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5587149-6af0-4ff1-b270-1b864e456b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:35.339555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9493117-8fe8-4628-a586-a9109bbef4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:35.340806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5587149-6af0-4ff1-b270-1b864e456b18 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:35.341835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9493117-8fe8-4628-a586-a9109bbef4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:35.342246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9493117-8fe8-4628-a586-a9109bbef4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:35.342537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9493117-8fe8-4628-a586-a9109bbef4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:35.343235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9493117-8fe8-4628-a586-a9109bbef4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:35.345369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9493117-8fe8-4628-a586-a9109bbef4a5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:35.396357 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1678/3316] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:35 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:35.399791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587149-6af0-4ff1-b270-1b864e456b18 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:35.428778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5587149-6af0-4ff1-b270-1b864e456b18 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.428928 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1639/3317] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:35 2022] POST /identity/v3/projects => generated 383 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:35.433112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9493117-8fe8-4628-a586-a9109bbef4a5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:35.602813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9493117-8fe8-4628-a586-a9109bbef4a5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.606437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee79f0-0512-46ab-8056-d38656d7cf26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:35.607452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee79f0-0512-46ab-8056-d38656d7cf26 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:35.607730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee79f0-0512-46ab-8056-d38656d7cf26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:35.608046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee79f0-0512-46ab-8056-d38656d7cf26 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:35.609203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee79f0-0512-46ab-8056-d38656d7cf26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:35.610805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee79f0-0512-46ab-8056-d38656d7cf26 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:35.616546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44694bb9-972a-4f5d-9991-4ff5c63c2b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:35.617235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694bb9-972a-4f5d-9991-4ff5c63c2b80 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:35.617512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694bb9-972a-4f5d-9991-4ff5c63c2b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:35.617788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694bb9-972a-4f5d-9991-4ff5c63c2b80 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:35.619006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694bb9-972a-4f5d-9991-4ff5c63c2b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:35.623279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694bb9-972a-4f5d-9991-4ff5c63c2b80 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:35.638524 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1679/3318] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:35.639688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee79f0-0512-46ab-8056-d38656d7cf26 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:35.669922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee79f0-0512-46ab-8056-d38656d7cf26 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.671379 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1640/3319] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:35 2022] POST /identity/v3/users => generated 298 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:35.673151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44694bb9-972a-4f5d-9991-4ff5c63c2b80 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:35.680901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bdddc-fdc3-4ade-91ab-ab95e9ef28c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:35.681701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bdddc-fdc3-4ade-91ab-ab95e9ef28c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:35.683905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bdddc-fdc3-4ade-91ab-ab95e9ef28c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:35.684707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bdddc-fdc3-4ade-91ab-ab95e9ef28c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:35.685531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bdddc-fdc3-4ade-91ab-ab95e9ef28c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:35.688099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933bdddc-fdc3-4ade-91ab-ab95e9ef28c5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:35.694215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44694bb9-972a-4f5d-9991-4ff5c63c2b80 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.701887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f529493-1fe6-415f-a73a-54a8bd56c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:35.702729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f529493-1fe6-415f-a73a-54a8bd56c572 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:35.707003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f529493-1fe6-415f-a73a-54a8bd56c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:35.707003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f529493-1fe6-415f-a73a-54a8bd56c572 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:35.707207 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1680/3320] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:35.707337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f529493-1fe6-415f-a73a-54a8bd56c572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:35.707444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bdddc-fdc3-4ade-91ab-ab95e9ef28c5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:35.707549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f529493-1fe6-415f-a73a-54a8bd56c572 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:35.715662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-933bdddc-fdc3-4ade-91ab-ab95e9ef28c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:35.727247 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1641/3321] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:35.728280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f529493-1fe6-415f-a73a-54a8bd56c572 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:35.742603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f529493-1fe6-415f-a73a-54a8bd56c572 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.749535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e5961-3321-4c9a-b619-bc9fdaa21269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:35.753277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e5961-3321-4c9a-b619-bc9fdaa21269 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:35.755876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e5961-3321-4c9a-b619-bc9fdaa21269 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:35.756283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e5961-3321-4c9a-b619-bc9fdaa21269 admin admin] PATH_INFO: `/v3/projects/94d4dd31cb2f45ebbadb90d56b9b393d/users/a28808e1fc35495dac029a5c68ddcf8e/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:35.786405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e5961-3321-4c9a-b619-bc9fdaa21269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d4dd31cb2f45ebbadb90d56b9b393d, user_id=a28808e1fc35495dac029a5c68ddcf8e, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:35.812185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e5961-3321-4c9a-b619-bc9fdaa21269 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:35.864270 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1642/3322] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:35 2022] PUT /identity/v3/projects/94d4dd31cb2f45ebbadb90d56b9b393d/users/a28808e1fc35495dac029a5c68ddcf8e/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:35.868487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e5961-3321-4c9a-b619-bc9fdaa21269 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:35.901566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933bdddc-fdc3-4ade-91ab-ab95e9ef28c5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.988704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e5961-3321-4c9a-b619-bc9fdaa21269 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:35.997340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d5adc9-8227-4a6d-81fb-f42ed8bd75f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:36.000520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5adc9-8227-4a6d-81fb-f42ed8bd75f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:36.001031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5adc9-8227-4a6d-81fb-f42ed8bd75f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:36.001573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d5adc9-8227-4a6d-81fb-f42ed8bd75f5 admin admin] PATH_INFO: `/v3/projects/71c0a30712034ec483067d169c2d4bae/users/3c36f9a92eea40debadbec96c0a2bef1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:36.031133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5adc9-8227-4a6d-81fb-f42ed8bd75f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c0a30712034ec483067d169c2d4bae, user_id=3c36f9a92eea40debadbec96c0a2bef1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:36.033938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d5adc9-8227-4a6d-81fb-f42ed8bd75f5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:36.043522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e8d62-f16f-4c2d-a841-17eae0573940 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:36.045609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e8d62-f16f-4c2d-a841-17eae0573940 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:36.045968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e8d62-f16f-4c2d-a841-17eae0573940 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:36.052743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e8d62-f16f-4c2d-a841-17eae0573940 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:36.059163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2d3e8d62-f16f-4c2d-a841-17eae0573940 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:36.084661 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1643/3323] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:35 2022] PUT /identity/v3/projects/71c0a30712034ec483067d169c2d4bae/users/3c36f9a92eea40debadbec96c0a2bef1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:36.090468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27231-4ac7-4f46-9d02-dab4fe238241 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:36.092754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27231-4ac7-4f46-9d02-dab4fe238241 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:36.093794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea27231-4ac7-4f46-9d02-dab4fe238241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:36.169682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6ea27231-4ac7-4f46-9d02-dab4fe238241 None None] MFA Rules not processed for user `a28808e1fc35495dac029a5c68ddcf8e`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:36.171700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6ea27231-4ac7-4f46-9d02-dab4fe238241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:36.217527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e8d62-f16f-4c2d-a841-17eae0573940 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:36.219194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e8d62-f16f-4c2d-a841-17eae0573940 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:36.252372 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1681/3324] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:36.255169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e8d62-f16f-4c2d-a841-17eae0573940 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:36.278419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e8d62-f16f-4c2d-a841-17eae0573940 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:36.305232 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1644/3325] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:36.434971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605522c4-6d5a-421f-a81e-8cb0070511b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:36.435669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605522c4-6d5a-421f-a81e-8cb0070511b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:36.435981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605522c4-6d5a-421f-a81e-8cb0070511b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:36.436265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605522c4-6d5a-421f-a81e-8cb0070511b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:36.437000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605522c4-6d5a-421f-a81e-8cb0070511b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:36.438666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605522c4-6d5a-421f-a81e-8cb0070511b2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:36.460743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea27231-4ac7-4f46-9d02-dab4fe238241 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:36.464727 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1682/3326] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:36.488004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea27231-4ac7-4f46-9d02-dab4fe238241 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:36.501634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db414b-b042-48be-8ab7-f527a4b4e153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:36.503679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db414b-b042-48be-8ab7-f527a4b4e153 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:36.504172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db414b-b042-48be-8ab7-f527a4b4e153 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:36.504374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db414b-b042-48be-8ab7-f527a4b4e153 admin admin] PATH_INFO: `/v3/projects/71c0a30712034ec483067d169c2d4bae/users/3c36f9a92eea40debadbec96c0a2bef1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:36.506680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db414b-b042-48be-8ab7-f527a4b4e153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c0a30712034ec483067d169c2d4bae, user_id=3c36f9a92eea40debadbec96c0a2bef1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:36.510351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db414b-b042-48be-8ab7-f527a4b4e153 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:36.532798 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1645/3327] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:36 2022] PUT /identity/v3/projects/71c0a30712034ec483067d169c2d4bae/users/3c36f9a92eea40debadbec96c0a2bef1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:36.535574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05700-0db3-473e-84de-f89ab4f21895 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:36.536587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05700-0db3-473e-84de-f89ab4f21895 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:36.536587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa05700-0db3-473e-84de-f89ab4f21895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:36.600891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4aa05700-0db3-473e-84de-f89ab4f21895 None None] MFA Rules not processed for user `3c36f9a92eea40debadbec96c0a2bef1`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:36.602224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4aa05700-0db3-473e-84de-f89ab4f21895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:36.657856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db414b-b042-48be-8ab7-f527a4b4e153 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:36.659663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-97db414b-b042-48be-8ab7-f527a4b4e153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:36.774340 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1683/3328] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:36.779014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30233ef5-104c-4062-971d-72b43001e851 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:36.781690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30233ef5-104c-4062-971d-72b43001e851 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:36.781690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30233ef5-104c-4062-971d-72b43001e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:36.860894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-30233ef5-104c-4062-971d-72b43001e851 None None] MFA Rules not processed for user `4c8199b3248742a7ba0d0cb6570c7058`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:36.875652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-30233ef5-104c-4062-971d-72b43001e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:36.937521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db414b-b042-48be-8ab7-f527a4b4e153 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:36.953907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d29e41-0100-4113-b8ba-8a54934708ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:36.954633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29e41-0100-4113-b8ba-8a54934708ec service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:36.954842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29e41-0100-4113-b8ba-8a54934708ec service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:36.955108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d29e41-0100-4113-b8ba-8a54934708ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:37.032458 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1684/3329] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:37.115722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d29e41-0100-4113-b8ba-8a54934708ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:37.117813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d29e41-0100-4113-b8ba-8a54934708ec service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:37.139042 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1646/3330] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:37.815015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30233ef5-104c-4062-971d-72b43001e851 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:37.868912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30233ef5-104c-4062-971d-72b43001e851 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:37.880786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c840e-dcd2-45a0-8311-5e7a0e6d5f0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:37.881980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c840e-dcd2-45a0-8311-5e7a0e6d5f0d service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:37.882710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c840e-dcd2-45a0-8311-5e7a0e6d5f0d service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:37.884084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c840e-dcd2-45a0-8311-5e7a0e6d5f0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:37.920636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c840e-dcd2-45a0-8311-5e7a0e6d5f0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:37.922274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c840e-dcd2-45a0-8311-5e7a0e6d5f0d service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:37.948401 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1685/3331] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:41.996415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1061-21a1-4e2f-9c65-83ca6f979c3a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:41.996991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1061-21a1-4e2f-9c65-83ca6f979c3a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:41.997105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c1061-21a1-4e2f-9c65-83ca6f979c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:42.038630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0f5c1061-21a1-4e2f-9c65-83ca6f979c3a None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:42.039855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0f5c1061-21a1-4e2f-9c65-83ca6f979c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:42.216456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c840e-dcd2-45a0-8311-5e7a0e6d5f0d service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:42.218637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-446c840e-dcd2-45a0-8311-5e7a0e6d5f0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:42.218782 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1647/3332] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:55:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:42.453469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c840e-dcd2-45a0-8311-5e7a0e6d5f0d service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:42.466746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb137c-8601-4eb0-b88c-492b03ff5ad2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:42.467431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb137c-8601-4eb0-b88c-492b03ff5ad2 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:42.468059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb137c-8601-4eb0-b88c-492b03ff5ad2 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:42.468339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb137c-8601-4eb0-b88c-492b03ff5ad2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:42.501190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb137c-8601-4eb0-b88c-492b03ff5ad2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:42.502366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb137c-8601-4eb0-b88c-492b03ff5ad2 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:42.514977 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1686/3333] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:55:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:55:42.579440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c1061-21a1-4e2f-9c65-83ca6f979c3a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:42.751377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c1061-21a1-4e2f-9c65-83ca6f979c3a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:42.767195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:42.770974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:42.772267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:42.772669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] PATH_INFO: `/v3/users/a28808e1fc35495dac029a5c68ddcf8e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:42.777476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28808e1fc35495dac029a5c68ddcf8e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:42.785005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:42.930238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28808e1fc35495dac029a5c68ddcf8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:42.940856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28808e1fc35495dac029a5c68ddcf8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:42.944471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28808e1fc35495dac029a5c68ddcf8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:42.945180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28808e1fc35495dac029a5c68ddcf8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:42.970752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28808e1fc35495dac029a5c68ddcf8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:43.010749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895585f9-5b58-4015-adc7-59255a392b22 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:43.011129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895585f9-5b58-4015-adc7-59255a392b22 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:43.011512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895585f9-5b58-4015-adc7-59255a392b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:43.013435 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1648/3334] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:42 2022] DELETE /identity/v3/users/a28808e1fc35495dac029a5c68ddcf8e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:43.044477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-895585f9-5b58-4015-adc7-59255a392b22 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:43.050021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-895585f9-5b58-4015-adc7-59255a392b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:43.169201 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1687/3335] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:43.209214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:43.210796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:43.345365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f026b-8779-44a1-904b-1bf18365a066 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:43.353150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9648bd-2051-4136-bd6b-d263226f106a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:43.354340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9648bd-2051-4136-bd6b-d263226f106a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:43.354792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9648bd-2051-4136-bd6b-d263226f106a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:43.355233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9648bd-2051-4136-bd6b-d263226f106a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:43.396287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9648bd-2051-4136-bd6b-d263226f106a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:43.405695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9648bd-2051-4136-bd6b-d263226f106a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:43.449475 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1649/3336] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:43.607757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895585f9-5b58-4015-adc7-59255a392b22 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:43.609266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-895585f9-5b58-4015-adc7-59255a392b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:43.622697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895585f9-5b58-4015-adc7-59255a392b22 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:43.627818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:43.628961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:43.629411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:43.629851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] PATH_INFO: `/v3/users/c8d2e97047c1481eb9916e203d2d8cba` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:43.631266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d2e97047c1481eb9916e203d2d8cba)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:43.633533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:43.758394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d2e97047c1481eb9916e203d2d8cba'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:43.768345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d2e97047c1481eb9916e203d2d8cba'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:43.769579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d2e97047c1481eb9916e203d2d8cba'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:43.770668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d2e97047c1481eb9916e203d2d8cba'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:43.792289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e941bf3b-3a28-4c08-8cf3-64c71169e224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d2e97047c1481eb9916e203d2d8cba'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:43.823627 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1688/3337] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:43 2022] DELETE /identity/v3/users/c8d2e97047c1481eb9916e203d2d8cba => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:44.421257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9648bd-2051-4136-bd6b-d263226f106a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:44.436153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9648bd-2051-4136-bd6b-d263226f106a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:44.605253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:44.606372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:44.606656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:44.606934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] PATH_INFO: `/v3/projects/6fee503421884a52b75aae2ae940aad0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:44.608148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fee503421884a52b75aae2ae940aad0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:44.610259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:44.718966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fee503421884a52b75aae2ae940aad0', 'request_id': 'req-87ea4b25-e1d6-4665-b12e-65942fa8d317'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:44.744144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fee503421884a52b75aae2ae940aad0', 'request_id': 'req-87ea4b25-e1d6-4665-b12e-65942fa8d317'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:44.751063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fee503421884a52b75aae2ae940aad0', 'request_id': 'req-87ea4b25-e1d6-4665-b12e-65942fa8d317'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:44.780422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] The token cache is being invalidate because project 6fee503421884a52b75aae2ae940aad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:44.781198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:44.782575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87ea4b25-e1d6-4665-b12e-65942fa8d317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:44.791862 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1650/3338] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:44 2022] DELETE /identity/v3/projects/6fee503421884a52b75aae2ae940aad0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:44.793727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2cd86-fae3-4e84-8010-2627936633d4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:44.797866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2cd86-fae3-4e84-8010-2627936633d4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:44.800311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2cd86-fae3-4e84-8010-2627936633d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:44.873713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-37e2cd86-fae3-4e84-8010-2627936633d4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:44.876091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-37e2cd86-fae3-4e84-8010-2627936633d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:45.040775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1689/3339] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:45.051149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4973694-c3fc-46f2-9f76-e8962e224452 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.051396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4973694-c3fc-46f2-9f76-e8962e224452 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.051673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4973694-c3fc-46f2-9f76-e8962e224452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.079273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2cd86-fae3-4e84-8010-2627936633d4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:45.081096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-37e2cd86-fae3-4e84-8010-2627936633d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:45.103054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f4973694-c3fc-46f2-9f76-e8962e224452 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:45.104554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f4973694-c3fc-46f2-9f76-e8962e224452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:45.113796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2cd86-fae3-4e84-8010-2627936633d4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:45.127204 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1651/3340] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:45.129100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4973694-c3fc-46f2-9f76-e8962e224452 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:45.133504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:45.134464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.134749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.135031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] PATH_INFO: `/v3/projects/94d4dd31cb2f45ebbadb90d56b9b393d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.147432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4973694-c3fc-46f2-9f76-e8962e224452 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:45.152226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d4dd31cb2f45ebbadb90d56b9b393d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:45.155144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:45.162635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ead43-53bb-4938-80c7-f79e7bd85ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:45.163596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ead43-53bb-4938-80c7-f79e7bd85ffc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.164016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ead43-53bb-4938-80c7-f79e7bd85ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.164395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ead43-53bb-4938-80c7-f79e7bd85ffc admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.165927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ead43-53bb-4938-80c7-f79e7bd85ffc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:55:45.171427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ead43-53bb-4938-80c7-f79e7bd85ffc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:45.173464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ead43-53bb-4938-80c7-f79e7bd85ffc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:45.195726 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1652/3341] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:45.197172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ead43-53bb-4938-80c7-f79e7bd85ffc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:45.208899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ead43-53bb-4938-80c7-f79e7bd85ffc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:45.215909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2e4b6-3dd3-4820-bbd0-be4678ba5018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:45.216940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2e4b6-3dd3-4820-bbd0-be4678ba5018 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.217620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2e4b6-3dd3-4820-bbd0-be4678ba5018 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.218138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2e4b6-3dd3-4820-bbd0-be4678ba5018 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.220684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2e4b6-3dd3-4820-bbd0-be4678ba5018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:45.223045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2e4b6-3dd3-4820-bbd0-be4678ba5018 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:45.286261 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1653/3342] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:45 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:45.288446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2e4b6-3dd3-4820-bbd0-be4678ba5018 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:45.332530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d4dd31cb2f45ebbadb90d56b9b393d', 'request_id': 'req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:45.366426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d4dd31cb2f45ebbadb90d56b9b393d', 'request_id': 'req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:45.388262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d4dd31cb2f45ebbadb90d56b9b393d', 'request_id': 'req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:45.418187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] The token cache is being invalidate because project 94d4dd31cb2f45ebbadb90d56b9b393d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:45.418489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:45.421187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ce450a3-0a14-4f67-8d4a-ff92ab8bd47f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:45.429280 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1690/3343] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:45 2022] DELETE /identity/v3/projects/94d4dd31cb2f45ebbadb90d56b9b393d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:45.430841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7622db-2d93-4727-8d7f-572e60d4e340 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.431133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7622db-2d93-4727-8d7f-572e60d4e340 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.431411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7622db-2d93-4727-8d7f-572e60d4e340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.441320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2e4b6-3dd3-4820-bbd0-be4678ba5018 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:45.476250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5d7622db-2d93-4727-8d7f-572e60d4e340 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:45.477706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5d7622db-2d93-4727-8d7f-572e60d4e340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:45.626630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26f649-d685-4950-aa1c-bb81570ed033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:45.627378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26f649-d685-4950-aa1c-bb81570ed033 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.627679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26f649-d685-4950-aa1c-bb81570ed033 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.628390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e26f649-d685-4950-aa1c-bb81570ed033 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.629031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26f649-d685-4950-aa1c-bb81570ed033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:45.631263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e26f649-d685-4950-aa1c-bb81570ed033 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:45.676486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1654/3344] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:45 2022] POST /identity/v3/users => generated 289 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:45.681410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26f649-d685-4950-aa1c-bb81570ed033 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:45.683248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e26f649-d685-4950-aa1c-bb81570ed033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:45.700293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e26f649-d685-4950-aa1c-bb81570ed033 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:45.715861 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1691/3345] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:45.717691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8f316-8057-45ec-9ad0-30d409942836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:45.718500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f316-8057-45ec-9ad0-30d409942836 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.718669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f316-8057-45ec-9ad0-30d409942836 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.718947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8f316-8057-45ec-9ad0-30d409942836 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.722374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8f316-8057-45ec-9ad0-30d409942836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:45.724117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff478f8-d558-47d1-afd0-b9f1c173462a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.724504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff478f8-d558-47d1-afd0-b9f1c173462a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.724881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff478f8-d558-47d1-afd0-b9f1c173462a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.726319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8f316-8057-45ec-9ad0-30d409942836 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:45.744720 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1655/3346] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:45.762307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8f316-8057-45ec-9ad0-30d409942836 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:45.785885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6ff478f8-d558-47d1-afd0-b9f1c173462a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:45.788648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6ff478f8-d558-47d1-afd0-b9f1c173462a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:45.805459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8f316-8057-45ec-9ad0-30d409942836 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:45.825704 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1692/3347] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:45.830578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6a44e-5523-44d2-a66a-f9586f9395f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:45.830578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6a44e-5523-44d2-a66a-f9586f9395f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.836733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6a44e-5523-44d2-a66a-f9586f9395f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.837443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff478f8-d558-47d1-afd0-b9f1c173462a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:45.837537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6a44e-5523-44d2-a66a-f9586f9395f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.844216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6a44e-5523-44d2-a66a-f9586f9395f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:45.851901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6a44e-5523-44d2-a66a-f9586f9395f0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:45.858935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff478f8-d558-47d1-afd0-b9f1c173462a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:45.879406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb90973-4551-4e59-b419-0015d7767528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:45.880106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb90973-4551-4e59-b419-0015d7767528 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.880395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb90973-4551-4e59-b419-0015d7767528 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.880670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb90973-4551-4e59-b419-0015d7767528 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.881714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb90973-4551-4e59-b419-0015d7767528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:55:45.881714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb90973-4551-4e59-b419-0015d7767528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:45.886563 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1656/3348] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:45.886734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb90973-4551-4e59-b419-0015d7767528 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:45.887846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6a44e-5523-44d2-a66a-f9586f9395f0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:45.903707 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1693/3349] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:45.908978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb90973-4551-4e59-b419-0015d7767528 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:45.924020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb90973-4551-4e59-b419-0015d7767528 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:45.925744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6a44e-5523-44d2-a66a-f9586f9395f0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:45.938004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40c36-b251-4253-9cc0-3599ada30052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:45.938724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40c36-b251-4253-9cc0-3599ada30052 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.939007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40c36-b251-4253-9cc0-3599ada30052 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.939284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40c36-b251-4253-9cc0-3599ada30052 admin admin] PATH_INFO: `/v3/projects/71d58c339cd84f6891e4545c28bb7927/users/70fab8e4c45d48ea8223a3acc60a5442/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.946116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee3ed-ac75-4295-af3e-d47b5e36faca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:45.947356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee3ed-ac75-4295-af3e-d47b5e36faca admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:45.947638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee3ed-ac75-4295-af3e-d47b5e36faca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:45.951004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ee3ed-ac75-4295-af3e-d47b5e36faca admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:45.951735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ee3ed-ac75-4295-af3e-d47b5e36faca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:45.960028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9ee3ed-ac75-4295-af3e-d47b5e36faca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:45.976854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc40c36-b251-4253-9cc0-3599ada30052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d58c339cd84f6891e4545c28bb7927, user_id=70fab8e4c45d48ea8223a3acc60a5442, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:45.988392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc40c36-b251-4253-9cc0-3599ada30052 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:46.023260 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1657/3350] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:45 2022] PUT /identity/v3/projects/71d58c339cd84f6891e4545c28bb7927/users/70fab8e4c45d48ea8223a3acc60a5442/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:46.033987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaca76-cfeb-417c-a39a-91bc2cee5316 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:46.034289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaca76-cfeb-417c-a39a-91bc2cee5316 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:46.034574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbaca76-cfeb-417c-a39a-91bc2cee5316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:46.036384 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1694/3351] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:45 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:46.040540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee3ed-ac75-4295-af3e-d47b5e36faca admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:46.117337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1fbaca76-cfeb-417c-a39a-91bc2cee5316 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:46.124056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1fbaca76-cfeb-417c-a39a-91bc2cee5316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:46.211731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ee3ed-ac75-4295-af3e-d47b5e36faca admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:46.231822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a942e-31dd-4d09-81fd-3c4c7e6d71e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:46.234272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a942e-31dd-4d09-81fd-3c4c7e6d71e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:46.234558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a942e-31dd-4d09-81fd-3c4c7e6d71e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:46.234837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a942e-31dd-4d09-81fd-3c4c7e6d71e0 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:46.236126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a942e-31dd-4d09-81fd-3c4c7e6d71e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:46.238978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a942e-31dd-4d09-81fd-3c4c7e6d71e0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:46.266363 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1658/3352] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:46.271415 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1695/3353] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:46 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:55:46.272095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaca76-cfeb-417c-a39a-91bc2cee5316 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:46.291201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbaca76-cfeb-417c-a39a-91bc2cee5316 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:46.309403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a942e-31dd-4d09-81fd-3c4c7e6d71e0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:46.311315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be4a942e-31dd-4d09-81fd-3c4c7e6d71e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:46.327129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df431631-fc1c-4ea5-b218-81f74c85f392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:46.328491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df431631-fc1c-4ea5-b218-81f74c85f392 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:46.328491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df431631-fc1c-4ea5-b218-81f74c85f392 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:46.328755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df431631-fc1c-4ea5-b218-81f74c85f392 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:46.329272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df431631-fc1c-4ea5-b218-81f74c85f392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:46.330908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df431631-fc1c-4ea5-b218-81f74c85f392 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:46.351978 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1659/3354] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:46.357572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df431631-fc1c-4ea5-b218-81f74c85f392 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:46.374825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df431631-fc1c-4ea5-b218-81f74c85f392 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:46.388880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b91c-0bed-49c0-be28-09c558505043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:46.389721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b91c-0bed-49c0-be28-09c558505043 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:46.390006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b91c-0bed-49c0-be28-09c558505043 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:46.390792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531b91c-0bed-49c0-be28-09c558505043 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:46.391069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b91c-0bed-49c0-be28-09c558505043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:46.394251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531b91c-0bed-49c0-be28-09c558505043 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:46.418377 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1660/3355] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:46.424685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b91c-0bed-49c0-be28-09c558505043 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:46.441227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531b91c-0bed-49c0-be28-09c558505043 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:46.444023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a942e-31dd-4d09-81fd-3c4c7e6d71e0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:46.450041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacafda9-ac86-4490-a51c-186bb2429608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:46.452763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacafda9-ac86-4490-a51c-186bb2429608 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:46.453207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacafda9-ac86-4490-a51c-186bb2429608 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:46.453664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacafda9-ac86-4490-a51c-186bb2429608 admin admin] PATH_INFO: `/v3/projects/a6beb485658f40dc83598fd2e00800ad/users/3c658c4a7b9c4d7886127c3e40f359f7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:46.455569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4bf8fb-8c87-4878-b78a-38b43b592cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:46.456425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bf8fb-8c87-4878-b78a-38b43b592cfc service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:46.456555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bf8fb-8c87-4878-b78a-38b43b592cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:46.456806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4bf8fb-8c87-4878-b78a-38b43b592cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:46.472627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacafda9-ac86-4490-a51c-186bb2429608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6beb485658f40dc83598fd2e00800ad, user_id=3c658c4a7b9c4d7886127c3e40f359f7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:46.475597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacafda9-ac86-4490-a51c-186bb2429608 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:46.477299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bf8fb-8c87-4878-b78a-38b43b592cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:46.479286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4bf8fb-8c87-4878-b78a-38b43b592cfc service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:46.494987 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1696/3356] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:55:46.497774 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1661/3357] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:46 2022] PUT /identity/v3/projects/a6beb485658f40dc83598fd2e00800ad/users/3c658c4a7b9c4d7886127c3e40f359f7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:46.502641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b28a-fa44-458c-995f-d31752d9d957 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:46.502929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b28a-fa44-458c-995f-d31752d9d957 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:46.503205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b28a-fa44-458c-995f-d31752d9d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:46.525132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6655b28a-fa44-458c-995f-d31752d9d957 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:46.526330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6655b28a-fa44-458c-995f-d31752d9d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:46.598361 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1697/3358] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:46.608988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacafda9-ac86-4490-a51c-186bb2429608 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:46.610841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aacafda9-ac86-4490-a51c-186bb2429608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:46.756066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacafda9-ac86-4490-a51c-186bb2429608 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:46.771340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a39fb-38f2-412f-ae1f-0cbe9ec1abf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:46.771340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a39fb-38f2-412f-ae1f-0cbe9ec1abf8 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:46.771340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a39fb-38f2-412f-ae1f-0cbe9ec1abf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:46.771340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a39fb-38f2-412f-ae1f-0cbe9ec1abf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:46.787099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a39fb-38f2-412f-ae1f-0cbe9ec1abf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:46.788985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a39fb-38f2-412f-ae1f-0cbe9ec1abf8 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:46.802876 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1662/3359] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:47.583857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655b28a-fa44-458c-995f-d31752d9d957 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:47.585315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6655b28a-fa44-458c-995f-d31752d9d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:47.607571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655b28a-fa44-458c-995f-d31752d9d957 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:47.621053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:47.621946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:47.622227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:47.622499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] PATH_INFO: `/v3/users/b188ca4deda94cec85da4582a37fea72` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:47.623723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b188ca4deda94cec85da4582a37fea72)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:47.625685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:47.740367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b188ca4deda94cec85da4582a37fea72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:47.750997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b188ca4deda94cec85da4582a37fea72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:47.752708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b188ca4deda94cec85da4582a37fea72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:47.753599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b188ca4deda94cec85da4582a37fea72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:47.771480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f26d992f-b209-4a8f-aa85-9e49075d2261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b188ca4deda94cec85da4582a37fea72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:47.836196 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1698/3360] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:55:47 2022] DELETE /identity/v3/users/b188ca4deda94cec85da4582a37fea72 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:48.422758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a39fb-38f2-412f-ae1f-0cbe9ec1abf8 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:48.435527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a39fb-38f2-412f-ae1f-0cbe9ec1abf8 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:48.469613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30451-174f-4e35-90ec-4281fd87c48a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:48.469881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30451-174f-4e35-90ec-4281fd87c48a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:48.470157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e30451-174f-4e35-90ec-4281fd87c48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:48.590992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-59e30451-174f-4e35-90ec-4281fd87c48a None None] MFA Rules not processed for user `3c658c4a7b9c4d7886127c3e40f359f7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:48.592264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-59e30451-174f-4e35-90ec-4281fd87c48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:48.693673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:48.694533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:48.697161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:48.699644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] PATH_INFO: `/v3/projects/2aa3ac21589f496b83c20104323f4bb2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:48.707341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa3ac21589f496b83c20104323f4bb2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:48.715205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:48.807761 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1699/3361] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:55:48.809842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa06e56-29ec-4d10-abe0-80896960b375 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:48.810339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa06e56-29ec-4d10-abe0-80896960b375 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:48.810815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa06e56-29ec-4d10-abe0-80896960b375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:48.846141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa3ac21589f496b83c20104323f4bb2', 'request_id': 'req-39640080-c5ac-4cb3-8c08-6471ef5da285'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:48.862475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1fa06e56-29ec-4d10-abe0-80896960b375 None None] MFA Rules not processed for user `3c658c4a7b9c4d7886127c3e40f359f7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:48.864819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1fa06e56-29ec-4d10-abe0-80896960b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:48.867838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa3ac21589f496b83c20104323f4bb2', 'request_id': 'req-39640080-c5ac-4cb3-8c08-6471ef5da285'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:48.875794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa3ac21589f496b83c20104323f4bb2', 'request_id': 'req-39640080-c5ac-4cb3-8c08-6471ef5da285'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:48.902752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] The token cache is being invalidate because project 2aa3ac21589f496b83c20104323f4bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:55:48.903045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:48.904683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-39640080-c5ac-4cb3-8c08-6471ef5da285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:55:48.908260 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1663/3362] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:55:48 2022] DELETE /identity/v3/projects/2aa3ac21589f496b83c20104323f4bb2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:48.914761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150a387-09a9-4b18-bbc5-d1796ab9be41 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:48.917684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150a387-09a9-4b18-bbc5-d1796ab9be41 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:48.918149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150a387-09a9-4b18-bbc5-d1796ab9be41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:48.962526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2150a387-09a9-4b18-bbc5-d1796ab9be41 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:48.963745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2150a387-09a9-4b18-bbc5-d1796ab9be41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:49.019674 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1700/3363] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:49.021190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d163391-e486-46dc-ade5-b9370c016a84 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.021479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d163391-e486-46dc-ade5-b9370c016a84 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.021756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d163391-e486-46dc-ade5-b9370c016a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:49.062977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1d163391-e486-46dc-ade5-b9370c016a84 None None] MFA Rules not processed for user `3c658c4a7b9c4d7886127c3e40f359f7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:49.066093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1d163391-e486-46dc-ade5-b9370c016a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:49.079183 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1701/3364] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:49.110184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e617-54c4-4393-9af2-da69a54c18b0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.110461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e617-54c4-4393-9af2-da69a54c18b0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.111088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24e617-54c4-4393-9af2-da69a54c18b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:49.114470 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1664/3365] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:49.145065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fd24e617-54c4-4393-9af2-da69a54c18b0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:49.146300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fd24e617-54c4-4393-9af2-da69a54c18b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:49.176544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150a387-09a9-4b18-bbc5-d1796ab9be41 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:49.184147 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1702/3366] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:49.194918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150a387-09a9-4b18-bbc5-d1796ab9be41 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:49.222391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85722863-fd41-42ed-b5fb-427806811f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:49.227131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85722863-fd41-42ed-b5fb-427806811f28 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.227818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85722863-fd41-42ed-b5fb-427806811f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.228319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85722863-fd41-42ed-b5fb-427806811f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:49.233982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85722863-fd41-42ed-b5fb-427806811f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:55:49.234501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85722863-fd41-42ed-b5fb-427806811f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:49.237978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85722863-fd41-42ed-b5fb-427806811f28 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:49.286722 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1665/3367] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:55:49.290520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e617-54c4-4393-9af2-da69a54c18b0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:49.302924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24e617-54c4-4393-9af2-da69a54c18b0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:49.308311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3d8fe-2804-41c9-b47d-7620ae35a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:49.309285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3d8fe-2804-41c9-b47d-7620ae35a327 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.309751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3d8fe-2804-41c9-b47d-7620ae35a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.310178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3d8fe-2804-41c9-b47d-7620ae35a327 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:49.311644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3d8fe-2804-41c9-b47d-7620ae35a327 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:49.314025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3d8fe-2804-41c9-b47d-7620ae35a327 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:49.366109 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1703/3368] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:55:49 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:55:49.366619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85722863-fd41-42ed-b5fb-427806811f28 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:49.382119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85722863-fd41-42ed-b5fb-427806811f28 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:49.417178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3d8fe-2804-41c9-b47d-7620ae35a327 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:49.419877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-06c3d8fe-2804-41c9-b47d-7620ae35a327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:49.528604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76081a6c-b4a1-4ec5-88b3-162b36bb2cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:49.530606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76081a6c-b4a1-4ec5-88b3-162b36bb2cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.531103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76081a6c-b4a1-4ec5-88b3-162b36bb2cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.531544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76081a6c-b4a1-4ec5-88b3-162b36bb2cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:49.532764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76081a6c-b4a1-4ec5-88b3-162b36bb2cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:49.538439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76081a6c-b4a1-4ec5-88b3-162b36bb2cf0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:49.553132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3d8fe-2804-41c9-b47d-7620ae35a327 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:49.563097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09b8db-8330-476c-807e-7967c5d832d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:49.563972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09b8db-8330-476c-807e-7967c5d832d9 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.564260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09b8db-8330-476c-807e-7967c5d832d9 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.564544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09b8db-8330-476c-807e-7967c5d832d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:49.574324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ef09b8db-8330-476c-807e-7967c5d832d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:49.598421 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1666/3369] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:55:49 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:55:49.613398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76081a6c-b4a1-4ec5-88b3-162b36bb2cf0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:49.656108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76081a6c-b4a1-4ec5-88b3-162b36bb2cf0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:49.679508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297e080-206a-4fa0-b381-d0d6a9c5b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:49.682933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297e080-206a-4fa0-b381-d0d6a9c5b248 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.684971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297e080-206a-4fa0-b381-d0d6a9c5b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.685368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297e080-206a-4fa0-b381-d0d6a9c5b248 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:49.692312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297e080-206a-4fa0-b381-d0d6a9c5b248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:49.702941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297e080-206a-4fa0-b381-d0d6a9c5b248 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:49.717615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09b8db-8330-476c-807e-7967c5d832d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:49.719394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09b8db-8330-476c-807e-7967c5d832d9 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:49.753250 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1704/3370] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:55:49.756164 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1667/3371] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:49.763188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09b8db-8330-476c-807e-7967c5d832d9 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:49.805004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09b8db-8330-476c-807e-7967c5d832d9 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:49.816691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a7e28-646b-4345-88fe-0c27ebf4d9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:49.817367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7e28-646b-4345-88fe-0c27ebf4d9fe admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.817644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7e28-646b-4345-88fe-0c27ebf4d9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.817980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a7e28-646b-4345-88fe-0c27ebf4d9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:49.824127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a7e28-646b-4345-88fe-0c27ebf4d9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:49.825769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a7e28-646b-4345-88fe-0c27ebf4d9fe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:49.853055 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1705/3372] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:55:49.858478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297e080-206a-4fa0-b381-d0d6a9c5b248 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:49.872333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297e080-206a-4fa0-b381-d0d6a9c5b248 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:49.891903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc2754-896f-4574-95c7-ee2a2da7bf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:49.895757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc2754-896f-4574-95c7-ee2a2da7bf04 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.896846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc2754-896f-4574-95c7-ee2a2da7bf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.897370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc2754-896f-4574-95c7-ee2a2da7bf04 admin admin] PATH_INFO: `/v3/projects/fb6fc427c1a34e1e82749e6035a27b92/users/890dc80d77a04a8a8a3f2e0194f06ca6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:49.919657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc2754-896f-4574-95c7-ee2a2da7bf04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6fc427c1a34e1e82749e6035a27b92, user_id=890dc80d77a04a8a8a3f2e0194f06ca6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:49.922488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc2754-896f-4574-95c7-ee2a2da7bf04 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:49.946539 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1668/3373] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:55:49 2022] PUT /identity/v3/projects/fb6fc427c1a34e1e82749e6035a27b92/users/890dc80d77a04a8a8a3f2e0194f06ca6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:55:49.956832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14db86-1202-4776-94c0-d862e02b3729 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:49.957052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14db86-1202-4776-94c0-d862e02b3729 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:49.957483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14db86-1202-4776-94c0-d862e02b3729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:50.018240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-de14db86-1202-4776-94c0-d862e02b3729 None None] MFA Rules not processed for user `890dc80d77a04a8a8a3f2e0194f06ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:50.020863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-de14db86-1202-4776-94c0-d862e02b3729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:50.162472 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1706/3374] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:50.175191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc2754-896f-4574-95c7-ee2a2da7bf04 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:55:50.177377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d6dc2754-896f-4574-95c7-ee2a2da7bf04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:50.292801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc2754-896f-4574-95c7-ee2a2da7bf04 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:55:50.297989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309cda9-a654-406d-bc80-9caeca019b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:55:50.298693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309cda9-a654-406d-bc80-9caeca019b4e service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:50.298932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309cda9-a654-406d-bc80-9caeca019b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:50.299353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309cda9-a654-406d-bc80-9caeca019b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:50.313817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309cda9-a654-406d-bc80-9caeca019b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:55:50.316406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b309cda9-a654-406d-bc80-9caeca019b4e service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:55:50.348731 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1669/3375] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:55:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:55:52.405478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d49a6a-bd72-4f29-91a8-7a92d2435e64 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:52.406501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d49a6a-bd72-4f29-91a8-7a92d2435e64 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:52.407131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d49a6a-bd72-4f29-91a8-7a92d2435e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:52.479404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-82d49a6a-bd72-4f29-91a8-7a92d2435e64 None None] MFA Rules not processed for user `3c658c4a7b9c4d7886127c3e40f359f7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:52.482504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82d49a6a-bd72-4f29-91a8-7a92d2435e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:52.653816 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1707/3376] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:55:54.960438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c1693-73da-45b6-abd9-c68ac9e8dd83 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:55:54.961417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c1693-73da-45b6-abd9-c68ac9e8dd83 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:55:54.962352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c1693-73da-45b6-abd9-c68ac9e8dd83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:55:55.043785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c56c1693-73da-45b6-abd9-c68ac9e8dd83 None None] MFA Rules not processed for user `3c658c4a7b9c4d7886127c3e40f359f7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:55:55.049638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c56c1693-73da-45b6-abd9-c68ac9e8dd83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:55:55.080305 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1670/3377] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:55:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:01.683206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d49a6a-bd72-4f29-91a8-7a92d2435e64 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:01.685586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82d49a6a-bd72-4f29-91a8-7a92d2435e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:01.856895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d49a6a-bd72-4f29-91a8-7a92d2435e64 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:01.870842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:01.873160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:01.875084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:01.876778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] PATH_INFO: `/v3/users/c748958cc2c64a5c9f7af16cae37c969` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:01.880884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c748958cc2c64a5c9f7af16cae37c969)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:01.890351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:02.083271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c748958cc2c64a5c9f7af16cae37c969'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:02.111210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c748958cc2c64a5c9f7af16cae37c969'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:02.112456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c748958cc2c64a5c9f7af16cae37c969'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:02.113712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c748958cc2c64a5c9f7af16cae37c969'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:02.130657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca1d7651-91c9-4b72-a153-a37ec3139651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c748958cc2c64a5c9f7af16cae37c969'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:02.193352 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1708/3378] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:01 2022] DELETE /identity/v3/users/c748958cc2c64a5c9f7af16cae37c969 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:03.051458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c1693-73da-45b6-abd9-c68ac9e8dd83 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:03.065655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c1693-73da-45b6-abd9-c68ac9e8dd83 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:03.172985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:03.174510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:03.174963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:03.175412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] PATH_INFO: `/v3/projects/4dadd4e8f76f462b9f22b4211c7d5d47` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:03.178151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dadd4e8f76f462b9f22b4211c7d5d47)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:03.180852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:03.309581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dadd4e8f76f462b9f22b4211c7d5d47', 'request_id': 'req-f5a61637-c52f-4650-99af-da702810a192'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:03.328376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dadd4e8f76f462b9f22b4211c7d5d47', 'request_id': 'req-f5a61637-c52f-4650-99af-da702810a192'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:03.340493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dadd4e8f76f462b9f22b4211c7d5d47', 'request_id': 'req-f5a61637-c52f-4650-99af-da702810a192'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:03.361319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] The token cache is being invalidate because project 4dadd4e8f76f462b9f22b4211c7d5d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:03.361657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:03.362782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f5a61637-c52f-4650-99af-da702810a192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:03.364870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1671/3379] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:03 2022] DELETE /identity/v3/projects/4dadd4e8f76f462b9f22b4211c7d5d47 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:56:03.370728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2e9ca-7ac6-424a-becc-df7ff1b8b575 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:03.373099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2e9ca-7ac6-424a-becc-df7ff1b8b575 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:03.374210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2e9ca-7ac6-424a-becc-df7ff1b8b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:03.407059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a3a2e9ca-7ac6-424a-becc-df7ff1b8b575 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:03.408674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a3a2e9ca-7ac6-424a-becc-df7ff1b8b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:03.505631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a7b32-e37b-4701-8f7f-84a2e645ba41 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:03.506407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a7b32-e37b-4701-8f7f-84a2e645ba41 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:03.506953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a7b32-e37b-4701-8f7f-84a2e645ba41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:03.514515 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1709/3380] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:03.527205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f41a7b32-e37b-4701-8f7f-84a2e645ba41 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:03.528975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f41a7b32-e37b-4701-8f7f-84a2e645ba41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:03.543802 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1672/3381] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:03.545193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2e9ca-7ac6-424a-becc-df7ff1b8b575 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:03.556519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2e9ca-7ac6-424a-becc-df7ff1b8b575 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:03.563367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd312717-0393-402b-9e09-e4b891fa235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:03.563953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd312717-0393-402b-9e09-e4b891fa235b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:03.564413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd312717-0393-402b-9e09-e4b891fa235b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:03.564916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd312717-0393-402b-9e09-e4b891fa235b admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:03.565916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd312717-0393-402b-9e09-e4b891fa235b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:03.566333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd312717-0393-402b-9e09-e4b891fa235b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:03.569513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd312717-0393-402b-9e09-e4b891fa235b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:03.592092 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1710/3382] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:56:03.595219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a7b32-e37b-4701-8f7f-84a2e645ba41 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:03.606112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a7b32-e37b-4701-8f7f-84a2e645ba41 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:03.611896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a844-89a3-42e4-a264-e08c64e9d51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:03.614724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a844-89a3-42e4-a264-e08c64e9d51e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:03.615288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a844-89a3-42e4-a264-e08c64e9d51e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:03.615776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a844-89a3-42e4-a264-e08c64e9d51e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:03.616680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9a844-89a3-42e4-a264-e08c64e9d51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:03.619844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9a844-89a3-42e4-a264-e08c64e9d51e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:03.666812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd312717-0393-402b-9e09-e4b891fa235b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:03.683215 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1673/3383] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:03 2022] POST /identity/v3/projects => generated 397 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:03.685512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd312717-0393-402b-9e09-e4b891fa235b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:03.853062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99016f2e-d2af-4b89-9a8e-029bd5d8bcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:03.854270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016f2e-d2af-4b89-9a8e-029bd5d8bcdd admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:03.856065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a844-89a3-42e4-a264-e08c64e9d51e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:03.858324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-92a9a844-89a3-42e4-a264-e08c64e9d51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:03.870895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016f2e-d2af-4b89-9a8e-029bd5d8bcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:03.872279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016f2e-d2af-4b89-9a8e-029bd5d8bcdd admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:03.875192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99016f2e-d2af-4b89-9a8e-029bd5d8bcdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:03.878820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99016f2e-d2af-4b89-9a8e-029bd5d8bcdd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:03.950926 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1711/3384] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:03 2022] POST /identity/v3/users => generated 299 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:03.955666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99016f2e-d2af-4b89-9a8e-029bd5d8bcdd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:03.974590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99016f2e-d2af-4b89-9a8e-029bd5d8bcdd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:03.985466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75069841-d887-4a71-a765-9c8976cabd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:03.986170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75069841-d887-4a71-a765-9c8976cabd00 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:03.986456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75069841-d887-4a71-a765-9c8976cabd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:03.986831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75069841-d887-4a71-a765-9c8976cabd00 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:03.987571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75069841-d887-4a71-a765-9c8976cabd00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:03.989231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75069841-d887-4a71-a765-9c8976cabd00 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:04.010658 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1712/3385] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:56:04.019338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75069841-d887-4a71-a765-9c8976cabd00 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:04.040777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75069841-d887-4a71-a765-9c8976cabd00 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:04.057861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135bf1-db3f-4b95-b0b5-494f45acc573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:04.058853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135bf1-db3f-4b95-b0b5-494f45acc573 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:04.059319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135bf1-db3f-4b95-b0b5-494f45acc573 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:04.059785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135bf1-db3f-4b95-b0b5-494f45acc573 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:04.060712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135bf1-db3f-4b95-b0b5-494f45acc573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:04.062501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135bf1-db3f-4b95-b0b5-494f45acc573 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:04.065349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a844-89a3-42e4-a264-e08c64e9d51e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:04.083344 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1713/3386] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:04.088491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135bf1-db3f-4b95-b0b5-494f45acc573 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:04.094267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:04.095701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:04.096269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:04.096788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:04.101879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:04.107279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135bf1-db3f-4b95-b0b5-494f45acc573 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:04.124106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e705183-7d40-485c-89eb-5e778eb4ad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:04.124859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e705183-7d40-485c-89eb-5e778eb4ad97 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:04.125143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e705183-7d40-485c-89eb-5e778eb4ad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:04.125443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e705183-7d40-485c-89eb-5e778eb4ad97 admin admin] PATH_INFO: `/v3/projects/1e309921cfc047bda328e3ad23aa5e7a/users/563bce524229478faa4886b1d2285114/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:04.160940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e705183-7d40-485c-89eb-5e778eb4ad97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e309921cfc047bda328e3ad23aa5e7a, user_id=563bce524229478faa4886b1d2285114, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:04.163706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e705183-7d40-485c-89eb-5e778eb4ad97 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:04.195375 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1714/3387] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:04 2022] PUT /identity/v3/projects/1e309921cfc047bda328e3ad23aa5e7a/users/563bce524229478faa4886b1d2285114/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:04.201162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda53454-42d0-49a7-b52d-509bf2f226a4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:04.201442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda53454-42d0-49a7-b52d-509bf2f226a4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:04.201727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda53454-42d0-49a7-b52d-509bf2f226a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:04.215496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:04.218440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:04.242210 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1674/3388] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:56:04.249783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fda53454-42d0-49a7-b52d-509bf2f226a4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:04.257827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fda53454-42d0-49a7-b52d-509bf2f226a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:04.370976 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1715/3389] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:04.416224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:04.418306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:04.436394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc97719-1beb-4583-ae87-3195e0fc0cba service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:04.441221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:04.442413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:04.442811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:04.445018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] PATH_INFO: `/v3/users/890dc80d77a04a8a8a3f2e0194f06ca6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:04.448792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=890dc80d77a04a8a8a3f2e0194f06ca6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:04.451044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:04.463571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda53454-42d0-49a7-b52d-509bf2f226a4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:04.465246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fda53454-42d0-49a7-b52d-509bf2f226a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:04.593359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '890dc80d77a04a8a8a3f2e0194f06ca6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:04.602796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda53454-42d0-49a7-b52d-509bf2f226a4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:04.605511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '890dc80d77a04a8a8a3f2e0194f06ca6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:04.607646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '890dc80d77a04a8a8a3f2e0194f06ca6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:04.609890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '890dc80d77a04a8a8a3f2e0194f06ca6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:04.613737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:04.616448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:04.617609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:04.619537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:04.625299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:04.650634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c7774be9-a9c2-45b2-8a2f-4568a09dbac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '890dc80d77a04a8a8a3f2e0194f06ca6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:04.661146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:04.664279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:04.688224 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1675/3390] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:04 2022] DELETE /identity/v3/users/890dc80d77a04a8a8a3f2e0194f06ca6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:04.693153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e46ad-4d6a-4aa2-80a6-b5444b94bb2f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:04.693825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e46ad-4d6a-4aa2-80a6-b5444b94bb2f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:04.701338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e46ad-4d6a-4aa2-80a6-b5444b94bb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:04.703605 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1716/3391] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:56:04.764215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6e7e46ad-4d6a-4aa2-80a6-b5444b94bb2f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:04.770260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6e7e46ad-4d6a-4aa2-80a6-b5444b94bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:04.928227 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1676/3392] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:04.942204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:04.943812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:04.969005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f98bc-1ef3-4991-a355-5b35bde666de service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:05.086061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3530d-dfb3-4311-a71b-0a6219c42b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:05.086494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3530d-dfb3-4311-a71b-0a6219c42b37 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:05.086963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3530d-dfb3-4311-a71b-0a6219c42b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:05.087237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3530d-dfb3-4311-a71b-0a6219c42b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:05.108641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3530d-dfb3-4311-a71b-0a6219c42b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:05.110112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3530d-dfb3-4311-a71b-0a6219c42b37 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:05.132820 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1717/3393] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:05.428596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50023-488e-4de5-bf16-ce9bbf780de8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:05.429197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50023-488e-4de5-bf16-ce9bbf780de8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:05.430044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b50023-488e-4de5-bf16-ce9bbf780de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:05.525931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-23b50023-488e-4de5-bf16-ce9bbf780de8 None None] MFA Rules not processed for user `70fab8e4c45d48ea8223a3acc60a5442`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:05.527356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-23b50023-488e-4de5-bf16-ce9bbf780de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:05.764126 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1677/3394] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:05.857835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3530d-dfb3-4311-a71b-0a6219c42b37 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:05.860005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-69c3530d-dfb3-4311-a71b-0a6219c42b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:05.937106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13cf0-86f1-4b52-9f0d-6392561925c3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:05.937648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13cf0-86f1-4b52-9f0d-6392561925c3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:05.938152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d13cf0-86f1-4b52-9f0d-6392561925c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:05.984717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e8d13cf0-86f1-4b52-9f0d-6392561925c3 None None] MFA Rules not processed for user `4c8199b3248742a7ba0d0cb6570c7058`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:05.993298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e8d13cf0-86f1-4b52-9f0d-6392561925c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:06.073669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3530d-dfb3-4311-a71b-0a6219c42b37 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:06.087618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5f05f-db2a-467e-a3cd-a3f82216d7c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:06.088378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f05f-db2a-467e-a3cd-a3f82216d7c1 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:06.088626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f05f-db2a-467e-a3cd-a3f82216d7c1 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:06.088895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5f05f-db2a-467e-a3cd-a3f82216d7c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:06.114615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5f05f-db2a-467e-a3cd-a3f82216d7c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:06.119340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5f05f-db2a-467e-a3cd-a3f82216d7c1 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:06.141267 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1718/3395] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:06.241935 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1678/3396] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:07.466967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5f05f-db2a-467e-a3cd-a3f82216d7c1 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:07.468600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-58b5f05f-db2a-467e-a3cd-a3f82216d7c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:07.520448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5f05f-db2a-467e-a3cd-a3f82216d7c1 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:07.532152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:07.533093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:07.533448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:07.533921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] PATH_INFO: `/v3/projects/fb6fc427c1a34e1e82749e6035a27b92` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:07.535520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6fc427c1a34e1e82749e6035a27b92)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:07.538431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:07.631082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6fc427c1a34e1e82749e6035a27b92', 'request_id': 'req-6be69747-2b7f-41ef-b21a-00c6374d1240'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:07.658011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6fc427c1a34e1e82749e6035a27b92', 'request_id': 'req-6be69747-2b7f-41ef-b21a-00c6374d1240'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:07.674415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6fc427c1a34e1e82749e6035a27b92', 'request_id': 'req-6be69747-2b7f-41ef-b21a-00c6374d1240'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:07.723178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] The token cache is being invalidate because project fb6fc427c1a34e1e82749e6035a27b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:07.723473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:07.724643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6be69747-2b7f-41ef-b21a-00c6374d1240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:07.731295 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1719/3397] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:07 2022] DELETE /identity/v3/projects/fb6fc427c1a34e1e82749e6035a27b92 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:07.737694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62cf4-649f-44ca-9326-259bad39acc8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:07.738886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62cf4-649f-44ca-9326-259bad39acc8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:07.739386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b62cf4-649f-44ca-9326-259bad39acc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:07.777317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a2b62cf4-649f-44ca-9326-259bad39acc8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:07.778806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a2b62cf4-649f-44ca-9326-259bad39acc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:07.890340 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1679/3398] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:07.897982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8d39-4446-4927-bd21-32c153c0df74 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:07.901318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8d39-4446-4927-bd21-32c153c0df74 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:07.902634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e8d39-4446-4927-bd21-32c153c0df74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:07.938421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0f2e8d39-4446-4927-bd21-32c153c0df74 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:07.941909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f2e8d39-4446-4927-bd21-32c153c0df74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:07.956804 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1720/3399] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:07.960470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b62cf4-649f-44ca-9326-259bad39acc8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:07.974960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b62cf4-649f-44ca-9326-259bad39acc8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:07.982807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e8181-ad96-47b8-916a-9d8c6adf9595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:07.985687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e8181-ad96-47b8-916a-9d8c6adf9595 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:07.986230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e8181-ad96-47b8-916a-9d8c6adf9595 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:07.986905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e8181-ad96-47b8-916a-9d8c6adf9595 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:07.988179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e8181-ad96-47b8-916a-9d8c6adf9595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:07.989015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e8181-ad96-47b8-916a-9d8c6adf9595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:07.991545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e8181-ad96-47b8-916a-9d8c6adf9595 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:08.022482 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1680/3400] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:08.025401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8d39-4446-4927-bd21-32c153c0df74 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:08.059220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e8d39-4446-4927-bd21-32c153c0df74 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:08.075085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f1754-e03e-4aa8-84ce-e2c7ba2c137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:08.076701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1754-e03e-4aa8-84ce-e2c7ba2c137d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:08.080113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1754-e03e-4aa8-84ce-e2c7ba2c137d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:08.080991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1754-e03e-4aa8-84ce-e2c7ba2c137d admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:08.093253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1754-e03e-4aa8-84ce-e2c7ba2c137d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:08.100181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1754-e03e-4aa8-84ce-e2c7ba2c137d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:08.230010 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1721/3401] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:08 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:08.231642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e8181-ad96-47b8-916a-9d8c6adf9595 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:08.263502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e8181-ad96-47b8-916a-9d8c6adf9595 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:08.469604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6aa43-c5a2-4dbf-b698-44792ee4f643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:08.470297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6aa43-c5a2-4dbf-b698-44792ee4f643 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:08.470585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6aa43-c5a2-4dbf-b698-44792ee4f643 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:08.470860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6aa43-c5a2-4dbf-b698-44792ee4f643 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:08.471605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6aa43-c5a2-4dbf-b698-44792ee4f643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:08.475881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6aa43-c5a2-4dbf-b698-44792ee4f643 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:08.526530 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1681/3402] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:08 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:08.528426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f1754-e03e-4aa8-84ce-e2c7ba2c137d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:08.540816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f1754-e03e-4aa8-84ce-e2c7ba2c137d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:08.582142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759fe2-9fd4-49e7-9024-6860102e94fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:08.584768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759fe2-9fd4-49e7-9024-6860102e94fd admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:08.587944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759fe2-9fd4-49e7-9024-6860102e94fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:08.619847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8759fe2-9fd4-49e7-9024-6860102e94fd admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:08.619847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8759fe2-9fd4-49e7-9024-6860102e94fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:08.619847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8759fe2-9fd4-49e7-9024-6860102e94fd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:08.654285 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1722/3403] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:08.657997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6aa43-c5a2-4dbf-b698-44792ee4f643 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:08.678682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6aa43-c5a2-4dbf-b698-44792ee4f643 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:08.695619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a1f70-e2d7-4fd8-895c-7f8f4d94a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:08.696380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a1f70-e2d7-4fd8-895c-7f8f4d94a514 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:08.696663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a1f70-e2d7-4fd8-895c-7f8f4d94a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:08.696945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a1f70-e2d7-4fd8-895c-7f8f4d94a514 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:08.698845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a1f70-e2d7-4fd8-895c-7f8f4d94a514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:08.702366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a1f70-e2d7-4fd8-895c-7f8f4d94a514 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:08.731861 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1682/3404] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:08.733294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759fe2-9fd4-49e7-9024-6860102e94fd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:08.749952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8759fe2-9fd4-49e7-9024-6860102e94fd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:08.764031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85dcc-d9a1-4a24-a870-eeabdc6e8a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:08.764993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85dcc-d9a1-4a24-a870-eeabdc6e8a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:08.766003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85dcc-d9a1-4a24-a870-eeabdc6e8a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:08.766294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c85dcc-d9a1-4a24-a870-eeabdc6e8a02 admin admin] PATH_INFO: `/v3/projects/4c0f2655489a435b902fd1a40393aa77/users/b676a570ed78444fa4f722d1e7a38115/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:08.806980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c85dcc-d9a1-4a24-a870-eeabdc6e8a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0f2655489a435b902fd1a40393aa77, user_id=b676a570ed78444fa4f722d1e7a38115, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:08.809776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c85dcc-d9a1-4a24-a870-eeabdc6e8a02 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:08.861223 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1723/3405] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:08 2022] PUT /identity/v3/projects/4c0f2655489a435b902fd1a40393aa77/users/b676a570ed78444fa4f722d1e7a38115/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:08.874001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653da152-ebdc-49b6-ab2a-42fad7304bfd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:08.874874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653da152-ebdc-49b6-ab2a-42fad7304bfd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:08.875380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653da152-ebdc-49b6-ab2a-42fad7304bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:08.948526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-653da152-ebdc-49b6-ab2a-42fad7304bfd None None] MFA Rules not processed for user `b676a570ed78444fa4f722d1e7a38115`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:08.950210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-653da152-ebdc-49b6-ab2a-42fad7304bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:09.121714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85dcc-d9a1-4a24-a870-eeabdc6e8a02 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:09.131853 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1683/3406] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:09.152594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047fd45-bfc8-442f-897e-253f664d77c9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:09.153086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047fd45-bfc8-442f-897e-253f664d77c9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:09.153236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047fd45-bfc8-442f-897e-253f664d77c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:09.207744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3047fd45-bfc8-442f-897e-253f664d77c9 None None] MFA Rules not processed for user `563bce524229478faa4886b1d2285114`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:09.209041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3047fd45-bfc8-442f-897e-253f664d77c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:09.325204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c85dcc-d9a1-4a24-a870-eeabdc6e8a02 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:09.348181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502e510-244f-4798-a740-4555045874af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:09.348863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502e510-244f-4798-a740-4555045874af admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:09.349146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502e510-244f-4798-a740-4555045874af admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:09.352018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502e510-244f-4798-a740-4555045874af admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:09.353410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502e510-244f-4798-a740-4555045874af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:09.355370 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1684/3407] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:09.363203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502e510-244f-4798-a740-4555045874af admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:09.371399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd421c-3644-4952-b1f9-7d9d849d6fe7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:09.371756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd421c-3644-4952-b1f9-7d9d849d6fe7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:09.372061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd421c-3644-4952-b1f9-7d9d849d6fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:09.397439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a7fd421c-3644-4952-b1f9-7d9d849d6fe7 None None] MFA Rules not processed for user `563bce524229478faa4886b1d2285114`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:09.399780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a7fd421c-3644-4952-b1f9-7d9d849d6fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:09.434198 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1685/3408] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:09.436832 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1724/3409] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:09 2022] POST /identity/v3/projects => generated 387 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:09.443429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd421c-3644-4952-b1f9-7d9d849d6fe7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:09.472846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fd421c-3644-4952-b1f9-7d9d849d6fe7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:09.594952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502e510-244f-4798-a740-4555045874af admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:09.597157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2502e510-244f-4798-a740-4555045874af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:09.668692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafaa733-d06d-4530-b6fc-c025738a6444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:09.670473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafaa733-d06d-4530-b6fc-c025738a6444 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:09.670785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafaa733-d06d-4530-b6fc-c025738a6444 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:09.671059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafaa733-d06d-4530-b6fc-c025738a6444 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:09.672298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafaa733-d06d-4530-b6fc-c025738a6444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:09.674585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafaa733-d06d-4530-b6fc-c025738a6444 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:09.715981 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1686/3410] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:09 2022] POST /identity/v3/users => generated 300 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:09.717256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cff04-f8ea-4842-bec2-5031e250e292 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:09.717586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cff04-f8ea-4842-bec2-5031e250e292 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:09.718669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090cff04-f8ea-4842-bec2-5031e250e292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:09.759595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502e510-244f-4798-a740-4555045874af admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:09.762518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-090cff04-f8ea-4842-bec2-5031e250e292 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:09.764067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-090cff04-f8ea-4842-bec2-5031e250e292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:09.770444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b019e-4399-4a64-b946-bff69f2638f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:09.772769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b019e-4399-4a64-b946-bff69f2638f5 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:09.774969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b019e-4399-4a64-b946-bff69f2638f5 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:09.775411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b019e-4399-4a64-b946-bff69f2638f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:09.887312 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1687/3411] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:56:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:09.889339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cff04-f8ea-4842-bec2-5031e250e292 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:09.905598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090cff04-f8ea-4842-bec2-5031e250e292 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:09.914287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49410e-6816-46b9-87f0-95f60014f010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:09.915059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49410e-6816-46b9-87f0-95f60014f010 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:09.915480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49410e-6816-46b9-87f0-95f60014f010 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:09.915614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be49410e-6816-46b9-87f0-95f60014f010 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:09.916811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49410e-6816-46b9-87f0-95f60014f010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:09.917791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b019e-4399-4a64-b946-bff69f2638f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:09.918218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be49410e-6816-46b9-87f0-95f60014f010 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:09.932810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b019e-4399-4a64-b946-bff69f2638f5 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:09.936778 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1688/3412] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:09.936778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49410e-6816-46b9-87f0-95f60014f010 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:09.936778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be49410e-6816-46b9-87f0-95f60014f010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:09.969287 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1725/3413] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:09 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:09.983509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b019e-4399-4a64-b946-bff69f2638f5 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:10.009890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b019e-4399-4a64-b946-bff69f2638f5 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:10.025061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c413ad-be92-4450-8295-943ddd2384a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:10.031385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c413ad-be92-4450-8295-943ddd2384a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:10.031841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c413ad-be92-4450-8295-943ddd2384a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:10.032010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be49410e-6816-46b9-87f0-95f60014f010 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:10.032445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c413ad-be92-4450-8295-943ddd2384a6 admin admin] PATH_INFO: `/v3/projects/b302b03ad433473dbecb94ee101ee0de/users/1c9cb161a01a4074b480e724c56c007f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:10.041275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47be98-ed31-4302-b0c6-111e03a55e6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:10.041952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47be98-ed31-4302-b0c6-111e03a55e6b service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:10.042238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47be98-ed31-4302-b0c6-111e03a55e6b service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:10.042516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef47be98-ed31-4302-b0c6-111e03a55e6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:10.053508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47be98-ed31-4302-b0c6-111e03a55e6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:10.055147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef47be98-ed31-4302-b0c6-111e03a55e6b service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:10.065751 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1689/3414] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:10.079791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c413ad-be92-4450-8295-943ddd2384a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b302b03ad433473dbecb94ee101ee0de, user_id=1c9cb161a01a4074b480e724c56c007f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:10.083028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c413ad-be92-4450-8295-943ddd2384a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:10.114608 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1726/3415] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:09 2022] PUT /identity/v3/projects/b302b03ad433473dbecb94ee101ee0de/users/1c9cb161a01a4074b480e724c56c007f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:10.118573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47be98-ed31-4302-b0c6-111e03a55e6b service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:10.136942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef47be98-ed31-4302-b0c6-111e03a55e6b service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:10.303952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11833d0-6318-4288-b650-c9209cab21fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:10.304829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11833d0-6318-4288-b650-c9209cab21fe admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:10.305113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11833d0-6318-4288-b650-c9209cab21fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:10.314353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11833d0-6318-4288-b650-c9209cab21fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:10.333070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11833d0-6318-4288-b650-c9209cab21fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:10.336920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11833d0-6318-4288-b650-c9209cab21fe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:10.387556 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1690/3416] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:10.389985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c413ad-be92-4450-8295-943ddd2384a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:10.415609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c413ad-be92-4450-8295-943ddd2384a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:10.438135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e2c6-64f8-4a55-a7fe-db4dc3db8d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:10.439211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e2c6-64f8-4a55-a7fe-db4dc3db8d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:10.439738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e2c6-64f8-4a55-a7fe-db4dc3db8d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:10.440268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949e2c6-64f8-4a55-a7fe-db4dc3db8d78 admin admin] PATH_INFO: `/v3/projects/b302b03ad433473dbecb94ee101ee0de/users/1c9cb161a01a4074b480e724c56c007f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:10.442684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949e2c6-64f8-4a55-a7fe-db4dc3db8d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b302b03ad433473dbecb94ee101ee0de, user_id=1c9cb161a01a4074b480e724c56c007f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:10.445907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949e2c6-64f8-4a55-a7fe-db4dc3db8d78 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:10.475380 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1727/3417] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:10 2022] PUT /identity/v3/projects/b302b03ad433473dbecb94ee101ee0de/users/1c9cb161a01a4074b480e724c56c007f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:10.486889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfca57-8ff4-4fec-bb02-15ffe3898c0e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:10.487238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfca57-8ff4-4fec-bb02-15ffe3898c0e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:10.487464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfca57-8ff4-4fec-bb02-15ffe3898c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:10.559483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-39cfca57-8ff4-4fec-bb02-15ffe3898c0e None None] MFA Rules not processed for user `1c9cb161a01a4074b480e724c56c007f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:10.561798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-39cfca57-8ff4-4fec-bb02-15ffe3898c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:10.721382 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1691/3418] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:10.725463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e2c6-64f8-4a55-a7fe-db4dc3db8d78 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:10.744201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949e2c6-64f8-4a55-a7fe-db4dc3db8d78 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:10.756888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5fdf9-3d93-404e-92e8-c721bfe82864 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:10.757960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fdf9-3d93-404e-92e8-c721bfe82864 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:10.758778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fdf9-3d93-404e-92e8-c721bfe82864 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:10.759015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5fdf9-3d93-404e-92e8-c721bfe82864 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:10.760042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5fdf9-3d93-404e-92e8-c721bfe82864 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:10.761490 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-4ec5fdf9-3d93-404e-92e8-c721bfe82864 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:10.761490 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:56:10.761490 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:56:10.763125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5fdf9-3d93-404e-92e8-c721bfe82864 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:10.796080 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1728/3419] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:10 2022] POST /identity/v3/services => generated 289 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:10.797277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfca57-8ff4-4fec-bb02-15ffe3898c0e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:10.826745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfca57-8ff4-4fec-bb02-15ffe3898c0e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:10.862248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:10.874109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:10.874427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:10.874763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:10.875501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:10.876698 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:10.876698 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:56:10.876698 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:56:10.877599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:10.904133 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Mar 26 20:56:10.904133 ncdv-master-1 devstack@keystone.service[97203]: Failed validating 'type' in schema['properties']['enabled']: Mar 26 20:56:10.904133 ncdv-master-1 devstack@keystone.service[97203]: {'enum': [True, False, None], 'type': 'boolean'} Mar 26 20:56:10.904133 ncdv-master-1 devstack@keystone.service[97203]: On instance['enabled']: Mar 26 20:56:10.904133 ncdv-master-1 devstack@keystone.service[97203]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Mar 26 20:56:10.911192 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1692/3420] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 20:56:10 2022] POST /identity/v3/endpoints => generated 283 bytes in 109 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Mar 26 20:56:10.913751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5fdf9-3d93-404e-92e8-c721bfe82864 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:10.928313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5fdf9-3d93-404e-92e8-c721bfe82864 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:10.934180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:10.935164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:10.935612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:10.936105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:10.937046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:10.938336 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:10.938336 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:56:10.938336 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:56:10.939609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:10.947347 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Mar 26 20:56:10.947347 ncdv-master-1 devstack@keystone.service[97202]: Failed validating 'type' in schema['properties']['enabled']: Mar 26 20:56:10.947347 ncdv-master-1 devstack@keystone.service[97202]: {'enum': [True, False, None], 'type': 'boolean'} Mar 26 20:56:10.947347 ncdv-master-1 devstack@keystone.service[97202]: On instance['enabled']: Mar 26 20:56:10.947347 ncdv-master-1 devstack@keystone.service[97202]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Mar 26 20:56:10.956383 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1729/3421] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 20:56:10 2022] POST /identity/v3/endpoints => generated 281 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Mar 26 20:56:10.956667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:10.970735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31024a8-1aac-4f86-98bd-038a977d0974 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:10.977246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc25c7-9df6-4dea-b925-cae92146c652 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:10.978211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc25c7-9df6-4dea-b925-cae92146c652 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:10.978670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc25c7-9df6-4dea-b925-cae92146c652 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:10.979123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc25c7-9df6-4dea-b925-cae92146c652 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:10.980182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc25c7-9df6-4dea-b925-cae92146c652 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:10.981984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc25c7-9df6-4dea-b925-cae92146c652 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.033236 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-58fc25c7-9df6-4dea-b925-cae92146c652 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-31472365. To ensure interoperability, identifiers should be a valid uuid. Mar 26 20:56:11.033236 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 20:56:11.033236 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:56:11.074988 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1693/3422] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 20:56:10 2022] POST /identity/v3/endpoints => generated 357 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:56:11.076371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.094771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bf75c-6934-4d9c-b5df-9e5c6a3f34ed tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.128266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b271b-24a9-40db-8299-09cd1489c9f2 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.129286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b271b-24a9-40db-8299-09cd1489c9f2 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.129656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b271b-24a9-40db-8299-09cd1489c9f2 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.129937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b271b-24a9-40db-8299-09cd1489c9f2 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/regions/tempest-region-31472365` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.130598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b271b-24a9-40db-8299-09cd1489c9f2 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-31472365)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.132208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b271b-24a9-40db-8299-09cd1489c9f2 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.138945 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1730/3423] 10.222.0.16 () {58 vars in 1199 bytes} [Sat Mar 26 20:56:11 2022] GET /identity/v3/regions/tempest-region-31472365 => generated 176 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:11.139166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc25c7-9df6-4dea-b925-cae92146c652 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.154474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc25c7-9df6-4dea-b925-cae92146c652 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.165835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.167112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.167754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.168209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/endpoints/40cadc6838fe42fdbe06cead38ce18b8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.188939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=40cadc6838fe42fdbe06cead38ce18b8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.189641 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:11.189641 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:56:11.189641 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:56:11.190747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.203875 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Mar 26 20:56:11.203875 ncdv-master-1 devstack@keystone.service[97203]: Failed validating 'type' in schema['properties']['enabled']: Mar 26 20:56:11.203875 ncdv-master-1 devstack@keystone.service[97203]: {'enum': [True, False, None], 'type': 'boolean'} Mar 26 20:56:11.203875 ncdv-master-1 devstack@keystone.service[97203]: On instance['enabled']: Mar 26 20:56:11.203875 ncdv-master-1 devstack@keystone.service[97203]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Mar 26 20:56:11.207899 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1694/3424] 10.222.0.16 () {60 vars in 1254 bytes} [Sat Mar 26 20:56:11 2022] PATCH /identity/v3/endpoints/40cadc6838fe42fdbe06cead38ce18b8 => generated 283 bytes in 69 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Mar 26 20:56:11.212620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b271b-24a9-40db-8299-09cd1489c9f2 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.227698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b271b-24a9-40db-8299-09cd1489c9f2 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.240809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.242452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.242452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.242452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/endpoints/40cadc6838fe42fdbe06cead38ce18b8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.244249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=40cadc6838fe42fdbe06cead38ce18b8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.251257 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:11.251257 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:56:11.251257 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:56:11.252444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.280934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '40cadc6838fe42fdbe06cead38ce18b8', 'request_id': 'req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:11.295240 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1731/3425] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:11 2022] DELETE /identity/v3/endpoints/40cadc6838fe42fdbe06cead38ce18b8 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:11.299018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.317039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e35ab-58f3-4a13-99b8-f213629910c6 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.339868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b9e41-ec23-4e25-afef-a5de8e1bea09 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.340729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b9e41-ec23-4e25-afef-a5de8e1bea09 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.341012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b9e41-ec23-4e25-afef-a5de8e1bea09 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.341287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b9e41-ec23-4e25-afef-a5de8e1bea09 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/regions/tempest-region-31472365` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.342049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b9e41-ec23-4e25-afef-a5de8e1bea09 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-31472365)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.342992 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-502b9e41-ec23-4e25-afef-a5de8e1bea09 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:11.342992 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:56:11.342992 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:56:11.344332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b9e41-ec23-4e25-afef-a5de8e1bea09 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.375800 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1695/3426] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 20:56:11 2022] DELETE /identity/v3/regions/tempest-region-31472365 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:11.383333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.399127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6064a1-5ad6-49c3-ad91-3b0b8bc5b61f tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.417332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a59a7a-6e4d-4f59-8182-eeeb10e62a3b tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.417978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a59a7a-6e4d-4f59-8182-eeeb10e62a3b tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.418263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a59a7a-6e4d-4f59-8182-eeeb10e62a3b tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.418540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a59a7a-6e4d-4f59-8182-eeeb10e62a3b tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.419266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a59a7a-6e4d-4f59-8182-eeeb10e62a3b tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.421059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a59a7a-6e4d-4f59-8182-eeeb10e62a3b tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.451950 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-c4a59a7a-6e4d-4f59-8182-eeeb10e62a3b tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1597016407. To ensure interoperability, identifiers should be a valid uuid. Mar 26 20:56:11.451950 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 20:56:11.451950 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:56:11.482891 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1732/3427] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 20:56:11 2022] POST /identity/v3/endpoints => generated 360 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:56:11.484147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b9e41-ec23-4e25-afef-a5de8e1bea09 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.496559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b9e41-ec23-4e25-afef-a5de8e1bea09 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.515150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b8712-d9f6-4924-bbce-6064e995dfef tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.516291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8712-d9f6-4924-bbce-6064e995dfef tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.516642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8712-d9f6-4924-bbce-6064e995dfef tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.517089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8712-d9f6-4924-bbce-6064e995dfef tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/regions/tempest-region-1597016407` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.517851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b8712-d9f6-4924-bbce-6064e995dfef tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1597016407)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.519010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b8712-d9f6-4924-bbce-6064e995dfef tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.521510 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1696/3428] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Mar 26 20:56:11 2022] GET /identity/v3/regions/tempest-region-1597016407 => generated 180 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:11.525482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a59a7a-6e4d-4f59-8182-eeeb10e62a3b tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.539965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a59a7a-6e4d-4f59-8182-eeeb10e62a3b tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.548561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.549407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.549698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.550082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/endpoints/6fb3a7a524884ce0b418ad7ebfd8e383` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.557841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=6fb3a7a524884ce0b418ad7ebfd8e383)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.559047 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:11.559047 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:56:11.559047 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:56:11.560133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.572852 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Mar 26 20:56:11.572852 ncdv-master-1 devstack@keystone.service[97202]: Failed validating 'type' in schema['properties']['enabled']: Mar 26 20:56:11.572852 ncdv-master-1 devstack@keystone.service[97202]: {'enum': [True, False, None], 'type': 'boolean'} Mar 26 20:56:11.572852 ncdv-master-1 devstack@keystone.service[97202]: On instance['enabled']: Mar 26 20:56:11.572852 ncdv-master-1 devstack@keystone.service[97202]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Mar 26 20:56:11.577463 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1733/3429] 10.222.0.16 () {60 vars in 1254 bytes} [Sat Mar 26 20:56:11 2022] PATCH /identity/v3/endpoints/6fb3a7a524884ce0b418ad7ebfd8e383 => generated 281 bytes in 50 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Mar 26 20:56:11.578781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b8712-d9f6-4924-bbce-6064e995dfef tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.596547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b8712-d9f6-4924-bbce-6064e995dfef tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.603617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.605431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.605955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.606717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/endpoints/6fb3a7a524884ce0b418ad7ebfd8e383` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.608711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6fb3a7a524884ce0b418ad7ebfd8e383)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.610258 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:11.610258 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:56:11.610258 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:56:11.611557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.624613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6fb3a7a524884ce0b418ad7ebfd8e383', 'request_id': 'req-88653d1f-117e-471d-838b-92c2f151c21d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:11.641815 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1697/3430] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 20:56:11 2022] DELETE /identity/v3/endpoints/6fb3a7a524884ce0b418ad7ebfd8e383 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:11.646044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.658796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d04277-47c4-47a8-b422-9e8bad0eab8c tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.681628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf634e4-d0b4-45ed-8fc0-52c8a8a9ea2d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.682946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf634e4-d0b4-45ed-8fc0-52c8a8a9ea2d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.683481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf634e4-d0b4-45ed-8fc0-52c8a8a9ea2d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.684005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf634e4-d0b4-45ed-8fc0-52c8a8a9ea2d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/regions/tempest-region-1597016407` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.684887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf634e4-d0b4-45ed-8fc0-52c8a8a9ea2d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1597016407)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.686351 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-9bf634e4-d0b4-45ed-8fc0-52c8a8a9ea2d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:11.686351 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:56:11.686351 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:56:11.687884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf634e4-d0b4-45ed-8fc0-52c8a8a9ea2d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.723140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.724655 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1734/3431] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Mar 26 20:56:11 2022] DELETE /identity/v3/regions/tempest-region-1597016407 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:11.737758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88653d1f-117e-471d-838b-92c2f151c21d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.762561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c02ad-ea01-4ca5-9ef7-63ef78000261 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c9cb161a01a4074b480e724c56c007f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b302b03ad433473dbecb94ee101ee0de', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.764265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c02ad-ea01-4ca5-9ef7-63ef78000261 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.764659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c02ad-ea01-4ca5-9ef7-63ef78000261 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.765334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c02ad-ea01-4ca5-9ef7-63ef78000261 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] PATH_INFO: `/v3/services/d4c2993187a14daf96cb34e1cefd93b7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.765904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c02ad-ea01-4ca5-9ef7-63ef78000261 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d4c2993187a14daf96cb34e1cefd93b7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.767259 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-ff9c02ad-ea01-4ca5-9ef7-63ef78000261 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:11.767259 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:56:11.767259 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:56:11.768537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c02ad-ea01-4ca5-9ef7-63ef78000261 tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:11.809698 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1698/3432] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:11 2022] DELETE /identity/v3/services/d4c2993187a14daf96cb34e1cefd93b7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:11.813991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf634e4-d0b4-45ed-8fc0-52c8a8a9ea2d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:11.913674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf634e4-d0b4-45ed-8fc0-52c8a8a9ea2d tempest-EndpointsNegativeTestJSON-1019501131 tempest-EndpointsNegativeTestJSON-1019501131-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:11.933331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:11.933969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:11.934254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:11.934529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] PATH_INFO: `/v3/users/b676a570ed78444fa4f722d1e7a38115` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:11.935799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b676a570ed78444fa4f722d1e7a38115)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:11.946266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:12.030140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b676a570ed78444fa4f722d1e7a38115'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:12.038659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b676a570ed78444fa4f722d1e7a38115'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:12.040431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b676a570ed78444fa4f722d1e7a38115'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:12.041104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b676a570ed78444fa4f722d1e7a38115'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:12.050160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b676a570ed78444fa4f722d1e7a38115'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:12.107776 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1735/3433] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:11 2022] DELETE /identity/v3/users/b676a570ed78444fa4f722d1e7a38115 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:12.114399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2736e8-73ae-406b-a694-a6ef0ded9c7d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:12.115450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2736e8-73ae-406b-a694-a6ef0ded9c7d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:12.115904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2736e8-73ae-406b-a694-a6ef0ded9c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:12.165453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7b2736e8-73ae-406b-a694-a6ef0ded9c7d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:12.166827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7b2736e8-73ae-406b-a694-a6ef0ded9c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:12.264215 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1699/3434] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:12.315854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:12.318021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:12.562186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c3689-5a01-4f9a-887d-c35f1cef47c7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:12.576268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa9af4-d2b5-4ff2-9ec6-fc36a7fe5acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:12.577261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa9af4-d2b5-4ff2-9ec6-fc36a7fe5acc service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:12.577416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa9af4-d2b5-4ff2-9ec6-fc36a7fe5acc service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:12.577769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa9af4-d2b5-4ff2-9ec6-fc36a7fe5acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:12.592870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa9af4-d2b5-4ff2-9ec6-fc36a7fe5acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:12.594835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa9af4-d2b5-4ff2-9ec6-fc36a7fe5acc service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:12.614658 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1736/3435] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:13.811103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4c6f8-b82e-4421-a33f-df2ed5d86d58 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:13.817107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4c6f8-b82e-4421-a33f-df2ed5d86d58 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:13.817107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4c6f8-b82e-4421-a33f-df2ed5d86d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:13.862435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d8a4c6f8-b82e-4421-a33f-df2ed5d86d58 None None] MFA Rules not processed for user `70fab8e4c45d48ea8223a3acc60a5442`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:13.864628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d8a4c6f8-b82e-4421-a33f-df2ed5d86d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:14.049533 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1700/3436] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:14.252237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa9af4-d2b5-4ff2-9ec6-fc36a7fe5acc service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:14.253711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7baa9af4-d2b5-4ff2-9ec6-fc36a7fe5acc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:14.267369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa9af4-d2b5-4ff2-9ec6-fc36a7fe5acc service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:14.280530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:14.281481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:14.281833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:14.282197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] PATH_INFO: `/v3/projects/4c0f2655489a435b902fd1a40393aa77` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:14.283636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0f2655489a435b902fd1a40393aa77)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:14.286116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:14.397397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0f2655489a435b902fd1a40393aa77', 'request_id': 'req-a30b8a6f-826d-4a34-9659-88c143ef5322'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.411857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0f2655489a435b902fd1a40393aa77', 'request_id': 'req-a30b8a6f-826d-4a34-9659-88c143ef5322'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.422951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0f2655489a435b902fd1a40393aa77', 'request_id': 'req-a30b8a6f-826d-4a34-9659-88c143ef5322'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.445663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] The token cache is being invalidate because project 4c0f2655489a435b902fd1a40393aa77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:14.445663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.445880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.451030 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1737/3437] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:14 2022] DELETE /identity/v3/projects/4c0f2655489a435b902fd1a40393aa77 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:14.453094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4c6f8-b82e-4421-a33f-df2ed5d86d58 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:14.470457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4c6f8-b82e-4421-a33f-df2ed5d86d58 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:14.544764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:14.546165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:14.546528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:14.546864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] PATH_INFO: `/v3/users/1c9cb161a01a4074b480e724c56c007f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:14.548117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c9cb161a01a4074b480e724c56c007f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:14.550101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:14.611406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c9cb161a01a4074b480e724c56c007f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.633598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c9cb161a01a4074b480e724c56c007f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.634338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c9cb161a01a4074b480e724c56c007f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.634966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c9cb161a01a4074b480e724c56c007f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.652223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d5fdba1b-b076-4644-ad80-4fb904866d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c9cb161a01a4074b480e724c56c007f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:14.687777 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1701/3438] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:14 2022] DELETE /identity/v3/users/1c9cb161a01a4074b480e724c56c007f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:16.083670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:16.087867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:16.115835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b8a6f-826d-4a34-9659-88c143ef5322 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:16.289309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:16.290231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:16.290519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:16.290799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] PATH_INFO: `/v3/projects/b302b03ad433473dbecb94ee101ee0de` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:16.294442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b302b03ad433473dbecb94ee101ee0de)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:16.296862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:16.434918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b302b03ad433473dbecb94ee101ee0de', 'request_id': 'req-0d989d30-5199-47db-9008-1c68ee006471'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:16.460052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b302b03ad433473dbecb94ee101ee0de', 'request_id': 'req-0d989d30-5199-47db-9008-1c68ee006471'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:16.478968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b302b03ad433473dbecb94ee101ee0de', 'request_id': 'req-0d989d30-5199-47db-9008-1c68ee006471'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:16.499147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] The token cache is being invalidate because project b302b03ad433473dbecb94ee101ee0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:16.499406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:16.500871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d989d30-5199-47db-9008-1c68ee006471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:16.503267 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1738/3439] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:16 2022] DELETE /identity/v3/projects/b302b03ad433473dbecb94ee101ee0de => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:16.509854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbae0d9-0404-44a7-aa6e-91995662e539 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:16.510479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbae0d9-0404-44a7-aa6e-91995662e539 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:16.510803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbae0d9-0404-44a7-aa6e-91995662e539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:16.568409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3bbae0d9-0404-44a7-aa6e-91995662e539 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:16.574643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3bbae0d9-0404-44a7-aa6e-91995662e539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:16.769050 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1702/3440] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:16.776731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42d08e-0509-47d9-93d3-e110f80e6291 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:16.777351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42d08e-0509-47d9-93d3-e110f80e6291 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:16.777873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42d08e-0509-47d9-93d3-e110f80e6291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:16.835863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7e42d08e-0509-47d9-93d3-e110f80e6291 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:16.842853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7e42d08e-0509-47d9-93d3-e110f80e6291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:16.890247 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1739/3441] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:16.893856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbae0d9-0404-44a7-aa6e-91995662e539 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:16.910092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbae0d9-0404-44a7-aa6e-91995662e539 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:16.926309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42d08e-0509-47d9-93d3-e110f80e6291 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:16.927799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7e42d08e-0509-47d9-93d3-e110f80e6291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:16.944611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad8185-c68a-4b38-86cb-1ead4c278c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:16.954345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad8185-c68a-4b38-86cb-1ead4c278c52 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:16.954630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad8185-c68a-4b38-86cb-1ead4c278c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:16.955169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad8185-c68a-4b38-86cb-1ead4c278c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:16.959851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad8185-c68a-4b38-86cb-1ead4c278c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:16.960538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad8185-c68a-4b38-86cb-1ead4c278c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:16.962793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42d08e-0509-47d9-93d3-e110f80e6291 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:16.965927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad8185-c68a-4b38-86cb-1ead4c278c52 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:16.974580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:16.980176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:16.980887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:16.981271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] PATH_INFO: `/v3/users/5d3b74fb605347bcbe8359165aaa0c6f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:16.983909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d3b74fb605347bcbe8359165aaa0c6f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:16.989911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:16.994692 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1703/3442] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:16.999120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad8185-c68a-4b38-86cb-1ead4c278c52 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:17.021462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad8185-c68a-4b38-86cb-1ead4c278c52 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:17.037790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7678dd8-fa1b-40a8-b931-aee3a205c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:17.038638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7678dd8-fa1b-40a8-b931-aee3a205c5ac admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.039010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7678dd8-fa1b-40a8-b931-aee3a205c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.039197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7678dd8-fa1b-40a8-b931-aee3a205c5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.040452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7678dd8-fa1b-40a8-b931-aee3a205c5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:17.042394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7678dd8-fa1b-40a8-b931-aee3a205c5ac admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:17.087494 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1704/3443] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:16 2022] POST /identity/v3/projects => generated 367 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:56:17.092591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7678dd8-fa1b-40a8-b931-aee3a205c5ac admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:17.103747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d3b74fb605347bcbe8359165aaa0c6f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.125727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d3b74fb605347bcbe8359165aaa0c6f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.126741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d3b74fb605347bcbe8359165aaa0c6f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.127557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d3b74fb605347bcbe8359165aaa0c6f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.137759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83c69c43-2619-4380-85b9-d6341433e134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d3b74fb605347bcbe8359165aaa0c6f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.192268 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1740/3444] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:16 2022] DELETE /identity/v3/users/5d3b74fb605347bcbe8359165aaa0c6f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:17.196599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296fd76-15f2-4834-802c-e72ea37692f6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.197087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296fd76-15f2-4834-802c-e72ea37692f6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.197574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296fd76-15f2-4834-802c-e72ea37692f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.233579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5296fd76-15f2-4834-802c-e72ea37692f6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:17.236771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5296fd76-15f2-4834-802c-e72ea37692f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:17.261761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7678dd8-fa1b-40a8-b931-aee3a205c5ac admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:17.322004 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1741/3445] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:17.334833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e485d-619e-4908-870e-59eeeb423053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:17.335571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e485d-619e-4908-870e-59eeeb423053 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.335858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e485d-619e-4908-870e-59eeeb423053 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.336192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e485d-619e-4908-870e-59eeeb423053 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.337631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e485d-619e-4908-870e-59eeeb423053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:17.339886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e485d-619e-4908-870e-59eeeb423053 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:17.349751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296fd76-15f2-4834-802c-e72ea37692f6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:17.351171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5296fd76-15f2-4834-802c-e72ea37692f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:17.366617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296fd76-15f2-4834-802c-e72ea37692f6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:17.370376 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1705/3446] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:17 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:17.372875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:17.374145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.374702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.374935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e485d-619e-4908-870e-59eeeb423053 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:17.375619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] PATH_INFO: `/v3/users/864b039c62424775834b1294a6725d80` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.377201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-891e485d-619e-4908-870e-59eeeb423053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:17.377712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=864b039c62424775834b1294a6725d80)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:17.380285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:17.422795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e485d-619e-4908-870e-59eeeb423053 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:17.441702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '864b039c62424775834b1294a6725d80'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.444810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f00e96-fd2f-4985-a421-876f238d84e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:17.446480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f00e96-fd2f-4985-a421-876f238d84e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.447353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f00e96-fd2f-4985-a421-876f238d84e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.447645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f00e96-fd2f-4985-a421-876f238d84e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.450180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f00e96-fd2f-4985-a421-876f238d84e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:17.452446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '864b039c62424775834b1294a6725d80'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.453590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '864b039c62424775834b1294a6725d80'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.454656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '864b039c62424775834b1294a6725d80'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.457617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f00e96-fd2f-4985-a421-876f238d84e3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:17.472021 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1706/3447] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:17.473243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f00e96-fd2f-4985-a421-876f238d84e3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:17.475984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-02f00e96-fd2f-4985-a421-876f238d84e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:17.484850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '864b039c62424775834b1294a6725d80'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:17.514026 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1742/3448] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:17 2022] DELETE /identity/v3/users/864b039c62424775834b1294a6725d80 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:17.515231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:17.518313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:17.569664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f00e96-fd2f-4985-a421-876f238d84e3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:17.604352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e8f2b-43d3-41be-91fb-540a2fee82eb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:17.610032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17823d9e-fcda-4380-a2d6-dee28701ac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:17.610729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17823d9e-fcda-4380-a2d6-dee28701ac4f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.611020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17823d9e-fcda-4380-a2d6-dee28701ac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.611303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17823d9e-fcda-4380-a2d6-dee28701ac4f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.612142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17823d9e-fcda-4380-a2d6-dee28701ac4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:17.613810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17823d9e-fcda-4380-a2d6-dee28701ac4f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:17.626745 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1743/3449] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:17.632586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77338ede-0f36-47bf-a41d-a02d814b6e28 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.632799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77338ede-0f36-47bf-a41d-a02d814b6e28 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.633061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77338ede-0f36-47bf-a41d-a02d814b6e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.643305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc8912-b853-4ae2-a171-1ee92687e939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:17.644015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc8912-b853-4ae2-a171-1ee92687e939 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.644305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc8912-b853-4ae2-a171-1ee92687e939 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.645746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc8912-b853-4ae2-a171-1ee92687e939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.647280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f3bc8912-b853-4ae2-a171-1ee92687e939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:17.661520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-77338ede-0f36-47bf-a41d-a02d814b6e28 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:17.662718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc8912-b853-4ae2-a171-1ee92687e939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:17.663232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-77338ede-0f36-47bf-a41d-a02d814b6e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:17.664393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc8912-b853-4ae2-a171-1ee92687e939 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:17.673224 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1744/3450] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:17.674333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77338ede-0f36-47bf-a41d-a02d814b6e28 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:17.680789 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1707/3451] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:17.702560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77338ede-0f36-47bf-a41d-a02d814b6e28 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:17.708099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b17ab-1394-4a62-a956-c434054c7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:17.709447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b17ab-1394-4a62-a956-c434054c7479 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.709921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b17ab-1394-4a62-a956-c434054c7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.710997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b17ab-1394-4a62-a956-c434054c7479 admin admin] PATH_INFO: `/v3/projects/421f161992594b7eb09b1d36336fca54/users/9e9975e768c94b3e9f0d6489192e4c98/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.724755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc8912-b853-4ae2-a171-1ee92687e939 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:17.737271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc8912-b853-4ae2-a171-1ee92687e939 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:17.747097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b17ab-1394-4a62-a956-c434054c7479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=421f161992594b7eb09b1d36336fca54, user_id=9e9975e768c94b3e9f0d6489192e4c98, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:17.751567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b17ab-1394-4a62-a956-c434054c7479 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:17.756099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5f69b-bf4a-4092-ae7e-b0b62f88bb58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:17.756774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5f69b-bf4a-4092-ae7e-b0b62f88bb58 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.757129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5f69b-bf4a-4092-ae7e-b0b62f88bb58 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.757460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad5f69b-bf4a-4092-ae7e-b0b62f88bb58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.781841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5f69b-bf4a-4092-ae7e-b0b62f88bb58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:17.783458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad5f69b-bf4a-4092-ae7e-b0b62f88bb58 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:17.801094 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1745/3452] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:17 2022] PUT /identity/v3/projects/421f161992594b7eb09b1d36336fca54/users/9e9975e768c94b3e9f0d6489192e4c98/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:17.812058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846beeb-4c15-44fe-89ac-30d786569024 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:17.812394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846beeb-4c15-44fe-89ac-30d786569024 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:17.812627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846beeb-4c15-44fe-89ac-30d786569024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:17.829670 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1708/3453] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:17.878196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e846beeb-4c15-44fe-89ac-30d786569024 None None] MFA Rules not processed for user `9e9975e768c94b3e9f0d6489192e4c98`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:17.879590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e846beeb-4c15-44fe-89ac-30d786569024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:17.987190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5f69b-bf4a-4092-ae7e-b0b62f88bb58 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:17.994540 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1746/3454] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:17.998355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad5f69b-bf4a-4092-ae7e-b0b62f88bb58 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.104277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0c8b-3828-4e95-8f9e-efb7b3196228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.105040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0c8b-3828-4e95-8f9e-efb7b3196228 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.105455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0c8b-3828-4e95-8f9e-efb7b3196228 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.105816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f0c8b-3828-4e95-8f9e-efb7b3196228 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.106776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0c8b-3828-4e95-8f9e-efb7b3196228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.108865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f0c8b-3828-4e95-8f9e-efb7b3196228 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:18.147195 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1709/3455] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:17 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:18.151625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846beeb-4c15-44fe-89ac-30d786569024 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:18.167133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846beeb-4c15-44fe-89ac-30d786569024 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.253646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc3a0-ce6a-4e13-a096-ed6429191a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.254804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc3a0-ce6a-4e13-a096-ed6429191a9e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.255086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc3a0-ce6a-4e13-a096-ed6429191a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.255487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc3a0-ce6a-4e13-a096-ed6429191a9e admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.256507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bc3a0-ce6a-4e13-a096-ed6429191a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.259070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bc3a0-ce6a-4e13-a096-ed6429191a9e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:18.283838 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1747/3456] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:18 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:18.285177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0c8b-3828-4e95-8f9e-efb7b3196228 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:18.295856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f0c8b-3828-4e95-8f9e-efb7b3196228 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.300568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f5f31-83ad-4fbd-ad7a-7dd4664489df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.301353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f5f31-83ad-4fbd-ad7a-7dd4664489df admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.301780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f5f31-83ad-4fbd-ad7a-7dd4664489df admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.302159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f5f31-83ad-4fbd-ad7a-7dd4664489df admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.302980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f5f31-83ad-4fbd-ad7a-7dd4664489df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.304740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f5f31-83ad-4fbd-ad7a-7dd4664489df admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:18.316782 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1710/3457] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:18.321433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc3a0-ce6a-4e13-a096-ed6429191a9e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:18.337320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc3a0-ce6a-4e13-a096-ed6429191a9e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.345966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee91b3b-a1e6-4ee9-91e2-a744c6871e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.347260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91b3b-a1e6-4ee9-91e2-a744c6871e1d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.347405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91b3b-a1e6-4ee9-91e2-a744c6871e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.347977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91b3b-a1e6-4ee9-91e2-a744c6871e1d admin admin] PATH_INFO: `/v3/projects/41f152a476ec4b588dfe4e10cf9c90d1/users/54a02d5a9485454987104fbd1bbf6f77/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.364701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee91b3b-a1e6-4ee9-91e2-a744c6871e1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f152a476ec4b588dfe4e10cf9c90d1, user_id=54a02d5a9485454987104fbd1bbf6f77, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.367358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee91b3b-a1e6-4ee9-91e2-a744c6871e1d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:18.384997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1748/3458] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:18 2022] PUT /identity/v3/projects/41f152a476ec4b588dfe4e10cf9c90d1/users/54a02d5a9485454987104fbd1bbf6f77/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:56:18.390066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f5f31-83ad-4fbd-ad7a-7dd4664489df admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:18.402281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f5f31-83ad-4fbd-ad7a-7dd4664489df admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.468235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cabae-e8e5-46ca-833c-6218e318635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.468919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cabae-e8e5-46ca-833c-6218e318635f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.469255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cabae-e8e5-46ca-833c-6218e318635f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.469531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cabae-e8e5-46ca-833c-6218e318635f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.470317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cabae-e8e5-46ca-833c-6218e318635f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.471963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cabae-e8e5-46ca-833c-6218e318635f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:18.485834 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1711/3459] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:56:18.488631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee91b3b-a1e6-4ee9-91e2-a744c6871e1d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:18.501889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee91b3b-a1e6-4ee9-91e2-a744c6871e1d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.512613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda90d5c-a96c-425c-b046-f3d7f9aac667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.513544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90d5c-a96c-425c-b046-f3d7f9aac667 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.514517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90d5c-a96c-425c-b046-f3d7f9aac667 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.514517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda90d5c-a96c-425c-b046-f3d7f9aac667 admin admin] PATH_INFO: `/v3/projects/41f152a476ec4b588dfe4e10cf9c90d1/users/54a02d5a9485454987104fbd1bbf6f77/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.516684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda90d5c-a96c-425c-b046-f3d7f9aac667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41f152a476ec4b588dfe4e10cf9c90d1, user_id=54a02d5a9485454987104fbd1bbf6f77, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.520592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda90d5c-a96c-425c-b046-f3d7f9aac667 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:18.544294 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1749/3460] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:18 2022] PUT /identity/v3/projects/41f152a476ec4b588dfe4e10cf9c90d1/users/54a02d5a9485454987104fbd1bbf6f77/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:18.548888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635876c-6d08-4fa6-8a92-f703835742a8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.549223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635876c-6d08-4fa6-8a92-f703835742a8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.549478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635876c-6d08-4fa6-8a92-f703835742a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.608299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a635876c-6d08-4fa6-8a92-f703835742a8 None None] MFA Rules not processed for user `54a02d5a9485454987104fbd1bbf6f77`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:18.610326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a635876c-6d08-4fa6-8a92-f703835742a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:18.726243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda90d5c-a96c-425c-b046-f3d7f9aac667 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:18.731246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cda90d5c-a96c-425c-b046-f3d7f9aac667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:18.737323 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1712/3461] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:18.741280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635876c-6d08-4fa6-8a92-f703835742a8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:18.753283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635876c-6d08-4fa6-8a92-f703835742a8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.765464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae26b33-31cb-479a-a789-df775a6396fc tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.766690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae26b33-31cb-479a-a789-df775a6396fc tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.766978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae26b33-31cb-479a-a789-df775a6396fc tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.772225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae26b33-31cb-479a-a789-df775a6396fc tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.773048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae26b33-31cb-479a-a789-df775a6396fc tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.776066 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-3ae26b33-31cb-479a-a789-df775a6396fc tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:18.776066 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:56:18.776066 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:56:18.777699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae26b33-31cb-479a-a789-df775a6396fc tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:18.833293 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1713/3462] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 20:56:18 2022] POST /identity/v3/regions => generated 223 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:18.838148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae26b33-31cb-479a-a789-df775a6396fc tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:18.887414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae26b33-31cb-479a-a789-df775a6396fc tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.898009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda90d5c-a96c-425c-b046-f3d7f9aac667 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.906978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09216f-0782-4936-8214-a26ec8451907 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.908153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09216f-0782-4936-8214-a26ec8451907 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.908976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09216f-0782-4936-8214-a26ec8451907 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.909362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09216f-0782-4936-8214-a26ec8451907 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.910183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09216f-0782-4936-8214-a26ec8451907 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.912902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09216f-0782-4936-8214-a26ec8451907 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:18.932597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.935856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.938991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.939262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] PATH_INFO: `/v3/projects/b2f47185eafd43c3a0a4a7cbfb9d679d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.943470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2f47185eafd43c3a0a4a7cbfb9d679d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.945400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:18.950116 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1714/3463] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 20:56:18 2022] POST /identity/v3/regions => generated 223 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:18.954589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09216f-0782-4936-8214-a26ec8451907 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:18.988315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09216f-0782-4936-8214-a26ec8451907 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:18.994179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71042a83-7e9e-4786-9e1c-4921beba22f3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:18.995613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042a83-7e9e-4786-9e1c-4921beba22f3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:18.996173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042a83-7e9e-4786-9e1c-4921beba22f3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:18.996691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042a83-7e9e-4786-9e1c-4921beba22f3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions/3d5fb13b-4629-4e10-b2a3-81dc410ca36b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:18.997736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71042a83-7e9e-4786-9e1c-4921beba22f3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:create_region(region_id=3d5fb13b-4629-4e10-b2a3-81dc410ca36b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:18.999774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71042a83-7e9e-4786-9e1c-4921beba22f3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:19.011101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'request_id': 'req-ef1b3585-ffd7-43f1-973b-21bf62d43d44'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.029543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'request_id': 'req-ef1b3585-ffd7-43f1-973b-21bf62d43d44'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.038689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2f47185eafd43c3a0a4a7cbfb9d679d', 'request_id': 'req-ef1b3585-ffd7-43f1-973b-21bf62d43d44'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.052726 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1715/3464] 10.222.0.16 () {60 vars in 1258 bytes} [Sat Mar 26 20:56:18 2022] PUT /identity/v3/regions/3d5fb13b-4629-4e10-b2a3-81dc410ca36b => generated 232 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:56:19.056820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71042a83-7e9e-4786-9e1c-4921beba22f3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:19.070856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] The token cache is being invalidate because project b2f47185eafd43c3a0a4a7cbfb9d679d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:19.071241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.072263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef1b3585-ffd7-43f1-973b-21bf62d43d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.074806 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1750/3465] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:18 2022] DELETE /identity/v3/projects/b2f47185eafd43c3a0a4a7cbfb9d679d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:19.079053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5543-7d5e-45ee-86e9-ef269fad6ba4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.079438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5543-7d5e-45ee-86e9-ef269fad6ba4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.080162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca5543-7d5e-45ee-86e9-ef269fad6ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:19.092173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71042a83-7e9e-4786-9e1c-4921beba22f3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:19.117279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-57ca5543-7d5e-45ee-86e9-ef269fad6ba4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:19.118581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57ca5543-7d5e-45ee-86e9-ef269fad6ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:19.214620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9d386-1610-4e64-966c-4aff8921114b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:19.215317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d386-1610-4e64-966c-4aff8921114b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.215605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d386-1610-4e64-966c-4aff8921114b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.215884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9d386-1610-4e64-966c-4aff8921114b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions/3d5fb13b-4629-4e10-b2a3-81dc410ca36b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:19.216575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d386-1610-4e64-966c-4aff8921114b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:delete_region(region_id=3d5fb13b-4629-4e10-b2a3-81dc410ca36b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:19.218211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9d386-1610-4e64-966c-4aff8921114b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:19.240002 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1751/3466] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:19.242107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5543-7d5e-45ee-86e9-ef269fad6ba4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:19.244422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57ca5543-7d5e-45ee-86e9-ef269fad6ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:19.258024 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1716/3467] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 20:56:19 2022] DELETE /identity/v3/regions/3d5fb13b-4629-4e10-b2a3-81dc410ca36b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:19.260077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655c6f0-34bf-4fc6-b96d-fb939e25b3e2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.260371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655c6f0-34bf-4fc6-b96d-fb939e25b3e2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.260653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655c6f0-34bf-4fc6-b96d-fb939e25b3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:19.264329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca5543-7d5e-45ee-86e9-ef269fad6ba4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:19.287627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:19.289359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.289844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.290315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] PATH_INFO: `/v3/projects/f1a4be7864234e8f93a10896a309e6ad` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:19.293047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a4be7864234e8f93a10896a309e6ad)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:19.296059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:19.300683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4655c6f0-34bf-4fc6-b96d-fb939e25b3e2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:19.302074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4655c6f0-34bf-4fc6-b96d-fb939e25b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:19.328420 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1717/3468] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:19.328420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655c6f0-34bf-4fc6-b96d-fb939e25b3e2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:19.328420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4655c6f0-34bf-4fc6-b96d-fb939e25b3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:19.376805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655c6f0-34bf-4fc6-b96d-fb939e25b3e2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:19.386619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c16f38-275d-4705-9792-8a40ef0af7df tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:19.387298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c16f38-275d-4705-9792-8a40ef0af7df tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.387583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c16f38-275d-4705-9792-8a40ef0af7df tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.387874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c16f38-275d-4705-9792-8a40ef0af7df tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:19.388716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c16f38-275d-4705-9792-8a40ef0af7df tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:19.393198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c16f38-275d-4705-9792-8a40ef0af7df tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:19.408149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a4be7864234e8f93a10896a309e6ad', 'request_id': 'req-9e3af608-b199-46e7-823a-502e25256189'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.426008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a4be7864234e8f93a10896a309e6ad', 'request_id': 'req-9e3af608-b199-46e7-823a-502e25256189'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.433784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a4be7864234e8f93a10896a309e6ad', 'request_id': 'req-9e3af608-b199-46e7-823a-502e25256189'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.436164 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1718/3469] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Mar 26 20:56:19 2022] POST /identity/v3/regions => generated 253 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:19.436839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c16f38-275d-4705-9792-8a40ef0af7df tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:19.450262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] The token cache is being invalidate because project f1a4be7864234e8f93a10896a309e6ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:19.450844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.452488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.454806 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1752/3470] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:19 2022] DELETE /identity/v3/projects/f1a4be7864234e8f93a10896a309e6ad => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:19.455826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:19.457844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:19.483794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c16f38-275d-4705-9792-8a40ef0af7df tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:19.575980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3af608-b199-46e7-823a-502e25256189 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:19.577206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:19.578149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.578507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.578847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:19.579633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:19.580028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:19.582308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:19.601969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:19.603067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.603538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.604086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions/ef7e44e5d7f1441f852d715ab67cc18c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:19.605067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:update_region(region_id=ef7e44e5d7f1441f852d715ab67cc18c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:19.606266 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:19.606266 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:56:19.606266 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:56:19.607520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:19.624317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1719/3471] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:19.625761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:19.629499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:19.647731 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1753/3472] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Mar 26 20:56:19 2022] PATCH /identity/v3/regions/ef7e44e5d7f1441f852d715ab67cc18c => generated 253 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:19.647731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:19.648214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:19.671330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9344bd-70fc-49f2-8787-6b599ed9f0e7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:19.694008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef436da3-d8ab-4036-9f43-b188c0481b46 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:19.700595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108059e-65f1-4027-b665-751c232e7a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:19.701195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108059e-65f1-4027-b665-751c232e7a0a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.701464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108059e-65f1-4027-b665-751c232e7a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.701743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108059e-65f1-4027-b665-751c232e7a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:19.702586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108059e-65f1-4027-b665-751c232e7a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:19.704561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108059e-65f1-4027-b665-751c232e7a0a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:19.705384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:19.706323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.706600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.706930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] PATH_INFO: `/v3/users/61a638f949a143d98b68286357b0a5d5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:19.712923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a638f949a143d98b68286357b0a5d5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:19.715080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:19.746485 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1754/3473] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:19 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:19.746485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108059e-65f1-4027-b665-751c232e7a0a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:19.785975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a638f949a143d98b68286357b0a5d5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.800241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a638f949a143d98b68286357b0a5d5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.801874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a638f949a143d98b68286357b0a5d5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.803942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a638f949a143d98b68286357b0a5d5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.833889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a638f949a143d98b68286357b0a5d5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:19.856202 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1720/3474] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:19 2022] DELETE /identity/v3/users/61a638f949a143d98b68286357b0a5d5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:19.857031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:19.859779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:19.912131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108059e-65f1-4027-b665-751c232e7a0a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:19.997108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a8548-9233-4994-98b6-12fc681b32e3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:19.998524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a8548-9233-4994-98b6-12fc681b32e3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:19.999307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a8548-9233-4994-98b6-12fc681b32e3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:19.999801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a8548-9233-4994-98b6-12fc681b32e3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions/ef7e44e5d7f1441f852d715ab67cc18c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.000715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a8548-9233-4994-98b6-12fc681b32e3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:get_region(region_id=ef7e44e5d7f1441f852d715ab67cc18c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.002393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a8548-9233-4994-98b6-12fc681b32e3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.014703 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1755/3475] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 20:56:19 2022] GET /identity/v3/regions/ef7e44e5d7f1441f852d715ab67cc18c => generated 253 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:20.016410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a8548-9233-4994-98b6-12fc681b32e3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.021447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-820a8548-9233-4994-98b6-12fc681b32e3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:20.031822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac0e7-d24d-41e0-ae15-aeec15012400 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.045602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b524b8-d257-4f3b-87bc-dc1356e6c9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.046292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b524b8-d257-4f3b-87bc-dc1356e6c9c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.046632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b524b8-d257-4f3b-87bc-dc1356e6c9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.047104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b524b8-d257-4f3b-87bc-dc1356e6c9c5 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.047669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a8548-9233-4994-98b6-12fc681b32e3 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.047798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b524b8-d257-4f3b-87bc-dc1356e6c9c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.051430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b524b8-d257-4f3b-87bc-dc1356e6c9c5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.053330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f0a47-607d-4044-a1d0-7c745f115aad tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.054273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f0a47-607d-4044-a1d0-7c745f115aad tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.054780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f0a47-607d-4044-a1d0-7c745f115aad tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.055156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f0a47-607d-4044-a1d0-7c745f115aad tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions/ef7e44e5d7f1441f852d715ab67cc18c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.056105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f0a47-607d-4044-a1d0-7c745f115aad tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ef7e44e5d7f1441f852d715ab67cc18c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.058304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f0a47-607d-4044-a1d0-7c745f115aad tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.098729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1721/3476] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:19 2022] POST /identity/v3/users => generated 291 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:20.102542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b524b8-d257-4f3b-87bc-dc1356e6c9c5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.109054 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1756/3477] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 20:56:20 2022] DELETE /identity/v3/regions/ef7e44e5d7f1441f852d715ab67cc18c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:20.113175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f0a47-607d-4044-a1d0-7c745f115aad tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.114141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b524b8-d257-4f3b-87bc-dc1356e6c9c5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.131304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f42e79-ce2f-4704-9313-7e0f2d525426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.132127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f42e79-ce2f-4704-9313-7e0f2d525426 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.132478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f42e79-ce2f-4704-9313-7e0f2d525426 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.132959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f42e79-ce2f-4704-9313-7e0f2d525426 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.134755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f42e79-ce2f-4704-9313-7e0f2d525426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.136065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f42e79-ce2f-4704-9313-7e0f2d525426 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.146337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f0a47-607d-4044-a1d0-7c745f115aad tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.157229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a0e4-b26e-4a3b-a36e-c453c93cf219 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.158201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a0e4-b26e-4a3b-a36e-c453c93cf219 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.158882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a0e4-b26e-4a3b-a36e-c453c93cf219 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.159435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a0e4-b26e-4a3b-a36e-c453c93cf219 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.160393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51a0e4-b26e-4a3b-a36e-c453c93cf219 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.161799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51a0e4-b26e-4a3b-a36e-c453c93cf219 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.165293 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1722/3478] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:56:20.167740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f42e79-ce2f-4704-9313-7e0f2d525426 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.175450 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1757/3479] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 20:56:20 2022] GET /identity/v3/regions => generated 668 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:56:20.193406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a0e4-b26e-4a3b-a36e-c453c93cf219 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.195528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f42e79-ce2f-4704-9313-7e0f2d525426 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.214222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3867e-683a-48fc-9f52-e46785d22143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.214920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3867e-683a-48fc-9f52-e46785d22143 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.215276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3867e-683a-48fc-9f52-e46785d22143 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.215545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3867e-683a-48fc-9f52-e46785d22143 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.216399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3867e-683a-48fc-9f52-e46785d22143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.219303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3867e-683a-48fc-9f52-e46785d22143 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.234700 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1723/3480] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:20.235059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a0e4-b26e-4a3b-a36e-c453c93cf219 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.236003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3867e-683a-48fc-9f52-e46785d22143 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.246960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1009e-c943-4c0e-a109-0b84bb656b50 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.247906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1009e-c943-4c0e-a109-0b84bb656b50 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.248164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1009e-c943-4c0e-a109-0b84bb656b50 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.248392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1009e-c943-4c0e-a109-0b84bb656b50 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions/ef7e44e5d7f1441f852d715ab67cc18c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.249059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1009e-c943-4c0e-a109-0b84bb656b50 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:delete_region(region_id=ef7e44e5d7f1441f852d715ab67cc18c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.255453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3867e-683a-48fc-9f52-e46785d22143 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.257375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1009e-c943-4c0e-a109-0b84bb656b50 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.279470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c4e90f-3bd7-462f-9917-375f8f4da098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.280476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e90f-3bd7-462f-9917-375f8f4da098 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.281000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e90f-3bd7-462f-9917-375f8f4da098 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.281347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4e90f-3bd7-462f-9917-375f8f4da098 admin admin] PATH_INFO: `/v3/projects/1f445e39b4b1445e827edea1f9d10585/users/0a6b226949544912b4be60795177ddf0/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.293849 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-4ee1009e-c943-4c0e-a109-0b84bb656b50 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Could not find region: ef7e44e5d7f1441f852d715ab67cc18c.: keystone.exception.RegionNotFound: Could not find region: ef7e44e5d7f1441f852d715ab67cc18c. Mar 26 20:56:20.300413 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1758/3481] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 20:56:20 2022] DELETE /identity/v3/regions/ef7e44e5d7f1441f852d715ab67cc18c => generated 112 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 20:56:20.303441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1009e-c943-4c0e-a109-0b84bb656b50 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.311746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e90f-3bd7-462f-9917-375f8f4da098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f445e39b4b1445e827edea1f9d10585, user_id=0a6b226949544912b4be60795177ddf0, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.315472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1009e-c943-4c0e-a109-0b84bb656b50 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.317029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c4e90f-3bd7-462f-9917-375f8f4da098 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.320530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a2134-ff02-4cbb-9460-00741974658b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.321744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a2134-ff02-4cbb-9460-00741974658b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.322040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a2134-ff02-4cbb-9460-00741974658b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.322545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a2134-ff02-4cbb-9460-00741974658b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.323768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a2134-ff02-4cbb-9460-00741974658b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.324902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a2134-ff02-4cbb-9460-00741974658b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.334735 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1759/3482] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 20:56:20 2022] GET /identity/v3/regions => generated 668 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:20.336447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a2134-ff02-4cbb-9460-00741974658b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.350136 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1724/3483] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:20 2022] PUT /identity/v3/projects/1f445e39b4b1445e827edea1f9d10585/users/0a6b226949544912b4be60795177ddf0/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:20.355507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a2134-ff02-4cbb-9460-00741974658b tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.361690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa967a-723f-4ccd-9d81-dfff587f6b2b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.363024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa967a-723f-4ccd-9d81-dfff587f6b2b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.363572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa967a-723f-4ccd-9d81-dfff587f6b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.452615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9daa967a-723f-4ccd-9d81-dfff587f6b2b None None] MFA Rules not processed for user `0a6b226949544912b4be60795177ddf0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:20.454561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9daa967a-723f-4ccd-9d81-dfff587f6b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:20.486200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec636c-c675-4562-a13b-1b1e8a8795e7 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.487347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec636c-c675-4562-a13b-1b1e8a8795e7 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.487638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec636c-c675-4562-a13b-1b1e8a8795e7 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.487941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec636c-c675-4562-a13b-1b1e8a8795e7 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.488728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec636c-c675-4562-a13b-1b1e8a8795e7 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.494761 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-9bec636c-c675-4562-a13b-1b1e8a8795e7 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:56:20.494761 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:56:20.494761 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:56:20.497255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec636c-c675-4562-a13b-1b1e8a8795e7 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.534072 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1760/3484] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Mar 26 20:56:20 2022] POST /identity/v3/regions => generated 253 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:56:20.538070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec636c-c675-4562-a13b-1b1e8a8795e7 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.568420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec636c-c675-4562-a13b-1b1e8a8795e7 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.576640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae8a37-d0bf-44ea-8774-77ca81961ca1 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.577410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae8a37-d0bf-44ea-8774-77ca81961ca1 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.577768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae8a37-d0bf-44ea-8774-77ca81961ca1 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.578129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae8a37-d0bf-44ea-8774-77ca81961ca1 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.579415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae8a37-d0bf-44ea-8774-77ca81961ca1 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Adding query filter params (parent_region_id=fc48e59e134d465fa782f375347e882c) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:20.579415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae8a37-d0bf-44ea-8774-77ca81961ca1 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.580872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae8a37-d0bf-44ea-8774-77ca81961ca1 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.590967 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1761/3485] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 20:56:20 2022] GET /identity/v3/regions?parent_region_id=fc48e59e134d465fa782f375347e882c => generated 399 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:20.592053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae8a37-d0bf-44ea-8774-77ca81961ca1 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.603336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae8a37-d0bf-44ea-8774-77ca81961ca1 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.609759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01076454-acf1-43ef-a99b-bac6933f29d6 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.610780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01076454-acf1-43ef-a99b-bac6933f29d6 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.611289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01076454-acf1-43ef-a99b-bac6933f29d6 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.611646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01076454-acf1-43ef-a99b-bac6933f29d6 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions/eaa4317573eb4075ad3f38205ed70d95` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.612735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01076454-acf1-43ef-a99b-bac6933f29d6 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:delete_region(region_id=eaa4317573eb4075ad3f38205ed70d95)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.614709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01076454-acf1-43ef-a99b-bac6933f29d6 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.620044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1725/3486] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:20.648082 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1762/3487] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 20:56:20 2022] DELETE /identity/v3/regions/eaa4317573eb4075ad3f38205ed70d95 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:20.659317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa967a-723f-4ccd-9d81-dfff587f6b2b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.678842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa967a-723f-4ccd-9d81-dfff587f6b2b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.696977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01076454-acf1-43ef-a99b-bac6933f29d6 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.699312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-01076454-acf1-43ef-a99b-bac6933f29d6 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:20.702629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254327f-1e00-4c5d-9ead-e8ed7d2978af tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.703483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254327f-1e00-4c5d-9ead-e8ed7d2978af tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.703768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254327f-1e00-4c5d-9ead-e8ed7d2978af tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.704081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254327f-1e00-4c5d-9ead-e8ed7d2978af tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions/0e1fa4781a874e9e9e72e90f52cf7007` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.704939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254327f-1e00-4c5d-9ead-e8ed7d2978af tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:delete_region(region_id=0e1fa4781a874e9e9e72e90f52cf7007)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.706912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254327f-1e00-4c5d-9ead-e8ed7d2978af tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.732835 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1726/3488] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 20:56:20 2022] DELETE /identity/v3/regions/0e1fa4781a874e9e9e72e90f52cf7007 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:56:20.736759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254327f-1e00-4c5d-9ead-e8ed7d2978af tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.774295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254327f-1e00-4c5d-9ead-e8ed7d2978af tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.782191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88340b-1b3c-4b8f-b129-308622a0cfdb tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a02d5a9485454987104fbd1bbf6f77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41f152a476ec4b588dfe4e10cf9c90d1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.783951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88340b-1b3c-4b8f-b129-308622a0cfdb tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.783951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88340b-1b3c-4b8f-b129-308622a0cfdb tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.787498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88340b-1b3c-4b8f-b129-308622a0cfdb tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] PATH_INFO: `/v3/regions/fc48e59e134d465fa782f375347e882c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.787498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88340b-1b3c-4b8f-b129-308622a0cfdb tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fc48e59e134d465fa782f375347e882c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.788138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88340b-1b3c-4b8f-b129-308622a0cfdb tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.813783 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1727/3489] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 20:56:20 2022] DELETE /identity/v3/regions/fc48e59e134d465fa782f375347e882c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:20.817463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88340b-1b3c-4b8f-b129-308622a0cfdb tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.819469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1d88340b-1b3c-4b8f-b129-308622a0cfdb tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:20.844386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01076454-acf1-43ef-a99b-bac6933f29d6 tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.848663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88340b-1b3c-4b8f-b129-308622a0cfdb tempest-RegionsTestJSON-156765855 tempest-RegionsTestJSON-156765855-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:20.854438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.855400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.855792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.856285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] PATH_INFO: `/v3/users/9e9975e768c94b3e9f0d6489192e4c98` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.857511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9975e768c94b3e9f0d6489192e4c98)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.859481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.866604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:20.868366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:20.868879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:20.869610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] PATH_INFO: `/v3/projects/42645a8397f54100955f168da56a7a19` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:20.871462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42645a8397f54100955f168da56a7a19)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:20.874432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:20.915469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9975e768c94b3e9f0d6489192e4c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:20.924767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9975e768c94b3e9f0d6489192e4c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:20.926410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9975e768c94b3e9f0d6489192e4c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:20.927109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9975e768c94b3e9f0d6489192e4c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:20.935730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42645a8397f54100955f168da56a7a19', 'request_id': 'req-e8711195-13c9-457d-a0db-a6c88962b196'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:20.942756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9975e768c94b3e9f0d6489192e4c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:20.944436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42645a8397f54100955f168da56a7a19', 'request_id': 'req-e8711195-13c9-457d-a0db-a6c88962b196'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:20.959951 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1728/3490] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:20 2022] DELETE /identity/v3/users/9e9975e768c94b3e9f0d6489192e4c98 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:20.965149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:20.967192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:20.978876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42645a8397f54100955f168da56a7a19', 'request_id': 'req-e8711195-13c9-457d-a0db-a6c88962b196'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:21.011571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] The token cache is being invalidate because project 42645a8397f54100955f168da56a7a19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:21.011571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:21.011571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e8711195-13c9-457d-a0db-a6c88962b196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:21.016002 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1763/3491] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:20 2022] DELETE /identity/v3/projects/42645a8397f54100955f168da56a7a19 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:56:21.029367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb57e5-0b6c-40d7-99e7-149a906a257e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.030002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb57e5-0b6c-40d7-99e7-149a906a257e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.030294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb57e5-0b6c-40d7-99e7-149a906a257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.064932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-17bb57e5-0b6c-40d7-99e7-149a906a257e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:21.066479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-17bb57e5-0b6c-40d7-99e7-149a906a257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:21.123022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a18d0-2a92-46bb-a71b-5fcdf5f77f97 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:21.136698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34be175-0213-4629-8a62-659d38e2de89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:21.137370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34be175-0213-4629-8a62-659d38e2de89 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.137652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34be175-0213-4629-8a62-659d38e2de89 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.137928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34be175-0213-4629-8a62-659d38e2de89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.141460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d34be175-0213-4629-8a62-659d38e2de89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:21.194742 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1764/3492] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:21.196697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca9bf-3e29-46e3-950d-312fbc87c35e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.197058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca9bf-3e29-46e3-950d-312fbc87c35e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.197402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca9bf-3e29-46e3-950d-312fbc87c35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.233597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34be175-0213-4629-8a62-659d38e2de89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:21.235353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34be175-0213-4629-8a62-659d38e2de89 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:21.237086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-51eca9bf-3e29-46e3-950d-312fbc87c35e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:21.238323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-51eca9bf-3e29-46e3-950d-312fbc87c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:21.264476 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1765/3493] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:21.268541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eca9bf-3e29-46e3-950d-312fbc87c35e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:21.271385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-51eca9bf-3e29-46e3-950d-312fbc87c35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:21.284440 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1729/3494] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:21.286293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4236dba-6aa8-401b-ae0f-1d791902a7d5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.286799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4236dba-6aa8-401b-ae0f-1d791902a7d5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.287385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4236dba-6aa8-401b-ae0f-1d791902a7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.309512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d4236dba-6aa8-401b-ae0f-1d791902a7d5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:21.311186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d4236dba-6aa8-401b-ae0f-1d791902a7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:21.322171 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1730/3495] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:21.327961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4236dba-6aa8-401b-ae0f-1d791902a7d5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:21.345274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4236dba-6aa8-401b-ae0f-1d791902a7d5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:21.358165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:21.359032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.359681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.360063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.361489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:21.361904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:21.363727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:21.385153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eca9bf-3e29-46e3-950d-312fbc87c35e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:21.389325 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1731/3496] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:21.390924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adde7aa-e776-4051-929f-9896b65495dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:21.391580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adde7aa-e776-4051-929f-9896b65495dd service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.392131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:21.396035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adde7aa-e776-4051-929f-9896b65495dd service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.396345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adde7aa-e776-4051-929f-9896b65495dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.397092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:21.419497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adde7aa-e776-4051-929f-9896b65495dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:21.422078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adde7aa-e776-4051-929f-9896b65495dd service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:21.436014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e382387-c555-4f19-b062-482af4135193 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:21.447082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:21.449222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.449505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.449776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] PATH_INFO: `/v3/users/0a6b226949544912b4be60795177ddf0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.454269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a6b226949544912b4be60795177ddf0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:21.455844 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1766/3497] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:21.457391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:21.457596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adde7aa-e776-4051-929f-9896b65495dd service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:21.479967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adde7aa-e776-4051-929f-9896b65495dd service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:21.493459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a999b-4d82-4f46-967e-292bf4599a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:21.494137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a999b-4d82-4f46-967e-292bf4599a8c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.494428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a999b-4d82-4f46-967e-292bf4599a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.494715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a999b-4d82-4f46-967e-292bf4599a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.495421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a999b-4d82-4f46-967e-292bf4599a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:21.504113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a999b-4d82-4f46-967e-292bf4599a8c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:21.577787 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1767/3498] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:21 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:21.582344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a999b-4d82-4f46-967e-292bf4599a8c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:21.604153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a6b226949544912b4be60795177ddf0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:21.619582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a6b226949544912b4be60795177ddf0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:21.621017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a6b226949544912b4be60795177ddf0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:21.621910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a6b226949544912b4be60795177ddf0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:21.655584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-048baf10-2782-4faa-949e-b610ddef0c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a6b226949544912b4be60795177ddf0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:21.691688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1732/3499] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:21 2022] DELETE /identity/v3/users/0a6b226949544912b4be60795177ddf0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:21.700373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd7777-0946-48fb-be0a-d404a15000dc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.701808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd7777-0946-48fb-be0a-d404a15000dc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.702103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd7777-0946-48fb-be0a-d404a15000dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.717578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a999b-4d82-4f46-967e-292bf4599a8c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:21.750543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1afd7777-0946-48fb-be0a-d404a15000dc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:21.751782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1afd7777-0946-48fb-be0a-d404a15000dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:21.859205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc67dc-4aaf-46d8-829b-d2f5b9a337df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:21.860026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc67dc-4aaf-46d8-829b-d2f5b9a337df admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.860385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc67dc-4aaf-46d8-829b-d2f5b9a337df admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.860739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc67dc-4aaf-46d8-829b-d2f5b9a337df admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.861509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc67dc-4aaf-46d8-829b-d2f5b9a337df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:21.871427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc67dc-4aaf-46d8-829b-d2f5b9a337df admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:21.925641 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1768/3500] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:21 2022] POST /identity/v3/users => generated 289 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:56:21.926915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc67dc-4aaf-46d8-829b-d2f5b9a337df admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:21.928993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4efc67dc-4aaf-46d8-829b-d2f5b9a337df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:21.945647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc67dc-4aaf-46d8-829b-d2f5b9a337df admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:21.956160 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1733/3501] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:21.960213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baa7e5-c8ff-41d7-a92f-b3cdebdd3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:21.961181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baa7e5-c8ff-41d7-a92f-b3cdebdd3185 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:21.961761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baa7e5-c8ff-41d7-a92f-b3cdebdd3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:21.962265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4baa7e5-c8ff-41d7-a92f-b3cdebdd3185 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:21.963229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baa7e5-c8ff-41d7-a92f-b3cdebdd3185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:21.965888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4baa7e5-c8ff-41d7-a92f-b3cdebdd3185 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:21.968621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd7777-0946-48fb-be0a-d404a15000dc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:21.970337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1afd7777-0946-48fb-be0a-d404a15000dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:22.000098 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1769/3502] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:22.003473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baa7e5-c8ff-41d7-a92f-b3cdebdd3185 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:22.031095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4baa7e5-c8ff-41d7-a92f-b3cdebdd3185 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:22.043154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81f384-984e-4779-94b2-29134d5f2a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:22.044046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f384-984e-4779-94b2-29134d5f2a57 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:22.044398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f384-984e-4779-94b2-29134d5f2a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:22.044745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c81f384-984e-4779-94b2-29134d5f2a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:22.045547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81f384-984e-4779-94b2-29134d5f2a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:22.048428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c81f384-984e-4779-94b2-29134d5f2a57 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:22.084010 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1770/3503] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:22.085422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81f384-984e-4779-94b2-29134d5f2a57 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:22.107635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c81f384-984e-4779-94b2-29134d5f2a57 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:22.113191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd7777-0946-48fb-be0a-d404a15000dc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:22.115825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756382b-4da3-4147-9af6-181e6f6b9218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:22.116828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756382b-4da3-4147-9af6-181e6f6b9218 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:22.117190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756382b-4da3-4147-9af6-181e6f6b9218 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:22.117539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756382b-4da3-4147-9af6-181e6f6b9218 admin admin] PATH_INFO: `/v3/projects/4779df637b8c4ad18db612e122dd0edc/users/9f1b846a05d1454bbd08f070d709e7d8/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:22.120578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d648e02-296e-40ad-a706-a13b5237a7f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:22.123367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d648e02-296e-40ad-a706-a13b5237a7f3 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:22.124371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d648e02-296e-40ad-a706-a13b5237a7f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:22.127034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d648e02-296e-40ad-a706-a13b5237a7f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:22.152932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d648e02-296e-40ad-a706-a13b5237a7f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:22.154584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d648e02-296e-40ad-a706-a13b5237a7f3 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:22.158585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756382b-4da3-4147-9af6-181e6f6b9218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4779df637b8c4ad18db612e122dd0edc, user_id=9f1b846a05d1454bbd08f070d709e7d8, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:22.161972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756382b-4da3-4147-9af6-181e6f6b9218 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:22.167038 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1734/3504] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:56:22.190446 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1771/3505] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:22 2022] PUT /identity/v3/projects/4779df637b8c4ad18db612e122dd0edc/users/9f1b846a05d1454bbd08f070d709e7d8/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:22.202255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2a96-56bb-4836-bf80-651ac4b4c0e3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:22.203172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2a96-56bb-4836-bf80-651ac4b4c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:22.203567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c2a96-56bb-4836-bf80-651ac4b4c0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:22.260313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7e1c2a96-56bb-4836-bf80-651ac4b4c0e3 None None] MFA Rules not processed for user `9f1b846a05d1454bbd08f070d709e7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:22.261760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e1c2a96-56bb-4836-bf80-651ac4b4c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:22.275662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756382b-4da3-4147-9af6-181e6f6b9218 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:22.277781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7756382b-4da3-4147-9af6-181e6f6b9218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:22.497387 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1735/3506] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:22.516734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756382b-4da3-4147-9af6-181e6f6b9218 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:22.530386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:22.531273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:22.531552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:22.532015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] PATH_INFO: `/v3/projects/421f161992594b7eb09b1d36336fca54` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:22.533498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=421f161992594b7eb09b1d36336fca54)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:22.540188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:22.645166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421f161992594b7eb09b1d36336fca54', 'request_id': 'req-ca6e9989-99f1-490a-be47-c864b7299436'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.663359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421f161992594b7eb09b1d36336fca54', 'request_id': 'req-ca6e9989-99f1-490a-be47-c864b7299436'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.670684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421f161992594b7eb09b1d36336fca54', 'request_id': 'req-ca6e9989-99f1-490a-be47-c864b7299436'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.692767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] The token cache is being invalidate because project 421f161992594b7eb09b1d36336fca54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:22.693059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.693714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.695245 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1772/3507] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:22 2022] DELETE /identity/v3/projects/421f161992594b7eb09b1d36336fca54 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:56:22.700535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c2a96-56bb-4836-bf80-651ac4b4c0e3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:22.715969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c2a96-56bb-4836-bf80-651ac4b4c0e3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:22.751210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:22.753159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:22.811834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:22.813139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:22.813796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:22.814310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] PATH_INFO: `/v3/users/54a02d5a9485454987104fbd1bbf6f77` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:22.816162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a02d5a9485454987104fbd1bbf6f77)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:22.819490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:22.889767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a02d5a9485454987104fbd1bbf6f77'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.892964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6e9989-99f1-490a-be47-c864b7299436 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:22.900787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a02d5a9485454987104fbd1bbf6f77'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.902087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a02d5a9485454987104fbd1bbf6f77'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.902218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a02d5a9485454987104fbd1bbf6f77'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.908674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7741ee-8aef-4bd6-a312-eb56f7aa57a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:22.910798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7741ee-8aef-4bd6-a312-eb56f7aa57a1 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:22.911299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7741ee-8aef-4bd6-a312-eb56f7aa57a1 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:22.912287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7741ee-8aef-4bd6-a312-eb56f7aa57a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:22.917049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a02d5a9485454987104fbd1bbf6f77'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:22.918538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fd7741ee-8aef-4bd6-a312-eb56f7aa57a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:22.930477 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1736/3508] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:22 2022] DELETE /identity/v3/users/54a02d5a9485454987104fbd1bbf6f77 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:22.931427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:22.940825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:23.042428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7741ee-8aef-4bd6-a312-eb56f7aa57a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:23.044389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7741ee-8aef-4bd6-a312-eb56f7aa57a1 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:23.062165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1773/3509] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:56:23.071701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d8ffe-eb37-4d12-bd02-a218f7d83788 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:23.078047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:23.080033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.080338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.080607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] PATH_INFO: `/v3/projects/1f445e39b4b1445e827edea1f9d10585` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.082541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f445e39b4b1445e827edea1f9d10585)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:23.094210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:23.170791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f445e39b4b1445e827edea1f9d10585', 'request_id': 'req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:23.193044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f445e39b4b1445e827edea1f9d10585', 'request_id': 'req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:23.212768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f445e39b4b1445e827edea1f9d10585', 'request_id': 'req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:23.253717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46093747-973a-4435-982f-58824652b5cb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.254794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46093747-973a-4435-982f-58824652b5cb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.256031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46093747-973a-4435-982f-58824652b5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.264578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] The token cache is being invalidate because project 1f445e39b4b1445e827edea1f9d10585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:23.265027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:23.268716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ffc6d4fc-4628-45e3-9dbc-51cac7d08d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:23.270689 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1737/3510] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:22 2022] DELETE /identity/v3/projects/1f445e39b4b1445e827edea1f9d10585 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:23.276202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779bcb4-f04b-40a5-9a4c-f2e02d17ae1e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.276566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779bcb4-f04b-40a5-9a4c-f2e02d17ae1e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.276920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779bcb4-f04b-40a5-9a4c-f2e02d17ae1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.283150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-46093747-973a-4435-982f-58824652b5cb None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:23.284526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-46093747-973a-4435-982f-58824652b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:23.313796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1779bcb4-f04b-40a5-9a4c-f2e02d17ae1e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:23.314937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1779bcb4-f04b-40a5-9a4c-f2e02d17ae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:23.417041 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1774/3511] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:23.438735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46093747-973a-4435-982f-58824652b5cb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:23.440644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-46093747-973a-4435-982f-58824652b5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:23.444702 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1738/3512] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:23.447408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371952c-104c-4f3b-b0c2-c1a1e26847e4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.447702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371952c-104c-4f3b-b0c2-c1a1e26847e4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.460104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371952c-104c-4f3b-b0c2-c1a1e26847e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.493129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b371952c-104c-4f3b-b0c2-c1a1e26847e4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:23.496283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b371952c-104c-4f3b-b0c2-c1a1e26847e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:23.520520 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1739/3513] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:23.521431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371952c-104c-4f3b-b0c2-c1a1e26847e4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:23.533756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371952c-104c-4f3b-b0c2-c1a1e26847e4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:23.543076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18d9d9-53b6-4d4a-8ccd-554de350da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:23.545179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18d9d9-53b6-4d4a-8ccd-554de350da6c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.546017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18d9d9-53b6-4d4a-8ccd-554de350da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.546797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18d9d9-53b6-4d4a-8ccd-554de350da6c admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.549004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18d9d9-53b6-4d4a-8ccd-554de350da6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:23.549606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18d9d9-53b6-4d4a-8ccd-554de350da6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:23.553467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18d9d9-53b6-4d4a-8ccd-554de350da6c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:23.584599 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1740/3514] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:23.586436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18d9d9-53b6-4d4a-8ccd-554de350da6c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:23.598027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46093747-973a-4435-982f-58824652b5cb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:23.599904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18d9d9-53b6-4d4a-8ccd-554de350da6c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:23.604963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c6e0-16bb-4dea-8933-940bffeae89d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:23.605350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e252adf-a3d1-456d-a91b-b1e5aff574b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:23.605612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c6e0-16bb-4dea-8933-940bffeae89d service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.606068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c6e0-16bb-4dea-8933-940bffeae89d service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.606515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4c6e0-16bb-4dea-8933-940bffeae89d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.606923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e252adf-a3d1-456d-a91b-b1e5aff574b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.607429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e252adf-a3d1-456d-a91b-b1e5aff574b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.607981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e252adf-a3d1-456d-a91b-b1e5aff574b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.609388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e252adf-a3d1-456d-a91b-b1e5aff574b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:23.611789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e252adf-a3d1-456d-a91b-b1e5aff574b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:23.616063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c6e0-16bb-4dea-8933-940bffeae89d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:23.618406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4c6e0-16bb-4dea-8933-940bffeae89d service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:23.628362 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1775/3515] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:56:23.660954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c6e0-16bb-4dea-8933-940bffeae89d service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:23.668190 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1741/3516] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:23 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:23.673146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4c6e0-16bb-4dea-8933-940bffeae89d service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:23.742029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e252adf-a3d1-456d-a91b-b1e5aff574b0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:23.744548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e252adf-a3d1-456d-a91b-b1e5aff574b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:23.765161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5253c-e051-483b-9c60-b9a4c3e08ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:23.766033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5253c-e051-483b-9c60-b9a4c3e08ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.766392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5253c-e051-483b-9c60-b9a4c3e08ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.766714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5253c-e051-483b-9c60-b9a4c3e08ac5 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.767604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5253c-e051-483b-9c60-b9a4c3e08ac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:23.770381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb5253c-e051-483b-9c60-b9a4c3e08ac5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:23.838961 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1776/3517] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:23 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:56:23.841707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971b07-0f27-4db2-8735-bb5377b409f0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.842006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971b07-0f27-4db2-8735-bb5377b409f0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.842457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971b07-0f27-4db2-8735-bb5377b409f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.868164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9a971b07-0f27-4db2-8735-bb5377b409f0 None None] MFA Rules not processed for user `9f1b846a05d1454bbd08f070d709e7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:23.868391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e252adf-a3d1-456d-a91b-b1e5aff574b0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:23.870750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9a971b07-0f27-4db2-8735-bb5377b409f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:23.877585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:23.878467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:23.878753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:23.879168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] PATH_INFO: `/v3/projects/41f152a476ec4b588dfe4e10cf9c90d1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:23.880446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41f152a476ec4b588dfe4e10cf9c90d1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:23.882448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:23.975427 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1777/3518] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:23.976665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41f152a476ec4b588dfe4e10cf9c90d1', 'request_id': 'req-452970d6-941e-44be-af77-cd1112551993'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:23.977228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971b07-0f27-4db2-8735-bb5377b409f0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:23.995244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a971b07-0f27-4db2-8735-bb5377b409f0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:23.995536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41f152a476ec4b588dfe4e10cf9c90d1', 'request_id': 'req-452970d6-941e-44be-af77-cd1112551993'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:24.000882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41f152a476ec4b588dfe4e10cf9c90d1', 'request_id': 'req-452970d6-941e-44be-af77-cd1112551993'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:24.030000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] The token cache is being invalidate because project 41f152a476ec4b588dfe4e10cf9c90d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:24.030333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:24.030951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-452970d6-941e-44be-af77-cd1112551993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:24.032938 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1742/3519] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:23 2022] DELETE /identity/v3/projects/41f152a476ec4b588dfe4e10cf9c90d1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:24.039038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f18e-b478-4b29-b05c-5f646ee600f6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.041134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f18e-b478-4b29-b05c-5f646ee600f6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.041513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8f18e-b478-4b29-b05c-5f646ee600f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.082716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-75d8f18e-b478-4b29-b05c-5f646ee600f6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:24.084051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-75d8f18e-b478-4b29-b05c-5f646ee600f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:24.160727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10f51b-ee9e-418f-9df2-1328a4f55c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.161597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f51b-ee9e-418f-9df2-1328a4f55c38 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.161882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f51b-ee9e-418f-9df2-1328a4f55c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.162150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f51b-ee9e-418f-9df2-1328a4f55c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.162878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10f51b-ee9e-418f-9df2-1328a4f55c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.164593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10f51b-ee9e-418f-9df2-1328a4f55c38 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.192323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1778/3520] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:24.195591 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1743/3521] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:24.197329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8f18e-b478-4b29-b05c-5f646ee600f6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.200520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-75d8f18e-b478-4b29-b05c-5f646ee600f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:24.210674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315e866-6499-4386-bfb5-611ae2842d69 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.211021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315e866-6499-4386-bfb5-611ae2842d69 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.211232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315e866-6499-4386-bfb5-611ae2842d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.225383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8f18e-b478-4b29-b05c-5f646ee600f6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.232506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4be18-857c-4720-b941-d1651800d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.233504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4be18-857c-4720-b941-d1651800d693 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.233797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4be18-857c-4720-b941-d1651800d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.234079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4be18-857c-4720-b941-d1651800d693 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.234814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4be18-857c-4720-b941-d1651800d693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.236963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4be18-857c-4720-b941-d1651800d693 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.245902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b315e866-6499-4386-bfb5-611ae2842d69 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:24.259652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b315e866-6499-4386-bfb5-611ae2842d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:24.268090 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1744/3522] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:24.269022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4be18-857c-4720-b941-d1651800d693 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.281621 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1779/3523] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:24.285520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315e866-6499-4386-bfb5-611ae2842d69 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.286121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4be18-857c-4720-b941-d1651800d693 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.290684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e575bf7c-4fb8-4233-8d81-36eef2103368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.291581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575bf7c-4fb8-4233-8d81-36eef2103368 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.291879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575bf7c-4fb8-4233-8d81-36eef2103368 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.292166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e575bf7c-4fb8-4233-8d81-36eef2103368 admin admin] PATH_INFO: `/v3/projects/5c5461353bca4916933328b9729676cf/users/3338788eae464112b4a5a2475157ca74/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.306733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315e866-6499-4386-bfb5-611ae2842d69 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.314083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9b70d-9e57-4123-8d45-bdc471314bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.315222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b70d-9e57-4123-8d45-bdc471314bce admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.315348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575bf7c-4fb8-4233-8d81-36eef2103368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c5461353bca4916933328b9729676cf, user_id=3338788eae464112b4a5a2475157ca74, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.315863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b70d-9e57-4123-8d45-bdc471314bce admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.316393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9b70d-9e57-4123-8d45-bdc471314bce admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.317406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9b70d-9e57-4123-8d45-bdc471314bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:24.317939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9b70d-9e57-4123-8d45-bdc471314bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.319669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e575bf7c-4fb8-4233-8d81-36eef2103368 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.320104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9b70d-9e57-4123-8d45-bdc471314bce admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.338887 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1780/3524] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:56:24.345391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9b70d-9e57-4123-8d45-bdc471314bce admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.346853 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1745/3525] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:24 2022] PUT /identity/v3/projects/5c5461353bca4916933328b9729676cf/users/3338788eae464112b4a5a2475157ca74/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:24.358015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33cd6c-422b-4edb-be50-16cb22920c02 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.358824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33cd6c-422b-4edb-be50-16cb22920c02 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.359357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33cd6c-422b-4edb-be50-16cb22920c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.364382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9b70d-9e57-4123-8d45-bdc471314bce admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.421533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-dc33cd6c-422b-4edb-be50-16cb22920c02 None None] MFA Rules not processed for user `3338788eae464112b4a5a2475157ca74`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:24.422926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dc33cd6c-422b-4edb-be50-16cb22920c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:24.439057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21fec9-587f-4b28-9760-48299833682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.440068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21fec9-587f-4b28-9760-48299833682b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.440441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21fec9-587f-4b28-9760-48299833682b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.440812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21fec9-587f-4b28-9760-48299833682b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.441602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21fec9-587f-4b28-9760-48299833682b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.443699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21fec9-587f-4b28-9760-48299833682b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.495341 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1781/3526] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:24 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:24.495341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194417-534e-4b39-8df9-3bf5455ea047 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.495341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194417-534e-4b39-8df9-3bf5455ea047 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.495341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4194417-534e-4b39-8df9-3bf5455ea047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.502130 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1746/3527] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:24.502130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33cd6c-422b-4edb-be50-16cb22920c02 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.515203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33cd6c-422b-4edb-be50-16cb22920c02 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.537634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a4194417-534e-4b39-8df9-3bf5455ea047 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:24.539242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a4194417-534e-4b39-8df9-3bf5455ea047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:24.598606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e128-3270-459e-ad23-372c8ffdb41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.600385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e128-3270-459e-ad23-372c8ffdb41b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.600666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e128-3270-459e-ad23-372c8ffdb41b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.600941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454e128-3270-459e-ad23-372c8ffdb41b admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.601905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454e128-3270-459e-ad23-372c8ffdb41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.605673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b454e128-3270-459e-ad23-372c8ffdb41b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.635211 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1782/3528] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:24.637168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194417-534e-4b39-8df9-3bf5455ea047 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.640977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a4194417-534e-4b39-8df9-3bf5455ea047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:24.647552 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1747/3529] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:24 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:24.650749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e128-3270-459e-ad23-372c8ffdb41b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.667906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b454e128-3270-459e-ad23-372c8ffdb41b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.684094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434f020-e338-405e-a52f-09b2c7e4aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.685606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434f020-e338-405e-a52f-09b2c7e4aa90 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.686244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434f020-e338-405e-a52f-09b2c7e4aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.686972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2434f020-e338-405e-a52f-09b2c7e4aa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.687832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434f020-e338-405e-a52f-09b2c7e4aa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.690062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2434f020-e338-405e-a52f-09b2c7e4aa90 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.703963 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1748/3530] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:24.703963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434f020-e338-405e-a52f-09b2c7e4aa90 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.705596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2434f020-e338-405e-a52f-09b2c7e4aa90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:24.771360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4194417-534e-4b39-8df9-3bf5455ea047 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.778399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fa283-532c-43b0-93d9-408f8a53c23e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.779055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fa283-532c-43b0-93d9-408f8a53c23e service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.779337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fa283-532c-43b0-93d9-408f8a53c23e service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.779619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fa283-532c-43b0-93d9-408f8a53c23e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.792684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2434f020-e338-405e-a52f-09b2c7e4aa90 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.798462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42426c-5963-4614-8e42-b3ea3260ec27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.799109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42426c-5963-4614-8e42-b3ea3260ec27 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.799556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42426c-5963-4614-8e42-b3ea3260ec27 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.799845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea42426c-5963-4614-8e42-b3ea3260ec27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.810006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42426c-5963-4614-8e42-b3ea3260ec27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.811643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea42426c-5963-4614-8e42-b3ea3260ec27 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.821217 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1749/3531] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:24.822155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42426c-5963-4614-8e42-b3ea3260ec27 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.835105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea42426c-5963-4614-8e42-b3ea3260ec27 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.841804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d5546-c86e-460e-a4b1-a3454fc7b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.842578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d5546-c86e-460e-a4b1-a3454fc7b583 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.842927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d5546-c86e-460e-a4b1-a3454fc7b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.843274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d5546-c86e-460e-a4b1-a3454fc7b583 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.844325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d5546-c86e-460e-a4b1-a3454fc7b583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.846121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d5546-c86e-460e-a4b1-a3454fc7b583 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.847068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fa283-532c-43b0-93d9-408f8a53c23e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.849319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fa283-532c-43b0-93d9-408f8a53c23e service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.861963 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1750/3532] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:24.863518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d5546-c86e-460e-a4b1-a3454fc7b583 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:24.865326 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1783/3533] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:24.875139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d5546-c86e-460e-a4b1-a3454fc7b583 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:24.887757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1be128-7624-4f08-81ff-9930406a4a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:24.888785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1be128-7624-4f08-81ff-9930406a4a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.889243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1be128-7624-4f08-81ff-9930406a4a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.889626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1be128-7624-4f08-81ff-9930406a4a6e admin admin] PATH_INFO: `/v3/projects/88c9aceff5e04f5c9c34dd5252062c8a/users/915f7c1f2168480b8b301166d8cbcfc2/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.908023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1be128-7624-4f08-81ff-9930406a4a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c9aceff5e04f5c9c34dd5252062c8a, user_id=915f7c1f2168480b8b301166d8cbcfc2, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:24.911573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1be128-7624-4f08-81ff-9930406a4a6e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:24.927532 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1751/3534] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:24 2022] PUT /identity/v3/projects/88c9aceff5e04f5c9c34dd5252062c8a/users/915f7c1f2168480b8b301166d8cbcfc2/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:24.937518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ba4f2-6477-4734-8e14-d72fb329bd15 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.937812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ba4f2-6477-4734-8e14-d72fb329bd15 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.938145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ba4f2-6477-4734-8e14-d72fb329bd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.950661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cb8fc-2f37-43ef-87c8-0ebfe18d1c72 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:24.950661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cb8fc-2f37-43ef-87c8-0ebfe18d1c72 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:24.950661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99cb8fc-2f37-43ef-87c8-0ebfe18d1c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:24.981533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f62ba4f2-6477-4734-8e14-d72fb329bd15 None None] MFA Rules not processed for user `915f7c1f2168480b8b301166d8cbcfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:24.982872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f62ba4f2-6477-4734-8e14-d72fb329bd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:24.999472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e99cb8fc-2f37-43ef-87c8-0ebfe18d1c72 None None] MFA Rules not processed for user `3338788eae464112b4a5a2475157ca74`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:25.000737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e99cb8fc-2f37-43ef-87c8-0ebfe18d1c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.080312 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1784/3535] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:25.081090 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1752/3536] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:25.081906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ba4f2-6477-4734-8e14-d72fb329bd15 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.084001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f62ba4f2-6477-4734-8e14-d72fb329bd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.087631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cb8fc-2f37-43ef-87c8-0ebfe18d1c72 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.167576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99cb8fc-2f37-43ef-87c8-0ebfe18d1c72 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.172716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78a57-59ca-4442-be9e-c7d4d59280f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.173372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78a57-59ca-4442-be9e-c7d4d59280f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.173657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78a57-59ca-4442-be9e-c7d4d59280f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.173932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b78a57-59ca-4442-be9e-c7d4d59280f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.174624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b78a57-59ca-4442-be9e-c7d4d59280f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.176579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b78a57-59ca-4442-be9e-c7d4d59280f0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.179273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ba4f2-6477-4734-8e14-d72fb329bd15 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.195267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.196711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.196989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.197394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] PATH_INFO: `/v3/users/9f1b846a05d1454bbd08f070d709e7d8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.199144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1b846a05d1454bbd08f070d709e7d8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.202036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.225183 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1753/3537] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:25 2022] POST /identity/v3/projects => generated 381 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:25.229365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78a57-59ca-4442-be9e-c7d4d59280f0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.265285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1b846a05d1454bbd08f070d709e7d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.274564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1b846a05d1454bbd08f070d709e7d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.276432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1b846a05d1454bbd08f070d709e7d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.277055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1b846a05d1454bbd08f070d709e7d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.288053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9545012-cf93-4247-8e18-d94fffc15889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1b846a05d1454bbd08f070d709e7d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.304832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b78a57-59ca-4442-be9e-c7d4d59280f0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.314447 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1785/3538] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:25 2022] DELETE /identity/v3/users/9f1b846a05d1454bbd08f070d709e7d8 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:25.316082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073653c-c9b3-48f0-85bc-57cabdf6e8d2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.316605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073653c-c9b3-48f0-85bc-57cabdf6e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.316998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be3550-a04f-4235-abbb-233c13437742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.317250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073653c-c9b3-48f0-85bc-57cabdf6e8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.317698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be3550-a04f-4235-abbb-233c13437742 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.318039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be3550-a04f-4235-abbb-233c13437742 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.318318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be3550-a04f-4235-abbb-233c13437742 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.319066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be3550-a04f-4235-abbb-233c13437742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.321159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08be3550-a04f-4235-abbb-233c13437742 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.338012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5073653c-c9b3-48f0-85bc-57cabdf6e8d2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:25.339495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5073653c-c9b3-48f0-85bc-57cabdf6e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.349224 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1754/3539] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:25 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:25.350674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be3550-a04f-4235-abbb-233c13437742 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.353126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-08be3550-a04f-4235-abbb-233c13437742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.371734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be3550-a04f-4235-abbb-233c13437742 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.418159 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1786/3540] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:25.426691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073653c-c9b3-48f0-85bc-57cabdf6e8d2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.428279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5073653c-c9b3-48f0-85bc-57cabdf6e8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.460810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345c159-ec85-4e2b-9503-9e3abc992027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.462149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345c159-ec85-4e2b-9503-9e3abc992027 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.462582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345c159-ec85-4e2b-9503-9e3abc992027 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.462966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345c159-ec85-4e2b-9503-9e3abc992027 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.464392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345c159-ec85-4e2b-9503-9e3abc992027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.466314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345c159-ec85-4e2b-9503-9e3abc992027 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.481465 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1755/3541] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:25.486605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345c159-ec85-4e2b-9503-9e3abc992027 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.488380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8345c159-ec85-4e2b-9503-9e3abc992027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.502859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345c159-ec85-4e2b-9503-9e3abc992027 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.506990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073653c-c9b3-48f0-85bc-57cabdf6e8d2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.508815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.510624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.511082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.511351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] PATH_INFO: `/v3/users/3338788eae464112b4a5a2475157ca74` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.512761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3338788eae464112b4a5a2475157ca74)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.514967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1b5f-5269-49ee-988d-78c5a087917d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.515152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.516053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1b5f-5269-49ee-988d-78c5a087917d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.516709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1b5f-5269-49ee-988d-78c5a087917d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.517431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a1b5f-5269-49ee-988d-78c5a087917d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.533448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a1b5f-5269-49ee-988d-78c5a087917d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.536559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a1b5f-5269-49ee-988d-78c5a087917d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.550563 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1787/3542] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:25.551224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1b5f-5269-49ee-988d-78c5a087917d service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.563079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a1b5f-5269-49ee-988d-78c5a087917d service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.568801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc21cdd-3356-4410-825f-7818c6b9d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.569525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc21cdd-3356-4410-825f-7818c6b9d180 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.569804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc21cdd-3356-4410-825f-7818c6b9d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.570082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc21cdd-3356-4410-825f-7818c6b9d180 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.570902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc21cdd-3356-4410-825f-7818c6b9d180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.572809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc21cdd-3356-4410-825f-7818c6b9d180 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.587575 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1788/3543] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:25.592153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc21cdd-3356-4410-825f-7818c6b9d180 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.608425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3338788eae464112b4a5a2475157ca74'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.608893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc21cdd-3356-4410-825f-7818c6b9d180 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.620409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6a1b8-b0ba-4237-bd48-12cadfdf0fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.621641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a1b8-b0ba-4237-bd48-12cadfdf0fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.622201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a1b8-b0ba-4237-bd48-12cadfdf0fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.622545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6a1b8-b0ba-4237-bd48-12cadfdf0fa0 admin admin] PATH_INFO: `/v3/projects/c9b3f33fb8f04b1b80ae057ffaaa62c0/users/417a8d1e3c04423cb2c142f09ce67700/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.624855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3338788eae464112b4a5a2475157ca74'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.626083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3338788eae464112b4a5a2475157ca74'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.627128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3338788eae464112b4a5a2475157ca74'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.645766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98d04e21-8bcc-4ee2-b5e4-0c7ede325df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3338788eae464112b4a5a2475157ca74'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:25.655186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6a1b8-b0ba-4237-bd48-12cadfdf0fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b3f33fb8f04b1b80ae057ffaaa62c0, user_id=417a8d1e3c04423cb2c142f09ce67700, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.659967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6a1b8-b0ba-4237-bd48-12cadfdf0fa0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.667993 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1756/3544] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:25 2022] DELETE /identity/v3/users/3338788eae464112b4a5a2475157ca74 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:25.673233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297a31-db4b-430d-9903-3ec5e2251c6a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.674627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297a31-db4b-430d-9903-3ec5e2251c6a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.674955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59297a31-db4b-430d-9903-3ec5e2251c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.697614 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1789/3545] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:25 2022] PUT /identity/v3/projects/c9b3f33fb8f04b1b80ae057ffaaa62c0/users/417a8d1e3c04423cb2c142f09ce67700/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:56:25.700184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-59297a31-db4b-430d-9903-3ec5e2251c6a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:25.701706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-59297a31-db4b-430d-9903-3ec5e2251c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.710430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54154b9-3f40-4e1c-b925-42f1e7aeadbc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.710786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54154b9-3f40-4e1c-b925-42f1e7aeadbc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.712089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54154b9-3f40-4e1c-b925-42f1e7aeadbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.751378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b54154b9-3f40-4e1c-b925-42f1e7aeadbc None None] MFA Rules not processed for user `417a8d1e3c04423cb2c142f09ce67700`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:25.752893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b54154b9-3f40-4e1c-b925-42f1e7aeadbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.803317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1757/3546] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:25.828280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59297a31-db4b-430d-9903-3ec5e2251c6a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.829953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-59297a31-db4b-430d-9903-3ec5e2251c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.842510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1790/3547] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:25.847655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54154b9-3f40-4e1c-b925-42f1e7aeadbc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:25.849779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b54154b9-3f40-4e1c-b925-42f1e7aeadbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:25.922710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59297a31-db4b-430d-9903-3ec5e2251c6a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.926499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2469a921-2693-4d03-85f8-71d05e0a9a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.927190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469a921-2693-4d03-85f8-71d05e0a9a75 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.927604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469a921-2693-4d03-85f8-71d05e0a9a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.927884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2469a921-2693-4d03-85f8-71d05e0a9a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.935164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54154b9-3f40-4e1c-b925-42f1e7aeadbc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:25.941032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90558e01-e8ff-4e55-aa13-85f71b1bfb08 tempest-IdentityV3ProjectsTest-716596226 tempest-IdentityV3ProjectsTest-716596226-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '915f7c1f2168480b8b301166d8cbcfc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88c9aceff5e04f5c9c34dd5252062c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:25.942013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90558e01-e8ff-4e55-aa13-85f71b1bfb08 tempest-IdentityV3ProjectsTest-716596226 tempest-IdentityV3ProjectsTest-716596226-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:25.942676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90558e01-e8ff-4e55-aa13-85f71b1bfb08 tempest-IdentityV3ProjectsTest-716596226 tempest-IdentityV3ProjectsTest-716596226-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:25.942968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90558e01-e8ff-4e55-aa13-85f71b1bfb08 tempest-IdentityV3ProjectsTest-716596226 tempest-IdentityV3ProjectsTest-716596226-project] PATH_INFO: `/v3/users/915f7c1f2168480b8b301166d8cbcfc2/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:25.948316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90558e01-e8ff-4e55-aa13-85f71b1bfb08 tempest-IdentityV3ProjectsTest-716596226 tempest-IdentityV3ProjectsTest-716596226-project] RBAC: Authorizing `identity:list_user_projects(user_id=915f7c1f2168480b8b301166d8cbcfc2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.951685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469a921-2693-4d03-85f8-71d05e0a9a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:25.953892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2469a921-2693-4d03-85f8-71d05e0a9a75 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.954028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90558e01-e8ff-4e55-aa13-85f71b1bfb08 tempest-IdentityV3ProjectsTest-716596226 tempest-IdentityV3ProjectsTest-716596226-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:25.968301 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1758/3548] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:26.061931 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1791/3549] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 20:56:25 2022] GET /identity/v3/users/915f7c1f2168480b8b301166d8cbcfc2/projects => generated 515 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:56:26.062106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43133577-6626-4bd1-bcc0-0312596cecb3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.062106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43133577-6626-4bd1-bcc0-0312596cecb3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.062106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43133577-6626-4bd1-bcc0-0312596cecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.107886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-43133577-6626-4bd1-bcc0-0312596cecb3 None None] MFA Rules not processed for user `915f7c1f2168480b8b301166d8cbcfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:26.109184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-43133577-6626-4bd1-bcc0-0312596cecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.124451 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1759/3550] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:26.125972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.126362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.126772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.127898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43133577-6626-4bd1-bcc0-0312596cecb3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.129759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-43133577-6626-4bd1-bcc0-0312596cecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.155137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] MFA Rules not processed for user `915f7c1f2168480b8b301166d8cbcfc2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:26.160372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.170310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43133577-6626-4bd1-bcc0-0312596cecb3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.182328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.183089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.183469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.183647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] PATH_INFO: `/v3/projects/4779df637b8c4ad18db612e122dd0edc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.185382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4779df637b8c4ad18db612e122dd0edc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.187335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.238195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.models.token_model [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] User 915f7c1f2168480b8b301166d8cbcfc2 has no access to project c9b3f33fb8f04b1b80ae057ffaaa62c0 {{(pid=97202) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Mar 26 20:56:26.244144 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Mar 26 20:56:26.246416 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1792/3551] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 122 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Mar 26 20:56:26.251573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.253486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.273269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4779df637b8c4ad18db612e122dd0edc', 'request_id': 'req-e5f6ff33-8a04-40ed-a63f-705766e922c8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.288044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c5383-a417-4713-b250-1cb3db8b6d2b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.292768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4779df637b8c4ad18db612e122dd0edc', 'request_id': 'req-e5f6ff33-8a04-40ed-a63f-705766e922c8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.302983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4779df637b8c4ad18db612e122dd0edc', 'request_id': 'req-e5f6ff33-8a04-40ed-a63f-705766e922c8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.319954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] The token cache is being invalidate because project 4779df637b8c4ad18db612e122dd0edc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:26.320562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.324174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5f6ff33-8a04-40ed-a63f-705766e922c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.329760 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1760/3552] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:26 2022] DELETE /identity/v3/projects/4779df637b8c4ad18db612e122dd0edc => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:26.331655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b1ac-6440-4b30-9fbe-8b6fc7dd8424 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.332064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b1ac-6440-4b30-9fbe-8b6fc7dd8424 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.332335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b1ac-6440-4b30-9fbe-8b6fc7dd8424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.358011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-eb38b1ac-6440-4b30-9fbe-8b6fc7dd8424 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:26.359829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eb38b1ac-6440-4b30-9fbe-8b6fc7dd8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.419190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.420224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.420852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.421136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] PATH_INFO: `/v3/users/915f7c1f2168480b8b301166d8cbcfc2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.422525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=915f7c1f2168480b8b301166d8cbcfc2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.427612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.450431 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1761/3553] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:26.452090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38b1ac-6440-4b30-9fbe-8b6fc7dd8424 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.454005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eb38b1ac-6440-4b30-9fbe-8b6fc7dd8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.468877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38b1ac-6440-4b30-9fbe-8b6fc7dd8424 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.475079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.476159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.476584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.476852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] PATH_INFO: `/v3/projects/5c5461353bca4916933328b9729676cf` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.478925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c5461353bca4916933328b9729676cf)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.480947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.505213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915f7c1f2168480b8b301166d8cbcfc2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.514570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915f7c1f2168480b8b301166d8cbcfc2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.515482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915f7c1f2168480b8b301166d8cbcfc2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.516264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915f7c1f2168480b8b301166d8cbcfc2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.525184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e5c0efc-1d7e-4d89-a6e6-830422eaa884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915f7c1f2168480b8b301166d8cbcfc2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.540917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c5461353bca4916933328b9729676cf', 'request_id': 'req-17637429-c4b2-464d-b7c2-f23db12c0a7a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.545477 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1793/3554] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:26 2022] DELETE /identity/v3/users/915f7c1f2168480b8b301166d8cbcfc2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:26.546965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a53ec-1af2-489e-a064-23112a36404e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.547256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a53ec-1af2-489e-a064-23112a36404e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.547560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a53ec-1af2-489e-a064-23112a36404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.551558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c5461353bca4916933328b9729676cf', 'request_id': 'req-17637429-c4b2-464d-b7c2-f23db12c0a7a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.558847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c5461353bca4916933328b9729676cf', 'request_id': 'req-17637429-c4b2-464d-b7c2-f23db12c0a7a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.570125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3b1a53ec-1af2-489e-a064-23112a36404e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:26.570350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] The token cache is being invalidate because project 5c5461353bca4916933328b9729676cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:26.571692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.572130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3b1a53ec-1af2-489e-a064-23112a36404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.576339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-17637429-c4b2-464d-b7c2-f23db12c0a7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:26.578567 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1762/3555] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:26 2022] DELETE /identity/v3/projects/5c5461353bca4916933328b9729676cf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:26.579675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b5a3b-23ef-423c-8557-fe8e78149d29 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.580127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b5a3b-23ef-423c-8557-fe8e78149d29 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.581181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b5a3b-23ef-423c-8557-fe8e78149d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.599234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ff8b5a3b-23ef-423c-8557-fe8e78149d29 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:26.600559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ff8b5a3b-23ef-423c-8557-fe8e78149d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.643194 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1794/3556] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:26.644624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba05e6-8d18-4d64-9983-95f2f8231146 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.644919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba05e6-8d18-4d64-9983-95f2f8231146 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.645200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba05e6-8d18-4d64-9983-95f2f8231146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.663815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ebba05e6-8d18-4d64-9983-95f2f8231146 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:26.665477 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1763/3557] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:26.668779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ebba05e6-8d18-4d64-9983-95f2f8231146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.668922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b5a3b-23ef-423c-8557-fe8e78149d29 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.676828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b5a3b-23ef-423c-8557-fe8e78149d29 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.683111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636167b-a77c-4a54-972e-3507caea6d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.683762 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1795/3558] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:26.683942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636167b-a77c-4a54-972e-3507caea6d0c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.684165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636167b-a77c-4a54-972e-3507caea6d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.684455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636167b-a77c-4a54-972e-3507caea6d0c admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.685242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636167b-a77c-4a54-972e-3507caea6d0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:26.685553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636167b-a77c-4a54-972e-3507caea6d0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.685712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba05e6-8d18-4d64-9983-95f2f8231146 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.687174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636167b-a77c-4a54-972e-3507caea6d0c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.691385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ebba05e6-8d18-4d64-9983-95f2f8231146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.699757 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1764/3559] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:26.701167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cda3a-04a8-44ab-b565-d7056be73429 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.701464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cda3a-04a8-44ab-b565-d7056be73429 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.701741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cda3a-04a8-44ab-b565-d7056be73429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.720197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c53cda3a-04a8-44ab-b565-d7056be73429 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:26.721417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c53cda3a-04a8-44ab-b565-d7056be73429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:26.730922 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1765/3560] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:26.731508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cda3a-04a8-44ab-b565-d7056be73429 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.741198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cda3a-04a8-44ab-b565-d7056be73429 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.747233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8daf5-1570-4d65-b5de-d1e6d2491559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.748106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8daf5-1570-4d65-b5de-d1e6d2491559 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.748544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8daf5-1570-4d65-b5de-d1e6d2491559 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.748671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8daf5-1570-4d65-b5de-d1e6d2491559 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.749511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8daf5-1570-4d65-b5de-d1e6d2491559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.751472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8daf5-1570-4d65-b5de-d1e6d2491559 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.763111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba05e6-8d18-4d64-9983-95f2f8231146 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.766806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede8106-bfb4-42d1-a25e-2fafff2d0801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.767445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8106-bfb4-42d1-a25e-2fafff2d0801 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.767727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8106-bfb4-42d1-a25e-2fafff2d0801 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.768042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede8106-bfb4-42d1-a25e-2fafff2d0801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.780624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8106-bfb4-42d1-a25e-2fafff2d0801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.782072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede8106-bfb4-42d1-a25e-2fafff2d0801 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.787058 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1766/3561] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/projects => generated 411 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:26.791512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8daf5-1570-4d65-b5de-d1e6d2491559 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.793425 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1796/3562] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:26.794220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede8106-bfb4-42d1-a25e-2fafff2d0801 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.804372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede8106-bfb4-42d1-a25e-2fafff2d0801 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.877968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8daf5-1570-4d65-b5de-d1e6d2491559 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.882869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c76c2-761e-461b-8b8a-07fbfc9195e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.883688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c76c2-761e-461b-8b8a-07fbfc9195e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.884024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c76c2-761e-461b-8b8a-07fbfc9195e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.884301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c76c2-761e-461b-8b8a-07fbfc9195e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.885045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c76c2-761e-461b-8b8a-07fbfc9195e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:26.885381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c76c2-761e-461b-8b8a-07fbfc9195e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.886885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b924e51-42f2-44ce-a109-cb37d3500fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.887038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c76c2-761e-461b-8b8a-07fbfc9195e4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.887557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b924e51-42f2-44ce-a109-cb37d3500fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.887877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b924e51-42f2-44ce-a109-cb37d3500fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.888190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b924e51-42f2-44ce-a109-cb37d3500fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.888876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b924e51-42f2-44ce-a109-cb37d3500fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.890819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b924e51-42f2-44ce-a109-cb37d3500fd8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.898757 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1767/3563] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:26.903206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c76c2-761e-461b-8b8a-07fbfc9195e4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.914191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c76c2-761e-461b-8b8a-07fbfc9195e4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.916995 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1797/3564] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/users => generated 306 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:26.919699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa06dc-fc2b-4712-a3da-e5da93e9a0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.920535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa06dc-fc2b-4712-a3da-e5da93e9a0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.920910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa06dc-fc2b-4712-a3da-e5da93e9a0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.921253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa06dc-fc2b-4712-a3da-e5da93e9a0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.921597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b924e51-42f2-44ce-a109-cb37d3500fd8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.922061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa06dc-fc2b-4712-a3da-e5da93e9a0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.924063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa06dc-fc2b-4712-a3da-e5da93e9a0f8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.933435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b924e51-42f2-44ce-a109-cb37d3500fd8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:26.939550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458322-00c7-43a9-86ba-312a69d89449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:26.940237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458322-00c7-43a9-86ba-312a69d89449 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:26.940517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458322-00c7-43a9-86ba-312a69d89449 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:26.940789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28458322-00c7-43a9-86ba-312a69d89449 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:26.941503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28458322-00c7-43a9-86ba-312a69d89449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:26.943423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28458322-00c7-43a9-86ba-312a69d89449 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:26.953729 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1798/3565] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:56:26.958891 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1768/3566] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/projects => generated 361 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:56:26.959647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458322-00c7-43a9-86ba-312a69d89449 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.960182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa06dc-fc2b-4712-a3da-e5da93e9a0f8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:26.970312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28458322-00c7-43a9-86ba-312a69d89449 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.056865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa06dc-fc2b-4712-a3da-e5da93e9a0f8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.066426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3f919-6b52-4988-90c0-47cadecd742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.067875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3f919-6b52-4988-90c0-47cadecd742d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.068186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3f919-6b52-4988-90c0-47cadecd742d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.068464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb3f919-6b52-4988-90c0-47cadecd742d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.069164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3f919-6b52-4988-90c0-47cadecd742d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.072592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb3f919-6b52-4988-90c0-47cadecd742d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.085523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ec82-e75d-4ebe-9804-001e2d326a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.086209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ec82-e75d-4ebe-9804-001e2d326a71 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.087019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ec82-e75d-4ebe-9804-001e2d326a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.087300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92ec82-e75d-4ebe-9804-001e2d326a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.088062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92ec82-e75d-4ebe-9804-001e2d326a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.089736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92ec82-e75d-4ebe-9804-001e2d326a71 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.110428 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1799/3567] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:56:27.110428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ec82-e75d-4ebe-9804-001e2d326a71 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:27.118328 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1769/3568] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:26 2022] POST /identity/v3/users => generated 281 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:27.119487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3f919-6b52-4988-90c0-47cadecd742d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:27.123882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92ec82-e75d-4ebe-9804-001e2d326a71 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.129480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb3f919-6b52-4988-90c0-47cadecd742d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.130483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841945e5-1ec1-4b8c-a837-f4becc39a144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.131435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841945e5-1ec1-4b8c-a837-f4becc39a144 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.131794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841945e5-1ec1-4b8c-a837-f4becc39a144 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.132172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841945e5-1ec1-4b8c-a837-f4becc39a144 admin admin] PATH_INFO: `/v3/projects/7150c612879247208855ce511f95a5a2/users/a01a3991559f4738b240874a96dd5ad6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.134394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a22378-d998-4277-8372-19957c3d21e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.135178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22378-d998-4277-8372-19957c3d21e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.135569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22378-d998-4277-8372-19957c3d21e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.136013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a22378-d998-4277-8372-19957c3d21e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.136847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a22378-d998-4277-8372-19957c3d21e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.138604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a22378-d998-4277-8372-19957c3d21e1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.152832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841945e5-1ec1-4b8c-a837-f4becc39a144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7150c612879247208855ce511f95a5a2, user_id=a01a3991559f4738b240874a96dd5ad6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.156005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841945e5-1ec1-4b8c-a837-f4becc39a144 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.158951 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1770/3569] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:27.161004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a22378-d998-4277-8372-19957c3d21e1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:27.176076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a22378-d998-4277-8372-19957c3d21e1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.184380 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1800/3570] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:27 2022] PUT /identity/v3/projects/7150c612879247208855ce511f95a5a2/users/a01a3991559f4738b240874a96dd5ad6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:27.187070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e919f1-a3bb-43ba-8e27-31d8d0fa2ef9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.188555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e919f1-a3bb-43ba-8e27-31d8d0fa2ef9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.189084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e919f1-a3bb-43ba-8e27-31d8d0fa2ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.215068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-67e919f1-a3bb-43ba-8e27-31d8d0fa2ef9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:27.220007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-67e919f1-a3bb-43ba-8e27-31d8d0fa2ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:27.276833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf7502-2acf-4767-acdb-d450ff62379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.277763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf7502-2acf-4767-acdb-d450ff62379a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.277763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf7502-2acf-4767-acdb-d450ff62379a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.277988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf7502-2acf-4767-acdb-d450ff62379a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.278639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf7502-2acf-4767-acdb-d450ff62379a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.280300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf7502-2acf-4767-acdb-d450ff62379a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.296244 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1771/3571] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:27.296244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf7502-2acf-4767-acdb-d450ff62379a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:27.296979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5dbf7502-2acf-4767-acdb-d450ff62379a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:27.320987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf7502-2acf-4767-acdb-d450ff62379a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.332034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.332475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.332754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.333026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] PATH_INFO: `/v3/projects/88c9aceff5e04f5c9c34dd5252062c8a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.334352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c9aceff5e04f5c9c34dd5252062c8a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.336841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.362559 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1801/3572] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:27.362559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e919f1-a3bb-43ba-8e27-31d8d0fa2ef9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:27.370749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e919f1-a3bb-43ba-8e27-31d8d0fa2ef9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.376717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcd36-cdcf-44d8-b882-e9917f975a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.377746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcd36-cdcf-44d8-b882-e9917f975a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.378252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcd36-cdcf-44d8-b882-e9917f975a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.378634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bcd36-cdcf-44d8-b882-e9917f975a38 admin admin] PATH_INFO: `/v3/projects/600ab65c259948d68ae63e9b7cfd26ee/users/24d6bbe430e043c8b9472546501e70aa/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.393894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c9aceff5e04f5c9c34dd5252062c8a', 'request_id': 'req-2ebc4664-54ad-4a7d-84d1-e0da47d20619'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.394501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bcd36-cdcf-44d8-b882-e9917f975a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=600ab65c259948d68ae63e9b7cfd26ee, user_id=24d6bbe430e043c8b9472546501e70aa, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.397323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bcd36-cdcf-44d8-b882-e9917f975a38 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.401713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c9aceff5e04f5c9c34dd5252062c8a', 'request_id': 'req-2ebc4664-54ad-4a7d-84d1-e0da47d20619'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.408481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c9aceff5e04f5c9c34dd5252062c8a', 'request_id': 'req-2ebc4664-54ad-4a7d-84d1-e0da47d20619'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.412105 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1802/3573] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:27 2022] PUT /identity/v3/projects/600ab65c259948d68ae63e9b7cfd26ee/users/24d6bbe430e043c8b9472546501e70aa/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:27.413070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcd36-cdcf-44d8-b882-e9917f975a38 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:27.415488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4d4bcd36-cdcf-44d8-b882-e9917f975a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:27.432419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] The token cache is being invalidate because project 88c9aceff5e04f5c9c34dd5252062c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:27.433342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.434136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ebc4664-54ad-4a7d-84d1-e0da47d20619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.439436 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1772/3574] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:27 2022] DELETE /identity/v3/projects/88c9aceff5e04f5c9c34dd5252062c8a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:27.439436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5391bf-cec9-4741-8668-1485a60228eb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.439436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5391bf-cec9-4741-8668-1485a60228eb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.439436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5391bf-cec9-4741-8668-1485a60228eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.470602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-dd5391bf-cec9-4741-8668-1485a60228eb None None] MFA Rules not processed for user `24d6bbe430e043c8b9472546501e70aa`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:27.472077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dd5391bf-cec9-4741-8668-1485a60228eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:27.496475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bcd36-cdcf-44d8-b882-e9917f975a38 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.505873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.506440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.507074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.507604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.511682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:27.562477 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1773/3575] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:27.563599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5391bf-cec9-4741-8668-1485a60228eb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:27.565402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dd5391bf-cec9-4741-8668-1485a60228eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:27.600061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.601637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.616394 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1803/3576] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:27.656217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5391bf-cec9-4741-8668-1485a60228eb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.658353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:27.659848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:27.667368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.668757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.668870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.669430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] PATH_INFO: `/v3/users/417a8d1e3c04423cb2c142f09ce67700` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.670725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=417a8d1e3c04423cb2c142f09ce67700)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.672995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.751257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '417a8d1e3c04423cb2c142f09ce67700'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.764496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '417a8d1e3c04423cb2c142f09ce67700'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.765421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '417a8d1e3c04423cb2c142f09ce67700'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.766261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '417a8d1e3c04423cb2c142f09ce67700'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.784445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60c92d6-b41d-4fb5-bf79-afb431406e95 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.785108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '417a8d1e3c04423cb2c142f09ce67700'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:27.791413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7980af2-e735-4165-852d-4152accc4bd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.792270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7980af2-e735-4165-852d-4152accc4bd2 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.792681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7980af2-e735-4165-852d-4152accc4bd2 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.793024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7980af2-e735-4165-852d-4152accc4bd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.795061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f7980af2-e735-4165-852d-4152accc4bd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:27.801399 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1774/3577] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:27 2022] DELETE /identity/v3/users/417a8d1e3c04423cb2c142f09ce67700 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:27.807067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7980af2-e735-4165-852d-4152accc4bd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.808830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7980af2-e735-4165-852d-4152accc4bd2 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:27.830916 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1804/3578] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:27.881758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:27.884417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:27.970358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def666d-fe9a-449b-97dc-1df2ca0364ce admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:27.978381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:27.980010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:27.980308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:27.980593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] PATH_INFO: `/v3/users/24d6bbe430e043c8b9472546501e70aa` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:27.982119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d6bbe430e043c8b9472546501e70aa)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:27.986035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:28.067442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d6bbe430e043c8b9472546501e70aa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.078409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d6bbe430e043c8b9472546501e70aa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.079182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d6bbe430e043c8b9472546501e70aa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.079979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d6bbe430e043c8b9472546501e70aa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.099587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d6bbe430e043c8b9472546501e70aa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.129772 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1775/3579] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:27 2022] DELETE /identity/v3/users/24d6bbe430e043c8b9472546501e70aa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:28.135760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80355702-6025-4235-9404-f4937ed98f76 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:28.136680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80355702-6025-4235-9404-f4937ed98f76 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:28.137124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80355702-6025-4235-9404-f4937ed98f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:28.157546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:28.159081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:28.172200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-80355702-6025-4235-9404-f4937ed98f76 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:28.174163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-80355702-6025-4235-9404-f4937ed98f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:28.269420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20107320-31e9-4abb-a316-28196fc8e056 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:28.274498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:28.275373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:28.275661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:28.276006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] PATH_INFO: `/v3/projects/c9b3f33fb8f04b1b80ae057ffaaa62c0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:28.277358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b3f33fb8f04b1b80ae057ffaaa62c0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:28.279457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:28.311970 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1805/3580] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:28.330887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80355702-6025-4235-9404-f4937ed98f76 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:28.332454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-80355702-6025-4235-9404-f4937ed98f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:28.340522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b3f33fb8f04b1b80ae057ffaaa62c0', 'request_id': 'req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.366590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b3f33fb8f04b1b80ae057ffaaa62c0', 'request_id': 'req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.392594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b3f33fb8f04b1b80ae057ffaaa62c0', 'request_id': 'req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.411520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] The token cache is being invalidate because project c9b3f33fb8f04b1b80ae057ffaaa62c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:28.411826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.412551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-66c9a4cd-81a8-4bf5-be8c-1165ef8f26e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:28.415042 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1776/3581] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:28 2022] DELETE /identity/v3/projects/c9b3f33fb8f04b1b80ae057ffaaa62c0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:56:28.422858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a41c93-7df9-4d71-9417-b55ff16cb704 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:28.423410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a41c93-7df9-4d71-9417-b55ff16cb704 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:28.423703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a41c93-7df9-4d71-9417-b55ff16cb704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:28.442778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80355702-6025-4235-9404-f4937ed98f76 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:28.454708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e3a41c93-7df9-4d71-9417-b55ff16cb704 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:28.460145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e3a41c93-7df9-4d71-9417-b55ff16cb704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:28.554386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af31e5-3923-401a-921e-705e7d7a6872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:28.554985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af31e5-3923-401a-921e-705e7d7a6872 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:28.555847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af31e5-3923-401a-921e-705e7d7a6872 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:28.556153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af31e5-3923-401a-921e-705e7d7a6872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:28.560037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-91af31e5-3923-401a-921e-705e7d7a6872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:28.607126 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1777/3582] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:28.618835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2526f6-a431-440b-8aca-935b695cc322 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:28.621338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2526f6-a431-440b-8aca-935b695cc322 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:28.621631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2526f6-a431-440b-8aca-935b695cc322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:28.667279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ac2526f6-a431-440b-8aca-935b695cc322 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:28.667279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ac2526f6-a431-440b-8aca-935b695cc322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:28.688133 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1778/3583] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:28.706414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af31e5-3923-401a-921e-705e7d7a6872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:28.708064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af31e5-3923-401a-921e-705e7d7a6872 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:28.714995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2526f6-a431-440b-8aca-935b695cc322 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:28.725231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2526f6-a431-440b-8aca-935b695cc322 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:28.730750 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1806/3584] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:28.731709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a91ee5-9036-41e9-bb2b-ac153dbc763f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:28.732813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a91ee5-9036-41e9-bb2b-ac153dbc763f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:28.733294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a91ee5-9036-41e9-bb2b-ac153dbc763f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:28.733642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a91ee5-9036-41e9-bb2b-ac153dbc763f admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:28.735376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a91ee5-9036-41e9-bb2b-ac153dbc763f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:28.735760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a91ee5-9036-41e9-bb2b-ac153dbc763f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:28.736811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f420de-c403-449c-a70d-c693d0868d6b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:28.737109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f420de-c403-449c-a70d-c693d0868d6b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:28.737407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f420de-c403-449c-a70d-c693d0868d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:28.738957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a91ee5-9036-41e9-bb2b-ac153dbc763f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:28.762205 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1779/3585] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:56:28.764767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2cfc-d9de-4271-a9bb-071a3d61fcc6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:28.765366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2cfc-d9de-4271-a9bb-071a3d61fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:28.765852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2cfc-d9de-4271-a9bb-071a3d61fcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:28.770668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-31f420de-c403-449c-a70d-c693d0868d6b None None] MFA Rules not processed for user `4c8199b3248742a7ba0d0cb6570c7058`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:28.771889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-31f420de-c403-449c-a70d-c693d0868d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:28.794620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ff1d2cfc-d9de-4271-a9bb-071a3d61fcc6 None None] MFA Rules not processed for user `563bce524229478faa4886b1d2285114`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:28.796508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ff1d2cfc-d9de-4271-a9bb-071a3d61fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:28.892079 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1807/3586] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:28.893595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f420de-c403-449c-a70d-c693d0868d6b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:28.896162 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1780/3587] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:28.923147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f420de-c403-449c-a70d-c693d0868d6b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:28.930419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd1612-1c7c-42f3-a19b-7576f11e01ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:28.931548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1612-1c7c-42f3-a19b-7576f11e01ed admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:28.931548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1612-1c7c-42f3-a19b-7576f11e01ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:28.931548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd1612-1c7c-42f3-a19b-7576f11e01ed admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:28.932548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd1612-1c7c-42f3-a19b-7576f11e01ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:28.936873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd1612-1c7c-42f3-a19b-7576f11e01ed admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:28.978237 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1808/3588] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:28 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:28.982422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2cfc-d9de-4271-a9bb-071a3d61fcc6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:29.001520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2cfc-d9de-4271-a9bb-071a3d61fcc6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:29.160384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398ca6b-48d3-4675-8664-41b10946e0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:29.161065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398ca6b-48d3-4675-8664-41b10946e0dd admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.161348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398ca6b-48d3-4675-8664-41b10946e0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.161852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398ca6b-48d3-4675-8664-41b10946e0dd admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.162373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398ca6b-48d3-4675-8664-41b10946e0dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:29.166164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e186-6115-4e25-81e3-a9600df8000a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.166753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e186-6115-4e25-81e3-a9600df8000a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.166974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549e186-6115-4e25-81e3-a9600df8000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.176397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398ca6b-48d3-4675-8664-41b10946e0dd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:29.207815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f549e186-6115-4e25-81e3-a9600df8000a None None] MFA Rules not processed for user `563bce524229478faa4886b1d2285114`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:29.211402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f549e186-6115-4e25-81e3-a9600df8000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:29.223259 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1781/3589] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:28 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:29.224453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398ca6b-48d3-4675-8664-41b10946e0dd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:29.247127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398ca6b-48d3-4675-8664-41b10946e0dd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:29.274599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb80d2-a44d-4472-af35-dc07cc758554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:29.275284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb80d2-a44d-4472-af35-dc07cc758554 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.275573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb80d2-a44d-4472-af35-dc07cc758554 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.275849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb80d2-a44d-4472-af35-dc07cc758554 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.279139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb80d2-a44d-4472-af35-dc07cc758554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:29.280841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb80d2-a44d-4472-af35-dc07cc758554 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:29.314780 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1782/3590] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:29.318727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb80d2-a44d-4472-af35-dc07cc758554 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:29.338712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb80d2-a44d-4472-af35-dc07cc758554 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:29.346492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53a107-3ca6-46b2-baca-097a4f935780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:29.346971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53a107-3ca6-46b2-baca-097a4f935780 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.347422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53a107-3ca6-46b2-baca-097a4f935780 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.347702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53a107-3ca6-46b2-baca-097a4f935780 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.348474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53a107-3ca6-46b2-baca-097a4f935780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:29.350368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f53a107-3ca6-46b2-baca-097a4f935780 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:29.370057 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1783/3591] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:29.374270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53a107-3ca6-46b2-baca-097a4f935780 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:29.381738 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1809/3592] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:29.392954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53a107-3ca6-46b2-baca-097a4f935780 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:29.399699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5408a3a-2485-44fa-a1ca-342e0a99acfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:29.401193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5408a3a-2485-44fa-a1ca-342e0a99acfb admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.402757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5408a3a-2485-44fa-a1ca-342e0a99acfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.403442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5408a3a-2485-44fa-a1ca-342e0a99acfb admin admin] PATH_INFO: `/v3/projects/99d744663f734bbd83f5cca6517a362c/users/e1dd9915b0be416996f27591c088fbf3/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.412259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fad4-487f-414c-9c74-299d9804869e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.413130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fad4-487f-414c-9c74-299d9804869e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.413450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217fad4-487f-414c-9c74-299d9804869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.449747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4217fad4-487f-414c-9c74-299d9804869e None None] MFA Rules not processed for user `563bce524229478faa4886b1d2285114`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:29.450670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5408a3a-2485-44fa-a1ca-342e0a99acfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d744663f734bbd83f5cca6517a362c, user_id=e1dd9915b0be416996f27591c088fbf3, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:29.453935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4217fad4-487f-414c-9c74-299d9804869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:29.455737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5408a3a-2485-44fa-a1ca-342e0a99acfb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:29.468268 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1810/3593] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:29.496129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097097e-2f0b-445c-a438-f14af29a43a8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.496500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097097e-2f0b-445c-a438-f14af29a43a8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.506124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a097097e-2f0b-445c-a438-f14af29a43a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.528386 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1784/3594] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:29 2022] PUT /identity/v3/projects/99d744663f734bbd83f5cca6517a362c/users/e1dd9915b0be416996f27591c088fbf3/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:56:29.536725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b049a-0d1e-4888-9f05-b0e767c6cd79 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.537102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b049a-0d1e-4888-9f05-b0e767c6cd79 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.537361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b049a-0d1e-4888-9f05-b0e767c6cd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.581308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a097097e-2f0b-445c-a438-f14af29a43a8 None None] MFA Rules not processed for user `563bce524229478faa4886b1d2285114`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:29.582546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a097097e-2f0b-445c-a438-f14af29a43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:29.603328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f25b049a-0d1e-4888-9f05-b0e767c6cd79 None None] MFA Rules not processed for user `e1dd9915b0be416996f27591c088fbf3`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:29.605682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f25b049a-0d1e-4888-9f05-b0e767c6cd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:29.725916 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1811/3595] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:29.780477 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1785/3596] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:29.788062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097097e-2f0b-445c-a438-f14af29a43a8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:29.790090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a097097e-2f0b-445c-a438-f14af29a43a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:29.932819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0394-0688-49dc-beb4-e9e9fadef0c9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.933293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0394-0688-49dc-beb4-e9e9fadef0c9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.933480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d0394-0688-49dc-beb4-e9e9fadef0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.946818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a097097e-2f0b-445c-a438-f14af29a43a8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:29.957334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71d04c-8587-49a9-a39e-2c7c6a266794 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:29.959153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71d04c-8587-49a9-a39e-2c7c6a266794 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:29.960260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71d04c-8587-49a9-a39e-2c7c6a266794 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:29.960647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71d04c-8587-49a9-a39e-2c7c6a266794 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:29.962552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8f0d0394-0688-49dc-beb4-e9e9fadef0c9 None None] MFA Rules not processed for user `563bce524229478faa4886b1d2285114`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:29.964760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f0d0394-0688-49dc-beb4-e9e9fadef0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:29.982448 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1786/3597] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:29.994485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71d04c-8587-49a9-a39e-2c7c6a266794 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:29.999699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71d04c-8587-49a9-a39e-2c7c6a266794 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:30.015160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0394-0688-49dc-beb4-e9e9fadef0c9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:30.019689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f0d0394-0688-49dc-beb4-e9e9fadef0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:30.026515 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1812/3598] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:30.235851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e969a-c956-415b-a134-b280f6ed1a4b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:30.236188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e969a-c956-415b-a134-b280f6ed1a4b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:30.236520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e969a-c956-415b-a134-b280f6ed1a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:30.262054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bf7e969a-c956-415b-a134-b280f6ed1a4b None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:30.263440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bf7e969a-c956-415b-a134-b280f6ed1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:30.265953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d0394-0688-49dc-beb4-e9e9fadef0c9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:30.277780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:30.279197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:30.279370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:30.279743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] PATH_INFO: `/v3/projects/600ab65c259948d68ae63e9b7cfd26ee` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:30.281261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=600ab65c259948d68ae63e9b7cfd26ee)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:30.292767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:30.360258 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1813/3599] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:30.367308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e969a-c956-415b-a134-b280f6ed1a4b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:30.369496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bf7e969a-c956-415b-a134-b280f6ed1a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:30.408350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '600ab65c259948d68ae63e9b7cfd26ee', 'request_id': 'req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:30.449673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '600ab65c259948d68ae63e9b7cfd26ee', 'request_id': 'req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:30.465074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '600ab65c259948d68ae63e9b7cfd26ee', 'request_id': 'req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:30.480871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] The token cache is being invalidate because project 600ab65c259948d68ae63e9b7cfd26ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:30.481169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:30.481885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1cd7c685-0df4-4a77-b2a7-20ea060fa1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:30.486987 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1787/3600] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:30 2022] DELETE /identity/v3/projects/600ab65c259948d68ae63e9b7cfd26ee => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:30.500613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483327b9-b720-46a9-b2e3-645b880d415c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:30.500910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483327b9-b720-46a9-b2e3-645b880d415c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:30.501184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483327b9-b720-46a9-b2e3-645b880d415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:30.540830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-483327b9-b720-46a9-b2e3-645b880d415c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:30.542389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-483327b9-b720-46a9-b2e3-645b880d415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:30.659352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e969a-c956-415b-a134-b280f6ed1a4b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:30.760882 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1788/3601] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:30.768240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8d502-5c1a-4cfe-bb66-4fd8688e3380 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:30.768685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8d502-5c1a-4cfe-bb66-4fd8688e3380 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:30.768994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8d502-5c1a-4cfe-bb66-4fd8688e3380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:30.801275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3cd8d502-5c1a-4cfe-bb66-4fd8688e3380 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:30.802849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3cd8d502-5c1a-4cfe-bb66-4fd8688e3380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:30.816001 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1789/3602] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:30.820446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8d502-5c1a-4cfe-bb66-4fd8688e3380 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:30.828970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c73dbe-bd20-4bb9-9646-579a1ea68d01 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:30.830112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c73dbe-bd20-4bb9-9646-579a1ea68d01 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:30.831270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c73dbe-bd20-4bb9-9646-579a1ea68d01 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:30.831796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c73dbe-bd20-4bb9-9646-579a1ea68d01 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:30.833014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8d502-5c1a-4cfe-bb66-4fd8688e3380 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:30.834189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-15c73dbe-bd20-4bb9-9646-579a1ea68d01 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:30.838868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dba9-2a18-4caa-9bb9-cc0cac3dc9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:30.839535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dba9-2a18-4caa-9bb9-cc0cac3dc9cd admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:30.839815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dba9-2a18-4caa-9bb9-cc0cac3dc9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:30.840129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320dba9-2a18-4caa-9bb9-cc0cac3dc9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:30.841214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320dba9-2a18-4caa-9bb9-cc0cac3dc9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:30.841521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320dba9-2a18-4caa-9bb9-cc0cac3dc9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:30.843727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320dba9-2a18-4caa-9bb9-cc0cac3dc9cd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:30.862977 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1790/3603] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:30.864144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dba9-2a18-4caa-9bb9-cc0cac3dc9cd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:30.874974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320dba9-2a18-4caa-9bb9-cc0cac3dc9cd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:30.880319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e0199-89f3-4e68-8514-14a501f1acbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:30.881104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e0199-89f3-4e68-8514-14a501f1acbf admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:30.881508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e0199-89f3-4e68-8514-14a501f1acbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:30.881884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e0199-89f3-4e68-8514-14a501f1acbf admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:30.882672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e0199-89f3-4e68-8514-14a501f1acbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:30.885281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e0199-89f3-4e68-8514-14a501f1acbf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:30.927028 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1791/3604] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:30 2022] POST /identity/v3/projects => generated 399 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:30.928337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e0199-89f3-4e68-8514-14a501f1acbf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:30.967457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c73dbe-bd20-4bb9-9646-579a1ea68d01 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:30.969281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c73dbe-bd20-4bb9-9646-579a1ea68d01 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:30.994169 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1814/3605] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:31.027603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e0199-89f3-4e68-8514-14a501f1acbf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:31.037977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14166b4-a6dc-4b42-83cd-a34f933ce50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:31.040187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14166b4-a6dc-4b42-83cd-a34f933ce50a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:31.040588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14166b4-a6dc-4b42-83cd-a34f933ce50a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:31.040971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14166b4-a6dc-4b42-83cd-a34f933ce50a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:31.041865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14166b4-a6dc-4b42-83cd-a34f933ce50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:31.044329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14166b4-a6dc-4b42-83cd-a34f933ce50a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:31.073334 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1792/3606] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:30 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:31.077228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c73dbe-bd20-4bb9-9646-579a1ea68d01 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:31.089267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c73dbe-bd20-4bb9-9646-579a1ea68d01 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:31.109311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a38a64-8480-438a-897b-abd31e4055b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:31.109997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a38a64-8480-438a-897b-abd31e4055b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:31.110280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a38a64-8480-438a-897b-abd31e4055b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:31.110556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a38a64-8480-438a-897b-abd31e4055b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:31.111282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a38a64-8480-438a-897b-abd31e4055b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:31.113011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a38a64-8480-438a-897b-abd31e4055b3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:31.140004 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1815/3607] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:31.143562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14166b4-a6dc-4b42-83cd-a34f933ce50a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:31.168885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14166b4-a6dc-4b42-83cd-a34f933ce50a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:31.179879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9614f-0ef0-4097-8d66-fda23b304ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:31.181973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9614f-0ef0-4097-8d66-fda23b304ffc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:31.182627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9614f-0ef0-4097-8d66-fda23b304ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:31.183129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9614f-0ef0-4097-8d66-fda23b304ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:31.185280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9614f-0ef0-4097-8d66-fda23b304ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:31.187610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9614f-0ef0-4097-8d66-fda23b304ffc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:31.203644 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1793/3608] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:31.207905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a38a64-8480-438a-897b-abd31e4055b3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:31.236747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a38a64-8480-438a-897b-abd31e4055b3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:31.254934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4ca09-7ec5-4675-875e-fd1322d2dec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:31.256251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4ca09-7ec5-4675-875e-fd1322d2dec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:31.256709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4ca09-7ec5-4675-875e-fd1322d2dec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:31.263689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4ca09-7ec5-4675-875e-fd1322d2dec2 admin admin] PATH_INFO: `/v3/projects/79effa8b201c422cb22e57efa4c8892a/users/ab0c5bde8c054cbcbc19291778a9511b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:31.319828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4ca09-7ec5-4675-875e-fd1322d2dec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79effa8b201c422cb22e57efa4c8892a, user_id=ab0c5bde8c054cbcbc19291778a9511b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:31.333769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f4ca09-7ec5-4675-875e-fd1322d2dec2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:31.408136 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1816/3609] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:31 2022] PUT /identity/v3/projects/79effa8b201c422cb22e57efa4c8892a/users/ab0c5bde8c054cbcbc19291778a9511b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:31.414087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1509d-c746-42e6-8fb7-56f9397bc60f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:31.415041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1509d-c746-42e6-8fb7-56f9397bc60f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:31.415526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1509d-c746-42e6-8fb7-56f9397bc60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:31.489424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4db1509d-c746-42e6-8fb7-56f9397bc60f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:31.495392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4db1509d-c746-42e6-8fb7-56f9397bc60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:31.708393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1794/3610] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:31.712717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4ca09-7ec5-4675-875e-fd1322d2dec2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:31.714896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-67f4ca09-7ec5-4675-875e-fd1322d2dec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:31.833632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc571e24-0b94-474e-b084-448fe2d2af90 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:31.833995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc571e24-0b94-474e-b084-448fe2d2af90 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:31.834519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc571e24-0b94-474e-b084-448fe2d2af90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:31.868905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4ca09-7ec5-4675-875e-fd1322d2dec2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:31.878786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d67c5-15f2-49b9-9c8e-6e8467d9ccf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:31.879769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d67c5-15f2-49b9-9c8e-6e8467d9ccf4 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:31.884560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d67c5-15f2-49b9-9c8e-6e8467d9ccf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:31.885067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d67c5-15f2-49b9-9c8e-6e8467d9ccf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:31.896326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cc571e24-0b94-474e-b084-448fe2d2af90 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:31.907474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cc571e24-0b94-474e-b084-448fe2d2af90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:31.910905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d67c5-15f2-49b9-9c8e-6e8467d9ccf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:31.913625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d67c5-15f2-49b9-9c8e-6e8467d9ccf4 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:31.955860 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1817/3611] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:32.097194 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1795/3612] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:56:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:32.112686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d67c5-15f2-49b9-9c8e-6e8467d9ccf4 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:32.114452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-976d67c5-15f2-49b9-9c8e-6e8467d9ccf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:32.295961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d67c5-15f2-49b9-9c8e-6e8467d9ccf4 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:32.308289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01493eeb-0d72-4e76-b732-5be03e899c5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:32.309399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01493eeb-0d72-4e76-b732-5be03e899c5e service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:32.309939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01493eeb-0d72-4e76-b732-5be03e899c5e service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:32.310391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01493eeb-0d72-4e76-b732-5be03e899c5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:32.334577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01493eeb-0d72-4e76-b732-5be03e899c5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:32.339435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01493eeb-0d72-4e76-b732-5be03e899c5e service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:32.407682 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1818/3613] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:32.942250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27666-88db-4c41-9168-1020aa1e2137 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:32.942860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27666-88db-4c41-9168-1020aa1e2137 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:32.943849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa27666-88db-4c41-9168-1020aa1e2137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:32.968624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-eaa27666-88db-4c41-9168-1020aa1e2137 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:32.969995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eaa27666-88db-4c41-9168-1020aa1e2137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:32.978934 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1796/3614] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:56:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:32.994667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01493eeb-0d72-4e76-b732-5be03e899c5e service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:33.017253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01493eeb-0d72-4e76-b732-5be03e899c5e service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:33.025049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85048940-1e08-4dfa-942f-f3df0f83d50f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:33.025992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048940-1e08-4dfa-942f-f3df0f83d50f service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:33.026459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048940-1e08-4dfa-942f-f3df0f83d50f service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:33.026908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85048940-1e08-4dfa-942f-f3df0f83d50f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:33.056253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85048940-1e08-4dfa-942f-f3df0f83d50f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:33.058142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85048940-1e08-4dfa-942f-f3df0f83d50f service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:33.073649 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1819/3615] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:33.278267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763355b-40ee-4a70-a19b-23c49664acf0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:33.278858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763355b-40ee-4a70-a19b-23c49664acf0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:33.280111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763355b-40ee-4a70-a19b-23c49664acf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:33.306031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a763355b-40ee-4a70-a19b-23c49664acf0 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:33.307640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a763355b-40ee-4a70-a19b-23c49664acf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:33.317492 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1797/3616] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:33.333414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85048940-1e08-4dfa-942f-f3df0f83d50f service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:33.345810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85048940-1e08-4dfa-942f-f3df0f83d50f service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:33.370719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc147c-16bf-4806-98aa-dbdd20dcda48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:33.372016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc147c-16bf-4806-98aa-dbdd20dcda48 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:33.376109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc147c-16bf-4806-98aa-dbdd20dcda48 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:33.376983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc147c-16bf-4806-98aa-dbdd20dcda48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:33.423934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc147c-16bf-4806-98aa-dbdd20dcda48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:33.429045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc147c-16bf-4806-98aa-dbdd20dcda48 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:33.486151 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1820/3617] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:33.848115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17679b12-94fb-475f-9ee3-14fcb14269e4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:33.848516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17679b12-94fb-475f-9ee3-14fcb14269e4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:33.848866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17679b12-94fb-475f-9ee3-14fcb14269e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:33.886889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-17679b12-94fb-475f-9ee3-14fcb14269e4 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:33.889086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-17679b12-94fb-475f-9ee3-14fcb14269e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:33.899328 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1798/3618] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:56:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:33.914124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc147c-16bf-4806-98aa-dbdd20dcda48 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:33.933037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc147c-16bf-4806-98aa-dbdd20dcda48 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:33.961975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618df1d-f2bc-44a5-ac58-5f82e190c341 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:33.963115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618df1d-f2bc-44a5-ac58-5f82e190c341 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:33.963401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618df1d-f2bc-44a5-ac58-5f82e190c341 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:33.963675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618df1d-f2bc-44a5-ac58-5f82e190c341 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:33.975401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618df1d-f2bc-44a5-ac58-5f82e190c341 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:33.977719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618df1d-f2bc-44a5-ac58-5f82e190c341 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:33.988527 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1821/3619] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:34.288274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44180-9bb6-403f-8635-f7e2c643aa6d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:34.289441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44180-9bb6-403f-8635-f7e2c643aa6d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:34.290062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b44180-9bb6-403f-8635-f7e2c643aa6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:34.291180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e61e85-cad8-4773-8f04-1735e7b83171 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:34.291583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e61e85-cad8-4773-8f04-1735e7b83171 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:34.291735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e61e85-cad8-4773-8f04-1735e7b83171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:34.325858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f8e61e85-cad8-4773-8f04-1735e7b83171 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:34.327083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-18b44180-9bb6-403f-8635-f7e2c643aa6d None None] MFA Rules not processed for user `ab0c5bde8c054cbcbc19291778a9511b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:34.328632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-18b44180-9bb6-403f-8635-f7e2c643aa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:34.330341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f8e61e85-cad8-4773-8f04-1735e7b83171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:34.354505 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1822/3620] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:34.378203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e61e85-cad8-4773-8f04-1735e7b83171 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:34.395189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e61e85-cad8-4773-8f04-1735e7b83171 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:34.402722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c346f-adea-4a27-870a-71e693af9897 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:34.403375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c346f-adea-4a27-870a-71e693af9897 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:34.403660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c346f-adea-4a27-870a-71e693af9897 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:34.403968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c346f-adea-4a27-870a-71e693af9897 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:34.413557 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1799/3621] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:34.424539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898fa65-c31b-4acd-a601-c37249841ad8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:34.425402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898fa65-c31b-4acd-a601-c37249841ad8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:34.425907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898fa65-c31b-4acd-a601-c37249841ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:34.428832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c346f-adea-4a27-870a-71e693af9897 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:34.430825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c346f-adea-4a27-870a-71e693af9897 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:34.464071 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1823/3622] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:56:34.464444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8898fa65-c31b-4acd-a601-c37249841ad8 None None] MFA Rules not processed for user `ab0c5bde8c054cbcbc19291778a9511b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:34.466938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8898fa65-c31b-4acd-a601-c37249841ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:34.487842 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1800/3623] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:34.499752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c346f-adea-4a27-870a-71e693af9897 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:34.503069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0c4c346f-adea-4a27-870a-71e693af9897 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:34.689960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c346f-adea-4a27-870a-71e693af9897 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:34.697133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898fa65-c31b-4acd-a601-c37249841ad8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:34.701247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8898fa65-c31b-4acd-a601-c37249841ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:34.712272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf76394-1a6e-4c24-88ed-5c0f0116d8d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:34.714603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf76394-1a6e-4c24-88ed-5c0f0116d8d0 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:34.718166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf76394-1a6e-4c24-88ed-5c0f0116d8d0 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:34.718991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf76394-1a6e-4c24-88ed-5c0f0116d8d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:34.746444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf76394-1a6e-4c24-88ed-5c0f0116d8d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:34.757008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898fa65-c31b-4acd-a601-c37249841ad8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:34.769344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:34.770942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:34.771435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:34.772680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf76394-1a6e-4c24-88ed-5c0f0116d8d0 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:34.773012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] PATH_INFO: `/v3/users/e1dd9915b0be416996f27591c088fbf3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:34.782355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dd9915b0be416996f27591c088fbf3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:34.784502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:34.814060 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1824/3624] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:34.922426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dd9915b0be416996f27591c088fbf3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:34.943051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dd9915b0be416996f27591c088fbf3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:34.944104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dd9915b0be416996f27591c088fbf3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:34.945068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dd9915b0be416996f27591c088fbf3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:34.971878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dd9915b0be416996f27591c088fbf3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:35.003050 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1801/3625] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:34 2022] DELETE /identity/v3/users/e1dd9915b0be416996f27591c088fbf3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:35.009350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42effab4-1f5b-4106-b2f9-699c15b9da3b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:35.014621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42effab4-1f5b-4106-b2f9-699c15b9da3b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:35.015800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42effab4-1f5b-4106-b2f9-699c15b9da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:35.062841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-42effab4-1f5b-4106-b2f9-699c15b9da3b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:35.064945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-42effab4-1f5b-4106-b2f9-699c15b9da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:35.203616 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1825/3626] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:35.270523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:35.272357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:35.372516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ce039-31e9-4af7-9845-39811d401df3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:35.377660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ea489-3b90-4d30-ac85-0077f291e752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:35.378327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ea489-3b90-4d30-ac85-0077f291e752 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:35.378611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ea489-3b90-4d30-ac85-0077f291e752 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:35.378890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ea489-3b90-4d30-ac85-0077f291e752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:35.394883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ea489-3b90-4d30-ac85-0077f291e752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:35.396360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ea489-3b90-4d30-ac85-0077f291e752 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:35.409566 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1802/3627] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:35.756095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42effab4-1f5b-4106-b2f9-699c15b9da3b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:35.776266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-42effab4-1f5b-4106-b2f9-699c15b9da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:35.802856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42effab4-1f5b-4106-b2f9-699c15b9da3b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:35.816146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:35.817527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:35.818380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:35.818620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] PATH_INFO: `/v3/projects/99d744663f734bbd83f5cca6517a362c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:35.820401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d744663f734bbd83f5cca6517a362c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:35.822878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:35.902558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d744663f734bbd83f5cca6517a362c', 'request_id': 'req-29c2be23-a8e2-4b5e-bc71-561245581f3b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:35.917901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d744663f734bbd83f5cca6517a362c', 'request_id': 'req-29c2be23-a8e2-4b5e-bc71-561245581f3b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:35.931450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d744663f734bbd83f5cca6517a362c', 'request_id': 'req-29c2be23-a8e2-4b5e-bc71-561245581f3b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:35.946313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] The token cache is being invalidate because project 99d744663f734bbd83f5cca6517a362c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:35.946706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:35.947845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-29c2be23-a8e2-4b5e-bc71-561245581f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:35.951332 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1826/3628] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:35 2022] DELETE /identity/v3/projects/99d744663f734bbd83f5cca6517a362c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:35.956025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3faedb-2d43-44e1-8b43-f7c60c6cf3a1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:35.956325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3faedb-2d43-44e1-8b43-f7c60c6cf3a1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:35.956617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3faedb-2d43-44e1-8b43-f7c60c6cf3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:35.995547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-db3faedb-2d43-44e1-8b43-f7c60c6cf3a1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:35.996833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-db3faedb-2d43-44e1-8b43-f7c60c6cf3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:36.138302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548a240-e759-4fb5-9cd8-090fdda3c89d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:36.138707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548a240-e759-4fb5-9cd8-090fdda3c89d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:36.138861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e548a240-e759-4fb5-9cd8-090fdda3c89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:36.141455 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1803/3629] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:36.162715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e548a240-e759-4fb5-9cd8-090fdda3c89d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:36.164334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e548a240-e759-4fb5-9cd8-090fdda3c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:36.182921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3faedb-2d43-44e1-8b43-f7c60c6cf3a1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:36.195136 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1827/3630] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:36.196602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3faedb-2d43-44e1-8b43-f7c60c6cf3a1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:36.216068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dd219-ebdd-42fd-9799-dfac9d6e077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:36.216756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dd219-ebdd-42fd-9799-dfac9d6e077d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:36.218187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dd219-ebdd-42fd-9799-dfac9d6e077d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:36.218467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771dd219-ebdd-42fd-9799-dfac9d6e077d admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:36.219200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dd219-ebdd-42fd-9799-dfac9d6e077d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:36.219514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dd219-ebdd-42fd-9799-dfac9d6e077d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:36.227498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771dd219-ebdd-42fd-9799-dfac9d6e077d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:36.256152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548a240-e759-4fb5-9cd8-090fdda3c89d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:36.263256 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1804/3631] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:36.268121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e548a240-e759-4fb5-9cd8-090fdda3c89d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:36.276917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f9631-447d-47df-b436-e4addaf3533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:36.277831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f9631-447d-47df-b436-e4addaf3533f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:36.278273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f9631-447d-47df-b436-e4addaf3533f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:36.278701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f9631-447d-47df-b436-e4addaf3533f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:36.280522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f9631-447d-47df-b436-e4addaf3533f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:36.284003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f9631-447d-47df-b436-e4addaf3533f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:36.328986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dd219-ebdd-42fd-9799-dfac9d6e077d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:36.330535 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1828/3632] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:36 2022] POST /identity/v3/projects => generated 377 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:36.348638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771dd219-ebdd-42fd-9799-dfac9d6e077d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:36.449315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131a34f-8b6c-4eec-b1f8-4ecf1b4b4af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:36.450917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131a34f-8b6c-4eec-b1f8-4ecf1b4b4af7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:36.451495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131a34f-8b6c-4eec-b1f8-4ecf1b4b4af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:36.452049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131a34f-8b6c-4eec-b1f8-4ecf1b4b4af7 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:36.453018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131a34f-8b6c-4eec-b1f8-4ecf1b4b4af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:36.456040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131a34f-8b6c-4eec-b1f8-4ecf1b4b4af7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:36.490253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f9631-447d-47df-b436-e4addaf3533f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:36.491651 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1805/3633] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:36 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:36.504847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f9631-447d-47df-b436-e4addaf3533f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:36.512099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76a903-861b-49da-bbfa-efe84b5f97b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:36.513028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a903-861b-49da-bbfa-efe84b5f97b7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:36.513505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a903-861b-49da-bbfa-efe84b5f97b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:36.513949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f76a903-861b-49da-bbfa-efe84b5f97b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:36.514925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76a903-861b-49da-bbfa-efe84b5f97b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:36.518008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f76a903-861b-49da-bbfa-efe84b5f97b7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:36.536998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131a34f-8b6c-4eec-b1f8-4ecf1b4b4af7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:36.548767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131a34f-8b6c-4eec-b1f8-4ecf1b4b4af7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:36.549211 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1829/3634] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:36.561700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd0fc4-e37c-4e4d-baee-e9d45bd3e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:36.564056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0fc4-e37c-4e4d-baee-e9d45bd3e77b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:36.565094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0fc4-e37c-4e4d-baee-e9d45bd3e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:36.565538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd0fc4-e37c-4e4d-baee-e9d45bd3e77b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:36.567873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd0fc4-e37c-4e4d-baee-e9d45bd3e77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:36.576830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd0fc4-e37c-4e4d-baee-e9d45bd3e77b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:36.600876 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1806/3635] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:36.605695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76a903-861b-49da-bbfa-efe84b5f97b7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:36.617240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f76a903-861b-49da-bbfa-efe84b5f97b7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:36.623596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541a62a-6867-4eab-937e-440e67567e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:36.625696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541a62a-6867-4eab-937e-440e67567e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:36.625997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541a62a-6867-4eab-937e-440e67567e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:36.626951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b541a62a-6867-4eab-937e-440e67567e99 admin admin] PATH_INFO: `/v3/projects/536501c2b7c74b16a98ea551668a1e63/users/6490758959f749c599d14389cf019c26/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:36.652373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541a62a-6867-4eab-937e-440e67567e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536501c2b7c74b16a98ea551668a1e63, user_id=6490758959f749c599d14389cf019c26, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:36.656541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b541a62a-6867-4eab-937e-440e67567e99 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:36.687400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1830/3636] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:36 2022] PUT /identity/v3/projects/536501c2b7c74b16a98ea551668a1e63/users/6490758959f749c599d14389cf019c26/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:36.690921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573d346-a63a-424b-943a-57f51adbd1c2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:36.691603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573d346-a63a-424b-943a-57f51adbd1c2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:36.691825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573d346-a63a-424b-943a-57f51adbd1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:36.737756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a573d346-a63a-424b-943a-57f51adbd1c2 None None] MFA Rules not processed for user `6490758959f749c599d14389cf019c26`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:36.739692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a573d346-a63a-424b-943a-57f51adbd1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:36.929832 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1807/3637] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:36.941222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541a62a-6867-4eab-937e-440e67567e99 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:36.943017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b541a62a-6867-4eab-937e-440e67567e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:37.129530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b541a62a-6867-4eab-937e-440e67567e99 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:37.138333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d87578-14dd-4076-b43e-f49892c58221 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:37.140908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d87578-14dd-4076-b43e-f49892c58221 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:37.142458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d87578-14dd-4076-b43e-f49892c58221 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:37.143583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d87578-14dd-4076-b43e-f49892c58221 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:37.170020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d87578-14dd-4076-b43e-f49892c58221 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:37.175037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d87578-14dd-4076-b43e-f49892c58221 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:37.210952 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1831/3638] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:37.618089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573d346-a63a-424b-943a-57f51adbd1c2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:37.781610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573d346-a63a-424b-943a-57f51adbd1c2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:37.787443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:37.788366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:37.788652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:37.789305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] PATH_INFO: `/v3/users/6490758959f749c599d14389cf019c26` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:37.792292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6490758959f749c599d14389cf019c26)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:37.794842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:37.859984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6490758959f749c599d14389cf019c26'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:37.872674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6490758959f749c599d14389cf019c26'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:37.873613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6490758959f749c599d14389cf019c26'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:37.876039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6490758959f749c599d14389cf019c26'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:37.917146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6490758959f749c599d14389cf019c26'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:37.940816 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1808/3639] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:37 2022] DELETE /identity/v3/users/6490758959f749c599d14389cf019c26 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:37.946954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f1fc0-d492-4ba8-bc17-fa6375e22c86 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:37.947833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f1fc0-d492-4ba8-bc17-fa6375e22c86 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:37.948554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f1fc0-d492-4ba8-bc17-fa6375e22c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:37.966323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:37.971809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:38.005500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7b7f1fc0-d492-4ba8-bc17-fa6375e22c86 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:38.036650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7b7f1fc0-d492-4ba8-bc17-fa6375e22c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:38.238683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa4030-b9da-4a54-965d-43c8c6b77ef7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:38.256668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:38.262009 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1832/3640] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:38.262332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:38.262332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:38.262332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] PATH_INFO: `/v3/users/563bce524229478faa4886b1d2285114` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:38.266707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563bce524229478faa4886b1d2285114)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:38.272606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:38.377524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563bce524229478faa4886b1d2285114'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:38.391902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563bce524229478faa4886b1d2285114'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:38.396338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563bce524229478faa4886b1d2285114'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:38.397020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563bce524229478faa4886b1d2285114'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:38.414894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563bce524229478faa4886b1d2285114'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:38.436812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1809/3641] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:56:37 2022] DELETE /identity/v3/users/563bce524229478faa4886b1d2285114 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:38.439971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f1fc0-d492-4ba8-bc17-fa6375e22c86 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:38.441938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7b7f1fc0-d492-4ba8-bc17-fa6375e22c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:38.660342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f1fc0-d492-4ba8-bc17-fa6375e22c86 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:38.971212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0bc99-4d9f-4d9e-a5b7-35212641278c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:38.975335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0bc99-4d9f-4d9e-a5b7-35212641278c service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:38.976736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0bc99-4d9f-4d9e-a5b7-35212641278c service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:38.977217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0bc99-4d9f-4d9e-a5b7-35212641278c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:38.983739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-94c0bc99-4d9f-4d9e-a5b7-35212641278c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:39.166247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0bc99-4d9f-4d9e-a5b7-35212641278c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:39.169925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0bc99-4d9f-4d9e-a5b7-35212641278c service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:39.186273 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1833/3642] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 747 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:56:40.145376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:40.147582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:40.171646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38067b21-6cc1-47f8-bfd5-fbd12add0072 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:40.183419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:40.184335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:40.184617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:40.184894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] PATH_INFO: `/v3/projects/1e309921cfc047bda328e3ad23aa5e7a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:40.191724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e309921cfc047bda328e3ad23aa5e7a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:40.193780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:40.342540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e309921cfc047bda328e3ad23aa5e7a', 'request_id': 'req-9b267633-42af-4359-8682-a25155c90ad3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:40.374520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e309921cfc047bda328e3ad23aa5e7a', 'request_id': 'req-9b267633-42af-4359-8682-a25155c90ad3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:40.374520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e309921cfc047bda328e3ad23aa5e7a', 'request_id': 'req-9b267633-42af-4359-8682-a25155c90ad3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:40.400833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] The token cache is being invalidate because project 1e309921cfc047bda328e3ad23aa5e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:40.401136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:40.402559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9b267633-42af-4359-8682-a25155c90ad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:40.405270 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1810/3643] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:40 2022] DELETE /identity/v3/projects/1e309921cfc047bda328e3ad23aa5e7a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:40.417803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30e15-cec1-4ed9-af1a-e231485b3361 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:40.418806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30e15-cec1-4ed9-af1a-e231485b3361 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:40.424890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30e15-cec1-4ed9-af1a-e231485b3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:40.457373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bda30e15-cec1-4ed9-af1a-e231485b3361 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:40.459014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bda30e15-cec1-4ed9-af1a-e231485b3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:40.613032 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1834/3644] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:40.622500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c07af-f795-4d54-bfb7-a1f400fcef81 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:40.622852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c07af-f795-4d54-bfb7-a1f400fcef81 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:40.623154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c07af-f795-4d54-bfb7-a1f400fcef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:40.655520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a04c07af-f795-4d54-bfb7-a1f400fcef81 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:40.656503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a04c07af-f795-4d54-bfb7-a1f400fcef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:40.667517 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1811/3645] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:56:40.673545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30e15-cec1-4ed9-af1a-e231485b3361 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:40.688502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30e15-cec1-4ed9-af1a-e231485b3361 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:40.693937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047be0cf-6f23-4186-8b29-78b5a05550b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:40.694838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047be0cf-6f23-4186-8b29-78b5a05550b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:40.695281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047be0cf-6f23-4186-8b29-78b5a05550b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:40.696459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047be0cf-6f23-4186-8b29-78b5a05550b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:40.697584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047be0cf-6f23-4186-8b29-78b5a05550b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:40.698367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047be0cf-6f23-4186-8b29-78b5a05550b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:40.700352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047be0cf-6f23-4186-8b29-78b5a05550b2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:40.720298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c07af-f795-4d54-bfb7-a1f400fcef81 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:40.726972 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1835/3646] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:40.731298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c07af-f795-4d54-bfb7-a1f400fcef81 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:40.737096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a95dc-e4d0-4d7a-94cc-5e2c223746fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:40.738289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a95dc-e4d0-4d7a-94cc-5e2c223746fe admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:40.738847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a95dc-e4d0-4d7a-94cc-5e2c223746fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:40.739334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a95dc-e4d0-4d7a-94cc-5e2c223746fe admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:40.740242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a95dc-e4d0-4d7a-94cc-5e2c223746fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:40.742334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a95dc-e4d0-4d7a-94cc-5e2c223746fe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:40.793079 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1812/3647] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:40 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:40.795396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047be0cf-6f23-4186-8b29-78b5a05550b2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:40.809767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047be0cf-6f23-4186-8b29-78b5a05550b2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:40.921499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159df88-fb92-40b4-90c8-3d7b446e66d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:40.922933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159df88-fb92-40b4-90c8-3d7b446e66d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:40.923224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159df88-fb92-40b4-90c8-3d7b446e66d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:40.923504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159df88-fb92-40b4-90c8-3d7b446e66d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:40.924327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159df88-fb92-40b4-90c8-3d7b446e66d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:40.926387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159df88-fb92-40b4-90c8-3d7b446e66d8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:40.964090 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1836/3648] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:40 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:40.966379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a95dc-e4d0-4d7a-94cc-5e2c223746fe admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:40.981567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a95dc-e4d0-4d7a-94cc-5e2c223746fe admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:40.987540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbee949-6d2b-4805-bff7-8e45d8f347ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:40.988622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbee949-6d2b-4805-bff7-8e45d8f347ab admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:40.988853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbee949-6d2b-4805-bff7-8e45d8f347ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:40.989315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbee949-6d2b-4805-bff7-8e45d8f347ab admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:40.990395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbee949-6d2b-4805-bff7-8e45d8f347ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:40.992336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbee949-6d2b-4805-bff7-8e45d8f347ab admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:41.037505 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1813/3649] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:41.038004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159df88-fb92-40b4-90c8-3d7b446e66d8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:41.079500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159df88-fb92-40b4-90c8-3d7b446e66d8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:41.093781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0ca04-1f11-43ce-bbc7-00489c33d85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:41.094919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0ca04-1f11-43ce-bbc7-00489c33d85b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:41.095772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0ca04-1f11-43ce-bbc7-00489c33d85b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:41.096313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0ca04-1f11-43ce-bbc7-00489c33d85b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:41.097341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0ca04-1f11-43ce-bbc7-00489c33d85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:41.101031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0ca04-1f11-43ce-bbc7-00489c33d85b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:41.116916 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1837/3650] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:56:41.121274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbee949-6d2b-4805-bff7-8e45d8f347ab admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:41.144019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbee949-6d2b-4805-bff7-8e45d8f347ab admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:41.149509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf832f-ca38-40c2-a0a4-ee2f2a97190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:41.150433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf832f-ca38-40c2-a0a4-ee2f2a97190b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:41.150950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf832f-ca38-40c2-a0a4-ee2f2a97190b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:41.151552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf832f-ca38-40c2-a0a4-ee2f2a97190b admin admin] PATH_INFO: `/v3/projects/3797b42bf82b407abdd1fabd06dbe141/users/387ac2e169914b57991e4c1c45937e73/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:41.168160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0ca04-1f11-43ce-bbc7-00489c33d85b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:41.172262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9ac0ca04-1f11-43ce-bbc7-00489c33d85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:41.175740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf832f-ca38-40c2-a0a4-ee2f2a97190b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3797b42bf82b407abdd1fabd06dbe141, user_id=387ac2e169914b57991e4c1c45937e73, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:41.179689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf832f-ca38-40c2-a0a4-ee2f2a97190b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:41.203486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1814/3651] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:41 2022] PUT /identity/v3/projects/3797b42bf82b407abdd1fabd06dbe141/users/387ac2e169914b57991e4c1c45937e73/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:41.208432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278cbaf-758e-42fd-a531-11bf730e9787 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:41.208958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278cbaf-758e-42fd-a531-11bf730e9787 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:41.209411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b278cbaf-758e-42fd-a531-11bf730e9787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:41.233583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b278cbaf-758e-42fd-a531-11bf730e9787 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:41.235742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b278cbaf-758e-42fd-a531-11bf730e9787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:41.251699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0ca04-1f11-43ce-bbc7-00489c33d85b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:41.323751 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1815/3652] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:41.366589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:41.367638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:41.368134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:41.368422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] PATH_INFO: `/v3/projects/536501c2b7c74b16a98ea551668a1e63` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:41.370116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536501c2b7c74b16a98ea551668a1e63)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:41.373038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:41.434943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536501c2b7c74b16a98ea551668a1e63', 'request_id': 'req-cd013bf3-fd2c-4ff6-a025-8de0d831df49'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:41.447836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536501c2b7c74b16a98ea551668a1e63', 'request_id': 'req-cd013bf3-fd2c-4ff6-a025-8de0d831df49'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:41.457448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536501c2b7c74b16a98ea551668a1e63', 'request_id': 'req-cd013bf3-fd2c-4ff6-a025-8de0d831df49'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:41.470106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278cbaf-758e-42fd-a531-11bf730e9787 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:41.471630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b278cbaf-758e-42fd-a531-11bf730e9787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:41.485250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] The token cache is being invalidate because project 536501c2b7c74b16a98ea551668a1e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:56:41.486948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:41.488174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd013bf3-fd2c-4ff6-a025-8de0d831df49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:56:41.490672 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1838/3653] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:56:41 2022] DELETE /identity/v3/projects/536501c2b7c74b16a98ea551668a1e63 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:41.499607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058ab00-9b4a-4429-8c9f-fecd3f8a70ef None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:41.499875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058ab00-9b4a-4429-8c9f-fecd3f8a70ef None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:41.500343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058ab00-9b4a-4429-8c9f-fecd3f8a70ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:41.545741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2058ab00-9b4a-4429-8c9f-fecd3f8a70ef None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:41.546982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2058ab00-9b4a-4429-8c9f-fecd3f8a70ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:41.571978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b278cbaf-758e-42fd-a531-11bf730e9787 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:41.675802 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1839/3654] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:41.677651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e9130-919f-4210-8690-d204a7180c59 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:41.678014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e9130-919f-4210-8690-d204a7180c59 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:41.678435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e9130-919f-4210-8690-d204a7180c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:41.725723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fddc75-fcbf-4702-8dab-1fb42b29537c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:41.727663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fddc75-fcbf-4702-8dab-1fb42b29537c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:41.728217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fddc75-fcbf-4702-8dab-1fb42b29537c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:41.728847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fddc75-fcbf-4702-8dab-1fb42b29537c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:41.734285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e0fddc75-fcbf-4702-8dab-1fb42b29537c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:41.744212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-de2e9130-919f-4210-8690-d204a7180c59 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:41.745920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-de2e9130-919f-4210-8690-d204a7180c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:41.778801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fddc75-fcbf-4702-8dab-1fb42b29537c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:41.782066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fddc75-fcbf-4702-8dab-1fb42b29537c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:41.784836 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1840/3655] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:41.788344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e9130-919f-4210-8690-d204a7180c59 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:41.802484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e9130-919f-4210-8690-d204a7180c59 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:41.805079 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1816/3656] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:41.809090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ae13d-6595-49c5-a094-521d4134e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:41.809860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ae13d-6595-49c5-a094-521d4134e20c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:41.810225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ae13d-6595-49c5-a094-521d4134e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:41.810869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ae13d-6595-49c5-a094-521d4134e20c admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:41.811677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ae13d-6595-49c5-a094-521d4134e20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:56:41.812183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ae13d-6595-49c5-a094-521d4134e20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:41.814140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ae13d-6595-49c5-a094-521d4134e20c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:41.835955 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1841/3657] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:56:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:56:41.839932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fddc75-fcbf-4702-8dab-1fb42b29537c service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:41.850606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fddc75-fcbf-4702-8dab-1fb42b29537c service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:41.856642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332f710-8aab-4754-a2a6-8f8ccb011f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:41.857495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332f710-8aab-4754-a2a6-8f8ccb011f9d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:41.857738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332f710-8aab-4754-a2a6-8f8ccb011f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:41.858089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a332f710-8aab-4754-a2a6-8f8ccb011f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:41.858964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332f710-8aab-4754-a2a6-8f8ccb011f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:41.861140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a332f710-8aab-4754-a2a6-8f8ccb011f9d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:41.891963 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1817/3658] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:41 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:41.897985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ae13d-6595-49c5-a094-521d4134e20c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:41.913373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ae13d-6595-49c5-a094-521d4134e20c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:41.999799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4698-64fa-4491-96d9-674073085ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:42.001491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4698-64fa-4491-96d9-674073085ecf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.002006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4698-64fa-4491-96d9-674073085ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.002427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb4698-64fa-4491-96d9-674073085ecf admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.003581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb4698-64fa-4491-96d9-674073085ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:42.006137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb4698-64fa-4491-96d9-674073085ecf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:42.049063 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1842/3659] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:41 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:42.053148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332f710-8aab-4754-a2a6-8f8ccb011f9d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:42.065260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a332f710-8aab-4754-a2a6-8f8ccb011f9d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:42.071145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cbfbc-3df1-4fb9-ac2b-6829566db9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:42.072092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cbfbc-3df1-4fb9-ac2b-6829566db9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.072092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cbfbc-3df1-4fb9-ac2b-6829566db9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.072341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06cbfbc-3df1-4fb9-ac2b-6829566db9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.073345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cbfbc-3df1-4fb9-ac2b-6829566db9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:42.075005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06cbfbc-3df1-4fb9-ac2b-6829566db9d8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:42.086642 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1818/3660] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:56:42.090734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4698-64fa-4491-96d9-674073085ecf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:42.101161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb4698-64fa-4491-96d9-674073085ecf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:42.106377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a621672-44ab-487c-87c4-adab8dd4c1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:42.107057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a621672-44ab-487c-87c4-adab8dd4c1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.107461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a621672-44ab-487c-87c4-adab8dd4c1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.107761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a621672-44ab-487c-87c4-adab8dd4c1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.108545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a621672-44ab-487c-87c4-adab8dd4c1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:42.110188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a621672-44ab-487c-87c4-adab8dd4c1b3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:42.124523 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1843/3661] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:42.125734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cbfbc-3df1-4fb9-ac2b-6829566db9d8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:42.138709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06cbfbc-3df1-4fb9-ac2b-6829566db9d8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:42.144475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eda3e-393e-4523-b6d8-c01fc11ac7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:42.145450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eda3e-393e-4523-b6d8-c01fc11ac7e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.146392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eda3e-393e-4523-b6d8-c01fc11ac7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.146392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eda3e-393e-4523-b6d8-c01fc11ac7e8 admin admin] PATH_INFO: `/v3/projects/ba712e82d41f49daa33efd59bdd437d8/users/7d1170d4b08f42eeb5a0ed92fb5ef0ef/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.162879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eda3e-393e-4523-b6d8-c01fc11ac7e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba712e82d41f49daa33efd59bdd437d8, user_id=7d1170d4b08f42eeb5a0ed92fb5ef0ef, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:42.165825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eda3e-393e-4523-b6d8-c01fc11ac7e8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:42.192536 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1819/3662] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:42 2022] PUT /identity/v3/projects/ba712e82d41f49daa33efd59bdd437d8/users/7d1170d4b08f42eeb5a0ed92fb5ef0ef/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:42.196394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb17064-4cb7-465d-a0f3-8b312772aff1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.197068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb17064-4cb7-465d-a0f3-8b312772aff1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.197734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb17064-4cb7-465d-a0f3-8b312772aff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.252549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ceb17064-4cb7-465d-a0f3-8b312772aff1 None None] MFA Rules not processed for user `7d1170d4b08f42eeb5a0ed92fb5ef0ef`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:42.253848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ceb17064-4cb7-465d-a0f3-8b312772aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:42.385445 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1844/3663] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:42.390942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eda3e-393e-4523-b6d8-c01fc11ac7e8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:42.490322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eda3e-393e-4523-b6d8-c01fc11ac7e8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:42.497050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572e80a-a503-49fd-9d07-7307b3b90b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:42.498062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572e80a-a503-49fd-9d07-7307b3b90b25 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.498455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572e80a-a503-49fd-9d07-7307b3b90b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.498844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572e80a-a503-49fd-9d07-7307b3b90b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.499909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572e80a-a503-49fd-9d07-7307b3b90b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:42.504075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572e80a-a503-49fd-9d07-7307b3b90b25 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:42.556498 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1820/3664] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:56:42 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:42.557964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb17064-4cb7-465d-a0f3-8b312772aff1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:42.574948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb17064-4cb7-465d-a0f3-8b312772aff1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:42.668872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae083a-794f-4088-bf6c-2e60fc193977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:42.670847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae083a-794f-4088-bf6c-2e60fc193977 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.671744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae083a-794f-4088-bf6c-2e60fc193977 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.671744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae083a-794f-4088-bf6c-2e60fc193977 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.672562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae083a-794f-4088-bf6c-2e60fc193977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:42.674760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae083a-794f-4088-bf6c-2e60fc193977 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:42.715400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1845/3665] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:56:42 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:56:42.719380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572e80a-a503-49fd-9d07-7307b3b90b25 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:42.744312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572e80a-a503-49fd-9d07-7307b3b90b25 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:42.759953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c1642-1e72-4d18-b587-ec926c4db1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:42.762166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c1642-1e72-4d18-b587-ec926c4db1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.763087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c1642-1e72-4d18-b587-ec926c4db1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.764237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c1642-1e72-4d18-b587-ec926c4db1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.765122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c1642-1e72-4d18-b587-ec926c4db1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:42.767863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c1642-1e72-4d18-b587-ec926c4db1b4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:42.797740 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1821/3666] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:42.801520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae083a-794f-4088-bf6c-2e60fc193977 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:42.813179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae083a-794f-4088-bf6c-2e60fc193977 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:42.819949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aeb43-0eae-4095-8d1d-f194daa98dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:42.821742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aeb43-0eae-4095-8d1d-f194daa98dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.821742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aeb43-0eae-4095-8d1d-f194daa98dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.821742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8aeb43-0eae-4095-8d1d-f194daa98dfd admin admin] PATH_INFO: `/v3/projects/57d69eeea72b409b8f311f5e9df6758e/users/9495b914e32f49cd915d41c8857e3ef6/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.842058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8aeb43-0eae-4095-8d1d-f194daa98dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d69eeea72b409b8f311f5e9df6758e, user_id=9495b914e32f49cd915d41c8857e3ef6, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:42.845630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8aeb43-0eae-4095-8d1d-f194daa98dfd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:42.887324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c1642-1e72-4d18-b587-ec926c4db1b4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:42.900901 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1846/3667] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:42 2022] PUT /identity/v3/projects/57d69eeea72b409b8f311f5e9df6758e/users/9495b914e32f49cd915d41c8857e3ef6/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:42.903397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c1642-1e72-4d18-b587-ec926c4db1b4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:42.982857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece12e13-7413-4f58-8eeb-29baf2944483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:42.983975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece12e13-7413-4f58-8eeb-29baf2944483 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:42.984520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece12e13-7413-4f58-8eeb-29baf2944483 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:42.985172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece12e13-7413-4f58-8eeb-29baf2944483 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:42.986753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece12e13-7413-4f58-8eeb-29baf2944483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:42.988578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece12e13-7413-4f58-8eeb-29baf2944483 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:43.005514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aeb43-0eae-4095-8d1d-f194daa98dfd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:43.008154 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1822/3668] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:56:43.038373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8aeb43-0eae-4095-8d1d-f194daa98dfd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:43.047390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7098626-66a7-4dff-94d2-265f07be421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:43.048540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7098626-66a7-4dff-94d2-265f07be421e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:43.048922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7098626-66a7-4dff-94d2-265f07be421e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:43.049298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7098626-66a7-4dff-94d2-265f07be421e admin admin] PATH_INFO: `/v3/projects/57d69eeea72b409b8f311f5e9df6758e/users/9495b914e32f49cd915d41c8857e3ef6/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:43.051947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7098626-66a7-4dff-94d2-265f07be421e admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d69eeea72b409b8f311f5e9df6758e, user_id=9495b914e32f49cd915d41c8857e3ef6, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:43.056142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7098626-66a7-4dff-94d2-265f07be421e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:43.077792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1847/3669] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:56:43 2022] PUT /identity/v3/projects/57d69eeea72b409b8f311f5e9df6758e/users/9495b914e32f49cd915d41c8857e3ef6/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:56:43.082449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c131ac-8dd6-4509-b935-3b235312483e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:43.082774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c131ac-8dd6-4509-b935-3b235312483e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:43.083062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c131ac-8dd6-4509-b935-3b235312483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:43.137729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-97c131ac-8dd6-4509-b935-3b235312483e None None] MFA Rules not processed for user `9495b914e32f49cd915d41c8857e3ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:43.139506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-97c131ac-8dd6-4509-b935-3b235312483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:43.255634 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1823/3670] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:43.294366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7098626-66a7-4dff-94d2-265f07be421e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:43.297938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f7098626-66a7-4dff-94d2-265f07be421e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:43.455830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7098626-66a7-4dff-94d2-265f07be421e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:43.469004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2935514-d15d-41a8-987a-304c4edbd7ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:43.470115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2935514-d15d-41a8-987a-304c4edbd7ce service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:43.470662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2935514-d15d-41a8-987a-304c4edbd7ce service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:43.471727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2935514-d15d-41a8-987a-304c4edbd7ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:43.629429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2935514-d15d-41a8-987a-304c4edbd7ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:43.632468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2935514-d15d-41a8-987a-304c4edbd7ce service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:43.668819 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1848/3671] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:44.366747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5baf4-1613-457f-8321-486843ab563d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:44.368232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5baf4-1613-457f-8321-486843ab563d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:44.368857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5baf4-1613-457f-8321-486843ab563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:44.456168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0ef5baf4-1613-457f-8321-486843ab563d None None] MFA Rules not processed for user `a01a3991559f4738b240874a96dd5ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:44.463769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0ef5baf4-1613-457f-8321-486843ab563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:44.553737 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1824/3672] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:44.637946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb885ff-7798-425b-842d-12d572051a92 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:44.638876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb885ff-7798-425b-842d-12d572051a92 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:44.639316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb885ff-7798-425b-842d-12d572051a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:44.689135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ffb885ff-7798-425b-842d-12d572051a92 None None] MFA Rules not processed for user `a01a3991559f4738b240874a96dd5ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:44.693315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ffb885ff-7798-425b-842d-12d572051a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:44.718958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1849/3673] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:44 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:44.924857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5baf4-1613-457f-8321-486843ab563d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:44.926453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0ef5baf4-1613-457f-8321-486843ab563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:45.036629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5baf4-1613-457f-8321-486843ab563d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:45.042249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db17c9b-7e49-4eed-b55f-9f8db17ec3ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:45.043277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db17c9b-7e49-4eed-b55f-9f8db17ec3ee service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:45.043738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db17c9b-7e49-4eed-b55f-9f8db17ec3ee service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:45.044208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db17c9b-7e49-4eed-b55f-9f8db17ec3ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:45.058527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db17c9b-7e49-4eed-b55f-9f8db17ec3ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:45.060651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db17c9b-7e49-4eed-b55f-9f8db17ec3ee service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:45.088910 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1825/3674] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:44 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:45.721971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb885ff-7798-425b-842d-12d572051a92 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:45.733791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb885ff-7798-425b-842d-12d572051a92 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:45.750710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ab18d-6030-4baf-8440-428d8ed1dcf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:45.751989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ab18d-6030-4baf-8440-428d8ed1dcf6 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:45.752298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ab18d-6030-4baf-8440-428d8ed1dcf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:45.752603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ab18d-6030-4baf-8440-428d8ed1dcf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:45.769854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ab18d-6030-4baf-8440-428d8ed1dcf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:45.771293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5ab18d-6030-4baf-8440-428d8ed1dcf6 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:45.794601 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1850/3675] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:45.898132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2476a7-4145-4cbf-ab13-31f454eb03ec None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:45.899650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2476a7-4145-4cbf-ab13-31f454eb03ec None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:45.900828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2476a7-4145-4cbf-ab13-31f454eb03ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:45.942338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ac2476a7-4145-4cbf-ab13-31f454eb03ec None None] MFA Rules not processed for user `387ac2e169914b57991e4c1c45937e73`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:45.944032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ac2476a7-4145-4cbf-ab13-31f454eb03ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:46.118785 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1826/3676] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:46.120465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83387854-8314-499a-81eb-bb0c2c08173e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:46.121123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83387854-8314-499a-81eb-bb0c2c08173e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:46.121515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83387854-8314-499a-81eb-bb0c2c08173e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:46.175532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-83387854-8314-499a-81eb-bb0c2c08173e None None] MFA Rules not processed for user `387ac2e169914b57991e4c1c45937e73`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:46.181895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-83387854-8314-499a-81eb-bb0c2c08173e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:46.205550 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1851/3677] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:56:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:46.758655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2476a7-4145-4cbf-ab13-31f454eb03ec None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:46.780388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2476a7-4145-4cbf-ab13-31f454eb03ec None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:46.792259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807014-1001-4666-a5be-1b21ad41a677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:46.793873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807014-1001-4666-a5be-1b21ad41a677 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:46.794494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807014-1001-4666-a5be-1b21ad41a677 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:46.795117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0807014-1001-4666-a5be-1b21ad41a677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:46.811434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0807014-1001-4666-a5be-1b21ad41a677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:46.813488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0807014-1001-4666-a5be-1b21ad41a677 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:46.848470 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1827/3678] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:56:48.026199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e81664-8692-496b-a199-e16012272b45 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:48.026895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e81664-8692-496b-a199-e16012272b45 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:48.026895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e81664-8692-496b-a199-e16012272b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:48.064025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e9e81664-8692-496b-a199-e16012272b45 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:48.066650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e9e81664-8692-496b-a199-e16012272b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:48.202556 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1852/3679] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:56:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:48.218105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807014-1001-4666-a5be-1b21ad41a677 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:48.219649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b0807014-1001-4666-a5be-1b21ad41a677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:48.384669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0807014-1001-4666-a5be-1b21ad41a677 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:48.408449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8685bf-64af-42f3-9af3-1c941f99cae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:48.409240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8685bf-64af-42f3-9af3-1c941f99cae1 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:48.409791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8685bf-64af-42f3-9af3-1c941f99cae1 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:48.410309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8685bf-64af-42f3-9af3-1c941f99cae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:48.431324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8685bf-64af-42f3-9af3-1c941f99cae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:48.433229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8685bf-64af-42f3-9af3-1c941f99cae1 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:48.460116 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1828/3680] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:56:52.993553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e0be-af8f-4aa3-9ba2-5d97c03ce799 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:52.994185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e0be-af8f-4aa3-9ba2-5d97c03ce799 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:52.994388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1e0be-af8f-4aa3-9ba2-5d97c03ce799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:53.044977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-09d1e0be-af8f-4aa3-9ba2-5d97c03ce799 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:56:53.057420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-09d1e0be-af8f-4aa3-9ba2-5d97c03ce799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:53.097830 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1853/3681] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:56:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:56:53.105384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8685bf-64af-42f3-9af3-1c941f99cae1 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:53.116464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8685bf-64af-42f3-9af3-1c941f99cae1 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:53.135346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7bc97-aa00-470e-9e32-aeb021ea08f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:53.136335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bc97-aa00-470e-9e32-aeb021ea08f8 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:53.136813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bc97-aa00-470e-9e32-aeb021ea08f8 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:53.137259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7bc97-aa00-470e-9e32-aeb021ea08f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:53.154422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7bc97-aa00-470e-9e32-aeb021ea08f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:53.157113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7bc97-aa00-470e-9e32-aeb021ea08f8 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:53.178928 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1829/3682] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:56:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:56:57.032517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1e0be-af8f-4aa3-9ba2-5d97c03ce799 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:56:57.032517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-09d1e0be-af8f-4aa3-9ba2-5d97c03ce799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:57.235282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1e0be-af8f-4aa3-9ba2-5d97c03ce799 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:56:57.243440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c90c3-a091-4191-942c-981cc71078c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:56:57.244533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c90c3-a091-4191-942c-981cc71078c3 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:56:57.245077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c90c3-a091-4191-942c-981cc71078c3 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:56:57.245563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6c90c3-a091-4191-942c-981cc71078c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:56:57.247654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b6c90c3-a091-4191-942c-981cc71078c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:56:57.261518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c90c3-a091-4191-942c-981cc71078c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:56:57.265271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6c90c3-a091-4191-942c-981cc71078c3 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:56:57.279872 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1854/3683] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:56:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:01.427012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c18054-43d6-43fc-9a3e-71c9cfdc79ed None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:01.430442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c18054-43d6-43fc-9a3e-71c9cfdc79ed None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:01.431421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c18054-43d6-43fc-9a3e-71c9cfdc79ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:01.473660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-68c18054-43d6-43fc-9a3e-71c9cfdc79ed None None] MFA Rules not processed for user `4c8199b3248742a7ba0d0cb6570c7058`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:01.476930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-68c18054-43d6-43fc-9a3e-71c9cfdc79ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:01.577111 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1830/3684] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:03.816297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c90c3-a091-4191-942c-981cc71078c3 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:03.822086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c18054-43d6-43fc-9a3e-71c9cfdc79ed None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:03.825950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-68c18054-43d6-43fc-9a3e-71c9cfdc79ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:03.831183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6c90c3-a091-4191-942c-981cc71078c3 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:03.840079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:03.840994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:03.842042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:03.842508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:03.844721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:03.847278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c18054-43d6-43fc-9a3e-71c9cfdc79ed None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:03.853601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229169a-538c-4981-b614-566809e62e9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:03.855505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229169a-538c-4981-b614-566809e62e9e service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:03.856037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229169a-538c-4981-b614-566809e62e9e service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:03.856480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229169a-538c-4981-b614-566809e62e9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:03.858491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:03.860189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:03.869262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229169a-538c-4981-b614-566809e62e9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:03.871444 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1855/3685] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:03.884984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229169a-538c-4981-b614-566809e62e9e service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:03.912956 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1831/3686] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:57:09.512166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:09.514128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:09.576813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229169a-538c-4981-b614-566809e62e9e service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:09.653629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e185d69d-b0e5-41ec-9aac-a196f3e48a32 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:09.669549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:09.670452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:09.671119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229169a-538c-4981-b614-566809e62e9e service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:09.671872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:09.672188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] PATH_INFO: `/v3/users/ab0c5bde8c054cbcbc19291778a9511b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:09.673587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0c5bde8c054cbcbc19291778a9511b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:09.677486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:09.683172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:09.686339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:09.689167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:09.689620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] PATH_INFO: `/v3/users/7d1170d4b08f42eeb5a0ed92fb5ef0ef` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:09.692125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d1170d4b08f42eeb5a0ed92fb5ef0ef)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:09.700026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:09.749434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0c5bde8c054cbcbc19291778a9511b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.757941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0c5bde8c054cbcbc19291778a9511b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.759214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0c5bde8c054cbcbc19291778a9511b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.760339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0c5bde8c054cbcbc19291778a9511b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.781185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5278866f-7b09-4cc1-a7cd-644479b68a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0c5bde8c054cbcbc19291778a9511b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.798634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d1170d4b08f42eeb5a0ed92fb5ef0ef'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.807400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1856/3687] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:09 2022] DELETE /identity/v3/users/ab0c5bde8c054cbcbc19291778a9511b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:09.809853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d1170d4b08f42eeb5a0ed92fb5ef0ef'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.811416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d1170d4b08f42eeb5a0ed92fb5ef0ef'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.811550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d1170d4b08f42eeb5a0ed92fb5ef0ef'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.827435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d1170d4b08f42eeb5a0ed92fb5ef0ef'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:09.848376 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1832/3688] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:09 2022] DELETE /identity/v3/users/7d1170d4b08f42eeb5a0ed92fb5ef0ef => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:57:09.848906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8c9f1-eb3f-46d8-9c5f-c4130242ab54 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:09.849224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8c9f1-eb3f-46d8-9c5f-c4130242ab54 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:09.849517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8c9f1-eb3f-46d8-9c5f-c4130242ab54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:09.877062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-59c8c9f1-eb3f-46d8-9c5f-c4130242ab54 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:09.878627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-59c8c9f1-eb3f-46d8-9c5f-c4130242ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:09.990199 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1857/3689] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:57:10.045226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:10.048032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:10.120267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e1963-8ee2-4a09-8762-cbad9d4f1dfc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:10.124601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87953751-a93d-4aec-9771-030a512525b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:10.125310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87953751-a93d-4aec-9771-030a512525b5 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:10.125613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87953751-a93d-4aec-9771-030a512525b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:10.126055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87953751-a93d-4aec-9771-030a512525b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:10.139250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87953751-a93d-4aec-9771-030a512525b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:10.140765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87953751-a93d-4aec-9771-030a512525b5 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:10.152146 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1833/3690] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:10.441572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8c9f1-eb3f-46d8-9c5f-c4130242ab54 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:10.443294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-59c8c9f1-eb3f-46d8-9c5f-c4130242ab54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:10.457043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8c9f1-eb3f-46d8-9c5f-c4130242ab54 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:10.468932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:10.470156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:10.470445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:10.472286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] PATH_INFO: `/v3/projects/79effa8b201c422cb22e57efa4c8892a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:10.473894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79effa8b201c422cb22e57efa4c8892a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:10.484299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:10.581412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79effa8b201c422cb22e57efa4c8892a', 'request_id': 'req-5d14d55b-c4a4-40ba-8041-3db4943769d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:10.596640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79effa8b201c422cb22e57efa4c8892a', 'request_id': 'req-5d14d55b-c4a4-40ba-8041-3db4943769d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:10.604483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79effa8b201c422cb22e57efa4c8892a', 'request_id': 'req-5d14d55b-c4a4-40ba-8041-3db4943769d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:10.621025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] The token cache is being invalidate because project 79effa8b201c422cb22e57efa4c8892a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:10.621366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:10.622475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d14d55b-c4a4-40ba-8041-3db4943769d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:10.627807 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1858/3691] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:10 2022] DELETE /identity/v3/projects/79effa8b201c422cb22e57efa4c8892a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:10.630292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3227a-c60d-4aa7-8aa1-58e86a63045a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:10.631466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3227a-c60d-4aa7-8aa1-58e86a63045a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:10.632032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3227a-c60d-4aa7-8aa1-58e86a63045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:10.660710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-07c3227a-c60d-4aa7-8aa1-58e86a63045a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:10.662459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-07c3227a-c60d-4aa7-8aa1-58e86a63045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:10.775662 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1834/3692] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:10.784425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8911e9b-b96b-4b2d-9b05-ec78818c76d2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:10.784719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8911e9b-b96b-4b2d-9b05-ec78818c76d2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:10.785008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8911e9b-b96b-4b2d-9b05-ec78818c76d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:10.796756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3227a-c60d-4aa7-8aa1-58e86a63045a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:10.801038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-07c3227a-c60d-4aa7-8aa1-58e86a63045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:10.810363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d8911e9b-b96b-4b2d-9b05-ec78818c76d2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:10.811595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d8911e9b-b96b-4b2d-9b05-ec78818c76d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:10.824636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3227a-c60d-4aa7-8aa1-58e86a63045a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:10.831184 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1859/3693] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:10.835005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8911e9b-b96b-4b2d-9b05-ec78818c76d2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:10.836124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:10.837483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:10.838078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:10.838578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] PATH_INFO: `/v3/projects/ba712e82d41f49daa33efd59bdd437d8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:10.841151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba712e82d41f49daa33efd59bdd437d8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:10.845261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:10.852194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8911e9b-b96b-4b2d-9b05-ec78818c76d2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:10.871996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae9f9-5859-4f95-ae9c-8f7596a508ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:10.873375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae9f9-5859-4f95-ae9c-8f7596a508ef admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:10.873827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae9f9-5859-4f95-ae9c-8f7596a508ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:10.874269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcae9f9-5859-4f95-ae9c-8f7596a508ef admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:10.875164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae9f9-5859-4f95-ae9c-8f7596a508ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:57:10.875650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae9f9-5859-4f95-ae9c-8f7596a508ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:10.879532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcae9f9-5859-4f95-ae9c-8f7596a508ef admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:10.911375 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1860/3694] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:57:10.916792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae9f9-5859-4f95-ae9c-8f7596a508ef admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:10.937399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcae9f9-5859-4f95-ae9c-8f7596a508ef admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:10.961737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba712e82d41f49daa33efd59bdd437d8', 'request_id': 'req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:10.977666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba712e82d41f49daa33efd59bdd437d8', 'request_id': 'req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:10.989993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba712e82d41f49daa33efd59bdd437d8', 'request_id': 'req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:11.011160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] The token cache is being invalidate because project ba712e82d41f49daa33efd59bdd437d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:11.011695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:11.012480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:11.018090 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1835/3695] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:10 2022] DELETE /identity/v3/projects/ba712e82d41f49daa33efd59bdd437d8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:11.019471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:11.021312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:11.028254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898987e-e2ff-4866-8ebc-78a17d65d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:11.029672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898987e-e2ff-4866-8ebc-78a17d65d1bf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:11.029672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898987e-e2ff-4866-8ebc-78a17d65d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:11.029986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898987e-e2ff-4866-8ebc-78a17d65d1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:11.035664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898987e-e2ff-4866-8ebc-78a17d65d1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:11.040665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898987e-e2ff-4866-8ebc-78a17d65d1bf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:11.076350 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1861/3696] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:57:10 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:11.080359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898987e-e2ff-4866-8ebc-78a17d65d1bf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:11.082980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3898987e-e2ff-4866-8ebc-78a17d65d1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:11.154016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7086c7-58e3-48ef-b771-4f60d9fe92a6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:11.275406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898987e-e2ff-4866-8ebc-78a17d65d1bf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:11.285138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:11.286736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:11.287019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:11.287296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] PATH_INFO: `/v3/users/9495b914e32f49cd915d41c8857e3ef6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:11.290108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9495b914e32f49cd915d41c8857e3ef6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:11.295403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:11.302384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228e537-d282-433a-a3d9-1ab469892bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:11.305211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e537-d282-433a-a3d9-1ab469892bae admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:11.306042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e537-d282-433a-a3d9-1ab469892bae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:11.306335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e537-d282-433a-a3d9-1ab469892bae admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:11.307037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228e537-d282-433a-a3d9-1ab469892bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:11.309418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228e537-d282-433a-a3d9-1ab469892bae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:11.344869 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1862/3697] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:57:11 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:57:11.353302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228e537-d282-433a-a3d9-1ab469892bae admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:11.371967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228e537-d282-433a-a3d9-1ab469892bae admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:11.391412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660442-2522-4e41-b1f4-139ccb682006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:11.392547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660442-2522-4e41-b1f4-139ccb682006 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:11.392547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660442-2522-4e41-b1f4-139ccb682006 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:11.392779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf660442-2522-4e41-b1f4-139ccb682006 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:11.393362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf660442-2522-4e41-b1f4-139ccb682006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:11.394984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf660442-2522-4e41-b1f4-139ccb682006 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:11.413950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9495b914e32f49cd915d41c8857e3ef6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:11.418310 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1863/3698] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:11.418551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660442-2522-4e41-b1f4-139ccb682006 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:11.434976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9495b914e32f49cd915d41c8857e3ef6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:11.435244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf660442-2522-4e41-b1f4-139ccb682006 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:11.436832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9495b914e32f49cd915d41c8857e3ef6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:11.440808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9495b914e32f49cd915d41c8857e3ef6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:11.451732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513d1d-8745-4a7b-9efd-1e447cf28af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:11.451732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513d1d-8745-4a7b-9efd-1e447cf28af1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:11.451732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513d1d-8745-4a7b-9efd-1e447cf28af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:11.452197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be513d1d-8745-4a7b-9efd-1e447cf28af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:11.452924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be513d1d-8745-4a7b-9efd-1e447cf28af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:11.456557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be513d1d-8745-4a7b-9efd-1e447cf28af1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:11.469564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32654fb9-5a89-44b7-a429-ab2324ff6652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9495b914e32f49cd915d41c8857e3ef6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:11.485423 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1864/3699] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:11.486327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513d1d-8745-4a7b-9efd-1e447cf28af1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:11.488297 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1836/3700] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:11 2022] DELETE /identity/v3/users/9495b914e32f49cd915d41c8857e3ef6 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:11.493173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be513d1d-8745-4a7b-9efd-1e447cf28af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:11.521069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be513d1d-8745-4a7b-9efd-1e447cf28af1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:11.611728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794ca23-4ad8-41da-8e7c-26b263fc80c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:11.613261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794ca23-4ad8-41da-8e7c-26b263fc80c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:11.613650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794ca23-4ad8-41da-8e7c-26b263fc80c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:11.614030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794ca23-4ad8-41da-8e7c-26b263fc80c5 admin admin] PATH_INFO: `/v3/projects/c7b56cae79f846b5b6f3700480cfc811/users/75cdd0c73bcc473081b65958a7b1fbe6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:11.639319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794ca23-4ad8-41da-8e7c-26b263fc80c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b56cae79f846b5b6f3700480cfc811, user_id=75cdd0c73bcc473081b65958a7b1fbe6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:11.646434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794ca23-4ad8-41da-8e7c-26b263fc80c5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:11.689312 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1865/3701] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:11 2022] PUT /identity/v3/projects/c7b56cae79f846b5b6f3700480cfc811/users/75cdd0c73bcc473081b65958a7b1fbe6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:11.694646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff9b86-affe-4c0a-aa98-28697a73b8ab None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:11.696300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff9b86-affe-4c0a-aa98-28697a73b8ab None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:11.696879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff9b86-affe-4c0a-aa98-28697a73b8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:11.764998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7aff9b86-affe-4c0a-aa98-28697a73b8ab None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:11.774679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7aff9b86-affe-4c0a-aa98-28697a73b8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:11.981111 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1837/3702] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:12.025167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794ca23-4ad8-41da-8e7c-26b263fc80c5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:12.027472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b794ca23-4ad8-41da-8e7c-26b263fc80c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:12.152933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794ca23-4ad8-41da-8e7c-26b263fc80c5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:12.165425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340fa0a-00ce-46c1-a648-8d70cceed6ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:12.166101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fa0a-00ce-46c1-a648-8d70cceed6ca service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:12.166387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fa0a-00ce-46c1-a648-8d70cceed6ca service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:12.166667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340fa0a-00ce-46c1-a648-8d70cceed6ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:12.203627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340fa0a-00ce-46c1-a648-8d70cceed6ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:12.205113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340fa0a-00ce-46c1-a648-8d70cceed6ca service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:12.230941 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1866/3703] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:12.439143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff9b86-affe-4c0a-aa98-28697a73b8ab None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:12.440808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7aff9b86-affe-4c0a-aa98-28697a73b8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:12.465954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff9b86-affe-4c0a-aa98-28697a73b8ab None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:12.474178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:12.475417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:12.475875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:12.477303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] PATH_INFO: `/v3/projects/57d69eeea72b409b8f311f5e9df6758e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:12.478908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d69eeea72b409b8f311f5e9df6758e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:12.481910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:12.563564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d69eeea72b409b8f311f5e9df6758e', 'request_id': 'req-666caf84-697c-42c9-b236-6dd5908bea29'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:12.575908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d69eeea72b409b8f311f5e9df6758e', 'request_id': 'req-666caf84-697c-42c9-b236-6dd5908bea29'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:12.584762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d69eeea72b409b8f311f5e9df6758e', 'request_id': 'req-666caf84-697c-42c9-b236-6dd5908bea29'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:12.613972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] The token cache is being invalidate because project 57d69eeea72b409b8f311f5e9df6758e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:12.614930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:12.615773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-666caf84-697c-42c9-b236-6dd5908bea29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:12.619992 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1838/3704] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:12 2022] DELETE /identity/v3/projects/57d69eeea72b409b8f311f5e9df6758e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:12.625440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80a8f2-47b0-49d3-81eb-1f64900f137b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:12.626442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80a8f2-47b0-49d3-81eb-1f64900f137b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:12.626705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80a8f2-47b0-49d3-81eb-1f64900f137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:12.647700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cf80a8f2-47b0-49d3-81eb-1f64900f137b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:12.649131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cf80a8f2-47b0-49d3-81eb-1f64900f137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:12.737668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdaf8c-de54-4254-aaf4-a81f18d2aa9d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:12.738171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdaf8c-de54-4254-aaf4-a81f18d2aa9d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:12.738556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cdaf8c-de54-4254-aaf4-a81f18d2aa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:12.740720 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1867/3705] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:57:12.769698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-48cdaf8c-de54-4254-aaf4-a81f18d2aa9d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:12.771199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-48cdaf8c-de54-4254-aaf4-a81f18d2aa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:12.791023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80a8f2-47b0-49d3-81eb-1f64900f137b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:12.798999 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1839/3706] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:12.806384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80a8f2-47b0-49d3-81eb-1f64900f137b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:12.812649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50c5c3-3570-4c0a-a702-c6c13ab269c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:12.813647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50c5c3-3570-4c0a-a702-c6c13ab269c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:12.814080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50c5c3-3570-4c0a-a702-c6c13ab269c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:12.814454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50c5c3-3570-4c0a-a702-c6c13ab269c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:12.815265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50c5c3-3570-4c0a-a702-c6c13ab269c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:57:12.815802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50c5c3-3570-4c0a-a702-c6c13ab269c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:12.817772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50c5c3-3570-4c0a-a702-c6c13ab269c1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:12.836712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdaf8c-de54-4254-aaf4-a81f18d2aa9d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:12.843261 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1868/3707] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:57:12.849743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cdaf8c-de54-4254-aaf4-a81f18d2aa9d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:12.858156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fbcb8-e347-4c8b-9b99-f05c2d2272ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:12.859398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fbcb8-e347-4c8b-9b99-f05c2d2272ae admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:12.859943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fbcb8-e347-4c8b-9b99-f05c2d2272ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:12.861980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fbcb8-e347-4c8b-9b99-f05c2d2272ae admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:12.863377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fbcb8-e347-4c8b-9b99-f05c2d2272ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:12.866483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0fbcb8-e347-4c8b-9b99-f05c2d2272ae admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:12.911867 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1840/3708] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:57:12 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:12.918472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50c5c3-3570-4c0a-a702-c6c13ab269c1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:12.930255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50c5c3-3570-4c0a-a702-c6c13ab269c1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:13.037700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43d212-7a4f-410a-9d25-13a1a6ad7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:13.038616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43d212-7a4f-410a-9d25-13a1a6ad7111 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.039588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43d212-7a4f-410a-9d25-13a1a6ad7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.039875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43d212-7a4f-410a-9d25-13a1a6ad7111 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.041151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43d212-7a4f-410a-9d25-13a1a6ad7111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:13.043241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43d212-7a4f-410a-9d25-13a1a6ad7111 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:13.072607 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1869/3709] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:57:12 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:13.081743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fbcb8-e347-4c8b-9b99-f05c2d2272ae admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:13.095059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fbcb8-e347-4c8b-9b99-f05c2d2272ae admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:13.102246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992b6e7-fc77-4129-8ea5-cc9ccf109fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:13.102999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992b6e7-fc77-4129-8ea5-cc9ccf109fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.103344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992b6e7-fc77-4129-8ea5-cc9ccf109fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.103680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3992b6e7-fc77-4129-8ea5-cc9ccf109fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.106237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992b6e7-fc77-4129-8ea5-cc9ccf109fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:13.106237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3992b6e7-fc77-4129-8ea5-cc9ccf109fe3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:13.126860 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1841/3710] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:13.128852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43d212-7a4f-410a-9d25-13a1a6ad7111 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:13.142823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43d212-7a4f-410a-9d25-13a1a6ad7111 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:13.150584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19560d3-fcec-46d2-a127-aeb6caf4cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:13.151360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19560d3-fcec-46d2-a127-aeb6caf4cdad admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.151708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19560d3-fcec-46d2-a127-aeb6caf4cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.152101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19560d3-fcec-46d2-a127-aeb6caf4cdad admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.153181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19560d3-fcec-46d2-a127-aeb6caf4cdad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:13.154912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19560d3-fcec-46d2-a127-aeb6caf4cdad admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:13.168885 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1870/3711] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:13.173220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992b6e7-fc77-4129-8ea5-cc9ccf109fe3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:13.183831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3992b6e7-fc77-4129-8ea5-cc9ccf109fe3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:13.189070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8b057-1d97-43e1-ac22-20aa50d240ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:13.190698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8b057-1d97-43e1-ac22-20aa50d240ee admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.190698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8b057-1d97-43e1-ac22-20aa50d240ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.190698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8b057-1d97-43e1-ac22-20aa50d240ee admin admin] PATH_INFO: `/v3/projects/56c2cb2b33c44968bbd816b91c447629/users/96442e9c178d478eb252f97ae0cc6331/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.208093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8b057-1d97-43e1-ac22-20aa50d240ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c2cb2b33c44968bbd816b91c447629, user_id=96442e9c178d478eb252f97ae0cc6331, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:13.211616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8b057-1d97-43e1-ac22-20aa50d240ee admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:13.227241 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1842/3712] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:13 2022] PUT /identity/v3/projects/56c2cb2b33c44968bbd816b91c447629/users/96442e9c178d478eb252f97ae0cc6331/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:57:13.312775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722646b-000b-48fa-8a47-55743c72beeb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.313103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722646b-000b-48fa-8a47-55743c72beeb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.313386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722646b-000b-48fa-8a47-55743c72beeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.342738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0722646b-000b-48fa-8a47-55743c72beeb None None] MFA Rules not processed for user `96442e9c178d478eb252f97ae0cc6331`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:13.344151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0722646b-000b-48fa-8a47-55743c72beeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:13.413694 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1871/3713] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:13.418175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8b057-1d97-43e1-ac22-20aa50d240ee admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:13.543318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8b057-1d97-43e1-ac22-20aa50d240ee admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:13.549002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeaed7-6410-458d-847a-fe6c84405e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:13.549701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeaed7-6410-458d-847a-fe6c84405e44 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.549984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeaed7-6410-458d-847a-fe6c84405e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.550884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afeaed7-6410-458d-847a-fe6c84405e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.551587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afeaed7-6410-458d-847a-fe6c84405e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:13.554211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afeaed7-6410-458d-847a-fe6c84405e44 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:13.588204 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1843/3714] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:57:13 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:13.589820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722646b-000b-48fa-8a47-55743c72beeb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:13.607644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722646b-000b-48fa-8a47-55743c72beeb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:13.716765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c38af-5013-4e09-b3bc-c8b7f422e5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:13.720419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c38af-5013-4e09-b3bc-c8b7f422e5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.722352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c38af-5013-4e09-b3bc-c8b7f422e5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.722668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c38af-5013-4e09-b3bc-c8b7f422e5d2 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.723552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c38af-5013-4e09-b3bc-c8b7f422e5d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:13.725817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c38af-5013-4e09-b3bc-c8b7f422e5d2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:13.760615 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1872/3715] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:57:13 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:13.764383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeaed7-6410-458d-847a-fe6c84405e44 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:13.774969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afeaed7-6410-458d-847a-fe6c84405e44 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:13.782312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092bbe6-2b69-4b58-bc5f-068a0e5205f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:13.782997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092bbe6-2b69-4b58-bc5f-068a0e5205f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.783460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092bbe6-2b69-4b58-bc5f-068a0e5205f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.784095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092bbe6-2b69-4b58-bc5f-068a0e5205f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.785001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092bbe6-2b69-4b58-bc5f-068a0e5205f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:13.786854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092bbe6-2b69-4b58-bc5f-068a0e5205f1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:13.807759 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1844/3716] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:13.810402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c38af-5013-4e09-b3bc-c8b7f422e5d2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:13.823729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c38af-5013-4e09-b3bc-c8b7f422e5d2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:13.835209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3570-3094-4818-b3f6-e53acbfdda27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:13.839436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3570-3094-4818-b3f6-e53acbfdda27 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.839817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3570-3094-4818-b3f6-e53acbfdda27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.840203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e3570-3094-4818-b3f6-e53acbfdda27 admin admin] PATH_INFO: `/v3/projects/214cff5714b7427da8bf35b5bb6e6990/users/82e9d047e79f4635b090187153e75a69/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.858402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e3570-3094-4818-b3f6-e53acbfdda27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=214cff5714b7427da8bf35b5bb6e6990, user_id=82e9d047e79f4635b090187153e75a69, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:13.861691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e3570-3094-4818-b3f6-e53acbfdda27 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:13.878287 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1873/3717] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:13 2022] PUT /identity/v3/projects/214cff5714b7427da8bf35b5bb6e6990/users/82e9d047e79f4635b090187153e75a69/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:13.883314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092bbe6-2b69-4b58-bc5f-068a0e5205f1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:13.893459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092bbe6-2b69-4b58-bc5f-068a0e5205f1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:13.955149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25967d-5a87-49b1-b164-95dd61ce49cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:13.956202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25967d-5a87-49b1-b164-95dd61ce49cc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:13.956489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25967d-5a87-49b1-b164-95dd61ce49cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:13.956769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25967d-5a87-49b1-b164-95dd61ce49cc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:13.957697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25967d-5a87-49b1-b164-95dd61ce49cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:13.959671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25967d-5a87-49b1-b164-95dd61ce49cc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:13.979014 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1845/3718] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:13.983440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3570-3094-4818-b3f6-e53acbfdda27 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:13.995960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e3570-3094-4818-b3f6-e53acbfdda27 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:14.000625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52236-6197-4d4b-b73d-3ca818c77a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:14.001514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52236-6197-4d4b-b73d-3ca818c77a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:14.001803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52236-6197-4d4b-b73d-3ca818c77a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:14.002083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52236-6197-4d4b-b73d-3ca818c77a3d admin admin] PATH_INFO: `/v3/projects/214cff5714b7427da8bf35b5bb6e6990/users/82e9d047e79f4635b090187153e75a69/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:14.004579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f52236-6197-4d4b-b73d-3ca818c77a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=214cff5714b7427da8bf35b5bb6e6990, user_id=82e9d047e79f4635b090187153e75a69, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:14.007397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f52236-6197-4d4b-b73d-3ca818c77a3d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:14.018290 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1874/3719] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:13 2022] PUT /identity/v3/projects/214cff5714b7427da8bf35b5bb6e6990/users/82e9d047e79f4635b090187153e75a69/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:14.028417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c40754-2b67-4617-b149-baf9cf84b339 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:14.028777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c40754-2b67-4617-b149-baf9cf84b339 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:14.029125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c40754-2b67-4617-b149-baf9cf84b339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:14.057531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-49c40754-2b67-4617-b149-baf9cf84b339 None None] MFA Rules not processed for user `82e9d047e79f4635b090187153e75a69`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:14.058839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49c40754-2b67-4617-b149-baf9cf84b339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:14.126209 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1846/3720] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:14.135802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52236-6197-4d4b-b73d-3ca818c77a3d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:14.137580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c6f52236-6197-4d4b-b73d-3ca818c77a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:14.204103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52236-6197-4d4b-b73d-3ca818c77a3d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:14.207994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07efe1aa-9a3a-4668-a4e8-29db2c1c375f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:14.208700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efe1aa-9a3a-4668-a4e8-29db2c1c375f service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:14.209121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efe1aa-9a3a-4668-a4e8-29db2c1c375f service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:14.209408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07efe1aa-9a3a-4668-a4e8-29db2c1c375f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:14.219285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efe1aa-9a3a-4668-a4e8-29db2c1c375f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:14.220934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07efe1aa-9a3a-4668-a4e8-29db2c1c375f service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:14.232689 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1875/3721] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:16.425639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90ad4-7f04-481d-a22f-447a1c505466 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:16.432839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90ad4-7f04-481d-a22f-447a1c505466 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:16.434665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c90ad4-7f04-481d-a22f-447a1c505466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:16.510622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c3c90ad4-7f04-481d-a22f-447a1c505466 None None] MFA Rules not processed for user `75cdd0c73bcc473081b65958a7b1fbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:16.512210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c3c90ad4-7f04-481d-a22f-447a1c505466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:16.752625 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1847/3722] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:16.755273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd0787-fc26-4fcb-a5ef-3f73fce69a70 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:16.755871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd0787-fc26-4fcb-a5ef-3f73fce69a70 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:16.755871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd0787-fc26-4fcb-a5ef-3f73fce69a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:16.782283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2fdd0787-fc26-4fcb-a5ef-3f73fce69a70 None None] MFA Rules not processed for user `75cdd0c73bcc473081b65958a7b1fbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:16.783536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2fdd0787-fc26-4fcb-a5ef-3f73fce69a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:16.800334 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1876/3723] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:17.475164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c90ad4-7f04-481d-a22f-447a1c505466 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:17.477618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c3c90ad4-7f04-481d-a22f-447a1c505466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:17.647965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c90ad4-7f04-481d-a22f-447a1c505466 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:17.661643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87697489-9470-418e-9ae0-72f41f878dfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:17.662546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87697489-9470-418e-9ae0-72f41f878dfa service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:17.665014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87697489-9470-418e-9ae0-72f41f878dfa service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:17.665478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87697489-9470-418e-9ae0-72f41f878dfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:17.697083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87697489-9470-418e-9ae0-72f41f878dfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:17.699388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87697489-9470-418e-9ae0-72f41f878dfa service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:17.734075 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1848/3724] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:17.864066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b0b9-d644-4eb0-93b1-55fd5692f0a4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:17.864953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b0b9-d644-4eb0-93b1-55fd5692f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:17.865440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267b0b9-d644-4eb0-93b1-55fd5692f0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:17.928888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d267b0b9-d644-4eb0-93b1-55fd5692f0a4 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:17.933455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d267b0b9-d644-4eb0-93b1-55fd5692f0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:18.030526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87697489-9470-418e-9ae0-72f41f878dfa service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:18.104487 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1877/3725] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:57:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:18.120304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267b0b9-d644-4eb0-93b1-55fd5692f0a4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:18.123105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d267b0b9-d644-4eb0-93b1-55fd5692f0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:18.160765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87697489-9470-418e-9ae0-72f41f878dfa service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:18.169615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:18.170147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:18.170531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:18.170731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] PATH_INFO: `/v3/users/96442e9c178d478eb252f97ae0cc6331` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:18.184913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96442e9c178d478eb252f97ae0cc6331)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:18.191750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:18.248551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267b0b9-d644-4eb0-93b1-55fd5692f0a4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:18.258892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fea11-026a-44e0-938f-2dd643a86fa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:18.260172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fea11-026a-44e0-938f-2dd643a86fa9 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:18.261129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fea11-026a-44e0-938f-2dd643a86fa9 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:18.261686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fea11-026a-44e0-938f-2dd643a86fa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:18.288043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fea11-026a-44e0-938f-2dd643a86fa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:18.289347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96442e9c178d478eb252f97ae0cc6331'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:18.301399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96442e9c178d478eb252f97ae0cc6331'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:18.302388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96442e9c178d478eb252f97ae0cc6331'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:18.303191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96442e9c178d478eb252f97ae0cc6331'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:18.303988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7fea11-026a-44e0-938f-2dd643a86fa9 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:18.320815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b76ed779-1175-485e-aca3-a84c5218d925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96442e9c178d478eb252f97ae0cc6331'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:18.336899 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1849/3726] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:18 2022] DELETE /identity/v3/users/96442e9c178d478eb252f97ae0cc6331 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:18.337768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1878/3727] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:57:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:57:18.343443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf74c1-aa4c-4e85-a2fd-a173b93691f1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:18.343835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf74c1-aa4c-4e85-a2fd-a173b93691f1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:18.344370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf74c1-aa4c-4e85-a2fd-a173b93691f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:18.397337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3fdf74c1-aa4c-4e85-a2fd-a173b93691f1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:18.398947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3fdf74c1-aa4c-4e85-a2fd-a173b93691f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:18.479057 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1850/3728] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:18.525609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fea11-026a-44e0-938f-2dd643a86fa9 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:18.527461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9a7fea11-026a-44e0-938f-2dd643a86fa9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:18.550012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fea11-026a-44e0-938f-2dd643a86fa9 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:18.682435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9869c-8728-4ca0-8a90-c07aa3a41cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:18.684594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9869c-8728-4ca0-8a90-c07aa3a41cca service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:18.685709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9869c-8728-4ca0-8a90-c07aa3a41cca service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:18.686240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9869c-8728-4ca0-8a90-c07aa3a41cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:18.711268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9869c-8728-4ca0-8a90-c07aa3a41cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:18.716225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9869c-8728-4ca0-8a90-c07aa3a41cca service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:18.743999 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1879/3729] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:19.126294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf74c1-aa4c-4e85-a2fd-a173b93691f1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:19.129092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3fdf74c1-aa4c-4e85-a2fd-a173b93691f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:19.150533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf74c1-aa4c-4e85-a2fd-a173b93691f1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:19.184188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:19.184188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:19.184188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:19.184188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] PATH_INFO: `/v3/users/57e806dbaedc49e395b7d6b374ca2fec` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:19.186518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e806dbaedc49e395b7d6b374ca2fec)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:19.188687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:19.308752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e806dbaedc49e395b7d6b374ca2fec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.332952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e806dbaedc49e395b7d6b374ca2fec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.333903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e806dbaedc49e395b7d6b374ca2fec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.334960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e806dbaedc49e395b7d6b374ca2fec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.375287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9869c-8728-4ca0-8a90-c07aa3a41cca service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:19.376826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f1a9869c-8728-4ca0-8a90-c07aa3a41cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:19.407557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9869c-8728-4ca0-8a90-c07aa3a41cca service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:19.413415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e806dbaedc49e395b7d6b374ca2fec'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.437713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:19.438577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:19.438855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:19.439129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] PATH_INFO: `/v3/projects/56c2cb2b33c44968bbd816b91c447629` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:19.442134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c2cb2b33c44968bbd816b91c447629)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:19.452154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:19.453757 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1851/3730] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:19 2022] DELETE /identity/v3/users/57e806dbaedc49e395b7d6b374ca2fec => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:19.587249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c2cb2b33c44968bbd816b91c447629', 'request_id': 'req-22ae1c19-d612-430e-899b-81cb6a4c70ae'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.610180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c2cb2b33c44968bbd816b91c447629', 'request_id': 'req-22ae1c19-d612-430e-899b-81cb6a4c70ae'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.624173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c2cb2b33c44968bbd816b91c447629', 'request_id': 'req-22ae1c19-d612-430e-899b-81cb6a4c70ae'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.639750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] The token cache is being invalidate because project 56c2cb2b33c44968bbd816b91c447629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:19.640102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.640757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:19.643786 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1880/3731] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:19 2022] DELETE /identity/v3/projects/56c2cb2b33c44968bbd816b91c447629 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:57:19.647711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:19.649745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:19.910078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40530ed4-c060-40b8-b9a6-0eb0521d909e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:20.113959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:20.114905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:20.115131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:20.115403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] PATH_INFO: `/v3/users/82e9d047e79f4635b090187153e75a69` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:20.120380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e9d047e79f4635b090187153e75a69)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:20.125864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:20.299859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e9d047e79f4635b090187153e75a69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.309986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:20.311574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:20.319511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e9d047e79f4635b090187153e75a69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.321738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e9d047e79f4635b090187153e75a69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.322765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e9d047e79f4635b090187153e75a69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.354444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae1c19-d612-430e-899b-81cb6a4c70ae admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:20.359589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e9d047e79f4635b090187153e75a69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.381813 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1852/3732] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:19 2022] DELETE /identity/v3/users/82e9d047e79f4635b090187153e75a69 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:20.402120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:20.403042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:20.403473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:20.403593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] PATH_INFO: `/v3/projects/28e51fbb6333452b84c0c77d29b423b0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:20.405870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e51fbb6333452b84c0c77d29b423b0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:20.408185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:20.573978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e51fbb6333452b84c0c77d29b423b0', 'request_id': 'req-e1015d8e-d887-41ab-8c85-480843fc978e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.603953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e51fbb6333452b84c0c77d29b423b0', 'request_id': 'req-e1015d8e-d887-41ab-8c85-480843fc978e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.616587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e51fbb6333452b84c0c77d29b423b0', 'request_id': 'req-e1015d8e-d887-41ab-8c85-480843fc978e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.634190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] The token cache is being invalidate because project 28e51fbb6333452b84c0c77d29b423b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:20.635202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.635491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:20.637685 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1881/3733] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:20 2022] DELETE /identity/v3/projects/28e51fbb6333452b84c0c77d29b423b0 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:57:20.641791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:20.646327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:20.782490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb56e48-8d5b-43f9-9b06-6af5f4b73a3e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:20.955977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:20.962326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:20.962956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:20.965175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] PATH_INFO: `/v3/users/039ceef8239c4ae79af0b85e35b0d776` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:20.968394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] RBAC: Authorizing `identity:delete_user(user_id=039ceef8239c4ae79af0b85e35b0d776)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:20.972667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:21.113575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '039ceef8239c4ae79af0b85e35b0d776'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.144046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '039ceef8239c4ae79af0b85e35b0d776'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.144794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '039ceef8239c4ae79af0b85e35b0d776'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.153868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '039ceef8239c4ae79af0b85e35b0d776'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.174070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '039ceef8239c4ae79af0b85e35b0d776'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.210982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1853/3734] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:20 2022] DELETE /identity/v3/users/039ceef8239c4ae79af0b85e35b0d776 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:21.415417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:21.417523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:21.454185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1015d8e-d887-41ab-8c85-480843fc978e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:21.661229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:21.662621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:21.666925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:21.667580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] PATH_INFO: `/v3/users/387ac2e169914b57991e4c1c45937e73` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:21.669502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387ac2e169914b57991e4c1c45937e73)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:21.672377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:21.799941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:21.803354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:21.860857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8094b62-2b47-4914-9764-e167de6d297a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:21.876572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387ac2e169914b57991e4c1c45937e73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.883354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:21.887143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:21.887762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:21.890050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] PATH_INFO: `/v3/projects/214cff5714b7427da8bf35b5bb6e6990` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:21.894253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=214cff5714b7427da8bf35b5bb6e6990)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:21.897517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:21.901389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387ac2e169914b57991e4c1c45937e73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.902840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387ac2e169914b57991e4c1c45937e73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.903959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387ac2e169914b57991e4c1c45937e73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.921570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387ac2e169914b57991e4c1c45937e73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:21.950068 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1882/3735] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:21 2022] DELETE /identity/v3/users/387ac2e169914b57991e4c1c45937e73 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:22.015561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:22.017319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:22.073299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214cff5714b7427da8bf35b5bb6e6990', 'request_id': 'req-101ff17d-1422-4459-a9ab-657a9ff514d2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.106146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214cff5714b7427da8bf35b5bb6e6990', 'request_id': 'req-101ff17d-1422-4459-a9ab-657a9ff514d2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.127695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214cff5714b7427da8bf35b5bb6e6990', 'request_id': 'req-101ff17d-1422-4459-a9ab-657a9ff514d2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.165577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] The token cache is being invalidate because project 214cff5714b7427da8bf35b5bb6e6990 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:22.166123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.167366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-101ff17d-1422-4459-a9ab-657a9ff514d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.193391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00744f78-3650-440d-b690-04fbd6c21957 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:22.211497 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1854/3736] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:21 2022] DELETE /identity/v3/projects/214cff5714b7427da8bf35b5bb6e6990 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:57:22.217968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa723d3-c6fe-40de-a41c-2dd9a832001f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.218533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa723d3-c6fe-40de-a41c-2dd9a832001f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.219827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa723d3-c6fe-40de-a41c-2dd9a832001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.268460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:22.269622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.270076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.270512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] PATH_INFO: `/v3/projects/45240caf3c574054979eb351e9f6865d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.271947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45240caf3c574054979eb351e9f6865d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:22.274106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:22.279736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4fa723d3-c6fe-40de-a41c-2dd9a832001f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:22.281776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4fa723d3-c6fe-40de-a41c-2dd9a832001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:22.321796 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1855/3737] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:22.324180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58ccf4-6ec3-4e92-aded-ce31b5aa17da None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.324473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58ccf4-6ec3-4e92-aded-ce31b5aa17da None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.325881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58ccf4-6ec3-4e92-aded-ce31b5aa17da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.357342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-dc58ccf4-6ec3-4e92-aded-ce31b5aa17da None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:22.359357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dc58ccf4-6ec3-4e92-aded-ce31b5aa17da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:22.381030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45240caf3c574054979eb351e9f6865d', 'request_id': 'req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.411465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45240caf3c574054979eb351e9f6865d', 'request_id': 'req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.420463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45240caf3c574054979eb351e9f6865d', 'request_id': 'req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.459297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] The token cache is being invalidate because project 45240caf3c574054979eb351e9f6865d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:22.459581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.468152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c839f332-5017-4b6f-a8f9-e1de88bc9a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:22.472027 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1883/3738] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:22 2022] DELETE /identity/v3/projects/45240caf3c574054979eb351e9f6865d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:57:22.477418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d67a-e3a2-47a1-81c8-25538cf4d8ea None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.478920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d67a-e3a2-47a1-81c8-25538cf4d8ea None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.479460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3d67a-e3a2-47a1-81c8-25538cf4d8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.492128 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1856/3739] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:22.493001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58ccf4-6ec3-4e92-aded-ce31b5aa17da None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:22.506032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58ccf4-6ec3-4e92-aded-ce31b5aa17da None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:22.513959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2e5e-206c-4f9d-9b19-e905945348c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:22.514700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2e5e-206c-4f9d-9b19-e905945348c4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.515010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2e5e-206c-4f9d-9b19-e905945348c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.515260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf2e5e-206c-4f9d-9b19-e905945348c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.516120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf2e5e-206c-4f9d-9b19-e905945348c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:57:22.516433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf2e5e-206c-4f9d-9b19-e905945348c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:22.518753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf2e5e-206c-4f9d-9b19-e905945348c4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:22.538093 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1857/3740] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:57:22.544178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2e5e-206c-4f9d-9b19-e905945348c4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:22.558340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-86a3d67a-e3a2-47a1-81c8-25538cf4d8ea None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:22.562093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-86a3d67a-e3a2-47a1-81c8-25538cf4d8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:22.577978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf2e5e-206c-4f9d-9b19-e905945348c4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:22.593581 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1884/3741] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:22.596431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e5795-e4e7-4469-bdb5-5ced612816d9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.597776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e5795-e4e7-4469-bdb5-5ced612816d9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.598569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344971b2-0d6c-468d-b3c0-c02260144bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:22.599391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89e5795-e4e7-4469-bdb5-5ced612816d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.601469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344971b2-0d6c-468d-b3c0-c02260144bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.601969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344971b2-0d6c-468d-b3c0-c02260144bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.603550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344971b2-0d6c-468d-b3c0-c02260144bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.606089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344971b2-0d6c-468d-b3c0-c02260144bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:22.612175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344971b2-0d6c-468d-b3c0-c02260144bd2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:22.649338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b89e5795-e4e7-4469-bdb5-5ced612816d9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:22.651986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b89e5795-e4e7-4469-bdb5-5ced612816d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:22.672448 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1885/3742] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:22.676983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e5795-e4e7-4469-bdb5-5ced612816d9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:22.688008 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1858/3743] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:57:22 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:22.691143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344971b2-0d6c-468d-b3c0-c02260144bd2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:22.704208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89e5795-e4e7-4469-bdb5-5ced612816d9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:22.825134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344971b2-0d6c-468d-b3c0-c02260144bd2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:22.831194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cd865-1b28-4439-a216-c2a8d02e251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:22.832135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cd865-1b28-4439-a216-c2a8d02e251b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.832797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cd865-1b28-4439-a216-c2a8d02e251b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.834313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951cd865-1b28-4439-a216-c2a8d02e251b admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.835709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cd865-1b28-4439-a216-c2a8d02e251b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:22.841396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951cd865-1b28-4439-a216-c2a8d02e251b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:22.847088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce382-4676-49a7-81af-3ef1c45733a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:22.847751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce382-4676-49a7-81af-3ef1c45733a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.848055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce382-4676-49a7-81af-3ef1c45733a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.848333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce382-4676-49a7-81af-3ef1c45733a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.849050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce382-4676-49a7-81af-3ef1c45733a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:57:22.849353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce382-4676-49a7-81af-3ef1c45733a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:22.854864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce382-4676-49a7-81af-3ef1c45733a8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:22.878875 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1859/3744] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:57:22 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:22.880537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cd865-1b28-4439-a216-c2a8d02e251b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:22.881127 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1886/3745] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:57:22.885693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce382-4676-49a7-81af-3ef1c45733a8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:22.907526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951cd865-1b28-4439-a216-c2a8d02e251b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:22.910006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce382-4676-49a7-81af-3ef1c45733a8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:22.922858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb803-2822-48e1-86bc-d3ae6969d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:22.923801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb803-2822-48e1-86bc-d3ae6969d646 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.924390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb803-2822-48e1-86bc-d3ae6969d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.924826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb803-2822-48e1-86bc-d3ae6969d646 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.925206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245add61-1517-430f-a798-ae3d6d6a0fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:22.925884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eeb803-2822-48e1-86bc-d3ae6969d646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:22.926941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245add61-1517-430f-a798-ae3d6d6a0fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.927773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245add61-1517-430f-a798-ae3d6d6a0fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.928155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245add61-1517-430f-a798-ae3d6d6a0fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.928962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245add61-1517-430f-a798-ae3d6d6a0fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:22.930923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eeb803-2822-48e1-86bc-d3ae6969d646 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:22.932635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245add61-1517-430f-a798-ae3d6d6a0fa2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:22.955530 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1860/3746] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:22.962311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245add61-1517-430f-a798-ae3d6d6a0fa2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:22.978263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245add61-1517-430f-a798-ae3d6d6a0fa2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:22.985942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b6a28-4d2b-42a1-8fd6-76371f94524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:22.987419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b6a28-4d2b-42a1-8fd6-76371f94524f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:22.987947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b6a28-4d2b-42a1-8fd6-76371f94524f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:22.989442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b6a28-4d2b-42a1-8fd6-76371f94524f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:22.990570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b6a28-4d2b-42a1-8fd6-76371f94524f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:22.993538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b6a28-4d2b-42a1-8fd6-76371f94524f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.003476 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1887/3747] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:57:22 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:23.007585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb803-2822-48e1-86bc-d3ae6969d646 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.015642 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1861/3748] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:23.017822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b6a28-4d2b-42a1-8fd6-76371f94524f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.031797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b6a28-4d2b-42a1-8fd6-76371f94524f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.146182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb803-2822-48e1-86bc-d3ae6969d646 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.146457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfe672c-e455-472c-a30a-286bf7009530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.147545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe672c-e455-472c-a30a-286bf7009530 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.148894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe672c-e455-472c-a30a-286bf7009530 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.149292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfe672c-e455-472c-a30a-286bf7009530 admin admin] PATH_INFO: `/v3/projects/082627e4643944bc9f4889278b480a7f/users/83b54675b1ee4f49a787ff59722d546a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.160848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e2c9f-10a7-4fb4-bb4b-93e98f65a218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.171767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e2c9f-10a7-4fb4-bb4b-93e98f65a218 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.172443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e2c9f-10a7-4fb4-bb4b-93e98f65a218 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.173812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e2c9f-10a7-4fb4-bb4b-93e98f65a218 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.174855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e2c9f-10a7-4fb4-bb4b-93e98f65a218 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:23.175957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe672c-e455-472c-a30a-286bf7009530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=082627e4643944bc9f4889278b480a7f, user_id=83b54675b1ee4f49a787ff59722d546a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:23.178214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfe672c-e455-472c-a30a-286bf7009530 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.188674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e2c9f-10a7-4fb4-bb4b-93e98f65a218 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.220321 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1862/3749] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:23 2022] PUT /identity/v3/projects/082627e4643944bc9f4889278b480a7f/users/83b54675b1ee4f49a787ff59722d546a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:23.228827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570689bd-f26c-4f24-aef3-adfcafcbd553 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.228827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570689bd-f26c-4f24-aef3-adfcafcbd553 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.228827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570689bd-f26c-4f24-aef3-adfcafcbd553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.243405 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1888/3750] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:57:23 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:57:23.248515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e2c9f-10a7-4fb4-bb4b-93e98f65a218 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.269979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-570689bd-f26c-4f24-aef3-adfcafcbd553 None None] MFA Rules not processed for user `83b54675b1ee4f49a787ff59722d546a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:23.271483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-570689bd-f26c-4f24-aef3-adfcafcbd553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:23.276787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e2c9f-10a7-4fb4-bb4b-93e98f65a218 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.401827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8282b5-1466-43b8-9ffd-7ed611e31a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.402620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8282b5-1466-43b8-9ffd-7ed611e31a8d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.402829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8282b5-1466-43b8-9ffd-7ed611e31a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.403046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8282b5-1466-43b8-9ffd-7ed611e31a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.403769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8282b5-1466-43b8-9ffd-7ed611e31a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:23.405560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8282b5-1466-43b8-9ffd-7ed611e31a8d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.414453 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1863/3751] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:23.416079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570689bd-f26c-4f24-aef3-adfcafcbd553 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.421184 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1889/3752] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:57:23.421184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8282b5-1466-43b8-9ffd-7ed611e31a8d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.425328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-570689bd-f26c-4f24-aef3-adfcafcbd553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:23.430707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8282b5-1466-43b8-9ffd-7ed611e31a8d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.435427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01690e-d632-41d1-b3ae-cf2e1325c974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.436121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01690e-d632-41d1-b3ae-cf2e1325c974 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.436404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01690e-d632-41d1-b3ae-cf2e1325c974 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.436887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01690e-d632-41d1-b3ae-cf2e1325c974 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.437581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01690e-d632-41d1-b3ae-cf2e1325c974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:23.439490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01690e-d632-41d1-b3ae-cf2e1325c974 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.447598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570689bd-f26c-4f24-aef3-adfcafcbd553 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.455375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.458343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.458902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.459693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] PATH_INFO: `/v3/projects/3797b42bf82b407abdd1fabd06dbe141` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.462233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3797b42bf82b407abdd1fabd06dbe141)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:23.464787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.500106 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1890/3753] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:57:23 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:23.500106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01690e-d632-41d1-b3ae-cf2e1325c974 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.539728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3797b42bf82b407abdd1fabd06dbe141', 'request_id': 'req-be625e43-6352-4a7e-8ddd-598e53530967'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:23.560307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3797b42bf82b407abdd1fabd06dbe141', 'request_id': 'req-be625e43-6352-4a7e-8ddd-598e53530967'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:23.570288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3797b42bf82b407abdd1fabd06dbe141', 'request_id': 'req-be625e43-6352-4a7e-8ddd-598e53530967'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:23.587735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] The token cache is being invalidate because project 3797b42bf82b407abdd1fabd06dbe141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:23.588490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:23.589449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:23.591624 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1864/3754] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:23 2022] DELETE /identity/v3/projects/3797b42bf82b407abdd1fabd06dbe141 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:23.592741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.594509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:23.605603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01690e-d632-41d1-b3ae-cf2e1325c974 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.684218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be625e43-6352-4a7e-8ddd-598e53530967 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.689160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbebca1-c092-4413-9911-ae3158b1aba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.690092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbebca1-c092-4413-9911-ae3158b1aba3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.690668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbebca1-c092-4413-9911-ae3158b1aba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.691105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbebca1-c092-4413-9911-ae3158b1aba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.692071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbebca1-c092-4413-9911-ae3158b1aba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:23.693906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbebca1-c092-4413-9911-ae3158b1aba3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.701161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1085b1-5ccb-44f7-ab86-01b3da797edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.703099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1085b1-5ccb-44f7-ab86-01b3da797edc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.704751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1085b1-5ccb-44f7-ab86-01b3da797edc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.705558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1085b1-5ccb-44f7-ab86-01b3da797edc admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.708342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1085b1-5ccb-44f7-ab86-01b3da797edc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:23.710150 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1891/3755] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:23.713033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f8f8e-5404-4f4f-8768-984fc2bf9b62 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.713575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f8f8e-5404-4f4f-8768-984fc2bf9b62 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.714015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f8f8e-5404-4f4f-8768-984fc2bf9b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.719464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1085b1-5ccb-44f7-ab86-01b3da797edc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.741251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f59f8f8e-5404-4f4f-8768-984fc2bf9b62 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:23.743437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f59f8f8e-5404-4f4f-8768-984fc2bf9b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:23.755365 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1892/3756] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:23.756629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f8f8e-5404-4f4f-8768-984fc2bf9b62 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.758772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f59f8f8e-5404-4f4f-8768-984fc2bf9b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:23.767588 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1865/3757] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:57:23 2022] POST /identity/v3/users => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:23.769640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2715b-09b2-4d02-bf4c-e2f877089b53 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.769951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2715b-09b2-4d02-bf4c-e2f877089b53 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.771027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2715b-09b2-4d02-bf4c-e2f877089b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.785435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f8f8e-5404-4f4f-8768-984fc2bf9b62 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.795193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-87f2715b-09b2-4d02-bf4c-e2f877089b53 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:23.796838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-87f2715b-09b2-4d02-bf4c-e2f877089b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:23.802495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433e185-af1d-4e41-b77b-26415d079138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.803873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433e185-af1d-4e41-b77b-26415d079138 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.805326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433e185-af1d-4e41-b77b-26415d079138 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.805837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433e185-af1d-4e41-b77b-26415d079138 admin admin] PATH_INFO: `/v3/projects/c6702eaac3714fd6aaeafeb1dddfc749/users/e0a55d0611954871ac316bcc4381d031/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.810335 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1866/3758] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:23.813392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2715b-09b2-4d02-bf4c-e2f877089b53 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.834069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2715b-09b2-4d02-bf4c-e2f877089b53 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.839654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433e185-af1d-4e41-b77b-26415d079138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6702eaac3714fd6aaeafeb1dddfc749, user_id=e0a55d0611954871ac316bcc4381d031, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:23.844567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c433e185-af1d-4e41-b77b-26415d079138 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.847721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f353-db03-4880-ada2-e45b481e9422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.848520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f353-db03-4880-ada2-e45b481e9422 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.848870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f353-db03-4880-ada2-e45b481e9422 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.849090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4f353-db03-4880-ada2-e45b481e9422 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:23.853214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4f353-db03-4880-ada2-e45b481e9422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:23.856198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4f353-db03-4880-ada2-e45b481e9422 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:23.874304 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1867/3759] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:23.875505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f353-db03-4880-ada2-e45b481e9422 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.885518 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1893/3760] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:23 2022] PUT /identity/v3/projects/c6702eaac3714fd6aaeafeb1dddfc749/users/e0a55d0611954871ac316bcc4381d031/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:23.886815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433e185-af1d-4e41-b77b-26415d079138 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:23.899277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4f353-db03-4880-ada2-e45b481e9422 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.983346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433e185-af1d-4e41-b77b-26415d079138 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:23.989602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e279891-0a1d-4667-b36f-10536780b9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:23.991036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e279891-0a1d-4667-b36f-10536780b9da admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:23.992586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e279891-0a1d-4667-b36f-10536780b9da admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:23.992981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e279891-0a1d-4667-b36f-10536780b9da admin admin] PATH_INFO: `/v3/projects/e9f58e9e5d09409298ca6e30634d9bca/users/35f9a468e300487d9df4d7273e97c8a1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.015885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e279891-0a1d-4667-b36f-10536780b9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f58e9e5d09409298ca6e30634d9bca, user_id=35f9a468e300487d9df4d7273e97c8a1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:24.017100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4aea5-3610-4bf0-955c-44b8f5ee1ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:24.024004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4aea5-3610-4bf0-955c-44b8f5ee1ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.024004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4aea5-3610-4bf0-955c-44b8f5ee1ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.024004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4aea5-3610-4bf0-955c-44b8f5ee1ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.024004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4aea5-3610-4bf0-955c-44b8f5ee1ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:57:24.024004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4aea5-3610-4bf0-955c-44b8f5ee1ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:24.024593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e279891-0a1d-4667-b36f-10536780b9da admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:24.024699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e4aea5-3610-4bf0-955c-44b8f5ee1ed1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:24.039210 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1868/3761] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:57:24.039210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d90a5-1348-4684-a300-e72a4462c86f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.039210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d90a5-1348-4684-a300-e72a4462c86f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.039210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d90a5-1348-4684-a300-e72a4462c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.052181 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1894/3762] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:23 2022] PUT /identity/v3/projects/e9f58e9e5d09409298ca6e30634d9bca/users/35f9a468e300487d9df4d7273e97c8a1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:24.059163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e279891-0a1d-4667-b36f-10536780b9da admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:24.117994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9a5d90a5-1348-4684-a300-e72a4462c86f None None] MFA Rules not processed for user `e0a55d0611954871ac316bcc4381d031`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:24.129132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9a5d90a5-1348-4684-a300-e72a4462c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:24.200093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e279891-0a1d-4667-b36f-10536780b9da admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:24.211890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539dff87-bca6-4c84-a3df-23c2bd1ca652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:24.212675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dff87-bca6-4c84-a3df-23c2bd1ca652 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.213070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dff87-bca6-4c84-a3df-23c2bd1ca652 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.213453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539dff87-bca6-4c84-a3df-23c2bd1ca652 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.214272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dff87-bca6-4c84-a3df-23c2bd1ca652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:24.216495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539dff87-bca6-4c84-a3df-23c2bd1ca652 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:24.235786 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1869/3763] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:24.237069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d90a5-1348-4684-a300-e72a4462c86f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:24.263662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d90a5-1348-4684-a300-e72a4462c86f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:24.271769 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1895/3764] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:57:24 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:24.273391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734ddcc-fced-4b33-ba87-64f17238d8cb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.274070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734ddcc-fced-4b33-ba87-64f17238d8cb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.274505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734ddcc-fced-4b33-ba87-64f17238d8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.312472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3734ddcc-fced-4b33-ba87-64f17238d8cb None None] MFA Rules not processed for user `e0a55d0611954871ac316bcc4381d031`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:24.313792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3734ddcc-fced-4b33-ba87-64f17238d8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:24.384120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67c06a-88f5-4eea-af6e-f83449ab8382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:24.384620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67c06a-88f5-4eea-af6e-f83449ab8382 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.384906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67c06a-88f5-4eea-af6e-f83449ab8382 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.385195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67c06a-88f5-4eea-af6e-f83449ab8382 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.385929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67c06a-88f5-4eea-af6e-f83449ab8382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:24.390011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67c06a-88f5-4eea-af6e-f83449ab8382 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:24.400360 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1870/3765] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:24.404543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67c06a-88f5-4eea-af6e-f83449ab8382 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:24.420269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67c06a-88f5-4eea-af6e-f83449ab8382 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:24.434224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5c17a-d688-4dfa-9cd6-9ee6f591a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:24.435078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5c17a-d688-4dfa-9cd6-9ee6f591a04e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.435395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5c17a-d688-4dfa-9cd6-9ee6f591a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.435395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5c17a-d688-4dfa-9cd6-9ee6f591a04e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.436285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5c17a-d688-4dfa-9cd6-9ee6f591a04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:24.438089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5c17a-d688-4dfa-9cd6-9ee6f591a04e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:24.441484 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1896/3766] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:24.443137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734ddcc-fced-4b33-ba87-64f17238d8cb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:24.463760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734ddcc-fced-4b33-ba87-64f17238d8cb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:24.470603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7001a-fd9a-4c2a-82b8-53dfce6cec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:24.471872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7001a-fd9a-4c2a-82b8-53dfce6cec2d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.471872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7001a-fd9a-4c2a-82b8-53dfce6cec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.472286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7001a-fd9a-4c2a-82b8-53dfce6cec2d admin admin] PATH_INFO: `/v3/projects/e9f58e9e5d09409298ca6e30634d9bca/users/35f9a468e300487d9df4d7273e97c8a1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.475069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7001a-fd9a-4c2a-82b8-53dfce6cec2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f58e9e5d09409298ca6e30634d9bca, user_id=35f9a468e300487d9df4d7273e97c8a1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:24.480006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7001a-fd9a-4c2a-82b8-53dfce6cec2d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:24.506228 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1897/3767] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:24 2022] PUT /identity/v3/projects/e9f58e9e5d09409298ca6e30634d9bca/users/35f9a468e300487d9df4d7273e97c8a1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:24.507043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7001a-fd9a-4c2a-82b8-53dfce6cec2d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:24.512716 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1871/3768] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:57:24 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:24.513820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3cb7001a-fd9a-4c2a-82b8-53dfce6cec2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:24.518291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae803d-1b8b-4da0-8db1-8869a944ab6e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.521305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae803d-1b8b-4da0-8db1-8869a944ab6e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.521677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae803d-1b8b-4da0-8db1-8869a944ab6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.582567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-66ae803d-1b8b-4da0-8db1-8869a944ab6e None None] MFA Rules not processed for user `35f9a468e300487d9df4d7273e97c8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:24.584341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-66ae803d-1b8b-4da0-8db1-8869a944ab6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:24.702418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7001a-fd9a-4c2a-82b8-53dfce6cec2d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:24.717588 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1872/3769] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:24.717588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae803d-1b8b-4da0-8db1-8869a944ab6e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:24.718146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fd7fa-6cb1-4f71-af02-46cb7019f285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:24.718921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fd7fa-6cb1-4f71-af02-46cb7019f285 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.719309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fd7fa-6cb1-4f71-af02-46cb7019f285 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.719797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fd7fa-6cb1-4f71-af02-46cb7019f285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.847005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301fd7fa-6cb1-4f71-af02-46cb7019f285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:24.849922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae803d-1b8b-4da0-8db1-8869a944ab6e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:24.853108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301fd7fa-6cb1-4f71-af02-46cb7019f285 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:24.857755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543999c-abff-4bd1-b96b-ee48614a9cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:24.858460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543999c-abff-4bd1-b96b-ee48614a9cea admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.858803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543999c-abff-4bd1-b96b-ee48614a9cea admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.858996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543999c-abff-4bd1-b96b-ee48614a9cea admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.860187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543999c-abff-4bd1-b96b-ee48614a9cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:24.867883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543999c-abff-4bd1-b96b-ee48614a9cea admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:24.879624 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1898/3770] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:24.880869 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1873/3771] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:24.885732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543999c-abff-4bd1-b96b-ee48614a9cea admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:24.888729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fd7fa-6cb1-4f71-af02-46cb7019f285 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:24.895584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-301fd7fa-6cb1-4f71-af02-46cb7019f285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:24.901982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543999c-abff-4bd1-b96b-ee48614a9cea admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:24.908667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2674413-7b37-4e14-86fc-6d5e5f41acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:24.909707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2674413-7b37-4e14-86fc-6d5e5f41acbc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.910262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2674413-7b37-4e14-86fc-6d5e5f41acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.910785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2674413-7b37-4e14-86fc-6d5e5f41acbc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:24.911809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2674413-7b37-4e14-86fc-6d5e5f41acbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:24.913794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2674413-7b37-4e14-86fc-6d5e5f41acbc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:24.928136 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1874/3772] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:24.939756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2674413-7b37-4e14-86fc-6d5e5f41acbc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:24.973765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2674413-7b37-4e14-86fc-6d5e5f41acbc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:24.987483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02334e3d-e485-4d42-b389-68441db310a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:24.988806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02334e3d-e485-4d42-b389-68441db310a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:24.989381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02334e3d-e485-4d42-b389-68441db310a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:24.998756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02334e3d-e485-4d42-b389-68441db310a3 admin admin] PATH_INFO: `/v3/projects/4711951c1994477aabaf5a8a585fe537/users/0e8a51bcbc574c758595a30ba9e885df/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:25.042338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02334e3d-e485-4d42-b389-68441db310a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4711951c1994477aabaf5a8a585fe537, user_id=0e8a51bcbc574c758595a30ba9e885df, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:25.046877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fd7fa-6cb1-4f71-af02-46cb7019f285 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:25.049610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02334e3d-e485-4d42-b389-68441db310a3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:25.057275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a9c5e-c86d-4aae-8e3e-2a051688bae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:25.058884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9c5e-c86d-4aae-8e3e-2a051688bae7 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:25.059375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9c5e-c86d-4aae-8e3e-2a051688bae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:25.059869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a9c5e-c86d-4aae-8e3e-2a051688bae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:25.079870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1875/3773] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:24 2022] PUT /identity/v3/projects/4711951c1994477aabaf5a8a585fe537/users/0e8a51bcbc574c758595a30ba9e885df/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:25.086610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9c5e-c86d-4aae-8e3e-2a051688bae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:25.088494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a9c5e-c86d-4aae-8e3e-2a051688bae7 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:25.090183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0696fe-4969-4263-a6cd-e18e8e951316 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:25.090549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0696fe-4969-4263-a6cd-e18e8e951316 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:25.091033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0696fe-4969-4263-a6cd-e18e8e951316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:25.122937 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1899/3774] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:25.154015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ba0696fe-4969-4263-a6cd-e18e8e951316 None None] MFA Rules not processed for user `0e8a51bcbc574c758595a30ba9e885df`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:25.158991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba0696fe-4969-4263-a6cd-e18e8e951316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:25.362813 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1876/3775] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:57:25.377861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad56f0-6c34-4daf-a1af-90cb373dc1ac None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:25.378515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad56f0-6c34-4daf-a1af-90cb373dc1ac None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:25.379016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad56f0-6c34-4daf-a1af-90cb373dc1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:25.607776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d8ad56f0-6c34-4daf-a1af-90cb373dc1ac None None] MFA Rules not processed for user `0e8a51bcbc574c758595a30ba9e885df`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:25.610194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d8ad56f0-6c34-4daf-a1af-90cb373dc1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:25.622649 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1900/3776] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:26.809082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0696fe-4969-4263-a6cd-e18e8e951316 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:26.810703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba0696fe-4969-4263-a6cd-e18e8e951316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:26.962170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0696fe-4969-4263-a6cd-e18e8e951316 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:26.968830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e5788-96f8-4d34-a993-9d48be015b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:26.969647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e5788-96f8-4d34-a993-9d48be015b21 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:26.970192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e5788-96f8-4d34-a993-9d48be015b21 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:26.971214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e5788-96f8-4d34-a993-9d48be015b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:26.982316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e5788-96f8-4d34-a993-9d48be015b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:26.984093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e5788-96f8-4d34-a993-9d48be015b21 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:26.997899 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1877/3777] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:27.995966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6fa1-e393-414f-8876-b2b01a543744 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:27.996524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6fa1-e393-414f-8876-b2b01a543744 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:27.996732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a6fa1-e393-414f-8876-b2b01a543744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:28.039330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-de5a6fa1-e393-414f-8876-b2b01a543744 None None] MFA Rules not processed for user `4c8199b3248742a7ba0d0cb6570c7058`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:28.040690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-de5a6fa1-e393-414f-8876-b2b01a543744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:28.202657 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1901/3778] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:30.780802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e5788-96f8-4d34-a993-9d48be015b21 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:30.783236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d75e5788-96f8-4d34-a993-9d48be015b21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:30.934560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e5788-96f8-4d34-a993-9d48be015b21 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:30.940045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:30.941204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:30.941700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:30.942145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] PATH_INFO: `/v3/users/3c658c4a7b9c4d7886127c3e40f359f7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:30.943576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c658c4a7b9c4d7886127c3e40f359f7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:30.946583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:31.030810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c658c4a7b9c4d7886127c3e40f359f7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:31.041875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c658c4a7b9c4d7886127c3e40f359f7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:31.043144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c658c4a7b9c4d7886127c3e40f359f7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:31.045414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c658c4a7b9c4d7886127c3e40f359f7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:31.081329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6094a0f7-f78f-442c-b0b1-a4dd70e21b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c658c4a7b9c4d7886127c3e40f359f7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:31.106642 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1878/3779] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:30 2022] DELETE /identity/v3/users/3c658c4a7b9c4d7886127c3e40f359f7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:32.305605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6fa1-e393-414f-8876-b2b01a543744 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:32.321130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a6fa1-e393-414f-8876-b2b01a543744 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:32.436396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:32.438402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:32.440077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:32.440554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] PATH_INFO: `/v3/projects/a6beb485658f40dc83598fd2e00800ad` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:32.450939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6beb485658f40dc83598fd2e00800ad)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:32.453428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:32.548595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6beb485658f40dc83598fd2e00800ad', 'request_id': 'req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:32.561824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6beb485658f40dc83598fd2e00800ad', 'request_id': 'req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:32.571174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6beb485658f40dc83598fd2e00800ad', 'request_id': 'req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:32.593247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] The token cache is being invalidate because project a6beb485658f40dc83598fd2e00800ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:32.593526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:32.596552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-973de873-40ad-4c4d-bd0f-65bb43d6e8ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:32.602028 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1902/3780] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:32 2022] DELETE /identity/v3/projects/a6beb485658f40dc83598fd2e00800ad => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:32.603334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50d191-2595-4fba-b2be-47f7d15763c4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:32.603809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50d191-2595-4fba-b2be-47f7d15763c4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:32.603901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50d191-2595-4fba-b2be-47f7d15763c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:32.641294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-df50d191-2595-4fba-b2be-47f7d15763c4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:32.642608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-df50d191-2595-4fba-b2be-47f7d15763c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:32.780044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1879/3781] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:57:32.787993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606d1f-d3fb-490a-9585-357dda2b7326 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:32.788335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606d1f-d3fb-490a-9585-357dda2b7326 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:32.789109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606d1f-d3fb-490a-9585-357dda2b7326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:32.830814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3b606d1f-d3fb-490a-9585-357dda2b7326 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:32.832310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3b606d1f-d3fb-490a-9585-357dda2b7326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:32.854456 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1903/3782] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:32.858630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50d191-2595-4fba-b2be-47f7d15763c4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:32.873142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50d191-2595-4fba-b2be-47f7d15763c4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:32.903003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccfc06-6220-41bb-a86c-2c0600351a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:32.903689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccfc06-6220-41bb-a86c-2c0600351a1e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:32.904037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccfc06-6220-41bb-a86c-2c0600351a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:32.904721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ccfc06-6220-41bb-a86c-2c0600351a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:32.905780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccfc06-6220-41bb-a86c-2c0600351a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:57:32.905780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccfc06-6220-41bb-a86c-2c0600351a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:32.907589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ccfc06-6220-41bb-a86c-2c0600351a1e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:32.930812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1880/3783] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:57:32.932096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606d1f-d3fb-490a-9585-357dda2b7326 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:32.943690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606d1f-d3fb-490a-9585-357dda2b7326 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:32.957470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0907c-0bc9-4a55-9fc6-5dedfc0e71ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:32.958243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0907c-0bc9-4a55-9fc6-5dedfc0e71ed admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:32.958593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0907c-0bc9-4a55-9fc6-5dedfc0e71ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:32.958949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0907c-0bc9-4a55-9fc6-5dedfc0e71ed admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:32.959722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0907c-0bc9-4a55-9fc6-5dedfc0e71ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:32.962166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0907c-0bc9-4a55-9fc6-5dedfc0e71ed admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:33.060809 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1904/3784] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:57:32 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:33.064942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccfc06-6220-41bb-a86c-2c0600351a1e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:33.077135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ccfc06-6220-41bb-a86c-2c0600351a1e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:33.168998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026e71-9272-44b3-a320-ac2606a8b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:33.169589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026e71-9272-44b3-a320-ac2606a8b15b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:33.169874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026e71-9272-44b3-a320-ac2606a8b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:33.170151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03026e71-9272-44b3-a320-ac2606a8b15b admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:33.170864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03026e71-9272-44b3-a320-ac2606a8b15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:33.172918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03026e71-9272-44b3-a320-ac2606a8b15b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:33.202011 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1881/3785] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:57:33 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:57:33.205748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0907c-0bc9-4a55-9fc6-5dedfc0e71ed admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:33.218108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0907c-0bc9-4a55-9fc6-5dedfc0e71ed admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:33.230958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4bbc-456a-424e-ac8c-a584b603c0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:33.231091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4bbc-456a-424e-ac8c-a584b603c0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:33.231323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4bbc-456a-424e-ac8c-a584b603c0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:33.231615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4bbc-456a-424e-ac8c-a584b603c0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:33.236759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4bbc-456a-424e-ac8c-a584b603c0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:33.240889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4bbc-456a-424e-ac8c-a584b603c0c6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:33.293428 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1905/3786] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:33.298336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026e71-9272-44b3-a320-ac2606a8b15b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:33.313026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03026e71-9272-44b3-a320-ac2606a8b15b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:33.326986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd8450-d03b-48e6-bc79-1ca89b9c4ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:33.328205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd8450-d03b-48e6-bc79-1ca89b9c4ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:33.328495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd8450-d03b-48e6-bc79-1ca89b9c4ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:33.328770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd8450-d03b-48e6-bc79-1ca89b9c4ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:33.329507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd8450-d03b-48e6-bc79-1ca89b9c4ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:33.342261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd8450-d03b-48e6-bc79-1ca89b9c4ef8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:33.383828 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1882/3787] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:33.385516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4bbc-456a-424e-ac8c-a584b603c0c6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:33.403183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4bbc-456a-424e-ac8c-a584b603c0c6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:33.415867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08df83-30b6-430a-8cd5-40ceb213b5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:33.416826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08df83-30b6-430a-8cd5-40ceb213b5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:33.417106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08df83-30b6-430a-8cd5-40ceb213b5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:33.417372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08df83-30b6-430a-8cd5-40ceb213b5f6 admin admin] PATH_INFO: `/v3/projects/a7e64b94cc37456185389445ddc56877/users/32e2a79f7ce548d5b39cd657ac6d578a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:33.475936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08df83-30b6-430a-8cd5-40ceb213b5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e64b94cc37456185389445ddc56877, user_id=32e2a79f7ce548d5b39cd657ac6d578a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:33.482199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c08df83-30b6-430a-8cd5-40ceb213b5f6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:33.517530 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1906/3788] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:33 2022] PUT /identity/v3/projects/a7e64b94cc37456185389445ddc56877/users/32e2a79f7ce548d5b39cd657ac6d578a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:33.521451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e98ba-91fc-4cd9-8fe1-62c826476017 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:33.521831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e98ba-91fc-4cd9-8fe1-62c826476017 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:33.522214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e98ba-91fc-4cd9-8fe1-62c826476017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:33.556209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-be1e98ba-91fc-4cd9-8fe1-62c826476017 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:33.569407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be1e98ba-91fc-4cd9-8fe1-62c826476017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:33.709757 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1883/3789] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:33.760762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08df83-30b6-430a-8cd5-40ceb213b5f6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:33.762610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1c08df83-30b6-430a-8cd5-40ceb213b5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:33.964043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08df83-30b6-430a-8cd5-40ceb213b5f6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:33.981580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b1584-e67f-489e-b2fe-5c413cdd77fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:33.982251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b1584-e67f-489e-b2fe-5c413cdd77fd service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:33.982540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b1584-e67f-489e-b2fe-5c413cdd77fd service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:33.982818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b1584-e67f-489e-b2fe-5c413cdd77fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:34.010293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b1584-e67f-489e-b2fe-5c413cdd77fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:34.011808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b1584-e67f-489e-b2fe-5c413cdd77fd service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:34.041943 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1907/3790] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:34.765105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e98ba-91fc-4cd9-8fe1-62c826476017 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:34.767857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be1e98ba-91fc-4cd9-8fe1-62c826476017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:34.786591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e98ba-91fc-4cd9-8fe1-62c826476017 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:34.802258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:34.803624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:34.804686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:34.807878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] PATH_INFO: `/v3/users/83b54675b1ee4f49a787ff59722d546a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:34.809715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b54675b1ee4f49a787ff59722d546a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:34.811971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:34.965142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b54675b1ee4f49a787ff59722d546a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:34.985043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b54675b1ee4f49a787ff59722d546a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:34.985864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b54675b1ee4f49a787ff59722d546a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:34.986634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b54675b1ee4f49a787ff59722d546a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:35.033044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b54675b1ee4f49a787ff59722d546a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:35.050908 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1884/3791] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:34 2022] DELETE /identity/v3/users/83b54675b1ee4f49a787ff59722d546a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:35.057264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db3127-2e1f-44f4-83d7-d74869b60e44 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:35.058222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db3127-2e1f-44f4-83d7-d74869b60e44 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:35.058759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db3127-2e1f-44f4-83d7-d74869b60e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:35.079333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b0db3127-2e1f-44f4-83d7-d74869b60e44 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:35.080952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b0db3127-2e1f-44f4-83d7-d74869b60e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:35.158998 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1908/3792] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:57:35.188103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:35.190231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:35.360514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd8600-2589-4f74-9d2e-a7aa68827543 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:35.364564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ba41-7fa3-4bfb-b781-fd6709156e0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:35.365281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ba41-7fa3-4bfb-b781-fd6709156e0f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:35.365570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ba41-7fa3-4bfb-b781-fd6709156e0f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:35.365859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1ba41-7fa3-4bfb-b781-fd6709156e0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:35.386102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1ba41-7fa3-4bfb-b781-fd6709156e0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:35.387715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1ba41-7fa3-4bfb-b781-fd6709156e0f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:35.400322 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1885/3793] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:36.301079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db3127-2e1f-44f4-83d7-d74869b60e44 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:36.303542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b0db3127-2e1f-44f4-83d7-d74869b60e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:36.320546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db3127-2e1f-44f4-83d7-d74869b60e44 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:36.339105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:36.340184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:36.340609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:36.341137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] PATH_INFO: `/v3/projects/082627e4643944bc9f4889278b480a7f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:36.353473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082627e4643944bc9f4889278b480a7f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:36.356198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:36.513630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082627e4643944bc9f4889278b480a7f', 'request_id': 'req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:36.537096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082627e4643944bc9f4889278b480a7f', 'request_id': 'req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:36.545513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082627e4643944bc9f4889278b480a7f', 'request_id': 'req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:36.576830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] The token cache is being invalidate because project 082627e4643944bc9f4889278b480a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:36.577598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:36.581534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:36.586510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1909/3794] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:36 2022] DELETE /identity/v3/projects/082627e4643944bc9f4889278b480a7f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:36.590136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ba41-7fa3-4bfb-b781-fd6709156e0f service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:36.605954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1ba41-7fa3-4bfb-b781-fd6709156e0f service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:36.780300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:36.782273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:36.784763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:36.785175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] PATH_INFO: `/v3/users/35f9a468e300487d9df4d7273e97c8a1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:36.793199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f9a468e300487d9df4d7273e97c8a1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:36.804695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:36.926171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f9a468e300487d9df4d7273e97c8a1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:36.947808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f9a468e300487d9df4d7273e97c8a1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:36.949866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f9a468e300487d9df4d7273e97c8a1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:36.952079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f9a468e300487d9df4d7273e97c8a1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:36.985775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b123cef-fe58-4aa4-918c-73015148637b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f9a468e300487d9df4d7273e97c8a1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:37.032538 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1886/3795] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:57:36 2022] DELETE /identity/v3/users/35f9a468e300487d9df4d7273e97c8a1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:37.920070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:37.921968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:37.953607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad93b068-6ed1-4f33-8a1a-1d751fc219a8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:38.108924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:38.110059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:38.110506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:38.110947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] PATH_INFO: `/v3/projects/e9f58e9e5d09409298ca6e30634d9bca` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:38.114436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f58e9e5d09409298ca6e30634d9bca)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:38.116910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:38.217541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f58e9e5d09409298ca6e30634d9bca', 'request_id': 'req-dbfc9212-a733-4f46-9f1e-f2d433373736'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:38.240668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f58e9e5d09409298ca6e30634d9bca', 'request_id': 'req-dbfc9212-a733-4f46-9f1e-f2d433373736'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:38.247796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f58e9e5d09409298ca6e30634d9bca', 'request_id': 'req-dbfc9212-a733-4f46-9f1e-f2d433373736'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:38.276372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] The token cache is being invalidate because project e9f58e9e5d09409298ca6e30634d9bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:57:38.276895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:38.283259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dbfc9212-a733-4f46-9f1e-f2d433373736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:57:38.285167 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1910/3796] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:57:37 2022] DELETE /identity/v3/projects/e9f58e9e5d09409298ca6e30634d9bca => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:38.290679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f587b46-509b-4cd1-a1d5-55446f8cf9c1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:38.291570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f587b46-509b-4cd1-a1d5-55446f8cf9c1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:38.292045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f587b46-509b-4cd1-a1d5-55446f8cf9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:38.336516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3f587b46-509b-4cd1-a1d5-55446f8cf9c1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:38.342013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3f587b46-509b-4cd1-a1d5-55446f8cf9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:38.487473 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1887/3797] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:38.494906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7563-d022-4c00-af67-b1ff6e7fde72 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:38.495189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7563-d022-4c00-af67-b1ff6e7fde72 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:38.495473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d7563-d022-4c00-af67-b1ff6e7fde72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:38.520891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e05d7563-d022-4c00-af67-b1ff6e7fde72 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:38.522126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e05d7563-d022-4c00-af67-b1ff6e7fde72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:38.546742 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1911/3798] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:38.547738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f587b46-509b-4cd1-a1d5-55446f8cf9c1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:38.559080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f587b46-509b-4cd1-a1d5-55446f8cf9c1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:38.573627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182df9f5-66c5-4caf-907e-63f811303f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:38.574900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182df9f5-66c5-4caf-907e-63f811303f69 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:38.575439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182df9f5-66c5-4caf-907e-63f811303f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:38.576250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182df9f5-66c5-4caf-907e-63f811303f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:38.577395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182df9f5-66c5-4caf-907e-63f811303f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:57:38.577966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182df9f5-66c5-4caf-907e-63f811303f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:38.580072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182df9f5-66c5-4caf-907e-63f811303f69 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:38.610273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7563-d022-4c00-af67-b1ff6e7fde72 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:38.610529 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1888/3799] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:57:38.627011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d7563-d022-4c00-af67-b1ff6e7fde72 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:38.635284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bc306-dd36-47a0-9317-f3cdb7def1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:38.636298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bc306-dd36-47a0-9317-f3cdb7def1ac admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:38.637534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bc306-dd36-47a0-9317-f3cdb7def1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:38.637972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bc306-dd36-47a0-9317-f3cdb7def1ac admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:38.638835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bc306-dd36-47a0-9317-f3cdb7def1ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:38.641727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bc306-dd36-47a0-9317-f3cdb7def1ac admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:38.734957 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1912/3800] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:57:38 2022] POST /identity/v3/projects => generated 397 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:57:38.735484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182df9f5-66c5-4caf-907e-63f811303f69 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:38.766449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182df9f5-66c5-4caf-907e-63f811303f69 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:38.916739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2e13-de24-4c9e-bab6-5d69298f5306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:38.917732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2e13-de24-4c9e-bab6-5d69298f5306 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:38.918028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2e13-de24-4c9e-bab6-5d69298f5306 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:38.918887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f2e13-de24-4c9e-bab6-5d69298f5306 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:38.919728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f2e13-de24-4c9e-bab6-5d69298f5306 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:38.923905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f2e13-de24-4c9e-bab6-5d69298f5306 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:38.952309 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1889/3801] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:57:38 2022] POST /identity/v3/users => generated 299 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:57:38.956835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bc306-dd36-47a0-9317-f3cdb7def1ac admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:38.972036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bc306-dd36-47a0-9317-f3cdb7def1ac admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:38.976934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb977a-bb01-43f5-ad0b-afa3df42933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:38.977960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb977a-bb01-43f5-ad0b-afa3df42933a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:38.978466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb977a-bb01-43f5-ad0b-afa3df42933a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:38.981039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb977a-bb01-43f5-ad0b-afa3df42933a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:38.982185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb977a-bb01-43f5-ad0b-afa3df42933a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:38.984083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb977a-bb01-43f5-ad0b-afa3df42933a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:38.996351 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1913/3802] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:39.000335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2e13-de24-4c9e-bab6-5d69298f5306 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:39.014957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f2e13-de24-4c9e-bab6-5d69298f5306 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:39.028270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc583e-74cc-4411-9db3-1e27ef784332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:39.031252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc583e-74cc-4411-9db3-1e27ef784332 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:39.035582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc583e-74cc-4411-9db3-1e27ef784332 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:39.036196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc583e-74cc-4411-9db3-1e27ef784332 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:39.037192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc583e-74cc-4411-9db3-1e27ef784332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:39.038979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc583e-74cc-4411-9db3-1e27ef784332 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:39.071092 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1890/3803] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:57:39.075352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb977a-bb01-43f5-ad0b-afa3df42933a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:39.086440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb977a-bb01-43f5-ad0b-afa3df42933a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:39.108912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ce54-ce34-459f-8815-ee59bd55fd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:39.110396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ce54-ce34-459f-8815-ee59bd55fd4c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:39.112886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ce54-ce34-459f-8815-ee59bd55fd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:39.113567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ce54-ce34-459f-8815-ee59bd55fd4c admin admin] PATH_INFO: `/v3/projects/c4885ef55ed84bc49abc7050962b85f6/users/fc0453ace26e4c81b46b11497ccae85b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:39.147886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ce54-ce34-459f-8815-ee59bd55fd4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4885ef55ed84bc49abc7050962b85f6, user_id=fc0453ace26e4c81b46b11497ccae85b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:39.152135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818ce54-ce34-459f-8815-ee59bd55fd4c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:39.239972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c64c4-ccef-44d8-8b3d-13cca0e0022b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:39.240556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c64c4-ccef-44d8-8b3d-13cca0e0022b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:39.241056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c64c4-ccef-44d8-8b3d-13cca0e0022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:39.264633 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1914/3804] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:57:39 2022] PUT /identity/v3/projects/c4885ef55ed84bc49abc7050962b85f6/users/fc0453ace26e4c81b46b11497ccae85b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:57:39.285685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e88c64c4-ccef-44d8-8b3d-13cca0e0022b None None] MFA Rules not processed for user `fc0453ace26e4c81b46b11497ccae85b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:39.287563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e88c64c4-ccef-44d8-8b3d-13cca0e0022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:39.395648 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1891/3805] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:57:39.431449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ce54-ce34-459f-8815-ee59bd55fd4c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:39.433650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2818ce54-ce34-459f-8815-ee59bd55fd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:39.533499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ce54-ce34-459f-8815-ee59bd55fd4c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:39.541367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26858af4-8e97-4df8-afdd-243f0b22fe27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:39.542448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858af4-8e97-4df8-afdd-243f0b22fe27 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:39.550081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858af4-8e97-4df8-afdd-243f0b22fe27 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:39.550805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26858af4-8e97-4df8-afdd-243f0b22fe27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:39.562051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26858af4-8e97-4df8-afdd-243f0b22fe27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:39.564009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26858af4-8e97-4df8-afdd-243f0b22fe27 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:39.574958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1915/3806] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:45.153467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1c420-d657-4590-92ef-2a46c1e04fdb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:45.154577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1c420-d657-4590-92ef-2a46c1e04fdb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:45.155155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1c420-d657-4590-92ef-2a46c1e04fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:45.192470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c3e1c420-d657-4590-92ef-2a46c1e04fdb None None] MFA Rules not processed for user `75cdd0c73bcc473081b65958a7b1fbe6`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:45.196440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c3e1c420-d657-4590-92ef-2a46c1e04fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:45.334329 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1892/3807] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:46.334533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aff896-8a1f-46b5-8719-5d5d8644bd47 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:46.335667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aff896-8a1f-46b5-8719-5d5d8644bd47 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:46.335667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aff896-8a1f-46b5-8719-5d5d8644bd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:46.372939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b3aff896-8a1f-46b5-8719-5d5d8644bd47 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:46.374882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b3aff896-8a1f-46b5-8719-5d5d8644bd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:46.500102 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1916/3808] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:46.508466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1c420-d657-4590-92ef-2a46c1e04fdb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:46.510624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c3e1c420-d657-4590-92ef-2a46c1e04fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:46.589325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1c420-d657-4590-92ef-2a46c1e04fdb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:46.595031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e9fcc1-6501-42dc-bc1f-48516eeda627 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:46.596192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9fcc1-6501-42dc-bc1f-48516eeda627 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:46.596846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9fcc1-6501-42dc-bc1f-48516eeda627 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:46.597387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9fcc1-6501-42dc-bc1f-48516eeda627 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:46.610002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9fcc1-6501-42dc-bc1f-48516eeda627 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:46.611883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e9fcc1-6501-42dc-bc1f-48516eeda627 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:46.631450 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1893/3809] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:57:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:57:49.224897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e193f0-6886-47aa-9feb-05f025e30db7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:49.225383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e193f0-6886-47aa-9feb-05f025e30db7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:49.225493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e193f0-6886-47aa-9feb-05f025e30db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:49.321054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b3e193f0-6886-47aa-9feb-05f025e30db7 None None] MFA Rules not processed for user `32e2a79f7ce548d5b39cd657ac6d578a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:49.328443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b3e193f0-6886-47aa-9feb-05f025e30db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:49.591898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca41a5-357a-427e-b0aa-4288010dbb69 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:49.592486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca41a5-357a-427e-b0aa-4288010dbb69 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:49.592486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca41a5-357a-427e-b0aa-4288010dbb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:49.592886 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1917/3810] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:49.641420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-99ca41a5-357a-427e-b0aa-4288010dbb69 None None] MFA Rules not processed for user `32e2a79f7ce548d5b39cd657ac6d578a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:49.643877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-99ca41a5-357a-427e-b0aa-4288010dbb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:49.710457 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1894/3811] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:57:50.083651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e193f0-6886-47aa-9feb-05f025e30db7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:57:50.086954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b3e193f0-6886-47aa-9feb-05f025e30db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:50.270976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e193f0-6886-47aa-9feb-05f025e30db7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:57:50.285330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10026d8-29ca-495a-ac8d-1d9afb97265d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:57:50.287629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10026d8-29ca-495a-ac8d-1d9afb97265d service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:50.288939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10026d8-29ca-495a-ac8d-1d9afb97265d service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:50.289461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10026d8-29ca-495a-ac8d-1d9afb97265d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:50.302017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10026d8-29ca-495a-ac8d-1d9afb97265d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:57:50.305369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10026d8-29ca-495a-ac8d-1d9afb97265d service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:57:50.331664 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1918/3812] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:57:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:57:56.760808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8889d0-1550-4fbe-ae55-56d49ed14e27 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:57:56.761921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8889d0-1550-4fbe-ae55-56d49ed14e27 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:57:56.761921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8889d0-1550-4fbe-ae55-56d49ed14e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:57:56.812526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ce8889d0-1550-4fbe-ae55-56d49ed14e27 None None] MFA Rules not processed for user `4c8199b3248742a7ba0d0cb6570c7058`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:57:56.816150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ce8889d0-1550-4fbe-ae55-56d49ed14e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:57:57.024350 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1895/3813] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:57:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:02.817779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10026d8-29ca-495a-ac8d-1d9afb97265d service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:02.820118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a10026d8-29ca-495a-ac8d-1d9afb97265d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:02.946636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10026d8-29ca-495a-ac8d-1d9afb97265d service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:02.960515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:02.961738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:02.963563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:02.964710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] PATH_INFO: `/v3/users/a01a3991559f4738b240874a96dd5ad6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:02.971768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01a3991559f4738b240874a96dd5ad6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:02.974062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:03.081090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01a3991559f4738b240874a96dd5ad6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:03.090740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01a3991559f4738b240874a96dd5ad6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:03.091865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01a3991559f4738b240874a96dd5ad6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:03.092811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01a3991559f4738b240874a96dd5ad6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:03.128222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc139abf-fbdc-4e1a-8157-46decb60486c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01a3991559f4738b240874a96dd5ad6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:03.192768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1919/3814] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:02 2022] DELETE /identity/v3/users/a01a3991559f4738b240874a96dd5ad6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:03.965616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8889d0-1550-4fbe-ae55-56d49ed14e27 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:03.986310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8889d0-1550-4fbe-ae55-56d49ed14e27 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:04.204888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:04.210625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:04.211340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:04.211837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] PATH_INFO: `/v3/projects/7150c612879247208855ce511f95a5a2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:04.215009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7150c612879247208855ce511f95a5a2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:04.220292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:04.359295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7150c612879247208855ce511f95a5a2', 'request_id': 'req-2b1ce8d3-ed74-4327-b065-b2757c7dde63'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:04.375374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7150c612879247208855ce511f95a5a2', 'request_id': 'req-2b1ce8d3-ed74-4327-b065-b2757c7dde63'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:04.388011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7150c612879247208855ce511f95a5a2', 'request_id': 'req-2b1ce8d3-ed74-4327-b065-b2757c7dde63'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:04.420682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] The token cache is being invalidate because project 7150c612879247208855ce511f95a5a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:04.421273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:04.422131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b1ce8d3-ed74-4327-b065-b2757c7dde63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:04.428474 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1896/3815] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:03 2022] DELETE /identity/v3/projects/7150c612879247208855ce511f95a5a2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:04.434280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3731f-e265-45e4-8d33-b0c5a810d04a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:04.434827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3731f-e265-45e4-8d33-b0c5a810d04a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:04.435105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3731f-e265-45e4-8d33-b0c5a810d04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:04.473383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c5d3731f-e265-45e4-8d33-b0c5a810d04a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:04.474906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c5d3731f-e265-45e4-8d33-b0c5a810d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:04.642804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61586a4c-84ca-4392-828f-06732f95d3eb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:04.644660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61586a4c-84ca-4392-828f-06732f95d3eb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:04.645449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61586a4c-84ca-4392-828f-06732f95d3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:04.653341 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1920/3816] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:04.681726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-61586a4c-84ca-4392-828f-06732f95d3eb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:04.683463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-61586a4c-84ca-4392-828f-06732f95d3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:04.696025 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1897/3817] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:58:04.700289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3731f-e265-45e4-8d33-b0c5a810d04a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:04.711010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3731f-e265-45e4-8d33-b0c5a810d04a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:04.716733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cce579-4305-44e1-9da7-8763f1f12ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:04.717797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce579-4305-44e1-9da7-8763f1f12ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:04.718362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce579-4305-44e1-9da7-8763f1f12ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:04.718882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce579-4305-44e1-9da7-8763f1f12ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:04.719845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cce579-4305-44e1-9da7-8763f1f12ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:04.720414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cce579-4305-44e1-9da7-8763f1f12ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:04.722266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cce579-4305-44e1-9da7-8763f1f12ff2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:04.745246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61586a4c-84ca-4392-828f-06732f95d3eb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:04.751855 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1921/3818] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:04.759016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61586a4c-84ca-4392-828f-06732f95d3eb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:04.767177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00cb2-b21b-4420-9a70-9972c9ffb427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:04.768402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00cb2-b21b-4420-9a70-9972c9ffb427 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:04.768979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00cb2-b21b-4420-9a70-9972c9ffb427 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:04.769486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00cb2-b21b-4420-9a70-9972c9ffb427 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:04.770567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00cb2-b21b-4420-9a70-9972c9ffb427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:04.773342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00cb2-b21b-4420-9a70-9972c9ffb427 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:04.818856 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1898/3819] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:04 2022] POST /identity/v3/projects => generated 393 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:58:04.824193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cce579-4305-44e1-9da7-8763f1f12ff2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:04.846548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cce579-4305-44e1-9da7-8763f1f12ff2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:04.936184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbb24d-1741-44b9-b26d-9fedf091ddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:04.937214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbb24d-1741-44b9-b26d-9fedf091ddab admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:04.937745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbb24d-1741-44b9-b26d-9fedf091ddab admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:04.938384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbb24d-1741-44b9-b26d-9fedf091ddab admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:04.939244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbb24d-1741-44b9-b26d-9fedf091ddab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:04.941687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbb24d-1741-44b9-b26d-9fedf091ddab admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:05.064584 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1922/3820] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:04 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:05.069359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00cb2-b21b-4420-9a70-9972c9ffb427 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:05.086760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00cb2-b21b-4420-9a70-9972c9ffb427 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:05.102713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c302d5-b034-416e-b152-877f1bd63a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:05.103946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c302d5-b034-416e-b152-877f1bd63a1f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:05.105115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c302d5-b034-416e-b152-877f1bd63a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:05.105518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c302d5-b034-416e-b152-877f1bd63a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:05.106363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c302d5-b034-416e-b152-877f1bd63a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:05.108187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c302d5-b034-416e-b152-877f1bd63a1f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:05.134228 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1899/3821] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:58:05.138548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbb24d-1741-44b9-b26d-9fedf091ddab admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:05.148879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbb24d-1741-44b9-b26d-9fedf091ddab admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:05.154569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a652545-d906-47a5-86fa-f9df5bc9b265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:05.154569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a652545-d906-47a5-86fa-f9df5bc9b265 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:05.155032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a652545-d906-47a5-86fa-f9df5bc9b265 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:05.155458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a652545-d906-47a5-86fa-f9df5bc9b265 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:05.156355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a652545-d906-47a5-86fa-f9df5bc9b265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:05.158628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a652545-d906-47a5-86fa-f9df5bc9b265 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:05.182887 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1923/3822] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:05.187615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c302d5-b034-416e-b152-877f1bd63a1f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:05.201424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c302d5-b034-416e-b152-877f1bd63a1f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:05.212698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8254a-9fcc-4eb5-bc45-d780e8b7ebd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:05.213593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8254a-9fcc-4eb5-bc45-d780e8b7ebd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:05.224572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8254a-9fcc-4eb5-bc45-d780e8b7ebd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:05.225134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d8254a-9fcc-4eb5-bc45-d780e8b7ebd7 admin admin] PATH_INFO: `/v3/projects/65f7ec66e7814012b1b00e5c23d35d64/users/088c5fc79dee48df8bb9490edc1224a8/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:05.246077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8254a-9fcc-4eb5-bc45-d780e8b7ebd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f7ec66e7814012b1b00e5c23d35d64, user_id=088c5fc79dee48df8bb9490edc1224a8, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:05.249387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d8254a-9fcc-4eb5-bc45-d780e8b7ebd7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:05.267305 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1900/3823] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:05 2022] PUT /identity/v3/projects/65f7ec66e7814012b1b00e5c23d35d64/users/088c5fc79dee48df8bb9490edc1224a8/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:58:05.279049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17686624-d1b1-41a1-a461-a5fd7d437241 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:05.279334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17686624-d1b1-41a1-a461-a5fd7d437241 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:05.280085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17686624-d1b1-41a1-a461-a5fd7d437241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:05.333856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-17686624-d1b1-41a1-a461-a5fd7d437241 None None] MFA Rules not processed for user `088c5fc79dee48df8bb9490edc1224a8`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:05.335645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-17686624-d1b1-41a1-a461-a5fd7d437241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:05.480381 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1924/3824] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:06.930097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8254a-9fcc-4eb5-bc45-d780e8b7ebd7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:06.932710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e5d8254a-9fcc-4eb5-bc45-d780e8b7ebd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:07.070044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d8254a-9fcc-4eb5-bc45-d780e8b7ebd7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:07.076818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b544-af6d-4b95-bc75-ab6d9a8c5dcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:07.077576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b544-af6d-4b95-bc75-ab6d9a8c5dcc service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:07.077930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b544-af6d-4b95-bc75-ab6d9a8c5dcc service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:07.078219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b544-af6d-4b95-bc75-ab6d9a8c5dcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:07.088581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b544-af6d-4b95-bc75-ab6d9a8c5dcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:07.090928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b544-af6d-4b95-bc75-ab6d9a8c5dcc service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:07.104370 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1901/3825] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:58:07.870444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17686624-d1b1-41a1-a461-a5fd7d437241 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:07.973906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17686624-d1b1-41a1-a461-a5fd7d437241 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:07.979192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:07.981634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:07.982182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:07.982696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] PATH_INFO: `/v3/users/088c5fc79dee48df8bb9490edc1224a8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:07.984229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=088c5fc79dee48df8bb9490edc1224a8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:07.986420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:08.179170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '088c5fc79dee48df8bb9490edc1224a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.205150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '088c5fc79dee48df8bb9490edc1224a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.207526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '088c5fc79dee48df8bb9490edc1224a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.214117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '088c5fc79dee48df8bb9490edc1224a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.227303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '088c5fc79dee48df8bb9490edc1224a8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.278559 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1925/3826] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:07 2022] DELETE /identity/v3/users/088c5fc79dee48df8bb9490edc1224a8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:08.283238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6d38-6041-4b5c-9964-e079f5a01199 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:08.284342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6d38-6041-4b5c-9964-e079f5a01199 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:08.285321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6d38-6041-4b5c-9964-e079f5a01199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:08.328997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-dacf6d38-6041-4b5c-9964-e079f5a01199 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:08.330781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dacf6d38-6041-4b5c-9964-e079f5a01199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:08.451271 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1902/3827] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:58:08.462652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:08.464670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:08.557728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ffc8a-3319-4720-9c4b-bc4d2c2558f2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:08.561557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edcc5b-2e36-42ef-957c-7d625132a93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:08.562199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edcc5b-2e36-42ef-957c-7d625132a93e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:08.562476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edcc5b-2e36-42ef-957c-7d625132a93e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:08.562751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edcc5b-2e36-42ef-957c-7d625132a93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:08.579221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edcc5b-2e36-42ef-957c-7d625132a93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:08.581354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60edcc5b-2e36-42ef-957c-7d625132a93e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:08.596931 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1926/3828] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:08.612656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6d38-6041-4b5c-9964-e079f5a01199 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:08.614155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dacf6d38-6041-4b5c-9964-e079f5a01199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:08.654138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6d38-6041-4b5c-9964-e079f5a01199 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:08.676747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:08.677657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:08.677937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:08.678210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] PATH_INFO: `/v3/users/0e8a51bcbc574c758595a30ba9e885df` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:08.682974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8a51bcbc574c758595a30ba9e885df)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:08.684989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:08.812617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8a51bcbc574c758595a30ba9e885df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.827286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edcc5b-2e36-42ef-957c-7d625132a93e service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:08.829118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-60edcc5b-2e36-42ef-957c-7d625132a93e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:08.833162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8a51bcbc574c758595a30ba9e885df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.834431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8a51bcbc574c758595a30ba9e885df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.835412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8a51bcbc574c758595a30ba9e885df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.855633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2595e1fc-5849-4831-9c3b-82674cd4c77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8a51bcbc574c758595a30ba9e885df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.856331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edcc5b-2e36-42ef-957c-7d625132a93e service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:08.869853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:08.871963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:08.872557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:08.872690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] PATH_INFO: `/v3/users/e0a55d0611954871ac316bcc4381d031` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:08.875672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a55d0611954871ac316bcc4381d031)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:08.878769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:08.891186 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1903/3829] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:08 2022] DELETE /identity/v3/users/0e8a51bcbc574c758595a30ba9e885df => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:08.892802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ef12-87e6-4f18-94b6-b0e7455c12b4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:08.893094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ef12-87e6-4f18-94b6-b0e7455c12b4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:08.893372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91ef12-87e6-4f18-94b6-b0e7455c12b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:08.932636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5b91ef12-87e6-4f18-94b6-b0e7455c12b4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:08.933884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5b91ef12-87e6-4f18-94b6-b0e7455c12b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:08.963472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a55d0611954871ac316bcc4381d031'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.971427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a55d0611954871ac316bcc4381d031'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.972658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a55d0611954871ac316bcc4381d031'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.973672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a55d0611954871ac316bcc4381d031'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:08.990612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c5d6f26-7c23-4c93-a459-44e9a5912261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a55d0611954871ac316bcc4381d031'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:09.035882 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1927/3830] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:08 2022] DELETE /identity/v3/users/e0a55d0611954871ac316bcc4381d031 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:09.042200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c362a-151a-4b27-82c6-50d86f6ef1fd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:09.042679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c362a-151a-4b27-82c6-50d86f6ef1fd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:09.046764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c362a-151a-4b27-82c6-50d86f6ef1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:09.086061 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1904/3831] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:09.092209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-481c362a-151a-4b27-82c6-50d86f6ef1fd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:09.093681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-481c362a-151a-4b27-82c6-50d86f6ef1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:09.102898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91ef12-87e6-4f18-94b6-b0e7455c12b4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:09.109592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5b91ef12-87e6-4f18-94b6-b0e7455c12b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:09.258380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91ef12-87e6-4f18-94b6-b0e7455c12b4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:09.300707 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1928/3832] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:09.307313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c362a-151a-4b27-82c6-50d86f6ef1fd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:09.355746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47e403-b66e-4b2f-a130-500308b054dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:09.357570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47e403-b66e-4b2f-a130-500308b054dc service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:09.358239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47e403-b66e-4b2f-a130-500308b054dc service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:09.358728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47e403-b66e-4b2f-a130-500308b054dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:09.377284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47e403-b66e-4b2f-a130-500308b054dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:09.379112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b47e403-b66e-4b2f-a130-500308b054dc service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:09.393516 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1905/3833] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:58:09.405055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c362a-151a-4b27-82c6-50d86f6ef1fd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:09.415419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b386688-83ab-4f2b-b44d-6c056b9677eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:09.416608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b386688-83ab-4f2b-b44d-6c056b9677eb service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:09.417070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b386688-83ab-4f2b-b44d-6c056b9677eb service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:09.417700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b386688-83ab-4f2b-b44d-6c056b9677eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:09.432869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b386688-83ab-4f2b-b44d-6c056b9677eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:09.434785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b386688-83ab-4f2b-b44d-6c056b9677eb service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:09.447960 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1929/3834] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:09.930515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47e403-b66e-4b2f-a130-500308b054dc service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:09.932027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5b47e403-b66e-4b2f-a130-500308b054dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:09.958291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47e403-b66e-4b2f-a130-500308b054dc service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:09.971303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:09.974131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:09.974527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:09.975734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] PATH_INFO: `/v3/projects/c6702eaac3714fd6aaeafeb1dddfc749` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:09.979714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6702eaac3714fd6aaeafeb1dddfc749)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:09.985717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:10.009837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b386688-83ab-4f2b-b44d-6c056b9677eb service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:10.012500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6b386688-83ab-4f2b-b44d-6c056b9677eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:10.044066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b386688-83ab-4f2b-b44d-6c056b9677eb service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:10.056331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:10.061421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.062645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.063165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] PATH_INFO: `/v3/projects/65f7ec66e7814012b1b00e5c23d35d64` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.082493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f7ec66e7814012b1b00e5c23d35d64)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:10.086957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:10.154853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6702eaac3714fd6aaeafeb1dddfc749', 'request_id': 'req-febe447a-4deb-4a79-8e69-04f2c8dd6b73'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.172118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6702eaac3714fd6aaeafeb1dddfc749', 'request_id': 'req-febe447a-4deb-4a79-8e69-04f2c8dd6b73'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.182467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f7ec66e7814012b1b00e5c23d35d64', 'request_id': 'req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.186588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6702eaac3714fd6aaeafeb1dddfc749', 'request_id': 'req-febe447a-4deb-4a79-8e69-04f2c8dd6b73'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.200230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f7ec66e7814012b1b00e5c23d35d64', 'request_id': 'req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.212373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f7ec66e7814012b1b00e5c23d35d64', 'request_id': 'req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.213308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] The token cache is being invalidate because project c6702eaac3714fd6aaeafeb1dddfc749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:10.213613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.215890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-febe447a-4deb-4a79-8e69-04f2c8dd6b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.223252 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1906/3835] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:09 2022] DELETE /identity/v3/projects/c6702eaac3714fd6aaeafeb1dddfc749 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:10.227002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5017a2d-a858-488f-8d1b-2ffe386187fa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.227002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5017a2d-a858-488f-8d1b-2ffe386187fa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.240235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5017a2d-a858-488f-8d1b-2ffe386187fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.267567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] The token cache is being invalidate because project 65f7ec66e7814012b1b00e5c23d35d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:10.267846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.269398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9d8c009f-8009-42c5-a3a7-a25e3ddb6937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.280235 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1930/3836] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:10 2022] DELETE /identity/v3/projects/65f7ec66e7814012b1b00e5c23d35d64 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:10.281696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13669f-2668-4a06-afa4-05c89a5bef4c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.281991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13669f-2668-4a06-afa4-05c89a5bef4c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.282371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13669f-2668-4a06-afa4-05c89a5bef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.306491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d5017a2d-a858-488f-8d1b-2ffe386187fa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:10.312113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d5017a2d-a858-488f-8d1b-2ffe386187fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:10.328879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ef13669f-2668-4a06-afa4-05c89a5bef4c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:10.330171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ef13669f-2668-4a06-afa4-05c89a5bef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:10.420920 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1931/3837] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:10.422339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13669f-2668-4a06-afa4-05c89a5bef4c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:10.424299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ef13669f-2668-4a06-afa4-05c89a5bef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:10.442496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13669f-2668-4a06-afa4-05c89a5bef4c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:10.449340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:10.450559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.450948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.451549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] PATH_INFO: `/v3/projects/4711951c1994477aabaf5a8a585fe537` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.453628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4711951c1994477aabaf5a8a585fe537)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:10.455590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:10.473839 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1907/3838] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:10.479820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbfee4-8022-4995-88c3-c9e22c492e9a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.480434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbfee4-8022-4995-88c3-c9e22c492e9a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.480913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbfee4-8022-4995-88c3-c9e22c492e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.540538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-acbbfee4-8022-4995-88c3-c9e22c492e9a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:10.543771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-acbbfee4-8022-4995-88c3-c9e22c492e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:10.565425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4711951c1994477aabaf5a8a585fe537', 'request_id': 'req-befa5687-8e40-4f15-854a-449db88c4ba3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.581078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4711951c1994477aabaf5a8a585fe537', 'request_id': 'req-befa5687-8e40-4f15-854a-449db88c4ba3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.601980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4711951c1994477aabaf5a8a585fe537', 'request_id': 'req-befa5687-8e40-4f15-854a-449db88c4ba3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.628628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] The token cache is being invalidate because project 4711951c1994477aabaf5a8a585fe537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:10.628952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.629711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-befa5687-8e40-4f15-854a-449db88c4ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:10.636328 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1932/3839] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:10 2022] DELETE /identity/v3/projects/4711951c1994477aabaf5a8a585fe537 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:10.637764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798053c4-63cd-4d38-9eae-eb6a6ec7e726 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.638582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798053c4-63cd-4d38-9eae-eb6a6ec7e726 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.638582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798053c4-63cd-4d38-9eae-eb6a6ec7e726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.677156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-798053c4-63cd-4d38-9eae-eb6a6ec7e726 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:10.682162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-798053c4-63cd-4d38-9eae-eb6a6ec7e726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:10.690612 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1908/3840] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:10.692522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeea6a-89fd-4628-80b3-3ac84a88afa5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.692923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeea6a-89fd-4628-80b3-3ac84a88afa5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.693301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeea6a-89fd-4628-80b3-3ac84a88afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.705096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1933/3841] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:10.705958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798053c4-63cd-4d38-9eae-eb6a6ec7e726 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:10.715814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8eeeea6a-89fd-4628-80b3-3ac84a88afa5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:10.718201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8eeeea6a-89fd-4628-80b3-3ac84a88afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:10.728724 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1909/3842] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:10.729983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeea6a-89fd-4628-80b3-3ac84a88afa5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:10.732942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798053c4-63cd-4d38-9eae-eb6a6ec7e726 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:10.742540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeea6a-89fd-4628-80b3-3ac84a88afa5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:10.745138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af1b4e-7748-4845-a8e9-701ee4e011e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:10.748363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af1b4e-7748-4845-a8e9-701ee4e011e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.748649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af1b4e-7748-4845-a8e9-701ee4e011e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.748926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af1b4e-7748-4845-a8e9-701ee4e011e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.750026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af1b4e-7748-4845-a8e9-701ee4e011e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:10.750159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af1b4e-7748-4845-a8e9-701ee4e011e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:10.751632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa334465-d2d8-4b16-8a7a-0639e04badb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:10.753824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa334465-d2d8-4b16-8a7a-0639e04badb3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.754278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af1b4e-7748-4845-a8e9-701ee4e011e8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:10.754851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa334465-d2d8-4b16-8a7a-0639e04badb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.755510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa334465-d2d8-4b16-8a7a-0639e04badb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.757074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa334465-d2d8-4b16-8a7a-0639e04badb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:10.757646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa334465-d2d8-4b16-8a7a-0639e04badb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:10.760011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa334465-d2d8-4b16-8a7a-0639e04badb3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:10.808564 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1910/3843] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:10.810510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8e97e-544e-4b6a-bd9d-c21bee54cf9a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.810699 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1934/3844] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:10.811205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8e97e-544e-4b6a-bd9d-c21bee54cf9a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.811694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8e97e-544e-4b6a-bd9d-c21bee54cf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.814609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af1b4e-7748-4845-a8e9-701ee4e011e8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:10.839211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af1b4e-7748-4845-a8e9-701ee4e011e8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:10.855361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9ca4-18ff-4299-b0da-a7309985f371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:10.856479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9ca4-18ff-4299-b0da-a7309985f371 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.856862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9ca4-18ff-4299-b0da-a7309985f371 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.857920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9ca4-18ff-4299-b0da-a7309985f371 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.859314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-95e8e97e-544e-4b6a-bd9d-c21bee54cf9a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:10.860458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9ca4-18ff-4299-b0da-a7309985f371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:10.865249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-95e8e97e-544e-4b6a-bd9d-c21bee54cf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:10.875712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9ca4-18ff-4299-b0da-a7309985f371 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:10.917464 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1911/3845] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:10.917464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8e97e-544e-4b6a-bd9d-c21bee54cf9a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:10.958085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8e97e-544e-4b6a-bd9d-c21bee54cf9a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:10.973111 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1935/3846] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:10 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:10.973111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9ca4-18ff-4299-b0da-a7309985f371 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:10.978253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac8645-a62d-4854-8c0f-d933b95c6aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:10.979826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac8645-a62d-4854-8c0f-d933b95c6aca admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:10.980611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac8645-a62d-4854-8c0f-d933b95c6aca admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:10.981949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac8645-a62d-4854-8c0f-d933b95c6aca admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:10.984025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac8645-a62d-4854-8c0f-d933b95c6aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:10.988007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccac8645-a62d-4854-8c0f-d933b95c6aca admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.079852 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1912/3847] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:10 2022] POST /identity/v3/projects => generated 371 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:11.079852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac8645-a62d-4854-8c0f-d933b95c6aca admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.128359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9ca4-18ff-4299-b0da-a7309985f371 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.243355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b8f12-0397-4960-924f-da8342094dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.244408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8f12-0397-4960-924f-da8342094dea admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.248993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8f12-0397-4960-924f-da8342094dea admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.249540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8f12-0397-4960-924f-da8342094dea admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.252138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b8f12-0397-4960-924f-da8342094dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:11.252627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b8f12-0397-4960-924f-da8342094dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.257797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac8645-a62d-4854-8c0f-d933b95c6aca admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.260532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b8f12-0397-4960-924f-da8342094dea admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.263016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061664c-9efe-4bb5-ab6e-3a3cba54bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.263764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061664c-9efe-4bb5-ab6e-3a3cba54bebf admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.264325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061664c-9efe-4bb5-ab6e-3a3cba54bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.264656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061664c-9efe-4bb5-ab6e-3a3cba54bebf admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.265717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061664c-9efe-4bb5-ab6e-3a3cba54bebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.268178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061664c-9efe-4bb5-ab6e-3a3cba54bebf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.299786 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1936/3848] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:11.300930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b8f12-0397-4960-924f-da8342094dea admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.308074 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1913/3849] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:11 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:11.309400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061664c-9efe-4bb5-ab6e-3a3cba54bebf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.332123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b8f12-0397-4960-924f-da8342094dea admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.332616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061664c-9efe-4bb5-ab6e-3a3cba54bebf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.340627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46f8b-397b-4c6c-9aab-36b5006e1611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.341578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46f8b-397b-4c6c-9aab-36b5006e1611 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.341957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46f8b-397b-4c6c-9aab-36b5006e1611 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.342332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd46f8b-397b-4c6c-9aab-36b5006e1611 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.342899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af74c87-ea3e-4988-ac8e-a4d6cf47c967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.343949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd46f8b-397b-4c6c-9aab-36b5006e1611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.346125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd46f8b-397b-4c6c-9aab-36b5006e1611 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.347156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af74c87-ea3e-4988-ac8e-a4d6cf47c967 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.347730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af74c87-ea3e-4988-ac8e-a4d6cf47c967 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.348732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af74c87-ea3e-4988-ac8e-a4d6cf47c967 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.350121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af74c87-ea3e-4988-ac8e-a4d6cf47c967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.354499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af74c87-ea3e-4988-ac8e-a4d6cf47c967 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.411164 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1914/3850] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:11 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:11.412561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46f8b-397b-4c6c-9aab-36b5006e1611 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.433269 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1937/3851] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:11 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:11.434279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af74c87-ea3e-4988-ac8e-a4d6cf47c967 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.480468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af74c87-ea3e-4988-ac8e-a4d6cf47c967 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.554068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd46f8b-397b-4c6c-9aab-36b5006e1611 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.576716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd5770-726c-4da9-be78-f6bd73b7f9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.577443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd5770-726c-4da9-be78-f6bd73b7f9d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.577734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd5770-726c-4da9-be78-f6bd73b7f9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.578019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd5770-726c-4da9-be78-f6bd73b7f9d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.578754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd5770-726c-4da9-be78-f6bd73b7f9d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.580439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd5770-726c-4da9-be78-f6bd73b7f9d5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.606457 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1915/3852] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:11.610439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd5770-726c-4da9-be78-f6bd73b7f9d5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.624174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae173b-831a-4e2c-8773-2089361315ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.625259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd5770-726c-4da9-be78-f6bd73b7f9d5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.626170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae173b-831a-4e2c-8773-2089361315ad admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.626761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae173b-831a-4e2c-8773-2089361315ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.627060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae173b-831a-4e2c-8773-2089361315ad admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.627765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae173b-831a-4e2c-8773-2089361315ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.631576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502b247-87ee-4895-a200-8836108f9393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.632762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502b247-87ee-4895-a200-8836108f9393 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.633152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502b247-87ee-4895-a200-8836108f9393 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.633588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502b247-87ee-4895-a200-8836108f9393 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.634469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502b247-87ee-4895-a200-8836108f9393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.634871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae173b-831a-4e2c-8773-2089361315ad admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.636648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502b247-87ee-4895-a200-8836108f9393 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.662807 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1916/3853] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:11.664999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502b247-87ee-4895-a200-8836108f9393 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.686453 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1938/3854] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:11 2022] POST /identity/v3/users => generated 283 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:11.688185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae173b-831a-4e2c-8773-2089361315ad admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.695424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502b247-87ee-4895-a200-8836108f9393 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.710334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e636f-89bf-40bf-a979-880da00183e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.711259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e636f-89bf-40bf-a979-880da00183e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.711722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e636f-89bf-40bf-a979-880da00183e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.712148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e636f-89bf-40bf-a979-880da00183e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.712973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e636f-89bf-40bf-a979-880da00183e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.714471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae173b-831a-4e2c-8773-2089361315ad admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.714919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e636f-89bf-40bf-a979-880da00183e8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.720889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2398735-093e-4ac6-9a20-4da0fba38ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.721995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2398735-093e-4ac6-9a20-4da0fba38ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.723195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2398735-093e-4ac6-9a20-4da0fba38ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.723829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2398735-093e-4ac6-9a20-4da0fba38ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.724748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2398735-093e-4ac6-9a20-4da0fba38ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.726787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2398735-093e-4ac6-9a20-4da0fba38ab7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.731610 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1917/3855] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:11.732692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e636f-89bf-40bf-a979-880da00183e8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.746146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e636f-89bf-40bf-a979-880da00183e8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.751940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555a88e-a27f-4dc5-bff5-0c89d636d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.752519 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1939/3856] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:11.754286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2398735-093e-4ac6-9a20-4da0fba38ab7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.757042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555a88e-a27f-4dc5-bff5-0c89d636d57c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.757538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555a88e-a27f-4dc5-bff5-0c89d636d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.757945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555a88e-a27f-4dc5-bff5-0c89d636d57c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.758897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555a88e-a27f-4dc5-bff5-0c89d636d57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.760856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555a88e-a27f-4dc5-bff5-0c89d636d57c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.779367 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1918/3857] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:11.779367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555a88e-a27f-4dc5-bff5-0c89d636d57c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.785367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2398735-093e-4ac6-9a20-4da0fba38ab7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.790637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555a88e-a27f-4dc5-bff5-0c89d636d57c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:11.791725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5fae9-b790-4a9b-9ed9-60602cfc8a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.792839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5fae9-b790-4a9b-9ed9-60602cfc8a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.793940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5fae9-b790-4a9b-9ed9-60602cfc8a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.794955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5fae9-b790-4a9b-9ed9-60602cfc8a6e admin admin] PATH_INFO: `/v3/projects/19b4a69e68554b2bbaa1fcbfc9810a2f/users/cd7a5f1b0b2c40b6aa8422ef1131bf75/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.796201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a53e8-2bb4-4e88-addc-7b11bba20c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:11.797315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a53e8-2bb4-4e88-addc-7b11bba20c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.797728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a53e8-2bb4-4e88-addc-7b11bba20c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.798106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a53e8-2bb4-4e88-addc-7b11bba20c80 admin admin] PATH_INFO: `/v3/projects/b5323738031048e9bdb73100c303fb6a/users/fa11526246ae4ce8a25f8a731a35264b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.813817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5fae9-b790-4a9b-9ed9-60602cfc8a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b4a69e68554b2bbaa1fcbfc9810a2f, user_id=cd7a5f1b0b2c40b6aa8422ef1131bf75, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.823606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5fae9-b790-4a9b-9ed9-60602cfc8a6e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.824459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a53e8-2bb4-4e88-addc-7b11bba20c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5323738031048e9bdb73100c303fb6a, user_id=fa11526246ae4ce8a25f8a731a35264b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:11.827316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a53e8-2bb4-4e88-addc-7b11bba20c80 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:11.860497 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1940/3859] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:11 2022] PUT /identity/v3/projects/19b4a69e68554b2bbaa1fcbfc9810a2f/users/cd7a5f1b0b2c40b6aa8422ef1131bf75/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:11.861480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5fae9-b790-4a9b-9ed9-60602cfc8a6e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:11.877134 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1919/3859] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:11 2022] PUT /identity/v3/projects/b5323738031048e9bdb73100c303fb6a/users/fa11526246ae4ce8a25f8a731a35264b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:11.882855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b19cb-0948-4c13-85f2-8d2c3acde38d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:11.883276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b19cb-0948-4c13-85f2-8d2c3acde38d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:11.883842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b19cb-0948-4c13-85f2-8d2c3acde38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:11.911814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fd9b19cb-0948-4c13-85f2-8d2c3acde38d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:11.914240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fd9b19cb-0948-4c13-85f2-8d2c3acde38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:11.969068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5fae9-b790-4a9b-9ed9-60602cfc8a6e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:12.083092 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1920/3860] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:12.086748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b92d70-261a-4f15-8b2a-e42e657bc949 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:12.087656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b92d70-261a-4f15-8b2a-e42e657bc949 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:12.089008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b92d70-261a-4f15-8b2a-e42e657bc949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:12.128077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f2d6a-8641-495c-b0f2-c26a9c223fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:12.129740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f2d6a-8641-495c-b0f2-c26a9c223fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:12.130354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f2d6a-8641-495c-b0f2-c26a9c223fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:12.130739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560f2d6a-8641-495c-b0f2-c26a9c223fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:12.133320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f2d6a-8641-495c-b0f2-c26a9c223fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:12.134999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560f2d6a-8641-495c-b0f2-c26a9c223fd9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:12.149324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-26b92d70-261a-4f15-8b2a-e42e657bc949 None None] MFA Rules not processed for user `fa11526246ae4ce8a25f8a731a35264b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:12.151138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-26b92d70-261a-4f15-8b2a-e42e657bc949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:12.159242 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1941/3861] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:12.165051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f2d6a-8641-495c-b0f2-c26a9c223fd9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:12.168865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-560f2d6a-8641-495c-b0f2-c26a9c223fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:12.269373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560f2d6a-8641-495c-b0f2-c26a9c223fd9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:12.281694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a8409-2567-4b24-a9c3-1f4b25f427f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:12.282413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a8409-2567-4b24-a9c3-1f4b25f427f2 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:12.282695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a8409-2567-4b24-a9c3-1f4b25f427f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:12.282969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a8409-2567-4b24-a9c3-1f4b25f427f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:12.305876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a8409-2567-4b24-a9c3-1f4b25f427f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:12.307956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a8409-2567-4b24-a9c3-1f4b25f427f2 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:12.316865 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1921/3862] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:12.321568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b92d70-261a-4f15-8b2a-e42e657bc949 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:12.324493 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1942/3863] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:12.326102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a5ea-d212-4fe8-ac0f-f5b0d41164cf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:12.326396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a5ea-d212-4fe8-ac0f-f5b0d41164cf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:12.326931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a5ea-d212-4fe8-ac0f-f5b0d41164cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:12.346351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2bb4a5ea-d212-4fe8-ac0f-f5b0d41164cf None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:12.347695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2bb4a5ea-d212-4fe8-ac0f-f5b0d41164cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:12.354109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b92d70-261a-4f15-8b2a-e42e657bc949 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:12.363217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba3f7e-09af-4a5c-a0a7-f0c75cb734a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:12.364296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba3f7e-09af-4a5c-a0a7-f0c75cb734a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:12.364580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba3f7e-09af-4a5c-a0a7-f0c75cb734a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:12.364860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba3f7e-09af-4a5c-a0a7-f0c75cb734a2 admin admin] PATH_INFO: `/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf/users/fe29b57bbdb240cfb2db88ee93accd74/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:12.406312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba3f7e-09af-4a5c-a0a7-f0c75cb734a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed5f1700fdf4c55a6bed753ec0072bf, user_id=fe29b57bbdb240cfb2db88ee93accd74, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:12.409626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba3f7e-09af-4a5c-a0a7-f0c75cb734a2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:12.419353 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1943/3864] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:12.420579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a5ea-d212-4fe8-ac0f-f5b0d41164cf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:12.423420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2bb4a5ea-d212-4fe8-ac0f-f5b0d41164cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:12.444533 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1922/3865] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:12 2022] PUT /identity/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf/users/fe29b57bbdb240cfb2db88ee93accd74/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:12.445768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba3f7e-09af-4a5c-a0a7-f0c75cb734a2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:12.447655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1aba3f7e-09af-4a5c-a0a7-f0c75cb734a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:12.545150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba3f7e-09af-4a5c-a0a7-f0c75cb734a2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:12.552862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34ce0e-cfe1-4159-9283-378b0bcbb168 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:12.553600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34ce0e-cfe1-4159-9283-378b0bcbb168 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:12.553956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34ce0e-cfe1-4159-9283-378b0bcbb168 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:12.554243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34ce0e-cfe1-4159-9283-378b0bcbb168 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:12.570010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a5ea-d212-4fe8-ac0f-f5b0d41164cf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:12.627549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34ce0e-cfe1-4159-9283-378b0bcbb168 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:12.629237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34ce0e-cfe1-4159-9283-378b0bcbb168 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:12.656718 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1923/3866] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:12.659444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e77d-eb17-4831-9da1-a692fd97a37a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:12.659740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e77d-eb17-4831-9da1-a692fd97a37a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:12.660532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185e77d-eb17-4831-9da1-a692fd97a37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:12.668465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ec9df-3d7e-4696-90a9-a77bbb5abf81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:12.669429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec9df-3d7e-4696-90a9-a77bbb5abf81 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:12.669814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec9df-3d7e-4696-90a9-a77bbb5abf81 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:12.670195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ec9df-3d7e-4696-90a9-a77bbb5abf81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:12.724927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8185e77d-eb17-4831-9da1-a692fd97a37a None None] MFA Rules not processed for user `fe29b57bbdb240cfb2db88ee93accd74`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:12.734405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8185e77d-eb17-4831-9da1-a692fd97a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:12.735765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ec9df-3d7e-4696-90a9-a77bbb5abf81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:12.737617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087ec9df-3d7e-4696-90a9-a77bbb5abf81 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:12.749789 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1944/3867] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:12.891641 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1924/3868] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:12.982800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ec9df-3d7e-4696-90a9-a77bbb5abf81 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:12.984756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-087ec9df-3d7e-4696-90a9-a77bbb5abf81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:13.016536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ec9df-3d7e-4696-90a9-a77bbb5abf81 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:13.034629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a8b7-6bb3-4a47-877a-8a360aee4fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:13.036197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a8b7-6bb3-4a47-877a-8a360aee4fef service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:13.040274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a8b7-6bb3-4a47-877a-8a360aee4fef service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:13.040731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29a8b7-6bb3-4a47-877a-8a360aee4fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:13.057761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a8b7-6bb3-4a47-877a-8a360aee4fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:13.061876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a29a8b7-6bb3-4a47-877a-8a360aee4fef service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:13.084131 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1945/3869] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:13.091736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b203e34-c5d3-4ecc-a01e-13a0f8b25091 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:13.092147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b203e34-c5d3-4ecc-a01e-13a0f8b25091 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:13.092500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b203e34-c5d3-4ecc-a01e-13a0f8b25091 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:13.094571 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1925/3870] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:58:13.101548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a8b7-6bb3-4a47-877a-8a360aee4fef service nova] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:58:13.115278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a8b7-6bb3-4a47-877a-8a360aee4fef service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:13.126966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29a8b7-6bb3-4a47-877a-8a360aee4fef service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:13.133095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325ed72-7067-4d93-be40-6b9511145e17 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe29b57bbdb240cfb2db88ee93accd74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ed5f1700fdf4c55a6bed753ec0072bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:13.133919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325ed72-7067-4d93-be40-6b9511145e17 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:13.134294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325ed72-7067-4d93-be40-6b9511145e17 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:13.134679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325ed72-7067-4d93-be40-6b9511145e17 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] PATH_INFO: `/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:13.136245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325ed72-7067-4d93-be40-6b9511145e17 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorizing `identity:get_project(project_id=6ed5f1700fdf4c55a6bed753ec0072bf)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:13.138700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325ed72-7067-4d93-be40-6b9511145e17 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:13.151780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1946/3871] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:58:13 2022] GET /identity/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf => generated 365 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:13.245979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b203e34-c5d3-4ecc-a01e-13a0f8b25091 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:13.342151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b203e34-c5d3-4ecc-a01e-13a0f8b25091 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:13.347881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:13.348910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:13.349471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:13.349817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] PATH_INFO: `/v3/users/fa11526246ae4ce8a25f8a731a35264b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:13.351972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa11526246ae4ce8a25f8a731a35264b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:13.354270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:13.468402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa11526246ae4ce8a25f8a731a35264b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:13.502747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa11526246ae4ce8a25f8a731a35264b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:13.504461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa11526246ae4ce8a25f8a731a35264b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:13.506404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa11526246ae4ce8a25f8a731a35264b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:13.510752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48da53-345a-47c8-933c-ac6843f3738c None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:13.511290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48da53-345a-47c8-933c-ac6843f3738c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:13.512130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48da53-345a-47c8-933c-ac6843f3738c None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:13.516545 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1947/3872] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:58:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 20:58:13.521914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48da53-345a-47c8-933c-ac6843f3738c None None] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:58:13.527044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4e48da53-345a-47c8-933c-ac6843f3738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:13.543887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45781335-c0be-4333-92ab-641b824cfa8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa11526246ae4ce8a25f8a731a35264b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:13.564776 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1926/3873] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:13 2022] DELETE /identity/v3/users/fa11526246ae4ce8a25f8a731a35264b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:13.579049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4515f9-93c5-47d5-96a9-f06ffbb9acba None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:13.579301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4515f9-93c5-47d5-96a9-f06ffbb9acba None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:13.579450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4515f9-93c5-47d5-96a9-f06ffbb9acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:13.584020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48da53-345a-47c8-933c-ac6843f3738c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:13.586059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4e48da53-345a-47c8-933c-ac6843f3738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:13.617234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48da53-345a-47c8-933c-ac6843f3738c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:13.625153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cf4515f9-93c5-47d5-96a9-f06ffbb9acba None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:13.631754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf4515f9-93c5-47d5-96a9-f06ffbb9acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:13.724071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48597c6d-9780-443a-a5cc-168f3cefb4ac tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe29b57bbdb240cfb2db88ee93accd74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ed5f1700fdf4c55a6bed753ec0072bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:13.725762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597c6d-9780-443a-a5cc-168f3cefb4ac tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:13.726345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597c6d-9780-443a-a5cc-168f3cefb4ac tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:13.726877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48597c6d-9780-443a-a5cc-168f3cefb4ac tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] PATH_INFO: `/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:13.728321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48597c6d-9780-443a-a5cc-168f3cefb4ac tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorizing `identity:get_project(project_id=6ed5f1700fdf4c55a6bed753ec0072bf)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:13.730547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48597c6d-9780-443a-a5cc-168f3cefb4ac tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:13.734562 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1927/3874] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:13.740136 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1948/3875] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:58:13 2022] GET /identity/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf => generated 365 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:13.805658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4515f9-93c5-47d5-96a9-f06ffbb9acba None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:13.807783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf4515f9-93c5-47d5-96a9-f06ffbb9acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:13.907361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4515f9-93c5-47d5-96a9-f06ffbb9acba None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:13.912343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7643a47-a4ea-4e15-9668-a6e67b3b73ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:13.913862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7643a47-a4ea-4e15-9668-a6e67b3b73ed service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:13.914241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7643a47-a4ea-4e15-9668-a6e67b3b73ed service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:13.914612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7643a47-a4ea-4e15-9668-a6e67b3b73ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:13.926656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7643a47-a4ea-4e15-9668-a6e67b3b73ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:13.928229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7643a47-a4ea-4e15-9668-a6e67b3b73ed service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:13.940312 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1928/3876] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:14.067423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a61c-c97a-4a70-a587-6b26018ef2e2 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.068338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a61c-c97a-4a70-a587-6b26018ef2e2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.069557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212a61c-c97a-4a70-a587-6b26018ef2e2 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.072123 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1949/3877] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:58:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:58:14.080217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7643a47-a4ea-4e15-9668-a6e67b3b73ed service neutron] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:58:14.088604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6107-82e2-4a73-b228-c5cbb5f394fa None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.088974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6107-82e2-4a73-b228-c5cbb5f394fa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.089461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce6107-82e2-4a73-b228-c5cbb5f394fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.146258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-57ce6107-82e2-4a73-b228-c5cbb5f394fa None None] MFA Rules not processed for user `cd7a5f1b0b2c40b6aa8422ef1131bf75`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:14.148743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57ce6107-82e2-4a73-b228-c5cbb5f394fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:14.208488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7643a47-a4ea-4e15-9668-a6e67b3b73ed service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:14.221664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7643a47-a4ea-4e15-9668-a6e67b3b73ed service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:14.227043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b4cd4-a42a-4ea0-bb43-11b1236c81f2 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe29b57bbdb240cfb2db88ee93accd74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ed5f1700fdf4c55a6bed753ec0072bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:14.228214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b4cd4-a42a-4ea0-bb43-11b1236c81f2 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.228784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b4cd4-a42a-4ea0-bb43-11b1236c81f2 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.229259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b4cd4-a42a-4ea0-bb43-11b1236c81f2 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] PATH_INFO: `/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.230701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b4cd4-a42a-4ea0-bb43-11b1236c81f2 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorizing `identity:get_project(project_id=6ed5f1700fdf4c55a6bed753ec0072bf)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:14.232772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b4cd4-a42a-4ea0-bb43-11b1236c81f2 tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:14.239190 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1929/3878] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:58:14 2022] GET /identity/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf => generated 365 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:14.270607 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1950/3879] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:14.451747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb56d7-50b9-41ed-baa7-34ed47eda665 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.452137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb56d7-50b9-41ed-baa7-34ed47eda665 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.453292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb56d7-50b9-41ed-baa7-34ed47eda665 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.455604 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1930/3880] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:58:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:58:14.461209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce6107-82e2-4a73-b228-c5cbb5f394fa None None] Authenticating service token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:58:14.462678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57ce6107-82e2-4a73-b228-c5cbb5f394fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:14.480752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce6107-82e2-4a73-b228-c5cbb5f394fa None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:14.497390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce6107-82e2-4a73-b228-c5cbb5f394fa None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:14.502430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc23321-171d-44c8-b618-843d5c71efca tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe29b57bbdb240cfb2db88ee93accd74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ed5f1700fdf4c55a6bed753ec0072bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:14.503718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc23321-171d-44c8-b618-843d5c71efca tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.504148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e2a5d-629c-447c-8b5f-6e2c835c305a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.504470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e2a5d-629c-447c-8b5f-6e2c835c305a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.504776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e2a5d-629c-447c-8b5f-6e2c835c305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.505043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc23321-171d-44c8-b618-843d5c71efca tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.505555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc23321-171d-44c8-b618-843d5c71efca tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] PATH_INFO: `/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.507200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc23321-171d-44c8-b618-843d5c71efca tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorizing `identity:get_project(project_id=6ed5f1700fdf4c55a6bed753ec0072bf)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:14.509350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc23321-171d-44c8-b618-843d5c71efca tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:14.511660 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1951/3881] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:58:14 2022] GET /identity/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf => generated 365 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:14.529008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-351e2a5d-629c-447c-8b5f-6e2c835c305a None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:14.530529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-351e2a5d-629c-447c-8b5f-6e2c835c305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:14.553351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc23321-171d-44c8-b618-843d5c71efca tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:14.571503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc23321-171d-44c8-b618-843d5c71efca tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:14.584429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad77fa-1397-45fb-9ed8-6de118450dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:14.586063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad77fa-1397-45fb-9ed8-6de118450dfc service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.586765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad77fa-1397-45fb-9ed8-6de118450dfc service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.587407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad77fa-1397-45fb-9ed8-6de118450dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.609224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad77fa-1397-45fb-9ed8-6de118450dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:14.610869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad77fa-1397-45fb-9ed8-6de118450dfc service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:14.627116 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1952/3882] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:58:14.629009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad77fa-1397-45fb-9ed8-6de118450dfc service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:14.639029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0cad77fa-1397-45fb-9ed8-6de118450dfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:14.651770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1931/3883] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:58:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:58:14.653078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e410d-cc73-4f86-bdd5-b681a45e4bef None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.653377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e410d-cc73-4f86-bdd5-b681a45e4bef None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.653792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e410d-cc73-4f86-bdd5-b681a45e4bef None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.655866 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1932/3884] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 20:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 20:58:14.661660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e410d-cc73-4f86-bdd5-b681a45e4bef None None] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 20:58:14.669850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad77fa-1397-45fb-9ed8-6de118450dfc service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:14.679718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:14.680399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.680679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.680955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] PATH_INFO: `/v3/users/fc0453ace26e4c81b46b11497ccae85b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.683651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0453ace26e4c81b46b11497ccae85b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:14.686644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:14.692207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e410d-cc73-4f86-bdd5-b681a45e4bef None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:14.708196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e410d-cc73-4f86-bdd5-b681a45e4bef None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:14.725888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e68e6-ed87-406e-b807-56e4312998dc tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe29b57bbdb240cfb2db88ee93accd74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ed5f1700fdf4c55a6bed753ec0072bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:14.730501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e68e6-ed87-406e-b807-56e4312998dc tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.731272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e68e6-ed87-406e-b807-56e4312998dc tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.731272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e68e6-ed87-406e-b807-56e4312998dc tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] PATH_INFO: `/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.734681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e68e6-ed87-406e-b807-56e4312998dc tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorizing `identity:get_project(project_id=6ed5f1700fdf4c55a6bed753ec0072bf)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:14.741718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e68e6-ed87-406e-b807-56e4312998dc tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:14.756150 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1933/3885] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 20:58:14 2022] GET /identity/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf => generated 365 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:14.759940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e68e6-ed87-406e-b807-56e4312998dc tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:14.762986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-026e68e6-ed87-406e-b807-56e4312998dc tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:14.770941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0453ace26e4c81b46b11497ccae85b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:14.780082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0453ace26e4c81b46b11497ccae85b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:14.781188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0453ace26e4c81b46b11497ccae85b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:14.782029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0453ace26e4c81b46b11497ccae85b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:14.795059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0453ace26e4c81b46b11497ccae85b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:14.834549 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1953/3886] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:14 2022] DELETE /identity/v3/users/fc0453ace26e4c81b46b11497ccae85b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:14.836344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:14.838333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:14.907363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e68e6-ed87-406e-b807-56e4312998dc tempest-QuotasTestJSON-1982157339 tempest-QuotasTestJSON-1982157339-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:14.962941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82191be-d97e-4388-831a-ec34fd93d69d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:14.976513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:14.980043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:14.980407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:14.981159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] PATH_INFO: `/v3/users/fe29b57bbdb240cfb2db88ee93accd74` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:14.982634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe29b57bbdb240cfb2db88ee93accd74)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:14.985692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:15.028320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:15.029223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.029570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.029867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.033806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.101087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe29b57bbdb240cfb2db88ee93accd74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.123505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe29b57bbdb240cfb2db88ee93accd74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.126934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe29b57bbdb240cfb2db88ee93accd74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.128205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe29b57bbdb240cfb2db88ee93accd74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.154183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d19965a-f2e5-49b1-b197-83149f120ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe29b57bbdb240cfb2db88ee93accd74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.195868 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1954/3887] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:14 2022] DELETE /identity/v3/users/fe29b57bbdb240cfb2db88ee93accd74 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:15.200827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c049-6b0d-40e6-9652-74e80c233411 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.201075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c049-6b0d-40e6-9652-74e80c233411 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.201367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c049-6b0d-40e6-9652-74e80c233411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.230248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8052c049-6b0d-40e6-9652-74e80c233411 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:15.231507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8052c049-6b0d-40e6-9652-74e80c233411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.234539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:15.237434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:15.260168 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1934/3888] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:15.261583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:15.263506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.280604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432f967-3076-4dcf-a88d-206c9eccf7a1 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:15.343287 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1955/3889] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:15.344996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562456-f74e-4aa2-a4cf-2ef12423e72a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.345347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562456-f74e-4aa2-a4cf-2ef12423e72a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.345691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562456-f74e-4aa2-a4cf-2ef12423e72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.376220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-df562456-f74e-4aa2-a4cf-2ef12423e72a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:15.379477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df562456-f74e-4aa2-a4cf-2ef12423e72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.405952 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1956/3890] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:15.409965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df562456-f74e-4aa2-a4cf-2ef12423e72a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:15.411749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df562456-f74e-4aa2-a4cf-2ef12423e72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.486013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:15.487147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.487338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.488012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] PATH_INFO: `/v3/projects/b5323738031048e9bdb73100c303fb6a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.489753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5323738031048e9bdb73100c303fb6a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:15.493304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:15.503168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df562456-f74e-4aa2-a4cf-2ef12423e72a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:15.509531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c0514-d99a-4e96-9f0e-be738f28e425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:15.510451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c0514-d99a-4e96-9f0e-be738f28e425 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.510658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c0514-d99a-4e96-9f0e-be738f28e425 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.510885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c0514-d99a-4e96-9f0e-be738f28e425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.521571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c0514-d99a-4e96-9f0e-be738f28e425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:15.523152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c0514-d99a-4e96-9f0e-be738f28e425 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:15.535868 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1957/3891] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:15.543158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c0514-d99a-4e96-9f0e-be738f28e425 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:15.544688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7b0c0514-d99a-4e96-9f0e-be738f28e425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.568184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c0514-d99a-4e96-9f0e-be738f28e425 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:15.573752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e16d1-24de-4183-982b-78804c483354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:15.574356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e16d1-24de-4183-982b-78804c483354 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.574690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e16d1-24de-4183-982b-78804c483354 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.575048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e16d1-24de-4183-982b-78804c483354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.612388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e16d1-24de-4183-982b-78804c483354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:15.616813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e16d1-24de-4183-982b-78804c483354 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:15.633013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5323738031048e9bdb73100c303fb6a', 'request_id': 'req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.648937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5323738031048e9bdb73100c303fb6a', 'request_id': 'req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.657051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5323738031048e9bdb73100c303fb6a', 'request_id': 'req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.663508 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1958/3892] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:15.684784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] The token cache is being invalidate because project b5323738031048e9bdb73100c303fb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:15.685086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.685783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c0d486aa-52cc-4bf1-842c-1b18d57cfafa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:15.687310 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1935/3893] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:15 2022] DELETE /identity/v3/projects/b5323738031048e9bdb73100c303fb6a => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:15.692896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36b348-adef-4ac4-b8d3-df775f67f3c9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.693306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36b348-adef-4ac4-b8d3-df775f67f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.694259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36b348-adef-4ac4-b8d3-df775f67f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.730176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1f36b348-adef-4ac4-b8d3-df775f67f3c9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:15.731495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1f36b348-adef-4ac4-b8d3-df775f67f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.869955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81289bd6-b704-4f59-bf01-e9c2f731b2c0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.870487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81289bd6-b704-4f59-bf01-e9c2f731b2c0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.872321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81289bd6-b704-4f59-bf01-e9c2f731b2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.885705 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1959/3894] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:15.888367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9a329-b911-4426-86a8-f046078b4fd0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.888367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9a329-b911-4426-86a8-f046078b4fd0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.888842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9a329-b911-4426-86a8-f046078b4fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.909153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-81289bd6-b704-4f59-bf01-e9c2f731b2c0 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:15.912213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-81289bd6-b704-4f59-bf01-e9c2f731b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.947083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f8c9a329-b911-4426-86a8-f046078b4fd0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:15.948925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f8c9a329-b911-4426-86a8-f046078b4fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.962062 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1960/3895] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:15.963122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9a329-b911-4426-86a8-f046078b4fd0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:15.967296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f8c9a329-b911-4426-86a8-f046078b4fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:15.983347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9a329-b911-4426-86a8-f046078b4fd0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:15.988220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:15.989744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:15.990126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:15.990521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] PATH_INFO: `/v3/projects/c4885ef55ed84bc49abc7050962b85f6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:15.992009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4885ef55ed84bc49abc7050962b85f6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:15.994086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:16.041045 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1936/3896] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:16.042087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81289bd6-b704-4f59-bf01-e9c2f731b2c0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:16.055387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81289bd6-b704-4f59-bf01-e9c2f731b2c0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:16.085994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4885ef55ed84bc49abc7050962b85f6', 'request_id': 'req-cb337f28-fc9d-43a8-a49c-58e7cf722e70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.101178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4885ef55ed84bc49abc7050962b85f6', 'request_id': 'req-cb337f28-fc9d-43a8-a49c-58e7cf722e70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.110689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4885ef55ed84bc49abc7050962b85f6', 'request_id': 'req-cb337f28-fc9d-43a8-a49c-58e7cf722e70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.138312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] The token cache is being invalidate because project c4885ef55ed84bc49abc7050962b85f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:16.138910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.140474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.142455 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1961/3897] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:15 2022] DELETE /identity/v3/projects/c4885ef55ed84bc49abc7050962b85f6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:16.143469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:16.145695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:16.199806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335f938-583c-4a16-9e79-553dbd0b1f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:16.200642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335f938-583c-4a16-9e79-553dbd0b1f9a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.200851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335f938-583c-4a16-9e79-553dbd0b1f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.201182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335f938-583c-4a16-9e79-553dbd0b1f9a admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.201914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335f938-583c-4a16-9e79-553dbd0b1f9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:16.202322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335f938-583c-4a16-9e79-553dbd0b1f9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:16.204919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335f938-583c-4a16-9e79-553dbd0b1f9a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:16.225177 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1937/3898] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:16.226596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a7684-d3cd-4572-9e83-f5b54b20925e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.226885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a7684-d3cd-4572-9e83-f5b54b20925e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.227163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a7684-d3cd-4572-9e83-f5b54b20925e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.246294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6c8a7684-d3cd-4572-9e83-f5b54b20925e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:16.247480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6c8a7684-d3cd-4572-9e83-f5b54b20925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:16.274728 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1938/3899] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:16.277756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a7684-d3cd-4572-9e83-f5b54b20925e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:16.284304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6c8a7684-d3cd-4572-9e83-f5b54b20925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:16.286025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb337f28-fc9d-43a8-a49c-58e7cf722e70 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:16.296015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:16.296684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.296973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.297233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.299294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a7684-d3cd-4572-9e83-f5b54b20925e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:16.299434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:16.304886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d341f-bb07-4e89-88d9-538f716a1629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:16.305853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d341f-bb07-4e89-88d9-538f716a1629 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.306428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d341f-bb07-4e89-88d9-538f716a1629 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.306818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d341f-bb07-4e89-88d9-538f716a1629 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.308319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d341f-bb07-4e89-88d9-538f716a1629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:16.310945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d341f-bb07-4e89-88d9-538f716a1629 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:16.346693 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1939/3900] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:16 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:16.348798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63140569-099d-4d01-aa03-308d5f804644 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.349188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63140569-099d-4d01-aa03-308d5f804644 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.349518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63140569-099d-4d01-aa03-308d5f804644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.390161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-63140569-099d-4d01-aa03-308d5f804644 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:16.391376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-63140569-099d-4d01-aa03-308d5f804644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:16.421467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:16.423500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:16.436068 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1962/3901] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:16.437376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:16.440693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:16.457977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e60b5-19b6-4813-8386-b8b559492f5f service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:16.520118 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1940/3902] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:16.524225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63140569-099d-4d01-aa03-308d5f804644 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:16.541025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63140569-099d-4d01-aa03-308d5f804644 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:16.556311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced4021-009e-4d48-895c-a740732bec66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:16.557136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced4021-009e-4d48-895c-a740732bec66 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.557529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced4021-009e-4d48-895c-a740732bec66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.557905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced4021-009e-4d48-895c-a740732bec66 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.558805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced4021-009e-4d48-895c-a740732bec66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:16.561651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced4021-009e-4d48-895c-a740732bec66 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:16.564580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:16.569949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.570319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.570676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] PATH_INFO: `/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.572004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed5f1700fdf4c55a6bed753ec0072bf)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:16.577709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:16.595105 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1941/3903] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:16 2022] POST /identity/v3/users => generated 292 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:16.597068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced4021-009e-4d48-895c-a740732bec66 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:16.612911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced4021-009e-4d48-895c-a740732bec66 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:16.620378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b7b6-0879-4638-bbcc-e8bd95107777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:16.621852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b7b6-0879-4638-bbcc-e8bd95107777 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.622281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b7b6-0879-4638-bbcc-e8bd95107777 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.622657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218b7b6-0879-4638-bbcc-e8bd95107777 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.623736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218b7b6-0879-4638-bbcc-e8bd95107777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:16.624248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218b7b6-0879-4638-bbcc-e8bd95107777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:16.626532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218b7b6-0879-4638-bbcc-e8bd95107777 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:16.645218 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1942/3904] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:16.646325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b7b6-0879-4638-bbcc-e8bd95107777 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:16.660160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218b7b6-0879-4638-bbcc-e8bd95107777 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:16.666983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b503-8b7f-4d02-adf0-a8c0dd92dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:16.668510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b503-8b7f-4d02-adf0-a8c0dd92dba0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.668883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b503-8b7f-4d02-adf0-a8c0dd92dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.669231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9b503-8b7f-4d02-adf0-a8c0dd92dba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.670044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9b503-8b7f-4d02-adf0-a8c0dd92dba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:16.671727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e9b503-8b7f-4d02-adf0-a8c0dd92dba0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:16.685151 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1943/3905] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:16.686065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b503-8b7f-4d02-adf0-a8c0dd92dba0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:16.699546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9b503-8b7f-4d02-adf0-a8c0dd92dba0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:16.714620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed5f1700fdf4c55a6bed753ec0072bf', 'request_id': 'req-de44b794-2ebd-4e75-8898-4e4b47e2f016'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.727460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed5f1700fdf4c55a6bed753ec0072bf', 'request_id': 'req-de44b794-2ebd-4e75-8898-4e4b47e2f016'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.736306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed5f1700fdf4c55a6bed753ec0072bf', 'request_id': 'req-de44b794-2ebd-4e75-8898-4e4b47e2f016'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.767867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] The token cache is being invalidate because project 6ed5f1700fdf4c55a6bed753ec0072bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:16.770188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.771998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:16.778998 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1963/3906] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:16 2022] DELETE /identity/v3/projects/6ed5f1700fdf4c55a6bed753ec0072bf => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:16.780114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:16.785318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:16.824178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbdb02-ff57-4062-8e39-b8e64e5cf0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:16.825320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbdb02-ff57-4062-8e39-b8e64e5cf0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.826050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbdb02-ff57-4062-8e39-b8e64e5cf0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.826735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbdb02-ff57-4062-8e39-b8e64e5cf0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.828908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbdb02-ff57-4062-8e39-b8e64e5cf0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:16.832298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbdb02-ff57-4062-8e39-b8e64e5cf0a4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:16.875304 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1944/3907] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:16 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:16.877018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e3ccf-1c2b-49ae-af48-ce88753220dd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:16.877018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e3ccf-1c2b-49ae-af48-ce88753220dd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:16.882040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e3ccf-1c2b-49ae-af48-ce88753220dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:16.909406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44b794-2ebd-4e75-8898-4e4b47e2f016 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:16.937317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d87e3ccf-1c2b-49ae-af48-ce88753220dd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:16.939219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d87e3ccf-1c2b-49ae-af48-ce88753220dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:17.004173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c469bc-67b3-41bd-8b7e-2493197745f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.004847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c469bc-67b3-41bd-8b7e-2493197745f7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.005126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c469bc-67b3-41bd-8b7e-2493197745f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.005399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c469bc-67b3-41bd-8b7e-2493197745f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.011563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c469bc-67b3-41bd-8b7e-2493197745f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.011563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c469bc-67b3-41bd-8b7e-2493197745f7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.019661 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1945/3908] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:17.022190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e3ccf-1c2b-49ae-af48-ce88753220dd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.023337 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1964/3909] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:17.026466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d87e3ccf-1c2b-49ae-af48-ce88753220dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:17.028772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c469bc-67b3-41bd-8b7e-2493197745f7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.040016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e3ccf-1c2b-49ae-af48-ce88753220dd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.047466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c469bc-67b3-41bd-8b7e-2493197745f7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.047809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b7061-46d8-4131-9f84-79b533848dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.048754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b7061-46d8-4131-9f84-79b533848dcb admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.049103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b7061-46d8-4131-9f84-79b533848dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.049379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b7061-46d8-4131-9f84-79b533848dcb admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.050379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b7061-46d8-4131-9f84-79b533848dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.052955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b7061-46d8-4131-9f84-79b533848dcb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.054846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf854-827f-43e7-b957-d6a3c4b5e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.057002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf854-827f-43e7-b957-d6a3c4b5e2bf admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.057285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf854-827f-43e7-b957-d6a3c4b5e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.057559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cf854-827f-43e7-b957-d6a3c4b5e2bf admin admin] PATH_INFO: `/v3/projects/23327f0f8a7b433b884f61312794cfeb/users/0c30a9434cd34f4a92ec3657d9cbbc4f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.081917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cf854-827f-43e7-b957-d6a3c4b5e2bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=23327f0f8a7b433b884f61312794cfeb, user_id=0c30a9434cd34f4a92ec3657d9cbbc4f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.084085 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1946/3910] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:17 2022] POST /identity/v3/users => generated 286 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:17.084813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cf854-827f-43e7-b957-d6a3c4b5e2bf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.086939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d77db-7785-4b47-b52c-ccc5a1a62bf8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.088295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d77db-7785-4b47-b52c-ccc5a1a62bf8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.088574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d77db-7785-4b47-b52c-ccc5a1a62bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.101908 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1965/3911] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:17 2022] PUT /identity/v3/projects/23327f0f8a7b433b884f61312794cfeb/users/0c30a9434cd34f4a92ec3657d9cbbc4f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:17.103248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf854-827f-43e7-b957-d6a3c4b5e2bf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.129189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a66d77db-7785-4b47-b52c-ccc5a1a62bf8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:17.131073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a66d77db-7785-4b47-b52c-ccc5a1a62bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:17.196718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cf854-827f-43e7-b957-d6a3c4b5e2bf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.204067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a85b02-d56f-4d09-b7f6-95c7a65fc6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.204691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a85b02-d56f-4d09-b7f6-95c7a65fc6ae admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.204974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a85b02-d56f-4d09-b7f6-95c7a65fc6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.205898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a85b02-d56f-4d09-b7f6-95c7a65fc6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.206040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a85b02-d56f-4d09-b7f6-95c7a65fc6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.207548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a85b02-d56f-4d09-b7f6-95c7a65fc6ae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.212406 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1947/3912] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:17.214589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3035d1-c485-48af-a477-88cb6c67c820 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.216163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3035d1-c485-48af-a477-88cb6c67c820 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.216933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3035d1-c485-48af-a477-88cb6c67c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.226434 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1966/3913] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:17.227301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a85b02-d56f-4d09-b7f6-95c7a65fc6ae admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.242720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a85b02-d56f-4d09-b7f6-95c7a65fc6ae admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.248901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83e40c-3183-4139-8052-47994099a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.249606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83e40c-3183-4139-8052-47994099a20a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.249890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83e40c-3183-4139-8052-47994099a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.250170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83e40c-3183-4139-8052-47994099a20a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.251302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83e40c-3183-4139-8052-47994099a20a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:17.251610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83e40c-3183-4139-8052-47994099a20a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.253302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83e40c-3183-4139-8052-47994099a20a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.258886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9a3035d1-c485-48af-a477-88cb6c67c820 None None] MFA Rules not processed for user `0c30a9434cd34f4a92ec3657d9cbbc4f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:17.261817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9a3035d1-c485-48af-a477-88cb6c67c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:17.266434 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1967/3914] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:17.270619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83e40c-3183-4139-8052-47994099a20a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.280838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83e40c-3183-4139-8052-47994099a20a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.290004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19907c39-5afe-4ba7-8aa0-cad35a3bfa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.291418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19907c39-5afe-4ba7-8aa0-cad35a3bfa5b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.291719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19907c39-5afe-4ba7-8aa0-cad35a3bfa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.292149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19907c39-5afe-4ba7-8aa0-cad35a3bfa5b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.293066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19907c39-5afe-4ba7-8aa0-cad35a3bfa5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.294771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19907c39-5afe-4ba7-8aa0-cad35a3bfa5b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.314307 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1968/3915] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:17.315273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19907c39-5afe-4ba7-8aa0-cad35a3bfa5b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.325598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19907c39-5afe-4ba7-8aa0-cad35a3bfa5b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.333851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9284-5e2a-4a99-8016-3e17e152840e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.335133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9284-5e2a-4a99-8016-3e17e152840e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.335474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9284-5e2a-4a99-8016-3e17e152840e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.335818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee9284-5e2a-4a99-8016-3e17e152840e admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.336604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee9284-5e2a-4a99-8016-3e17e152840e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.338730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee9284-5e2a-4a99-8016-3e17e152840e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.391501 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1969/3916] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:17 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:17.392830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9284-5e2a-4a99-8016-3e17e152840e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.404009 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1948/3917] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:17.404009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3035d1-c485-48af-a477-88cb6c67c820 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.431446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3035d1-c485-48af-a477-88cb6c67c820 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.484048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee9284-5e2a-4a99-8016-3e17e152840e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.496770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02db79f-e1d8-40ba-99c1-4e5ac5cb78c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.497701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02db79f-e1d8-40ba-99c1-4e5ac5cb78c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.498324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02db79f-e1d8-40ba-99c1-4e5ac5cb78c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.498324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02db79f-e1d8-40ba-99c1-4e5ac5cb78c9 admin admin] PATH_INFO: `/v3/projects/6349609b9c304ab296fafc47dc857c05/users/61957c996e4544d69989a300e142954d/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.507073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce7545-b6ff-4831-8450-462f64a8e3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.507073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce7545-b6ff-4831-8450-462f64a8e3ce admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.507345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce7545-b6ff-4831-8450-462f64a8e3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.507560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce7545-b6ff-4831-8450-462f64a8e3ce admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.508579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce7545-b6ff-4831-8450-462f64a8e3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.510250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce7545-b6ff-4831-8450-462f64a8e3ce admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.530085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02db79f-e1d8-40ba-99c1-4e5ac5cb78c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6349609b9c304ab296fafc47dc857c05, user_id=61957c996e4544d69989a300e142954d, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.533990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02db79f-e1d8-40ba-99c1-4e5ac5cb78c9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.547584 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1949/3918] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:17 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:17.550023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce7545-b6ff-4831-8450-462f64a8e3ce admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.570769 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1970/3919] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:17 2022] PUT /identity/v3/projects/6349609b9c304ab296fafc47dc857c05/users/61957c996e4544d69989a300e142954d/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:17.577568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce7545-b6ff-4831-8450-462f64a8e3ce admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.587695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbadfc-c139-4044-93c1-b39f9183acd7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.592380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbadfc-c139-4044-93c1-b39f9183acd7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.592797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbadfc-c139-4044-93c1-b39f9183acd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.654591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8cdbadfc-c139-4044-93c1-b39f9183acd7 None None] MFA Rules not processed for user `61957c996e4544d69989a300e142954d`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:17.657721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8cdbadfc-c139-4044-93c1-b39f9183acd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:17.729611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ae1d-5964-4f56-b07a-ac348623d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.730525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ae1d-5964-4f56-b07a-ac348623d110 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.730906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ae1d-5964-4f56-b07a-ac348623d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.731283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110ae1d-5964-4f56-b07a-ac348623d110 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.732307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ae1d-5964-4f56-b07a-ac348623d110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.740187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110ae1d-5964-4f56-b07a-ac348623d110 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.755491 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1950/3920] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:17.757293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ae1d-5964-4f56-b07a-ac348623d110 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.759238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c110ae1d-5964-4f56-b07a-ac348623d110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:17.790534 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1971/3921] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:17.793694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbadfc-c139-4044-93c1-b39f9183acd7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.807553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbadfc-c139-4044-93c1-b39f9183acd7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.812653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047d013-0cc3-4622-8c8c-2592559e7347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.813324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047d013-0cc3-4622-8c8c-2592559e7347 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.813608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047d013-0cc3-4622-8c8c-2592559e7347 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.813886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047d013-0cc3-4622-8c8c-2592559e7347 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.814694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047d013-0cc3-4622-8c8c-2592559e7347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.816382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047d013-0cc3-4622-8c8c-2592559e7347 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.828084 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1972/3922] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:17.828955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047d013-0cc3-4622-8c8c-2592559e7347 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.831791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5047d013-0cc3-4622-8c8c-2592559e7347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:17.860516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110ae1d-5964-4f56-b07a-ac348623d110 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.867347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a83e6-3929-4990-87c9-0f923f7e984c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.868168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a83e6-3929-4990-87c9-0f923f7e984c service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.868459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a83e6-3929-4990-87c9-0f923f7e984c service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.868740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a83e6-3929-4990-87c9-0f923f7e984c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.897002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047d013-0cc3-4622-8c8c-2592559e7347 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.901158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac365-d77a-4247-89ec-4613ddc0f89d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.901879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac365-d77a-4247-89ec-4613ddc0f89d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.902242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac365-d77a-4247-89ec-4613ddc0f89d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.902618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ac365-d77a-4247-89ec-4613ddc0f89d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.911803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ac365-d77a-4247-89ec-4613ddc0f89d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.914746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ac365-d77a-4247-89ec-4613ddc0f89d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.925251 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1973/3923] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:17.926030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac365-d77a-4247-89ec-4613ddc0f89d service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:17.938168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ac365-d77a-4247-89ec-4613ddc0f89d service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:17.944359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b6b13-837c-4bc8-9768-a601923e97ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:17.945377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b6b13-837c-4bc8-9768-a601923e97ff admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:17.946045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b6b13-837c-4bc8-9768-a601923e97ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:17.946371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b6b13-837c-4bc8-9768-a601923e97ff admin admin] PATH_INFO: `/v3/projects/79df195683464266bbf9cc62745231c0/users/b7133b218dde41fc9d7d3503734ebae5/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:17.949332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a83e6-3929-4990-87c9-0f923f7e984c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.951241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a83e6-3929-4990-87c9-0f923f7e984c service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.967299 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1951/3924] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:17.968382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b6b13-837c-4bc8-9768-a601923e97ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=79df195683464266bbf9cc62745231c0, user_id=b7133b218dde41fc9d7d3503734ebae5, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:17.971692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b6b13-837c-4bc8-9768-a601923e97ff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:17.998982 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1974/3925] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:17 2022] PUT /identity/v3/projects/79df195683464266bbf9cc62745231c0/users/b7133b218dde41fc9d7d3503734ebae5/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:18.018248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bea072-1b9e-4e27-8e70-ffcfb9086bef None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:18.018547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bea072-1b9e-4e27-8e70-ffcfb9086bef None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:18.018824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bea072-1b9e-4e27-8e70-ffcfb9086bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:18.059598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d4bea072-1b9e-4e27-8e70-ffcfb9086bef None None] MFA Rules not processed for user `b7133b218dde41fc9d7d3503734ebae5`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:18.061764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d4bea072-1b9e-4e27-8e70-ffcfb9086bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:18.174409 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1952/3926] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:18.179608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b6b13-837c-4bc8-9768-a601923e97ff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:18.274452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b6b13-837c-4bc8-9768-a601923e97ff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:18.281163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50002f25-6b43-45fc-bbbf-699d2c60e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:18.281840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002f25-6b43-45fc-bbbf-699d2c60e16c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:18.282125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002f25-6b43-45fc-bbbf-699d2c60e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:18.282346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50002f25-6b43-45fc-bbbf-699d2c60e16c admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:18.283037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50002f25-6b43-45fc-bbbf-699d2c60e16c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:18.285586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50002f25-6b43-45fc-bbbf-699d2c60e16c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:18.331538 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1975/3927] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:18 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:18.336011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bea072-1b9e-4e27-8e70-ffcfb9086bef None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:18.353415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bea072-1b9e-4e27-8e70-ffcfb9086bef None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:18.456900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a8a0-6951-428d-a0bb-9f75f1c3f37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:18.457584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a8a0-6951-428d-a0bb-9f75f1c3f37e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:18.457862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a8a0-6951-428d-a0bb-9f75f1c3f37e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:18.458136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6a8a0-6951-428d-a0bb-9f75f1c3f37e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:18.458830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6a8a0-6951-428d-a0bb-9f75f1c3f37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:18.461850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6a8a0-6951-428d-a0bb-9f75f1c3f37e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:18.485698 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1953/3928] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:18 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:18.487425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50002f25-6b43-45fc-bbbf-699d2c60e16c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:18.499694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50002f25-6b43-45fc-bbbf-699d2c60e16c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:18.508381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0088abd-9729-4321-9b7f-95e24e4808fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:18.509912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0088abd-9729-4321-9b7f-95e24e4808fb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:18.510239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0088abd-9729-4321-9b7f-95e24e4808fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:18.510476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0088abd-9729-4321-9b7f-95e24e4808fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:18.511192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0088abd-9729-4321-9b7f-95e24e4808fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:18.513223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0088abd-9729-4321-9b7f-95e24e4808fb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:18.531121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a8a0-6951-428d-a0bb-9f75f1c3f37e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:18.533358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c6b6a8a0-6951-428d-a0bb-9f75f1c3f37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:18.542870 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1976/3929] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:58:18.544796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0088abd-9729-4321-9b7f-95e24e4808fb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:18.549095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6a8a0-6951-428d-a0bb-9f75f1c3f37e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:18.559180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:18.560375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:18.560900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:18.561307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] PATH_INFO: `/v3/users/75cdd0c73bcc473081b65958a7b1fbe6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:18.564900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cdd0c73bcc473081b65958a7b1fbe6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:18.565497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0088abd-9729-4321-9b7f-95e24e4808fb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:18.571373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f852ccf-e6a1-4622-84df-ef872780b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:18.574146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f852ccf-e6a1-4622-84df-ef872780b77e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:18.574673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f852ccf-e6a1-4622-84df-ef872780b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:18.574967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f852ccf-e6a1-4622-84df-ef872780b77e admin admin] PATH_INFO: `/v3/projects/f6cf8b3119f74db6ac88816116f7880c/users/53cc3327d6534d678884386bba7597d5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:18.576775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:18.595755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f852ccf-e6a1-4622-84df-ef872780b77e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cf8b3119f74db6ac88816116f7880c, user_id=53cc3327d6534d678884386bba7597d5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:18.598617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f852ccf-e6a1-4622-84df-ef872780b77e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:18.621979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1977/3930] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:18 2022] PUT /identity/v3/projects/f6cf8b3119f74db6ac88816116f7880c/users/53cc3327d6534d678884386bba7597d5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:18.624228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f852ccf-e6a1-4622-84df-ef872780b77e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:18.679832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cdd0c73bcc473081b65958a7b1fbe6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:18.690171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cdd0c73bcc473081b65958a7b1fbe6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:18.690922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cdd0c73bcc473081b65958a7b1fbe6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:18.691975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cdd0c73bcc473081b65958a7b1fbe6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:18.730315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cdd0c73bcc473081b65958a7b1fbe6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:18.739820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f852ccf-e6a1-4622-84df-ef872780b77e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:18.746339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c52df4-29a7-4815-9a5a-6703dcb70c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:18.752564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52df4-29a7-4815-9a5a-6703dcb70c69 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:18.753092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52df4-29a7-4815-9a5a-6703dcb70c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:18.753454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c52df4-29a7-4815-9a5a-6703dcb70c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:18.754251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52df4-29a7-4815-9a5a-6703dcb70c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:18.758773 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1954/3931] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:18 2022] DELETE /identity/v3/users/75cdd0c73bcc473081b65958a7b1fbe6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:18.758912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c52df4-29a7-4815-9a5a-6703dcb70c69 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:18.788667 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1978/3932] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:58:18.793238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:18.795835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:18.891665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4467987-1326-4130-8cd9-4b2f207e0739 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:18.900134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9af67f-c650-4def-a819-110bb98e347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:18.901181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9af67f-c650-4def-a819-110bb98e347f admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:18.901496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9af67f-c650-4def-a819-110bb98e347f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:18.901740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9af67f-c650-4def-a819-110bb98e347f admin admin] PATH_INFO: `/v3/projects/f6cf8b3119f74db6ac88816116f7880c/users/53cc3327d6534d678884386bba7597d5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:18.907323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9af67f-c650-4def-a819-110bb98e347f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6cf8b3119f74db6ac88816116f7880c, user_id=53cc3327d6534d678884386bba7597d5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:18.910221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9af67f-c650-4def-a819-110bb98e347f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:18.937373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7b89-1cfc-49dc-9f74-f954d3a53556 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:18.937777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7b89-1cfc-49dc-9f74-f954d3a53556 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:18.938062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a7b89-1cfc-49dc-9f74-f954d3a53556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:18.940402 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1955/3933] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:18 2022] PUT /identity/v3/projects/f6cf8b3119f74db6ac88816116f7880c/users/53cc3327d6534d678884386bba7597d5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:18.988022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dd2a7b89-1cfc-49dc-9f74-f954d3a53556 None None] MFA Rules not processed for user `53cc3327d6534d678884386bba7597d5`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:18.990669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dd2a7b89-1cfc-49dc-9f74-f954d3a53556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:19.087866 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1979/3934] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:19.093432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9af67f-c650-4def-a819-110bb98e347f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.114530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9af67f-c650-4def-a819-110bb98e347f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.132618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:19.133413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.133768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.134437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.135721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:19.139971 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:19.139971 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 20:58:19.139971 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 20:58:19.141152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:19.190371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7b89-1cfc-49dc-9f74-f954d3a53556 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.192128 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1956/3935] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Mar 26 20:58:19 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:58:19.193666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.203819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a7b89-1cfc-49dc-9f74-f954d3a53556 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.204903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:19.232876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ef26-88c3-4dfe-ab75-cd18cb1ff4a4 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:19.233775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ef26-88c3-4dfe-ab75-cd18cb1ff4a4 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.234055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ef26-88c3-4dfe-ab75-cd18cb1ff4a4 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.234250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e6ef26-88c3-4dfe-ab75-cd18cb1ff4a4 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b163291be7814261b6eb6b6c609d879a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.237843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ef26-88c3-4dfe-ab75-cd18cb1ff4a4 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=b163291be7814261b6eb6b6c609d879a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:19.260098 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-01e6ef26-88c3-4dfe-ab75-cd18cb1ff4a4 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:19.260098 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:58:19.260098 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:58:19.264165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e6ef26-88c3-4dfe-ab75-cd18cb1ff4a4 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:19.288979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1980/3936] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:58:19 2022] GET /identity/v3/OS-OAUTH1/consumers/b163291be7814261b6eb6b6c609d879a => generated 221 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:58:19.291670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ef26-88c3-4dfe-ab75-cd18cb1ff4a4 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.316900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e6ef26-88c3-4dfe-ab75-cd18cb1ff4a4 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.332607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:19.335026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.335492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.336102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b163291be7814261b6eb6b6c609d879a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.339768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b163291be7814261b6eb6b6c609d879a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:19.341445 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:19.341445 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:58:19.341445 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:58:19.342620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:19.344294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invalidating token cache because consumer b163291be7814261b6eb6b6c609d879a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:19.347865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.350408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.386680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6216a-23f8-4da1-b661-2639b1f2d94e tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.399593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:19.403685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.405137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.406776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] PATH_INFO: `/v3/projects/c7b56cae79f846b5b6f3700480cfc811` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.409037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b56cae79f846b5b6f3700480cfc811)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:19.409182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b163291be7814261b6eb6b6c609d879a', 'request_id': 'req-7523b4b8-50b5-485a-9da6-7afe42dc10c5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.412807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:19.445727 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1981/3937] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:58:19 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b163291be7814261b6eb6b6c609d879a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:19.450819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.457674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:19.499401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b56cae79f846b5b6f3700480cfc811', 'request_id': 'req-19dadb40-0324-4eed-ad60-495fbeddc84d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.505681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523b4b8-50b5-485a-9da6-7afe42dc10c5 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.515846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b56cae79f846b5b6f3700480cfc811', 'request_id': 'req-19dadb40-0324-4eed-ad60-495fbeddc84d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.536072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b56cae79f846b5b6f3700480cfc811', 'request_id': 'req-19dadb40-0324-4eed-ad60-495fbeddc84d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.582503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] The token cache is being invalidate because project c7b56cae79f846b5b6f3700480cfc811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:19.582860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.584892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-19dadb40-0324-4eed-ad60-495fbeddc84d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.595622 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1957/3938] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:19 2022] DELETE /identity/v3/projects/c7b56cae79f846b5b6f3700480cfc811 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:19.600640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631abbee-3aa8-46cc-930f-f51c6510ff54 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.601115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631abbee-3aa8-46cc-930f-f51c6510ff54 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.601402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631abbee-3aa8-46cc-930f-f51c6510ff54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.659175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-631abbee-3aa8-46cc-930f-f51c6510ff54 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:19.662232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-631abbee-3aa8-46cc-930f-f51c6510ff54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:19.728555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:19.729235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.729550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.729837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.730614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:19.731694 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:19.731694 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:58:19.731694 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:58:19.732651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:19.774209 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1982/3939] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Mar 26 20:58:19 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:19.780999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.792878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:19.832730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee97966-68c7-4e59-99e9-1b931ff5c4d1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.849172 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1958/3940] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:19.850955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d03b84-8418-4767-a182-bcd83a207dde None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.851259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d03b84-8418-4767-a182-bcd83a207dde None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.851661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d03b84-8418-4767-a182-bcd83a207dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.857787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c072861-a454-4928-81c0-bfff8543d481 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:19.858626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c072861-a454-4928-81c0-bfff8543d481 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.858915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c072861-a454-4928-81c0-bfff8543d481 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.859196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c072861-a454-4928-81c0-bfff8543d481 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/35577c2e2ae54563b2b329991801963a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.859865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c072861-a454-4928-81c0-bfff8543d481 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=35577c2e2ae54563b2b329991801963a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:19.861521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c072861-a454-4928-81c0-bfff8543d481 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:19.876976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f0d03b84-8418-4767-a182-bcd83a207dde None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:19.881056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f0d03b84-8418-4767-a182-bcd83a207dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:19.882343 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1983/3941] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:58:19 2022] GET /identity/v3/OS-OAUTH1/consumers/35577c2e2ae54563b2b329991801963a => generated 220 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:19.887008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c072861-a454-4928-81c0-bfff8543d481 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.906656 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1959/3942] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:19.907615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d03b84-8418-4767-a182-bcd83a207dde None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.909651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c072861-a454-4928-81c0-bfff8543d481 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.923603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:19.925126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.925596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.926059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/35577c2e2ae54563b2b329991801963a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.926893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=35577c2e2ae54563b2b329991801963a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:19.928797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:19.929014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d03b84-8418-4767-a182-bcd83a207dde None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.929453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invalidating token cache because consumer 35577c2e2ae54563b2b329991801963a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:19.929920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.930803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.935958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:19.936633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:19.936924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:19.938084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:19.938831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:19.939145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:19.941711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:19.946134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '35577c2e2ae54563b2b329991801963a', 'request_id': 'req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:19.966650 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1960/3943] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:19.971199 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1984/3944] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:58:19 2022] DELETE /identity/v3/OS-OAUTH1/consumers/35577c2e2ae54563b2b329991801963a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:58:19.972022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.973329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:19.975233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:19.977088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:19.992585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea529143-2d3f-4dc0-8123-8b0bb0b874bd tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.996024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9988c99f-318f-4535-a47d-ef141938bca6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:19.999854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7289b-69ec-48db-97d1-dd6902c4b74d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.000843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7289b-69ec-48db-97d1-dd6902c4b74d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.001297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7289b-69ec-48db-97d1-dd6902c4b74d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.001643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7289b-69ec-48db-97d1-dd6902c4b74d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/35577c2e2ae54563b2b329991801963a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.002288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7289b-69ec-48db-97d1-dd6902c4b74d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=35577c2e2ae54563b2b329991801963a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.004648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7289b-69ec-48db-97d1-dd6902c4b74d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.006828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c83011-e350-4ee7-b7f5-149982d0a744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.009884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c83011-e350-4ee7-b7f5-149982d0a744 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.010604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c83011-e350-4ee7-b7f5-149982d0a744 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.011270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c83011-e350-4ee7-b7f5-149982d0a744 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.012328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c83011-e350-4ee7-b7f5-149982d0a744 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.015380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c83011-e350-4ee7-b7f5-149982d0a744 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.021470 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-34a7289b-69ec-48db-97d1-dd6902c4b74d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Mar 26 20:58:20.023970 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1985/3945] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:58:19 2022] GET /identity/v3/OS-OAUTH1/consumers/35577c2e2ae54563b2b329991801963a => generated 74 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:58:20.028339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7289b-69ec-48db-97d1-dd6902c4b74d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.041328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7289b-69ec-48db-97d1-dd6902c4b74d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.048424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.050767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.051215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.052401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/35577c2e2ae54563b2b329991801963a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.054642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=35577c2e2ae54563b2b329991801963a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.071259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.074286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invalidating token cache because consumer 35577c2e2ae54563b2b329991801963a has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:20.075703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.078466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.082480 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1961/3946] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:19 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:20.088109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c83011-e350-4ee7-b7f5-149982d0a744 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.089849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b1c83011-e350-4ee7-b7f5-149982d0a744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:20.117827 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Mar 26 20:58:20.124223 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1986/3947] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:58:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/35577c2e2ae54563b2b329991801963a => generated 74 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 20:58:20.126883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.128592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:20.146237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf9f3b-665e-486e-b288-3b8c9f70bb0d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.182520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c83011-e350-4ee7-b7f5-149982d0a744 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.189039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862cc98-f31c-4234-ae3e-2da145860dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.189772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862cc98-f31c-4234-ae3e-2da145860dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.190081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862cc98-f31c-4234-ae3e-2da145860dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.190346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862cc98-f31c-4234-ae3e-2da145860dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.191049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862cc98-f31c-4234-ae3e-2da145860dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.193156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862cc98-f31c-4234-ae3e-2da145860dd3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.217196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fc629-b681-484e-b876-bafd5e623d69 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.218202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fc629-b681-484e-b876-bafd5e623d69 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.218597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fc629-b681-484e-b876-bafd5e623d69 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.218982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fc629-b681-484e-b876-bafd5e623d69 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.219809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fc629-b681-484e-b876-bafd5e623d69 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.221721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fc629-b681-484e-b876-bafd5e623d69 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.222831 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1962/3948] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:20 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:58:20.223812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862cc98-f31c-4234-ae3e-2da145860dd3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.245727 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1987/3949] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Mar 26 20:58:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:20.249778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fc629-b681-484e-b876-bafd5e623d69 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.259515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862cc98-f31c-4234-ae3e-2da145860dd3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.267634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd777d-6799-418f-ae9f-8cc03065e890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.268378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd777d-6799-418f-ae9f-8cc03065e890 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.268667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd777d-6799-418f-ae9f-8cc03065e890 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.268955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd777d-6799-418f-ae9f-8cc03065e890 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.269742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd777d-6799-418f-ae9f-8cc03065e890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.272839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd777d-6799-418f-ae9f-8cc03065e890 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.282142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fc629-b681-484e-b876-bafd5e623d69 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.291004 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1963/3950] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:20.292205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd777d-6799-418f-ae9f-8cc03065e890 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.296823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b261c29-4508-4716-96ca-45d46c82c363 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.298573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b261c29-4508-4716-96ca-45d46c82c363 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.298970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b261c29-4508-4716-96ca-45d46c82c363 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.300141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b261c29-4508-4716-96ca-45d46c82c363 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.302075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b261c29-4508-4716-96ca-45d46c82c363 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.307023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd777d-6799-418f-ae9f-8cc03065e890 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.309238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b261c29-4508-4716-96ca-45d46c82c363 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.327139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7644d3c-7681-4ef8-989f-916c2eede1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.327835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7644d3c-7681-4ef8-989f-916c2eede1bf admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.329071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7644d3c-7681-4ef8-989f-916c2eede1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.335833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7644d3c-7681-4ef8-989f-916c2eede1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.335833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7644d3c-7681-4ef8-989f-916c2eede1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.336658 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1988/3951] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Mar 26 20:58:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:58:20.337096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7644d3c-7681-4ef8-989f-916c2eede1bf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.340459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b261c29-4508-4716-96ca-45d46c82c363 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.359948 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1964/3952] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:20.362704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b261c29-4508-4716-96ca-45d46c82c363 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.364455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7644d3c-7681-4ef8-989f-916c2eede1bf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.375893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429e27-ec2b-4647-851e-0661ecd4bbbe tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.377363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429e27-ec2b-4647-851e-0661ecd4bbbe tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.377877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429e27-ec2b-4647-851e-0661ecd4bbbe tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.378565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74429e27-ec2b-4647-851e-0661ecd4bbbe tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.379564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7644d3c-7681-4ef8-989f-916c2eede1bf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.379872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74429e27-ec2b-4647-851e-0661ecd4bbbe tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.383423 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-74429e27-ec2b-4647-851e-0661ecd4bbbe tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:20.383423 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:58:20.383423 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:58:20.385781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74429e27-ec2b-4647-851e-0661ecd4bbbe tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.398788 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1989/3953] 10.222.0.16 () {58 vars in 1163 bytes} [Sat Mar 26 20:58:20 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:20.399739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429e27-ec2b-4647-851e-0661ecd4bbbe tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.408354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eead02-fd83-4a78-aa97-a3cb44157004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.410030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eead02-fd83-4a78-aa97-a3cb44157004 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.410371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eead02-fd83-4a78-aa97-a3cb44157004 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.410672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eead02-fd83-4a78-aa97-a3cb44157004 admin admin] PATH_INFO: `/v3/projects/dff0b12b0e8843e99f5aac63876e13fb/users/3cb495ec547743d38a7502110a166b1a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.424859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74429e27-ec2b-4647-851e-0661ecd4bbbe tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.440475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.442310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.442310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.442310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/151780a3def34179abc25f6b8d8a3d86` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.445922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=151780a3def34179abc25f6b8d8a3d86)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.449878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.450706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invalidating token cache because consumer 151780a3def34179abc25f6b8d8a3d86 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:20.451883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.453280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eead02-fd83-4a78-aa97-a3cb44157004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff0b12b0e8843e99f5aac63876e13fb, user_id=3cb495ec547743d38a7502110a166b1a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.456003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eead02-fd83-4a78-aa97-a3cb44157004 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.456572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.478916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '151780a3def34179abc25f6b8d8a3d86', 'request_id': 'req-81205eb3-e05a-462a-9888-7bb33d94df1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.490443 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1965/3954] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:20 2022] PUT /identity/v3/projects/dff0b12b0e8843e99f5aac63876e13fb/users/3cb495ec547743d38a7502110a166b1a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:20.496643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff325-cf41-47b8-8fe3-725665bc7a57 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.500061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff325-cf41-47b8-8fe3-725665bc7a57 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.502256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aff325-cf41-47b8-8fe3-725665bc7a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.512242 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1990/3955] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:58:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/151780a3def34179abc25f6b8d8a3d86 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:20.524498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.528486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:20.536504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-35aff325-cf41-47b8-8fe3-725665bc7a57 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:20.538276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-35aff325-cf41-47b8-8fe3-725665bc7a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:20.564093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81205eb3-e05a-462a-9888-7bb33d94df1a tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.644789 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1966/3956] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:20.675110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff325-cf41-47b8-8fe3-725665bc7a57 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.677350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-35aff325-cf41-47b8-8fe3-725665bc7a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:20.682684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.683564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.683855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.687505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/75360864c1854c1dbd4b8cb7da81e85f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.688274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=75360864c1854c1dbd4b8cb7da81e85f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.693355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.693640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invalidating token cache because consumer 75360864c1854c1dbd4b8cb7da81e85f has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:20.694917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.696242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.714530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '75360864c1854c1dbd4b8cb7da81e85f', 'request_id': 'req-00d05a75-7add-4195-b1d7-83ebf83f068d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.742939 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1991/3957] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:58:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/75360864c1854c1dbd4b8cb7da81e85f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:20.744008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.746165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:20.768225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d05a75-7add-4195-b1d7-83ebf83f068d tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.776288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813ddc1-9595-4651-a350-03a4601d4ff1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.776288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813ddc1-9595-4651-a350-03a4601d4ff1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.776288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813ddc1-9595-4651-a350-03a4601d4ff1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.776610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813ddc1-9595-4651-a350-03a4601d4ff1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.777442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813ddc1-9595-4651-a350-03a4601d4ff1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.779817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813ddc1-9595-4651-a350-03a4601d4ff1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.803041 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1992/3958] 10.222.0.16 () {60 vars in 1184 bytes} [Sat Mar 26 20:58:20 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:20.804171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813ddc1-9595-4651-a350-03a4601d4ff1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.821593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813ddc1-9595-4651-a350-03a4601d4ff1 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.831468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395db0c9-11c3-4714-95d1-dac83c5a0f60 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.832379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395db0c9-11c3-4714-95d1-dac83c5a0f60 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.832677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395db0c9-11c3-4714-95d1-dac83c5a0f60 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.832960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395db0c9-11c3-4714-95d1-dac83c5a0f60 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/87f09d2904884bd8a58309b05b8e3fa5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.833194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aff325-cf41-47b8-8fe3-725665bc7a57 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.833695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395db0c9-11c3-4714-95d1-dac83c5a0f60 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=87f09d2904884bd8a58309b05b8e3fa5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.835554 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-395db0c9-11c3-4714-95d1-dac83c5a0f60 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 20:58:20.835554 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 20:58:20.835554 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:58:20.836672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395db0c9-11c3-4714-95d1-dac83c5a0f60 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.845434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.850671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.851430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.851722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.858879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:20.859466 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1993/3959] 10.222.0.16 () {60 vars in 1284 bytes} [Sat Mar 26 20:58:20 2022] PATCH /identity/v3/OS-OAUTH1/consumers/87f09d2904884bd8a58309b05b8e3fa5 => generated 220 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:20.860734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395db0c9-11c3-4714-95d1-dac83c5a0f60 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.872564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395db0c9-11c3-4714-95d1-dac83c5a0f60 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.878003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f927cd-a31d-4b0f-96d7-aaf585fc1928 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.878950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f927cd-a31d-4b0f-96d7-aaf585fc1928 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.879338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f927cd-a31d-4b0f-96d7-aaf585fc1928 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.879938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f927cd-a31d-4b0f-96d7-aaf585fc1928 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/87f09d2904884bd8a58309b05b8e3fa5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.880721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f927cd-a31d-4b0f-96d7-aaf585fc1928 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=87f09d2904884bd8a58309b05b8e3fa5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.883463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f927cd-a31d-4b0f-96d7-aaf585fc1928 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.895351 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1994/3960] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 20:58:20 2022] GET /identity/v3/OS-OAUTH1/consumers/87f09d2904884bd8a58309b05b8e3fa5 => generated 220 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:20.896041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.896615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f927cd-a31d-4b0f-96d7-aaf585fc1928 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.899315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.908388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f927cd-a31d-4b0f-96d7-aaf585fc1928 tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.914483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53cc3327d6534d678884386bba7597d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6cf8b3119f74db6ac88816116f7880c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.916772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.917801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.918206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/87f09d2904884bd8a58309b05b8e3fa5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.918989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=87f09d2904884bd8a58309b05b8e3fa5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.921060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:20.921447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invalidating token cache because consumer 87f09d2904884bd8a58309b05b8e3fa5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:20.921836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.922675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.935147 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1967/3961] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:20.936235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a1da9240-9963-4e9b-964b-e521401a811b tempest-OAUTHConsumersV3Test-501605653 tempest-OAUTHConsumersV3Test-501605653-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '87f09d2904884bd8a58309b05b8e3fa5', 'request_id': 'req-a1da9240-9963-4e9b-964b-e521401a811b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:20.958168 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1995/3962] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 20:58:20 2022] DELETE /identity/v3/OS-OAUTH1/consumers/87f09d2904884bd8a58309b05b8e3fa5 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:20.958687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:20.960913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:20.980272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a13cb-04fc-4819-a0b7-6fa8377628b9 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:20.986556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:20.988175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:20.988469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:20.988752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] PATH_INFO: `/v3/users/b7133b218dde41fc9d7d3503734ebae5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:20.990908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7133b218dde41fc9d7d3503734ebae5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:20.992951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:21.111612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7133b218dde41fc9d7d3503734ebae5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.126055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7133b218dde41fc9d7d3503734ebae5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.127585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7133b218dde41fc9d7d3503734ebae5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.128406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7133b218dde41fc9d7d3503734ebae5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.152564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7133b218dde41fc9d7d3503734ebae5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.168026 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1968/3963] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:20 2022] DELETE /identity/v3/users/b7133b218dde41fc9d7d3503734ebae5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:58:21.172323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e19f2-10d3-4253-ba81-32aaba1ee011 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:21.172620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e19f2-10d3-4253-ba81-32aaba1ee011 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:21.172906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e19f2-10d3-4253-ba81-32aaba1ee011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:21.192118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d26e19f2-10d3-4253-ba81-32aaba1ee011 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:21.193646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d26e19f2-10d3-4253-ba81-32aaba1ee011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:21.279522 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1996/3964] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:58:21.292242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:21.294153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:21.392365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b7652-5c98-46b3-a909-31328e14c9fd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:21.395728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5d4fa-0e98-4659-b1a0-12a1e8352164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:21.396475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d4fa-0e98-4659-b1a0-12a1e8352164 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:21.396773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d4fa-0e98-4659-b1a0-12a1e8352164 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:21.397074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d4fa-0e98-4659-b1a0-12a1e8352164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:21.407997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5d4fa-0e98-4659-b1a0-12a1e8352164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:21.409465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5d4fa-0e98-4659-b1a0-12a1e8352164 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:21.423347 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1969/3965] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:21.723050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e19f2-10d3-4253-ba81-32aaba1ee011 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:21.725679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d26e19f2-10d3-4253-ba81-32aaba1ee011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:21.741565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e19f2-10d3-4253-ba81-32aaba1ee011 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:21.747030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:21.747909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:21.748345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:21.748665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] PATH_INFO: `/v3/users/0c30a9434cd34f4a92ec3657d9cbbc4f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:21.750011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c30a9434cd34f4a92ec3657d9cbbc4f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:21.754141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:21.840444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c30a9434cd34f4a92ec3657d9cbbc4f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.854226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c30a9434cd34f4a92ec3657d9cbbc4f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.856946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c30a9434cd34f4a92ec3657d9cbbc4f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.860592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c30a9434cd34f4a92ec3657d9cbbc4f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.871495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c30a9434cd34f4a92ec3657d9cbbc4f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:21.894802 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1997/3966] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:21 2022] DELETE /identity/v3/users/0c30a9434cd34f4a92ec3657d9cbbc4f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:21.900050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11725b2c-7887-41d0-9993-7129ec6ca1bd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:21.900540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11725b2c-7887-41d0-9993-7129ec6ca1bd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:21.900609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11725b2c-7887-41d0-9993-7129ec6ca1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:21.921791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-11725b2c-7887-41d0-9993-7129ec6ca1bd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:21.923302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-11725b2c-7887-41d0-9993-7129ec6ca1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:21.965934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:21.968188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:22.057988 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1970/3967] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:22.085715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7629e-90ac-4547-87e7-88eea05d9b5f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:22.090911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11725b2c-7887-41d0-9993-7129ec6ca1bd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:22.092210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:22.092573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-11725b2c-7887-41d0-9993-7129ec6ca1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:22.093789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:22.094400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:22.094879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] PATH_INFO: `/v3/projects/79df195683464266bbf9cc62745231c0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:22.097682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79df195683464266bbf9cc62745231c0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:22.100732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:22.169688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79df195683464266bbf9cc62745231c0', 'request_id': 'req-96a21bbf-a9e8-483d-b53a-5cec224c64f5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.181551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79df195683464266bbf9cc62745231c0', 'request_id': 'req-96a21bbf-a9e8-483d-b53a-5cec224c64f5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.198816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79df195683464266bbf9cc62745231c0', 'request_id': 'req-96a21bbf-a9e8-483d-b53a-5cec224c64f5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.214657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] The token cache is being invalidate because project 79df195683464266bbf9cc62745231c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:22.215108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.215312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11725b2c-7887-41d0-9993-7129ec6ca1bd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:22.216007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.218271 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1998/3968] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:21 2022] DELETE /identity/v3/projects/79df195683464266bbf9cc62745231c0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:22.222219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:22.225733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:22.314386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a21bbf-a9e8-483d-b53a-5cec224c64f5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:22.318269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:22.319339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:22.319819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:22.320260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:22.320811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:22.320922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:22.321222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:22.321561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] PATH_INFO: `/v3/users/53cc3327d6534d678884386bba7597d5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:22.323313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53cc3327d6534d678884386bba7597d5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:22.324423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:22.325663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:22.348940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:22.351571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:22.364080 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1971/3969] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:22.403312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53cc3327d6534d678884386bba7597d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.413853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53cc3327d6534d678884386bba7597d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.415609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53cc3327d6534d678884386bba7597d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.416627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53cc3327d6534d678884386bba7597d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.427799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d3f42996-a3eb-4fb2-8612-005fc509dfc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53cc3327d6534d678884386bba7597d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:22.453496 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 1999/3970] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:22 2022] DELETE /identity/v3/users/53cc3327d6534d678884386bba7597d5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:23.401227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:23.403505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:23.433478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bdea0e-0d12-4630-8637-7a61d939d2a8 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:23.591763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:23.592888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:23.593173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:23.593450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] PATH_INFO: `/v3/projects/23327f0f8a7b433b884f61312794cfeb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:23.594692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23327f0f8a7b433b884f61312794cfeb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:23.597283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:23.680406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23327f0f8a7b433b884f61312794cfeb', 'request_id': 'req-7af9bf05-3031-43f6-8d6f-570c52c74826'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:23.691346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23327f0f8a7b433b884f61312794cfeb', 'request_id': 'req-7af9bf05-3031-43f6-8d6f-570c52c74826'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:23.702284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23327f0f8a7b433b884f61312794cfeb', 'request_id': 'req-7af9bf05-3031-43f6-8d6f-570c52c74826'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:23.721735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] The token cache is being invalidate because project 23327f0f8a7b433b884f61312794cfeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:23.722043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:23.722734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7af9bf05-3031-43f6-8d6f-570c52c74826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:23.728998 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1972/3971] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:23 2022] DELETE /identity/v3/projects/23327f0f8a7b433b884f61312794cfeb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:23.731288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad781f-9b3c-43e9-9dbf-b83539ffbfe9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:23.732056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad781f-9b3c-43e9-9dbf-b83539ffbfe9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:23.732407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad781f-9b3c-43e9-9dbf-b83539ffbfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:23.772142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a7ad781f-9b3c-43e9-9dbf-b83539ffbfe9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:23.773814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a7ad781f-9b3c-43e9-9dbf-b83539ffbfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:23.950834 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2000/3972] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:23.959352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972962f1-b110-4e4f-b831-493fea1ab8f2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:23.959998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972962f1-b110-4e4f-b831-493fea1ab8f2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:23.961041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972962f1-b110-4e4f-b831-493fea1ab8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.002561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-972962f1-b110-4e4f-b831-493fea1ab8f2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:24.004268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-972962f1-b110-4e4f-b831-493fea1ab8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:24.039393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1973/3973] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:24.043382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad781f-9b3c-43e9-9dbf-b83539ffbfe9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:24.055910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad781f-9b3c-43e9-9dbf-b83539ffbfe9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:24.064007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002027e3-e680-4157-a1bf-3f2ee498585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:24.065445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002027e3-e680-4157-a1bf-3f2ee498585a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.067292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002027e3-e680-4157-a1bf-3f2ee498585a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.067801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002027e3-e680-4157-a1bf-3f2ee498585a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.069789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002027e3-e680-4157-a1bf-3f2ee498585a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:24.070343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002027e3-e680-4157-a1bf-3f2ee498585a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:24.072673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002027e3-e680-4157-a1bf-3f2ee498585a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:24.097164 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2001/3974] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:24.101956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972962f1-b110-4e4f-b831-493fea1ab8f2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:24.119959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972962f1-b110-4e4f-b831-493fea1ab8f2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:24.128191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e89477-6c91-45b1-a534-cfe9c186e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:24.129188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e89477-6c91-45b1-a534-cfe9c186e6ba admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.129479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e89477-6c91-45b1-a534-cfe9c186e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.129772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e89477-6c91-45b1-a534-cfe9c186e6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.130949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e89477-6c91-45b1-a534-cfe9c186e6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:24.134438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e89477-6c91-45b1-a534-cfe9c186e6ba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:24.172277 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1974/3975] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:24 2022] POST /identity/v3/projects => generated 401 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:24.176204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002027e3-e680-4157-a1bf-3f2ee498585a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:24.190239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002027e3-e680-4157-a1bf-3f2ee498585a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:24.191613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e89477-6c91-45b1-a534-cfe9c186e6ba admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:24.193301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e4e89477-6c91-45b1-a534-cfe9c186e6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:24.286653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb8051-e502-408d-a348-d95c3d541a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:24.287346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb8051-e502-408d-a348-d95c3d541a12 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.287647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb8051-e502-408d-a348-d95c3d541a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.288242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb8051-e502-408d-a348-d95c3d541a12 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.288947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb8051-e502-408d-a348-d95c3d541a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:24.290911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb8051-e502-408d-a348-d95c3d541a12 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:24.321775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2002/3976] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:24 2022] POST /identity/v3/users => generated 301 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:24.328846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb8051-e502-408d-a348-d95c3d541a12 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:24.332882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e89477-6c91-45b1-a534-cfe9c186e6ba admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:24.339821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:24.340938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.343627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.343941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] PATH_INFO: `/v3/projects/f6cf8b3119f74db6ac88816116f7880c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.344991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb8051-e502-408d-a348-d95c3d541a12 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:24.345465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6cf8b3119f74db6ac88816116f7880c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:24.347980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:24.352627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bbef4-751f-4250-8dfb-33c3cada2aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:24.352627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bbef4-751f-4250-8dfb-33c3cada2aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.352627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bbef4-751f-4250-8dfb-33c3cada2aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.352935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bbef4-751f-4250-8dfb-33c3cada2aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.369781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bbef4-751f-4250-8dfb-33c3cada2aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:24.372699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bbef4-751f-4250-8dfb-33c3cada2aa9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:24.393896 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2003/3977] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:24.398496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bbef4-751f-4250-8dfb-33c3cada2aa9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:24.416971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bbef4-751f-4250-8dfb-33c3cada2aa9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:24.447830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a73248-7f7f-4d88-ae18-15c5ccb0fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:24.449319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a73248-7f7f-4d88-ae18-15c5ccb0fe22 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.452005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a73248-7f7f-4d88-ae18-15c5ccb0fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.452691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a73248-7f7f-4d88-ae18-15c5ccb0fe22 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.453916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a73248-7f7f-4d88-ae18-15c5ccb0fe22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:24.456740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a73248-7f7f-4d88-ae18-15c5ccb0fe22 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:24.477388 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2004/3978] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:24.481201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a73248-7f7f-4d88-ae18-15c5ccb0fe22 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:24.495484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a73248-7f7f-4d88-ae18-15c5ccb0fe22 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:24.504169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6cf8b3119f74db6ac88816116f7880c', 'request_id': 'req-2b3dcfb1-1900-4589-a93b-32703d0e43b9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:24.524647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6cf8b3119f74db6ac88816116f7880c', 'request_id': 'req-2b3dcfb1-1900-4589-a93b-32703d0e43b9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:24.537098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6cf8b3119f74db6ac88816116f7880c', 'request_id': 'req-2b3dcfb1-1900-4589-a93b-32703d0e43b9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:24.553886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] The token cache is being invalidate because project f6cf8b3119f74db6ac88816116f7880c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:24.554473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:24.556039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b3dcfb1-1900-4589-a93b-32703d0e43b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:24.558755 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1975/3979] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:24 2022] DELETE /identity/v3/projects/f6cf8b3119f74db6ac88816116f7880c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:24.569541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c420b-574f-455e-910d-0d4ca19b2231 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.572348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c420b-574f-455e-910d-0d4ca19b2231 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.572745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c420b-574f-455e-910d-0d4ca19b2231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.630904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-528c420b-574f-455e-910d-0d4ca19b2231 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:24.634100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-528c420b-574f-455e-910d-0d4ca19b2231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:24.655781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5545c-e447-45e1-8068-82c22a0ee6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:24.658206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5545c-e447-45e1-8068-82c22a0ee6a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.660473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5545c-e447-45e1-8068-82c22a0ee6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.661768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5545c-e447-45e1-8068-82c22a0ee6a6 admin admin] PATH_INFO: `/v3/projects/5528600a6ba948aa9c4f6bd131569d3c/users/cd7c9dfb7f82412793f720486265a5bc/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.689669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5545c-e447-45e1-8068-82c22a0ee6a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5528600a6ba948aa9c4f6bd131569d3c, user_id=cd7c9dfb7f82412793f720486265a5bc, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:24.697461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5545c-e447-45e1-8068-82c22a0ee6a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:24.730678 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2005/3980] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:24 2022] PUT /identity/v3/projects/5528600a6ba948aa9c4f6bd131569d3c/users/cd7c9dfb7f82412793f720486265a5bc/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:24.732879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618c2bc-1be5-4c49-9b72-c18efde5e590 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.733449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618c2bc-1be5-4c49-9b72-c18efde5e590 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.733658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1618c2bc-1be5-4c49-9b72-c18efde5e590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.776747 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1976/3981] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:24.778062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1618c2bc-1be5-4c49-9b72-c18efde5e590 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:24.779553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1618c2bc-1be5-4c49-9b72-c18efde5e590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:24.786692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0663c4d-c4f4-4db3-a886-5d99146dc557 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.787126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0663c4d-c4f4-4db3-a886-5d99146dc557 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.788263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0663c4d-c4f4-4db3-a886-5d99146dc557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:24.838659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f0663c4d-c4f4-4db3-a886-5d99146dc557 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:24.841285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f0663c4d-c4f4-4db3-a886-5d99146dc557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:24.934616 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2006/3982] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:24.961018 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1977/3983] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:24.965578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618c2bc-1be5-4c49-9b72-c18efde5e590 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:24.975708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0663c4d-c4f4-4db3-a886-5d99146dc557 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:24.979549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1618c2bc-1be5-4c49-9b72-c18efde5e590 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:24.981256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f0663c4d-c4f4-4db3-a886-5d99146dc557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:24.995887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679e26d-83bc-4f68-9b92-a64f438cd97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:24.997700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679e26d-83bc-4f68-9b92-a64f438cd97e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:24.997982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679e26d-83bc-4f68-9b92-a64f438cd97e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:24.998246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679e26d-83bc-4f68-9b92-a64f438cd97e admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:25.016965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679e26d-83bc-4f68-9b92-a64f438cd97e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:25.026987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679e26d-83bc-4f68-9b92-a64f438cd97e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:25.028703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679e26d-83bc-4f68-9b92-a64f438cd97e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:25.072294 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2007/3984] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:25.076603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679e26d-83bc-4f68-9b92-a64f438cd97e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:25.100596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679e26d-83bc-4f68-9b92-a64f438cd97e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:25.125606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800e65-55ea-4bd8-96c8-1a088097fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:25.126280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800e65-55ea-4bd8-96c8-1a088097fb19 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:25.126562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800e65-55ea-4bd8-96c8-1a088097fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:25.127122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12800e65-55ea-4bd8-96c8-1a088097fb19 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:25.128582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12800e65-55ea-4bd8-96c8-1a088097fb19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:25.139295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12800e65-55ea-4bd8-96c8-1a088097fb19 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:25.168988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0663c4d-c4f4-4db3-a886-5d99146dc557 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:25.178914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fc8bf-a34c-4ca3-a0ca-5fcd0207b04a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:25.183992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc8bf-a34c-4ca3-a0ca-5fcd0207b04a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:25.186674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc8bf-a34c-4ca3-a0ca-5fcd0207b04a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:25.186674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167fc8bf-a34c-4ca3-a0ca-5fcd0207b04a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:25.210035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fc8bf-a34c-4ca3-a0ca-5fcd0207b04a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:25.211521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167fc8bf-a34c-4ca3-a0ca-5fcd0207b04a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:25.242825 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1978/3985] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:25.255600 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2008/3986] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:25 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:58:25.260171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fc8bf-a34c-4ca3-a0ca-5fcd0207b04a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:25.275594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167fc8bf-a34c-4ca3-a0ca-5fcd0207b04a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:25.406432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d6801-5d93-4569-9f36-e70e7428f779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:25.408420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d6801-5d93-4569-9f36-e70e7428f779 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:25.409056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d6801-5d93-4569-9f36-e70e7428f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:25.409534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d6801-5d93-4569-9f36-e70e7428f779 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:25.410529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d6801-5d93-4569-9f36-e70e7428f779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:25.419615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d6801-5d93-4569-9f36-e70e7428f779 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:25.489473 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1979/3987] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:25 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:25.493327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800e65-55ea-4bd8-96c8-1a088097fb19 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:25.520413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12800e65-55ea-4bd8-96c8-1a088097fb19 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:25.539986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7fe4d-3c0f-45ff-b140-33fb6ceed42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:25.541223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7fe4d-3c0f-45ff-b140-33fb6ceed42b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:25.542101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7fe4d-3c0f-45ff-b140-33fb6ceed42b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:25.542760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7fe4d-3c0f-45ff-b140-33fb6ceed42b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:25.543898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7fe4d-3c0f-45ff-b140-33fb6ceed42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:25.547452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7fe4d-3c0f-45ff-b140-33fb6ceed42b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:25.574214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2009/3988] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:58:25.577282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d6801-5d93-4569-9f36-e70e7428f779 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:25.592760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d6801-5d93-4569-9f36-e70e7428f779 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:25.608000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbdf52-9564-41d2-b0d8-6ed30580a5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:25.609650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbdf52-9564-41d2-b0d8-6ed30580a5fa admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:25.611521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbdf52-9564-41d2-b0d8-6ed30580a5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:25.612142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbdf52-9564-41d2-b0d8-6ed30580a5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:25.614591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbdf52-9564-41d2-b0d8-6ed30580a5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:25.617979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccbdf52-9564-41d2-b0d8-6ed30580a5fa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:25.645103 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1980/3989] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:25.647731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7fe4d-3c0f-45ff-b140-33fb6ceed42b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:25.659280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7fe4d-3c0f-45ff-b140-33fb6ceed42b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:25.669133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6543c9-8ad3-4231-a6ed-c5e9381cc0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:25.670288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6543c9-8ad3-4231-a6ed-c5e9381cc0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:25.670714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6543c9-8ad3-4231-a6ed-c5e9381cc0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:25.671132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6543c9-8ad3-4231-a6ed-c5e9381cc0a6 admin admin] PATH_INFO: `/v3/projects/743a9e41705f4b6e8b2b823a6e196c8b/users/f13d03598d2244b684d821f3d27484c1/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:25.709240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6543c9-8ad3-4231-a6ed-c5e9381cc0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=743a9e41705f4b6e8b2b823a6e196c8b, user_id=f13d03598d2244b684d821f3d27484c1, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:25.712513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6543c9-8ad3-4231-a6ed-c5e9381cc0a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:25.733254 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2010/3990] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:25 2022] PUT /identity/v3/projects/743a9e41705f4b6e8b2b823a6e196c8b/users/f13d03598d2244b684d821f3d27484c1/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:25.743996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa802267-c705-4b31-bec6-ef198149fe79 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:25.744575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa802267-c705-4b31-bec6-ef198149fe79 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:25.744993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa802267-c705-4b31-bec6-ef198149fe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:25.797045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-aa802267-c705-4b31-bec6-ef198149fe79 None None] MFA Rules not processed for user `f13d03598d2244b684d821f3d27484c1`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:25.799029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aa802267-c705-4b31-bec6-ef198149fe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:25.887759 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1981/3991] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:25.892334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6543c9-8ad3-4231-a6ed-c5e9381cc0a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:25.994595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6543c9-8ad3-4231-a6ed-c5e9381cc0a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:26.000919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866075bc-c263-4952-8975-62b30eff5e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:26.002043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866075bc-c263-4952-8975-62b30eff5e45 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:26.002489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866075bc-c263-4952-8975-62b30eff5e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:26.002958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866075bc-c263-4952-8975-62b30eff5e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:26.003756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866075bc-c263-4952-8975-62b30eff5e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:26.024148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866075bc-c263-4952-8975-62b30eff5e45 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:26.075498 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2011/3992] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:25 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:26.075994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa802267-c705-4b31-bec6-ef198149fe79 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:26.089107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa802267-c705-4b31-bec6-ef198149fe79 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:26.167899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9ebd-b6bd-4c0c-8fd4-4260d6eedfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:26.168809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9ebd-b6bd-4c0c-8fd4-4260d6eedfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:26.169647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9ebd-b6bd-4c0c-8fd4-4260d6eedfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:26.169647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db9ebd-b6bd-4c0c-8fd4-4260d6eedfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:26.170577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db9ebd-b6bd-4c0c-8fd4-4260d6eedfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:26.172677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6db9ebd-b6bd-4c0c-8fd4-4260d6eedfc4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:26.217583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866075bc-c263-4952-8975-62b30eff5e45 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:26.219221 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1982/3993] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:26 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:26.233517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866075bc-c263-4952-8975-62b30eff5e45 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:26.248527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ca752-b082-42dd-8a35-11f34cf98d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:26.249218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ca752-b082-42dd-8a35-11f34cf98d96 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:26.249505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ca752-b082-42dd-8a35-11f34cf98d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:26.251097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ca752-b082-42dd-8a35-11f34cf98d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:26.251860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ca752-b082-42dd-8a35-11f34cf98d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:26.257934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1ca752-b082-42dd-8a35-11f34cf98d96 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:26.283082 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2012/3994] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:26.298128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9ebd-b6bd-4c0c-8fd4-4260d6eedfc4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:26.314707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6db9ebd-b6bd-4c0c-8fd4-4260d6eedfc4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:26.326624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6928af-394e-4ab6-9896-0c0fdd37c040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:26.327833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6928af-394e-4ab6-9896-0c0fdd37c040 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:26.328330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6928af-394e-4ab6-9896-0c0fdd37c040 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:26.328815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6928af-394e-4ab6-9896-0c0fdd37c040 admin admin] PATH_INFO: `/v3/projects/73b1584431b34845801c5b57babad400/users/a3918ccce9f644d2adda7c23703384b3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:26.366945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6928af-394e-4ab6-9896-0c0fdd37c040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b1584431b34845801c5b57babad400, user_id=a3918ccce9f644d2adda7c23703384b3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:26.370116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6928af-394e-4ab6-9896-0c0fdd37c040 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:26.403355 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1983/3995] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:26 2022] PUT /identity/v3/projects/73b1584431b34845801c5b57babad400/users/a3918ccce9f644d2adda7c23703384b3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:26.407353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ca752-b082-42dd-8a35-11f34cf98d96 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:26.421661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ca752-b082-42dd-8a35-11f34cf98d96 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:26.504744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f47efb-2793-40c6-9bf8-5a473aacd0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:26.533290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f47efb-2793-40c6-9bf8-5a473aacd0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:26.533593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f47efb-2793-40c6-9bf8-5a473aacd0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:26.533882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f47efb-2793-40c6-9bf8-5a473aacd0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:26.534642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f47efb-2793-40c6-9bf8-5a473aacd0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:26.541626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f47efb-2793-40c6-9bf8-5a473aacd0f3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:26.562368 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2013/3996] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:26.562807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6928af-394e-4ab6-9896-0c0fdd37c040 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:26.580286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6928af-394e-4ab6-9896-0c0fdd37c040 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:26.589077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcfe1ab-fbde-493f-9c92-1753726d85af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:26.590527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfe1ab-fbde-493f-9c92-1753726d85af admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:26.592347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfe1ab-fbde-493f-9c92-1753726d85af admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:26.593199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcfe1ab-fbde-493f-9c92-1753726d85af admin admin] PATH_INFO: `/v3/projects/73b1584431b34845801c5b57babad400/users/a3918ccce9f644d2adda7c23703384b3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:26.600717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfe1ab-fbde-493f-9c92-1753726d85af admin admin] RBAC: Authorizing `identity:create_grant(project_id=73b1584431b34845801c5b57babad400, user_id=a3918ccce9f644d2adda7c23703384b3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:26.604762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcfe1ab-fbde-493f-9c92-1753726d85af admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:26.631096 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1984/3997] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:26 2022] PUT /identity/v3/projects/73b1584431b34845801c5b57babad400/users/a3918ccce9f644d2adda7c23703384b3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:26.643798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e2db-7109-4134-bb16-dd8425f206b1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:26.644250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e2db-7109-4134-bb16-dd8425f206b1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:26.644616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553e2db-7109-4134-bb16-dd8425f206b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:26.690925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c553e2db-7109-4134-bb16-dd8425f206b1 None None] MFA Rules not processed for user `a3918ccce9f644d2adda7c23703384b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:26.692243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c553e2db-7109-4134-bb16-dd8425f206b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:26.748936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f0ac4-591d-48fe-9fa9-a14b206edca3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:26.749406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f0ac4-591d-48fe-9fa9-a14b206edca3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:26.749406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f0ac4-591d-48fe-9fa9-a14b206edca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:26.797865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4c2f0ac4-591d-48fe-9fa9-a14b206edca3 None None] MFA Rules not processed for user `70fab8e4c45d48ea8223a3acc60a5442`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:26.799138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4c2f0ac4-591d-48fe-9fa9-a14b206edca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:26.837216 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2014/3998] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:26.839240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553e2db-7109-4134-bb16-dd8425f206b1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:26.854660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553e2db-7109-4134-bb16-dd8425f206b1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:26.862137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b99616-f7c2-4cfc-9c2d-ecc7a89219ab tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:26.862990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b99616-f7c2-4cfc-9c2d-ecc7a89219ab tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:26.863421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b99616-f7c2-4cfc-9c2d-ecc7a89219ab tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:26.863880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b99616-f7c2-4cfc-9c2d-ecc7a89219ab tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:26.864744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b99616-f7c2-4cfc-9c2d-ecc7a89219ab tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:26.867218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b99616-f7c2-4cfc-9c2d-ecc7a89219ab tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:26.868965 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.common [None req-e2b99616-f7c2-4cfc-9c2d-ecc7a89219ab tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 26 20:58:26.948543 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2015/3999] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:26 2022] POST /identity/v3/projects => generated 359 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:26.950056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b99616-f7c2-4cfc-9c2d-ecc7a89219ab tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:26.985533 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1985/4000] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:58:27.071346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b99616-f7c2-4cfc-9c2d-ecc7a89219ab tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:27.081439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4493f1b-a982-433e-a3d7-9447ed34e0c1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:27.084255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493f1b-a982-433e-a3d7-9447ed34e0c1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:27.084805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493f1b-a982-433e-a3d7-9447ed34e0c1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:27.085141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4493f1b-a982-433e-a3d7-9447ed34e0c1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags/tempest-tag-1935596037` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:27.087876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4493f1b-a982-433e-a3d7-9447ed34e0c1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=85ae18ad62f0405db0e8b32007c0f2d2, value=tempest-tag-1935596037)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:27.090380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4493f1b-a982-433e-a3d7-9447ed34e0c1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:27.199662 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-c4493f1b-a982-433e-a3d7-9447ed34e0c1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1935596037. To ensure interoperability, identifiers should be a valid uuid. Mar 26 20:58:27.199662 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 20:58:27.199662 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:58:27.212141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f0ac4-591d-48fe-9fa9-a14b206edca3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:27.235042 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2016/4001] 10.222.0.16 () {60 vars in 1332 bytes} [Sat Mar 26 20:58:26 2022] PUT /identity/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags/tempest-tag-1935596037 => generated 0 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Mar 26 20:58:27.246976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f0ac4-591d-48fe-9fa9-a14b206edca3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:27.254094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840a739-e5de-4b1f-baee-77a753bac6ec tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:27.255492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840a739-e5de-4b1f-baee-77a753bac6ec tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:27.255909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840a739-e5de-4b1f-baee-77a753bac6ec tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:27.256926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840a739-e5de-4b1f-baee-77a753bac6ec tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags/tempest-tag-1935596037` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:27.270975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840a739-e5de-4b1f-baee-77a753bac6ec tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=85ae18ad62f0405db0e8b32007c0f2d2, value=tempest-tag-1935596037)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:27.273498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840a739-e5de-4b1f-baee-77a753bac6ec tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:27.295002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4493f1b-a982-433e-a3d7-9447ed34e0c1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:27.296254 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1986/4002] 10.222.0.16 () {58 vars in 1313 bytes} [Sat Mar 26 20:58:27 2022] GET /identity/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags/tempest-tag-1935596037 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:27.309115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4493f1b-a982-433e-a3d7-9447ed34e0c1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:27.314587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92f1fe-a886-4d5f-9075-0b7014ac32e1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:27.315494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92f1fe-a886-4d5f-9075-0b7014ac32e1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:27.316212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92f1fe-a886-4d5f-9075-0b7014ac32e1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:27.316789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92f1fe-a886-4d5f-9075-0b7014ac32e1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:27.318230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92f1fe-a886-4d5f-9075-0b7014ac32e1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=85ae18ad62f0405db0e8b32007c0f2d2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:27.322306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd92f1fe-a886-4d5f-9075-0b7014ac32e1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:27.425194 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2017/4003] 10.222.0.16 () {60 vars in 1264 bytes} [Sat Mar 26 20:58:27 2022] PUT /identity/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags => generated 139 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:27.434452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840a739-e5de-4b1f-baee-77a753bac6ec tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:27.450763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840a739-e5de-4b1f-baee-77a753bac6ec tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:27.464655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2438f9-72d7-4511-a093-667a383152ad tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:27.465754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2438f9-72d7-4511-a093-667a383152ad tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:27.466043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2438f9-72d7-4511-a093-667a383152ad tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:27.466317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2438f9-72d7-4511-a093-667a383152ad tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:27.492538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2438f9-72d7-4511-a093-667a383152ad tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=85ae18ad62f0405db0e8b32007c0f2d2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:27.495747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2438f9-72d7-4511-a093-667a383152ad tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:27.516818 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1987/4004] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 20:58:27 2022] GET /identity/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags => generated 139 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:27.519777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92f1fe-a886-4d5f-9075-0b7014ac32e1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:27.533649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92f1fe-a886-4d5f-9075-0b7014ac32e1 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:27.542428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fd2dd-8b6a-4c5c-84b4-eb208c170df7 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:27.543543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd2dd-8b6a-4c5c-84b4-eb208c170df7 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:27.544018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd2dd-8b6a-4c5c-84b4-eb208c170df7 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:27.544451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fd2dd-8b6a-4c5c-84b4-eb208c170df7 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags/tempest-tag-733377410` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:27.546031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fd2dd-8b6a-4c5c-84b4-eb208c170df7 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=85ae18ad62f0405db0e8b32007c0f2d2, value=tempest-tag-733377410)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:27.548535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fd2dd-8b6a-4c5c-84b4-eb208c170df7 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:27.627987 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-343fd2dd-8b6a-4c5c-84b4-eb208c170df7 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-733377410. To ensure interoperability, identifiers should be a valid uuid. Mar 26 20:58:27.627987 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 20:58:27.627987 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 20:58:27.635528 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2018/4005] 10.222.0.16 () {58 vars in 1313 bytes} [Sat Mar 26 20:58:27 2022] DELETE /identity/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags/tempest-tag-733377410 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:27.639393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2438f9-72d7-4511-a093-667a383152ad tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:27.681299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2438f9-72d7-4511-a093-667a383152ad tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:27.702075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557ddbb-2cd9-4866-91ec-3c9e324bd36b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:27.706372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557ddbb-2cd9-4866-91ec-3c9e324bd36b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:27.706871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557ddbb-2cd9-4866-91ec-3c9e324bd36b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:27.709171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557ddbb-2cd9-4866-91ec-3c9e324bd36b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags/tempest-tag-733377410` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:27.735024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557ddbb-2cd9-4866-91ec-3c9e324bd36b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=85ae18ad62f0405db0e8b32007c0f2d2, value=tempest-tag-733377410)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:27.738510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557ddbb-2cd9-4866-91ec-3c9e324bd36b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:27.802924 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-5557ddbb-2cd9-4866-91ec-3c9e324bd36b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Could not find project tag: tempest-tag-733377410.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-733377410. Mar 26 20:58:27.805096 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1988/4006] 10.222.0.16 () {58 vars in 1310 bytes} [Sat Mar 26 20:58:27 2022] GET /identity/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags/tempest-tag-733377410 => generated 106 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 20:58:27.810215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fd2dd-8b6a-4c5c-84b4-eb208c170df7 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:27.827895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fd2dd-8b6a-4c5c-84b4-eb208c170df7 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:27.833489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730ced-34f5-43ce-a784-5f51712cc4b2 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:27.834985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730ced-34f5-43ce-a784-5f51712cc4b2 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:27.835370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730ced-34f5-43ce-a784-5f51712cc4b2 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:27.835750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15730ced-34f5-43ce-a784-5f51712cc4b2 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:27.837122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15730ced-34f5-43ce-a784-5f51712cc4b2 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=85ae18ad62f0405db0e8b32007c0f2d2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:27.839359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15730ced-34f5-43ce-a784-5f51712cc4b2 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:27.897714 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2019/4007] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 20:58:27 2022] DELETE /identity/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:27.901821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557ddbb-2cd9-4866-91ec-3c9e324bd36b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:27.924786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557ddbb-2cd9-4866-91ec-3c9e324bd36b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:27.930993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7214501-76e2-4a4b-bbe8-5a43bc678f7b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:27.931843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7214501-76e2-4a4b-bbe8-5a43bc678f7b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:27.932156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7214501-76e2-4a4b-bbe8-5a43bc678f7b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:27.933600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7214501-76e2-4a4b-bbe8-5a43bc678f7b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:27.964055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7214501-76e2-4a4b-bbe8-5a43bc678f7b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=85ae18ad62f0405db0e8b32007c0f2d2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:27.967541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7214501-76e2-4a4b-bbe8-5a43bc678f7b tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:27.996388 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1989/4008] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 20:58:27 2022] GET /identity/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2/tags => generated 66 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Mar 26 20:58:27.997365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730ced-34f5-43ce-a784-5f51712cc4b2 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:28.011481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15730ced-34f5-43ce-a784-5f51712cc4b2 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:28.018255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3918ccce9f644d2adda7c23703384b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '73b1584431b34845801c5b57babad400', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:28.019438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:28.019903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:28.020653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] PATH_INFO: `/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:28.022967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorizing `identity:delete_project(project_id=85ae18ad62f0405db0e8b32007c0f2d2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:28.025336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:28.090829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fde866-f8a7-4233-9851-32bfdb5a4bc4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:28.091539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fde866-f8a7-4233-9851-32bfdb5a4bc4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:28.093694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fde866-f8a7-4233-9851-32bfdb5a4bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:28.147348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ae18ad62f0405db0e8b32007c0f2d2', 'request_id': 'req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.167363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d5fde866-f8a7-4233-9851-32bfdb5a4bc4 None None] MFA Rules not processed for user `cd7c9dfb7f82412793f720486265a5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:28.167573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ae18ad62f0405db0e8b32007c0f2d2', 'request_id': 'req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.169034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d5fde866-f8a7-4233-9851-32bfdb5a4bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:28.177827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ae18ad62f0405db0e8b32007c0f2d2', 'request_id': 'req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.206630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] The token cache is being invalidate because project 85ae18ad62f0405db0e8b32007c0f2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:28.207422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.208509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.213622 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2020/4009] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:27 2022] DELETE /identity/v3/projects/85ae18ad62f0405db0e8b32007c0f2d2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:58:28.218732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:28.223578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:28.290393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1990/4010] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:28.358587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a55f6-90b9-41b6-a4f1-78fa9f2b8716 tempest-IdentityV3ProjectTagsTest-301108060 tempest-IdentityV3ProjectTagsTest-301108060-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:28.403696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:28.407484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:28.408756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:28.410120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] PATH_INFO: `/v3/users/f13d03598d2244b684d821f3d27484c1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:28.414658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f13d03598d2244b684d821f3d27484c1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:28.418835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:28.511532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f13d03598d2244b684d821f3d27484c1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.525969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f13d03598d2244b684d821f3d27484c1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.526665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f13d03598d2244b684d821f3d27484c1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.532444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f13d03598d2244b684d821f3d27484c1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.552794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fe9aede8-b59e-4ed0-8e35-0e2b081ada5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f13d03598d2244b684d821f3d27484c1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:28.600689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fde866-f8a7-4233-9851-32bfdb5a4bc4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:28.602740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d5fde866-f8a7-4233-9851-32bfdb5a4bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:28.608367 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2021/4011] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:28 2022] DELETE /identity/v3/users/f13d03598d2244b684d821f3d27484c1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:28.610797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa9e4e-a172-487d-873f-5e2a1df64ff1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:28.611145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa9e4e-a172-487d-873f-5e2a1df64ff1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:28.611434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa9e4e-a172-487d-873f-5e2a1df64ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:28.669553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-73fa9e4e-a172-487d-873f-5e2a1df64ff1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:28.671126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-73fa9e4e-a172-487d-873f-5e2a1df64ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:28.811813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fde866-f8a7-4233-9851-32bfdb5a4bc4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:28.815435 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2022/4012] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:58:28.860388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa9e4e-a172-487d-873f-5e2a1df64ff1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:28.862039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-73fa9e4e-a172-487d-873f-5e2a1df64ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:29.034286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757fd6c-fc62-415e-b7cb-c794cf74cec3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:29.035196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757fd6c-fc62-415e-b7cb-c794cf74cec3 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:29.038421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757fd6c-fc62-415e-b7cb-c794cf74cec3 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:29.038891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757fd6c-fc62-415e-b7cb-c794cf74cec3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:29.046357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7757fd6c-fc62-415e-b7cb-c794cf74cec3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:29.074837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa9e4e-a172-487d-873f-5e2a1df64ff1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:29.079853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a37b29-8b90-4a40-91db-15754b34f957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:29.081371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37b29-8b90-4a40-91db-15754b34f957 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:29.081792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37b29-8b90-4a40-91db-15754b34f957 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:29.082167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37b29-8b90-4a40-91db-15754b34f957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:29.116642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a37b29-8b90-4a40-91db-15754b34f957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:29.121287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a37b29-8b90-4a40-91db-15754b34f957 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:29.149976 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2023/4013] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:58:29.233930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757fd6c-fc62-415e-b7cb-c794cf74cec3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:29.242741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757fd6c-fc62-415e-b7cb-c794cf74cec3 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:29.276066 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1991/4014] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:28 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:31.018247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a37b29-8b90-4a40-91db-15754b34f957 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:31.020468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-08a37b29-8b90-4a40-91db-15754b34f957 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:31.050722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a37b29-8b90-4a40-91db-15754b34f957 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:31.065111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:31.066159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:31.066639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:31.066882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] PATH_INFO: `/v3/projects/743a9e41705f4b6e8b2b823a6e196c8b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:31.069707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743a9e41705f4b6e8b2b823a6e196c8b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:31.071670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:31.182767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743a9e41705f4b6e8b2b823a6e196c8b', 'request_id': 'req-116b6456-eaa0-4437-9867-e01ca2e33350'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.197253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743a9e41705f4b6e8b2b823a6e196c8b', 'request_id': 'req-116b6456-eaa0-4437-9867-e01ca2e33350'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.206961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743a9e41705f4b6e8b2b823a6e196c8b', 'request_id': 'req-116b6456-eaa0-4437-9867-e01ca2e33350'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.233799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] The token cache is being invalidate because project 743a9e41705f4b6e8b2b823a6e196c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:31.234104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.235413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-116b6456-eaa0-4437-9867-e01ca2e33350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.238291 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2024/4015] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:31 2022] DELETE /identity/v3/projects/743a9e41705f4b6e8b2b823a6e196c8b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:31.241991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757fd6c-fc62-415e-b7cb-c794cf74cec3 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:31.254114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757fd6c-fc62-415e-b7cb-c794cf74cec3 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:31.372312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:31.373333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:31.373622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:31.373899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] PATH_INFO: `/v3/users/a3918ccce9f644d2adda7c23703384b3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:31.375291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3918ccce9f644d2adda7c23703384b3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:31.377311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:31.407670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509f0f1-c8a3-4a10-b8bb-830617f024f1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:31.408834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509f0f1-c8a3-4a10-b8bb-830617f024f1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:31.411444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509f0f1-c8a3-4a10-b8bb-830617f024f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:31.484592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3918ccce9f644d2adda7c23703384b3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.494042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3918ccce9f644d2adda7c23703384b3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.494678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3918ccce9f644d2adda7c23703384b3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.495527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3918ccce9f644d2adda7c23703384b3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.502971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5509f0f1-c8a3-4a10-b8bb-830617f024f1 None None] MFA Rules not processed for user `3cb495ec547743d38a7502110a166b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:31.504620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5509f0f1-c8a3-4a10-b8bb-830617f024f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:31.530444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d92e1c9f-ea2b-4dec-b33c-3806bbe76417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3918ccce9f644d2adda7c23703384b3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:31.559393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1992/4016] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:31 2022] DELETE /identity/v3/users/a3918ccce9f644d2adda7c23703384b3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:31.617111 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2025/4017] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:31.626975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af82e47-a424-4e7d-9de5-63d618420e82 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:31.627500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af82e47-a424-4e7d-9de5-63d618420e82 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:31.627906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af82e47-a424-4e7d-9de5-63d618420e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:31.674831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7af82e47-a424-4e7d-9de5-63d618420e82 None None] MFA Rules not processed for user `3cb495ec547743d38a7502110a166b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:31.682546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7af82e47-a424-4e7d-9de5-63d618420e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:31.835503 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1993/4018] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:32.458580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509f0f1-c8a3-4a10-b8bb-830617f024f1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:32.461406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5509f0f1-c8a3-4a10-b8bb-830617f024f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:32.574636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509f0f1-c8a3-4a10-b8bb-830617f024f1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:32.636183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af82e47-a424-4e7d-9de5-63d618420e82 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:32.638449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7af82e47-a424-4e7d-9de5-63d618420e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:32.689774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013764d-765f-4b74-904b-46fa393a76f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:32.690428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013764d-765f-4b74-904b-46fa393a76f8 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:32.690709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013764d-765f-4b74-904b-46fa393a76f8 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:32.691115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013764d-765f-4b74-904b-46fa393a76f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:32.703880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013764d-765f-4b74-904b-46fa393a76f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:32.705851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013764d-765f-4b74-904b-46fa393a76f8 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:32.728152 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2026/4019] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:32.836780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af82e47-a424-4e7d-9de5-63d618420e82 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:32.851601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:32.853330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:32.855834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:32.857222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] PATH_INFO: `/v3/projects/73b1584431b34845801c5b57babad400` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:32.859185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=73b1584431b34845801c5b57babad400)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:32.861347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:32.940324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73b1584431b34845801c5b57babad400', 'request_id': 'req-3d74fea2-5a85-4c54-b108-a53c71d56cdd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:32.957804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73b1584431b34845801c5b57babad400', 'request_id': 'req-3d74fea2-5a85-4c54-b108-a53c71d56cdd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:32.970077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73b1584431b34845801c5b57babad400', 'request_id': 'req-3d74fea2-5a85-4c54-b108-a53c71d56cdd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:32.998433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] The token cache is being invalidate because project 73b1584431b34845801c5b57babad400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:32.998747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:33.001605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d74fea2-5a85-4c54-b108-a53c71d56cdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:33.011639 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1994/4020] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:32 2022] DELETE /identity/v3/projects/73b1584431b34845801c5b57babad400 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:33.018787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08bcad-9d05-445d-90b3-631105947f1c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:33.019275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08bcad-9d05-445d-90b3-631105947f1c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:33.019692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08bcad-9d05-445d-90b3-631105947f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:33.048681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9b08bcad-9d05-445d-90b3-631105947f1c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:33.050367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9b08bcad-9d05-445d-90b3-631105947f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:33.145352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781dc1-07a7-4914-b04a-4513e59900c1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:33.146217 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2027/4021] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:33.149977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781dc1-07a7-4914-b04a-4513e59900c1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:33.149977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781dc1-07a7-4914-b04a-4513e59900c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:33.173680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1b781dc1-07a7-4914-b04a-4513e59900c1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:33.175771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1b781dc1-07a7-4914-b04a-4513e59900c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:33.194151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08bcad-9d05-445d-90b3-631105947f1c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:33.209394 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1995/4022] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:33.224633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08bcad-9d05-445d-90b3-631105947f1c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:33.238797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fb105-f02c-4813-ba05-d13c46442878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:33.239970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fb105-f02c-4813-ba05-d13c46442878 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:33.241112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fb105-f02c-4813-ba05-d13c46442878 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:33.241792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fb105-f02c-4813-ba05-d13c46442878 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:33.243229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fb105-f02c-4813-ba05-d13c46442878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:33.243748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fb105-f02c-4813-ba05-d13c46442878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:33.259182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fb105-f02c-4813-ba05-d13c46442878 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:33.275622 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2028/4023] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:58:33.279170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781dc1-07a7-4914-b04a-4513e59900c1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:33.298897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781dc1-07a7-4914-b04a-4513e59900c1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:33.306335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ad15a-6c68-4bb4-a13c-48dae1897bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:33.307225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad15a-6c68-4bb4-a13c-48dae1897bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:33.307697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad15a-6c68-4bb4-a13c-48dae1897bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:33.308178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ad15a-6c68-4bb4-a13c-48dae1897bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:33.309167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ad15a-6c68-4bb4-a13c-48dae1897bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:33.311277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ad15a-6c68-4bb4-a13c-48dae1897bd6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:33.355446 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1996/4024] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:33 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:33.362834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fb105-f02c-4813-ba05-d13c46442878 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:33.380833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fb105-f02c-4813-ba05-d13c46442878 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:33.538337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b044ad-776d-438d-a3e8-39c3554a674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:33.543546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b044ad-776d-438d-a3e8-39c3554a674f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:33.545088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b044ad-776d-438d-a3e8-39c3554a674f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:33.547637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b044ad-776d-438d-a3e8-39c3554a674f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:33.550293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b044ad-776d-438d-a3e8-39c3554a674f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:33.561062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b044ad-776d-438d-a3e8-39c3554a674f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:33.616759 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2029/4025] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:33 2022] POST /identity/v3/users => generated 287 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:33.621185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ad15a-6c68-4bb4-a13c-48dae1897bd6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:33.635581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ad15a-6c68-4bb4-a13c-48dae1897bd6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:33.661048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a73667-66f5-4ab0-b98a-b2a859d34342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:33.668348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a73667-66f5-4ab0-b98a-b2a859d34342 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:33.668592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a73667-66f5-4ab0-b98a-b2a859d34342 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:33.668879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a73667-66f5-4ab0-b98a-b2a859d34342 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:33.669631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a73667-66f5-4ab0-b98a-b2a859d34342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:33.671281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a73667-66f5-4ab0-b98a-b2a859d34342 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:33.711702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b044ad-776d-438d-a3e8-39c3554a674f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:33.714853 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1997/4026] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:33.731609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b044ad-776d-438d-a3e8-39c3554a674f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:33.741521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7052ed0-a2bb-472f-8363-fbc2576a378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:33.742204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7052ed0-a2bb-472f-8363-fbc2576a378e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:33.742489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7052ed0-a2bb-472f-8363-fbc2576a378e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:33.742770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7052ed0-a2bb-472f-8363-fbc2576a378e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:33.743498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7052ed0-a2bb-472f-8363-fbc2576a378e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:33.745169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7052ed0-a2bb-472f-8363-fbc2576a378e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:33.773597 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2030/4027] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:58:33.774605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a73667-66f5-4ab0-b98a-b2a859d34342 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:33.799010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a73667-66f5-4ab0-b98a-b2a859d34342 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:33.812962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd110c8-43a5-4801-85e0-9fa357440900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:33.814362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd110c8-43a5-4801-85e0-9fa357440900 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:33.815078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd110c8-43a5-4801-85e0-9fa357440900 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:33.815557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd110c8-43a5-4801-85e0-9fa357440900 admin admin] PATH_INFO: `/v3/projects/b67f351d258f4b0d90ed043f15a41de5/users/db6663a9a0ec4b87b0555fa3bcadcac4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:33.856437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd110c8-43a5-4801-85e0-9fa357440900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b67f351d258f4b0d90ed043f15a41de5, user_id=db6663a9a0ec4b87b0555fa3bcadcac4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:33.865667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd110c8-43a5-4801-85e0-9fa357440900 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:33.890931 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1998/4028] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:33 2022] PUT /identity/v3/projects/b67f351d258f4b0d90ed043f15a41de5/users/db6663a9a0ec4b87b0555fa3bcadcac4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:33.903060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083e6e-34a1-446a-9281-fc86fb01f802 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:33.903358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083e6e-34a1-446a-9281-fc86fb01f802 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:33.903641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94083e6e-34a1-446a-9281-fc86fb01f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:33.965783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-94083e6e-34a1-446a-9281-fc86fb01f802 None None] MFA Rules not processed for user `db6663a9a0ec4b87b0555fa3bcadcac4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:33.967986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-94083e6e-34a1-446a-9281-fc86fb01f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:34.032803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd110c8-43a5-4801-85e0-9fa357440900 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:34.035657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8cd110c8-43a5-4801-85e0-9fa357440900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:34.158713 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2031/4029] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:34.166249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd110c8-43a5-4801-85e0-9fa357440900 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:34.169426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083e6e-34a1-446a-9281-fc86fb01f802 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:34.170827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-94083e6e-34a1-446a-9281-fc86fb01f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:34.188652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:34.189549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:34.189832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:34.190108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] PATH_INFO: `/v3/users/cd7a5f1b0b2c40b6aa8422ef1131bf75` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:34.193275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7a5f1b0b2c40b6aa8422ef1131bf75)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:34.196700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:34.299228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7a5f1b0b2c40b6aa8422ef1131bf75'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:34.300376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94083e6e-34a1-446a-9281-fc86fb01f802 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:34.309961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1405c07-fc49-4c3e-9f87-0f219b4ddf0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:34.310925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1405c07-fc49-4c3e-9f87-0f219b4ddf0c service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:34.311110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1405c07-fc49-4c3e-9f87-0f219b4ddf0c service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:34.311448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1405c07-fc49-4c3e-9f87-0f219b4ddf0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:34.319968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7a5f1b0b2c40b6aa8422ef1131bf75'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:34.320812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7a5f1b0b2c40b6aa8422ef1131bf75'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:34.321697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7a5f1b0b2c40b6aa8422ef1131bf75'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:34.338053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1405c07-fc49-4c3e-9f87-0f219b4ddf0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:34.341005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1405c07-fc49-4c3e-9f87-0f219b4ddf0c service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:34.348007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7a5f1b0b2c40b6aa8422ef1131bf75'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:34.365915 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2032/4030] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 20:58:34.373601 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 1999/4031] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:34 2022] DELETE /identity/v3/users/cd7a5f1b0b2c40b6aa8422ef1131bf75 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:58:34.577558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaca081-c33e-417d-af55-f8f2cffe5219 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:34.578873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaca081-c33e-417d-af55-f8f2cffe5219 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:34.579155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaca081-c33e-417d-af55-f8f2cffe5219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:34.607781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ccaca081-c33e-417d-af55-f8f2cffe5219 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:34.611069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ccaca081-c33e-417d-af55-f8f2cffe5219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:34.704863 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2033/4032] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:58:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:34.712074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:34.714536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:34.833005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ec0e5-3fb2-454a-9dc9-a683a71271d3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:34.844622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab5ad8-244f-440b-b62a-9b9c6bfe92b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:34.845318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5ad8-244f-440b-b62a-9b9c6bfe92b6 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:34.845605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5ad8-244f-440b-b62a-9b9c6bfe92b6 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:34.846014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab5ad8-244f-440b-b62a-9b9c6bfe92b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:34.861105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab5ad8-244f-440b-b62a-9b9c6bfe92b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:34.864066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab5ad8-244f-440b-b62a-9b9c6bfe92b6 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:34.879988 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2000/4033] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:35.168243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaca081-c33e-417d-af55-f8f2cffe5219 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:35.170211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ccaca081-c33e-417d-af55-f8f2cffe5219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:35.285579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093569f-c2a9-4631-b80b-5d9258e12abe None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:35.285875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093569f-c2a9-4631-b80b-5d9258e12abe None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:35.286160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093569f-c2a9-4631-b80b-5d9258e12abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:35.326026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0093569f-c2a9-4631-b80b-5d9258e12abe None None] MFA Rules not processed for user `3cb495ec547743d38a7502110a166b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:35.327295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0093569f-c2a9-4631-b80b-5d9258e12abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:35.399590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaca081-c33e-417d-af55-f8f2cffe5219 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:35.426111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:35.428758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:35.430212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:35.430573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] PATH_INFO: `/v3/projects/19b4a69e68554b2bbaa1fcbfc9810a2f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:35.432894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b4a69e68554b2bbaa1fcbfc9810a2f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:35.438728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:35.515379 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2001/4034] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:35.517434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389673e-2e58-4047-84ed-1aff96cc090b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:35.517738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389673e-2e58-4047-84ed-1aff96cc090b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:35.518115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389673e-2e58-4047-84ed-1aff96cc090b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:35.554126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f389673e-2e58-4047-84ed-1aff96cc090b None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:35.555776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f389673e-2e58-4047-84ed-1aff96cc090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:35.575760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b4a69e68554b2bbaa1fcbfc9810a2f', 'request_id': 'req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:35.586147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b4a69e68554b2bbaa1fcbfc9810a2f', 'request_id': 'req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:35.606404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b4a69e68554b2bbaa1fcbfc9810a2f', 'request_id': 'req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:35.640644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] The token cache is being invalidate because project 19b4a69e68554b2bbaa1fcbfc9810a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:35.641009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:35.642058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-83e75b4b-4f95-44f0-8545-ecc248ed4c8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:35.650272 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2034/4035] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:35 2022] DELETE /identity/v3/projects/19b4a69e68554b2bbaa1fcbfc9810a2f => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:35.652270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3244f3b-1142-42f8-8fb6-9b0fc41d3da2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:35.652707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3244f3b-1142-42f8-8fb6-9b0fc41d3da2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:35.654913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3244f3b-1142-42f8-8fb6-9b0fc41d3da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:35.688598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c3244f3b-1142-42f8-8fb6-9b0fc41d3da2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:35.690233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c3244f3b-1142-42f8-8fb6-9b0fc41d3da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:35.707051 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2002/4036] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:35.721211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389673e-2e58-4047-84ed-1aff96cc090b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:35.733666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f389673e-2e58-4047-84ed-1aff96cc090b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:35.859988 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2035/4037] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:35.871642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbab92-fa00-42de-9453-50d6919eeba9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:35.872177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbab92-fa00-42de-9453-50d6919eeba9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:35.872788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dbab92-fa00-42de-9453-50d6919eeba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:35.923006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-78dbab92-fa00-42de-9453-50d6919eeba9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:35.925114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-78dbab92-fa00-42de-9453-50d6919eeba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:35.953134 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2036/4038] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:35.954217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbab92-fa00-42de-9453-50d6919eeba9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:35.961275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389673e-2e58-4047-84ed-1aff96cc090b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:35.977933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dbab92-fa00-42de-9453-50d6919eeba9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:35.981526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb504e7-9054-47b0-ae5c-3259daa54c7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:35.982386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb504e7-9054-47b0-ae5c-3259daa54c7f service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:35.984748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb504e7-9054-47b0-ae5c-3259daa54c7f service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:35.986342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb504e7-9054-47b0-ae5c-3259daa54c7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:35.997212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f45d3c-6f3c-41d2-a6a1-faf0af79c005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:35.999587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45d3c-6f3c-41d2-a6a1-faf0af79c005 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:36.001757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45d3c-6f3c-41d2-a6a1-faf0af79c005 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:36.002551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f45d3c-6f3c-41d2-a6a1-faf0af79c005 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:36.004261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f45d3c-6f3c-41d2-a6a1-faf0af79c005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:36.006544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f45d3c-6f3c-41d2-a6a1-faf0af79c005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:36.010528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f45d3c-6f3c-41d2-a6a1-faf0af79c005 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:36.017169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb504e7-9054-47b0-ae5c-3259daa54c7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:36.020683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb504e7-9054-47b0-ae5c-3259daa54c7f service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:36.047038 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2037/4040] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:58:36.047319 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2003/4040] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:36.051548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f45d3c-6f3c-41d2-a6a1-faf0af79c005 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:36.091494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f45d3c-6f3c-41d2-a6a1-faf0af79c005 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:36.120661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c72a5-a373-4fdd-9ba0-7bb6c4a11411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:36.122594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c72a5-a373-4fdd-9ba0-7bb6c4a11411 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:36.122882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c72a5-a373-4fdd-9ba0-7bb6c4a11411 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:36.123355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c72a5-a373-4fdd-9ba0-7bb6c4a11411 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:36.124100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c72a5-a373-4fdd-9ba0-7bb6c4a11411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:36.127085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c72a5-a373-4fdd-9ba0-7bb6c4a11411 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:36.210840 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2038/4041] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:36 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:36.216293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb504e7-9054-47b0-ae5c-3259daa54c7f service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:36.236239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb504e7-9054-47b0-ae5c-3259daa54c7f service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:36.378912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d70560-244d-4b7a-997a-171e52cf19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:36.379599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d70560-244d-4b7a-997a-171e52cf19ce admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:36.380183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d70560-244d-4b7a-997a-171e52cf19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:36.381289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d70560-244d-4b7a-997a-171e52cf19ce admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:36.384928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d70560-244d-4b7a-997a-171e52cf19ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:36.384928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d70560-244d-4b7a-997a-171e52cf19ce admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:36.425240 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2004/4042] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:36 2022] POST /identity/v3/users => generated 290 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:36.429200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c72a5-a373-4fdd-9ba0-7bb6c4a11411 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:36.447676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c72a5-a373-4fdd-9ba0-7bb6c4a11411 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:36.455392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd11c2a-cb74-46b2-98e3-930a97e3d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:36.456352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11c2a-cb74-46b2-98e3-930a97e3d475 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:36.456929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11c2a-cb74-46b2-98e3-930a97e3d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:36.457452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd11c2a-cb74-46b2-98e3-930a97e3d475 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:36.458946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd11c2a-cb74-46b2-98e3-930a97e3d475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:36.461477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd11c2a-cb74-46b2-98e3-930a97e3d475 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:36.485902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d70560-244d-4b7a-997a-171e52cf19ce admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:36.500480 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2039/4043] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:36.502869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d70560-244d-4b7a-997a-171e52cf19ce admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:36.519955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a470a-df54-404c-8c47-2366ae76c571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:36.521099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a470a-df54-404c-8c47-2366ae76c571 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:36.523706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ae465-b81a-4f95-ac6d-587042ba1466 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:36.524137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ae465-b81a-4f95-ac6d-587042ba1466 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:36.524511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ae465-b81a-4f95-ac6d-587042ba1466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:36.532371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a470a-df54-404c-8c47-2366ae76c571 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:36.534627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a470a-df54-404c-8c47-2366ae76c571 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:36.535518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a470a-df54-404c-8c47-2366ae76c571 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:36.543428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a470a-df54-404c-8c47-2366ae76c571 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:36.576968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-020ae465-b81a-4f95-ac6d-587042ba1466 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:36.580268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-020ae465-b81a-4f95-ac6d-587042ba1466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:36.580963 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2005/4044] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:58:36.587038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a470a-df54-404c-8c47-2366ae76c571 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:36.603755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a470a-df54-404c-8c47-2366ae76c571 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:36.623413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353092e-5b95-4c1f-b6c5-4db41963d5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:36.624482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353092e-5b95-4c1f-b6c5-4db41963d5df admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:36.625211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353092e-5b95-4c1f-b6c5-4db41963d5df admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:36.625609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353092e-5b95-4c1f-b6c5-4db41963d5df admin admin] PATH_INFO: `/v3/projects/c3f87b02119a4e3f86e4fdc7a4bd93a6/users/0458cfbae7f945309c300d336b6dfd64/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:36.664600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353092e-5b95-4c1f-b6c5-4db41963d5df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f87b02119a4e3f86e4fdc7a4bd93a6, user_id=0458cfbae7f945309c300d336b6dfd64, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:36.677523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353092e-5b95-4c1f-b6c5-4db41963d5df admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:36.722986 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2006/4045] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:36 2022] PUT /identity/v3/projects/c3f87b02119a4e3f86e4fdc7a4bd93a6/users/0458cfbae7f945309c300d336b6dfd64/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:36.728781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cac86-3d84-4d75-b6ac-ee50fd0d2e99 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:36.729183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cac86-3d84-4d75-b6ac-ee50fd0d2e99 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:36.729598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49cac86-3d84-4d75-b6ac-ee50fd0d2e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:36.743975 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2040/4046] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:36.758229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c49cac86-3d84-4d75-b6ac-ee50fd0d2e99 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:36.759949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c49cac86-3d84-4d75-b6ac-ee50fd0d2e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:36.761264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ae465-b81a-4f95-ac6d-587042ba1466 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:36.905828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ae465-b81a-4f95-ac6d-587042ba1466 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:36.909239 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2007/4047] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:36.944435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cac86-3d84-4d75-b6ac-ee50fd0d2e99 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:36.946318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c49cac86-3d84-4d75-b6ac-ee50fd0d2e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:37.055866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586525a-a35c-4739-bdae-2ada29074d87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:37.056814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586525a-a35c-4739-bdae-2ada29074d87 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:37.057103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586525a-a35c-4739-bdae-2ada29074d87 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:37.057383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586525a-a35c-4739-bdae-2ada29074d87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:37.095474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49cac86-3d84-4d75-b6ac-ee50fd0d2e99 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:37.108609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d486c-4725-4513-bb12-1493650f9a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:37.109285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d486c-4725-4513-bb12-1493650f9a33 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:37.109577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d486c-4725-4513-bb12-1493650f9a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:37.109869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d486c-4725-4513-bb12-1493650f9a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:37.128112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d486c-4725-4513-bb12-1493650f9a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:37.131576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d486c-4725-4513-bb12-1493650f9a33 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:37.162120 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2008/4048] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:37.174687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586525a-a35c-4739-bdae-2ada29074d87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:37.176441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586525a-a35c-4739-bdae-2ada29074d87 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:37.186552 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2041/4049] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:58:37.616406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197643c4-4ff0-4251-b3b2-ad770cf66a2d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:37.616703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197643c4-4ff0-4251-b3b2-ad770cf66a2d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:37.616986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197643c4-4ff0-4251-b3b2-ad770cf66a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:37.636934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-197643c4-4ff0-4251-b3b2-ad770cf66a2d None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:37.638228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-197643c4-4ff0-4251-b3b2-ad770cf66a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:37.655520 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2009/4050] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:37.664602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586525a-a35c-4739-bdae-2ada29074d87 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:37.683947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586525a-a35c-4739-bdae-2ada29074d87 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:37.696791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744db837-1d70-48c5-9d9d-1b67a6a55bf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:37.697638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744db837-1d70-48c5-9d9d-1b67a6a55bf9 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:37.698519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744db837-1d70-48c5-9d9d-1b67a6a55bf9 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:37.698730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744db837-1d70-48c5-9d9d-1b67a6a55bf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:37.725557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744db837-1d70-48c5-9d9d-1b67a6a55bf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:37.727188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744db837-1d70-48c5-9d9d-1b67a6a55bf9 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:37.763542 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2042/4051] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:38.192864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a78d35-ae99-49fc-97c6-5497b0baae6f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:38.194352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a78d35-ae99-49fc-97c6-5497b0baae6f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:38.194787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a78d35-ae99-49fc-97c6-5497b0baae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:38.236669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c6a78d35-ae99-49fc-97c6-5497b0baae6f None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:38.237936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c6a78d35-ae99-49fc-97c6-5497b0baae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:38.250285 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2010/4052] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:58:38.264895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744db837-1d70-48c5-9d9d-1b67a6a55bf9 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:38.282184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744db837-1d70-48c5-9d9d-1b67a6a55bf9 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:38.294221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc148fa-f712-47ea-9230-3f5c82fddfd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:38.294885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc148fa-f712-47ea-9230-3f5c82fddfd1 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:38.295158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc148fa-f712-47ea-9230-3f5c82fddfd1 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:38.297565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc148fa-f712-47ea-9230-3f5c82fddfd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:38.320135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc148fa-f712-47ea-9230-3f5c82fddfd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:38.322667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc148fa-f712-47ea-9230-3f5c82fddfd1 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:38.347811 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2043/4053] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:38.843535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b2fc-9f9f-410d-a668-41cbf432c2a1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:38.843822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b2fc-9f9f-410d-a668-41cbf432c2a1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:38.844308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401b2fc-9f9f-410d-a668-41cbf432c2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:38.880819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a401b2fc-9f9f-410d-a668-41cbf432c2a1 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:38.882110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a401b2fc-9f9f-410d-a668-41cbf432c2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:38.909644 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2011/4054] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:38.910426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc148fa-f712-47ea-9230-3f5c82fddfd1 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:38.939033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc148fa-f712-47ea-9230-3f5c82fddfd1 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:38.952565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156277f-b804-4dca-99d9-d8063b2c5bba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:38.953219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156277f-b804-4dca-99d9-d8063b2c5bba service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:38.953509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156277f-b804-4dca-99d9-d8063b2c5bba service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:38.953783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156277f-b804-4dca-99d9-d8063b2c5bba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:38.972275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156277f-b804-4dca-99d9-d8063b2c5bba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:38.973947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156277f-b804-4dca-99d9-d8063b2c5bba service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:38.994789 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2044/4055] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:58:39.230746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19759d-f1c9-4bde-97bd-29db552971cd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:39.232413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19759d-f1c9-4bde-97bd-29db552971cd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:39.232903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19759d-f1c9-4bde-97bd-29db552971cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:39.315741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2a19759d-f1c9-4bde-97bd-29db552971cd None None] MFA Rules not processed for user `0458cfbae7f945309c300d336b6dfd64`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:39.318500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2a19759d-f1c9-4bde-97bd-29db552971cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:39.438384 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2012/4056] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:39.740023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156277f-b804-4dca-99d9-d8063b2c5bba service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:39.743265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6156277f-b804-4dca-99d9-d8063b2c5bba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:39.871831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156277f-b804-4dca-99d9-d8063b2c5bba service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:39.884452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb6e94-fee6-48a0-86fc-a5984cfb736c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:39.885493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb6e94-fee6-48a0-86fc-a5984cfb736c service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:39.885776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb6e94-fee6-48a0-86fc-a5984cfb736c service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:39.886068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb6e94-fee6-48a0-86fc-a5984cfb736c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:39.910123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb6e94-fee6-48a0-86fc-a5984cfb736c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:39.912027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb6e94-fee6-48a0-86fc-a5984cfb736c service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:39.925602 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2045/4057] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:40.417461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6543c-d886-4ae9-a78c-1fbb6e3d5266 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:40.417967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6543c-d886-4ae9-a78c-1fbb6e3d5266 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:40.418230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6543c-d886-4ae9-a78c-1fbb6e3d5266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:40.448435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e0c6543c-d886-4ae9-a78c-1fbb6e3d5266 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:40.449845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e0c6543c-d886-4ae9-a78c-1fbb6e3d5266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:40.457751 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2013/4058] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:40.474216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb6e94-fee6-48a0-86fc-a5984cfb736c service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:40.492417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb6e94-fee6-48a0-86fc-a5984cfb736c service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:40.500104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923f58-dbfd-4bd6-bed6-5ad6ca577747 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:40.501160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923f58-dbfd-4bd6-bed6-5ad6ca577747 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:40.501637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923f58-dbfd-4bd6-bed6-5ad6ca577747 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:40.502118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923f58-dbfd-4bd6-bed6-5ad6ca577747 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:40.513778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5923f58-dbfd-4bd6-bed6-5ad6ca577747 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:40.515667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5923f58-dbfd-4bd6-bed6-5ad6ca577747 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:40.525521 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2046/4059] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:40.687889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56996-285b-4938-aa7a-a950d08f4a03 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:40.688198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56996-285b-4938-aa7a-a950d08f4a03 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:40.688506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b56996-285b-4938-aa7a-a950d08f4a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:40.722087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-87b56996-285b-4938-aa7a-a950d08f4a03 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:40.723438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-87b56996-285b-4938-aa7a-a950d08f4a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:40.730740 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2014/4060] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:40.743877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923f58-dbfd-4bd6-bed6-5ad6ca577747 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:40.758170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923f58-dbfd-4bd6-bed6-5ad6ca577747 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:40.766312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6d7e6-ee5c-4632-a763-e35fafdda1a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:40.767327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6d7e6-ee5c-4632-a763-e35fafdda1a6 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:40.767814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6d7e6-ee5c-4632-a763-e35fafdda1a6 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:40.768366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6d7e6-ee5c-4632-a763-e35fafdda1a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:40.780190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6d7e6-ee5c-4632-a763-e35fafdda1a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:40.782019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6d7e6-ee5c-4632-a763-e35fafdda1a6 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:40.792393 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2047/4061] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:40.960644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55760d78-1f55-472c-8676-96dd0dfed9f2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:40.960937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55760d78-1f55-472c-8676-96dd0dfed9f2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:40.961222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55760d78-1f55-472c-8676-96dd0dfed9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:40.982052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-55760d78-1f55-472c-8676-96dd0dfed9f2 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:40.983278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-55760d78-1f55-472c-8676-96dd0dfed9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:40.991418 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2015/4062] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:41.006001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6d7e6-ee5c-4632-a763-e35fafdda1a6 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:41.020073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6d7e6-ee5c-4632-a763-e35fafdda1a6 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:41.026657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435225d3-a906-4f3b-bc95-35e73e0047d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:41.027377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435225d3-a906-4f3b-bc95-35e73e0047d6 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:41.027717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435225d3-a906-4f3b-bc95-35e73e0047d6 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:41.028033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435225d3-a906-4f3b-bc95-35e73e0047d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:41.036708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435225d3-a906-4f3b-bc95-35e73e0047d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:41.038859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435225d3-a906-4f3b-bc95-35e73e0047d6 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:41.047766 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2048/4063] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 20:58:41.224606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333018db-5f9e-4eea-826c-06ad3d1672cb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:41.224902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333018db-5f9e-4eea-826c-06ad3d1672cb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:41.225354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333018db-5f9e-4eea-826c-06ad3d1672cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:41.244274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-333018db-5f9e-4eea-826c-06ad3d1672cb None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:41.245395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-333018db-5f9e-4eea-826c-06ad3d1672cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:41.263379 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2016/4064] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:41.269124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435225d3-a906-4f3b-bc95-35e73e0047d6 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:41.285114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435225d3-a906-4f3b-bc95-35e73e0047d6 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:41.290512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff08c29-8a51-4a17-956f-925c5453a3a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:41.291149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff08c29-8a51-4a17-956f-925c5453a3a0 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:41.291435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff08c29-8a51-4a17-956f-925c5453a3a0 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:41.291947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff08c29-8a51-4a17-956f-925c5453a3a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:41.305005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff08c29-8a51-4a17-956f-925c5453a3a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:41.307186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff08c29-8a51-4a17-956f-925c5453a3a0 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:41.336713 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2049/4065] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:41.415080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e90e10-77fe-4b5b-ad6a-79f89ae7e620 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:41.415493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e90e10-77fe-4b5b-ad6a-79f89ae7e620 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:41.416063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e90e10-77fe-4b5b-ad6a-79f89ae7e620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:41.470843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f2e90e10-77fe-4b5b-ad6a-79f89ae7e620 None None] MFA Rules not processed for user `0458cfbae7f945309c300d336b6dfd64`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:41.476893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f2e90e10-77fe-4b5b-ad6a-79f89ae7e620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:41.501813 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2017/4066] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:41.574839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e741a-7d0d-494d-8dec-456fef47ee92 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:41.577049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e741a-7d0d-494d-8dec-456fef47ee92 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:41.578785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e741a-7d0d-494d-8dec-456fef47ee92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:41.603585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f59e741a-7d0d-494d-8dec-456fef47ee92 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:41.604973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f59e741a-7d0d-494d-8dec-456fef47ee92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:41.626646 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2050/4067] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:41.644519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e90e10-77fe-4b5b-ad6a-79f89ae7e620 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:41.672443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e90e10-77fe-4b5b-ad6a-79f89ae7e620 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:41.680877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf79b7-9446-425b-98b7-9870cbf6f492 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:41.681551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf79b7-9446-425b-98b7-9870cbf6f492 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:41.681837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf79b7-9446-425b-98b7-9870cbf6f492 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:41.682114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf79b7-9446-425b-98b7-9870cbf6f492 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:41.699054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf79b7-9446-425b-98b7-9870cbf6f492 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:41.701402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf79b7-9446-425b-98b7-9870cbf6f492 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:41.747301 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2018/4068] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:41.911410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc5c5-a5b8-4de2-8309-db4dcf8fd066 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:41.914035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc5c5-a5b8-4de2-8309-db4dcf8fd066 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:41.914431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dc5c5-a5b8-4de2-8309-db4dcf8fd066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:41.935816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-695dc5c5-a5b8-4de2-8309-db4dcf8fd066 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:41.938072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-695dc5c5-a5b8-4de2-8309-db4dcf8fd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:41.952079 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2051/4069] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 20:58:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:58:41.964673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf79b7-9446-425b-98b7-9870cbf6f492 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:41.982792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf79b7-9446-425b-98b7-9870cbf6f492 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:41.989923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de45e0-7052-4aa0-8e4c-08412913564e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:41.992687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de45e0-7052-4aa0-8e4c-08412913564e service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:41.993927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de45e0-7052-4aa0-8e4c-08412913564e service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:41.994222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de45e0-7052-4aa0-8e4c-08412913564e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:42.006171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de45e0-7052-4aa0-8e4c-08412913564e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:42.010558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de45e0-7052-4aa0-8e4c-08412913564e service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:42.033209 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2019/4070] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 20:58:42.245410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc5c5-a5b8-4de2-8309-db4dcf8fd066 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:42.247544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-695dc5c5-a5b8-4de2-8309-db4dcf8fd066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:42.265577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dc5c5-a5b8-4de2-8309-db4dcf8fd066 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:42.270940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:42.272543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:42.272928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:42.273431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] PATH_INFO: `/v3/users/db6663a9a0ec4b87b0555fa3bcadcac4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:42.275571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6663a9a0ec4b87b0555fa3bcadcac4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:42.277983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:42.370021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6663a9a0ec4b87b0555fa3bcadcac4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:42.381823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6663a9a0ec4b87b0555fa3bcadcac4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:42.382895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6663a9a0ec4b87b0555fa3bcadcac4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:42.383574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6663a9a0ec4b87b0555fa3bcadcac4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:42.398992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6663a9a0ec4b87b0555fa3bcadcac4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:42.421257 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2052/4071] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:42 2022] DELETE /identity/v3/users/db6663a9a0ec4b87b0555fa3bcadcac4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:42.425801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ff90-70ce-4133-8e65-e3870a9fad8e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:42.426442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ff90-70ce-4133-8e65-e3870a9fad8e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:42.426754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed9ff90-70ce-4133-8e65-e3870a9fad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:42.456374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3ed9ff90-70ce-4133-8e65-e3870a9fad8e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:42.457979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3ed9ff90-70ce-4133-8e65-e3870a9fad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:42.572759 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2020/4072] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:42.605845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:42.607295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:42.702570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d34862-413e-48ef-b6ef-6aad1a8e09e4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:42.714461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9911e0a6-89f8-413d-9429-fff76cecb1df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:42.715153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911e0a6-89f8-413d-9429-fff76cecb1df service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:42.715440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911e0a6-89f8-413d-9429-fff76cecb1df service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:42.715720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9911e0a6-89f8-413d-9429-fff76cecb1df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:42.730431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911e0a6-89f8-413d-9429-fff76cecb1df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:42.732244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9911e0a6-89f8-413d-9429-fff76cecb1df service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:42.746022 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2053/4073] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:44.208018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ff90-70ce-4133-8e65-e3870a9fad8e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:44.211513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3ed9ff90-70ce-4133-8e65-e3870a9fad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:44.226574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed9ff90-70ce-4133-8e65-e3870a9fad8e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:44.238914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:44.240102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:44.240574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:44.242093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] PATH_INFO: `/v3/projects/b67f351d258f4b0d90ed043f15a41de5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:44.244635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b67f351d258f4b0d90ed043f15a41de5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:44.258400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:44.339172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b67f351d258f4b0d90ed043f15a41de5', 'request_id': 'req-560822f8-fb06-4fc5-8760-b3b446c5d657'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:44.348660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b67f351d258f4b0d90ed043f15a41de5', 'request_id': 'req-560822f8-fb06-4fc5-8760-b3b446c5d657'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:44.370414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b67f351d258f4b0d90ed043f15a41de5', 'request_id': 'req-560822f8-fb06-4fc5-8760-b3b446c5d657'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:44.396594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] The token cache is being invalidate because project b67f351d258f4b0d90ed043f15a41de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:44.396967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:44.397726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-560822f8-fb06-4fc5-8760-b3b446c5d657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:44.399543 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2021/4074] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:44 2022] DELETE /identity/v3/projects/b67f351d258f4b0d90ed043f15a41de5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:44.405009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f3008-8031-4265-abf2-6549faa295c8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:44.405499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f3008-8031-4265-abf2-6549faa295c8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:44.405587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f3008-8031-4265-abf2-6549faa295c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:44.426233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ab5f3008-8031-4265-abf2-6549faa295c8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:44.427590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ab5f3008-8031-4265-abf2-6549faa295c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:44.504627 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2054/4075] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:44.512377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ba9c-2bc3-4ea5-b918-f495989f97f6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:44.512668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ba9c-2bc3-4ea5-b918-f495989f97f6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:44.512949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508ba9c-2bc3-4ea5-b918-f495989f97f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:44.569189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1508ba9c-2bc3-4ea5-b918-f495989f97f6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:44.572833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1508ba9c-2bc3-4ea5-b918-f495989f97f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:44.593694 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2022/4076] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:44.597729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f3008-8031-4265-abf2-6549faa295c8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:44.623960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f3008-8031-4265-abf2-6549faa295c8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:44.654200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667631-bdb8-45cb-b9e6-67b44b366419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:44.655819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667631-bdb8-45cb-b9e6-67b44b366419 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:44.660406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667631-bdb8-45cb-b9e6-67b44b366419 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:44.660695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667631-bdb8-45cb-b9e6-67b44b366419 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:44.661540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667631-bdb8-45cb-b9e6-67b44b366419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:44.661760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667631-bdb8-45cb-b9e6-67b44b366419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:44.672145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667631-bdb8-45cb-b9e6-67b44b366419 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:44.693666 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2055/4077] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:58:44.697852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ba9c-2bc3-4ea5-b918-f495989f97f6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:44.709748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508ba9c-2bc3-4ea5-b918-f495989f97f6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:44.723823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1a492-78a1-41c4-9973-a1de7e832553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:44.725932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1a492-78a1-41c4-9973-a1de7e832553 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:44.726612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1a492-78a1-41c4-9973-a1de7e832553 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:44.727108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1a492-78a1-41c4-9973-a1de7e832553 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:44.729565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1a492-78a1-41c4-9973-a1de7e832553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:44.736841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1a492-78a1-41c4-9973-a1de7e832553 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:44.815211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667631-bdb8-45cb-b9e6-67b44b366419 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:44.815892 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2023/4078] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:44 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:44.827603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667631-bdb8-45cb-b9e6-67b44b366419 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:44.920514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960825-9b0d-4f16-b7af-fe635fd00364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:44.921328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960825-9b0d-4f16-b7af-fe635fd00364 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:44.921687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960825-9b0d-4f16-b7af-fe635fd00364 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:44.922652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2960825-9b0d-4f16-b7af-fe635fd00364 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:44.923460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2960825-9b0d-4f16-b7af-fe635fd00364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:44.925700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2960825-9b0d-4f16-b7af-fe635fd00364 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:44.961570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1a492-78a1-41c4-9973-a1de7e832553 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:44.962261 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2056/4079] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:44 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:44.991157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1a492-78a1-41c4-9973-a1de7e832553 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:45.000417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1202678-14ba-418e-9550-677697701480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:45.001199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1202678-14ba-418e-9550-677697701480 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:45.001690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1202678-14ba-418e-9550-677697701480 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:45.002037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1202678-14ba-418e-9550-677697701480 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:45.002834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1202678-14ba-418e-9550-677697701480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:45.004719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1202678-14ba-418e-9550-677697701480 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:45.022587 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2024/4080] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:45.026904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960825-9b0d-4f16-b7af-fe635fd00364 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:45.045374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2960825-9b0d-4f16-b7af-fe635fd00364 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:45.051719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc0602-ef77-4d7a-85e9-b28e7a4cc0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:45.053399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0602-ef77-4d7a-85e9-b28e7a4cc0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:45.053816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0602-ef77-4d7a-85e9-b28e7a4cc0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:45.054304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc0602-ef77-4d7a-85e9-b28e7a4cc0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:45.056000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0602-ef77-4d7a-85e9-b28e7a4cc0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:45.072216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc0602-ef77-4d7a-85e9-b28e7a4cc0a3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:45.093233 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2057/4081] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:45.098805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1202678-14ba-418e-9550-677697701480 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:45.129968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1202678-14ba-418e-9550-677697701480 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:45.138383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad14a38-6c56-4489-bb49-8d612da8f3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:45.139873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad14a38-6c56-4489-bb49-8d612da8f3ad admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:45.140379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad14a38-6c56-4489-bb49-8d612da8f3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:45.140799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad14a38-6c56-4489-bb49-8d612da8f3ad admin admin] PATH_INFO: `/v3/projects/ca56e69705e94a6fb86b89b6e2934f67/users/bde2c340c07d481e9e95167948dd9b1d/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:45.196044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad14a38-6c56-4489-bb49-8d612da8f3ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca56e69705e94a6fb86b89b6e2934f67, user_id=bde2c340c07d481e9e95167948dd9b1d, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:45.202901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad14a38-6c56-4489-bb49-8d612da8f3ad admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:45.241218 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2025/4082] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:45 2022] PUT /identity/v3/projects/ca56e69705e94a6fb86b89b6e2934f67/users/bde2c340c07d481e9e95167948dd9b1d/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:45.330592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec1b07-60f8-49a5-9f31-66e4035b569f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:45.330878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec1b07-60f8-49a5-9f31-66e4035b569f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:45.331165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec1b07-60f8-49a5-9f31-66e4035b569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:45.360870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f6ec1b07-60f8-49a5-9f31-66e4035b569f None None] MFA Rules not processed for user `bde2c340c07d481e9e95167948dd9b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:45.362090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f6ec1b07-60f8-49a5-9f31-66e4035b569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:45.475358 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2058/4083] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:45.480057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad14a38-6c56-4489-bb49-8d612da8f3ad admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:45.577104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad14a38-6c56-4489-bb49-8d612da8f3ad admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:45.584666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d852b78-ce15-4300-a99b-2607be40756d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:45.585577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852b78-ce15-4300-a99b-2607be40756d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:45.585903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852b78-ce15-4300-a99b-2607be40756d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:45.586328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d852b78-ce15-4300-a99b-2607be40756d admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:45.587029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d852b78-ce15-4300-a99b-2607be40756d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:45.589229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d852b78-ce15-4300-a99b-2607be40756d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:45.627177 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2026/4084] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:45 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:45.632412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec1b07-60f8-49a5-9f31-66e4035b569f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:45.658280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec1b07-60f8-49a5-9f31-66e4035b569f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:45.743265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f38676-c35f-4aa2-a5c6-364c8279c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:45.744117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38676-c35f-4aa2-a5c6-364c8279c614 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:45.744377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38676-c35f-4aa2-a5c6-364c8279c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:45.744653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38676-c35f-4aa2-a5c6-364c8279c614 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:45.745348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f38676-c35f-4aa2-a5c6-364c8279c614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:45.747896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f38676-c35f-4aa2-a5c6-364c8279c614 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:45.786716 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2059/4085] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:45 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:45.790461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d852b78-ce15-4300-a99b-2607be40756d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:45.806175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d852b78-ce15-4300-a99b-2607be40756d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:45.813294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112d116-9764-474d-b209-5fbee25b463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:45.814397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112d116-9764-474d-b209-5fbee25b463a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:45.814882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112d116-9764-474d-b209-5fbee25b463a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:45.816873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112d116-9764-474d-b209-5fbee25b463a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:45.818073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112d116-9764-474d-b209-5fbee25b463a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:45.822036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8112d116-9764-474d-b209-5fbee25b463a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:45.840908 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2027/4086] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:45.844693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f38676-c35f-4aa2-a5c6-364c8279c614 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:45.860623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f38676-c35f-4aa2-a5c6-364c8279c614 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:45.870272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f950b7-4019-494b-8aee-cb5394dc6738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:45.872330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f950b7-4019-494b-8aee-cb5394dc6738 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:45.873925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f950b7-4019-494b-8aee-cb5394dc6738 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:45.874411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f950b7-4019-494b-8aee-cb5394dc6738 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:45.875773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f950b7-4019-494b-8aee-cb5394dc6738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:45.878099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f950b7-4019-494b-8aee-cb5394dc6738 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:45.899499 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2060/4087] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:45.900927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112d116-9764-474d-b209-5fbee25b463a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:45.934453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112d116-9764-474d-b209-5fbee25b463a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:45.940724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784cb94-61a0-4ac9-9f0b-af9d3d6bdc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:45.942429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784cb94-61a0-4ac9-9f0b-af9d3d6bdc5b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:45.943012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784cb94-61a0-4ac9-9f0b-af9d3d6bdc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:45.943857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784cb94-61a0-4ac9-9f0b-af9d3d6bdc5b admin admin] PATH_INFO: `/v3/projects/be7dbe6eaa914dbe85d4c759d98cf540/users/ba64e1888749497ebcd9cf6e983dd6b4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:45.992501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784cb94-61a0-4ac9-9f0b-af9d3d6bdc5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7dbe6eaa914dbe85d4c759d98cf540, user_id=ba64e1888749497ebcd9cf6e983dd6b4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:45.998440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784cb94-61a0-4ac9-9f0b-af9d3d6bdc5b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:46.037230 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2028/4088] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:45 2022] PUT /identity/v3/projects/be7dbe6eaa914dbe85d4c759d98cf540/users/ba64e1888749497ebcd9cf6e983dd6b4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:58:46.038947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb0040-b514-4829-94f7-81c1bc503b00 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:46.039460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb0040-b514-4829-94f7-81c1bc503b00 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:46.039888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb0040-b514-4829-94f7-81c1bc503b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:46.092855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-22cb0040-b514-4829-94f7-81c1bc503b00 None None] MFA Rules not processed for user `ba64e1888749497ebcd9cf6e983dd6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:46.094907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-22cb0040-b514-4829-94f7-81c1bc503b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:46.196249 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2061/4089] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:46.197836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784cb94-61a0-4ac9-9f0b-af9d3d6bdc5b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:46.281090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784cb94-61a0-4ac9-9f0b-af9d3d6bdc5b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:46.289636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb6dd3-563b-46ea-ba3b-45c65db056c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:46.291022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb6dd3-563b-46ea-ba3b-45c65db056c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:46.291518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb6dd3-563b-46ea-ba3b-45c65db056c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:46.291963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb6dd3-563b-46ea-ba3b-45c65db056c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:46.292909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb6dd3-563b-46ea-ba3b-45c65db056c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:46.295183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb6dd3-563b-46ea-ba3b-45c65db056c6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:46.342168 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2029/4090] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:46 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:58:46.343130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb0040-b514-4829-94f7-81c1bc503b00 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:46.364231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb0040-b514-4829-94f7-81c1bc503b00 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:46.443078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c34aa-55be-4546-b0cb-56b7a030cae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:46.443793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c34aa-55be-4546-b0cb-56b7a030cae1 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:46.444130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c34aa-55be-4546-b0cb-56b7a030cae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:46.444406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c34aa-55be-4546-b0cb-56b7a030cae1 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:46.445092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c34aa-55be-4546-b0cb-56b7a030cae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:46.447013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c34aa-55be-4546-b0cb-56b7a030cae1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:46.471803 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2062/4091] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:46 2022] POST /identity/v3/users => generated 297 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:58:46.473219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb6dd3-563b-46ea-ba3b-45c65db056c6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:46.496481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb6dd3-563b-46ea-ba3b-45c65db056c6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:46.505222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc484d-26ce-467f-854c-d4f7ffe39f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:46.508679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc484d-26ce-467f-854c-d4f7ffe39f3e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:46.509139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc484d-26ce-467f-854c-d4f7ffe39f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:46.510417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc484d-26ce-467f-854c-d4f7ffe39f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:46.511325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc484d-26ce-467f-854c-d4f7ffe39f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:46.516819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc484d-26ce-467f-854c-d4f7ffe39f3e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:46.534130 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2030/4092] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:46.535371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c34aa-55be-4546-b0cb-56b7a030cae1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:46.548431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c34aa-55be-4546-b0cb-56b7a030cae1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:46.560560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf232d-0995-44a0-bebc-02fff369d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:46.563741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf232d-0995-44a0-bebc-02fff369d9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:46.564071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf232d-0995-44a0-bebc-02fff369d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:46.565204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf232d-0995-44a0-bebc-02fff369d9c4 admin admin] PATH_INFO: `/v3/projects/eb9c5150e67d4fb2a985e63892c9bd6c/users/265ae1aa09a34b5997df47fbde85bfc1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:46.593896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf232d-0995-44a0-bebc-02fff369d9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9c5150e67d4fb2a985e63892c9bd6c, user_id=265ae1aa09a34b5997df47fbde85bfc1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:46.596882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf232d-0995-44a0-bebc-02fff369d9c4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:46.616060 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2063/4093] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:46 2022] PUT /identity/v3/projects/eb9c5150e67d4fb2a985e63892c9bd6c/users/265ae1aa09a34b5997df47fbde85bfc1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:46.619872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc484d-26ce-467f-854c-d4f7ffe39f3e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:46.639031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc484d-26ce-467f-854c-d4f7ffe39f3e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:46.733731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b89663-c60d-4eb9-a3cb-13113ef4ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:46.734591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b89663-c60d-4eb9-a3cb-13113ef4ceb0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:46.734974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b89663-c60d-4eb9-a3cb-13113ef4ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:46.735348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b89663-c60d-4eb9-a3cb-13113ef4ceb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:46.736220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b89663-c60d-4eb9-a3cb-13113ef4ceb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:46.738638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b89663-c60d-4eb9-a3cb-13113ef4ceb0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:46.755786 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2031/4094] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:46.758029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf232d-0995-44a0-bebc-02fff369d9c4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:46.773821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf232d-0995-44a0-bebc-02fff369d9c4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:46.786379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79006bd-4cd2-4b13-becd-4d5fd8abeade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:46.789023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79006bd-4cd2-4b13-becd-4d5fd8abeade admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:46.789399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79006bd-4cd2-4b13-becd-4d5fd8abeade admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:46.789771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79006bd-4cd2-4b13-becd-4d5fd8abeade admin admin] PATH_INFO: `/v3/projects/eb9c5150e67d4fb2a985e63892c9bd6c/users/265ae1aa09a34b5997df47fbde85bfc1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:46.792515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79006bd-4cd2-4b13-becd-4d5fd8abeade admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9c5150e67d4fb2a985e63892c9bd6c, user_id=265ae1aa09a34b5997df47fbde85bfc1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:46.801861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79006bd-4cd2-4b13-becd-4d5fd8abeade admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:46.820766 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2064/4095] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:46 2022] PUT /identity/v3/projects/eb9c5150e67d4fb2a985e63892c9bd6c/users/265ae1aa09a34b5997df47fbde85bfc1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:46.832960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de6ef0-d7d5-4727-add1-1a98a56477b6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:46.833581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de6ef0-d7d5-4727-add1-1a98a56477b6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:46.835735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de6ef0-d7d5-4727-add1-1a98a56477b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:46.865796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-79de6ef0-d7d5-4727-add1-1a98a56477b6 None None] MFA Rules not processed for user `265ae1aa09a34b5997df47fbde85bfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:46.867100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-79de6ef0-d7d5-4727-add1-1a98a56477b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:46.956619 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2032/4096] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:46.988323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79006bd-4cd2-4b13-becd-4d5fd8abeade admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:46.991124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a79006bd-4cd2-4b13-becd-4d5fd8abeade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:47.117100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79006bd-4cd2-4b13-becd-4d5fd8abeade admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:47.121128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da60a1-9028-4756-ba4c-55d831e96ad6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:47.121910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da60a1-9028-4756-ba4c-55d831e96ad6 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:47.122199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da60a1-9028-4756-ba4c-55d831e96ad6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:47.122478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da60a1-9028-4756-ba4c-55d831e96ad6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:47.195569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da60a1-9028-4756-ba4c-55d831e96ad6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:47.197176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50da60a1-9028-4756-ba4c-55d831e96ad6 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:47.207867 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2065/4097] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:47.294990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de6ef0-d7d5-4727-add1-1a98a56477b6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:47.297250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-79de6ef0-d7d5-4727-add1-1a98a56477b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:47.389738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de6ef0-d7d5-4727-add1-1a98a56477b6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:47.396569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:47.397915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:47.398346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:47.399416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] PATH_INFO: `/v3/users/cd7c9dfb7f82412793f720486265a5bc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:47.401835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7c9dfb7f82412793f720486265a5bc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:47.404864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:47.463104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7c9dfb7f82412793f720486265a5bc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:47.471527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7c9dfb7f82412793f720486265a5bc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:47.477460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7c9dfb7f82412793f720486265a5bc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:47.478403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7c9dfb7f82412793f720486265a5bc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:47.502705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1ea426f6-4bd7-4ce6-aaea-9204fd85b7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7c9dfb7f82412793f720486265a5bc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:47.525212 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2033/4098] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:47 2022] DELETE /identity/v3/users/cd7c9dfb7f82412793f720486265a5bc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:48.255249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da60a1-9028-4756-ba4c-55d831e96ad6 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:48.267585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da60a1-9028-4756-ba4c-55d831e96ad6 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:48.346352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:48.347963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:48.348381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:48.348782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] PATH_INFO: `/v3/projects/5528600a6ba948aa9c4f6bd131569d3c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:48.351450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5528600a6ba948aa9c4f6bd131569d3c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:48.354701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:48.441265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5528600a6ba948aa9c4f6bd131569d3c', 'request_id': 'req-ade9f874-cd2e-450b-8b48-dd2cc054fea3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:48.459769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5528600a6ba948aa9c4f6bd131569d3c', 'request_id': 'req-ade9f874-cd2e-450b-8b48-dd2cc054fea3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:48.470293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5528600a6ba948aa9c4f6bd131569d3c', 'request_id': 'req-ade9f874-cd2e-450b-8b48-dd2cc054fea3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:48.487395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] The token cache is being invalidate because project 5528600a6ba948aa9c4f6bd131569d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:48.487780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:48.489207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ade9f874-cd2e-450b-8b48-dd2cc054fea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:48.496731 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2066/4099] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:48 2022] DELETE /identity/v3/projects/5528600a6ba948aa9c4f6bd131569d3c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:48.499815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f10ad-6500-4ba1-87bf-6c80bf3901b8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:48.500337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f10ad-6500-4ba1-87bf-6c80bf3901b8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:48.501150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f10ad-6500-4ba1-87bf-6c80bf3901b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:48.522179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-156f10ad-6500-4ba1-87bf-6c80bf3901b8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:48.523382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-156f10ad-6500-4ba1-87bf-6c80bf3901b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:48.670004 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2034/4100] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:48.673966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a500b-cd09-4012-9312-dd46d9811f19 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:48.674408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a500b-cd09-4012-9312-dd46d9811f19 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:48.676435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a500b-cd09-4012-9312-dd46d9811f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:48.709558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-020a500b-cd09-4012-9312-dd46d9811f19 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:48.710798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-020a500b-cd09-4012-9312-dd46d9811f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:48.722682 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2067/4101] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:48.725196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f10ad-6500-4ba1-87bf-6c80bf3901b8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:48.736488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f10ad-6500-4ba1-87bf-6c80bf3901b8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:48.744021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c075c6-e9f1-44ec-b646-36c76b1cd5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:48.745270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c075c6-e9f1-44ec-b646-36c76b1cd5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:48.745696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c075c6-e9f1-44ec-b646-36c76b1cd5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:48.759450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c075c6-e9f1-44ec-b646-36c76b1cd5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:48.760327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c075c6-e9f1-44ec-b646-36c76b1cd5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:48.760970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c075c6-e9f1-44ec-b646-36c76b1cd5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:48.763336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c075c6-e9f1-44ec-b646-36c76b1cd5b8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:48.790310 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2035/4102] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:58:48.791556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a500b-cd09-4012-9312-dd46d9811f19 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:48.808554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a500b-cd09-4012-9312-dd46d9811f19 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:48.817394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c625ed-2c57-49af-b222-8066857933de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:48.821087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c625ed-2c57-49af-b222-8066857933de admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:48.821523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c625ed-2c57-49af-b222-8066857933de admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:48.822416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c625ed-2c57-49af-b222-8066857933de admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:48.825086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c625ed-2c57-49af-b222-8066857933de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:48.827391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c625ed-2c57-49af-b222-8066857933de admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:48.877566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c075c6-e9f1-44ec-b646-36c76b1cd5b8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:48.886605 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2068/4103] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:48 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:48.893924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c075c6-e9f1-44ec-b646-36c76b1cd5b8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:48.996104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97859a82-e9b2-4b1c-ac30-e87ba62bd641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:48.998358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859a82-e9b2-4b1c-ac30-e87ba62bd641 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:48.998916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859a82-e9b2-4b1c-ac30-e87ba62bd641 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:48.999366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97859a82-e9b2-4b1c-ac30-e87ba62bd641 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:49.000689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97859a82-e9b2-4b1c-ac30-e87ba62bd641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:49.006345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97859a82-e9b2-4b1c-ac30-e87ba62bd641 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:49.040289 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2036/4104] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:48 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:49.045323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c625ed-2c57-49af-b222-8066857933de admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:49.070512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c625ed-2c57-49af-b222-8066857933de admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:49.084201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8481a4-2fbe-48e7-9e01-da3d8f5437ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:49.084886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8481a4-2fbe-48e7-9e01-da3d8f5437ce admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:49.085169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8481a4-2fbe-48e7-9e01-da3d8f5437ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:49.085449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8481a4-2fbe-48e7-9e01-da3d8f5437ce admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:49.086183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8481a4-2fbe-48e7-9e01-da3d8f5437ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:49.087812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8481a4-2fbe-48e7-9e01-da3d8f5437ce admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:49.134916 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2069/4105] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:49.144138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97859a82-e9b2-4b1c-ac30-e87ba62bd641 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:49.170771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97859a82-e9b2-4b1c-ac30-e87ba62bd641 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:49.178306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1dc90-2d8c-4a6b-92e7-7c8adfd8004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:49.179859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1dc90-2d8c-4a6b-92e7-7c8adfd8004c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:49.180371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1dc90-2d8c-4a6b-92e7-7c8adfd8004c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:49.180853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1dc90-2d8c-4a6b-92e7-7c8adfd8004c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:49.181767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1dc90-2d8c-4a6b-92e7-7c8adfd8004c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:49.183851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c1dc90-2d8c-4a6b-92e7-7c8adfd8004c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:49.200841 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2037/4106] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:58:49.204746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8481a4-2fbe-48e7-9e01-da3d8f5437ce admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:49.219846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8481a4-2fbe-48e7-9e01-da3d8f5437ce admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:49.228805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc185876-2910-43c9-9b9f-b1e81cc2c24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:49.229686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc185876-2910-43c9-9b9f-b1e81cc2c24d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:49.229965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc185876-2910-43c9-9b9f-b1e81cc2c24d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:49.230235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc185876-2910-43c9-9b9f-b1e81cc2c24d admin admin] PATH_INFO: `/v3/projects/586533ed0cf646c2945f68477b651e23/users/791eb951b71e493c82ce921d1f8f4174/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:49.262087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc185876-2910-43c9-9b9f-b1e81cc2c24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=586533ed0cf646c2945f68477b651e23, user_id=791eb951b71e493c82ce921d1f8f4174, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:49.265429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc185876-2910-43c9-9b9f-b1e81cc2c24d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:49.281918 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2070/4107] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:49 2022] PUT /identity/v3/projects/586533ed0cf646c2945f68477b651e23/users/791eb951b71e493c82ce921d1f8f4174/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:49.286840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a3410-7f42-4082-911c-4a801234869b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:49.287648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a3410-7f42-4082-911c-4a801234869b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:49.288122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a3410-7f42-4082-911c-4a801234869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:49.308983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6e9a3410-7f42-4082-911c-4a801234869b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:49.310408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6e9a3410-7f42-4082-911c-4a801234869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:49.378803 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2038/4108] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:49.399881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc185876-2910-43c9-9b9f-b1e81cc2c24d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:49.402307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dc185876-2910-43c9-9b9f-b1e81cc2c24d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:49.473034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc185876-2910-43c9-9b9f-b1e81cc2c24d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:49.478428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f36863-22c2-48a5-a5b3-a7cbef348e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:49.479077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f36863-22c2-48a5-a5b3-a7cbef348e4b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:49.480089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f36863-22c2-48a5-a5b3-a7cbef348e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:49.480089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f36863-22c2-48a5-a5b3-a7cbef348e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:49.491073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f36863-22c2-48a5-a5b3-a7cbef348e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:49.506098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f36863-22c2-48a5-a5b3-a7cbef348e4b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:49.521521 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2071/4109] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:49.544498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a3410-7f42-4082-911c-4a801234869b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:49.546226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6e9a3410-7f42-4082-911c-4a801234869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:49.561312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a3410-7f42-4082-911c-4a801234869b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:49.566379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:49.567253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:49.567721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:49.568210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] PATH_INFO: `/v3/users/4c8199b3248742a7ba0d0cb6570c7058` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:49.569467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8199b3248742a7ba0d0cb6570c7058)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:49.572115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:49.677189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8199b3248742a7ba0d0cb6570c7058'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:49.691537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8199b3248742a7ba0d0cb6570c7058'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:49.692746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8199b3248742a7ba0d0cb6570c7058'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:49.693887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8199b3248742a7ba0d0cb6570c7058'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:49.717201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8199b3248742a7ba0d0cb6570c7058'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:49.732739 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2039/4110] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:49 2022] DELETE /identity/v3/users/4c8199b3248742a7ba0d0cb6570c7058 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:49.737812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e07db-2ae9-42d0-844d-a30f43accb56 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:49.738224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e07db-2ae9-42d0-844d-a30f43accb56 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:49.738602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e07db-2ae9-42d0-844d-a30f43accb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:49.765048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ab3e07db-2ae9-42d0-844d-a30f43accb56 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:49.766222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ab3e07db-2ae9-42d0-844d-a30f43accb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:49.944112 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2072/4111] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:49.953739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:49.955574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:50.096732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927fce9-8fa2-4810-83c0-b26502319b0a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:50.100993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f7278-3e5c-4845-9887-daa67b03dc23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:50.101785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f7278-3e5c-4845-9887-daa67b03dc23 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:50.102799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f7278-3e5c-4845-9887-daa67b03dc23 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:50.102799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f7278-3e5c-4845-9887-daa67b03dc23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:50.115552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f7278-3e5c-4845-9887-daa67b03dc23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:50.117196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f7278-3e5c-4845-9887-daa67b03dc23 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:50.134529 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2040/4112] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:51.226531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e07db-2ae9-42d0-844d-a30f43accb56 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:51.228174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ab3e07db-2ae9-42d0-844d-a30f43accb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:51.245325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e07db-2ae9-42d0-844d-a30f43accb56 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:51.250750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:51.256413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:51.256920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:51.257401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] PATH_INFO: `/v3/projects/a8e2bb0e3958483d90176ec061c32ca8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:51.259450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e2bb0e3958483d90176ec061c32ca8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:51.262875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:51.353602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e2bb0e3958483d90176ec061c32ca8', 'request_id': 'req-909f2e64-1345-415a-9d5e-659a7b438cc1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.370056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e2bb0e3958483d90176ec061c32ca8', 'request_id': 'req-909f2e64-1345-415a-9d5e-659a7b438cc1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.379612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e2bb0e3958483d90176ec061c32ca8', 'request_id': 'req-909f2e64-1345-415a-9d5e-659a7b438cc1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.407014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] The token cache is being invalidate because project a8e2bb0e3958483d90176ec061c32ca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:51.407364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.408063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.414193 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2073/4113] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:51 2022] DELETE /identity/v3/projects/a8e2bb0e3958483d90176ec061c32ca8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:51.415153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f7278-3e5c-4845-9887-daa67b03dc23 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:51.433457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f7278-3e5c-4845-9887-daa67b03dc23 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:51.657224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:51.658322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:51.658666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:51.658773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] PATH_INFO: `/v3/users/3c36f9a92eea40debadbec96c0a2bef1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:51.661339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c36f9a92eea40debadbec96c0a2bef1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:51.664133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:51.728428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c36f9a92eea40debadbec96c0a2bef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.745311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c36f9a92eea40debadbec96c0a2bef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.746076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c36f9a92eea40debadbec96c0a2bef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.747157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c36f9a92eea40debadbec96c0a2bef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.765174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb2e11ae-11b1-4671-9473-3c49483a1a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c36f9a92eea40debadbec96c0a2bef1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:51.781223 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2041/4114] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:51 2022] DELETE /identity/v3/users/3c36f9a92eea40debadbec96c0a2bef1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:52.166716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:52.168769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:52.191830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f2e64-1345-415a-9d5e-659a7b438cc1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:52.263659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:52.264710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:52.265090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:52.265984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] PATH_INFO: `/v3/projects/71c0a30712034ec483067d169c2d4bae` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:52.268109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c0a30712034ec483067d169c2d4bae)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:52.270250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:52.346183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c0a30712034ec483067d169c2d4bae', 'request_id': 'req-bed323d1-cade-4132-b017-d948eaa80acc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:52.361168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c0a30712034ec483067d169c2d4bae', 'request_id': 'req-bed323d1-cade-4132-b017-d948eaa80acc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:52.369669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c0a30712034ec483067d169c2d4bae', 'request_id': 'req-bed323d1-cade-4132-b017-d948eaa80acc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:52.402236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] The token cache is being invalidate because project 71c0a30712034ec483067d169c2d4bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:52.406566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:52.407487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bed323d1-cade-4132-b017-d948eaa80acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:52.410487 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2074/4115] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:52 2022] DELETE /identity/v3/projects/71c0a30712034ec483067d169c2d4bae => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:52.415715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3fd3b-05b6-464e-b964-4d1ff65662a5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:52.417921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3fd3b-05b6-464e-b964-4d1ff65662a5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:52.418455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3fd3b-05b6-464e-b964-4d1ff65662a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:52.456980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-07d3fd3b-05b6-464e-b964-4d1ff65662a5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:52.459562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-07d3fd3b-05b6-464e-b964-4d1ff65662a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:52.571211 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2042/4116] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:52.578313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770069e9-eba9-4b76-b523-bffd9bee3f88 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:52.578595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770069e9-eba9-4b76-b523-bffd9bee3f88 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:52.578877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770069e9-eba9-4b76-b523-bffd9bee3f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:52.623962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-770069e9-eba9-4b76-b523-bffd9bee3f88 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:52.626412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-770069e9-eba9-4b76-b523-bffd9bee3f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:52.640583 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2075/4117] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:52.640769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3fd3b-05b6-464e-b964-4d1ff65662a5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:52.651172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3fd3b-05b6-464e-b964-4d1ff65662a5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:52.656176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3f1a9-1631-4d00-83e8-439f1011a239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:52.657194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3f1a9-1631-4d00-83e8-439f1011a239 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:52.657662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3f1a9-1631-4d00-83e8-439f1011a239 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:52.658135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3f1a9-1631-4d00-83e8-439f1011a239 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:52.659048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3f1a9-1631-4d00-83e8-439f1011a239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:58:52.659543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3f1a9-1631-4d00-83e8-439f1011a239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:52.661894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3f1a9-1631-4d00-83e8-439f1011a239 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:52.677361 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2043/4118] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 20:58:52.681716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770069e9-eba9-4b76-b523-bffd9bee3f88 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:52.693096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770069e9-eba9-4b76-b523-bffd9bee3f88 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:52.698753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6083848-e84e-4bcc-8b5b-b47780375d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:52.699652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6083848-e84e-4bcc-8b5b-b47780375d3f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:52.700564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6083848-e84e-4bcc-8b5b-b47780375d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:52.700947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6083848-e84e-4bcc-8b5b-b47780375d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:52.701845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6083848-e84e-4bcc-8b5b-b47780375d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:52.704089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6083848-e84e-4bcc-8b5b-b47780375d3f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:52.747523 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2076/4119] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:52 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:52.748432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3f1a9-1631-4d00-83e8-439f1011a239 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:52.763063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3f1a9-1631-4d00-83e8-439f1011a239 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:52.878284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50b0b5-c7b1-457f-bab6-42b52cebc823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:52.879522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50b0b5-c7b1-457f-bab6-42b52cebc823 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:52.881733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50b0b5-c7b1-457f-bab6-42b52cebc823 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:52.882307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50b0b5-c7b1-457f-bab6-42b52cebc823 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:52.883212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50b0b5-c7b1-457f-bab6-42b52cebc823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:52.887261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50b0b5-c7b1-457f-bab6-42b52cebc823 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:52.925262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6083848-e84e-4bcc-8b5b-b47780375d3f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:52.940005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2044/4120] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:52 2022] POST /identity/v3/users => generated 290 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:58:52.942564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6083848-e84e-4bcc-8b5b-b47780375d3f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:52.949383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e7fe-c918-4375-b163-61ac6ad5bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:52.950192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e7fe-c918-4375-b163-61ac6ad5bb8e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:52.950579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e7fe-c918-4375-b163-61ac6ad5bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:52.951005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5e7fe-c918-4375-b163-61ac6ad5bb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:52.951833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e7fe-c918-4375-b163-61ac6ad5bb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:52.953726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5e7fe-c918-4375-b163-61ac6ad5bb8e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:52.973714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50b0b5-c7b1-457f-bab6-42b52cebc823 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:52.984664 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2077/4121] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:52.994323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50b0b5-c7b1-457f-bab6-42b52cebc823 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:52.994323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a63ba-22f3-4cb9-9fa7-d6777b5c9e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:52.994323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a63ba-22f3-4cb9-9fa7-d6777b5c9e9f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:52.994323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a63ba-22f3-4cb9-9fa7-d6777b5c9e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:52.994718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a63ba-22f3-4cb9-9fa7-d6777b5c9e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:52.994718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a63ba-22f3-4cb9-9fa7-d6777b5c9e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:52.995417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a63ba-22f3-4cb9-9fa7-d6777b5c9e9f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:53.015093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e7fe-c918-4375-b163-61ac6ad5bb8e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:53.028775 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2045/4122] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:53.033121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5e7fe-c918-4375-b163-61ac6ad5bb8e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:53.044729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b19f64-823d-40af-a95d-775fe065e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:53.045910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b19f64-823d-40af-a95d-775fe065e148 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:53.046462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b19f64-823d-40af-a95d-775fe065e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:53.046844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b19f64-823d-40af-a95d-775fe065e148 admin admin] PATH_INFO: `/v3/projects/0f36a3686a4146f9bae991b08dfdb3b0/users/1ee6c71072ad4e19812feb7a1c33b77c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:53.064132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b19f64-823d-40af-a95d-775fe065e148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f36a3686a4146f9bae991b08dfdb3b0, user_id=1ee6c71072ad4e19812feb7a1c33b77c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:53.067102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b19f64-823d-40af-a95d-775fe065e148 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:53.096472 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2078/4123] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:53 2022] PUT /identity/v3/projects/0f36a3686a4146f9bae991b08dfdb3b0/users/1ee6c71072ad4e19812feb7a1c33b77c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:53.108654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eae27-1f47-423b-a998-50d46f5233bf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:53.108959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eae27-1f47-423b-a998-50d46f5233bf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:53.109245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00eae27-1f47-423b-a998-50d46f5233bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:53.158767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d00eae27-1f47-423b-a998-50d46f5233bf None None] MFA Rules not processed for user `1ee6c71072ad4e19812feb7a1c33b77c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:53.160126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d00eae27-1f47-423b-a998-50d46f5233bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:53.245844 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2046/4124] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:53.248705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b19f64-823d-40af-a95d-775fe065e148 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:53.407524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b19f64-823d-40af-a95d-775fe065e148 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:53.417559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dec90-4258-439f-acfa-95109acb5af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:53.419167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dec90-4258-439f-acfa-95109acb5af4 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:53.419529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dec90-4258-439f-acfa-95109acb5af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:53.419931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77dec90-4258-439f-acfa-95109acb5af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:53.421062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77dec90-4258-439f-acfa-95109acb5af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:53.423589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77dec90-4258-439f-acfa-95109acb5af4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:53.468165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2079/4125] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:58:53 2022] POST /identity/v3/projects => generated 377 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:53.473430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eae27-1f47-423b-a998-50d46f5233bf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:53.488888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00eae27-1f47-423b-a998-50d46f5233bf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:53.622661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720a824-11c1-4f2f-81b6-98163fff3e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:53.623511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720a824-11c1-4f2f-81b6-98163fff3e8a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:53.623896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720a824-11c1-4f2f-81b6-98163fff3e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:53.624382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720a824-11c1-4f2f-81b6-98163fff3e8a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:53.625551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720a824-11c1-4f2f-81b6-98163fff3e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:53.628075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720a824-11c1-4f2f-81b6-98163fff3e8a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:53.696969 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2047/4126] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:58:53 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:58:53.699198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dec90-4258-439f-acfa-95109acb5af4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:53.721027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77dec90-4258-439f-acfa-95109acb5af4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:53.732567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64f9fb-aee8-4c8b-bbc5-257fd3d2bcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:53.734310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64f9fb-aee8-4c8b-bbc5-257fd3d2bcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:53.734606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64f9fb-aee8-4c8b-bbc5-257fd3d2bcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:53.734885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64f9fb-aee8-4c8b-bbc5-257fd3d2bcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:53.735799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64f9fb-aee8-4c8b-bbc5-257fd3d2bcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:53.737523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64f9fb-aee8-4c8b-bbc5-257fd3d2bcf4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:53.756319 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2080/4127] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:53.758199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720a824-11c1-4f2f-81b6-98163fff3e8a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:53.776131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720a824-11c1-4f2f-81b6-98163fff3e8a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:53.803581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf920616-5ed5-4dd9-9015-76d403628cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:53.804635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf920616-5ed5-4dd9-9015-76d403628cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:53.805218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf920616-5ed5-4dd9-9015-76d403628cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:53.806226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf920616-5ed5-4dd9-9015-76d403628cc1 admin admin] PATH_INFO: `/v3/projects/2e7a7f239330459fbf71a52cf933b94e/users/3460d79db8974a0e9b23e44eb5249f93/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:53.842321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf920616-5ed5-4dd9-9015-76d403628cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7a7f239330459fbf71a52cf933b94e, user_id=3460d79db8974a0e9b23e44eb5249f93, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:53.845480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf920616-5ed5-4dd9-9015-76d403628cc1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:53.875349 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2048/4128] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:53 2022] PUT /identity/v3/projects/2e7a7f239330459fbf71a52cf933b94e/users/3460d79db8974a0e9b23e44eb5249f93/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:53.879324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64f9fb-aee8-4c8b-bbc5-257fd3d2bcf4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:53.891495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64f9fb-aee8-4c8b-bbc5-257fd3d2bcf4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:53.965855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e298026-2b8a-4bd3-8edf-faf35c3de82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:53.966061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e298026-2b8a-4bd3-8edf-faf35c3de82d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:53.972479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e298026-2b8a-4bd3-8edf-faf35c3de82d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:53.976526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e298026-2b8a-4bd3-8edf-faf35c3de82d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:53.977576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e298026-2b8a-4bd3-8edf-faf35c3de82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:53.979640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e298026-2b8a-4bd3-8edf-faf35c3de82d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:53.998177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf920616-5ed5-4dd9-9015-76d403628cc1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:54.050140 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2081/4129] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:58:54.053879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf920616-5ed5-4dd9-9015-76d403628cc1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:54.061094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b3b99-2307-4afa-b9a6-ed2b873f2d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:54.062090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b3b99-2307-4afa-b9a6-ed2b873f2d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:54.062375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b3b99-2307-4afa-b9a6-ed2b873f2d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:54.062667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b3b99-2307-4afa-b9a6-ed2b873f2d0d admin admin] PATH_INFO: `/v3/projects/2e7a7f239330459fbf71a52cf933b94e/users/3460d79db8974a0e9b23e44eb5249f93/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:54.064945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b3b99-2307-4afa-b9a6-ed2b873f2d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7a7f239330459fbf71a52cf933b94e, user_id=3460d79db8974a0e9b23e44eb5249f93, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:54.067901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2b3b99-2307-4afa-b9a6-ed2b873f2d0d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:54.092153 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2049/4130] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:58:53 2022] PUT /identity/v3/projects/2e7a7f239330459fbf71a52cf933b94e/users/3460d79db8974a0e9b23e44eb5249f93/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:54.095492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e91a-b0bd-4735-bd3a-b53da8fd355f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:54.095779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e91a-b0bd-4735-bd3a-b53da8fd355f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:54.096111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa2e91a-b0bd-4735-bd3a-b53da8fd355f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:54.141552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4fa2e91a-b0bd-4735-bd3a-b53da8fd355f None None] MFA Rules not processed for user `3460d79db8974a0e9b23e44eb5249f93`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:54.142829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4fa2e91a-b0bd-4735-bd3a-b53da8fd355f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:54.293797 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2082/4131] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:54.698149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b3b99-2307-4afa-b9a6-ed2b873f2d0d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:54.700924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e2b3b99-2307-4afa-b9a6-ed2b873f2d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:54.879352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b3b99-2307-4afa-b9a6-ed2b873f2d0d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:54.936923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa70c3c-3188-4500-b26d-819e30b34151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:54.937601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa70c3c-3188-4500-b26d-819e30b34151 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:54.937991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa70c3c-3188-4500-b26d-819e30b34151 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:54.938150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa70c3c-3188-4500-b26d-819e30b34151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:54.967290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa70c3c-3188-4500-b26d-819e30b34151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:54.969770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa70c3c-3188-4500-b26d-819e30b34151 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:55.019330 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2050/4132] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:56.161018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e91a-b0bd-4735-bd3a-b53da8fd355f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:56.310407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa2e91a-b0bd-4735-bd3a-b53da8fd355f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:56.319956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:56.321099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:56.321539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:56.321965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] PATH_INFO: `/v3/users/1ee6c71072ad4e19812feb7a1c33b77c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:56.324740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee6c71072ad4e19812feb7a1c33b77c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:56.327307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:56.409137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77eee-d957-43c5-ba68-40b77ee7ea58 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:56.409690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77eee-d957-43c5-ba68-40b77ee7ea58 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:56.409690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f77eee-d957-43c5-ba68-40b77ee7ea58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:56.428391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee6c71072ad4e19812feb7a1c33b77c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:56.444464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-76f77eee-d957-43c5-ba68-40b77ee7ea58 None None] MFA Rules not processed for user `32e2a79f7ce548d5b39cd657ac6d578a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:56.445772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-76f77eee-d957-43c5-ba68-40b77ee7ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:56.448678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee6c71072ad4e19812feb7a1c33b77c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:56.450251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee6c71072ad4e19812feb7a1c33b77c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:56.451072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee6c71072ad4e19812feb7a1c33b77c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:56.470899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-261c41a8-f7b2-44f7-a860-c132959f85a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee6c71072ad4e19812feb7a1c33b77c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:56.528183 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2083/4133] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:56 2022] DELETE /identity/v3/users/1ee6c71072ad4e19812feb7a1c33b77c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:56.532348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d9ff5-8a13-4843-9d09-8182df8e9f03 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:56.532639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d9ff5-8a13-4843-9d09-8182df8e9f03 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:56.532913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d9ff5-8a13-4843-9d09-8182df8e9f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:56.569407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-017d9ff5-8a13-4843-9d09-8182df8e9f03 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:58:56.571742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-017d9ff5-8a13-4843-9d09-8182df8e9f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:56.675359 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2051/4134] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:58:56.754695 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2084/4135] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:58:56.774853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f77eee-d957-43c5-ba68-40b77ee7ea58 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:56.777060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-76f77eee-d957-43c5-ba68-40b77ee7ea58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:56.889315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f77eee-d957-43c5-ba68-40b77ee7ea58 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:56.966812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87648-9fae-4f8f-990f-4d7e4e861b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:56.975704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87648-9fae-4f8f-990f-4d7e4e861b7b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:56.976017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87648-9fae-4f8f-990f-4d7e4e861b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:56.976260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d87648-9fae-4f8f-990f-4d7e4e861b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:56.988808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d87648-9fae-4f8f-990f-4d7e4e861b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:56.990637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d87648-9fae-4f8f-990f-4d7e4e861b7b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:57.014206 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2052/4136] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:58:58.812027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d9ff5-8a13-4843-9d09-8182df8e9f03 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:58.813360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-017d9ff5-8a13-4843-9d09-8182df8e9f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:58:58.834708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d9ff5-8a13-4843-9d09-8182df8e9f03 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:58.847223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:58.848445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:58.848730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:58.849150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] PATH_INFO: `/v3/projects/0f36a3686a4146f9bae991b08dfdb3b0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:58.852350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f36a3686a4146f9bae991b08dfdb3b0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:58.856931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:58.961262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f36a3686a4146f9bae991b08dfdb3b0', 'request_id': 'req-b8143989-cb0c-43a8-a31d-de29cc5efb01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:58.985120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f36a3686a4146f9bae991b08dfdb3b0', 'request_id': 'req-b8143989-cb0c-43a8-a31d-de29cc5efb01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:58.999882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f36a3686a4146f9bae991b08dfdb3b0', 'request_id': 'req-b8143989-cb0c-43a8-a31d-de29cc5efb01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:59.040759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] The token cache is being invalidate because project 0f36a3686a4146f9bae991b08dfdb3b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:58:59.041211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:59.042518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:59.045237 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2085/4137] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:58:58 2022] DELETE /identity/v3/projects/0f36a3686a4146f9bae991b08dfdb3b0 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:58:59.054495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87648-9fae-4f8f-990f-4d7e4e861b7b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:58:59.067611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d87648-9fae-4f8f-990f-4d7e4e861b7b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:58:59.184717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:58:59.186141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:58:59.186633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:58:59.187120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] PATH_INFO: `/v3/users/3460d79db8974a0e9b23e44eb5249f93` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:58:59.189521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3460d79db8974a0e9b23e44eb5249f93)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:58:59.191778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:58:59.299374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3460d79db8974a0e9b23e44eb5249f93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:59.321733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3460d79db8974a0e9b23e44eb5249f93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:59.322808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3460d79db8974a0e9b23e44eb5249f93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:59.323798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3460d79db8974a0e9b23e44eb5249f93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:59.341522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8b29ea6e-84e7-4e02-a83e-937cd83a2ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3460d79db8974a0e9b23e44eb5249f93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:58:59.357989 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2053/4138] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:58:59 2022] DELETE /identity/v3/users/3460d79db8974a0e9b23e44eb5249f93 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:00.128670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:00.131119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:00.162473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8143989-cb0c-43a8-a31d-de29cc5efb01 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:00.272820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:00.273814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:00.274292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:00.274741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] PATH_INFO: `/v3/projects/2e7a7f239330459fbf71a52cf933b94e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:00.276307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7a7f239330459fbf71a52cf933b94e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:00.278474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:00.359758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498b72e-8b4a-4bc8-9423-96058c138ea2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:00.360611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498b72e-8b4a-4bc8-9423-96058c138ea2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:00.360895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498b72e-8b4a-4bc8-9423-96058c138ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:00.373590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7a7f239330459fbf71a52cf933b94e', 'request_id': 'req-639da6cd-196a-42dd-8514-a234234dc98c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:00.387077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7a7f239330459fbf71a52cf933b94e', 'request_id': 'req-639da6cd-196a-42dd-8514-a234234dc98c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:00.402809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c498b72e-8b4a-4bc8-9423-96058c138ea2 None None] MFA Rules not processed for user `791eb951b71e493c82ce921d1f8f4174`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:00.404789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c498b72e-8b4a-4bc8-9423-96058c138ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:00.423826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7a7f239330459fbf71a52cf933b94e', 'request_id': 'req-639da6cd-196a-42dd-8514-a234234dc98c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:00.447317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] The token cache is being invalidate because project 2e7a7f239330459fbf71a52cf933b94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:59:00.447614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:00.448797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-639da6cd-196a-42dd-8514-a234234dc98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:00.450848 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2086/4139] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:00 2022] DELETE /identity/v3/projects/2e7a7f239330459fbf71a52cf933b94e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:00.456089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d8d89-fa14-4147-b75d-7b8fcbdf0765 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:00.456268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d8d89-fa14-4147-b75d-7b8fcbdf0765 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:00.456713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d8d89-fa14-4147-b75d-7b8fcbdf0765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:00.498788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-950d8d89-fa14-4147-b75d-7b8fcbdf0765 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:00.500459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-950d8d89-fa14-4147-b75d-7b8fcbdf0765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:00.521311 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2054/4140] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:00.532313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498b72e-8b4a-4bc8-9423-96058c138ea2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:00.533931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c498b72e-8b4a-4bc8-9423-96058c138ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:00.651674 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2087/4141] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:00.678391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae825-7ebf-47f3-860f-58f96c4779d8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:00.678926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae825-7ebf-47f3-860f-58f96c4779d8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:00.679395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ae825-7ebf-47f3-860f-58f96c4779d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:00.723280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cc0ae825-7ebf-47f3-860f-58f96c4779d8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:00.727591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cc0ae825-7ebf-47f3-860f-58f96c4779d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:00.734189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498b72e-8b4a-4bc8-9423-96058c138ea2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:00.745873 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2088/4142] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:00.749397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae825-7ebf-47f3-860f-58f96c4779d8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:00.756880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a30b0-5ab2-4054-af75-c1deb1172f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:00.757904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a30b0-5ab2-4054-af75-c1deb1172f1a service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:00.774241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a30b0-5ab2-4054-af75-c1deb1172f1a service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:00.774465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a30b0-5ab2-4054-af75-c1deb1172f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:00.790226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ae825-7ebf-47f3-860f-58f96c4779d8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:00.792271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a30b0-5ab2-4054-af75-c1deb1172f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:00.793969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a30b0-5ab2-4054-af75-c1deb1172f1a service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:00.803045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fdb8c-920e-4089-b9a5-31b52f9da344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:00.804281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fdb8c-920e-4089-b9a5-31b52f9da344 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:00.811244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fdb8c-920e-4089-b9a5-31b52f9da344 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:00.812761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fdb8c-920e-4089-b9a5-31b52f9da344 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:00.813810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fdb8c-920e-4089-b9a5-31b52f9da344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:59:00.814583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fdb8c-920e-4089-b9a5-31b52f9da344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:00.817955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158fdb8c-920e-4089-b9a5-31b52f9da344 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:00.819675 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2055/4143] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:00.841137 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2089/4144] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:59:00.845520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a30b0-5ab2-4054-af75-c1deb1172f1a service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:00.867557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a30b0-5ab2-4054-af75-c1deb1172f1a service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:00.885827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25bab9-514a-4ea0-81b1-18639f0604c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:00.886802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25bab9-514a-4ea0-81b1-18639f0604c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:00.887274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25bab9-514a-4ea0-81b1-18639f0604c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:00.887732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25bab9-514a-4ea0-81b1-18639f0604c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:00.890353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25bab9-514a-4ea0-81b1-18639f0604c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:00.892570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25bab9-514a-4ea0-81b1-18639f0604c0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:00.958436 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2056/4145] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:59:00 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:59:00.971896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fdb8c-920e-4089-b9a5-31b52f9da344 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:00.988939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fdb8c-920e-4089-b9a5-31b52f9da344 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:01.128045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dfa20-648a-4a02-a484-11b95e763095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:01.128810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dfa20-648a-4a02-a484-11b95e763095 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:01.129435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dfa20-648a-4a02-a484-11b95e763095 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:01.129435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dfa20-648a-4a02-a484-11b95e763095 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:01.129939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4dfa20-648a-4a02-a484-11b95e763095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:01.131948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4dfa20-648a-4a02-a484-11b95e763095 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:01.184437 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2090/4146] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:59:00 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:59:01.188175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25bab9-514a-4ea0-81b1-18639f0604c0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:01.203692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25bab9-514a-4ea0-81b1-18639f0604c0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:01.216768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfce6c-9cac-4c44-9a40-187d341cc748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:01.217547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfce6c-9cac-4c44-9a40-187d341cc748 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:01.217962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfce6c-9cac-4c44-9a40-187d341cc748 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:01.218312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfce6c-9cac-4c44-9a40-187d341cc748 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:01.233016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfce6c-9cac-4c44-9a40-187d341cc748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:01.240707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfce6c-9cac-4c44-9a40-187d341cc748 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:01.256240 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2057/4147] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:59:01.263570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dfa20-648a-4a02-a484-11b95e763095 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:01.284161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dfa20-648a-4a02-a484-11b95e763095 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:01.300292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe22f0-4e16-427e-8139-495999e2c772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:01.301282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe22f0-4e16-427e-8139-495999e2c772 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:01.303041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe22f0-4e16-427e-8139-495999e2c772 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:01.303374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe22f0-4e16-427e-8139-495999e2c772 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:01.305407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe22f0-4e16-427e-8139-495999e2c772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:01.312365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe22f0-4e16-427e-8139-495999e2c772 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:01.337610 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2091/4148] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:59:01.341833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfce6c-9cac-4c44-9a40-187d341cc748 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:01.355366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfce6c-9cac-4c44-9a40-187d341cc748 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:01.375581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eccb26-e278-434a-83ad-8f24c01ae9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:01.377495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eccb26-e278-434a-83ad-8f24c01ae9df admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:01.377843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eccb26-e278-434a-83ad-8f24c01ae9df admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:01.378185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eccb26-e278-434a-83ad-8f24c01ae9df admin admin] PATH_INFO: `/v3/projects/f84eadfab429428c9f1c0642dcf6e5fa/users/9d5ac01e719842ba8a3e31cfe9ce1516/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:01.409024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eccb26-e278-434a-83ad-8f24c01ae9df admin admin] RBAC: Authorizing `identity:create_grant(project_id=f84eadfab429428c9f1c0642dcf6e5fa, user_id=9d5ac01e719842ba8a3e31cfe9ce1516, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:01.412546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eccb26-e278-434a-83ad-8f24c01ae9df admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:01.440716 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2058/4149] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:59:01 2022] PUT /identity/v3/projects/f84eadfab429428c9f1c0642dcf6e5fa/users/9d5ac01e719842ba8a3e31cfe9ce1516/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:01.445696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e51db-4350-4cd4-b049-0f16d546ddaf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:01.445992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e51db-4350-4cd4-b049-0f16d546ddaf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:01.446273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e51db-4350-4cd4-b049-0f16d546ddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:01.499324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ea3e51db-4350-4cd4-b049-0f16d546ddaf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:01.501369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ea3e51db-4350-4cd4-b049-0f16d546ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:01.589995 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2092/4150] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:01.636146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eccb26-e278-434a-83ad-8f24c01ae9df admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:01.639795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-08eccb26-e278-434a-83ad-8f24c01ae9df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:01.795670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eccb26-e278-434a-83ad-8f24c01ae9df admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:01.807681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619b674-3878-494e-9594-83640f11a2fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:01.808372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b674-3878-494e-9594-83640f11a2fc service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:01.808656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b674-3878-494e-9594-83640f11a2fc service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:01.808934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619b674-3878-494e-9594-83640f11a2fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:01.826108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b674-3878-494e-9594-83640f11a2fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:01.829039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619b674-3878-494e-9594-83640f11a2fc service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:01.848557 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2059/4151] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:06.940087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e51db-4350-4cd4-b049-0f16d546ddaf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:06.942617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ea3e51db-4350-4cd4-b049-0f16d546ddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:06.963848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e51db-4350-4cd4-b049-0f16d546ddaf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:06.974072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868fcd4-0645-46af-a885-5c847a971076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:06.974749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868fcd4-0645-46af-a885-5c847a971076 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:06.975046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868fcd4-0645-46af-a885-5c847a971076 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:06.975322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868fcd4-0645-46af-a885-5c847a971076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:06.986996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6868fcd4-0645-46af-a885-5c847a971076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:07.107773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868fcd4-0645-46af-a885-5c847a971076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:07.109388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868fcd4-0645-46af-a885-5c847a971076 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:07.141276 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2093/4152] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:07.686573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a269b-ce6e-4a5e-a560-391cc39334bb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:07.687033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a269b-ce6e-4a5e-a560-391cc39334bb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:07.687112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488a269b-ce6e-4a5e-a560-391cc39334bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:07.720479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-488a269b-ce6e-4a5e-a560-391cc39334bb None None] MFA Rules not processed for user `791eb951b71e493c82ce921d1f8f4174`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:07.721945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-488a269b-ce6e-4a5e-a560-391cc39334bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:07.891818 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2060/4153] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:10.718446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868fcd4-0645-46af-a885-5c847a971076 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:10.740410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868fcd4-0645-46af-a885-5c847a971076 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:10.750261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6ea40-8d1d-4f6c-9053-07284f8fd345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:10.751212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6ea40-8d1d-4f6c-9053-07284f8fd345 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:10.751822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6ea40-8d1d-4f6c-9053-07284f8fd345 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:10.752396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6ea40-8d1d-4f6c-9053-07284f8fd345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:10.754534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-24e6ea40-8d1d-4f6c-9053-07284f8fd345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:10.849582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6ea40-8d1d-4f6c-9053-07284f8fd345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:10.851796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6ea40-8d1d-4f6c-9053-07284f8fd345 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:10.867417 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2094/4154] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:11.002791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a269b-ce6e-4a5e-a560-391cc39334bb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:11.028483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488a269b-ce6e-4a5e-a560-391cc39334bb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:11.039775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae53ac-82c4-4baf-8516-78d0a0b72c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:11.041464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae53ac-82c4-4baf-8516-78d0a0b72c6a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:11.044428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae53ac-82c4-4baf-8516-78d0a0b72c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:11.047181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae53ac-82c4-4baf-8516-78d0a0b72c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:11.051785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-20ae53ac-82c4-4baf-8516-78d0a0b72c6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:11.079690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae53ac-82c4-4baf-8516-78d0a0b72c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:11.081464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae53ac-82c4-4baf-8516-78d0a0b72c6a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:11.103627 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2061/4155] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:16.164716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303cec-a704-4ea7-b83d-4642fcedc007 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:16.166537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303cec-a704-4ea7-b83d-4642fcedc007 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:16.166940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4303cec-a704-4ea7-b83d-4642fcedc007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:16.243446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d4303cec-a704-4ea7-b83d-4642fcedc007 None None] MFA Rules not processed for user `9d5ac01e719842ba8a3e31cfe9ce1516`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:16.244960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d4303cec-a704-4ea7-b83d-4642fcedc007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:16.350344 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2095/4156] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:16.705414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae53ac-82c4-4baf-8516-78d0a0b72c6a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:16.729859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae53ac-82c4-4baf-8516-78d0a0b72c6a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:16.737836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846795f-cab9-4c85-929f-faa5aa3f7c55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:16.739657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846795f-cab9-4c85-929f-faa5aa3f7c55 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:16.740245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846795f-cab9-4c85-929f-faa5aa3f7c55 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:16.741079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846795f-cab9-4c85-929f-faa5aa3f7c55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:16.754748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846795f-cab9-4c85-929f-faa5aa3f7c55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:16.761959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846795f-cab9-4c85-929f-faa5aa3f7c55 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:16.790498 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2062/4157] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:17.146276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4303cec-a704-4ea7-b83d-4642fcedc007 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:17.163335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4303cec-a704-4ea7-b83d-4642fcedc007 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:17.173945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3fc29-9e21-4aa8-bdda-223188594a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:17.174648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3fc29-9e21-4aa8-bdda-223188594a29 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:17.174871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3fc29-9e21-4aa8-bdda-223188594a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:17.175313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3fc29-9e21-4aa8-bdda-223188594a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:17.181269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-04b3fc29-9e21-4aa8-bdda-223188594a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:17.205914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3fc29-9e21-4aa8-bdda-223188594a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:17.207676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3fc29-9e21-4aa8-bdda-223188594a29 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:17.227231 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2096/4158] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:20.081377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846795f-cab9-4c85-929f-faa5aa3f7c55 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:20.100575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846795f-cab9-4c85-929f-faa5aa3f7c55 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:20.105411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d413f-916c-4acb-9f12-93aa1823f465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:20.107176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d413f-916c-4acb-9f12-93aa1823f465 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:20.107509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d413f-916c-4acb-9f12-93aa1823f465 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:20.108302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d413f-916c-4acb-9f12-93aa1823f465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:20.110662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-806d413f-916c-4acb-9f12-93aa1823f465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:20.201040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d413f-916c-4acb-9f12-93aa1823f465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:20.202774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d413f-916c-4acb-9f12-93aa1823f465 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:20.215758 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2063/4159] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:20.840444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7229027-e751-476c-96b3-978ba54c84c4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:20.840950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7229027-e751-476c-96b3-978ba54c84c4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:20.841040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7229027-e751-476c-96b3-978ba54c84c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:20.866298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f7229027-e751-476c-96b3-978ba54c84c4 None None] MFA Rules not processed for user `0458cfbae7f945309c300d336b6dfd64`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:20.868549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f7229027-e751-476c-96b3-978ba54c84c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:20.960055 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2097/4160] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:22.904252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d413f-916c-4acb-9f12-93aa1823f465 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:22.926445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d413f-916c-4acb-9f12-93aa1823f465 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:22.933114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fdbcf-e3a3-4dba-90ac-8371fcbb0959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:22.933797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fdbcf-e3a3-4dba-90ac-8371fcbb0959 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:22.934084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fdbcf-e3a3-4dba-90ac-8371fcbb0959 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:22.934365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fdbcf-e3a3-4dba-90ac-8371fcbb0959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:22.945258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2c7fdbcf-e3a3-4dba-90ac-8371fcbb0959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:22.970268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fdbcf-e3a3-4dba-90ac-8371fcbb0959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:22.972600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fdbcf-e3a3-4dba-90ac-8371fcbb0959 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:22.985372 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2064/4161] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:23.410105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16028-4788-472a-bd87-31d61a287431 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:23.410589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16028-4788-472a-bd87-31d61a287431 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:23.410686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce16028-4788-472a-bd87-31d61a287431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:23.444830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0ce16028-4788-472a-bd87-31d61a287431 None None] MFA Rules not processed for user `70fab8e4c45d48ea8223a3acc60a5442`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:23.447185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0ce16028-4788-472a-bd87-31d61a287431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:23.550831 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2098/4162] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:28.564996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fdbcf-e3a3-4dba-90ac-8371fcbb0959 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:28.579086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fdbcf-e3a3-4dba-90ac-8371fcbb0959 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:28.585412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:28.586540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:28.587049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:28.587498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] PATH_INFO: `/v3/users/9d5ac01e719842ba8a3e31cfe9ce1516` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:28.588886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5ac01e719842ba8a3e31cfe9ce1516)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:28.590962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:28.695477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5ac01e719842ba8a3e31cfe9ce1516'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:28.713545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5ac01e719842ba8a3e31cfe9ce1516'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:28.714414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5ac01e719842ba8a3e31cfe9ce1516'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:28.715198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5ac01e719842ba8a3e31cfe9ce1516'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:28.741754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5ac01e719842ba8a3e31cfe9ce1516'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:28.769532 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2065/4163] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:59:28 2022] DELETE /identity/v3/users/9d5ac01e719842ba8a3e31cfe9ce1516 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:29.359905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16028-4788-472a-bd87-31d61a287431 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:29.361305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0ce16028-4788-472a-bd87-31d61a287431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:29.401397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce16028-4788-472a-bd87-31d61a287431 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:29.511696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ca6f7-dc73-4b1a-be7c-818882e8cc8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:29.512785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ca6f7-dc73-4b1a-be7c-818882e8cc8e service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:29.513572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ca6f7-dc73-4b1a-be7c-818882e8cc8e service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:29.514001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ca6f7-dc73-4b1a-be7c-818882e8cc8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:29.516608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6b6ca6f7-dc73-4b1a-be7c-818882e8cc8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:29.536675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ca6f7-dc73-4b1a-be7c-818882e8cc8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:29.538322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ca6f7-dc73-4b1a-be7c-818882e8cc8e service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:29.553813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:29.557651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:29.564078 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2099/4164] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:29.658328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195ac3f-12df-4b1b-8570-7f9896d8ddc0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:29.665785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:29.666969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:29.667462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:29.668289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] PATH_INFO: `/v3/projects/f84eadfab429428c9f1c0642dcf6e5fa` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:29.669742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f84eadfab429428c9f1c0642dcf6e5fa)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:29.671880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:29.728414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f84eadfab429428c9f1c0642dcf6e5fa', 'request_id': 'req-27c33546-beba-4546-a7ba-949e0526d380'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:29.747779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f84eadfab429428c9f1c0642dcf6e5fa', 'request_id': 'req-27c33546-beba-4546-a7ba-949e0526d380'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:29.754880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f84eadfab429428c9f1c0642dcf6e5fa', 'request_id': 'req-27c33546-beba-4546-a7ba-949e0526d380'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:29.767075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] The token cache is being invalidate because project f84eadfab429428c9f1c0642dcf6e5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:59:29.767374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:29.768078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27c33546-beba-4546-a7ba-949e0526d380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:29.769668 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2066/4165] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:29 2022] DELETE /identity/v3/projects/f84eadfab429428c9f1c0642dcf6e5fa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:29.775039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d11f3-de7e-4a04-ae43-bd9632fc7628 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:29.775593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d11f3-de7e-4a04-ae43-bd9632fc7628 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:29.775909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d11f3-de7e-4a04-ae43-bd9632fc7628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:29.799819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a10d11f3-de7e-4a04-ae43-bd9632fc7628 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:29.801347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a10d11f3-de7e-4a04-ae43-bd9632fc7628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:29.865637 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2100/4166] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 20:59:29.873009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab1bcb-c73f-4adc-9641-442b48f7feaf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:29.873381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab1bcb-c73f-4adc-9641-442b48f7feaf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:29.873925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab1bcb-c73f-4adc-9641-442b48f7feaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:29.895668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5dab1bcb-c73f-4adc-9641-442b48f7feaf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:29.896933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5dab1bcb-c73f-4adc-9641-442b48f7feaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:29.910237 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2067/4167] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:29.912126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d11f3-de7e-4a04-ae43-bd9632fc7628 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:29.922123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d11f3-de7e-4a04-ae43-bd9632fc7628 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:29.927412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b483d-9152-4410-9ea3-6131121b064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:29.928198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b483d-9152-4410-9ea3-6131121b064d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:29.928549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b483d-9152-4410-9ea3-6131121b064d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:29.928899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b483d-9152-4410-9ea3-6131121b064d admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:29.929688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b483d-9152-4410-9ea3-6131121b064d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:59:29.930058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b483d-9152-4410-9ea3-6131121b064d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:29.931747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b483d-9152-4410-9ea3-6131121b064d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:29.944302 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2101/4168] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:59:29.957893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab1bcb-c73f-4adc-9641-442b48f7feaf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:29.967712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab1bcb-c73f-4adc-9641-442b48f7feaf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:29.972539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb5e1e-610b-429c-a1fe-dff56c5fb3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:29.973308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb5e1e-610b-429c-a1fe-dff56c5fb3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:29.974218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb5e1e-610b-429c-a1fe-dff56c5fb3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:29.974994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb5e1e-610b-429c-a1fe-dff56c5fb3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:29.975381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb5e1e-610b-429c-a1fe-dff56c5fb3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:29.978135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb5e1e-610b-429c-a1fe-dff56c5fb3e1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:30.024584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b483d-9152-4410-9ea3-6131121b064d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:30.028558 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2068/4169] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:59:29 2022] POST /identity/v3/projects => generated 363 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:59:30.056537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b483d-9152-4410-9ea3-6131121b064d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:30.212298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadb397-1ce1-4121-aea5-6374af50f86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:30.214409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadb397-1ce1-4121-aea5-6374af50f86d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:30.214699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadb397-1ce1-4121-aea5-6374af50f86d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:30.216300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadb397-1ce1-4121-aea5-6374af50f86d admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:30.216944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadb397-1ce1-4121-aea5-6374af50f86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:30.218927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadb397-1ce1-4121-aea5-6374af50f86d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:30.273126 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2102/4170] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:59:30 2022] POST /identity/v3/users => generated 282 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:59:30.277775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb5e1e-610b-429c-a1fe-dff56c5fb3e1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:30.290023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb5e1e-610b-429c-a1fe-dff56c5fb3e1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:30.295782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bc9ac-0716-4459-863b-af1b9ac92944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:30.296565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc9ac-0716-4459-863b-af1b9ac92944 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:30.296909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc9ac-0716-4459-863b-af1b9ac92944 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:30.297419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65bc9ac-0716-4459-863b-af1b9ac92944 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:30.298224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bc9ac-0716-4459-863b-af1b9ac92944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:30.300118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65bc9ac-0716-4459-863b-af1b9ac92944 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:30.318130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadb397-1ce1-4121-aea5-6374af50f86d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:30.326013 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2069/4171] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:59:30.331046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadb397-1ce1-4121-aea5-6374af50f86d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:30.337213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ac3ea-f79b-4d50-ae42-e057843bf023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:30.338035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ac3ea-f79b-4d50-ae42-e057843bf023 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:30.338420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ac3ea-f79b-4d50-ae42-e057843bf023 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:30.338799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ac3ea-f79b-4d50-ae42-e057843bf023 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:30.339628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ac3ea-f79b-4d50-ae42-e057843bf023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:30.341553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ac3ea-f79b-4d50-ae42-e057843bf023 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:30.358362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bc9ac-0716-4459-863b-af1b9ac92944 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:30.360222 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2103/4172] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:59:30.370410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65bc9ac-0716-4459-863b-af1b9ac92944 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:30.375846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ca539-dcfa-463f-8136-dd4afdf7dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:30.377062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ca539-dcfa-463f-8136-dd4afdf7dbad admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:30.377522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ca539-dcfa-463f-8136-dd4afdf7dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:30.377885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ca539-dcfa-463f-8136-dd4afdf7dbad admin admin] PATH_INFO: `/v3/projects/496f2be9357e414ca8db7bf1f5ed0234/users/fdd16c1bdb3d416d8421202397566d1c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:30.394623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ca539-dcfa-463f-8136-dd4afdf7dbad admin admin] RBAC: Authorizing `identity:create_grant(project_id=496f2be9357e414ca8db7bf1f5ed0234, user_id=fdd16c1bdb3d416d8421202397566d1c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:30.398043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ca539-dcfa-463f-8136-dd4afdf7dbad admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:30.412901 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2070/4173] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:59:30 2022] PUT /identity/v3/projects/496f2be9357e414ca8db7bf1f5ed0234/users/fdd16c1bdb3d416d8421202397566d1c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:59:30.418549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8d2c-2d8e-4d6c-9d25-744ad5c2dfc8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:30.418838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8d2c-2d8e-4d6c-9d25-744ad5c2dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:30.419115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c8d2c-2d8e-4d6c-9d25-744ad5c2dfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:30.440151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a77c8d2c-2d8e-4d6c-9d25-744ad5c2dfc8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:30.441435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a77c8d2c-2d8e-4d6c-9d25-744ad5c2dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:30.513179 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2104/4174] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:30.550441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ca539-dcfa-463f-8136-dd4afdf7dbad admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:30.552829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f6ca539-dcfa-463f-8136-dd4afdf7dbad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:30.710922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ca539-dcfa-463f-8136-dd4afdf7dbad admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:30.716546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff05b84-6a8a-4061-9f39-9f7fdd6933a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:30.717464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05b84-6a8a-4061-9f39-9f7fdd6933a9 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:30.717986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05b84-6a8a-4061-9f39-9f7fdd6933a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:30.718730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff05b84-6a8a-4061-9f39-9f7fdd6933a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:30.732759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff05b84-6a8a-4061-9f39-9f7fdd6933a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:30.734996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff05b84-6a8a-4061-9f39-9f7fdd6933a9 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:30.748803 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2071/4175] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:33.420171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5590b8-7158-46c0-9089-b78fae3b77ab None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:33.420757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5590b8-7158-46c0-9089-b78fae3b77ab None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:33.420757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5590b8-7158-46c0-9089-b78fae3b77ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:33.460849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1a5590b8-7158-46c0-9089-b78fae3b77ab None None] MFA Rules not processed for user `fdd16c1bdb3d416d8421202397566d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:33.462077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1a5590b8-7158-46c0-9089-b78fae3b77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:33.587963 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2105/4176] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:33.596549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124d28-8803-4967-84d2-efab5157da34 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:33.597088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124d28-8803-4967-84d2-efab5157da34 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:33.597250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b124d28-8803-4967-84d2-efab5157da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:33.618407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9b124d28-8803-4967-84d2-efab5157da34 None None] MFA Rules not processed for user `fdd16c1bdb3d416d8421202397566d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:33.619974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9b124d28-8803-4967-84d2-efab5157da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:33.633232 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2072/4177] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:33.709473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5590b8-7158-46c0-9089-b78fae3b77ab None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:33.710883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1a5590b8-7158-46c0-9089-b78fae3b77ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:33.818811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5590b8-7158-46c0-9089-b78fae3b77ab None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:33.826746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834f0f2-b0d3-4463-882b-cb65830d1c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:33.827959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834f0f2-b0d3-4463-882b-cb65830d1c72 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:33.827959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834f0f2-b0d3-4463-882b-cb65830d1c72 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:33.827959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834f0f2-b0d3-4463-882b-cb65830d1c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:33.837078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834f0f2-b0d3-4463-882b-cb65830d1c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:33.838095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834f0f2-b0d3-4463-882b-cb65830d1c72 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:33.848364 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2106/4178] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:34.876074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124d28-8803-4967-84d2-efab5157da34 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:34.877476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9b124d28-8803-4967-84d2-efab5157da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:34.994693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b124d28-8803-4967-84d2-efab5157da34 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:35.002413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:35.004993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:35.005499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:35.005976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:35.008098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:35.030839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:35.033656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:35.055941 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2073/4179] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:39.745652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834f0f2-b0d3-4463-882b-cb65830d1c72 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:39.766201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834f0f2-b0d3-4463-882b-cb65830d1c72 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:39.774739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd6fc0-569a-4406-a3b9-7d1427c19b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:39.775667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd6fc0-569a-4406-a3b9-7d1427c19b4a service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:39.776274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd6fc0-569a-4406-a3b9-7d1427c19b4a service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:39.776762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd6fc0-569a-4406-a3b9-7d1427c19b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:39.779693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c7cd6fc0-569a-4406-a3b9-7d1427c19b4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:39.807765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd6fc0-569a-4406-a3b9-7d1427c19b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:39.809783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd6fc0-569a-4406-a3b9-7d1427c19b4a service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:39.836342 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2107/4180] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:41.132292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:41.134918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:41.226763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bcc9d3-5e91-4961-8ab6-6fe3ffad912b service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:41.232304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:41.233449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:41.233943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:41.234410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] PATH_INFO: `/v3/users/bde2c340c07d481e9e95167948dd9b1d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:41.236166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde2c340c07d481e9e95167948dd9b1d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:41.238387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:41.306193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde2c340c07d481e9e95167948dd9b1d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:41.317988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde2c340c07d481e9e95167948dd9b1d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:41.318623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde2c340c07d481e9e95167948dd9b1d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:41.319280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde2c340c07d481e9e95167948dd9b1d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:41.337082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde2c340c07d481e9e95167948dd9b1d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:41.361696 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2074/4181] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:59:41 2022] DELETE /identity/v3/users/bde2c340c07d481e9e95167948dd9b1d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:41.363475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cf722-5ca5-4940-ae69-52ae9f60c76b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:41.364024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cf722-5ca5-4940-ae69-52ae9f60c76b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:41.364160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01cf722-5ca5-4940-ae69-52ae9f60c76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:41.399971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f01cf722-5ca5-4940-ae69-52ae9f60c76b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:41.402121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f01cf722-5ca5-4940-ae69-52ae9f60c76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:41.478910 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2108/4182] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:41.496796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:41.507726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:41.603613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a694d59-a836-4780-b463-a2c2141e2091 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:41.609715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861143e1-90f6-4648-a67f-32e5873a4b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:41.609986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861143e1-90f6-4648-a67f-32e5873a4b8d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:41.610196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861143e1-90f6-4648-a67f-32e5873a4b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:41.610515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861143e1-90f6-4648-a67f-32e5873a4b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:41.621536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861143e1-90f6-4648-a67f-32e5873a4b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:41.623195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861143e1-90f6-4648-a67f-32e5873a4b8d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:41.647569 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2075/4183] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:42.139319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cf722-5ca5-4940-ae69-52ae9f60c76b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:42.140851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f01cf722-5ca5-4940-ae69-52ae9f60c76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:42.157700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01cf722-5ca5-4940-ae69-52ae9f60c76b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:42.163293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:42.164994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:42.165320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:42.165603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] PATH_INFO: `/v3/projects/ca56e69705e94a6fb86b89b6e2934f67` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:42.166881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca56e69705e94a6fb86b89b6e2934f67)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:42.170630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:42.244751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca56e69705e94a6fb86b89b6e2934f67', 'request_id': 'req-bf32dce3-c087-436e-8cb9-8ce4888335a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.257359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca56e69705e94a6fb86b89b6e2934f67', 'request_id': 'req-bf32dce3-c087-436e-8cb9-8ce4888335a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.280973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca56e69705e94a6fb86b89b6e2934f67', 'request_id': 'req-bf32dce3-c087-436e-8cb9-8ce4888335a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.309321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] The token cache is being invalidate because project ca56e69705e94a6fb86b89b6e2934f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:59:42.309617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.310218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.312726 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2109/4184] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:42 2022] DELETE /identity/v3/projects/ca56e69705e94a6fb86b89b6e2934f67 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:42.316256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861143e1-90f6-4648-a67f-32e5873a4b8d service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:42.348138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861143e1-90f6-4648-a67f-32e5873a4b8d service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:42.469709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:42.470791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:42.471200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:42.471771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] PATH_INFO: `/v3/users/ba64e1888749497ebcd9cf6e983dd6b4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:42.473261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba64e1888749497ebcd9cf6e983dd6b4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:42.475415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:42.584234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba64e1888749497ebcd9cf6e983dd6b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.600042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba64e1888749497ebcd9cf6e983dd6b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.600729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba64e1888749497ebcd9cf6e983dd6b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.601874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba64e1888749497ebcd9cf6e983dd6b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.620153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba64e1888749497ebcd9cf6e983dd6b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:42.651980 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2076/4185] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:59:42 2022] DELETE /identity/v3/users/ba64e1888749497ebcd9cf6e983dd6b4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 20:59:43.466789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:43.468942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:43.486038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32dce3-c087-436e-8cb9-8ce4888335a7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:43.557992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:43.558893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:43.559370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:43.559654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] PATH_INFO: `/v3/projects/be7dbe6eaa914dbe85d4c759d98cf540` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:43.561528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7dbe6eaa914dbe85d4c759d98cf540)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:43.564325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:43.637489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7dbe6eaa914dbe85d4c759d98cf540', 'request_id': 'req-33f61b10-66cb-4b9f-b5b0-45bc508ef957'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.647405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7dbe6eaa914dbe85d4c759d98cf540', 'request_id': 'req-33f61b10-66cb-4b9f-b5b0-45bc508ef957'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.654069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7dbe6eaa914dbe85d4c759d98cf540', 'request_id': 'req-33f61b10-66cb-4b9f-b5b0-45bc508ef957'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.668294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] The token cache is being invalidate because project be7dbe6eaa914dbe85d4c759d98cf540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:59:43.668775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.669258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.673676 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2110/4186] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:43 2022] DELETE /identity/v3/projects/be7dbe6eaa914dbe85d4c759d98cf540 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:43.674910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:43.676546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:43.691167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3fe1e6-15bd-49a2-a01c-dd0609c55f88 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:43.758495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:43.759499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:43.759849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:43.760334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] PATH_INFO: `/v3/users/265ae1aa09a34b5997df47fbde85bfc1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:43.764770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265ae1aa09a34b5997df47fbde85bfc1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:43.767349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:43.853002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265ae1aa09a34b5997df47fbde85bfc1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.867881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265ae1aa09a34b5997df47fbde85bfc1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.868580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265ae1aa09a34b5997df47fbde85bfc1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.877078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265ae1aa09a34b5997df47fbde85bfc1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.907045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-107caac2-cb29-4606-8b9f-4614b9003a20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265ae1aa09a34b5997df47fbde85bfc1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:43.923418 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2077/4187] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 20:59:43 2022] DELETE /identity/v3/users/265ae1aa09a34b5997df47fbde85bfc1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:44.853041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:44.854916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:44.885963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f61b10-66cb-4b9f-b5b0-45bc508ef957 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:44.984852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:44.985887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:44.986268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:44.986642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] PATH_INFO: `/v3/projects/eb9c5150e67d4fb2a985e63892c9bd6c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:44.987990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9c5150e67d4fb2a985e63892c9bd6c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:44.990726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:45.070101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9c5150e67d4fb2a985e63892c9bd6c', 'request_id': 'req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:45.079605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9c5150e67d4fb2a985e63892c9bd6c', 'request_id': 'req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:45.086715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9c5150e67d4fb2a985e63892c9bd6c', 'request_id': 'req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:45.101055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] The token cache is being invalidate because project eb9c5150e67d4fb2a985e63892c9bd6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 20:59:45.101476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:45.102489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75c2a5cd-9b5d-4cf8-b8d6-e7ecfea708bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 20:59:45.106497 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2111/4188] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 20:59:44 2022] DELETE /identity/v3/projects/eb9c5150e67d4fb2a985e63892c9bd6c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:45.112296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876955-86cc-4636-ac46-28c63aa90be8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.116568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876955-86cc-4636-ac46-28c63aa90be8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.116568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876955-86cc-4636-ac46-28c63aa90be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.160859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-be876955-86cc-4636-ac46-28c63aa90be8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:45.162176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be876955-86cc-4636-ac46-28c63aa90be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:45.234558 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2078/4189] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:45.242928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee690c-1f48-420a-a4e8-2422fbc981aa None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.243306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee690c-1f48-420a-a4e8-2422fbc981aa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.243665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bee690c-1f48-420a-a4e8-2422fbc981aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.262484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0bee690c-1f48-420a-a4e8-2422fbc981aa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:45.263853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0bee690c-1f48-420a-a4e8-2422fbc981aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:45.273143 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2112/4190] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:45.277999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876955-86cc-4636-ac46-28c63aa90be8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:45.287806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876955-86cc-4636-ac46-28c63aa90be8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:45.292499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b76b9-6bc3-44dc-bec2-26f8eb3d2ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:45.293241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b76b9-6bc3-44dc-bec2-26f8eb3d2ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.293601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b76b9-6bc3-44dc-bec2-26f8eb3d2ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.293957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b76b9-6bc3-44dc-bec2-26f8eb3d2ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.294754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b76b9-6bc3-44dc-bec2-26f8eb3d2ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 20:59:45.295126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b76b9-6bc3-44dc-bec2-26f8eb3d2ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:45.296869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b76b9-6bc3-44dc-bec2-26f8eb3d2ae1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:45.309042 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2079/4191] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 20:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 20:59:45.313406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee690c-1f48-420a-a4e8-2422fbc981aa None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:45.323694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bee690c-1f48-420a-a4e8-2422fbc981aa None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:45.328879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a9cf7-20bb-4897-ab65-317a5f00de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:45.329615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a9cf7-20bb-4897-ab65-317a5f00de55 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.329973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a9cf7-20bb-4897-ab65-317a5f00de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.330326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a9cf7-20bb-4897-ab65-317a5f00de55 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.331132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a9cf7-20bb-4897-ab65-317a5f00de55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:45.333243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a9cf7-20bb-4897-ab65-317a5f00de55 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:45.368804 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2113/4192] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 20:59:45 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 20:59:45.372845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b76b9-6bc3-44dc-bec2-26f8eb3d2ae1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:45.384602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b76b9-6bc3-44dc-bec2-26f8eb3d2ae1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:45.445041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38981901-ea80-42ef-965b-dfc8046ddf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:45.445712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981901-ea80-42ef-965b-dfc8046ddf82 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.446006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981901-ea80-42ef-965b-dfc8046ddf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.446264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38981901-ea80-42ef-965b-dfc8046ddf82 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.446957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38981901-ea80-42ef-965b-dfc8046ddf82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:45.449192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38981901-ea80-42ef-965b-dfc8046ddf82 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:45.477682 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2080/4193] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 20:59:45 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 20:59:45.481670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a9cf7-20bb-4897-ab65-317a5f00de55 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:45.498430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a9cf7-20bb-4897-ab65-317a5f00de55 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:45.503672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146c79a-2f76-49b4-86a8-eb827752fefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:45.504489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c79a-2f76-49b4-86a8-eb827752fefd admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.504696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c79a-2f76-49b4-86a8-eb827752fefd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.507013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146c79a-2f76-49b4-86a8-eb827752fefd admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.508301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146c79a-2f76-49b4-86a8-eb827752fefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:45.509464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146c79a-2f76-49b4-86a8-eb827752fefd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:45.522459 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2114/4194] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 20:59:45.526611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38981901-ea80-42ef-965b-dfc8046ddf82 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:45.541469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38981901-ea80-42ef-965b-dfc8046ddf82 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:45.553018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e215ba-1096-4de4-bd3a-d56f474e703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:45.553703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e215ba-1096-4de4-bd3a-d56f474e703c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.553983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e215ba-1096-4de4-bd3a-d56f474e703c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.554259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e215ba-1096-4de4-bd3a-d56f474e703c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.554978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e215ba-1096-4de4-bd3a-d56f474e703c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:45.557270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e215ba-1096-4de4-bd3a-d56f474e703c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:45.577411 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2081/4195] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 20:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 20:59:45.582836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146c79a-2f76-49b4-86a8-eb827752fefd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:45.593750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146c79a-2f76-49b4-86a8-eb827752fefd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:45.599864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9bd81-7774-4cb6-b354-7694aa7662a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:45.600907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9bd81-7774-4cb6-b354-7694aa7662a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.601115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9bd81-7774-4cb6-b354-7694aa7662a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.602382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9bd81-7774-4cb6-b354-7694aa7662a4 admin admin] PATH_INFO: `/v3/projects/f7c998fb98ff4ad3947f0e147eaf4393/users/7556c6d8faaa45e7980806d59e122c88/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.619374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9bd81-7774-4cb6-b354-7694aa7662a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c998fb98ff4ad3947f0e147eaf4393, user_id=7556c6d8faaa45e7980806d59e122c88, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:45.622139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9bd81-7774-4cb6-b354-7694aa7662a4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:45.644011 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2115/4196] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 20:59:45 2022] PUT /identity/v3/projects/f7c998fb98ff4ad3947f0e147eaf4393/users/7556c6d8faaa45e7980806d59e122c88/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 20:59:45.649460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f5fba-34d6-47ed-936f-10d29e8dad55 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.649711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f5fba-34d6-47ed-936f-10d29e8dad55 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.649990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f5fba-34d6-47ed-936f-10d29e8dad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.681643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c95f5fba-34d6-47ed-936f-10d29e8dad55 None None] MFA Rules not processed for user `7556c6d8faaa45e7980806d59e122c88`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:45.682888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c95f5fba-34d6-47ed-936f-10d29e8dad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:45.783627 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2082/4197] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 20:59:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:45.790313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9bd81-7774-4cb6-b354-7694aa7662a4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:45.792172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5ac9bd81-7774-4cb6-b354-7694aa7662a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:45.852910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9bd81-7774-4cb6-b354-7694aa7662a4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:45.856621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecee8d9-faa5-40a9-bec1-546acfe28a4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:45.857274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecee8d9-faa5-40a9-bec1-546acfe28a4d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:45.857559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecee8d9-faa5-40a9-bec1-546acfe28a4d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:45.857865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecee8d9-faa5-40a9-bec1-546acfe28a4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:45.867274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecee8d9-faa5-40a9-bec1-546acfe28a4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:45.869712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecee8d9-faa5-40a9-bec1-546acfe28a4d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:45.880105 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2116/4198] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:46.426518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f5fba-34d6-47ed-936f-10d29e8dad55 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:46.428416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c95f5fba-34d6-47ed-936f-10d29e8dad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:46.537164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f5fba-34d6-47ed-936f-10d29e8dad55 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:46.543036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:46.543776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:46.544132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:46.544478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:46.550632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:46.567838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:46.570084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:46.596223 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2083/4199] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 20:59:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 20:59:55.125589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a1485-5576-4440-a98b-4ba37714c977 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:55.127398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a1485-5576-4440-a98b-4ba37714c977 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:55.127897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a1485-5576-4440-a98b-4ba37714c977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:55.221791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-079a1485-5576-4440-a98b-4ba37714c977 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 20:59:55.226144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-079a1485-5576-4440-a98b-4ba37714c977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:55.373883 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2117/4200] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 20:59:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 20:59:55.472263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 20:59:55.478245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 20:59:55.589728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f75c4-9886-4616-a921-50157741cbd8 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 20:59:55.594905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205a0e-4c53-46a8-9841-75d4faa267ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 20:59:55.595552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205a0e-4c53-46a8-9841-75d4faa267ec service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 20:59:55.595839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205a0e-4c53-46a8-9841-75d4faa267ec service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 20:59:55.596159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9205a0e-4c53-46a8-9841-75d4faa267ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 20:59:55.609207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9205a0e-4c53-46a8-9841-75d4faa267ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 20:59:55.611088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9205a0e-4c53-46a8-9841-75d4faa267ec service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 20:59:55.620687 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2084/4201] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 20:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:00:06.523495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeca786-9ed4-46e1-8d5e-2c35ecb3026b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:06.524191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeca786-9ed4-46e1-8d5e-2c35ecb3026b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:06.524191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeca786-9ed4-46e1-8d5e-2c35ecb3026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:06.560834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9aeca786-9ed4-46e1-8d5e-2c35ecb3026b None None] MFA Rules not processed for user `3cb495ec547743d38a7502110a166b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:06.562068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9aeca786-9ed4-46e1-8d5e-2c35ecb3026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:06.684802 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2118/4202] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:07.986186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205a0e-4c53-46a8-9841-75d4faa267ec service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:08.008648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9205a0e-4c53-46a8-9841-75d4faa267ec service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:08.023824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fa19b-9ba6-4de1-91cf-9afc2fb78694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:08.025964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fa19b-9ba6-4de1-91cf-9afc2fb78694 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:08.028180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fa19b-9ba6-4de1-91cf-9afc2fb78694 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:08.031162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55fa19b-9ba6-4de1-91cf-9afc2fb78694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:08.047012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c55fa19b-9ba6-4de1-91cf-9afc2fb78694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:08.064652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fa19b-9ba6-4de1-91cf-9afc2fb78694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:08.068140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55fa19b-9ba6-4de1-91cf-9afc2fb78694 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:08.086599 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2085/4203] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:00:09.028819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeca786-9ed4-46e1-8d5e-2c35ecb3026b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:09.032229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9aeca786-9ed4-46e1-8d5e-2c35ecb3026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:09.260225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeca786-9ed4-46e1-8d5e-2c35ecb3026b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:09.266355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:09.267286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:09.267610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:09.267933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] PATH_INFO: `/v3/users/0458cfbae7f945309c300d336b6dfd64` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:09.270009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0458cfbae7f945309c300d336b6dfd64)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:09.273865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:09.402388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0458cfbae7f945309c300d336b6dfd64'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:09.428621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0458cfbae7f945309c300d336b6dfd64'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:09.432057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0458cfbae7f945309c300d336b6dfd64'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:09.433715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0458cfbae7f945309c300d336b6dfd64'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:09.452334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f106ed2-11af-45ce-9727-620c78b83230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0458cfbae7f945309c300d336b6dfd64'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:09.482132 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2119/4204] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:00:09 2022] DELETE /identity/v3/users/0458cfbae7f945309c300d336b6dfd64 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:10.685672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fa19b-9ba6-4de1-91cf-9afc2fb78694 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:10.720791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55fa19b-9ba6-4de1-91cf-9afc2fb78694 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:10.866982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:10.871833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:10.872371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:10.872878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] PATH_INFO: `/v3/projects/c3f87b02119a4e3f86e4fdc7a4bd93a6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:10.877519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f87b02119a4e3f86e4fdc7a4bd93a6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:10.892751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:11.014155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'request_id': 'req-237d03c3-8bc5-476a-bc7a-60733ab3ee32'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:11.034891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'request_id': 'req-237d03c3-8bc5-476a-bc7a-60733ab3ee32'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:11.043984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f87b02119a4e3f86e4fdc7a4bd93a6', 'request_id': 'req-237d03c3-8bc5-476a-bc7a-60733ab3ee32'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:11.070121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] The token cache is being invalidate because project c3f87b02119a4e3f86e4fdc7a4bd93a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:00:11.070668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:11.072982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-237d03c3-8bc5-476a-bc7a-60733ab3ee32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:11.076459 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2086/4205] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:10 2022] DELETE /identity/v3/projects/c3f87b02119a4e3f86e4fdc7a4bd93a6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:11.082413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be085e-959e-49f8-8ae1-dad38cb5a356 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:11.083201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be085e-959e-49f8-8ae1-dad38cb5a356 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:11.083201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be085e-959e-49f8-8ae1-dad38cb5a356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:11.171809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-63be085e-959e-49f8-8ae1-dad38cb5a356 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:11.175103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-63be085e-959e-49f8-8ae1-dad38cb5a356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:11.297154 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2120/4206] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:11.306424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761da761-7054-4715-b065-6c312f5774ac None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:11.306975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761da761-7054-4715-b065-6c312f5774ac None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:11.307483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761da761-7054-4715-b065-6c312f5774ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:11.349305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-761da761-7054-4715-b065-6c312f5774ac None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:11.350690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-761da761-7054-4715-b065-6c312f5774ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:11.367831 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2087/4207] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:11.371867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be085e-959e-49f8-8ae1-dad38cb5a356 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:11.385736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be085e-959e-49f8-8ae1-dad38cb5a356 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:11.398398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d472b4-b1f7-4cdc-be9f-f26b464e3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:11.399349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d472b4-b1f7-4cdc-be9f-f26b464e3511 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:11.400210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d472b4-b1f7-4cdc-be9f-f26b464e3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:11.402035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d472b4-b1f7-4cdc-be9f-f26b464e3511 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:11.403559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d472b4-b1f7-4cdc-be9f-f26b464e3511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:00:11.404308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d472b4-b1f7-4cdc-be9f-f26b464e3511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:11.408162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d472b4-b1f7-4cdc-be9f-f26b464e3511 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:11.451881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761da761-7054-4715-b065-6c312f5774ac None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:11.467984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761da761-7054-4715-b065-6c312f5774ac None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:11.471152 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2121/4208] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:00:11.484792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f7541-2c29-4969-a9fa-2f110aebf131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:11.486367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f7541-2c29-4969-a9fa-2f110aebf131 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:11.486814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f7541-2c29-4969-a9fa-2f110aebf131 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:11.487250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f7541-2c29-4969-a9fa-2f110aebf131 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:11.488179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f7541-2c29-4969-a9fa-2f110aebf131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:11.493120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f7541-2c29-4969-a9fa-2f110aebf131 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:11.559649 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2088/4209] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:00:11 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:00:11.563505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d472b4-b1f7-4cdc-be9f-f26b464e3511 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:11.582404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d472b4-b1f7-4cdc-be9f-f26b464e3511 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:11.708627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a7673-e24c-4394-ac83-3e0acb05dc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:11.710283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a7673-e24c-4394-ac83-3e0acb05dc12 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:11.710916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a7673-e24c-4394-ac83-3e0acb05dc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:11.711438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a7673-e24c-4394-ac83-3e0acb05dc12 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:11.712627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a7673-e24c-4394-ac83-3e0acb05dc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:11.715062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a7673-e24c-4394-ac83-3e0acb05dc12 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:11.750228 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2122/4210] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:00:11 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:00:11.752365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f7541-2c29-4969-a9fa-2f110aebf131 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:11.786183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f7541-2c29-4969-a9fa-2f110aebf131 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:11.811234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09a62-c5c6-4a75-b574-929c9e5dbdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:11.817710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09a62-c5c6-4a75-b574-929c9e5dbdd5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:11.819511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09a62-c5c6-4a75-b574-929c9e5dbdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:11.823359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e09a62-c5c6-4a75-b574-929c9e5dbdd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:11.825528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e09a62-c5c6-4a75-b574-929c9e5dbdd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:11.830249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e09a62-c5c6-4a75-b574-929c9e5dbdd5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:11.866320 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2089/4211] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:00:11.870274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a7673-e24c-4394-ac83-3e0acb05dc12 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:11.884173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a7673-e24c-4394-ac83-3e0acb05dc12 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:11.909924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894942be-dbb3-4e1e-935f-6a216ceb1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:11.910668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894942be-dbb3-4e1e-935f-6a216ceb1f16 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:11.911007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894942be-dbb3-4e1e-935f-6a216ceb1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:11.911226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894942be-dbb3-4e1e-935f-6a216ceb1f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:11.911988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894942be-dbb3-4e1e-935f-6a216ceb1f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:11.913628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894942be-dbb3-4e1e-935f-6a216ceb1f16 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:11.959018 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2123/4212] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:00:11.962159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09a62-c5c6-4a75-b574-929c9e5dbdd5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:11.976231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e09a62-c5c6-4a75-b574-929c9e5dbdd5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:11.992595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589c52-35a1-48c1-b235-01d69f013087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:11.993514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589c52-35a1-48c1-b235-01d69f013087 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:11.993796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589c52-35a1-48c1-b235-01d69f013087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:11.996306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76589c52-35a1-48c1-b235-01d69f013087 admin admin] PATH_INFO: `/v3/projects/62b213fd60a44c2481f49b4ed4711a67/users/6f4376fd9ace4887af0b56483b90a23d/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:12.033983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76589c52-35a1-48c1-b235-01d69f013087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b213fd60a44c2481f49b4ed4711a67, user_id=6f4376fd9ace4887af0b56483b90a23d, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:12.037338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76589c52-35a1-48c1-b235-01d69f013087 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:12.062254 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2090/4213] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:00:11 2022] PUT /identity/v3/projects/62b213fd60a44c2481f49b4ed4711a67/users/6f4376fd9ace4887af0b56483b90a23d/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:12.067621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c463f-d77d-4322-b41b-508d27c2b2a1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:12.068007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c463f-d77d-4322-b41b-508d27c2b2a1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:12.068301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c463f-d77d-4322-b41b-508d27c2b2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:12.116485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d04c463f-d77d-4322-b41b-508d27c2b2a1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:12.120855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d04c463f-d77d-4322-b41b-508d27c2b2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:12.147534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589c52-35a1-48c1-b235-01d69f013087 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:12.150784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-76589c52-35a1-48c1-b235-01d69f013087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:12.293438 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2124/4214] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:12.365576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c463f-d77d-4322-b41b-508d27c2b2a1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:12.367356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d04c463f-d77d-4322-b41b-508d27c2b2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:12.426299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76589c52-35a1-48c1-b235-01d69f013087 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:12.444300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:12.451066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:12.452996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:12.454031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] PATH_INFO: `/v3/users/61957c996e4544d69989a300e142954d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:12.457527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61957c996e4544d69989a300e142954d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:12.460933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:12.488162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c463f-d77d-4322-b41b-508d27c2b2a1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:12.493805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ef384-3edc-457c-bfe6-f669a2593758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:12.495065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef384-3edc-457c-bfe6-f669a2593758 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:12.495684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef384-3edc-457c-bfe6-f669a2593758 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:12.500495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef384-3edc-457c-bfe6-f669a2593758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:12.521668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ef384-3edc-457c-bfe6-f669a2593758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:12.525060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ef384-3edc-457c-bfe6-f669a2593758 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:12.552190 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2125/4215] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:00:12.606665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61957c996e4544d69989a300e142954d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:12.624627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61957c996e4544d69989a300e142954d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:12.626139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61957c996e4544d69989a300e142954d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:12.626281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61957c996e4544d69989a300e142954d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:12.656649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61957c996e4544d69989a300e142954d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:12.677590 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2091/4216] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:00:12 2022] DELETE /identity/v3/users/61957c996e4544d69989a300e142954d => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:12.682561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d278c-b976-4d17-911b-547fe609c11d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:12.683250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d278c-b976-4d17-911b-547fe609c11d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:12.683857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d278c-b976-4d17-911b-547fe609c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:12.745693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-747d278c-b976-4d17-911b-547fe609c11d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:12.752974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-747d278c-b976-4d17-911b-547fe609c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:12.885202 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2126/4217] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:12.963609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:12.966125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:13.106934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a34e1-823a-4fd1-9360-eb84284a24e3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:13.118959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee38aa-cf0f-4c15-a14a-3167ea6586fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:13.119623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee38aa-cf0f-4c15-a14a-3167ea6586fa service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:13.119903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee38aa-cf0f-4c15-a14a-3167ea6586fa service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:13.120228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee38aa-cf0f-4c15-a14a-3167ea6586fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:13.156677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee38aa-cf0f-4c15-a14a-3167ea6586fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:13.159785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee38aa-cf0f-4c15-a14a-3167ea6586fa service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:13.182257 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2092/4218] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:00:13.429548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d278c-b976-4d17-911b-547fe609c11d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:13.431221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-747d278c-b976-4d17-911b-547fe609c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:13.457756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d278c-b976-4d17-911b-547fe609c11d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:13.469445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:13.470335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:13.470618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:13.470993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] PATH_INFO: `/v3/users/32e2a79f7ce548d5b39cd657ac6d578a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:13.472765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e2a79f7ce548d5b39cd657ac6d578a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:13.478003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:13.617159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e2a79f7ce548d5b39cd657ac6d578a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:13.630965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e2a79f7ce548d5b39cd657ac6d578a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:13.632605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e2a79f7ce548d5b39cd657ac6d578a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:13.633170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e2a79f7ce548d5b39cd657ac6d578a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:13.644348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e2a79f7ce548d5b39cd657ac6d578a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:13.677870 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2127/4219] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:00:13 2022] DELETE /identity/v3/users/32e2a79f7ce548d5b39cd657ac6d578a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:14.238178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee38aa-cf0f-4c15-a14a-3167ea6586fa service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:14.253601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee38aa-cf0f-4c15-a14a-3167ea6586fa service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:14.359517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:14.361432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:14.361702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:14.362274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] PATH_INFO: `/v3/projects/a7e64b94cc37456185389445ddc56877` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:14.364796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e64b94cc37456185389445ddc56877)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:14.368269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:14.399772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:14.401694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:14.423511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd442e-985b-4ce1-be7c-c0bfed777676 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:14.450891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e64b94cc37456185389445ddc56877', 'request_id': 'req-f89d4bb9-f774-4386-ae7d-80495e3e1158'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.475426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e64b94cc37456185389445ddc56877', 'request_id': 'req-f89d4bb9-f774-4386-ae7d-80495e3e1158'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.489085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e64b94cc37456185389445ddc56877', 'request_id': 'req-f89d4bb9-f774-4386-ae7d-80495e3e1158'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.508440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] The token cache is being invalidate because project a7e64b94cc37456185389445ddc56877 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:00:14.509256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.510208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f89d4bb9-f774-4386-ae7d-80495e3e1158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.516674 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2093/4220] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:14 2022] DELETE /identity/v3/projects/a7e64b94cc37456185389445ddc56877 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:14.518709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa84d33-f66b-4def-a698-c22cd6f7685a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:14.519777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa84d33-f66b-4def-a698-c22cd6f7685a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:14.520786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa84d33-f66b-4def-a698-c22cd6f7685a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:14.568768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0aa84d33-f66b-4def-a698-c22cd6f7685a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:14.569985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0aa84d33-f66b-4def-a698-c22cd6f7685a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:14.582645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:14.584491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:14.585085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:14.585730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] PATH_INFO: `/v3/projects/6349609b9c304ab296fafc47dc857c05` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:14.587329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=6349609b9c304ab296fafc47dc857c05)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:14.589829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:14.686274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6349609b9c304ab296fafc47dc857c05', 'request_id': 'req-0cefae50-9725-400b-85ff-6a5d1cea3eda'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.705187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6349609b9c304ab296fafc47dc857c05', 'request_id': 'req-0cefae50-9725-400b-85ff-6a5d1cea3eda'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.712742 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2094/4221] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:14.715016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6349609b9c304ab296fafc47dc857c05', 'request_id': 'req-0cefae50-9725-400b-85ff-6a5d1cea3eda'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.720153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753e2e4-b41d-48f9-bcb1-3396f98b250c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:14.721156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753e2e4-b41d-48f9-bcb1-3396f98b250c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:14.723151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4753e2e4-b41d-48f9-bcb1-3396f98b250c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:14.749321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] The token cache is being invalidate because project 6349609b9c304ab296fafc47dc857c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:00:14.751579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.753663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0cefae50-9725-400b-85ff-6a5d1cea3eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:14.758801 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2128/4222] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:14 2022] DELETE /identity/v3/projects/6349609b9c304ab296fafc47dc857c05 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:00:14.764113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc6c6-c3b9-425b-ad03-b0ead81b24e5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:14.764461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc6c6-c3b9-425b-ad03-b0ead81b24e5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:14.764867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646cc6c6-c3b9-425b-ad03-b0ead81b24e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:14.782964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4753e2e4-b41d-48f9-bcb1-3396f98b250c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:14.784406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4753e2e4-b41d-48f9-bcb1-3396f98b250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:14.819633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-646cc6c6-c3b9-425b-ad03-b0ead81b24e5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:14.820952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-646cc6c6-c3b9-425b-ad03-b0ead81b24e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:14.917012 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2095/4223] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:14.919151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753e2e4-b41d-48f9-bcb1-3396f98b250c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:14.936788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4753e2e4-b41d-48f9-bcb1-3396f98b250c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:14.958283 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2129/4224] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:14.959947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7958e-345d-4f5e-81d0-d0e21840f6b5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:14.960890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7958e-345d-4f5e-81d0-d0e21840f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:14.961073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7958e-345d-4f5e-81d0-d0e21840f6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:14.968483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99731d4b-2ee0-4ad0-83e0-79d6f9b0af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:14.989823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731d4b-2ee0-4ad0-83e0-79d6f9b0af49 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:14.991339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731d4b-2ee0-4ad0-83e0-79d6f9b0af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:14.991974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99731d4b-2ee0-4ad0-83e0-79d6f9b0af49 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:14.992910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99731d4b-2ee0-4ad0-83e0-79d6f9b0af49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:00:14.993404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99731d4b-2ee0-4ad0-83e0-79d6f9b0af49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:14.996022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99731d4b-2ee0-4ad0-83e0-79d6f9b0af49 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.024325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-31f7958e-345d-4f5e-81d0-d0e21840f6b5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:15.026345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-31f7958e-345d-4f5e-81d0-d0e21840f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:15.043630 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2096/4225] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:00:15.051902 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2130/4226] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:15.064854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7958e-345d-4f5e-81d0-d0e21840f6b5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.066575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99731d4b-2ee0-4ad0-83e0-79d6f9b0af49 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.086253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7958e-345d-4f5e-81d0-d0e21840f6b5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.098375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99731d4b-2ee0-4ad0-83e0-79d6f9b0af49 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.105222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9940d-e23b-4311-91ce-39e31bebbf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.106001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9940d-e23b-4311-91ce-39e31bebbf33 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.106318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9940d-e23b-4311-91ce-39e31bebbf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.106624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9940d-e23b-4311-91ce-39e31bebbf33 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.106922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552c481-fc06-4247-9e83-6c4b70a7c235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.107978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9940d-e23b-4311-91ce-39e31bebbf33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:00:15.108296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9940d-e23b-4311-91ce-39e31bebbf33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.109655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552c481-fc06-4247-9e83-6c4b70a7c235 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.111159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552c481-fc06-4247-9e83-6c4b70a7c235 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.112107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9940d-e23b-4311-91ce-39e31bebbf33 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.112666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552c481-fc06-4247-9e83-6c4b70a7c235 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.115830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552c481-fc06-4247-9e83-6c4b70a7c235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.120023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552c481-fc06-4247-9e83-6c4b70a7c235 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.135691 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2131/4227] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:00:15.136813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9940d-e23b-4311-91ce-39e31bebbf33 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.155534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9940d-e23b-4311-91ce-39e31bebbf33 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.167840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbeb8f-0fab-4a39-9c8a-967b76961d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.168754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbeb8f-0fab-4a39-9c8a-967b76961d72 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.169044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbeb8f-0fab-4a39-9c8a-967b76961d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.169336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbeb8f-0fab-4a39-9c8a-967b76961d72 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.170247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbeb8f-0fab-4a39-9c8a-967b76961d72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.172579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbeb8f-0fab-4a39-9c8a-967b76961d72 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.184754 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2097/4228] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:00:15 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:00:15.193174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552c481-fc06-4247-9e83-6c4b70a7c235 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.254816 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2132/4229] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:00:15 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:00:15.258500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbeb8f-0fab-4a39-9c8a-967b76961d72 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.311891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552c481-fc06-4247-9e83-6c4b70a7c235 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.396575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbeb8f-0fab-4a39-9c8a-967b76961d72 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.422365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49803a-d297-4820-9e03-52a092e3defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.423051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49803a-d297-4820-9e03-52a092e3defc admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.423345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49803a-d297-4820-9e03-52a092e3defc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.423645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49803a-d297-4820-9e03-52a092e3defc admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.431411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49803a-d297-4820-9e03-52a092e3defc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.433928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49803a-d297-4820-9e03-52a092e3defc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.447906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b67cfe-945f-47dd-b00e-cdf596a7f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.449106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b67cfe-945f-47dd-b00e-cdf596a7f6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.449106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b67cfe-945f-47dd-b00e-cdf596a7f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.449319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b67cfe-945f-47dd-b00e-cdf596a7f6d2 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.450453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b67cfe-945f-47dd-b00e-cdf596a7f6d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.456408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b67cfe-945f-47dd-b00e-cdf596a7f6d2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.515516 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2098/4230] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:00:15 2022] POST /identity/v3/users => generated 286 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:00:15.519993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b67cfe-945f-47dd-b00e-cdf596a7f6d2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.530725 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2133/4231] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:00:15 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:00:15.533834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49803a-d297-4820-9e03-52a092e3defc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.548825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b67cfe-945f-47dd-b00e-cdf596a7f6d2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.570313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89598161-a3cd-4c04-997b-39206d3d121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.573782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49803a-d297-4820-9e03-52a092e3defc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.574840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89598161-a3cd-4c04-997b-39206d3d121b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.574840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89598161-a3cd-4c04-997b-39206d3d121b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.575093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89598161-a3cd-4c04-997b-39206d3d121b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.576971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89598161-a3cd-4c04-997b-39206d3d121b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.580034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89598161-a3cd-4c04-997b-39206d3d121b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.591875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1724000-fc16-4471-9b98-9b768e0a1ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.593748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724000-fc16-4471-9b98-9b768e0a1ebb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.593748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724000-fc16-4471-9b98-9b768e0a1ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.593748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1724000-fc16-4471-9b98-9b768e0a1ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.597842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1724000-fc16-4471-9b98-9b768e0a1ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.598675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1724000-fc16-4471-9b98-9b768e0a1ebb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.613465 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2099/4232] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:00:15.615704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89598161-a3cd-4c04-997b-39206d3d121b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.634140 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2134/4233] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:00:15.636796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1724000-fc16-4471-9b98-9b768e0a1ebb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.646670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89598161-a3cd-4c04-997b-39206d3d121b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.662414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad3f66-f8a6-4b61-b42b-e732da24a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.663155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad3f66-f8a6-4b61-b42b-e732da24a769 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.663460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad3f66-f8a6-4b61-b42b-e732da24a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.663742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad3f66-f8a6-4b61-b42b-e732da24a769 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.664133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1724000-fc16-4471-9b98-9b768e0a1ebb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.666193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad3f66-f8a6-4b61-b42b-e732da24a769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.670798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad3f66-f8a6-4b61-b42b-e732da24a769 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.678056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6bef3-ae6d-474a-836c-94a6820d3f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.678756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6bef3-ae6d-474a-836c-94a6820d3f6c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.679041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6bef3-ae6d-474a-836c-94a6820d3f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.679753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6bef3-ae6d-474a-836c-94a6820d3f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.680628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6bef3-ae6d-474a-836c-94a6820d3f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.686718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6bef3-ae6d-474a-836c-94a6820d3f6c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.702283 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2100/4234] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:00:15.703661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad3f66-f8a6-4b61-b42b-e732da24a769 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.718394 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2135/4235] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:00:15.722739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6bef3-ae6d-474a-836c-94a6820d3f6c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:15.734984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad3f66-f8a6-4b61-b42b-e732da24a769 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.742971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6bef3-ae6d-474a-836c-94a6820d3f6c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:15.743531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9ffed7-6963-41bc-97f2-b10382368182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.745255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ffed7-6963-41bc-97f2-b10382368182 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.745681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ffed7-6963-41bc-97f2-b10382368182 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.746053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ffed7-6963-41bc-97f2-b10382368182 admin admin] PATH_INFO: `/v3/projects/95b182d640d24ff9ab5c8da47efdc110/users/95881858fbbb418aac62a64f4d0754d7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.762447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87013068-5a97-4df3-81ec-2434d0e53174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:15.763907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013068-5a97-4df3-81ec-2434d0e53174 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.764370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013068-5a97-4df3-81ec-2434d0e53174 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.764530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87013068-5a97-4df3-81ec-2434d0e53174 admin admin] PATH_INFO: `/v3/projects/0dbb142e667e4a64b1646661b95654ee/users/976e9565a9b341ad9536184c04616e94/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.776690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ffed7-6963-41bc-97f2-b10382368182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b182d640d24ff9ab5c8da47efdc110, user_id=95881858fbbb418aac62a64f4d0754d7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.781391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9ffed7-6963-41bc-97f2-b10382368182 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.809525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87013068-5a97-4df3-81ec-2434d0e53174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbb142e667e4a64b1646661b95654ee, user_id=976e9565a9b341ad9536184c04616e94, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:15.810988 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2101/4236] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:00:15 2022] PUT /identity/v3/projects/95b182d640d24ff9ab5c8da47efdc110/users/95881858fbbb418aac62a64f4d0754d7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:00:15.812889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87013068-5a97-4df3-81ec-2434d0e53174 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:15.819610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42405eb5-7fd7-4f60-a297-bdf3656708c0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.820949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42405eb5-7fd7-4f60-a297-bdf3656708c0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.821243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42405eb5-7fd7-4f60-a297-bdf3656708c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.829107 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2136/4237] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:00:15 2022] PUT /identity/v3/projects/0dbb142e667e4a64b1646661b95654ee/users/976e9565a9b341ad9536184c04616e94/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:15.840958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb15b2-0e93-4300-a8b0-637e0f457206 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:15.841167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb15b2-0e93-4300-a8b0-637e0f457206 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:15.841455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb15b2-0e93-4300-a8b0-637e0f457206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:15.858827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-42405eb5-7fd7-4f60-a297-bdf3656708c0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:15.861421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42405eb5-7fd7-4f60-a297-bdf3656708c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:15.895350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c8eb15b2-0e93-4300-a8b0-637e0f457206 None None] MFA Rules not processed for user `976e9565a9b341ad9536184c04616e94`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:15.898838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c8eb15b2-0e93-4300-a8b0-637e0f457206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:15.954407 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2102/4238] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:16.047002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42405eb5-7fd7-4f60-a297-bdf3656708c0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:16.048785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42405eb5-7fd7-4f60-a297-bdf3656708c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:16.078987 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2137/4239] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:00:16.117443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb15b2-0e93-4300-a8b0-637e0f457206 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:16.119102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c8eb15b2-0e93-4300-a8b0-637e0f457206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:16.216583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42405eb5-7fd7-4f60-a297-bdf3656708c0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:16.229089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118c435-bbda-46da-b0d2-c60f48ba67c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:16.229770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c435-bbda-46da-b0d2-c60f48ba67c5 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:16.230063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c435-bbda-46da-b0d2-c60f48ba67c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:16.230348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118c435-bbda-46da-b0d2-c60f48ba67c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:16.252172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118c435-bbda-46da-b0d2-c60f48ba67c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:16.257195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118c435-bbda-46da-b0d2-c60f48ba67c5 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:16.258342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb15b2-0e93-4300-a8b0-637e0f457206 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:16.268231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf04f-7d63-4a00-89c3-87b9312d0f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:16.268987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf04f-7d63-4a00-89c3-87b9312d0f22 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:16.269394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf04f-7d63-4a00-89c3-87b9312d0f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:16.269769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adf04f-7d63-4a00-89c3-87b9312d0f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:16.279828 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2103/4240] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:00:16.293552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf04f-7d63-4a00-89c3-87b9312d0f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:16.299717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adf04f-7d63-4a00-89c3-87b9312d0f22 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:16.342136 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2138/4241] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:00:16.650464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66563931-4aa2-4b8d-9296-36f35f92c950 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:16.652240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66563931-4aa2-4b8d-9296-36f35f92c950 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:16.652240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66563931-4aa2-4b8d-9296-36f35f92c950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:16.675870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-66563931-4aa2-4b8d-9296-36f35f92c950 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:16.677559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-66563931-4aa2-4b8d-9296-36f35f92c950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:16.786876 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2104/4242] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:00:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:16.815615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf04f-7d63-4a00-89c3-87b9312d0f22 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:16.817579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-58adf04f-7d63-4a00-89c3-87b9312d0f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:16.986297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adf04f-7d63-4a00-89c3-87b9312d0f22 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:16.995126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e6fc4-4560-42af-bc2c-28f7dafa8140 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:16.996404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e6fc4-4560-42af-bc2c-28f7dafa8140 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:16.997461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e6fc4-4560-42af-bc2c-28f7dafa8140 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:16.997924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e6fc4-4560-42af-bc2c-28f7dafa8140 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:17.013061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e6fc4-4560-42af-bc2c-28f7dafa8140 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:17.016299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e6fc4-4560-42af-bc2c-28f7dafa8140 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:17.053050 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2139/4243] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:00:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:00:18.105031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb456-8174-4b3d-81d5-94d614b0e48b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:18.111332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb456-8174-4b3d-81d5-94d614b0e48b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:18.112074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4cb456-8174-4b3d-81d5-94d614b0e48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:18.139450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-af4cb456-8174-4b3d-81d5-94d614b0e48b None None] MFA Rules not processed for user `fdd16c1bdb3d416d8421202397566d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:18.141963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-af4cb456-8174-4b3d-81d5-94d614b0e48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:18.344116 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2105/4244] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:19.088701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e6fc4-4560-42af-bc2c-28f7dafa8140 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:19.104925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e6fc4-4560-42af-bc2c-28f7dafa8140 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:19.115579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faea736-8472-41b4-8d2a-3252ee197ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:19.116465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faea736-8472-41b4-8d2a-3252ee197ecb service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:19.116845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faea736-8472-41b4-8d2a-3252ee197ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:19.117293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faea736-8472-41b4-8d2a-3252ee197ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:19.124177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6faea736-8472-41b4-8d2a-3252ee197ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:19.145720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faea736-8472-41b4-8d2a-3252ee197ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:19.147563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faea736-8472-41b4-8d2a-3252ee197ecb service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:19.167075 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2140/4245] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:00:21.391332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e1695-0f86-42db-8178-d4a479a5045c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:21.392446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e1695-0f86-42db-8178-d4a479a5045c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:21.393480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e1695-0f86-42db-8178-d4a479a5045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:21.458590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a09e1695-0f86-42db-8178-d4a479a5045c None None] MFA Rules not processed for user `95881858fbbb418aac62a64f4d0754d7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:21.460651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a09e1695-0f86-42db-8178-d4a479a5045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:21.587546 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2106/4246] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:21.596982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047843f-4983-4639-8ad1-c0426b8618a3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:21.597530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047843f-4983-4639-8ad1-c0426b8618a3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:21.597677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047843f-4983-4639-8ad1-c0426b8618a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:21.638079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4047843f-4983-4639-8ad1-c0426b8618a3 None None] MFA Rules not processed for user `95881858fbbb418aac62a64f4d0754d7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:21.641593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4047843f-4983-4639-8ad1-c0426b8618a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:21.659932 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2141/4247] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:21.779169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e1695-0f86-42db-8178-d4a479a5045c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:21.782404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a09e1695-0f86-42db-8178-d4a479a5045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:21.993252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e1695-0f86-42db-8178-d4a479a5045c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:22.004961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497bd3f-c34c-4bc6-8a42-96d964513482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:22.007416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497bd3f-c34c-4bc6-8a42-96d964513482 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:22.010321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497bd3f-c34c-4bc6-8a42-96d964513482 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:22.010765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5497bd3f-c34c-4bc6-8a42-96d964513482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:22.026693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497bd3f-c34c-4bc6-8a42-96d964513482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:22.028622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5497bd3f-c34c-4bc6-8a42-96d964513482 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:22.052070 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2107/4248] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:00:27.773776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337d96-b369-4c9a-9e18-963ea2717745 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:27.774671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337d96-b369-4c9a-9e18-963ea2717745 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:27.774963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2337d96-b369-4c9a-9e18-963ea2717745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:27.830938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f2337d96-b369-4c9a-9e18-963ea2717745 None None] MFA Rules not processed for user `6f4376fd9ace4887af0b56483b90a23d`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:27.836480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f2337d96-b369-4c9a-9e18-963ea2717745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:27.978626 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2142/4249] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:28.879229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497bd3f-c34c-4bc6-8a42-96d964513482 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:28.881906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5497bd3f-c34c-4bc6-8a42-96d964513482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:28.901374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5497bd3f-c34c-4bc6-8a42-96d964513482 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:28.912449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babd5a0-fec6-4fd1-9bfe-d7ec0068dc0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:28.939417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babd5a0-fec6-4fd1-9bfe-d7ec0068dc0b service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:28.940565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babd5a0-fec6-4fd1-9bfe-d7ec0068dc0b service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:28.941315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babd5a0-fec6-4fd1-9bfe-d7ec0068dc0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:28.970560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babd5a0-fec6-4fd1-9bfe-d7ec0068dc0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:28.973540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1babd5a0-fec6-4fd1-9bfe-d7ec0068dc0b service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:29.028987 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2108/4250] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:00:35.533865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa4da-21dc-4857-b65b-f3b57039a2d3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:35.534749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa4da-21dc-4857-b65b-f3b57039a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:35.535222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fa4da-21dc-4857-b65b-f3b57039a2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:35.608600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-876fa4da-21dc-4857-b65b-f3b57039a2d3 None None] MFA Rules not processed for user `6f4376fd9ace4887af0b56483b90a23d`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:35.610074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-876fa4da-21dc-4857-b65b-f3b57039a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:35.627000 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2143/4251] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:48.458197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babd5a0-fec6-4fd1-9bfe-d7ec0068dc0b service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:48.480744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babd5a0-fec6-4fd1-9bfe-d7ec0068dc0b service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:48.492380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:48.493533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:48.493917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:48.494263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] PATH_INFO: `/v3/users/976e9565a9b341ad9536184c04616e94` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:48.501561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=976e9565a9b341ad9536184c04616e94)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:48.504577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:48.635672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '976e9565a9b341ad9536184c04616e94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:48.650727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '976e9565a9b341ad9536184c04616e94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:48.656126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '976e9565a9b341ad9536184c04616e94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:48.657137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '976e9565a9b341ad9536184c04616e94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:48.680496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '976e9565a9b341ad9536184c04616e94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:48.728599 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2109/4252] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:00:48 2022] DELETE /identity/v3/users/976e9565a9b341ad9536184c04616e94 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:48.733155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76236b89-c907-4ace-95bb-fb19e909bb28 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:48.733820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76236b89-c907-4ace-95bb-fb19e909bb28 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:48.733820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76236b89-c907-4ace-95bb-fb19e909bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:48.762971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-76236b89-c907-4ace-95bb-fb19e909bb28 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:48.764468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-76236b89-c907-4ace-95bb-fb19e909bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:48.871102 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2144/4253] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:48.886731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:48.889647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:48.977468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedde9ef-87bc-4958-8c43-cfebcc58ecb7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:48.984887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26222a00-c4ac-46e7-9e5c-f387bcf61d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:48.986424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222a00-c4ac-46e7-9e5c-f387bcf61d56 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:48.986759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222a00-c4ac-46e7-9e5c-f387bcf61d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:48.987777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222a00-c4ac-46e7-9e5c-f387bcf61d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:49.000822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222a00-c4ac-46e7-9e5c-f387bcf61d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:49.002823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222a00-c4ac-46e7-9e5c-f387bcf61d56 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:49.031080 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2110/4254] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:00:49.419780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76236b89-c907-4ace-95bb-fb19e909bb28 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:49.425808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-76236b89-c907-4ace-95bb-fb19e909bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:49.445035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76236b89-c907-4ace-95bb-fb19e909bb28 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:49.455463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:49.457172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:49.457894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:49.459227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] PATH_INFO: `/v3/projects/0dbb142e667e4a64b1646661b95654ee` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:49.462962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbb142e667e4a64b1646661b95654ee)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:49.482907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:49.565453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbb142e667e4a64b1646661b95654ee', 'request_id': 'req-df72d656-eba3-4758-af11-1754ae4cc2aa'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.576575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbb142e667e4a64b1646661b95654ee', 'request_id': 'req-df72d656-eba3-4758-af11-1754ae4cc2aa'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.584991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbb142e667e4a64b1646661b95654ee', 'request_id': 'req-df72d656-eba3-4758-af11-1754ae4cc2aa'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.600610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] The token cache is being invalidate because project 0dbb142e667e4a64b1646661b95654ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:00:49.600927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.601719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.603776 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2145/4255] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:49 2022] DELETE /identity/v3/projects/0dbb142e667e4a64b1646661b95654ee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:49.609747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428adfe0-2a8e-4986-a1e4-54f8e509a2fd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:49.610364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428adfe0-2a8e-4986-a1e4-54f8e509a2fd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:49.611359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428adfe0-2a8e-4986-a1e4-54f8e509a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:49.639994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-428adfe0-2a8e-4986-a1e4-54f8e509a2fd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:49.641407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-428adfe0-2a8e-4986-a1e4-54f8e509a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:49.665279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:49.667062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:49.768229 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2111/4256] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:49.777171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331f256-0f1d-4705-ba7f-60af833f732d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:49.777845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331f256-0f1d-4705-ba7f-60af833f732d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:49.778398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331f256-0f1d-4705-ba7f-60af833f732d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:49.790601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72d656-eba3-4758-af11-1754ae4cc2aa admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:49.803738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:49.804914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:49.805359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:49.806018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] PATH_INFO: `/v3/users/95881858fbbb418aac62a64f4d0754d7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:49.809088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95881858fbbb418aac62a64f4d0754d7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:49.811560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:49.812309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e331f256-0f1d-4705-ba7f-60af833f732d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:49.814140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e331f256-0f1d-4705-ba7f-60af833f732d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:49.826002 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2112/4257] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:00:49.833075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331f256-0f1d-4705-ba7f-60af833f732d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:49.848344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331f256-0f1d-4705-ba7f-60af833f732d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:49.861638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e368-1e08-4479-907a-4e25645754e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:49.862599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e368-1e08-4479-907a-4e25645754e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:49.863029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e368-1e08-4479-907a-4e25645754e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:49.863461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e368-1e08-4479-907a-4e25645754e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:49.864674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e368-1e08-4479-907a-4e25645754e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:00:49.868037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e368-1e08-4479-907a-4e25645754e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:49.871248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e368-1e08-4479-907a-4e25645754e3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:49.902652 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2113/4258] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:00:49.908100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e368-1e08-4479-907a-4e25645754e3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:49.913691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95881858fbbb418aac62a64f4d0754d7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.933105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95881858fbbb418aac62a64f4d0754d7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.936468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95881858fbbb418aac62a64f4d0754d7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.937939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95881858fbbb418aac62a64f4d0754d7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.941143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e368-1e08-4479-907a-4e25645754e3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:49.951779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95881858fbbb418aac62a64f4d0754d7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:49.960080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a3ca3-f0ba-4b59-a1a0-0196249a67fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:49.961124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a3ca3-f0ba-4b59-a1a0-0196249a67fa admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:49.961597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a3ca3-f0ba-4b59-a1a0-0196249a67fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:49.962049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a3ca3-f0ba-4b59-a1a0-0196249a67fa admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:49.962924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a3ca3-f0ba-4b59-a1a0-0196249a67fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:49.965252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a3ca3-f0ba-4b59-a1a0-0196249a67fa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:49.981573 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2146/4259] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:00:49 2022] DELETE /identity/v3/users/95881858fbbb418aac62a64f4d0754d7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:50.025163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:50.025729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2114/4260] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:00:49 2022] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:00:50.028837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:50.163106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6a76b-5ea6-4f4e-a9cd-c3f110923056 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:50.255538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ad3ab-0036-4214-bf36-48a3b8aba706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:50.256276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ad3ab-0036-4214-bf36-48a3b8aba706 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.256567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ad3ab-0036-4214-bf36-48a3b8aba706 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.256950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ad3ab-0036-4214-bf36-48a3b8aba706 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.257650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ad3ab-0036-4214-bf36-48a3b8aba706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:50.260884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ad3ab-0036-4214-bf36-48a3b8aba706 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:50.285860 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2147/4261] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:00:50 2022] POST /identity/v3/users => generated 281 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:00:50.290505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a3ca3-f0ba-4b59-a1a0-0196249a67fa admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:50.304109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a3ca3-f0ba-4b59-a1a0-0196249a67fa admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:50.310317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f517d-73de-4be5-b327-2e3531da9c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:50.311282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f517d-73de-4be5-b327-2e3531da9c18 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.311642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f517d-73de-4be5-b327-2e3531da9c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.312103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f517d-73de-4be5-b327-2e3531da9c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.312926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f517d-73de-4be5-b327-2e3531da9c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:50.314749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f517d-73de-4be5-b327-2e3531da9c18 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:50.332040 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2115/4262] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:00:50.333603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ad3ab-0036-4214-bf36-48a3b8aba706 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:50.346847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ad3ab-0036-4214-bf36-48a3b8aba706 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:50.352255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19f19e-cf59-420f-a71d-447300c3d9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:50.353743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f19e-cf59-420f-a71d-447300c3d9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.354371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f19e-cf59-420f-a71d-447300c3d9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.354371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19f19e-cf59-420f-a71d-447300c3d9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.355682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19f19e-cf59-420f-a71d-447300c3d9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:50.357617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c19f19e-cf59-420f-a71d-447300c3d9d9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:50.376043 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2148/4263] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:00:50.380768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f517d-73de-4be5-b327-2e3531da9c18 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:50.382882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19f19e-cf59-420f-a71d-447300c3d9d9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:50.384902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-405f517d-73de-4be5-b327-2e3531da9c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:50.412040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f517d-73de-4be5-b327-2e3531da9c18 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:50.412229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19f19e-cf59-420f-a71d-447300c3d9d9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:50.420440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:50.421667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.422126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.422462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] PATH_INFO: `/v3/projects/95b182d640d24ff9ab5c8da47efdc110` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.424079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2a241-1856-41ea-9f61-bb60b810f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:50.425492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2a241-1856-41ea-9f61-bb60b810f9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.425781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2a241-1856-41ea-9f61-bb60b810f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.426053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2a241-1856-41ea-9f61-bb60b810f9e8 admin admin] PATH_INFO: `/v3/projects/b80a8a10ae564166bc62181ad18daf5d/users/63a67a69e7ec49d380d07e649f536865/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.427284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b182d640d24ff9ab5c8da47efdc110)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:50.430708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:50.468633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2a241-1856-41ea-9f61-bb60b810f9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80a8a10ae564166bc62181ad18daf5d, user_id=63a67a69e7ec49d380d07e649f536865, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:50.471735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2a241-1856-41ea-9f61-bb60b810f9e8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:50.504847 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2149/4264] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:00:50 2022] PUT /identity/v3/projects/b80a8a10ae564166bc62181ad18daf5d/users/63a67a69e7ec49d380d07e649f536865/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:50.514988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ae887-a449-4842-8c02-065e7a65db6a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.515632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ae887-a449-4842-8c02-065e7a65db6a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.516389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ae887-a449-4842-8c02-065e7a65db6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.533685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b182d640d24ff9ab5c8da47efdc110', 'request_id': 'req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:50.551589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b182d640d24ff9ab5c8da47efdc110', 'request_id': 'req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:50.555046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b53ae887-a449-4842-8c02-065e7a65db6a None None] MFA Rules not processed for user `63a67a69e7ec49d380d07e649f536865`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:50.556307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b53ae887-a449-4842-8c02-065e7a65db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:50.562962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b182d640d24ff9ab5c8da47efdc110', 'request_id': 'req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:50.594587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] The token cache is being invalidate because project 95b182d640d24ff9ab5c8da47efdc110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:00:50.595782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:50.596446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-787f1c11-17a1-4f46-b5e8-1ee8850b9fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:00:50.602527 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2116/4265] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:00:50 2022] DELETE /identity/v3/projects/95b182d640d24ff9ab5c8da47efdc110 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:50.604345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d1ec-55ee-42c5-a320-a6f532558275 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.604814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d1ec-55ee-42c5-a320-a6f532558275 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.605089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848d1ec-55ee-42c5-a320-a6f532558275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.625626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d848d1ec-55ee-42c5-a320-a6f532558275 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:50.626949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d848d1ec-55ee-42c5-a320-a6f532558275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:50.671948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2150/4266] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:00:50.687128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ae887-a449-4842-8c02-065e7a65db6a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:50.688692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b53ae887-a449-4842-8c02-065e7a65db6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:50.732536 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2117/4267] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:50.742480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c16b8-c10a-47e8-95b8-883818c646ee None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.743033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c16b8-c10a-47e8-95b8-883818c646ee None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.744094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c16b8-c10a-47e8-95b8-883818c646ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.769089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-118c16b8-c10a-47e8-95b8-883818c646ee None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:50.769708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ae887-a449-4842-8c02-065e7a65db6a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:50.771380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-118c16b8-c10a-47e8-95b8-883818c646ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:50.776870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b38fc3-1ae8-4481-9d0e-dd17a706befb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:50.777856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b38fc3-1ae8-4481-9d0e-dd17a706befb service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.778362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b38fc3-1ae8-4481-9d0e-dd17a706befb service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.778846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b38fc3-1ae8-4481-9d0e-dd17a706befb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.788759 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2118/4268] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:50.789771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c16b8-c10a-47e8-95b8-883818c646ee None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:50.793283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b38fc3-1ae8-4481-9d0e-dd17a706befb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:50.797200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b38fc3-1ae8-4481-9d0e-dd17a706befb service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:50.802042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c16b8-c10a-47e8-95b8-883818c646ee None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:50.813570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a2725-9c72-4878-964e-2b61875106bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:50.814630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a2725-9c72-4878-964e-2b61875106bd admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.815270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a2725-9c72-4878-964e-2b61875106bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.815932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a2725-9c72-4878-964e-2b61875106bd admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.816914 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2151/4269] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:00:50.817595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a2725-9c72-4878-964e-2b61875106bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:00:50.818163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a2725-9c72-4878-964e-2b61875106bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:50.820323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a2725-9c72-4878-964e-2b61875106bd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:50.837158 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2119/4270] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:00:50.842542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b38fc3-1ae8-4481-9d0e-dd17a706befb service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:50.868180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b38fc3-1ae8-4481-9d0e-dd17a706befb service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:50.874838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f6f61-4c11-47d5-a687-add765acad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:50.875790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f6f61-4c11-47d5-a687-add765acad9a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:50.876394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f6f61-4c11-47d5-a687-add765acad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:50.876899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f6f61-4c11-47d5-a687-add765acad9a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:50.878153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f6f61-4c11-47d5-a687-add765acad9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:50.880613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f6f61-4c11-47d5-a687-add765acad9a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:50.955710 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2152/4271] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:00:50 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:00:50.959481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a2725-9c72-4878-964e-2b61875106bd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:50.996967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a2725-9c72-4878-964e-2b61875106bd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:51.089292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640e6ea-3307-4477-bb6f-78f5cadde1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:51.090517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e6ea-3307-4477-bb6f-78f5cadde1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:51.091098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e6ea-3307-4477-bb6f-78f5cadde1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:51.091767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640e6ea-3307-4477-bb6f-78f5cadde1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:51.092529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640e6ea-3307-4477-bb6f-78f5cadde1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:51.097544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640e6ea-3307-4477-bb6f-78f5cadde1e3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:51.130571 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2120/4272] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:00:50 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:00:51.136851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f6f61-4c11-47d5-a687-add765acad9a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:51.154795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f6f61-4c11-47d5-a687-add765acad9a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:51.166423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8a280-79ab-4633-adfa-5598e7aad728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:51.167396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8a280-79ab-4633-adfa-5598e7aad728 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:51.167666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8a280-79ab-4633-adfa-5598e7aad728 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:51.168152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d8a280-79ab-4633-adfa-5598e7aad728 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:51.169342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8a280-79ab-4633-adfa-5598e7aad728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:51.171978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d8a280-79ab-4633-adfa-5598e7aad728 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:51.194516 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2153/4273] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:00:51.195628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640e6ea-3307-4477-bb6f-78f5cadde1e3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:51.210725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640e6ea-3307-4477-bb6f-78f5cadde1e3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:51.218682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff81c9-d28d-43cf-90c6-5ed91f1bbdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:51.219385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff81c9-d28d-43cf-90c6-5ed91f1bbdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:51.219711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff81c9-d28d-43cf-90c6-5ed91f1bbdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:51.220329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff81c9-d28d-43cf-90c6-5ed91f1bbdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:51.221377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff81c9-d28d-43cf-90c6-5ed91f1bbdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:51.224593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff81c9-d28d-43cf-90c6-5ed91f1bbdf5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:51.239985 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2121/4274] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:00:51.242364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8a280-79ab-4633-adfa-5598e7aad728 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:51.258608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d8a280-79ab-4633-adfa-5598e7aad728 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:51.266813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879f63b-11e5-4dd0-b6e6-96ce0a47f54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:51.268223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879f63b-11e5-4dd0-b6e6-96ce0a47f54d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:51.270465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879f63b-11e5-4dd0-b6e6-96ce0a47f54d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:51.270465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879f63b-11e5-4dd0-b6e6-96ce0a47f54d admin admin] PATH_INFO: `/v3/projects/436249e4501a43dd95fd98fc53d74b30/users/7eac57fcd76942d28f51d0f6ee6eeb0f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:51.292866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879f63b-11e5-4dd0-b6e6-96ce0a47f54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=436249e4501a43dd95fd98fc53d74b30, user_id=7eac57fcd76942d28f51d0f6ee6eeb0f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:51.297886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879f63b-11e5-4dd0-b6e6-96ce0a47f54d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:51.320281 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2154/4275] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:00:51 2022] PUT /identity/v3/projects/436249e4501a43dd95fd98fc53d74b30/users/7eac57fcd76942d28f51d0f6ee6eeb0f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:00:51.332552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7d2b-e44a-49e8-9f28-a8d827494b96 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:51.332993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7d2b-e44a-49e8-9f28-a8d827494b96 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:51.333365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c7d2b-e44a-49e8-9f28-a8d827494b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:51.370986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7b1c7d2b-e44a-49e8-9f28-a8d827494b96 None None] MFA Rules not processed for user `7eac57fcd76942d28f51d0f6ee6eeb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:51.372411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7b1c7d2b-e44a-49e8-9f28-a8d827494b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:51.490157 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2122/4276] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:00:51.496952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1c69-ecab-4f30-b107-0850c5aa0a50 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:51.497290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1c69-ecab-4f30-b107-0850c5aa0a50 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:51.497556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d1c69-ecab-4f30-b107-0850c5aa0a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:51.528175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1f6d1c69-ecab-4f30-b107-0850c5aa0a50 None None] MFA Rules not processed for user `7eac57fcd76942d28f51d0f6ee6eeb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:51.529881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1f6d1c69-ecab-4f30-b107-0850c5aa0a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:51.547971 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2155/4277] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:00:51.558945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c7d2b-e44a-49e8-9f28-a8d827494b96 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:00:51.561703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7b1c7d2b-e44a-49e8-9f28-a8d827494b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:51.688151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c7d2b-e44a-49e8-9f28-a8d827494b96 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:00:51.703015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33b54-c409-4687-a802-92e7ddb15d53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:00:51.704310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33b54-c409-4687-a802-92e7ddb15d53 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:51.704752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33b54-c409-4687-a802-92e7ddb15d53 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:51.705312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f33b54-c409-4687-a802-92e7ddb15d53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:51.718611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f33b54-c409-4687-a802-92e7ddb15d53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:00:51.721106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f33b54-c409-4687-a802-92e7ddb15d53 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:00:51.734850 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2123/4278] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:00:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:00:52.166784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6e42-5d69-472b-89e0-42f6d4fd44bd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:00:52.167261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6e42-5d69-472b-89e0-42f6d4fd44bd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:00:52.167452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed6e42-5d69-472b-89e0-42f6d4fd44bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:00:52.221726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e2ed6e42-5d69-472b-89e0-42f6d4fd44bd None None] MFA Rules not processed for user `7eac57fcd76942d28f51d0f6ee6eeb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:00:52.222985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e2ed6e42-5d69-472b-89e0-42f6d4fd44bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:00:52.242481 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2156/4279] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:08.486980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33b54-c409-4687-a802-92e7ddb15d53 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:08.488657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e8f33b54-c409-4687-a802-92e7ddb15d53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:08.687429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f33b54-c409-4687-a802-92e7ddb15d53 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:08.706626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:08.707721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:08.708152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:08.708289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] PATH_INFO: `/v3/users/791eb951b71e493c82ce921d1f8f4174` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:08.709524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=791eb951b71e493c82ce921d1f8f4174)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:08.711487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:08.812431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '791eb951b71e493c82ce921d1f8f4174'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:08.835298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '791eb951b71e493c82ce921d1f8f4174'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:08.835298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '791eb951b71e493c82ce921d1f8f4174'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:08.835298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '791eb951b71e493c82ce921d1f8f4174'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:08.858619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55d8c56f-3aa1-499e-8c33-186f080a6e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '791eb951b71e493c82ce921d1f8f4174'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:08.875326 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2124/4280] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:01:08 2022] DELETE /identity/v3/users/791eb951b71e493c82ce921d1f8f4174 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:01:09.179465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed6e42-5d69-472b-89e0-42f6d4fd44bd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:09.198784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed6e42-5d69-472b-89e0-42f6d4fd44bd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:09.280865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:09.281886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.282184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.282458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] PATH_INFO: `/v3/projects/586533ed0cf646c2945f68477b651e23` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.283893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=586533ed0cf646c2945f68477b651e23)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:09.285882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:09.347432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '586533ed0cf646c2945f68477b651e23', 'request_id': 'req-d613ce18-f274-48a6-a3f2-aee962cd9bff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:09.372183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '586533ed0cf646c2945f68477b651e23', 'request_id': 'req-d613ce18-f274-48a6-a3f2-aee962cd9bff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:09.379346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '586533ed0cf646c2945f68477b651e23', 'request_id': 'req-d613ce18-f274-48a6-a3f2-aee962cd9bff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:09.400727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] The token cache is being invalidate because project 586533ed0cf646c2945f68477b651e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:01:09.401030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:09.401793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d613ce18-f274-48a6-a3f2-aee962cd9bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:09.403386 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2157/4281] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:09 2022] DELETE /identity/v3/projects/586533ed0cf646c2945f68477b651e23 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:01:09.409147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a158ce8-cc65-49a7-9636-4e4d257ed1b8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.409428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a158ce8-cc65-49a7-9636-4e4d257ed1b8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.409936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a158ce8-cc65-49a7-9636-4e4d257ed1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.431797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6a158ce8-cc65-49a7-9636-4e4d257ed1b8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:09.433646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6a158ce8-cc65-49a7-9636-4e4d257ed1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:09.506510 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2125/4282] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:09.518273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ff34e-a2e9-46a8-b952-4fcb34a6e4c0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.518563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ff34e-a2e9-46a8-b952-4fcb34a6e4c0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.518837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ff34e-a2e9-46a8-b952-4fcb34a6e4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.537755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4c0ff34e-a2e9-46a8-b952-4fcb34a6e4c0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:09.539169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4c0ff34e-a2e9-46a8-b952-4fcb34a6e4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:09.552866 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2158/4283] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:09.554189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a158ce8-cc65-49a7-9636-4e4d257ed1b8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:09.564371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a158ce8-cc65-49a7-9636-4e4d257ed1b8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:09.569194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec713d5-af60-4e4b-b211-e61b0ef1418c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:09.569864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec713d5-af60-4e4b-b211-e61b0ef1418c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.570158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec713d5-af60-4e4b-b211-e61b0ef1418c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.570438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec713d5-af60-4e4b-b211-e61b0ef1418c admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.571152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec713d5-af60-4e4b-b211-e61b0ef1418c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:01:09.571456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec713d5-af60-4e4b-b211-e61b0ef1418c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:09.573404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec713d5-af60-4e4b-b211-e61b0ef1418c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:09.593312 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2126/4284] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:01:09.595827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ff34e-a2e9-46a8-b952-4fcb34a6e4c0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:09.606560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ff34e-a2e9-46a8-b952-4fcb34a6e4c0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:09.612789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e608-5860-4a44-b410-66775912287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:09.613055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e608-5860-4a44-b410-66775912287c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.613447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e608-5860-4a44-b410-66775912287c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.613806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65e608-5860-4a44-b410-66775912287c admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.614695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65e608-5860-4a44-b410-66775912287c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:09.617253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65e608-5860-4a44-b410-66775912287c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:09.644629 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2159/4285] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:01:09 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:01:09.648582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec713d5-af60-4e4b-b211-e61b0ef1418c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:09.659541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec713d5-af60-4e4b-b211-e61b0ef1418c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:09.724350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96367-a60d-4c87-91e8-3076cc283cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:09.725023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96367-a60d-4c87-91e8-3076cc283cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.725305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96367-a60d-4c87-91e8-3076cc283cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.725580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96367-a60d-4c87-91e8-3076cc283cd7 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.726303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f96367-a60d-4c87-91e8-3076cc283cd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:09.728287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f96367-a60d-4c87-91e8-3076cc283cd7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:09.751636 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2127/4286] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:01:09 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:01:09.756154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e608-5860-4a44-b410-66775912287c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:09.766838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65e608-5860-4a44-b410-66775912287c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:09.771568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acf351-af10-47f6-b384-a0db7698a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:09.772264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acf351-af10-47f6-b384-a0db7698a841 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.772547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acf351-af10-47f6-b384-a0db7698a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.772821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3acf351-af10-47f6-b384-a0db7698a841 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.773613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acf351-af10-47f6-b384-a0db7698a841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:09.775227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3acf351-af10-47f6-b384-a0db7698a841 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:09.788938 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2160/4287] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:01:09.794251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96367-a60d-4c87-91e8-3076cc283cd7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:09.805561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96367-a60d-4c87-91e8-3076cc283cd7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:09.810279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0ffb6-3939-4169-a5e7-f976e9adfde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:09.810944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0ffb6-3939-4169-a5e7-f976e9adfde6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.811226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0ffb6-3939-4169-a5e7-f976e9adfde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.811500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0ffb6-3939-4169-a5e7-f976e9adfde6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.812281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0ffb6-3939-4169-a5e7-f976e9adfde6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:09.813897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0ffb6-3939-4169-a5e7-f976e9adfde6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:09.828089 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2128/4288] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:01:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:01:09.829724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acf351-af10-47f6-b384-a0db7698a841 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:09.840607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3acf351-af10-47f6-b384-a0db7698a841 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:09.845540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285edea-82cb-4392-a46e-814878dc5101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:09.847013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285edea-82cb-4392-a46e-814878dc5101 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.847289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285edea-82cb-4392-a46e-814878dc5101 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.847560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285edea-82cb-4392-a46e-814878dc5101 admin admin] PATH_INFO: `/v3/projects/9643f439b26e41cda482b9533143d636/users/87a1de01e7de440d86084c1b5b5aede4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.862475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285edea-82cb-4392-a46e-814878dc5101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9643f439b26e41cda482b9533143d636, user_id=87a1de01e7de440d86084c1b5b5aede4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:09.865173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285edea-82cb-4392-a46e-814878dc5101 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:09.878630 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2161/4289] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:01:09 2022] PUT /identity/v3/projects/9643f439b26e41cda482b9533143d636/users/87a1de01e7de440d86084c1b5b5aede4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:01:09.883879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06102fdc-1cf3-42fb-a445-dbec76cabd47 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:09.884376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06102fdc-1cf3-42fb-a445-dbec76cabd47 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:09.884713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06102fdc-1cf3-42fb-a445-dbec76cabd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:09.903447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-06102fdc-1cf3-42fb-a445-dbec76cabd47 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:09.904701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-06102fdc-1cf3-42fb-a445-dbec76cabd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:09.964941 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2129/4290] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:09.975380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285edea-82cb-4392-a46e-814878dc5101 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:09.977099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d285edea-82cb-4392-a46e-814878dc5101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:10.034949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285edea-82cb-4392-a46e-814878dc5101 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:10.038593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02888903-15be-443c-9280-cbde14575e83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:10.039228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02888903-15be-443c-9280-cbde14575e83 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:10.039505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02888903-15be-443c-9280-cbde14575e83 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:10.039786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02888903-15be-443c-9280-cbde14575e83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:10.049303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02888903-15be-443c-9280-cbde14575e83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:10.050734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02888903-15be-443c-9280-cbde14575e83 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:10.060902 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2162/4291] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:01:16.450095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd9e13-84f1-4463-aeed-76874a13358d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:16.451164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd9e13-84f1-4463-aeed-76874a13358d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:16.451611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd9e13-84f1-4463-aeed-76874a13358d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:16.474492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-85dd9e13-84f1-4463-aeed-76874a13358d None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:16.476086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-85dd9e13-84f1-4463-aeed-76874a13358d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:16.547728 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2130/4292] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:01:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:16.585203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02888903-15be-443c-9280-cbde14575e83 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:16.587203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-02888903-15be-443c-9280-cbde14575e83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:16.729376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02888903-15be-443c-9280-cbde14575e83 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:16.737157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916d66a-45f2-47bf-b50c-45a2e443f872 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:16.737976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916d66a-45f2-47bf-b50c-45a2e443f872 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:16.738382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916d66a-45f2-47bf-b50c-45a2e443f872 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:16.738755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916d66a-45f2-47bf-b50c-45a2e443f872 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:16.750967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916d66a-45f2-47bf-b50c-45a2e443f872 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:16.753769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916d66a-45f2-47bf-b50c-45a2e443f872 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:16.767446 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2163/4293] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:01:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:01:20.169315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00de254-134d-488f-87d0-d0d752a6d5f5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:20.169953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00de254-134d-488f-87d0-d0d752a6d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:20.170179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00de254-134d-488f-87d0-d0d752a6d5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:20.206181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d00de254-134d-488f-87d0-d0d752a6d5f5 None None] MFA Rules not processed for user `87a1de01e7de440d86084c1b5b5aede4`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:20.207720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d00de254-134d-488f-87d0-d0d752a6d5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:20.309083 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2131/4294] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:20.309292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916d66a-45f2-47bf-b50c-45a2e443f872 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:20.328340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916d66a-45f2-47bf-b50c-45a2e443f872 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:20.352673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334b104-875c-4b67-b505-9258346ac704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:20.354495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334b104-875c-4b67-b505-9258346ac704 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:20.356127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334b104-875c-4b67-b505-9258346ac704 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:20.356645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334b104-875c-4b67-b505-9258346ac704 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:20.384653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334b104-875c-4b67-b505-9258346ac704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:20.396941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6334b104-875c-4b67-b505-9258346ac704 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:20.462081 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2164/4295] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:01:20 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:01:20.463487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00de254-134d-488f-87d0-d0d752a6d5f5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:20.479869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00de254-134d-488f-87d0-d0d752a6d5f5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:20.648955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb909-24d9-4b1b-ade1-ede5be08e271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:20.650100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb909-24d9-4b1b-ade1-ede5be08e271 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:20.650480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb909-24d9-4b1b-ade1-ede5be08e271 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:20.651011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fb909-24d9-4b1b-ade1-ede5be08e271 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:20.651935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fb909-24d9-4b1b-ade1-ede5be08e271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:20.654343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fb909-24d9-4b1b-ade1-ede5be08e271 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:20.716150 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2132/4296] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:01:20 2022] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:01:20.726025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334b104-875c-4b67-b505-9258346ac704 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:20.751498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334b104-875c-4b67-b505-9258346ac704 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:20.772131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b772273-b34e-404e-9fc2-4439d1d74701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:20.772815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b772273-b34e-404e-9fc2-4439d1d74701 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:20.773096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b772273-b34e-404e-9fc2-4439d1d74701 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:20.773370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b772273-b34e-404e-9fc2-4439d1d74701 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:20.774100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b772273-b34e-404e-9fc2-4439d1d74701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:20.784210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b772273-b34e-404e-9fc2-4439d1d74701 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:20.821150 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2165/4297] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:01:20.822693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb909-24d9-4b1b-ade1-ede5be08e271 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:20.842101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fb909-24d9-4b1b-ade1-ede5be08e271 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:20.886028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386ade6-e6d6-4537-ad2e-a9a33ab71924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:20.887631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ade6-e6d6-4537-ad2e-a9a33ab71924 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:20.887950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ade6-e6d6-4537-ad2e-a9a33ab71924 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:20.888213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386ade6-e6d6-4537-ad2e-a9a33ab71924 admin admin] PATH_INFO: `/v3/projects/0c00094084934413b62c2a79ef898316/users/1d0473b9b2a24e1c94e825a803a00e15/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:20.933991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386ade6-e6d6-4537-ad2e-a9a33ab71924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c00094084934413b62c2a79ef898316, user_id=1d0473b9b2a24e1c94e825a803a00e15, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:20.937082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386ade6-e6d6-4537-ad2e-a9a33ab71924 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:20.981184 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2133/4298] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:01:20 2022] PUT /identity/v3/projects/0c00094084934413b62c2a79ef898316/users/1d0473b9b2a24e1c94e825a803a00e15/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:01:20.982457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b772273-b34e-404e-9fc2-4439d1d74701 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:21.005835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b772273-b34e-404e-9fc2-4439d1d74701 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:21.134897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff94d5-040b-4f6c-81e1-845548b68092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:21.136671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff94d5-040b-4f6c-81e1-845548b68092 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:21.140295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff94d5-040b-4f6c-81e1-845548b68092 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:21.140736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff94d5-040b-4f6c-81e1-845548b68092 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:21.145262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff94d5-040b-4f6c-81e1-845548b68092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:21.148319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff94d5-040b-4f6c-81e1-845548b68092 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:21.174541 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2166/4299] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:01:21.179750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386ade6-e6d6-4537-ad2e-a9a33ab71924 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:21.200378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386ade6-e6d6-4537-ad2e-a9a33ab71924 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:21.223496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f651-c53e-4de8-a94e-8c005997032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:21.226889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f651-c53e-4de8-a94e-8c005997032c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:21.227203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f651-c53e-4de8-a94e-8c005997032c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:21.230322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f651-c53e-4de8-a94e-8c005997032c admin admin] PATH_INFO: `/v3/projects/0c00094084934413b62c2a79ef898316/users/1d0473b9b2a24e1c94e825a803a00e15/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:21.239719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f651-c53e-4de8-a94e-8c005997032c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c00094084934413b62c2a79ef898316, user_id=1d0473b9b2a24e1c94e825a803a00e15, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:21.251455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f651-c53e-4de8-a94e-8c005997032c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:21.289155 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2134/4300] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:01:21 2022] PUT /identity/v3/projects/0c00094084934413b62c2a79ef898316/users/1d0473b9b2a24e1c94e825a803a00e15/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:01:27.438932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2ab7-06bf-4bc4-b5c4-771ac05ba05b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:27.441009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2ab7-06bf-4bc4-b5c4-771ac05ba05b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:27.441009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f2ab7-06bf-4bc4-b5c4-771ac05ba05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:27.489514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c02f2ab7-06bf-4bc4-b5c4-771ac05ba05b None None] MFA Rules not processed for user `3cb495ec547743d38a7502110a166b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:27.491014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c02f2ab7-06bf-4bc4-b5c4-771ac05ba05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:27.674329 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2167/4301] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:33.292246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca7fe1-4d79-413f-8eb8-9713035a0bea None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:33.292995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca7fe1-4d79-413f-8eb8-9713035a0bea None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:33.293454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca7fe1-4d79-413f-8eb8-9713035a0bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:33.354389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0cca7fe1-4d79-413f-8eb8-9713035a0bea None None] MFA Rules not processed for user `1d0473b9b2a24e1c94e825a803a00e15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:33.356439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0cca7fe1-4d79-413f-8eb8-9713035a0bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:33.515674 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2135/4302] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:33.525069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2ab7-06bf-4bc4-b5c4-771ac05ba05b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:33.528507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c02f2ab7-06bf-4bc4-b5c4-771ac05ba05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:33.780195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f2ab7-06bf-4bc4-b5c4-771ac05ba05b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:33.801082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48654c-9894-4f47-aa41-77e4f33d5a1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:33.804315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48654c-9894-4f47-aa41-77e4f33d5a1c service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:33.807153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48654c-9894-4f47-aa41-77e4f33d5a1c service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:33.807619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48654c-9894-4f47-aa41-77e4f33d5a1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:33.889214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48654c-9894-4f47-aa41-77e4f33d5a1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:33.890716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48654c-9894-4f47-aa41-77e4f33d5a1c service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:33.912098 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2168/4303] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:01:39.656220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca7fe1-4d79-413f-8eb8-9713035a0bea None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:39.658586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0cca7fe1-4d79-413f-8eb8-9713035a0bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:39.860645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca7fe1-4d79-413f-8eb8-9713035a0bea None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:39.891671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95551359-8d4d-4b21-87d2-0cac1ae5ce4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:39.897496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95551359-8d4d-4b21-87d2-0cac1ae5ce4d service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:39.900044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95551359-8d4d-4b21-87d2-0cac1ae5ce4d service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:39.900881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95551359-8d4d-4b21-87d2-0cac1ae5ce4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:39.904831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-95551359-8d4d-4b21-87d2-0cac1ae5ce4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:40.073239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95551359-8d4d-4b21-87d2-0cac1ae5ce4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:40.075015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95551359-8d4d-4b21-87d2-0cac1ae5ce4d service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:40.133007 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2136/4304] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:01:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:01:42.840970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c0c4-2961-4732-8dfb-21bf316047fa None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:42.841915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c0c4-2961-4732-8dfb-21bf316047fa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:42.842408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c0c4-2961-4732-8dfb-21bf316047fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:42.897713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9b59c0c4-2961-4732-8dfb-21bf316047fa None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:42.899351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9b59c0c4-2961-4732-8dfb-21bf316047fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:43.021780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2169/4305] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:43.043120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95551359-8d4d-4b21-87d2-0cac1ae5ce4d service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:43.140781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95551359-8d4d-4b21-87d2-0cac1ae5ce4d service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:43.148716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3649f8-b05d-4cef-a09c-5279272df23a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:43.149526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3649f8-b05d-4cef-a09c-5279272df23a service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:43.149887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3649f8-b05d-4cef-a09c-5279272df23a service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:43.150080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3649f8-b05d-4cef-a09c-5279272df23a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:43.161564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3649f8-b05d-4cef-a09c-5279272df23a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:43.163422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3649f8-b05d-4cef-a09c-5279272df23a service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:43.173738 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2137/4306] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:01:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:01:43.902806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59c0c4-2961-4732-8dfb-21bf316047fa None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:43.904356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9b59c0c4-2961-4732-8dfb-21bf316047fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:44.001400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59c0c4-2961-4732-8dfb-21bf316047fa None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:44.010702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:44.012632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:44.013158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:44.013599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] PATH_INFO: `/v3/users/7eac57fcd76942d28f51d0f6ee6eeb0f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:44.017259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eac57fcd76942d28f51d0f6ee6eeb0f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:44.021332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:44.084369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da27592-ba46-460c-88af-47099a5d484e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:44.084943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da27592-ba46-460c-88af-47099a5d484e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:44.085225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da27592-ba46-460c-88af-47099a5d484e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:44.108209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eac57fcd76942d28f51d0f6ee6eeb0f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:44.110054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9da27592-ba46-460c-88af-47099a5d484e None None] MFA Rules not processed for user `fdd16c1bdb3d416d8421202397566d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:44.112378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9da27592-ba46-460c-88af-47099a5d484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:44.117750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eac57fcd76942d28f51d0f6ee6eeb0f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:44.131344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eac57fcd76942d28f51d0f6ee6eeb0f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:44.133806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eac57fcd76942d28f51d0f6ee6eeb0f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:44.153173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fe884f6-8b47-43dd-9ef1-4fc2fd025082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eac57fcd76942d28f51d0f6ee6eeb0f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:44.198286 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2170/4307] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:01:43 2022] DELETE /identity/v3/users/7eac57fcd76942d28f51d0f6ee6eeb0f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:01:44.203188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f07e66-5dc6-4424-8f96-07b256ba0af8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:44.203696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f07e66-5dc6-4424-8f96-07b256ba0af8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:44.204082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f07e66-5dc6-4424-8f96-07b256ba0af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:44.226209 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2138/4308] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:44.256772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-93f07e66-5dc6-4424-8f96-07b256ba0af8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:44.258521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-93f07e66-5dc6-4424-8f96-07b256ba0af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:44.343625 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2171/4309] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:44.361190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da27592-ba46-460c-88af-47099a5d484e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:44.363561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9da27592-ba46-460c-88af-47099a5d484e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:44.443104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da27592-ba46-460c-88af-47099a5d484e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:44.500478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f394-c175-4001-94d8-72dcee80ae82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:44.501382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f394-c175-4001-94d8-72dcee80ae82 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:44.502778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f394-c175-4001-94d8-72dcee80ae82 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:44.503228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362f394-c175-4001-94d8-72dcee80ae82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:44.516319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362f394-c175-4001-94d8-72dcee80ae82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:44.518890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362f394-c175-4001-94d8-72dcee80ae82 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:44.531361 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2139/4310] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:01:44.884990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aa2c3-87d8-4773-8c05-356a4cbd1830 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:44.885559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aa2c3-87d8-4773-8c05-356a4cbd1830 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:44.886012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9aa2c3-87d8-4773-8c05-356a4cbd1830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:44.936083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7a9aa2c3-87d8-4773-8c05-356a4cbd1830 None None] MFA Rules not processed for user `70fab8e4c45d48ea8223a3acc60a5442`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:44.939798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7a9aa2c3-87d8-4773-8c05-356a4cbd1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:45.045112 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2172/4311] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:46.556526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f394-c175-4001-94d8-72dcee80ae82 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:46.558088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7362f394-c175-4001-94d8-72dcee80ae82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:46.581603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362f394-c175-4001-94d8-72dcee80ae82 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:46.599759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:46.601167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:46.601694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:46.602121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] PATH_INFO: `/v3/users/7556c6d8faaa45e7980806d59e122c88` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:46.610360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7556c6d8faaa45e7980806d59e122c88)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:46.612448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:46.712049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7556c6d8faaa45e7980806d59e122c88'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:46.725792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7556c6d8faaa45e7980806d59e122c88'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:46.726912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7556c6d8faaa45e7980806d59e122c88'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:46.727732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7556c6d8faaa45e7980806d59e122c88'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:46.740729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aa2c3-87d8-4773-8c05-356a4cbd1830 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:46.742238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7a9aa2c3-87d8-4773-8c05-356a4cbd1830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:46.750094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7fc0ac0a-9555-4b96-b9c0-fa9104f8d285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7556c6d8faaa45e7980806d59e122c88'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:46.764479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9aa2c3-87d8-4773-8c05-356a4cbd1830 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:46.767863 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2140/4312] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:01:46 2022] DELETE /identity/v3/users/7556c6d8faaa45e7980806d59e122c88 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:01:46.772412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47fc74-f7ba-4250-8d13-e610d87a67f0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:46.772894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47fc74-f7ba-4250-8d13-e610d87a67f0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:46.773466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47fc74-f7ba-4250-8d13-e610d87a67f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:46.808690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ac47fc74-f7ba-4250-8d13-e610d87a67f0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:46.822655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ac47fc74-f7ba-4250-8d13-e610d87a67f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:46.918538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:46.924892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:46.925364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:46.925798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] PATH_INFO: `/v3/projects/436249e4501a43dd95fd98fc53d74b30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:46.929526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436249e4501a43dd95fd98fc53d74b30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:46.934326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:46.958388 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2141/4313] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:47.012642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47fc74-f7ba-4250-8d13-e610d87a67f0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:47.014082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ac47fc74-f7ba-4250-8d13-e610d87a67f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:47.044481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436249e4501a43dd95fd98fc53d74b30', 'request_id': 'req-30f46704-f824-4aaa-a09b-c309e8b64168'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:47.066855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436249e4501a43dd95fd98fc53d74b30', 'request_id': 'req-30f46704-f824-4aaa-a09b-c309e8b64168'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:47.080649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436249e4501a43dd95fd98fc53d74b30', 'request_id': 'req-30f46704-f824-4aaa-a09b-c309e8b64168'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:47.115257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] The token cache is being invalidate because project 436249e4501a43dd95fd98fc53d74b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:01:47.115563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:47.117276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30f46704-f824-4aaa-a09b-c309e8b64168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:47.119685 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2173/4314] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:46 2022] DELETE /identity/v3/projects/436249e4501a43dd95fd98fc53d74b30 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:01:47.124550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18968fc-ca03-4072-b9e0-31e82e7bc5ac None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:47.125034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18968fc-ca03-4072-b9e0-31e82e7bc5ac None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:47.125448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18968fc-ca03-4072-b9e0-31e82e7bc5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:47.165380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47fc74-f7ba-4250-8d13-e610d87a67f0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:47.175837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e18968fc-ca03-4072-b9e0-31e82e7bc5ac None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:47.179951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e18968fc-ca03-4072-b9e0-31e82e7bc5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:47.263131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee631df-e4b0-4bfd-aa0d-cd76a0a4d998 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:47.264082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee631df-e4b0-4bfd-aa0d-cd76a0a4d998 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:47.264298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee631df-e4b0-4bfd-aa0d-cd76a0a4d998 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:47.264534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee631df-e4b0-4bfd-aa0d-cd76a0a4d998 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:47.266443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0ee631df-e4b0-4bfd-aa0d-cd76a0a4d998 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:47.324531 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2174/4315] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:47.326449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a892c2-5b80-41f2-8de7-2dcfebc82299 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:47.326742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a892c2-5b80-41f2-8de7-2dcfebc82299 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:47.327027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a892c2-5b80-41f2-8de7-2dcfebc82299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:47.361115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-05a892c2-5b80-41f2-8de7-2dcfebc82299 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:47.362808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-05a892c2-5b80-41f2-8de7-2dcfebc82299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:47.379733 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2175/4316] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:01:47.384920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a892c2-5b80-41f2-8de7-2dcfebc82299 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:47.403097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a892c2-5b80-41f2-8de7-2dcfebc82299 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:47.404842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee631df-e4b0-4bfd-aa0d-cd76a0a4d998 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:47.407535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee631df-e4b0-4bfd-aa0d-cd76a0a4d998 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:47.416580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94470-be0c-4af2-a7a6-b21b39f9c0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:47.417256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94470-be0c-4af2-a7a6-b21b39f9c0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:47.417542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94470-be0c-4af2-a7a6-b21b39f9c0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:47.417822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94470-be0c-4af2-a7a6-b21b39f9c0b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:47.418747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94470-be0c-4af2-a7a6-b21b39f9c0b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:01:47.419059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94470-be0c-4af2-a7a6-b21b39f9c0b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:47.420749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94470-be0c-4af2-a7a6-b21b39f9c0b9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:47.430773 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2142/4317] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:01:47.443616 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2176/4318] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:01:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:01:47.447098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee631df-e4b0-4bfd-aa0d-cd76a0a4d998 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:47.462063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee631df-e4b0-4bfd-aa0d-cd76a0a4d998 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:47.468531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582564e-ec08-497a-862c-b69734264775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:47.469657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582564e-ec08-497a-862c-b69734264775 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:47.470435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582564e-ec08-497a-862c-b69734264775 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:47.470971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582564e-ec08-497a-862c-b69734264775 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:47.472014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582564e-ec08-497a-862c-b69734264775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:47.474456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582564e-ec08-497a-862c-b69734264775 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:47.541043 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2143/4319] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:01:47 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:01:47.550646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94470-be0c-4af2-a7a6-b21b39f9c0b9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:47.569308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94470-be0c-4af2-a7a6-b21b39f9c0b9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:47.707814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeda3c-805b-421b-8d38-5d3ede59e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:47.708773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeda3c-805b-421b-8d38-5d3ede59e99f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:47.709237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeda3c-805b-421b-8d38-5d3ede59e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:47.709664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdeda3c-805b-421b-8d38-5d3ede59e99f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:47.711676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdeda3c-805b-421b-8d38-5d3ede59e99f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:47.714861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdeda3c-805b-421b-8d38-5d3ede59e99f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:47.757330 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2177/4320] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:01:47 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:01:47.760924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582564e-ec08-497a-862c-b69734264775 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:47.772580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582564e-ec08-497a-862c-b69734264775 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:47.792680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44324-45cb-4dc3-a2ca-48f2eb7ba087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:47.793593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44324-45cb-4dc3-a2ca-48f2eb7ba087 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:47.794161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44324-45cb-4dc3-a2ca-48f2eb7ba087 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:47.794603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d44324-45cb-4dc3-a2ca-48f2eb7ba087 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:47.795532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d44324-45cb-4dc3-a2ca-48f2eb7ba087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:47.799055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d44324-45cb-4dc3-a2ca-48f2eb7ba087 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:47.849953 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2144/4321] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:01:47.853276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeda3c-805b-421b-8d38-5d3ede59e99f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:47.891393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdeda3c-805b-421b-8d38-5d3ede59e99f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:47.934011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd46ee-f123-463f-a3d1-e56c800c651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:47.940428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd46ee-f123-463f-a3d1-e56c800c651f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:47.942668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd46ee-f123-463f-a3d1-e56c800c651f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:47.944657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd46ee-f123-463f-a3d1-e56c800c651f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:47.948112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd46ee-f123-463f-a3d1-e56c800c651f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:47.958952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd46ee-f123-463f-a3d1-e56c800c651f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:47.986885 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2178/4322] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:01:47.991122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44324-45cb-4dc3-a2ca-48f2eb7ba087 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:48.003016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d44324-45cb-4dc3-a2ca-48f2eb7ba087 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:48.030792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c2826-1986-4590-b2b2-3781f1f46d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:48.032917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c2826-1986-4590-b2b2-3781f1f46d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:48.037281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c2826-1986-4590-b2b2-3781f1f46d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:48.037524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c2826-1986-4590-b2b2-3781f1f46d0f admin admin] PATH_INFO: `/v3/projects/092a9ada15ab4bd1960204f158625a42/users/16965e41493449858ada0e70c052e3e8/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:48.097051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c2826-1986-4590-b2b2-3781f1f46d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=092a9ada15ab4bd1960204f158625a42, user_id=16965e41493449858ada0e70c052e3e8, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:48.105382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4c2826-1986-4590-b2b2-3781f1f46d0f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:48.149029 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2145/4323] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:01:47 2022] PUT /identity/v3/projects/092a9ada15ab4bd1960204f158625a42/users/16965e41493449858ada0e70c052e3e8/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:01:48.160389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81015-2e6a-4109-a3bb-d7ea48adde75 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:48.160389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81015-2e6a-4109-a3bb-d7ea48adde75 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:48.160620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d81015-2e6a-4109-a3bb-d7ea48adde75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:48.246685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a9d81015-2e6a-4109-a3bb-d7ea48adde75 None None] MFA Rules not processed for user `16965e41493449858ada0e70c052e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:48.248257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a9d81015-2e6a-4109-a3bb-d7ea48adde75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:48.478613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c2826-1986-4590-b2b2-3781f1f46d0f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:48.480857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6a4c2826-1986-4590-b2b2-3781f1f46d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:48.494157 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2179/4324] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:48.509597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd656-1183-4dcb-881c-bdc42d6df9de None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:48.513901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd656-1183-4dcb-881c-bdc42d6df9de None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:48.514113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd656-1183-4dcb-881c-bdc42d6df9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:48.588263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-117cd656-1183-4dcb-881c-bdc42d6df9de None None] MFA Rules not processed for user `16965e41493449858ada0e70c052e3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:48.589839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-117cd656-1183-4dcb-881c-bdc42d6df9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:48.613110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2180/4325] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:48.625233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd656-1183-4dcb-881c-bdc42d6df9de None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:48.628778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-117cd656-1183-4dcb-881c-bdc42d6df9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:48.710605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c2826-1986-4590-b2b2-3781f1f46d0f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:48.735338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:48.738426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:48.739221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:48.739692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] PATH_INFO: `/v3/projects/f7c998fb98ff4ad3947f0e147eaf4393` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:48.751290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c998fb98ff4ad3947f0e147eaf4393)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:48.756761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:48.931424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd656-1183-4dcb-881c-bdc42d6df9de None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:48.950085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54900689-690c-4a7d-bc64-a97fe01ec751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:48.950681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54900689-690c-4a7d-bc64-a97fe01ec751 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:48.955472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54900689-690c-4a7d-bc64-a97fe01ec751 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:48.957928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54900689-690c-4a7d-bc64-a97fe01ec751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:48.996398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54900689-690c-4a7d-bc64-a97fe01ec751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:48.998342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c998fb98ff4ad3947f0e147eaf4393', 'request_id': 'req-024559ba-3207-4c5a-bc5b-5042ef4e65eb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:48.998972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54900689-690c-4a7d-bc64-a97fe01ec751 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:49.024940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c998fb98ff4ad3947f0e147eaf4393', 'request_id': 'req-024559ba-3207-4c5a-bc5b-5042ef4e65eb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:49.040188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c998fb98ff4ad3947f0e147eaf4393', 'request_id': 'req-024559ba-3207-4c5a-bc5b-5042ef4e65eb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:49.044116 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2181/4326] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:01:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:01:49.092722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] The token cache is being invalidate because project f7c998fb98ff4ad3947f0e147eaf4393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:01:49.093234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:49.096009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-024559ba-3207-4c5a-bc5b-5042ef4e65eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:01:49.098396 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2146/4327] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:01:48 2022] DELETE /identity/v3/projects/f7c998fb98ff4ad3947f0e147eaf4393 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:01:49.103358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bafe2b-9625-49ee-ada0-66ad72d23dcf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:49.103650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bafe2b-9625-49ee-ada0-66ad72d23dcf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:49.103946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bafe2b-9625-49ee-ada0-66ad72d23dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:49.130952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d4bafe2b-9625-49ee-ada0-66ad72d23dcf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:49.133358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d4bafe2b-9625-49ee-ada0-66ad72d23dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:49.325796 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2182/4328] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:49.334689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef5b52-50e2-4c55-9e4e-0942b98c53a3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:49.334973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef5b52-50e2-4c55-9e4e-0942b98c53a3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:49.335473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef5b52-50e2-4c55-9e4e-0942b98c53a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:49.378109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2fef5b52-50e2-4c55-9e4e-0942b98c53a3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:49.379665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2fef5b52-50e2-4c55-9e4e-0942b98c53a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:49.395653 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2147/4329] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:01:49.400403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bafe2b-9625-49ee-ada0-66ad72d23dcf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:49.417051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bafe2b-9625-49ee-ada0-66ad72d23dcf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:49.442036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644357-73c7-43e3-803d-31c3f1d30498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:49.442726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644357-73c7-43e3-803d-31c3f1d30498 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:49.443057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644357-73c7-43e3-803d-31c3f1d30498 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:49.443341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644357-73c7-43e3-803d-31c3f1d30498 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:49.444181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644357-73c7-43e3-803d-31c3f1d30498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:01:49.444691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644357-73c7-43e3-803d-31c3f1d30498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:49.447138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644357-73c7-43e3-803d-31c3f1d30498 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:49.482783 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2183/4330] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:01:49.484726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef5b52-50e2-4c55-9e4e-0942b98c53a3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:49.518522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef5b52-50e2-4c55-9e4e-0942b98c53a3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:49.556193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09ef3-a587-4af9-a613-c62b396d6f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:49.573092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09ef3-a587-4af9-a613-c62b396d6f30 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:49.602324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09ef3-a587-4af9-a613-c62b396d6f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:49.603775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc09ef3-a587-4af9-a613-c62b396d6f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:49.605217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc09ef3-a587-4af9-a613-c62b396d6f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:49.612996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc09ef3-a587-4af9-a613-c62b396d6f30 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:49.712771 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2148/4331] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:01:49 2022] POST /identity/v3/projects => generated 365 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:01:49.717619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644357-73c7-43e3-803d-31c3f1d30498 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:49.732761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644357-73c7-43e3-803d-31c3f1d30498 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:49.921316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bf153-462f-4dda-9187-66b07de5eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:49.922090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bf153-462f-4dda-9187-66b07de5eebd admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:49.922300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bf153-462f-4dda-9187-66b07de5eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:49.922774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732bf153-462f-4dda-9187-66b07de5eebd admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:49.924407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732bf153-462f-4dda-9187-66b07de5eebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:49.926403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732bf153-462f-4dda-9187-66b07de5eebd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:49.992048 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2184/4332] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:01:49 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:01:49.994851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09ef3-a587-4af9-a613-c62b396d6f30 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:50.038269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc09ef3-a587-4af9-a613-c62b396d6f30 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:50.049908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e5bf-bdeb-41c2-a43f-99202a465f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:50.052265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e5bf-bdeb-41c2-a43f-99202a465f6c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:50.052722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e5bf-bdeb-41c2-a43f-99202a465f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:50.053159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472e5bf-bdeb-41c2-a43f-99202a465f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:50.055208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e5bf-bdeb-41c2-a43f-99202a465f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:50.060246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472e5bf-bdeb-41c2-a43f-99202a465f6c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:50.091054 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2149/4333] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:01:50.092068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bf153-462f-4dda-9187-66b07de5eebd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:50.105694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732bf153-462f-4dda-9187-66b07de5eebd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:50.119730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb3172-9da5-4e37-b4e1-e40258ba31d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:50.120735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb3172-9da5-4e37-b4e1-e40258ba31d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:50.121260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb3172-9da5-4e37-b4e1-e40258ba31d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:50.121772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb3172-9da5-4e37-b4e1-e40258ba31d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:50.122722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb3172-9da5-4e37-b4e1-e40258ba31d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:50.131680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb3172-9da5-4e37-b4e1-e40258ba31d8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:50.167550 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2185/4334] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:01:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:01:50.172103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e5bf-bdeb-41c2-a43f-99202a465f6c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:50.214210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472e5bf-bdeb-41c2-a43f-99202a465f6c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:50.236748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a07eb2-b6ad-4b65-af6e-7cb6aa214922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:50.238409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07eb2-b6ad-4b65-af6e-7cb6aa214922 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:50.246597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07eb2-b6ad-4b65-af6e-7cb6aa214922 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:50.248826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a07eb2-b6ad-4b65-af6e-7cb6aa214922 admin admin] PATH_INFO: `/v3/projects/70b5ae85e2294d2f818d72b81ce595e1/users/e891d0071e064b73b60609f0104d00f4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:50.311172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a07eb2-b6ad-4b65-af6e-7cb6aa214922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b5ae85e2294d2f818d72b81ce595e1, user_id=e891d0071e064b73b60609f0104d00f4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:50.314024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a07eb2-b6ad-4b65-af6e-7cb6aa214922 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:50.386870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2150/4335] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:01:50 2022] PUT /identity/v3/projects/70b5ae85e2294d2f818d72b81ce595e1/users/e891d0071e064b73b60609f0104d00f4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:01:50.389330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b52c3e-387f-4808-b8e2-d2dfb6982565 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:50.389704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b52c3e-387f-4808-b8e2-d2dfb6982565 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:50.390069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b52c3e-387f-4808-b8e2-d2dfb6982565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:50.450350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-26b52c3e-387f-4808-b8e2-d2dfb6982565 None None] MFA Rules not processed for user `e891d0071e064b73b60609f0104d00f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:50.453192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-26b52c3e-387f-4808-b8e2-d2dfb6982565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:50.620220 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2186/4336] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:50.640379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a07eb2-b6ad-4b65-af6e-7cb6aa214922 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:01:50.643092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a6a07eb2-b6ad-4b65-af6e-7cb6aa214922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:50.818027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a07eb2-b6ad-4b65-af6e-7cb6aa214922 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:01:50.834147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80326113-62e4-4c0d-9dba-9da12a17fe8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:01:50.835662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80326113-62e4-4c0d-9dba-9da12a17fe8f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:50.836555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80326113-62e4-4c0d-9dba-9da12a17fe8f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:50.837935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80326113-62e4-4c0d-9dba-9da12a17fe8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:50.881908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80326113-62e4-4c0d-9dba-9da12a17fe8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:01:50.885001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80326113-62e4-4c0d-9dba-9da12a17fe8f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:01:50.918381 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2151/4337] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:01:59.623313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfe25-b631-4320-94a5-d94d0895d833 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:59.624164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfe25-b631-4320-94a5-d94d0895d833 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:59.624591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcfe25-b631-4320-94a5-d94d0895d833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:59.675220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d1dcfe25-b631-4320-94a5-d94d0895d833 None None] MFA Rules not processed for user `87a1de01e7de440d86084c1b5b5aede4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:59.678120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d1dcfe25-b631-4320-94a5-d94d0895d833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:59.842739 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2187/4338] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:01:59.853175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3e13-a67e-49ed-b584-03ccc855cd86 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:01:59.853837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3e13-a67e-49ed-b584-03ccc855cd86 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:01:59.854442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3e13-a67e-49ed-b584-03ccc855cd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:01:59.878893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-056b3e13-a67e-49ed-b584-03ccc855cd86 None None] MFA Rules not processed for user `87a1de01e7de440d86084c1b5b5aede4`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:01:59.880416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-056b3e13-a67e-49ed-b584-03ccc855cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:01:59.902087 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2152/4339] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:01:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:01.792475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcfe25-b631-4320-94a5-d94d0895d833 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:01.792475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d1dcfe25-b631-4320-94a5-d94d0895d833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:01.930583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcfe25-b631-4320-94a5-d94d0895d833 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:01.936257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:01.937130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:01.937413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:01.937691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] PATH_INFO: `/v3/users/6f4376fd9ace4887af0b56483b90a23d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:01.939656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4376fd9ace4887af0b56483b90a23d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:01.941689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:02.006621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4376fd9ace4887af0b56483b90a23d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.018099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4376fd9ace4887af0b56483b90a23d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.019309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4376fd9ace4887af0b56483b90a23d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.020254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4376fd9ace4887af0b56483b90a23d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.031034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-838f16fc-60bb-477a-b453-528e0a9b4591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4376fd9ace4887af0b56483b90a23d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.052572 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2188/4340] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:02:01 2022] DELETE /identity/v3/users/6f4376fd9ace4887af0b56483b90a23d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:02.454265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3e13-a67e-49ed-b584-03ccc855cd86 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:02.455788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-056b3e13-a67e-49ed-b584-03ccc855cd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:02.478041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3e13-a67e-49ed-b584-03ccc855cd86 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:02.556357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:02.557535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:02.559254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:02.559744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] PATH_INFO: `/v3/users/63a67a69e7ec49d380d07e649f536865` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:02.561929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a67a69e7ec49d380d07e649f536865)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:02.565013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:02.630858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a67a69e7ec49d380d07e649f536865'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.641686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a67a69e7ec49d380d07e649f536865'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.643894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a67a69e7ec49d380d07e649f536865'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.644667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a67a69e7ec49d380d07e649f536865'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.666202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a67a69e7ec49d380d07e649f536865'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:02.713324 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2153/4341] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:02:02 2022] DELETE /identity/v3/users/63a67a69e7ec49d380d07e649f536865 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:02.718838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022882-10f3-485d-bc02-6b74bff88336 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:02.720144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022882-10f3-485d-bc02-6b74bff88336 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:02.721275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9022882-10f3-485d-bc02-6b74bff88336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:02.748317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a9022882-10f3-485d-bc02-6b74bff88336 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:02.749880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a9022882-10f3-485d-bc02-6b74bff88336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:02.793591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:02.799316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:02.852671 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2189/4342] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:02.867535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9022882-10f3-485d-bc02-6b74bff88336 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:02.871990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a9022882-10f3-485d-bc02-6b74bff88336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:02.947196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894dd9bd-6711-4d20-bec3-15ab692b93d4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:02.963955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:02.963955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:02.963955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:02.963955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] PATH_INFO: `/v3/projects/62b213fd60a44c2481f49b4ed4711a67` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:02.964494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b213fd60a44c2481f49b4ed4711a67)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:02.965510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:02.987974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9022882-10f3-485d-bc02-6b74bff88336 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:02.999838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36361b-3c20-40cd-b81d-e77bc1140f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:03.000778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36361b-3c20-40cd-b81d-e77bc1140f00 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.002070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36361b-3c20-40cd-b81d-e77bc1140f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.002958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36361b-3c20-40cd-b81d-e77bc1140f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.034312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36361b-3c20-40cd-b81d-e77bc1140f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:03.036133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36361b-3c20-40cd-b81d-e77bc1140f00 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:03.047334 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2190/4343] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:02:03.053497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b213fd60a44c2481f49b4ed4711a67', 'request_id': 'req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.065030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b213fd60a44c2481f49b4ed4711a67', 'request_id': 'req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.094217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b213fd60a44c2481f49b4ed4711a67', 'request_id': 'req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.125655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] The token cache is being invalidate because project 62b213fd60a44c2481f49b4ed4711a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:02:03.126087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.126896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.129242 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2154/4344] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:02 2022] DELETE /identity/v3/projects/62b213fd60a44c2481f49b4ed4711a67 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:03.137475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e724ed1-4e89-4d1d-9897-48ab2fb300df None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.138127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e724ed1-4e89-4d1d-9897-48ab2fb300df None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.138631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e724ed1-4e89-4d1d-9897-48ab2fb300df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.172175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3e724ed1-4e89-4d1d-9897-48ab2fb300df None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:03.174501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3e724ed1-4e89-4d1d-9897-48ab2fb300df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:03.264412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:03.266880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:03.304699 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2191/4345] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:03.316719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651e65-da0f-4b28-a9d3-3a5d48d9d485 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.317272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651e65-da0f-4b28-a9d3-3a5d48d9d485 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.317725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5651e65-da0f-4b28-a9d3-3a5d48d9d485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.339841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e5651e65-da0f-4b28-a9d3-3a5d48d9d485 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:03.341983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e5651e65-da0f-4b28-a9d3-3a5d48d9d485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:03.352031 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2192/4346] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:02:03.356315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651e65-da0f-4b28-a9d3-3a5d48d9d485 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:03.366244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5651e65-da0f-4b28-a9d3-3a5d48d9d485 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:03.376854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d12f05-bdb2-4dcd-8b57-25d14733c5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:03.377999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d12f05-bdb2-4dcd-8b57-25d14733c5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.378431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d12f05-bdb2-4dcd-8b57-25d14733c5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.378919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d12f05-bdb2-4dcd-8b57-25d14733c5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.379781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d12f05-bdb2-4dcd-8b57-25d14733c5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:02:03.380297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d12f05-bdb2-4dcd-8b57-25d14733c5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:03.383609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d12f05-bdb2-4dcd-8b57-25d14733c5d4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:03.402877 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2193/4347] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:02:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:02:03.407744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d12f05-bdb2-4dcd-8b57-25d14733c5d4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:03.423420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d12f05-bdb2-4dcd-8b57-25d14733c5d4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:03.440061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4d0c3-4d5c-41aa-8419-e6f671017f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:03.441041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d0c3-4d5c-41aa-8419-e6f671017f1b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.441507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d0c3-4d5c-41aa-8419-e6f671017f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.442000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4d0c3-4d5c-41aa-8419-e6f671017f1b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.442904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4d0c3-4d5c-41aa-8419-e6f671017f1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:03.445212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4d0c3-4d5c-41aa-8419-e6f671017f1b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:03.469822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6f8a4-6f52-4e5d-ae88-ca8ab2cc88cc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:03.487548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c13905-d81b-4a4e-af49-9c82690a664e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:03.491278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13905-d81b-4a4e-af49-9c82690a664e service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.492726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13905-d81b-4a4e-af49-9c82690a664e service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.493283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13905-d81b-4a4e-af49-9c82690a664e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.496833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-25c13905-d81b-4a4e-af49-9c82690a664e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:03.501590 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2194/4348] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:02:03 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:02:03.506148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4d0c3-4d5c-41aa-8419-e6f671017f1b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:03.509857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f0c4d0c3-4d5c-41aa-8419-e6f671017f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:03.525761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c13905-d81b-4a4e-af49-9c82690a664e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:03.528294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c13905-d81b-4a4e-af49-9c82690a664e service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:03.546003 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2155/4349] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:02:03.562915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c13905-d81b-4a4e-af49-9c82690a664e service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:03.588805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c13905-d81b-4a4e-af49-9c82690a664e service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:03.650391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4d0c3-4d5c-41aa-8419-e6f671017f1b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:03.660732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:03.661707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.661895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.662179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] PATH_INFO: `/v3/projects/b80a8a10ae564166bc62181ad18daf5d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.665999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80a8a10ae564166bc62181ad18daf5d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:03.667999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:03.730103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc96e06-8f95-416e-a63d-56dc7c30d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:03.730836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc96e06-8f95-416e-a63d-56dc7c30d68f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.731064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc96e06-8f95-416e-a63d-56dc7c30d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.731339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc96e06-8f95-416e-a63d-56dc7c30d68f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.732549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc96e06-8f95-416e-a63d-56dc7c30d68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:03.734615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc96e06-8f95-416e-a63d-56dc7c30d68f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:03.749593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80a8a10ae564166bc62181ad18daf5d', 'request_id': 'req-30432b86-fe1a-490b-8e72-67efda1e86c3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.765800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80a8a10ae564166bc62181ad18daf5d', 'request_id': 'req-30432b86-fe1a-490b-8e72-67efda1e86c3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.785509 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2156/4350] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:02:03 2022] POST /identity/v3/users => generated 288 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:02:03.788379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80a8a10ae564166bc62181ad18daf5d', 'request_id': 'req-30432b86-fe1a-490b-8e72-67efda1e86c3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.788808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc96e06-8f95-416e-a63d-56dc7c30d68f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:03.805952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc96e06-8f95-416e-a63d-56dc7c30d68f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:03.810351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] The token cache is being invalidate because project b80a8a10ae564166bc62181ad18daf5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:02:03.810532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.811622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30432b86-fe1a-490b-8e72-67efda1e86c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:03.816932 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2195/4351] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:03 2022] DELETE /identity/v3/projects/b80a8a10ae564166bc62181ad18daf5d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:03.824221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad80e5-c310-42f2-9a16-4d95617df1d8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.824677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad80e5-c310-42f2-9a16-4d95617df1d8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.825235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad80e5-c310-42f2-9a16-4d95617df1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.851757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-77ad80e5-c310-42f2-9a16-4d95617df1d8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:03.854622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-77ad80e5-c310-42f2-9a16-4d95617df1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:03.879065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc8cff-6717-4a6b-9b1a-c76c3a6fb8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:03.879745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc8cff-6717-4a6b-9b1a-c76c3a6fb8ed admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.880062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc8cff-6717-4a6b-9b1a-c76c3a6fb8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.880341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc8cff-6717-4a6b-9b1a-c76c3a6fb8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.881119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc8cff-6717-4a6b-9b1a-c76c3a6fb8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:03.882793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc8cff-6717-4a6b-9b1a-c76c3a6fb8ed admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:03.894331 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2157/4352] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:02:03.900543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc8cff-6717-4a6b-9b1a-c76c3a6fb8ed admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:03.902325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4dcc8cff-6717-4a6b-9b1a-c76c3a6fb8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:03.928274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc8cff-6717-4a6b-9b1a-c76c3a6fb8ed admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:03.941609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341739e6-6c52-4fa7-8d7c-24017c9463f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:03.942282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341739e6-6c52-4fa7-8d7c-24017c9463f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.942564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341739e6-6c52-4fa7-8d7c-24017c9463f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.942838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341739e6-6c52-4fa7-8d7c-24017c9463f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.943556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341739e6-6c52-4fa7-8d7c-24017c9463f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:03.947893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341739e6-6c52-4fa7-8d7c-24017c9463f8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:03.955977 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2196/4353] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:03.958545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44e45-083d-4fa5-97ee-a2823632deaf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:03.958841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44e45-083d-4fa5-97ee-a2823632deaf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:03.959124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44e45-083d-4fa5-97ee-a2823632deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:03.975793 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2158/4354] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:02:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:02:03.978547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341739e6-6c52-4fa7-8d7c-24017c9463f8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:03.997744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-02c44e45-083d-4fa5-97ee-a2823632deaf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:03.999171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-02c44e45-083d-4fa5-97ee-a2823632deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:04.001892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341739e6-6c52-4fa7-8d7c-24017c9463f8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:04.006861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58139fda-7e01-42c9-9def-bc8ed7629b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:04.007877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58139fda-7e01-42c9-9def-bc8ed7629b08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.008202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58139fda-7e01-42c9-9def-bc8ed7629b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.008635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58139fda-7e01-42c9-9def-bc8ed7629b08 admin admin] PATH_INFO: `/v3/projects/c7ef32a79723421e847963a749a03313/users/b52006e4eed04870964f3b282818c82c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.012169 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2197/4355] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:04.013232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c44e45-083d-4fa5-97ee-a2823632deaf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:04.023153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c44e45-083d-4fa5-97ee-a2823632deaf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:04.028868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf54e7-93e9-4faf-9435-3d7dca92218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:04.029750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf54e7-93e9-4faf-9435-3d7dca92218f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.030043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf54e7-93e9-4faf-9435-3d7dca92218f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.030320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf54e7-93e9-4faf-9435-3d7dca92218f admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.031052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf54e7-93e9-4faf-9435-3d7dca92218f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:02:04.031357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf54e7-93e9-4faf-9435-3d7dca92218f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:04.033196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf54e7-93e9-4faf-9435-3d7dca92218f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:04.053176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58139fda-7e01-42c9-9def-bc8ed7629b08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ef32a79723421e847963a749a03313, user_id=b52006e4eed04870964f3b282818c82c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:04.055785 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2198/4356] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:02:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:02:04.057265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58139fda-7e01-42c9-9def-bc8ed7629b08 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:04.060114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf54e7-93e9-4faf-9435-3d7dca92218f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:04.081773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf54e7-93e9-4faf-9435-3d7dca92218f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:04.086142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2159/4357] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:02:03 2022] PUT /identity/v3/projects/c7ef32a79723421e847963a749a03313/users/b52006e4eed04870964f3b282818c82c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:04.093012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5848e3a-faee-4cca-b47d-95c6b4ae6ac8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.093316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5848e3a-faee-4cca-b47d-95c6b4ae6ac8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.093739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5848e3a-faee-4cca-b47d-95c6b4ae6ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.129423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b5848e3a-faee-4cca-b47d-95c6b4ae6ac8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:04.130154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b5848e3a-faee-4cca-b47d-95c6b4ae6ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:04.169320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9bf35-eb7c-4f89-9675-9bb451010544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:04.170687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9bf35-eb7c-4f89-9675-9bb451010544 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.171151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9bf35-eb7c-4f89-9675-9bb451010544 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.171617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9bf35-eb7c-4f89-9675-9bb451010544 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.173349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9bf35-eb7c-4f89-9675-9bb451010544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:04.176335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9bf35-eb7c-4f89-9675-9bb451010544 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:04.222214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2199/4358] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:02:04 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:02:04.224416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9bf35-eb7c-4f89-9675-9bb451010544 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:04.233264 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2160/4359] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:04.255301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5848e3a-faee-4cca-b47d-95c6b4ae6ac8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:04.256769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b5848e3a-faee-4cca-b47d-95c6b4ae6ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:04.306794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9bf35-eb7c-4f89-9675-9bb451010544 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:04.311712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae395c17-ce1a-420f-a808-4340f9a9540e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:04.312692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae395c17-ce1a-420f-a808-4340f9a9540e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.312981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae395c17-ce1a-420f-a808-4340f9a9540e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.313439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae395c17-ce1a-420f-a808-4340f9a9540e admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.314275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae395c17-ce1a-420f-a808-4340f9a9540e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:04.316471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae395c17-ce1a-420f-a808-4340f9a9540e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:04.352266 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2200/4360] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:02:04 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:02:04.353188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae395c17-ce1a-420f-a808-4340f9a9540e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:04.364587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae395c17-ce1a-420f-a808-4340f9a9540e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:04.373438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b0318-3cee-471f-a299-737a06054ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:04.374207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b0318-3cee-471f-a299-737a06054ffd admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.374399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b0318-3cee-471f-a299-737a06054ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.374834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b0318-3cee-471f-a299-737a06054ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.376925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b0318-3cee-471f-a299-737a06054ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:04.378678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b0318-3cee-471f-a299-737a06054ffd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:04.378765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5848e3a-faee-4cca-b47d-95c6b4ae6ac8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:04.393655 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2201/4361] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:02:04.398955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b0318-3cee-471f-a299-737a06054ffd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:04.412721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b0318-3cee-471f-a299-737a06054ffd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:04.426498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551a115-9f81-411c-90fc-f31e53f5635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:04.427501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551a115-9f81-411c-90fc-f31e53f5635c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.427752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551a115-9f81-411c-90fc-f31e53f5635c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.430960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551a115-9f81-411c-90fc-f31e53f5635c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.431738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551a115-9f81-411c-90fc-f31e53f5635c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:04.433468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551a115-9f81-411c-90fc-f31e53f5635c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:04.456855 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2202/4362] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:02:04.458420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551a115-9f81-411c-90fc-f31e53f5635c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:04.474384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551a115-9f81-411c-90fc-f31e53f5635c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:04.480185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73498faf-773c-4c53-9599-fb1b77107b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:04.482906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73498faf-773c-4c53-9599-fb1b77107b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.484656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73498faf-773c-4c53-9599-fb1b77107b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.484656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73498faf-773c-4c53-9599-fb1b77107b01 admin admin] PATH_INFO: `/v3/projects/071536f2731b462e8a9718f742660e3b/users/cd954503eb9a46d3b4785c1ae5bfa5c5/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.485734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715a57c-cdf1-4666-87ee-51dd32b70a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:04.486481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715a57c-cdf1-4666-87ee-51dd32b70a4f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.504432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715a57c-cdf1-4666-87ee-51dd32b70a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.504893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715a57c-cdf1-4666-87ee-51dd32b70a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.536219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73498faf-773c-4c53-9599-fb1b77107b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=071536f2731b462e8a9718f742660e3b, user_id=cd954503eb9a46d3b4785c1ae5bfa5c5, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:04.539394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73498faf-773c-4c53-9599-fb1b77107b01 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:04.548326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715a57c-cdf1-4666-87ee-51dd32b70a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:04.551339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715a57c-cdf1-4666-87ee-51dd32b70a4f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:04.572081 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2203/4363] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:02:04 2022] PUT /identity/v3/projects/071536f2731b462e8a9718f742660e3b/users/cd954503eb9a46d3b4785c1ae5bfa5c5/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:04.582211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda409e-7e31-4f65-b5ab-617b40a6f49c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:04.582500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda409e-7e31-4f65-b5ab-617b40a6f49c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:04.582776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda409e-7e31-4f65-b5ab-617b40a6f49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:04.604270 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2161/4364] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:02:04.640157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9bda409e-7e31-4f65-b5ab-617b40a6f49c None None] MFA Rules not processed for user `cd954503eb9a46d3b4785c1ae5bfa5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:04.642343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9bda409e-7e31-4f65-b5ab-617b40a6f49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:04.863360 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2204/4365] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:02:04.880158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715a57c-cdf1-4666-87ee-51dd32b70a4f service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:04.881679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2715a57c-cdf1-4666-87ee-51dd32b70a4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:04.898729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715a57c-cdf1-4666-87ee-51dd32b70a4f service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:05.065001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ee71d-a3fd-47ee-9efd-a5d53354c812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:05.065668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ee71d-a3fd-47ee-9efd-a5d53354c812 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:05.065949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ee71d-a3fd-47ee-9efd-a5d53354c812 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:05.066246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ee71d-a3fd-47ee-9efd-a5d53354c812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:05.088086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ee71d-a3fd-47ee-9efd-a5d53354c812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:05.090043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ee71d-a3fd-47ee-9efd-a5d53354c812 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:05.108718 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2162/4366] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:02:05.208644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda409e-7e31-4f65-b5ab-617b40a6f49c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:05.225910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda409e-7e31-4f65-b5ab-617b40a6f49c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:05.237975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be2fd1-c3a8-4609-937c-1fa15722fba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:05.239616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be2fd1-c3a8-4609-937c-1fa15722fba3 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:05.242322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be2fd1-c3a8-4609-937c-1fa15722fba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:05.242826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be2fd1-c3a8-4609-937c-1fa15722fba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:05.254288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-50be2fd1-c3a8-4609-937c-1fa15722fba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:05.419402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be2fd1-c3a8-4609-937c-1fa15722fba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:05.421164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be2fd1-c3a8-4609-937c-1fa15722fba3 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:05.458516 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2205/4367] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:02:06.211147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ee71d-a3fd-47ee-9efd-a5d53354c812 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:06.213497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4a3ee71d-a3fd-47ee-9efd-a5d53354c812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:06.329807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ee71d-a3fd-47ee-9efd-a5d53354c812 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:06.336077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:06.336942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:06.337375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:06.337786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:06.340086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:06.364441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:06.368556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:06.399891 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2163/4368] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:02:14.738470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5519f0-3da4-4f9b-8ade-47e8c0ed5ffe None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:14.739002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5519f0-3da4-4f9b-8ade-47e8c0ed5ffe None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:14.739002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5519f0-3da4-4f9b-8ade-47e8c0ed5ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:14.762564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4b5519f0-3da4-4f9b-8ade-47e8c0ed5ffe None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:14.763939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4b5519f0-3da4-4f9b-8ade-47e8c0ed5ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:14.852188 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2206/4369] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:14.861140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:14.862717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:15.067554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716f63f-b156-4bb6-9412-3542f011c4b6 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:15.077491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ad46-8dd6-47d0-8840-73df2e0d16e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:15.083360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ad46-8dd6-47d0-8840-73df2e0d16e1 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:15.083899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ad46-8dd6-47d0-8840-73df2e0d16e1 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:15.084378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899ad46-8dd6-47d0-8840-73df2e0d16e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:15.096485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899ad46-8dd6-47d0-8840-73df2e0d16e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:15.098759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899ad46-8dd6-47d0-8840-73df2e0d16e1 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:15.111174 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2164/4370] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:02:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:02:17.334614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d792-638b-49b1-9a1c-2bbf00b70687 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:17.335095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d792-638b-49b1-9a1c-2bbf00b70687 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:17.335176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843d792-638b-49b1-9a1c-2bbf00b70687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:17.403089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f843d792-638b-49b1-9a1c-2bbf00b70687 None None] MFA Rules not processed for user `b52006e4eed04870964f3b282818c82c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:17.404654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f843d792-638b-49b1-9a1c-2bbf00b70687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:17.570729 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2207/4371] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:17.615497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ad46-8dd6-47d0-8840-73df2e0d16e1 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:17.659153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899ad46-8dd6-47d0-8840-73df2e0d16e1 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:17.671633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c8a13-21c4-4010-81b9-630a7335121e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:17.672901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8a13-21c4-4010-81b9-630a7335121e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:17.677919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8a13-21c4-4010-81b9-630a7335121e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:17.680881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c8a13-21c4-4010-81b9-630a7335121e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:17.704454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8a13-21c4-4010-81b9-630a7335121e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:17.714499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c8a13-21c4-4010-81b9-630a7335121e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:17.745000 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2165/4372] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:02:19.424543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f4958-1bf1-48c7-980e-3070f5d6a3e7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:19.425066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f4958-1bf1-48c7-980e-3070f5d6a3e7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:19.425170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f4958-1bf1-48c7-980e-3070f5d6a3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:19.488599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-037f4958-1bf1-48c7-980e-3070f5d6a3e7 None None] MFA Rules not processed for user `70fab8e4c45d48ea8223a3acc60a5442`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:19.489856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-037f4958-1bf1-48c7-980e-3070f5d6a3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:19.686900 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2208/4373] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:26.697993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e82d9-8d14-495b-880d-d4805cbbb62e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:26.698569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e82d9-8d14-495b-880d-d4805cbbb62e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:26.698799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e82d9-8d14-495b-880d-d4805cbbb62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:26.730802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f48e82d9-8d14-495b-880d-d4805cbbb62e None None] MFA Rules not processed for user `b52006e4eed04870964f3b282818c82c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:26.737353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f48e82d9-8d14-495b-880d-d4805cbbb62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:26.758454 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2166/4374] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:37.450000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f4958-1bf1-48c7-980e-3070f5d6a3e7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:37.451543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-037f4958-1bf1-48c7-980e-3070f5d6a3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:37.607148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f4958-1bf1-48c7-980e-3070f5d6a3e7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:37.620560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:37.621381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:37.621662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:37.621936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] PATH_INFO: `/v3/users/16965e41493449858ada0e70c052e3e8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:37.638984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=16965e41493449858ada0e70c052e3e8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:37.643761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:37.735475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16965e41493449858ada0e70c052e3e8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:37.743126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16965e41493449858ada0e70c052e3e8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:37.743796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16965e41493449858ada0e70c052e3e8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:37.744633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16965e41493449858ada0e70c052e3e8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:37.757340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16965e41493449858ada0e70c052e3e8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:37.791110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2209/4375] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:02:37 2022] DELETE /identity/v3/users/16965e41493449858ada0e70c052e3e8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:37.795573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98360d-6591-49b0-8978-68cd7c8e8334 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:37.796077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98360d-6591-49b0-8978-68cd7c8e8334 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:37.796179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98360d-6591-49b0-8978-68cd7c8e8334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:37.824975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3e98360d-6591-49b0-8978-68cd7c8e8334 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:37.827083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3e98360d-6591-49b0-8978-68cd7c8e8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:37.929705 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2167/4376] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:37.940545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:37.941007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:38.010872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97310f-c0d3-42f8-af28-a8f166d3ac3e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:38.014608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6dba4-80fe-496f-bc0d-e11a269ef7b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:38.015933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dba4-80fe-496f-bc0d-e11a269ef7b1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:38.016288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dba4-80fe-496f-bc0d-e11a269ef7b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:38.016684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6dba4-80fe-496f-bc0d-e11a269ef7b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:38.029055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6dba4-80fe-496f-bc0d-e11a269ef7b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:38.030611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6dba4-80fe-496f-bc0d-e11a269ef7b1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:38.049878 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2210/4377] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:02:38.539892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98360d-6591-49b0-8978-68cd7c8e8334 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:38.541120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3e98360d-6591-49b0-8978-68cd7c8e8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:38.567810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98360d-6591-49b0-8978-68cd7c8e8334 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:38.577975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:38.578854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:38.579134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:38.579407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] PATH_INFO: `/v3/projects/092a9ada15ab4bd1960204f158625a42` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:38.580770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092a9ada15ab4bd1960204f158625a42)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:38.582713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:38.731268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092a9ada15ab4bd1960204f158625a42', 'request_id': 'req-e20044eb-68b5-4528-9125-14a12c83df41'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:38.747110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092a9ada15ab4bd1960204f158625a42', 'request_id': 'req-e20044eb-68b5-4528-9125-14a12c83df41'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:38.755491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092a9ada15ab4bd1960204f158625a42', 'request_id': 'req-e20044eb-68b5-4528-9125-14a12c83df41'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:38.778590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] The token cache is being invalidate because project 092a9ada15ab4bd1960204f158625a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:02:38.779726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:38.786006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e20044eb-68b5-4528-9125-14a12c83df41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:38.794139 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2168/4378] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:38 2022] DELETE /identity/v3/projects/092a9ada15ab4bd1960204f158625a42 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:38.795676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690efb-b370-4115-b827-cd401f8a4f1b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:38.796209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690efb-b370-4115-b827-cd401f8a4f1b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:38.796307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08690efb-b370-4115-b827-cd401f8a4f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:38.827911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-08690efb-b370-4115-b827-cd401f8a4f1b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:38.829184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-08690efb-b370-4115-b827-cd401f8a4f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:38.940820 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2211/4379] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:38.951767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8cc31-9434-4f30-be6a-b9b883e77dc1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:38.953354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8cc31-9434-4f30-be6a-b9b883e77dc1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:38.953827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8cc31-9434-4f30-be6a-b9b883e77dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:38.977856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ecd8cc31-9434-4f30-be6a-b9b883e77dc1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:38.979392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ecd8cc31-9434-4f30-be6a-b9b883e77dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:38.994099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690efb-b370-4115-b827-cd401f8a4f1b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:38.994349 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2169/4380] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:39.008930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08690efb-b370-4115-b827-cd401f8a4f1b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:39.041599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81996c49-9550-4a4d-a5ed-fc106f1105a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:39.044736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81996c49-9550-4a4d-a5ed-fc106f1105a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:39.045192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81996c49-9550-4a4d-a5ed-fc106f1105a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:39.045486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81996c49-9550-4a4d-a5ed-fc106f1105a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:39.046331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81996c49-9550-4a4d-a5ed-fc106f1105a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:02:39.048577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81996c49-9550-4a4d-a5ed-fc106f1105a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:39.056543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81996c49-9550-4a4d-a5ed-fc106f1105a0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:39.092886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8cc31-9434-4f30-be6a-b9b883e77dc1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:39.095091 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2212/4381] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:02:39.125921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8cc31-9434-4f30-be6a-b9b883e77dc1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:39.151412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a583d0-a047-4d47-a322-fef8bb5eddba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:39.153440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a583d0-a047-4d47-a322-fef8bb5eddba admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:39.153926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a583d0-a047-4d47-a322-fef8bb5eddba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:39.154375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a583d0-a047-4d47-a322-fef8bb5eddba admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:39.155237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a583d0-a047-4d47-a322-fef8bb5eddba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:39.159779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a583d0-a047-4d47-a322-fef8bb5eddba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:39.236336 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2170/4382] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:02:39 2022] POST /identity/v3/projects => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:02:39.240220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81996c49-9550-4a4d-a5ed-fc106f1105a0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:39.253749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81996c49-9550-4a4d-a5ed-fc106f1105a0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:39.396570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783982a-0a08-49e0-ae00-1ac0ff566606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:39.397454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783982a-0a08-49e0-ae00-1ac0ff566606 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:39.397751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783982a-0a08-49e0-ae00-1ac0ff566606 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:39.398037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783982a-0a08-49e0-ae00-1ac0ff566606 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:39.398747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783982a-0a08-49e0-ae00-1ac0ff566606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:39.401469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783982a-0a08-49e0-ae00-1ac0ff566606 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:39.441823 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2213/4383] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:02:39 2022] POST /identity/v3/users => generated 281 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:02:39.443549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a583d0-a047-4d47-a322-fef8bb5eddba admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:39.461086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a583d0-a047-4d47-a322-fef8bb5eddba admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:39.473808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd0131-8077-4c8d-b2df-040872824795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:39.474747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd0131-8077-4c8d-b2df-040872824795 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:39.475207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd0131-8077-4c8d-b2df-040872824795 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:39.475650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd0131-8077-4c8d-b2df-040872824795 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:39.476562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd0131-8077-4c8d-b2df-040872824795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:39.478354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dd0131-8077-4c8d-b2df-040872824795 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:39.507556 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2171/4384] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:02:39.511538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783982a-0a08-49e0-ae00-1ac0ff566606 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:39.526376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783982a-0a08-49e0-ae00-1ac0ff566606 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:39.533699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192388e-edeb-4a50-b282-62a77c9a548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:39.534824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192388e-edeb-4a50-b282-62a77c9a548c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:39.535673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192388e-edeb-4a50-b282-62a77c9a548c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:39.536340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192388e-edeb-4a50-b282-62a77c9a548c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:39.537312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192388e-edeb-4a50-b282-62a77c9a548c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:39.545028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192388e-edeb-4a50-b282-62a77c9a548c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:39.566330 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2214/4385] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:02:39.569666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd0131-8077-4c8d-b2df-040872824795 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:39.587794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd0131-8077-4c8d-b2df-040872824795 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:39.599431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b89df9-b73c-4cd0-9964-8fd9b0e51710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:39.600688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b89df9-b73c-4cd0-9964-8fd9b0e51710 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:39.601161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b89df9-b73c-4cd0-9964-8fd9b0e51710 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:39.601612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b89df9-b73c-4cd0-9964-8fd9b0e51710 admin admin] PATH_INFO: `/v3/projects/e520292ca1b54018aac52054b2b8ac37/users/8857852e66af4e6abefd2d96e62285cc/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:39.635188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b89df9-b73c-4cd0-9964-8fd9b0e51710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e520292ca1b54018aac52054b2b8ac37, user_id=8857852e66af4e6abefd2d96e62285cc, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:39.638377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b89df9-b73c-4cd0-9964-8fd9b0e51710 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:39.699508 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2172/4386] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:02:39 2022] PUT /identity/v3/projects/e520292ca1b54018aac52054b2b8ac37/users/8857852e66af4e6abefd2d96e62285cc/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:39.794315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dd4d8-4b9a-4932-8407-26d3e52b8af0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:39.794521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dd4d8-4b9a-4932-8407-26d3e52b8af0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:39.794607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dd4d8-4b9a-4932-8407-26d3e52b8af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:39.829465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-be0dd4d8-4b9a-4932-8407-26d3e52b8af0 None None] MFA Rules not processed for user `8857852e66af4e6abefd2d96e62285cc`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:39.831684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be0dd4d8-4b9a-4932-8407-26d3e52b8af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:39.964487 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2215/4387] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:02:40.541651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b89df9-b73c-4cd0-9964-8fd9b0e51710 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:40.714269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b89df9-b73c-4cd0-9964-8fd9b0e51710 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:40.738166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:40.740018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:40.741444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:40.741898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] PATH_INFO: `/v3/users/8857852e66af4e6abefd2d96e62285cc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:40.743471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8857852e66af4e6abefd2d96e62285cc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:40.750492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:40.888619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8857852e66af4e6abefd2d96e62285cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:40.916705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8857852e66af4e6abefd2d96e62285cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:40.917686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8857852e66af4e6abefd2d96e62285cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:40.918485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8857852e66af4e6abefd2d96e62285cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:40.947651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8857852e66af4e6abefd2d96e62285cc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:41.011181 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2173/4388] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:02:40 2022] DELETE /identity/v3/users/8857852e66af4e6abefd2d96e62285cc => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:41.017296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8fd3d-873b-49df-8a3a-061a0b3c1b3d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:41.018435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8fd3d-873b-49df-8a3a-061a0b3c1b3d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:41.020257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8fd3d-873b-49df-8a3a-061a0b3c1b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:41.071017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4dd8fd3d-873b-49df-8a3a-061a0b3c1b3d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:41.074243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4dd8fd3d-873b-49df-8a3a-061a0b3c1b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:41.191841 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2216/4389] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:41.270064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:41.272183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:41.361230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c65aa-c5ae-4897-85b4-0643df9b2d2f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:41.365292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761aea5-7922-4099-999a-182e6bcd7ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:41.365975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761aea5-7922-4099-999a-182e6bcd7ddc service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:41.366264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761aea5-7922-4099-999a-182e6bcd7ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:41.366583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d761aea5-7922-4099-999a-182e6bcd7ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:41.386407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761aea5-7922-4099-999a-182e6bcd7ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:41.388769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d761aea5-7922-4099-999a-182e6bcd7ddc service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:41.399928 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2174/4390] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:02:42.574564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc66798-42f7-4677-868f-0891f3b6bebb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:42.575082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc66798-42f7-4677-868f-0891f3b6bebb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:42.576192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc66798-42f7-4677-868f-0891f3b6bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:42.595572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9cc66798-42f7-4677-868f-0891f3b6bebb None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:42.597113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9cc66798-42f7-4677-868f-0891f3b6bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:42.683495 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2217/4391] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:02:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:42.708622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761aea5-7922-4099-999a-182e6bcd7ddc service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:42.711646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d761aea5-7922-4099-999a-182e6bcd7ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:42.910567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d761aea5-7922-4099-999a-182e6bcd7ddc service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:42.916631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cffdce-a436-450a-8f94-a0dc2babdbd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:42.917606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cffdce-a436-450a-8f94-a0dc2babdbd6 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:42.918081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cffdce-a436-450a-8f94-a0dc2babdbd6 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:42.918221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cffdce-a436-450a-8f94-a0dc2babdbd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:42.941481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cffdce-a436-450a-8f94-a0dc2babdbd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:42.943651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cffdce-a436-450a-8f94-a0dc2babdbd6 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:42.975122 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2175/4392] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:02:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:02:43.728727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877609d-71f9-4943-8588-73406f0f840d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:43.729598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877609d-71f9-4943-8588-73406f0f840d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:43.730098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877609d-71f9-4943-8588-73406f0f840d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:43.755536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e877609d-71f9-4943-8588-73406f0f840d None None] MFA Rules not processed for user `fdd16c1bdb3d416d8421202397566d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:43.757333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e877609d-71f9-4943-8588-73406f0f840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:43.837547 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2218/4393] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:44.176447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cffdce-a436-450a-8f94-a0dc2babdbd6 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:44.178953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-61cffdce-a436-450a-8f94-a0dc2babdbd6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:44.201738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cffdce-a436-450a-8f94-a0dc2babdbd6 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:44.209917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:44.211324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.211848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.212396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] PATH_INFO: `/v3/projects/e520292ca1b54018aac52054b2b8ac37` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.213918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e520292ca1b54018aac52054b2b8ac37)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:44.216230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:44.288163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e520292ca1b54018aac52054b2b8ac37', 'request_id': 'req-595339b7-811d-4381-9f8b-ab389e7dd0d1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:44.298257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e520292ca1b54018aac52054b2b8ac37', 'request_id': 'req-595339b7-811d-4381-9f8b-ab389e7dd0d1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:44.305152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e520292ca1b54018aac52054b2b8ac37', 'request_id': 'req-595339b7-811d-4381-9f8b-ab389e7dd0d1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:44.318989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] The token cache is being invalidate because project e520292ca1b54018aac52054b2b8ac37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:02:44.319278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:44.320175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-595339b7-811d-4381-9f8b-ab389e7dd0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:44.321980 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2176/4394] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:02:44 2022] DELETE /identity/v3/projects/e520292ca1b54018aac52054b2b8ac37 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:44.328260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88793c5-0600-4baf-9722-9e5273f336fb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.328544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88793c5-0600-4baf-9722-9e5273f336fb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.329263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88793c5-0600-4baf-9722-9e5273f336fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.348574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a88793c5-0600-4baf-9722-9e5273f336fb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:44.349807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a88793c5-0600-4baf-9722-9e5273f336fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:44.425819 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2219/4395] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:02:44.433573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f703-b1de-4d19-9a11-1fa23ca07afa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.433853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f703-b1de-4d19-9a11-1fa23ca07afa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.434319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f703-b1de-4d19-9a11-1fa23ca07afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.457126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e870f703-b1de-4d19-9a11-1fa23ca07afa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:44.459359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e870f703-b1de-4d19-9a11-1fa23ca07afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:44.472564 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2177/4396] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:02:44.474232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88793c5-0600-4baf-9722-9e5273f336fb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:44.487946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88793c5-0600-4baf-9722-9e5273f336fb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:44.495146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d847b8-80f8-4cd7-9e62-44c2e520b594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:44.501399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d847b8-80f8-4cd7-9e62-44c2e520b594 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.501992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d847b8-80f8-4cd7-9e62-44c2e520b594 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.502473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d847b8-80f8-4cd7-9e62-44c2e520b594 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.503433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d847b8-80f8-4cd7-9e62-44c2e520b594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:02:44.504238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d847b8-80f8-4cd7-9e62-44c2e520b594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:44.506763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d847b8-80f8-4cd7-9e62-44c2e520b594 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:44.523229 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2220/4397] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:02:44.529951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870f703-b1de-4d19-9a11-1fa23ca07afa None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:44.553575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870f703-b1de-4d19-9a11-1fa23ca07afa None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:44.563850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e390-618f-41bd-a95e-183b0af708d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:44.565217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e390-618f-41bd-a95e-183b0af708d9 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.565704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e390-618f-41bd-a95e-183b0af708d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.566134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e390-618f-41bd-a95e-183b0af708d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.567419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8e390-618f-41bd-a95e-183b0af708d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:44.570077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8e390-618f-41bd-a95e-183b0af708d9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:44.613496 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2178/4398] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:02:44 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:02:44.618069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d847b8-80f8-4cd7-9e62-44c2e520b594 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:44.632721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d847b8-80f8-4cd7-9e62-44c2e520b594 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:44.720442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d01d0-2249-4c4c-86b0-0f2ef2eb070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:44.721614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d01d0-2249-4c4c-86b0-0f2ef2eb070f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.722061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d01d0-2249-4c4c-86b0-0f2ef2eb070f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.722503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d01d0-2249-4c4c-86b0-0f2ef2eb070f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.723968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d01d0-2249-4c4c-86b0-0f2ef2eb070f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:44.726466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568d01d0-2249-4c4c-86b0-0f2ef2eb070f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:44.767713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e390-618f-41bd-a95e-183b0af708d9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:44.767989 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2221/4399] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:02:44 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:02:44.779198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e390-618f-41bd-a95e-183b0af708d9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:44.785761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63022e18-4b8c-4c57-8829-71b3c2441fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:44.787720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63022e18-4b8c-4c57-8829-71b3c2441fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.789952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63022e18-4b8c-4c57-8829-71b3c2441fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.790480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63022e18-4b8c-4c57-8829-71b3c2441fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.792051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63022e18-4b8c-4c57-8829-71b3c2441fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:44.794695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63022e18-4b8c-4c57-8829-71b3c2441fa9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:44.809318 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2179/4400] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:02:44.813081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d01d0-2249-4c4c-86b0-0f2ef2eb070f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:44.825715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d01d0-2249-4c4c-86b0-0f2ef2eb070f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:44.832408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e595c0b-aed9-4742-b001-d88165314546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:44.833082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595c0b-aed9-4742-b001-d88165314546 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.833549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595c0b-aed9-4742-b001-d88165314546 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.833832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595c0b-aed9-4742-b001-d88165314546 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.834562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e595c0b-aed9-4742-b001-d88165314546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:44.836818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e595c0b-aed9-4742-b001-d88165314546 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:44.848882 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2222/4401] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:02:44.853404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63022e18-4b8c-4c57-8829-71b3c2441fa9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:44.878253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63022e18-4b8c-4c57-8829-71b3c2441fa9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:44.893562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182fa7-d7f8-4eca-bb08-9e95dcd89c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:44.894889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182fa7-d7f8-4eca-bb08-9e95dcd89c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.895235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182fa7-d7f8-4eca-bb08-9e95dcd89c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.895522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a182fa7-d7f8-4eca-bb08-9e95dcd89c06 admin admin] PATH_INFO: `/v3/projects/5a748aa42d5c4f55bd7d2d86838ff112/users/321431f1b82447d28c58e7d03fd20515/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.919203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a182fa7-d7f8-4eca-bb08-9e95dcd89c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a748aa42d5c4f55bd7d2d86838ff112, user_id=321431f1b82447d28c58e7d03fd20515, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:44.925726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a182fa7-d7f8-4eca-bb08-9e95dcd89c06 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:44.965004 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2180/4402] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:02:44 2022] PUT /identity/v3/projects/5a748aa42d5c4f55bd7d2d86838ff112/users/321431f1b82447d28c58e7d03fd20515/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:44.970234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792a0ef-0b0c-40ba-8c63-09a07099c4a3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:44.970801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792a0ef-0b0c-40ba-8c63-09a07099c4a3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:44.971352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792a0ef-0b0c-40ba-8c63-09a07099c4a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:44.996177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d792a0ef-0b0c-40ba-8c63-09a07099c4a3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:44.997668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d792a0ef-0b0c-40ba-8c63-09a07099c4a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:45.133179 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2223/4403] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:02:45.156395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182fa7-d7f8-4eca-bb08-9e95dcd89c06 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:45.158544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a182fa7-d7f8-4eca-bb08-9e95dcd89c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:45.244467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a182fa7-d7f8-4eca-bb08-9e95dcd89c06 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:45.250408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde7a9a-f18a-48ec-97e7-f539252068ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:45.251348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde7a9a-f18a-48ec-97e7-f539252068ab service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:45.251853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde7a9a-f18a-48ec-97e7-f539252068ab service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:45.252537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde7a9a-f18a-48ec-97e7-f539252068ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:45.266499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde7a9a-f18a-48ec-97e7-f539252068ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:45.268375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde7a9a-f18a-48ec-97e7-f539252068ab service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:45.284326 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2181/4404] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:02:58.246095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eefb4-b79d-41c1-b290-712e376eca77 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:58.250381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eefb4-b79d-41c1-b290-712e376eca77 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:58.251840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eefb4-b79d-41c1-b290-712e376eca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:58.278899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4f3eefb4-b79d-41c1-b290-712e376eca77 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:58.280617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4f3eefb4-b79d-41c1-b290-712e376eca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:58.383374 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2224/4405] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:02:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:02:58.384340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde7a9a-f18a-48ec-97e7-f539252068ab service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:58.385969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6dde7a9a-f18a-48ec-97e7-f539252068ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:58.538509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde7a9a-f18a-48ec-97e7-f539252068ab service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:58.557042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada087-36c3-4ddc-b2cf-6fea51513bdc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:58.574701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada087-36c3-4ddc-b2cf-6fea51513bdc service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:58.575471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada087-36c3-4ddc-b2cf-6fea51513bdc service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:58.575911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada087-36c3-4ddc-b2cf-6fea51513bdc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:58.614006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada087-36c3-4ddc-b2cf-6fea51513bdc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:58.618104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada087-36c3-4ddc-b2cf-6fea51513bdc service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:58.646881 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2182/4406] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:02:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 21:02:59.535014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eefb4-b79d-41c1-b290-712e376eca77 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:02:59.536476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4f3eefb4-b79d-41c1-b290-712e376eca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:02:59.560449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eefb4-b79d-41c1-b290-712e376eca77 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:02:59.571712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:02:59.573789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:59.575205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:59.575506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] PATH_INFO: `/v3/users/cd954503eb9a46d3b4785c1ae5bfa5c5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:59.586284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd954503eb9a46d3b4785c1ae5bfa5c5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:02:59.591003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:02:59.698192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd954503eb9a46d3b4785c1ae5bfa5c5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:59.716220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd954503eb9a46d3b4785c1ae5bfa5c5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:59.718543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd954503eb9a46d3b4785c1ae5bfa5c5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:59.719182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd954503eb9a46d3b4785c1ae5bfa5c5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:59.738164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd954503eb9a46d3b4785c1ae5bfa5c5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:02:59.779187 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2225/4407] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:02:59 2022] DELETE /identity/v3/users/cd954503eb9a46d3b4785c1ae5bfa5c5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:02:59.785645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69799c8-49de-4810-8aff-4a278e14dc9c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:02:59.786515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69799c8-49de-4810-8aff-4a278e14dc9c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:02:59.786515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69799c8-49de-4810-8aff-4a278e14dc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:02:59.822029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d69799c8-49de-4810-8aff-4a278e14dc9c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:02:59.825443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d69799c8-49de-4810-8aff-4a278e14dc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:00.017662 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2183/4408] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:00.072850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:00.074561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:00.180706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fac8de-cd39-417b-ae04-ac62b6d76557 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:00.185889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53f2ec-ca1d-43c7-921f-832c25acbd6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:00.186895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53f2ec-ca1d-43c7-921f-832c25acbd6e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:00.187360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53f2ec-ca1d-43c7-921f-832c25acbd6e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:00.187794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53f2ec-ca1d-43c7-921f-832c25acbd6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:00.199798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53f2ec-ca1d-43c7-921f-832c25acbd6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:00.203557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53f2ec-ca1d-43c7-921f-832c25acbd6e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:00.243824 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2226/4409] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:01.529561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69799c8-49de-4810-8aff-4a278e14dc9c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:01.532230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d69799c8-49de-4810-8aff-4a278e14dc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:01.555261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69799c8-49de-4810-8aff-4a278e14dc9c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:01.605202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:01.608015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:01.608758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:01.609815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] PATH_INFO: `/v3/projects/071536f2731b462e8a9718f742660e3b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:01.613675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071536f2731b462e8a9718f742660e3b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:01.620647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:01.745084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071536f2731b462e8a9718f742660e3b', 'request_id': 'req-4f2fd3b7-c960-48d3-a73f-d927fe726c60'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:01.767028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071536f2731b462e8a9718f742660e3b', 'request_id': 'req-4f2fd3b7-c960-48d3-a73f-d927fe726c60'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:01.778591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071536f2731b462e8a9718f742660e3b', 'request_id': 'req-4f2fd3b7-c960-48d3-a73f-d927fe726c60'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:01.821155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] The token cache is being invalidate because project 071536f2731b462e8a9718f742660e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:03:01.822456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:01.823794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4f2fd3b7-c960-48d3-a73f-d927fe726c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:01.826905 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2184/4410] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:03:01 2022] DELETE /identity/v3/projects/071536f2731b462e8a9718f742660e3b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:01.832806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096e218-8c97-4a2e-ba4d-139939bd8ab0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:01.833307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096e218-8c97-4a2e-ba4d-139939bd8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:01.833402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096e218-8c97-4a2e-ba4d-139939bd8ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:01.881666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9096e218-8c97-4a2e-ba4d-139939bd8ab0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:01.887746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9096e218-8c97-4a2e-ba4d-139939bd8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:02.090404 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2227/4411] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:03:02.098760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158b75b-cc2f-4417-b292-5d51c364e4bf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:02.099302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158b75b-cc2f-4417-b292-5d51c364e4bf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:02.099764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158b75b-cc2f-4417-b292-5d51c364e4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:02.156901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1158b75b-cc2f-4417-b292-5d51c364e4bf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:02.158218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1158b75b-cc2f-4417-b292-5d51c364e4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:02.179632 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2185/4412] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:03:02.185275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096e218-8c97-4a2e-ba4d-139939bd8ab0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:02.207220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096e218-8c97-4a2e-ba4d-139939bd8ab0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:02.227768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87994d-6e8b-4395-87ac-cff04120e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:02.229745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87994d-6e8b-4395-87ac-cff04120e173 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:02.230245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87994d-6e8b-4395-87ac-cff04120e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:02.230741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc87994d-6e8b-4395-87ac-cff04120e173 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:02.231650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87994d-6e8b-4395-87ac-cff04120e173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:03:02.232206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87994d-6e8b-4395-87ac-cff04120e173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:02.234352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc87994d-6e8b-4395-87ac-cff04120e173 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:02.275064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158b75b-cc2f-4417-b292-5d51c364e4bf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:02.279496 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2228/4413] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:03:02.288829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158b75b-cc2f-4417-b292-5d51c364e4bf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:02.305634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5ae14-9f43-48c4-8f83-981d3b0014ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:02.307998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ae14-9f43-48c4-8f83-981d3b0014ae admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:02.308581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ae14-9f43-48c4-8f83-981d3b0014ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:02.309697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5ae14-9f43-48c4-8f83-981d3b0014ae admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:02.311380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5ae14-9f43-48c4-8f83-981d3b0014ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:02.317553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5ae14-9f43-48c4-8f83-981d3b0014ae admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:02.379177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87994d-6e8b-4395-87ac-cff04120e173 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:02.387408 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2186/4414] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:03:02 2022] POST /identity/v3/projects => generated 359 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:03:02.391893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc87994d-6e8b-4395-87ac-cff04120e173 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:02.504090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76c9cc-bf7e-47e5-a0a6-3781c8ecd5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:02.505200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76c9cc-bf7e-47e5-a0a6-3781c8ecd5eb admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:02.507611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76c9cc-bf7e-47e5-a0a6-3781c8ecd5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:02.507818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e76c9cc-bf7e-47e5-a0a6-3781c8ecd5eb admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:02.511842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76c9cc-bf7e-47e5-a0a6-3781c8ecd5eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:02.512440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e76c9cc-bf7e-47e5-a0a6-3781c8ecd5eb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:02.542218 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2229/4415] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:03:02 2022] POST /identity/v3/users => generated 280 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:03:02.544682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5ae14-9f43-48c4-8f83-981d3b0014ae admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:02.560448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5ae14-9f43-48c4-8f83-981d3b0014ae admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:02.569422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606664f-74ec-4299-87eb-0586183f1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:02.570298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606664f-74ec-4299-87eb-0586183f1503 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:02.571037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606664f-74ec-4299-87eb-0586183f1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:02.571464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606664f-74ec-4299-87eb-0586183f1503 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:02.572380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606664f-74ec-4299-87eb-0586183f1503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:02.574589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606664f-74ec-4299-87eb-0586183f1503 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:02.594784 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2187/4416] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:03:02.595674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76c9cc-bf7e-47e5-a0a6-3781c8ecd5eb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:02.609771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e76c9cc-bf7e-47e5-a0a6-3781c8ecd5eb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:02.615535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c901482-dcda-4b51-84c0-daf4edbf38f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:02.616596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901482-dcda-4b51-84c0-daf4edbf38f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:02.617151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901482-dcda-4b51-84c0-daf4edbf38f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:02.617535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c901482-dcda-4b51-84c0-daf4edbf38f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:02.618371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c901482-dcda-4b51-84c0-daf4edbf38f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:02.622486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c901482-dcda-4b51-84c0-daf4edbf38f0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:02.658579 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2230/4417] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:03:02.662797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606664f-74ec-4299-87eb-0586183f1503 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:02.683496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606664f-74ec-4299-87eb-0586183f1503 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:02.701206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250600fe-9406-434a-8509-0e32677f7353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:02.705203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250600fe-9406-434a-8509-0e32677f7353 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:02.705935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250600fe-9406-434a-8509-0e32677f7353 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:02.708002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250600fe-9406-434a-8509-0e32677f7353 admin admin] PATH_INFO: `/v3/projects/39746f58ba5b42c09ee5e6277a7afcd7/users/a7388f025bee4ee1a5f9dfe1b536b728/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:02.747282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250600fe-9406-434a-8509-0e32677f7353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39746f58ba5b42c09ee5e6277a7afcd7, user_id=a7388f025bee4ee1a5f9dfe1b536b728, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:02.753125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250600fe-9406-434a-8509-0e32677f7353 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:02.790659 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2188/4418] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:03:02 2022] PUT /identity/v3/projects/39746f58ba5b42c09ee5e6277a7afcd7/users/a7388f025bee4ee1a5f9dfe1b536b728/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:02.792550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4b5c-0186-4f98-9253-83add703e327 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:02.792859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4b5c-0186-4f98-9253-83add703e327 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:02.793305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e4b5c-0186-4f98-9253-83add703e327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:02.841157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-340e4b5c-0186-4f98-9253-83add703e327 None None] MFA Rules not processed for user `a7388f025bee4ee1a5f9dfe1b536b728`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:02.844416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-340e4b5c-0186-4f98-9253-83add703e327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:02.935817 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2231/4419] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:02 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:02.942511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250600fe-9406-434a-8509-0e32677f7353 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:02.944489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-250600fe-9406-434a-8509-0e32677f7353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:03.055903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250600fe-9406-434a-8509-0e32677f7353 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:03.060669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59451af8-af15-4dc9-9f00-c9fd4ac2ca98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:03.062074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59451af8-af15-4dc9-9f00-c9fd4ac2ca98 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:03.062659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59451af8-af15-4dc9-9f00-c9fd4ac2ca98 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:03.063429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59451af8-af15-4dc9-9f00-c9fd4ac2ca98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:03.120559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59451af8-af15-4dc9-9f00-c9fd4ac2ca98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:03.124626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59451af8-af15-4dc9-9f00-c9fd4ac2ca98 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:03.147900 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2189/4420] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:02 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:06.675955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4b5c-0186-4f98-9253-83add703e327 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:06.677404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-340e4b5c-0186-4f98-9253-83add703e327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:06.812120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e4b5c-0186-4f98-9253-83add703e327 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:06.821614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:06.822662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:06.823154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:06.824208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] PATH_INFO: `/v3/users/3cb495ec547743d38a7502110a166b1a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:06.825973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb495ec547743d38a7502110a166b1a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:06.828193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:06.927378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb495ec547743d38a7502110a166b1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:06.946567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb495ec547743d38a7502110a166b1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:06.947316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb495ec547743d38a7502110a166b1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:06.948022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb495ec547743d38a7502110a166b1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:06.960351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-680fb81f-f26d-4bf8-9095-4c99d85e9c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb495ec547743d38a7502110a166b1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:06.987780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2232/4421] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:03:06 2022] DELETE /identity/v3/users/3cb495ec547743d38a7502110a166b1a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:08.276408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59451af8-af15-4dc9-9f00-c9fd4ac2ca98 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:08.299559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59451af8-af15-4dc9-9f00-c9fd4ac2ca98 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:08.497953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:08.498975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:08.499546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:08.499833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] PATH_INFO: `/v3/projects/dff0b12b0e8843e99f5aac63876e13fb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:08.501292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff0b12b0e8843e99f5aac63876e13fb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:08.504707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:08.600071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff0b12b0e8843e99f5aac63876e13fb', 'request_id': 'req-8bf5f1a6-3668-491d-a5d3-225f55679397'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:08.620292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff0b12b0e8843e99f5aac63876e13fb', 'request_id': 'req-8bf5f1a6-3668-491d-a5d3-225f55679397'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:08.633601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff0b12b0e8843e99f5aac63876e13fb', 'request_id': 'req-8bf5f1a6-3668-491d-a5d3-225f55679397'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:08.648278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] The token cache is being invalidate because project dff0b12b0e8843e99f5aac63876e13fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:03:08.648724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:08.649412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bf5f1a6-3668-491d-a5d3-225f55679397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:08.651267 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2190/4422] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:03:08 2022] DELETE /identity/v3/projects/dff0b12b0e8843e99f5aac63876e13fb => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:08.657143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21449f-8496-4595-85f4-b4407f14a9cc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:08.657648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21449f-8496-4595-85f4-b4407f14a9cc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:08.657738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21449f-8496-4595-85f4-b4407f14a9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:08.695231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3d21449f-8496-4595-85f4-b4407f14a9cc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:08.696730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3d21449f-8496-4595-85f4-b4407f14a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:08.829186 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2233/4423] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:08.830795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e64f83-0c75-4824-a07f-51bafdbe5bf0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:08.831217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e64f83-0c75-4824-a07f-51bafdbe5bf0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:08.831707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e64f83-0c75-4824-a07f-51bafdbe5bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:08.885088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-31e64f83-0c75-4824-a07f-51bafdbe5bf0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:08.886534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-31e64f83-0c75-4824-a07f-51bafdbe5bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:08.904437 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2191/4424] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:08.905813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21449f-8496-4595-85f4-b4407f14a9cc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:08.925562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21449f-8496-4595-85f4-b4407f14a9cc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:08.940487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa029fc-34b1-4164-938d-d85538e80478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:08.941493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa029fc-34b1-4164-938d-d85538e80478 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:08.941881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa029fc-34b1-4164-938d-d85538e80478 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:08.942434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa029fc-34b1-4164-938d-d85538e80478 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:08.943430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa029fc-34b1-4164-938d-d85538e80478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:03:08.944567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa029fc-34b1-4164-938d-d85538e80478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:08.946963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa029fc-34b1-4164-938d-d85538e80478 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:08.967798 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2234/4425] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:03:08.972905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e64f83-0c75-4824-a07f-51bafdbe5bf0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:08.984585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e64f83-0c75-4824-a07f-51bafdbe5bf0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:08.996810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aad9db-4134-409a-8654-780366930e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:08.997328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aad9db-4134-409a-8654-780366930e54 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:08.997624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aad9db-4134-409a-8654-780366930e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:08.997972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aad9db-4134-409a-8654-780366930e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:08.999586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aad9db-4134-409a-8654-780366930e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:09.001547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aad9db-4134-409a-8654-780366930e54 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:09.064233 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2192/4426] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:03:08 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:03:09.065830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa029fc-34b1-4164-938d-d85538e80478 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:09.104221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa029fc-34b1-4164-938d-d85538e80478 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:09.329168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508880a7-30d2-44f5-8e4b-4e15598806cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:09.348470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508880a7-30d2-44f5-8e4b-4e15598806cb admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:09.351313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508880a7-30d2-44f5-8e4b-4e15598806cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:09.351786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508880a7-30d2-44f5-8e4b-4e15598806cb admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:09.354289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508880a7-30d2-44f5-8e4b-4e15598806cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:09.365186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508880a7-30d2-44f5-8e4b-4e15598806cb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:09.434865 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2235/4427] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:03:09 2022] POST /identity/v3/users => generated 288 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:03:09.442023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aad9db-4134-409a-8654-780366930e54 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:09.456521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aad9db-4134-409a-8654-780366930e54 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:09.465392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ce976-5477-4e36-a8dc-8cafdb492155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:09.466811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ce976-5477-4e36-a8dc-8cafdb492155 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:09.467481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ce976-5477-4e36-a8dc-8cafdb492155 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:09.469362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ce976-5477-4e36-a8dc-8cafdb492155 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:09.470269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ce976-5477-4e36-a8dc-8cafdb492155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:09.472955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ce976-5477-4e36-a8dc-8cafdb492155 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:09.499586 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2193/4428] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:03:09.502587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508880a7-30d2-44f5-8e4b-4e15598806cb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:09.517665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508880a7-30d2-44f5-8e4b-4e15598806cb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:09.536351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baff4d6-ad79-43d1-9be0-ab1d12122ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:09.537174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baff4d6-ad79-43d1-9be0-ab1d12122ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:09.537459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baff4d6-ad79-43d1-9be0-ab1d12122ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:09.537747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baff4d6-ad79-43d1-9be0-ab1d12122ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:09.538484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baff4d6-ad79-43d1-9be0-ab1d12122ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:09.540163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baff4d6-ad79-43d1-9be0-ab1d12122ad2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:09.574168 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2236/4429] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:03:09.578800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ce976-5477-4e36-a8dc-8cafdb492155 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:09.610708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ce976-5477-4e36-a8dc-8cafdb492155 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:09.622719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245b429-541a-48a1-8865-a020776fed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:09.624741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245b429-541a-48a1-8865-a020776fed2d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:09.625128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245b429-541a-48a1-8865-a020776fed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:09.627159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245b429-541a-48a1-8865-a020776fed2d admin admin] PATH_INFO: `/v3/projects/32df8b04107445c89edb0d809d87d6fc/users/8cab4cf432764bb487de9abc0f283898/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:09.664633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245b429-541a-48a1-8865-a020776fed2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32df8b04107445c89edb0d809d87d6fc, user_id=8cab4cf432764bb487de9abc0f283898, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:09.668247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245b429-541a-48a1-8865-a020776fed2d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:09.703834 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2194/4430] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:03:09 2022] PUT /identity/v3/projects/32df8b04107445c89edb0d809d87d6fc/users/8cab4cf432764bb487de9abc0f283898/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:09.705338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6235b-80c3-474d-bc56-1a5704a089eb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:09.705805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6235b-80c3-474d-bc56-1a5704a089eb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:09.705913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc6235b-80c3-474d-bc56-1a5704a089eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:09.747323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4dc6235b-80c3-474d-bc56-1a5704a089eb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:09.753540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4dc6235b-80c3-474d-bc56-1a5704a089eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:09.876389 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2237/4431] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:03:09.888514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245b429-541a-48a1-8865-a020776fed2d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:09.890768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4245b429-541a-48a1-8865-a020776fed2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:10.019559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245b429-541a-48a1-8865-a020776fed2d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:10.023526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1152aa-6007-40bc-a40d-5fcaed52d8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:10.024285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1152aa-6007-40bc-a40d-5fcaed52d8dc service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:10.024632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1152aa-6007-40bc-a40d-5fcaed52d8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:10.025027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1152aa-6007-40bc-a40d-5fcaed52d8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:10.035167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1152aa-6007-40bc-a40d-5fcaed52d8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:10.036942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1152aa-6007-40bc-a40d-5fcaed52d8dc service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:10.060102 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2195/4432] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:10.631496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967cbc5-bcd9-47d3-bfbf-796cdc7fef1b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:10.632067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967cbc5-bcd9-47d3-bfbf-796cdc7fef1b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:10.632591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967cbc5-bcd9-47d3-bfbf-796cdc7fef1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:10.683582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c967cbc5-bcd9-47d3-bfbf-796cdc7fef1b None None] MFA Rules not processed for user `321431f1b82447d28c58e7d03fd20515`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:10.686213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c967cbc5-bcd9-47d3-bfbf-796cdc7fef1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:10.859414 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2238/4433] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:11.681185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1152aa-6007-40bc-a40d-5fcaed52d8dc service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:11.683270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d1152aa-6007-40bc-a40d-5fcaed52d8dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:11.906618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1152aa-6007-40bc-a40d-5fcaed52d8dc service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:11.921270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cc2cc-f329-46b1-94a8-7a7c13f7eb99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:11.924820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cc2cc-f329-46b1-94a8-7a7c13f7eb99 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:11.925211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cc2cc-f329-46b1-94a8-7a7c13f7eb99 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:11.926220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cc2cc-f329-46b1-94a8-7a7c13f7eb99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:11.964919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cc2cc-f329-46b1-94a8-7a7c13f7eb99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:11.966567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cc2cc-f329-46b1-94a8-7a7c13f7eb99 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:12.056500 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2196/4434] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:18.462569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9e931-78fa-4688-9343-478cc4c1ff15 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:18.463117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9e931-78fa-4688-9343-478cc4c1ff15 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:18.463117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9e931-78fa-4688-9343-478cc4c1ff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:18.502251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-66c9e931-78fa-4688-9343-478cc4c1ff15 None None] MFA Rules not processed for user `321431f1b82447d28c58e7d03fd20515`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:18.503477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-66c9e931-78fa-4688-9343-478cc4c1ff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:18.518717 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2239/4435] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:22.899952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cc2cc-f329-46b1-94a8-7a7c13f7eb99 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:22.901962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6a7cc2cc-f329-46b1-94a8-7a7c13f7eb99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:22.940028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cc2cc-f329-46b1-94a8-7a7c13f7eb99 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:22.947616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:22.948822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:22.949315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:22.950168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] PATH_INFO: `/v3/users/fdd16c1bdb3d416d8421202397566d1c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:22.953621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd16c1bdb3d416d8421202397566d1c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:22.957702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:23.082656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd16c1bdb3d416d8421202397566d1c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:23.095078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd16c1bdb3d416d8421202397566d1c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:23.096527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd16c1bdb3d416d8421202397566d1c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:23.098877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd16c1bdb3d416d8421202397566d1c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:23.137606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3320ffa3-cb70-4b09-b181-895d099e77b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd16c1bdb3d416d8421202397566d1c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:23.179537 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2197/4436] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:03:22 2022] DELETE /identity/v3/users/fdd16c1bdb3d416d8421202397566d1c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:24.400321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9e931-78fa-4688-9343-478cc4c1ff15 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:24.411682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9e931-78fa-4688-9343-478cc4c1ff15 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:24.498614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:24.499532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:24.499788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:24.500107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] PATH_INFO: `/v3/projects/496f2be9357e414ca8db7bf1f5ed0234` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:24.518284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496f2be9357e414ca8db7bf1f5ed0234)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:24.522461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:24.589491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496f2be9357e414ca8db7bf1f5ed0234', 'request_id': 'req-7aaf3b85-8cde-409f-8698-80e110be1a16'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:24.601672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496f2be9357e414ca8db7bf1f5ed0234', 'request_id': 'req-7aaf3b85-8cde-409f-8698-80e110be1a16'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:24.609475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496f2be9357e414ca8db7bf1f5ed0234', 'request_id': 'req-7aaf3b85-8cde-409f-8698-80e110be1a16'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:24.628098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] The token cache is being invalidate because project 496f2be9357e414ca8db7bf1f5ed0234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:03:24.628521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:24.629796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7aaf3b85-8cde-409f-8698-80e110be1a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:24.631675 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2240/4437] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:03:24 2022] DELETE /identity/v3/projects/496f2be9357e414ca8db7bf1f5ed0234 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:24.637067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867caa5-e1ce-443b-8972-74138cb61271 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:24.638167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867caa5-e1ce-443b-8972-74138cb61271 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:24.638473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d867caa5-e1ce-443b-8972-74138cb61271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:24.662771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d867caa5-e1ce-443b-8972-74138cb61271 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:24.664791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d867caa5-e1ce-443b-8972-74138cb61271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:24.772103 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2198/4438] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:24.773793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a153278-3050-44a1-9519-8b583d1f8be3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:24.774084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a153278-3050-44a1-9519-8b583d1f8be3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:24.774369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a153278-3050-44a1-9519-8b583d1f8be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:24.802823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2a153278-3050-44a1-9519-8b583d1f8be3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:24.805850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2a153278-3050-44a1-9519-8b583d1f8be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:24.823692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867caa5-e1ce-443b-8972-74138cb61271 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:24.824173 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2241/4439] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:24.839186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d867caa5-e1ce-443b-8972-74138cb61271 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:24.845408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4811a-4f7f-41ef-8e30-4c2f9ecc7fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:24.846082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4811a-4f7f-41ef-8e30-4c2f9ecc7fed admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:24.846537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4811a-4f7f-41ef-8e30-4c2f9ecc7fed admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:24.846973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4811a-4f7f-41ef-8e30-4c2f9ecc7fed admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:24.847854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4811a-4f7f-41ef-8e30-4c2f9ecc7fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:03:24.848363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4811a-4f7f-41ef-8e30-4c2f9ecc7fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:24.850168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec4811a-4f7f-41ef-8e30-4c2f9ecc7fed admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:24.864982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2199/4440] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:03:24.869890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a153278-3050-44a1-9519-8b583d1f8be3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:24.882868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a153278-3050-44a1-9519-8b583d1f8be3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:24.901133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912876-49af-4332-a6bd-79b7aea5533a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:24.902285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912876-49af-4332-a6bd-79b7aea5533a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:24.902958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912876-49af-4332-a6bd-79b7aea5533a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:24.903404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912876-49af-4332-a6bd-79b7aea5533a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:24.904360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e912876-49af-4332-a6bd-79b7aea5533a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:24.906959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e912876-49af-4332-a6bd-79b7aea5533a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:24.958046 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2242/4441] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:03:24 2022] POST /identity/v3/projects => generated 397 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:03:24.958276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4811a-4f7f-41ef-8e30-4c2f9ecc7fed admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:24.973653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4811a-4f7f-41ef-8e30-4c2f9ecc7fed admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:25.098757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a2f50-e2c0-4dea-9f00-b5b3793696b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:25.099885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a2f50-e2c0-4dea-9f00-b5b3793696b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:25.101118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a2f50-e2c0-4dea-9f00-b5b3793696b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:25.101118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a2f50-e2c0-4dea-9f00-b5b3793696b3 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:25.101350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a2f50-e2c0-4dea-9f00-b5b3793696b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:25.104971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a2f50-e2c0-4dea-9f00-b5b3793696b3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:25.143368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912876-49af-4332-a6bd-79b7aea5533a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:25.156508 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2200/4442] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:03:24 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:03:25.160914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912876-49af-4332-a6bd-79b7aea5533a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:25.169229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dae75-6b78-467c-b696-7688d92f5bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:25.171187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dae75-6b78-467c-b696-7688d92f5bae admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:25.172646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dae75-6b78-467c-b696-7688d92f5bae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:25.173087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dae75-6b78-467c-b696-7688d92f5bae admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:25.174268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dae75-6b78-467c-b696-7688d92f5bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:25.176655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dae75-6b78-467c-b696-7688d92f5bae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:25.198681 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2243/4443] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:03:25.204461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a2f50-e2c0-4dea-9f00-b5b3793696b3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:25.219570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a2f50-e2c0-4dea-9f00-b5b3793696b3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:25.227866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9830d-87ba-4bbf-af8d-75e45555dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:25.229232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9830d-87ba-4bbf-af8d-75e45555dc57 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:25.229704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9830d-87ba-4bbf-af8d-75e45555dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:25.230146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9830d-87ba-4bbf-af8d-75e45555dc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:25.231289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9830d-87ba-4bbf-af8d-75e45555dc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:25.236890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9830d-87ba-4bbf-af8d-75e45555dc57 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:25.265953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dae75-6b78-467c-b696-7688d92f5bae admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:25.266159 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2201/4444] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:03:25.284624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dae75-6b78-467c-b696-7688d92f5bae admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:25.296670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db58548-3667-4f90-9ed5-b7fe06311404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:25.298529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db58548-3667-4f90-9ed5-b7fe06311404 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:25.299083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db58548-3667-4f90-9ed5-b7fe06311404 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:25.299580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db58548-3667-4f90-9ed5-b7fe06311404 admin admin] PATH_INFO: `/v3/projects/3652534f0b48491f895462536365ef07/users/cbbebd48cec04499a06386f886c8f99c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:25.328563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db58548-3667-4f90-9ed5-b7fe06311404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3652534f0b48491f895462536365ef07, user_id=cbbebd48cec04499a06386f886c8f99c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:25.331773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db58548-3667-4f90-9ed5-b7fe06311404 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:25.356705 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2244/4445] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:03:25 2022] PUT /identity/v3/projects/3652534f0b48491f895462536365ef07/users/cbbebd48cec04499a06386f886c8f99c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:25.363620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb187e1-9f42-446b-befd-7b0f051ef858 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:25.364827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb187e1-9f42-446b-befd-7b0f051ef858 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:25.365315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb187e1-9f42-446b-befd-7b0f051ef858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:25.389897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2fb187e1-9f42-446b-befd-7b0f051ef858 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:25.391543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2fb187e1-9f42-446b-befd-7b0f051ef858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:25.477969 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2202/4446] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:25.504316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db58548-3667-4f90-9ed5-b7fe06311404 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:25.511341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9db58548-3667-4f90-9ed5-b7fe06311404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:25.637461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db58548-3667-4f90-9ed5-b7fe06311404 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:25.646765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18dcf-b3b9-437c-8bfd-eb539d7ce887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:25.647640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18dcf-b3b9-437c-8bfd-eb539d7ce887 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:25.647950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18dcf-b3b9-437c-8bfd-eb539d7ce887 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:25.648253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee18dcf-b3b9-437c-8bfd-eb539d7ce887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:25.684607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee18dcf-b3b9-437c-8bfd-eb539d7ce887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:25.687800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee18dcf-b3b9-437c-8bfd-eb539d7ce887 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:25.706024 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2245/4447] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:25.880989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d030b5-0453-41f6-83a0-8e97c4979f13 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:25.881490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d030b5-0453-41f6-83a0-8e97c4979f13 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:25.881577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d030b5-0453-41f6-83a0-8e97c4979f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:25.937212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-49d030b5-0453-41f6-83a0-8e97c4979f13 None None] MFA Rules not processed for user `8cab4cf432764bb487de9abc0f283898`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:25.939047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49d030b5-0453-41f6-83a0-8e97c4979f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:26.097094 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2203/4448] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:26.103755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18dcf-b3b9-437c-8bfd-eb539d7ce887 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:26.105193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9ee18dcf-b3b9-437c-8bfd-eb539d7ce887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:26.222196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee18dcf-b3b9-437c-8bfd-eb539d7ce887 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:26.230572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f80006-da70-452f-9d55-10ab7118d38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:26.231758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f80006-da70-452f-9d55-10ab7118d38d service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:26.232191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f80006-da70-452f-9d55-10ab7118d38d service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:26.232524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f80006-da70-452f-9d55-10ab7118d38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:26.261841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f80006-da70-452f-9d55-10ab7118d38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:26.266076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f80006-da70-452f-9d55-10ab7118d38d service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:26.296490 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2246/4449] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:28.291294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc86b6-e5b1-48f4-aef4-f5994baf5de4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:28.292798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc86b6-e5b1-48f4-aef4-f5994baf5de4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:28.293436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc86b6-e5b1-48f4-aef4-f5994baf5de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:28.345685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-20bc86b6-e5b1-48f4-aef4-f5994baf5de4 None None] MFA Rules not processed for user `cbbebd48cec04499a06386f886c8f99c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:28.350957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-20bc86b6-e5b1-48f4-aef4-f5994baf5de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:28.520525 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2204/4450] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:28.527863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ad6e0-f336-4a18-b0c6-e999f5c1e220 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:28.528971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ad6e0-f336-4a18-b0c6-e999f5c1e220 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:28.530023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ad6e0-f336-4a18-b0c6-e999f5c1e220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:28.565981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-545ad6e0-f336-4a18-b0c6-e999f5c1e220 None None] MFA Rules not processed for user `cbbebd48cec04499a06386f886c8f99c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:28.570601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-545ad6e0-f336-4a18-b0c6-e999f5c1e220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:28.608418 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2247/4451] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:28.924737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc86b6-e5b1-48f4-aef4-f5994baf5de4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:28.955464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc86b6-e5b1-48f4-aef4-f5994baf5de4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:28.962806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f110b-a003-4947-bcce-e2ff82d2e634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:28.963833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f110b-a003-4947-bcce-e2ff82d2e634 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:28.964320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f110b-a003-4947-bcce-e2ff82d2e634 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:28.964749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f110b-a003-4947-bcce-e2ff82d2e634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:28.979740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f110b-a003-4947-bcce-e2ff82d2e634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:28.982438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f110b-a003-4947-bcce-e2ff82d2e634 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:28.997422 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2205/4452] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:33.793906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f25c6-f346-4556-8398-777d304a85a7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:33.795328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f25c6-f346-4556-8398-777d304a85a7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:33.795783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f25c6-f346-4556-8398-777d304a85a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:33.825324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4b7f25c6-f346-4556-8398-777d304a85a7 None None] MFA Rules not processed for user `8cab4cf432764bb487de9abc0f283898`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:33.827958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4b7f25c6-f346-4556-8398-777d304a85a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:33.843190 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2248/4453] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:38.654813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f110b-a003-4947-bcce-e2ff82d2e634 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:38.656471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a1f110b-a003-4947-bcce-e2ff82d2e634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:38.671584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f110b-a003-4947-bcce-e2ff82d2e634 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:38.678784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:38.680013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:38.680239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:38.680510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] PATH_INFO: `/v3/users/a7388f025bee4ee1a5f9dfe1b536b728` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:38.682173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7388f025bee4ee1a5f9dfe1b536b728)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:38.684311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:38.776897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7388f025bee4ee1a5f9dfe1b536b728'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:38.786395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7388f025bee4ee1a5f9dfe1b536b728'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:38.787368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7388f025bee4ee1a5f9dfe1b536b728'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:38.787992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7388f025bee4ee1a5f9dfe1b536b728'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:38.808118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7388f025bee4ee1a5f9dfe1b536b728'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:38.834373 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2206/4454] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:03:38 2022] DELETE /identity/v3/users/a7388f025bee4ee1a5f9dfe1b536b728 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:38.835718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9dd5b-673c-47a4-9512-b2eddc0b041f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:38.836594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9dd5b-673c-47a4-9512-b2eddc0b041f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:38.837151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9dd5b-673c-47a4-9512-b2eddc0b041f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:38.861111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2ae9dd5b-673c-47a4-9512-b2eddc0b041f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:38.862742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2ae9dd5b-673c-47a4-9512-b2eddc0b041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:38.954607 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2249/4455] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:38.974987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:38.977708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:39.066357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5bac0-e96f-46a8-9cd3-6d4c1c2eb22f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:39.072235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b125cc-ea50-4255-845c-0bd74e697a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:39.072905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b125cc-ea50-4255-845c-0bd74e697a00 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:39.073189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b125cc-ea50-4255-845c-0bd74e697a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:39.073470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b125cc-ea50-4255-845c-0bd74e697a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:39.094187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b125cc-ea50-4255-845c-0bd74e697a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:39.094767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b125cc-ea50-4255-845c-0bd74e697a00 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:39.112463 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2207/4456] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:39.719491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9dd5b-673c-47a4-9512-b2eddc0b041f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:39.721018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2ae9dd5b-673c-47a4-9512-b2eddc0b041f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:39.738607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9dd5b-673c-47a4-9512-b2eddc0b041f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:39.750795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:39.751854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:39.752336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:39.753015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] PATH_INFO: `/v3/projects/39746f58ba5b42c09ee5e6277a7afcd7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:39.756848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39746f58ba5b42c09ee5e6277a7afcd7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:39.759002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:39.824103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39746f58ba5b42c09ee5e6277a7afcd7', 'request_id': 'req-7acb8144-b287-46c1-a360-a9d7274bd244'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:39.839902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39746f58ba5b42c09ee5e6277a7afcd7', 'request_id': 'req-7acb8144-b287-46c1-a360-a9d7274bd244'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:39.851175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39746f58ba5b42c09ee5e6277a7afcd7', 'request_id': 'req-7acb8144-b287-46c1-a360-a9d7274bd244'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:39.870781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] The token cache is being invalidate because project 39746f58ba5b42c09ee5e6277a7afcd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:03:39.871686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:39.880105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7acb8144-b287-46c1-a360-a9d7274bd244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:39.883062 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2250/4457] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:03:39 2022] DELETE /identity/v3/projects/39746f58ba5b42c09ee5e6277a7afcd7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:39.887663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fbf13-d987-4ff4-960d-407c923a17b0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:39.888193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fbf13-d987-4ff4-960d-407c923a17b0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:39.888848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fbf13-d987-4ff4-960d-407c923a17b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:39.910678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-266fbf13-d987-4ff4-960d-407c923a17b0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:39.912607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-266fbf13-d987-4ff4-960d-407c923a17b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:40.016035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2208/4458] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:03:40.028752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e72a8-fd75-4575-bae6-36ffde27e51f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:40.030381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e72a8-fd75-4575-bae6-36ffde27e51f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:40.030710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e72a8-fd75-4575-bae6-36ffde27e51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:40.084653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b00e72a8-fd75-4575-bae6-36ffde27e51f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:40.088159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b00e72a8-fd75-4575-bae6-36ffde27e51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:40.120872 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2251/4459] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:40.121097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fbf13-d987-4ff4-960d-407c923a17b0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:40.140878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fbf13-d987-4ff4-960d-407c923a17b0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:40.193571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181c37d-aafc-49c6-a5b1-156e3b76bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:40.195695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181c37d-aafc-49c6-a5b1-156e3b76bb98 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:40.200339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181c37d-aafc-49c6-a5b1-156e3b76bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:40.200722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181c37d-aafc-49c6-a5b1-156e3b76bb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:40.206004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181c37d-aafc-49c6-a5b1-156e3b76bb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:03:40.206957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181c37d-aafc-49c6-a5b1-156e3b76bb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:40.210438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9181c37d-aafc-49c6-a5b1-156e3b76bb98 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:40.229027 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2209/4460] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:03:40.230089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e72a8-fd75-4575-bae6-36ffde27e51f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:40.246489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e72a8-fd75-4575-bae6-36ffde27e51f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:40.264504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d7fa2-30b7-49c8-9023-354ead69a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:40.265354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d7fa2-30b7-49c8-9023-354ead69a00e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:40.265648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d7fa2-30b7-49c8-9023-354ead69a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:40.265928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d7fa2-30b7-49c8-9023-354ead69a00e admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:40.266632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d7fa2-30b7-49c8-9023-354ead69a00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:40.269233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d7fa2-30b7-49c8-9023-354ead69a00e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:40.338622 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2252/4461] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:03:40 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:03:40.344120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181c37d-aafc-49c6-a5b1-156e3b76bb98 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:40.356611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181c37d-aafc-49c6-a5b1-156e3b76bb98 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:40.531716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc76dde-b4b6-43ff-b294-ae90a4ece85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:40.532514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc76dde-b4b6-43ff-b294-ae90a4ece85a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:40.532876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc76dde-b4b6-43ff-b294-ae90a4ece85a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:40.539217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc76dde-b4b6-43ff-b294-ae90a4ece85a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:40.540482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc76dde-b4b6-43ff-b294-ae90a4ece85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:40.543578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc76dde-b4b6-43ff-b294-ae90a4ece85a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:40.615945 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2210/4462] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:03:40 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:03:40.617192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d7fa2-30b7-49c8-9023-354ead69a00e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:40.633542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d7fa2-30b7-49c8-9023-354ead69a00e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:40.641632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09f27f-4489-4295-b6f2-b73d493768ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:40.642648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09f27f-4489-4295-b6f2-b73d493768ee admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:40.643184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09f27f-4489-4295-b6f2-b73d493768ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:40.643767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09f27f-4489-4295-b6f2-b73d493768ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:40.645035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09f27f-4489-4295-b6f2-b73d493768ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:40.647237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09f27f-4489-4295-b6f2-b73d493768ee admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:40.681187 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2253/4463] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:03:40.685979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc76dde-b4b6-43ff-b294-ae90a4ece85a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:40.705301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc76dde-b4b6-43ff-b294-ae90a4ece85a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:40.712138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0937c6b-8a21-44f5-9686-84321a09d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:40.712912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0937c6b-8a21-44f5-9686-84321a09d6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:40.713198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0937c6b-8a21-44f5-9686-84321a09d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:40.713507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0937c6b-8a21-44f5-9686-84321a09d6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:40.715125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0937c6b-8a21-44f5-9686-84321a09d6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:40.717363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0937c6b-8a21-44f5-9686-84321a09d6b1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:40.743118 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2211/4464] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:03:40.746919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09f27f-4489-4295-b6f2-b73d493768ee admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:40.759031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09f27f-4489-4295-b6f2-b73d493768ee admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:40.781414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf94d44-c17b-4c81-93f2-0e66bef21ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:40.782325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf94d44-c17b-4c81-93f2-0e66bef21ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:40.782612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf94d44-c17b-4c81-93f2-0e66bef21ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:40.783045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf94d44-c17b-4c81-93f2-0e66bef21ae8 admin admin] PATH_INFO: `/v3/projects/f5da41e8b4b24be9b347f18359729bc6/users/f8af8e3b75a445a5841739eec4de83f5/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:40.847478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf94d44-c17b-4c81-93f2-0e66bef21ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5da41e8b4b24be9b347f18359729bc6, user_id=f8af8e3b75a445a5841739eec4de83f5, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:40.852004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf94d44-c17b-4c81-93f2-0e66bef21ae8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:40.895792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2254/4465] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:03:40 2022] PUT /identity/v3/projects/f5da41e8b4b24be9b347f18359729bc6/users/f8af8e3b75a445a5841739eec4de83f5/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:40.898873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819cf1e-49ea-41f1-9033-936acbc0cd38 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:40.899344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819cf1e-49ea-41f1-9033-936acbc0cd38 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:40.902300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819cf1e-49ea-41f1-9033-936acbc0cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:40.937991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7819cf1e-49ea-41f1-9033-936acbc0cd38 None None] MFA Rules not processed for user `f8af8e3b75a445a5841739eec4de83f5`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:40.939617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7819cf1e-49ea-41f1-9033-936acbc0cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:41.077281 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2212/4466] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:41.109308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf94d44-c17b-4c81-93f2-0e66bef21ae8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:41.110943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4bf94d44-c17b-4c81-93f2-0e66bef21ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:41.233703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf94d44-c17b-4c81-93f2-0e66bef21ae8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:41.262324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc881220-9faa-4edb-bb75-93fb05369c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:41.268166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc881220-9faa-4edb-bb75-93fb05369c36 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:41.268660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc881220-9faa-4edb-bb75-93fb05369c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:41.268946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc881220-9faa-4edb-bb75-93fb05369c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:41.287256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc881220-9faa-4edb-bb75-93fb05369c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:41.290082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc881220-9faa-4edb-bb75-93fb05369c36 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:41.313356 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2255/4467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:41.473600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819cf1e-49ea-41f1-9033-936acbc0cd38 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:41.546062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819cf1e-49ea-41f1-9033-936acbc0cd38 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:41.554492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:41.555562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:41.556027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:41.556482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] PATH_INFO: `/v3/users/f8af8e3b75a445a5841739eec4de83f5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:41.559690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8af8e3b75a445a5841739eec4de83f5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:41.561925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:41.641253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8af8e3b75a445a5841739eec4de83f5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:41.658483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8af8e3b75a445a5841739eec4de83f5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:41.659313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8af8e3b75a445a5841739eec4de83f5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:41.660120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8af8e3b75a445a5841739eec4de83f5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:41.678812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8af8e3b75a445a5841739eec4de83f5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:41.705313 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2213/4468] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:03:41 2022] DELETE /identity/v3/users/f8af8e3b75a445a5841739eec4de83f5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:41.705785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f7c4-0477-4249-b747-e72a17cb5943 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:41.706831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f7c4-0477-4249-b747-e72a17cb5943 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:41.707059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6f7c4-0477-4249-b747-e72a17cb5943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:41.767799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b0d6f7c4-0477-4249-b747-e72a17cb5943 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:41.769062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b0d6f7c4-0477-4249-b747-e72a17cb5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:41.922640 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2256/4469] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:41.941563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:41.944659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:42.078996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d347680-ea1b-40fc-9e41-26a166b54cd1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:42.090745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad367ca1-3d89-4532-b059-2ec8312e4fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:42.091754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad367ca1-3d89-4532-b059-2ec8312e4fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:42.092066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad367ca1-3d89-4532-b059-2ec8312e4fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:42.092342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad367ca1-3d89-4532-b059-2ec8312e4fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:42.111643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad367ca1-3d89-4532-b059-2ec8312e4fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:42.113694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad367ca1-3d89-4532-b059-2ec8312e4fb9 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:42.130780 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2214/4470] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:43.190768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f7c4-0477-4249-b747-e72a17cb5943 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:43.192925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b0d6f7c4-0477-4249-b747-e72a17cb5943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:43.209764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6f7c4-0477-4249-b747-e72a17cb5943 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:43.218601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:43.220205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:43.221447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:43.222334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] PATH_INFO: `/v3/projects/f5da41e8b4b24be9b347f18359729bc6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:43.223947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5da41e8b4b24be9b347f18359729bc6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:43.226769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:43.320318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5da41e8b4b24be9b347f18359729bc6', 'request_id': 'req-74d173a7-08ad-4006-8bd6-526a362f8436'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:43.340898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5da41e8b4b24be9b347f18359729bc6', 'request_id': 'req-74d173a7-08ad-4006-8bd6-526a362f8436'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:43.354702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5da41e8b4b24be9b347f18359729bc6', 'request_id': 'req-74d173a7-08ad-4006-8bd6-526a362f8436'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:43.375818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] The token cache is being invalidate because project f5da41e8b4b24be9b347f18359729bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:03:43.376415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:43.378029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74d173a7-08ad-4006-8bd6-526a362f8436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:03:43.393617 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2257/4471] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:03:43 2022] DELETE /identity/v3/projects/f5da41e8b4b24be9b347f18359729bc6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:43.394388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fec57-30eb-4dc5-a2da-863b788b5d5d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:43.394867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fec57-30eb-4dc5-a2da-863b788b5d5d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:43.395137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fec57-30eb-4dc5-a2da-863b788b5d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:43.429635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f80fec57-30eb-4dc5-a2da-863b788b5d5d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:43.431277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f80fec57-30eb-4dc5-a2da-863b788b5d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:43.557518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6fbcc-13b5-416d-b2bd-309dd0774ad7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:43.558125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6fbcc-13b5-416d-b2bd-309dd0774ad7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:43.558594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6fbcc-13b5-416d-b2bd-309dd0774ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:43.570770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2215/4472] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:43.595992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c0e6fbcc-13b5-416d-b2bd-309dd0774ad7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:43.598967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c0e6fbcc-13b5-416d-b2bd-309dd0774ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:43.619360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fec57-30eb-4dc5-a2da-863b788b5d5d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:43.629755 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2258/4473] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:43.632246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fec57-30eb-4dc5-a2da-863b788b5d5d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:43.637035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28c108-31c3-4596-837b-acd68ba03563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:43.638152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c108-31c3-4596-837b-acd68ba03563 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:43.638450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c108-31c3-4596-837b-acd68ba03563 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:43.638731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28c108-31c3-4596-837b-acd68ba03563 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:43.639454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28c108-31c3-4596-837b-acd68ba03563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:03:43.639762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28c108-31c3-4596-837b-acd68ba03563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:43.642101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28c108-31c3-4596-837b-acd68ba03563 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:43.660982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2216/4474] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:03:43.662435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6fbcc-13b5-416d-b2bd-309dd0774ad7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:43.676487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6fbcc-13b5-416d-b2bd-309dd0774ad7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:43.682529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1d59a-3451-4ba6-a9ca-5209a19b2ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:43.683192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d59a-3451-4ba6-a9ca-5209a19b2ccf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:43.686291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d59a-3451-4ba6-a9ca-5209a19b2ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:43.686918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1d59a-3451-4ba6-a9ca-5209a19b2ccf admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:43.688320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1d59a-3451-4ba6-a9ca-5209a19b2ccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:43.691085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1d59a-3451-4ba6-a9ca-5209a19b2ccf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:43.737496 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2259/4475] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:03:43 2022] POST /identity/v3/projects => generated 359 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:03:43.740914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28c108-31c3-4596-837b-acd68ba03563 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:43.754758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28c108-31c3-4596-837b-acd68ba03563 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:43.892946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b6d5-e858-4850-aead-9245f4f3d980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:43.893703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b6d5-e858-4850-aead-9245f4f3d980 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:43.894894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b6d5-e858-4850-aead-9245f4f3d980 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:43.895185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3b6d5-e858-4850-aead-9245f4f3d980 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:43.896283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b6d5-e858-4850-aead-9245f4f3d980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:43.900116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3b6d5-e858-4850-aead-9245f4f3d980 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:43.940208 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2217/4476] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:03:43 2022] POST /identity/v3/users => generated 280 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:03:43.945693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1d59a-3451-4ba6-a9ca-5209a19b2ccf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:43.960368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1d59a-3451-4ba6-a9ca-5209a19b2ccf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:43.965823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f8d5b-9ad8-48b5-b10d-2a19b9535f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:43.967107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f8d5b-9ad8-48b5-b10d-2a19b9535f2b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:43.967488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f8d5b-9ad8-48b5-b10d-2a19b9535f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:43.967866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f8d5b-9ad8-48b5-b10d-2a19b9535f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:43.968771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f8d5b-9ad8-48b5-b10d-2a19b9535f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:43.970836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f8d5b-9ad8-48b5-b10d-2a19b9535f2b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:43.985972 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2260/4477] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:03:43.990016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b6d5-e858-4850-aead-9245f4f3d980 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:44.003080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3b6d5-e858-4850-aead-9245f4f3d980 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:44.010063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca4867-51c7-41eb-aac9-25d5a95725db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:44.010538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca4867-51c7-41eb-aac9-25d5a95725db admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:44.010747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca4867-51c7-41eb-aac9-25d5a95725db admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:44.011031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca4867-51c7-41eb-aac9-25d5a95725db admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:44.012653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca4867-51c7-41eb-aac9-25d5a95725db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:44.014615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca4867-51c7-41eb-aac9-25d5a95725db admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:44.035449 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2218/4478] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:03:44.039857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f8d5b-9ad8-48b5-b10d-2a19b9535f2b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:44.052593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f8d5b-9ad8-48b5-b10d-2a19b9535f2b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:44.058318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e4fbf-ab8e-401a-9b77-0b9c9ab49a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:44.059365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e4fbf-ab8e-401a-9b77-0b9c9ab49a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:44.059651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e4fbf-ab8e-401a-9b77-0b9c9ab49a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:44.059998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e4fbf-ab8e-401a-9b77-0b9c9ab49a82 admin admin] PATH_INFO: `/v3/projects/965d02c5815647dbb38389d1642775cd/users/87ccd2632725424c81676a9cd4246ee7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:44.079019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e4fbf-ab8e-401a-9b77-0b9c9ab49a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965d02c5815647dbb38389d1642775cd, user_id=87ccd2632725424c81676a9cd4246ee7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:44.082232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e4fbf-ab8e-401a-9b77-0b9c9ab49a82 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:44.098719 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2261/4479] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:03:44 2022] PUT /identity/v3/projects/965d02c5815647dbb38389d1642775cd/users/87ccd2632725424c81676a9cd4246ee7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:03:44.109224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2297794-340b-4f6b-ba27-a5e47c80c423 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:44.109584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2297794-340b-4f6b-ba27-a5e47c80c423 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:44.109821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2297794-340b-4f6b-ba27-a5e47c80c423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:44.140147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f2297794-340b-4f6b-ba27-a5e47c80c423 None None] MFA Rules not processed for user `87ccd2632725424c81676a9cd4246ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:44.141474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f2297794-340b-4f6b-ba27-a5e47c80c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:44.218810 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2219/4480] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:44 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:44.246328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e4fbf-ab8e-401a-9b77-0b9c9ab49a82 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:44.249512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-435e4fbf-ab8e-401a-9b77-0b9c9ab49a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:44.336785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e4fbf-ab8e-401a-9b77-0b9c9ab49a82 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:44.342770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e581a1-f473-484c-a65d-9fae5a04e25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:44.344951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e581a1-f473-484c-a65d-9fae5a04e25a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:44.345438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e581a1-f473-484c-a65d-9fae5a04e25a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:44.345880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e581a1-f473-484c-a65d-9fae5a04e25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:44.367304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e581a1-f473-484c-a65d-9fae5a04e25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:44.369196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e581a1-f473-484c-a65d-9fae5a04e25a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:44.381210 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2262/4481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:03:44 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:03:47.643453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394fe5f-8033-4027-8b0a-09576a8634dd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:47.645430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394fe5f-8033-4027-8b0a-09576a8634dd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:47.646558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394fe5f-8033-4027-8b0a-09576a8634dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:47.687823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c394fe5f-8033-4027-8b0a-09576a8634dd None None] MFA Rules not processed for user `b52006e4eed04870964f3b282818c82c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:47.692558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c394fe5f-8033-4027-8b0a-09576a8634dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:47.845518 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2220/4482] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:03:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:58.454096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c7f2f-cea4-491a-87cb-007c20f41ef0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:58.457383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c7f2f-cea4-491a-87cb-007c20f41ef0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:58.457682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c7f2f-cea4-491a-87cb-007c20f41ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:58.487729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-237c7f2f-cea4-491a-87cb-007c20f41ef0 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:03:58.489139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-237c7f2f-cea4-491a-87cb-007c20f41ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:58.577493 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2263/4483] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:03:58.603936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394fe5f-8033-4027-8b0a-09576a8634dd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:03:58.605537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c394fe5f-8033-4027-8b0a-09576a8634dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:03:58.733723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394fe5f-8033-4027-8b0a-09576a8634dd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:03:58.740496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4caa3-bfa0-47d0-a582-fea013400aaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:03:58.741552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4caa3-bfa0-47d0-a582-fea013400aaa service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:03:58.741835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4caa3-bfa0-47d0-a582-fea013400aaa service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:03:58.742113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4caa3-bfa0-47d0-a582-fea013400aaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:03:58.753595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4caa3-bfa0-47d0-a582-fea013400aaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:03:58.755415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4caa3-bfa0-47d0-a582-fea013400aaa service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:03:58.765841 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2221/4484] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:03:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:01.003975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8d927-436f-4f83-8def-50697767cf87 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:01.004839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8d927-436f-4f83-8def-50697767cf87 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:01.005268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8d927-436f-4f83-8def-50697767cf87 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:01.007938 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2264/4485] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 21:04:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:04:01.021537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983dd7-3f88-4ab8-92e1-68562cfa81e1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:01.022539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983dd7-3f88-4ab8-92e1-68562cfa81e1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:01.022976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39983dd7-3f88-4ab8-92e1-68562cfa81e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:01.132821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-39983dd7-3f88-4ab8-92e1-68562cfa81e1 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:01.134061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-39983dd7-3f88-4ab8-92e1-68562cfa81e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:01.291505 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2222/4486] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:01.318447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8d927-436f-4f83-8def-50697767cf87 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:01.320690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-25a8d927-436f-4f83-8def-50697767cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:01.374817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8d927-436f-4f83-8def-50697767cf87 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:01.396297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644c220-e7a8-433b-ba6f-5529aa1292ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:01.396963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644c220-e7a8-433b-ba6f-5529aa1292ca service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:01.397248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644c220-e7a8-433b-ba6f-5529aa1292ca service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:01.397525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644c220-e7a8-433b-ba6f-5529aa1292ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:01.414380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644c220-e7a8-433b-ba6f-5529aa1292ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:01.420583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644c220-e7a8-433b-ba6f-5529aa1292ca service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:01.480435 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2265/4487] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:05.916057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375195-78fb-4097-a5ba-0bf6f00ee8c1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:05.916702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375195-78fb-4097-a5ba-0bf6f00ee8c1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:05.917261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375195-78fb-4097-a5ba-0bf6f00ee8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:05.950687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8f375195-78fb-4097-a5ba-0bf6f00ee8c1 None None] MFA Rules not processed for user `cbbebd48cec04499a06386f886c8f99c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:05.953111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f375195-78fb-4097-a5ba-0bf6f00ee8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:06.035169 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2223/4488] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:11.126773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644c220-e7a8-433b-ba6f-5529aa1292ca service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:11.128914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0644c220-e7a8-433b-ba6f-5529aa1292ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:11.151358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644c220-e7a8-433b-ba6f-5529aa1292ca service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:11.164710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c4afb-1c07-408d-9665-c001f12f5553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:11.165615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c4afb-1c07-408d-9665-c001f12f5553 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:11.166096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c4afb-1c07-408d-9665-c001f12f5553 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:11.166537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c4afb-1c07-408d-9665-c001f12f5553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:11.169264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ea7c4afb-1c07-408d-9665-c001f12f5553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:11.263294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c4afb-1c07-408d-9665-c001f12f5553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:11.265088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c4afb-1c07-408d-9665-c001f12f5553 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:11.275860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375195-78fb-4097-a5ba-0bf6f00ee8c1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:11.282056 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2266/4489] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:11.421104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375195-78fb-4097-a5ba-0bf6f00ee8c1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:11.427587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:11.428883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:11.429480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:11.429929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] PATH_INFO: `/v3/users/87ccd2632725424c81676a9cd4246ee7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:11.431619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ccd2632725424c81676a9cd4246ee7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:11.435224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:11.512146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ccd2632725424c81676a9cd4246ee7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:11.519227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c4afb-1c07-408d-9665-c001f12f5553 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:11.526791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ccd2632725424c81676a9cd4246ee7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:11.536430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ccd2632725424c81676a9cd4246ee7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:11.537832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ccd2632725424c81676a9cd4246ee7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:11.538773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c4afb-1c07-408d-9665-c001f12f5553 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:11.543237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:11.544006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:11.544499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:11.544783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:11.547501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:11.556005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65103189-5ec1-457a-baf5-143afb7252b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ccd2632725424c81676a9cd4246ee7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:11.570581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:11.572689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:11.593193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2224/4490] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:04:11 2022] DELETE /identity/v3/users/87ccd2632725424c81676a9cd4246ee7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:04:11.598253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f63d41-7102-4ac3-a947-1ddb200f292a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:11.600534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f63d41-7102-4ac3-a947-1ddb200f292a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:11.600884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f63d41-7102-4ac3-a947-1ddb200f292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:11.602924 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2267/4491] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:11.631115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-18f63d41-7102-4ac3-a947-1ddb200f292a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:11.633629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-18f63d41-7102-4ac3-a947-1ddb200f292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:11.727008 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2225/4492] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:11.761123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:11.765128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:11.787426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30637d83-8aff-419e-afa8-662cdb4c8f19 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:11.893252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b15f2-2aa5-4fd7-bec1-6e21818d5549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:11.894282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b15f2-2aa5-4fd7-bec1-6e21818d5549 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:11.894969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b15f2-2aa5-4fd7-bec1-6e21818d5549 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:11.895373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b15f2-2aa5-4fd7-bec1-6e21818d5549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:11.911791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b15f2-2aa5-4fd7-bec1-6e21818d5549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:11.913304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b15f2-2aa5-4fd7-bec1-6e21818d5549 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:11.930213 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2268/4493] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:12.577516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f63d41-7102-4ac3-a947-1ddb200f292a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:12.579189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-18f63d41-7102-4ac3-a947-1ddb200f292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:12.609424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f63d41-7102-4ac3-a947-1ddb200f292a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:12.618307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:12.619268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:12.619761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:12.620325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] PATH_INFO: `/v3/projects/965d02c5815647dbb38389d1642775cd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:12.623448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965d02c5815647dbb38389d1642775cd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:12.627573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:12.821732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965d02c5815647dbb38389d1642775cd', 'request_id': 'req-3313e134-da6e-4d98-9062-90106b84cc41'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:12.836890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965d02c5815647dbb38389d1642775cd', 'request_id': 'req-3313e134-da6e-4d98-9062-90106b84cc41'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:12.849441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965d02c5815647dbb38389d1642775cd', 'request_id': 'req-3313e134-da6e-4d98-9062-90106b84cc41'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:12.874779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] The token cache is being invalidate because project 965d02c5815647dbb38389d1642775cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:04:12.875493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:12.877184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3313e134-da6e-4d98-9062-90106b84cc41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:12.880616 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2226/4494] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:04:12 2022] DELETE /identity/v3/projects/965d02c5815647dbb38389d1642775cd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:12.885650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91335c9-9474-4ad9-8890-0d6cef4e25e3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:12.886496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91335c9-9474-4ad9-8890-0d6cef4e25e3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:12.887545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91335c9-9474-4ad9-8890-0d6cef4e25e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:12.916812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b91335c9-9474-4ad9-8890-0d6cef4e25e3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:12.918875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b91335c9-9474-4ad9-8890-0d6cef4e25e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:13.081485 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2269/4495] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:04:13.177073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d21a66-16b7-4ada-8167-e9424cbcf9a7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:13.179038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d21a66-16b7-4ada-8167-e9424cbcf9a7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:13.179349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d21a66-16b7-4ada-8167-e9424cbcf9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:13.205004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d5d21a66-16b7-4ada-8167-e9424cbcf9a7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:13.206744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d5d21a66-16b7-4ada-8167-e9424cbcf9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:13.225171 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2227/4496] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:13.229680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91335c9-9474-4ad9-8890-0d6cef4e25e3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:13.250058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91335c9-9474-4ad9-8890-0d6cef4e25e3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:13.267015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111279-8154-4ee9-8a09-f27d5ec10d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:13.268694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111279-8154-4ee9-8a09-f27d5ec10d37 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:13.269184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111279-8154-4ee9-8a09-f27d5ec10d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:13.269667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be111279-8154-4ee9-8a09-f27d5ec10d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:13.270718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111279-8154-4ee9-8a09-f27d5ec10d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:04:13.271232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111279-8154-4ee9-8a09-f27d5ec10d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:13.275450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be111279-8154-4ee9-8a09-f27d5ec10d37 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:13.313764 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2270/4497] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:04:13.318011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d21a66-16b7-4ada-8167-e9424cbcf9a7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:13.354664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d21a66-16b7-4ada-8167-e9424cbcf9a7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:13.376024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf48159-8022-4672-90af-4ff6a49e6581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:13.376024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf48159-8022-4672-90af-4ff6a49e6581 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:13.376312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf48159-8022-4672-90af-4ff6a49e6581 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:13.376566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf48159-8022-4672-90af-4ff6a49e6581 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:13.377956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf48159-8022-4672-90af-4ff6a49e6581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:13.380779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf48159-8022-4672-90af-4ff6a49e6581 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:13.460555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2228/4498] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:04:13 2022] POST /identity/v3/projects => generated 355 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:13.464058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111279-8154-4ee9-8a09-f27d5ec10d37 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:13.483129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be111279-8154-4ee9-8a09-f27d5ec10d37 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:13.681029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd3e01-c511-4a08-a55b-be1b448c779c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:13.681874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd3e01-c511-4a08-a55b-be1b448c779c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:13.682272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd3e01-c511-4a08-a55b-be1b448c779c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:13.682592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd3e01-c511-4a08-a55b-be1b448c779c admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:13.685382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd3e01-c511-4a08-a55b-be1b448c779c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:13.690229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd3e01-c511-4a08-a55b-be1b448c779c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:13.741203 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2271/4499] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:04:13 2022] POST /identity/v3/users => generated 278 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:13.743518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf48159-8022-4672-90af-4ff6a49e6581 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:13.781483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf48159-8022-4672-90af-4ff6a49e6581 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:13.803801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5f573-72a9-41fa-9616-70854c8854eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:13.813178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5f573-72a9-41fa-9616-70854c8854eb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:13.813708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5f573-72a9-41fa-9616-70854c8854eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:13.814169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5f573-72a9-41fa-9616-70854c8854eb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:13.815377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5f573-72a9-41fa-9616-70854c8854eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:13.840127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b5f573-72a9-41fa-9616-70854c8854eb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:13.876430 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2229/4500] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:13.880385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd3e01-c511-4a08-a55b-be1b448c779c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:13.905822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd3e01-c511-4a08-a55b-be1b448c779c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:13.916262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1d5f6-b25e-47c8-a404-87dff16a7db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:13.918582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1d5f6-b25e-47c8-a404-87dff16a7db0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:13.919111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1d5f6-b25e-47c8-a404-87dff16a7db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:13.920093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1d5f6-b25e-47c8-a404-87dff16a7db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:13.921530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1d5f6-b25e-47c8-a404-87dff16a7db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:13.924004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1d5f6-b25e-47c8-a404-87dff16a7db0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:13.937918 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2272/4501] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:13.946286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5f573-72a9-41fa-9616-70854c8854eb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:13.970186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b5f573-72a9-41fa-9616-70854c8854eb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:13.984296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65651ee0-7823-4db3-955c-22df69822556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:13.985498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65651ee0-7823-4db3-955c-22df69822556 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:13.986288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65651ee0-7823-4db3-955c-22df69822556 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:13.986805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65651ee0-7823-4db3-955c-22df69822556 admin admin] PATH_INFO: `/v3/projects/6d5c678d2fcd49fcb6bd6822ebc67e92/users/97a43d839ec24c08998b387efb4de196/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:14.034517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65651ee0-7823-4db3-955c-22df69822556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5c678d2fcd49fcb6bd6822ebc67e92, user_id=97a43d839ec24c08998b387efb4de196, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:14.050057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65651ee0-7823-4db3-955c-22df69822556 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:14.084499 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2230/4502] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:13 2022] PUT /identity/v3/projects/6d5c678d2fcd49fcb6bd6822ebc67e92/users/97a43d839ec24c08998b387efb4de196/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:14.095899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be92d8-a3e6-4555-a688-6951e42911dc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:14.097176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be92d8-a3e6-4555-a688-6951e42911dc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:14.097581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be92d8-a3e6-4555-a688-6951e42911dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:14.170147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e3be92d8-a3e6-4555-a688-6951e42911dc None None] MFA Rules not processed for user `97a43d839ec24c08998b387efb4de196`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:14.173704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e3be92d8-a3e6-4555-a688-6951e42911dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:14.404999 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2273/4503] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:14 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:14.409656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65651ee0-7823-4db3-955c-22df69822556 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:14.587935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65651ee0-7823-4db3-955c-22df69822556 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:14.594704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4302d98-3f0a-45b5-b1f8-a9af0deb650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:14.596765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4302d98-3f0a-45b5-b1f8-a9af0deb650f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:14.597395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4302d98-3f0a-45b5-b1f8-a9af0deb650f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:14.597827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4302d98-3f0a-45b5-b1f8-a9af0deb650f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:14.598693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4302d98-3f0a-45b5-b1f8-a9af0deb650f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:14.603569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4302d98-3f0a-45b5-b1f8-a9af0deb650f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:14.670549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be92d8-a3e6-4555-a688-6951e42911dc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:14.671005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2231/4504] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:04:14 2022] POST /identity/v3/projects => generated 355 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:14.686781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be92d8-a3e6-4555-a688-6951e42911dc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:14.809057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ed486-cb67-4d7c-af3f-6a2b6ebcaf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:14.810688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ed486-cb67-4d7c-af3f-6a2b6ebcaf8a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:14.811394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ed486-cb67-4d7c-af3f-6a2b6ebcaf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:14.811591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ed486-cb67-4d7c-af3f-6a2b6ebcaf8a admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:14.812512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ed486-cb67-4d7c-af3f-6a2b6ebcaf8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:14.815600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ed486-cb67-4d7c-af3f-6a2b6ebcaf8a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:14.922147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4302d98-3f0a-45b5-b1f8-a9af0deb650f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:14.948590 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2274/4505] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:04:14 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:14.960237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4302d98-3f0a-45b5-b1f8-a9af0deb650f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:14.985484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b8d36-9cf4-4150-84cf-46d80fb19ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:14.990518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b8d36-9cf4-4150-84cf-46d80fb19ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:14.991266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b8d36-9cf4-4150-84cf-46d80fb19ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:14.991969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b8d36-9cf4-4150-84cf-46d80fb19ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:14.994063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b8d36-9cf4-4150-84cf-46d80fb19ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:15.003901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b8d36-9cf4-4150-84cf-46d80fb19ee6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:15.046480 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2232/4506] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:04:15.051305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ed486-cb67-4d7c-af3f-6a2b6ebcaf8a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:15.066462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ed486-cb67-4d7c-af3f-6a2b6ebcaf8a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:15.082732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d952-0ed6-4a52-9552-bd34817059c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:15.086347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d952-0ed6-4a52-9552-bd34817059c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:15.087564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d952-0ed6-4a52-9552-bd34817059c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:15.091085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d952-0ed6-4a52-9552-bd34817059c7 admin admin] PATH_INFO: `/v3/projects/a91e3682354d48e2920344adae38ccb4/users/a6f56334a9004d4c90f9b979ef80ec72/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:15.118121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8d952-0ed6-4a52-9552-bd34817059c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91e3682354d48e2920344adae38ccb4, user_id=a6f56334a9004d4c90f9b979ef80ec72, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:15.122182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8d952-0ed6-4a52-9552-bd34817059c7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:15.170900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b8d36-9cf4-4150-84cf-46d80fb19ee6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:15.171626 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2275/4507] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:15 2022] PUT /identity/v3/projects/a91e3682354d48e2920344adae38ccb4/users/a6f56334a9004d4c90f9b979ef80ec72/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:15.197694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b8d36-9cf4-4150-84cf-46d80fb19ee6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:15.338183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f235c10-0949-4417-b109-da4263b59b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:15.339251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f235c10-0949-4417-b109-da4263b59b27 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:15.339797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f235c10-0949-4417-b109-da4263b59b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:15.341481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f235c10-0949-4417-b109-da4263b59b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:15.342667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f235c10-0949-4417-b109-da4263b59b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:15.344618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f235c10-0949-4417-b109-da4263b59b27 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:15.359122 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2233/4508] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:15.367081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d952-0ed6-4a52-9552-bd34817059c7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:15.386746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d952-0ed6-4a52-9552-bd34817059c7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:15.398868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72b89-5cde-4f68-a1f1-1988bee3d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:15.400232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72b89-5cde-4f68-a1f1-1988bee3d17e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:15.400871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72b89-5cde-4f68-a1f1-1988bee3d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:15.401356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb72b89-5cde-4f68-a1f1-1988bee3d17e admin admin] PATH_INFO: `/v3/projects/a91e3682354d48e2920344adae38ccb4/users/a6f56334a9004d4c90f9b979ef80ec72/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:15.404939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb72b89-5cde-4f68-a1f1-1988bee3d17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91e3682354d48e2920344adae38ccb4, user_id=a6f56334a9004d4c90f9b979ef80ec72, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:15.408259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb72b89-5cde-4f68-a1f1-1988bee3d17e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:15.454275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e741-fb1d-41b0-88bf-b2125d588c0e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:15.454881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e741-fb1d-41b0-88bf-b2125d588c0e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:15.455507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9e741-fb1d-41b0-88bf-b2125d588c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:15.455986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2276/4509] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:15 2022] PUT /identity/v3/projects/a91e3682354d48e2920344adae38ccb4/users/a6f56334a9004d4c90f9b979ef80ec72/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:15.526845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-25c9e741-fb1d-41b0-88bf-b2125d588c0e None None] MFA Rules not processed for user `a6f56334a9004d4c90f9b979ef80ec72`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:15.529376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-25c9e741-fb1d-41b0-88bf-b2125d588c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:15.677958 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2234/4510] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:15 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:15.694613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72b89-5cde-4f68-a1f1-1988bee3d17e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:15.698976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cfb72b89-5cde-4f68-a1f1-1988bee3d17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:15.878646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb72b89-5cde-4f68-a1f1-1988bee3d17e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:15.888651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ff6a2-4cb6-4bb0-9353-f4b8e8bc7c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:15.889345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ff6a2-4cb6-4bb0-9353-f4b8e8bc7c75 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:15.891267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ff6a2-4cb6-4bb0-9353-f4b8e8bc7c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:15.891537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ff6a2-4cb6-4bb0-9353-f4b8e8bc7c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:15.917322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ff6a2-4cb6-4bb0-9353-f4b8e8bc7c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:15.919974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ff6a2-4cb6-4bb0-9353-f4b8e8bc7c75 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:15.956151 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2277/4511] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:15 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:16.156939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e741-fb1d-41b0-88bf-b2125d588c0e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:16.184723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9e741-fb1d-41b0-88bf-b2125d588c0e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:16.194123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d783b-a7e6-4273-aae5-35b00b48a464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:16.196242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d783b-a7e6-4273-aae5-35b00b48a464 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:16.196859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d783b-a7e6-4273-aae5-35b00b48a464 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:16.198025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d783b-a7e6-4273-aae5-35b00b48a464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:16.317655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d783b-a7e6-4273-aae5-35b00b48a464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:16.319779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d783b-a7e6-4273-aae5-35b00b48a464 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:16.332868 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2235/4512] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:16 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:04:23.464473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ff6a2-4cb6-4bb0-9353-f4b8e8bc7c75 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:23.467156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-529ff6a2-4cb6-4bb0-9353-f4b8e8bc7c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:23.555147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ff6a2-4cb6-4bb0-9353-f4b8e8bc7c75 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:23.559115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed617e73-c1e7-437c-a374-6e9492ec9287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:23.560143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed617e73-c1e7-437c-a374-6e9492ec9287 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:23.560526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed617e73-c1e7-437c-a374-6e9492ec9287 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:23.560927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed617e73-c1e7-437c-a374-6e9492ec9287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:23.563044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ed617e73-c1e7-437c-a374-6e9492ec9287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:23.649599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed617e73-c1e7-437c-a374-6e9492ec9287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:23.651865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed617e73-c1e7-437c-a374-6e9492ec9287 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:23.680362 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2278/4513] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:32.370131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d783b-a7e6-4273-aae5-35b00b48a464 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:32.371777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e1d783b-a7e6-4273-aae5-35b00b48a464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:32.392767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d783b-a7e6-4273-aae5-35b00b48a464 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:32.400243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:32.401838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:32.408430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:32.408722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] PATH_INFO: `/v3/users/70fab8e4c45d48ea8223a3acc60a5442` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:32.415018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70fab8e4c45d48ea8223a3acc60a5442)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:32.417051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:32.478381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70fab8e4c45d48ea8223a3acc60a5442'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.486008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70fab8e4c45d48ea8223a3acc60a5442'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.486986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70fab8e4c45d48ea8223a3acc60a5442'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.487598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70fab8e4c45d48ea8223a3acc60a5442'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.500075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-187c8a82-5448-4322-b6d0-075c315c349f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70fab8e4c45d48ea8223a3acc60a5442'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.513383 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2236/4514] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:04:32 2022] DELETE /identity/v3/users/70fab8e4c45d48ea8223a3acc60a5442 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:32.689471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed617e73-c1e7-437c-a374-6e9492ec9287 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:32.708794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed617e73-c1e7-437c-a374-6e9492ec9287 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:32.773803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:32.774593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:32.774879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:32.775190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] PATH_INFO: `/v3/projects/71d58c339cd84f6891e4545c28bb7927` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:32.776707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d58c339cd84f6891e4545c28bb7927)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:32.778428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:32.827339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d58c339cd84f6891e4545c28bb7927', 'request_id': 'req-cfc0c453-401d-40ec-9619-659d0ecef0e3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.835191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d58c339cd84f6891e4545c28bb7927', 'request_id': 'req-cfc0c453-401d-40ec-9619-659d0ecef0e3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.841647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d58c339cd84f6891e4545c28bb7927', 'request_id': 'req-cfc0c453-401d-40ec-9619-659d0ecef0e3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.853039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] The token cache is being invalidate because project 71d58c339cd84f6891e4545c28bb7927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:04:32.853335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.853972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfc0c453-401d-40ec-9619-659d0ecef0e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:32.855513 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2279/4515] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:04:32 2022] DELETE /identity/v3/projects/71d58c339cd84f6891e4545c28bb7927 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:32.862004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4009d9d-8f3f-4213-8817-2bff7b492dc0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:32.862302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4009d9d-8f3f-4213-8817-2bff7b492dc0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:32.862586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4009d9d-8f3f-4213-8817-2bff7b492dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:32.882228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e4009d9d-8f3f-4213-8817-2bff7b492dc0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:32.883893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e4009d9d-8f3f-4213-8817-2bff7b492dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:32.952080 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2237/4516] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:04:32.957655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ca1c0-57e6-448a-b05c-89c76c10376e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:32.958623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ca1c0-57e6-448a-b05c-89c76c10376e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:32.958912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ca1c0-57e6-448a-b05c-89c76c10376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:32.977938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-966ca1c0-57e6-448a-b05c-89c76c10376e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:32.979365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-966ca1c0-57e6-448a-b05c-89c76c10376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:32.991225 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2280/4517] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:32.995448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4009d9d-8f3f-4213-8817-2bff7b492dc0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:33.008027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4009d9d-8f3f-4213-8817-2bff7b492dc0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:33.017325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb7fce-4d24-4fc1-b520-961c7fed3981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:33.018601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb7fce-4d24-4fc1-b520-961c7fed3981 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:33.018601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb7fce-4d24-4fc1-b520-961c7fed3981 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:33.018806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb7fce-4d24-4fc1-b520-961c7fed3981 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:33.019809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb7fce-4d24-4fc1-b520-961c7fed3981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:04:33.019984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb7fce-4d24-4fc1-b520-961c7fed3981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:33.022051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb7fce-4d24-4fc1-b520-961c7fed3981 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:33.046492 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2238/4518] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:04:33.048018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ca1c0-57e6-448a-b05c-89c76c10376e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:33.065878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ca1c0-57e6-448a-b05c-89c76c10376e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:33.071275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d92e2f-442d-4ff1-91df-bd416494854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:33.072112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d92e2f-442d-4ff1-91df-bd416494854e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:33.072493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d92e2f-442d-4ff1-91df-bd416494854e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:33.072866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d92e2f-442d-4ff1-91df-bd416494854e admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:33.073649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d92e2f-442d-4ff1-91df-bd416494854e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:33.081257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d92e2f-442d-4ff1-91df-bd416494854e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:33.126802 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2281/4519] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:04:33 2022] POST /identity/v3/projects => generated 405 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:33.128041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb7fce-4d24-4fc1-b520-961c7fed3981 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:33.142131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb7fce-4d24-4fc1-b520-961c7fed3981 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:33.226704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa650d-cc68-4927-964a-7d4aa24df807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:33.227848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa650d-cc68-4927-964a-7d4aa24df807 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:33.228342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa650d-cc68-4927-964a-7d4aa24df807 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:33.228769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa650d-cc68-4927-964a-7d4aa24df807 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:33.229850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa650d-cc68-4927-964a-7d4aa24df807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:33.232707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa650d-cc68-4927-964a-7d4aa24df807 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:33.287361 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2239/4520] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:04:33 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:33.291594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d92e2f-442d-4ff1-91df-bd416494854e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:33.316841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d92e2f-442d-4ff1-91df-bd416494854e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:33.334617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b16e50-58bb-4a8f-9e59-8efd7ee0d768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:33.338747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b16e50-58bb-4a8f-9e59-8efd7ee0d768 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:33.339256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b16e50-58bb-4a8f-9e59-8efd7ee0d768 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:33.339944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b16e50-58bb-4a8f-9e59-8efd7ee0d768 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:33.340959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b16e50-58bb-4a8f-9e59-8efd7ee0d768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:33.344051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b16e50-58bb-4a8f-9e59-8efd7ee0d768 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:33.359694 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2282/4521] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:33.363751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa650d-cc68-4927-964a-7d4aa24df807 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:33.375590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa650d-cc68-4927-964a-7d4aa24df807 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:33.380971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbf3ef-7c8d-412f-b1f5-289ba513fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:33.381647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbf3ef-7c8d-412f-b1f5-289ba513fecd admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:33.381928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbf3ef-7c8d-412f-b1f5-289ba513fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:33.382203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbf3ef-7c8d-412f-b1f5-289ba513fecd admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:33.383650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbf3ef-7c8d-412f-b1f5-289ba513fecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:33.384779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbf3ef-7c8d-412f-b1f5-289ba513fecd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:33.404626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b16e50-58bb-4a8f-9e59-8efd7ee0d768 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:33.411753 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2240/4522] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:33.416493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b16e50-58bb-4a8f-9e59-8efd7ee0d768 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:33.425587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1187-3aa2-460a-8fde-bdfdd52ab3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:33.426505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1187-3aa2-460a-8fde-bdfdd52ab3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:33.426788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1187-3aa2-460a-8fde-bdfdd52ab3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:33.427068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d1187-3aa2-460a-8fde-bdfdd52ab3cd admin admin] PATH_INFO: `/v3/projects/b97ee3626b824293b17899943c256a52/users/9491de6627b346fca21989a44e262429/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:33.466671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1187-3aa2-460a-8fde-bdfdd52ab3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97ee3626b824293b17899943c256a52, user_id=9491de6627b346fca21989a44e262429, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:33.471068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40d1187-3aa2-460a-8fde-bdfdd52ab3cd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:33.504212 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2283/4523] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:33 2022] PUT /identity/v3/projects/b97ee3626b824293b17899943c256a52/users/9491de6627b346fca21989a44e262429/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:33.509255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a9165-966b-4247-b60a-e024f59ca89c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:33.509824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a9165-966b-4247-b60a-e024f59ca89c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:33.510294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220a9165-966b-4247-b60a-e024f59ca89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:33.548684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-220a9165-966b-4247-b60a-e024f59ca89c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:33.550059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-220a9165-966b-4247-b60a-e024f59ca89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:33.704631 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2241/4524] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:33.784529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1187-3aa2-460a-8fde-bdfdd52ab3cd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:33.788474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d40d1187-3aa2-460a-8fde-bdfdd52ab3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:33.957752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40d1187-3aa2-460a-8fde-bdfdd52ab3cd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:33.970210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec004e-03e2-4fa0-8a13-7531da0073b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:33.971177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec004e-03e2-4fa0-8a13-7531da0073b5 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:33.971662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec004e-03e2-4fa0-8a13-7531da0073b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:33.972143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec004e-03e2-4fa0-8a13-7531da0073b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:33.984076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec004e-03e2-4fa0-8a13-7531da0073b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:33.987614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec004e-03e2-4fa0-8a13-7531da0073b5 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:34.009280 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2284/4525] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:36.643380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a9165-966b-4247-b60a-e024f59ca89c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:36.644947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-220a9165-966b-4247-b60a-e024f59ca89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:36.811487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220a9165-966b-4247-b60a-e024f59ca89c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:36.853573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83e75b-3834-4f43-99c7-ebe20f66ca22 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:36.854248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83e75b-3834-4f43-99c7-ebe20f66ca22 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:36.854248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83e75b-3834-4f43-99c7-ebe20f66ca22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:36.857587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:36.859669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:36.861558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:36.862828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:36.867521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:36.890337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:36.893477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:36.911215 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2242/4526] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:36.914049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2b83e75b-3834-4f43-99c7-ebe20f66ca22 None None] MFA Rules not processed for user `9491de6627b346fca21989a44e262429`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:36.915809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2b83e75b-3834-4f43-99c7-ebe20f66ca22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:36.948466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:36.950685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:36.984976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372441e2-641f-4e2b-ba9f-c52cdc464704 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:37.019062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:37.021575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:37.022814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:37.044747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] PATH_INFO: `/v3/users/97a43d839ec24c08998b387efb4de196` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:37.047791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=97a43d839ec24c08998b387efb4de196)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:37.052090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:37.113381 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2285/4527] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:36 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:37.117108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83e75b-3834-4f43-99c7-ebe20f66ca22 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:37.154312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83e75b-3834-4f43-99c7-ebe20f66ca22 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:37.169332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17b3bb-d512-44d1-9328-de1f93e14319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:37.170116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17b3bb-d512-44d1-9328-de1f93e14319 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:37.170461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17b3bb-d512-44d1-9328-de1f93e14319 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:37.170790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17b3bb-d512-44d1-9328-de1f93e14319 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:37.171502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17b3bb-d512-44d1-9328-de1f93e14319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:37.176581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17b3bb-d512-44d1-9328-de1f93e14319 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:37.262828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97a43d839ec24c08998b387efb4de196'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:37.263627 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2286/4528] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:04:37 2022] POST /identity/v3/projects => generated 405 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:04:37.268417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17b3bb-d512-44d1-9328-de1f93e14319 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:37.283881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97a43d839ec24c08998b387efb4de196'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:37.285030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97a43d839ec24c08998b387efb4de196'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:37.286527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97a43d839ec24c08998b387efb4de196'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:37.324870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9efb328-a021-4200-a378-484c4f056eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97a43d839ec24c08998b387efb4de196'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:37.359785 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2243/4529] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:04:36 2022] DELETE /identity/v3/users/97a43d839ec24c08998b387efb4de196 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:37.367643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f0d73-f60a-4d10-9f19-c88b976aa594 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:37.367936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17b3bb-d512-44d1-9328-de1f93e14319 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:37.369378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f0d73-f60a-4d10-9f19-c88b976aa594 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:37.369960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f0d73-f60a-4d10-9f19-c88b976aa594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:37.430171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-508f0d73-f60a-4d10-9f19-c88b976aa594 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:37.431752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-508f0d73-f60a-4d10-9f19-c88b976aa594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:37.484276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b7a8-16d2-4e26-a99e-0c446dc50141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:37.485872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b7a8-16d2-4e26-a99e-0c446dc50141 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:37.486571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b7a8-16d2-4e26-a99e-0c446dc50141 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:37.487436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b7a8-16d2-4e26-a99e-0c446dc50141 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:37.490537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51b7a8-16d2-4e26-a99e-0c446dc50141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:37.492956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51b7a8-16d2-4e26-a99e-0c446dc50141 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:37.534138 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2287/4530] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:04:37 2022] POST /identity/v3/users => generated 303 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:37.540911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b7a8-16d2-4e26-a99e-0c446dc50141 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:37.550393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bd51b7a8-16d2-4e26-a99e-0c446dc50141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:37.579538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b7a8-16d2-4e26-a99e-0c446dc50141 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:37.593302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b3833-fcbb-44ea-a702-11b55bd420d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:37.593984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b3833-fcbb-44ea-a702-11b55bd420d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:37.594440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b3833-fcbb-44ea-a702-11b55bd420d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:37.595828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b3833-fcbb-44ea-a702-11b55bd420d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:37.596977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b3833-fcbb-44ea-a702-11b55bd420d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:37.602504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b3833-fcbb-44ea-a702-11b55bd420d5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:37.618989 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2288/4531] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:37.624154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b3833-fcbb-44ea-a702-11b55bd420d5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:37.643129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b3833-fcbb-44ea-a702-11b55bd420d5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:37.647718 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2244/4532] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:37.653109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d3d1c-8ff0-4cfb-883d-e0019bbf59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:37.653823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3d1c-8ff0-4cfb-883d-e0019bbf59f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:37.654436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3d1c-8ff0-4cfb-883d-e0019bbf59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:37.654952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d3d1c-8ff0-4cfb-883d-e0019bbf59f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:37.656406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d3d1c-8ff0-4cfb-883d-e0019bbf59f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:37.658751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3d3d1c-8ff0-4cfb-883d-e0019bbf59f5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:37.665600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f0d73-f60a-4d10-9f19-c88b976aa594 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:37.670140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-508f0d73-f60a-4d10-9f19-c88b976aa594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:37.674547 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2289/4533] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:37.678663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d3d1c-8ff0-4cfb-883d-e0019bbf59f5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:37.697137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3d3d1c-8ff0-4cfb-883d-e0019bbf59f5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:37.714226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e54abd-c39f-4777-a400-1a6f5fc4019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:37.715748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e54abd-c39f-4777-a400-1a6f5fc4019a admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:37.716090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e54abd-c39f-4777-a400-1a6f5fc4019a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:37.716387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e54abd-c39f-4777-a400-1a6f5fc4019a admin admin] PATH_INFO: `/v3/projects/875a90eb5cc94cc38f2ce52df8d72946/users/7109ce5813564f6b9c6cacd0df98a550/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:37.758022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e54abd-c39f-4777-a400-1a6f5fc4019a admin admin] RBAC: Authorizing `identity:create_grant(project_id=875a90eb5cc94cc38f2ce52df8d72946, user_id=7109ce5813564f6b9c6cacd0df98a550, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:37.770380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e54abd-c39f-4777-a400-1a6f5fc4019a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:37.789185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f0d73-f60a-4d10-9f19-c88b976aa594 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:37.804913 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2290/4534] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:37 2022] PUT /identity/v3/projects/875a90eb5cc94cc38f2ce52df8d72946/users/7109ce5813564f6b9c6cacd0df98a550/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:04:37.805972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f940a-9521-4214-97ce-66e1e23e48d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:37.806814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f940a-9521-4214-97ce-66e1e23e48d3 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:37.807158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f940a-9521-4214-97ce-66e1e23e48d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:37.807506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f940a-9521-4214-97ce-66e1e23e48d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:37.820590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f940a-9521-4214-97ce-66e1e23e48d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:37.822463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f940a-9521-4214-97ce-66e1e23e48d3 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:37.836914 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2245/4535] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:38.414750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e54abd-c39f-4777-a400-1a6f5fc4019a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:38.419170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-83e54abd-c39f-4777-a400-1a6f5fc4019a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:38.565324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e54abd-c39f-4777-a400-1a6f5fc4019a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:38.582423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:38.589319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:38.590447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:38.590904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] PATH_INFO: `/v3/users/b52006e4eed04870964f3b282818c82c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:38.592513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52006e4eed04870964f3b282818c82c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:38.594869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:38.651118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dae74f-34b8-4028-a4f5-d8e884c9be14 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:38.653329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dae74f-34b8-4028-a4f5-d8e884c9be14 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:38.653886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dae74f-34b8-4028-a4f5-d8e884c9be14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:38.673220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52006e4eed04870964f3b282818c82c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:38.681709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52006e4eed04870964f3b282818c82c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:38.684429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a2dae74f-34b8-4028-a4f5-d8e884c9be14 None None] MFA Rules not processed for user `cbbebd48cec04499a06386f886c8f99c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:38.684623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52006e4eed04870964f3b282818c82c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:38.685704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52006e4eed04870964f3b282818c82c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:38.686363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a2dae74f-34b8-4028-a4f5-d8e884c9be14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:38.708084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63889446-7b3a-4d19-8329-1dafd4c41641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52006e4eed04870964f3b282818c82c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:38.738834 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2291/4536] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:04:38 2022] DELETE /identity/v3/users/b52006e4eed04870964f3b282818c82c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:38.809713 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2246/4537] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:39.145852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c253691-b5a8-4626-9d2d-7075ac2a4e69 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:39.146359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c253691-b5a8-4626-9d2d-7075ac2a4e69 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:39.146686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c253691-b5a8-4626-9d2d-7075ac2a4e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:39.190613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0c253691-b5a8-4626-9d2d-7075ac2a4e69 None None] MFA Rules not processed for user `7109ce5813564f6b9c6cacd0df98a550`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:39.192300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0c253691-b5a8-4626-9d2d-7075ac2a4e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:39.316626 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2292/4538] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:39.327090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e53a9-0bb8-4b6a-86c4-29c21cdc36ae None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:39.327648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e53a9-0bb8-4b6a-86c4-29c21cdc36ae None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:39.328419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e53a9-0bb8-4b6a-86c4-29c21cdc36ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:39.360964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-043e53a9-0bb8-4b6a-86c4-29c21cdc36ae None None] MFA Rules not processed for user `9491de6627b346fca21989a44e262429`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:39.363999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-043e53a9-0bb8-4b6a-86c4-29c21cdc36ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:39.429473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c253691-b5a8-4626-9d2d-7075ac2a4e69 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:39.432222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0c253691-b5a8-4626-9d2d-7075ac2a4e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:39.479586 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2247/4539] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:39.633823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c253691-b5a8-4626-9d2d-7075ac2a4e69 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:39.634603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e53a9-0bb8-4b6a-86c4-29c21cdc36ae None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:39.636943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-043e53a9-0bb8-4b6a-86c4-29c21cdc36ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:39.663272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e53a9-0bb8-4b6a-86c4-29c21cdc36ae None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:39.664107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:39.667616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:39.667905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:39.668220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] PATH_INFO: `/v3/projects/6d5c678d2fcd49fcb6bd6822ebc67e92` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:39.670957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5c678d2fcd49fcb6bd6822ebc67e92)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:39.672944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:39.673351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:39.674737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:39.675314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:39.676020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] PATH_INFO: `/v3/projects/c7ef32a79723421e847963a749a03313` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:39.677519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ef32a79723421e847963a749a03313)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:39.680138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:39.788641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ef32a79723421e847963a749a03313', 'request_id': 'req-eb834390-ab9b-43e9-ab09-d4ed08036a94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.805613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ef32a79723421e847963a749a03313', 'request_id': 'req-eb834390-ab9b-43e9-ab09-d4ed08036a94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.820432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ef32a79723421e847963a749a03313', 'request_id': 'req-eb834390-ab9b-43e9-ab09-d4ed08036a94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.837492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] The token cache is being invalidate because project c7ef32a79723421e847963a749a03313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:04:39.838124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.839101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.841734 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2248/4540] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:04:39 2022] DELETE /identity/v3/projects/c7ef32a79723421e847963a749a03313 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:39.842853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:39.846525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:39.865175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5c678d2fcd49fcb6bd6822ebc67e92', 'request_id': 'req-c5429fab-d171-49bd-93e9-c322d0f76293'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.891357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5c678d2fcd49fcb6bd6822ebc67e92', 'request_id': 'req-c5429fab-d171-49bd-93e9-c322d0f76293'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.902664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5c678d2fcd49fcb6bd6822ebc67e92', 'request_id': 'req-c5429fab-d171-49bd-93e9-c322d0f76293'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.946088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] The token cache is being invalidate because project 6d5c678d2fcd49fcb6bd6822ebc67e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:04:39.947432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.949375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5429fab-d171-49bd-93e9-c322d0f76293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:39.959962 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2293/4541] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:04:39 2022] DELETE /identity/v3/projects/6d5c678d2fcd49fcb6bd6822ebc67e92 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:04:39.961555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100e64-2558-4184-a3fd-f2758b6b5d04 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:39.961856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100e64-2558-4184-a3fd-f2758b6b5d04 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:39.962111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66100e64-2558-4184-a3fd-f2758b6b5d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:39.991050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-66100e64-2558-4184-a3fd-f2758b6b5d04 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:39.992653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-66100e64-2558-4184-a3fd-f2758b6b5d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:40.035571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb834390-ab9b-43e9-ab09-d4ed08036a94 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:40.099781 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2294/4542] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:40.105838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66100e64-2558-4184-a3fd-f2758b6b5d04 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:40.107625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-66100e64-2558-4184-a3fd-f2758b6b5d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:40.124953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66100e64-2558-4184-a3fd-f2758b6b5d04 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:40.141383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:40.142668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:40.142955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:40.143228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] PATH_INFO: `/v3/users/a6f56334a9004d4c90f9b979ef80ec72` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:40.147163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f56334a9004d4c90f9b979ef80ec72)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:40.150988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:40.153483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625483ab-eebd-49f8-80c5-f02f76f3e3cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:40.155242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625483ab-eebd-49f8-80c5-f02f76f3e3cd service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:40.155531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625483ab-eebd-49f8-80c5-f02f76f3e3cd service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:40.156082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625483ab-eebd-49f8-80c5-f02f76f3e3cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:40.158471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-625483ab-eebd-49f8-80c5-f02f76f3e3cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:40.240415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f56334a9004d4c90f9b979ef80ec72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:40.248497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f56334a9004d4c90f9b979ef80ec72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:40.249381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f56334a9004d4c90f9b979ef80ec72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:40.250069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f56334a9004d4c90f9b979ef80ec72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:40.266384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f56334a9004d4c90f9b979ef80ec72'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:40.266606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625483ab-eebd-49f8-80c5-f02f76f3e3cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:40.268423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625483ab-eebd-49f8-80c5-f02f76f3e3cd service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:40.289772 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2249/4543] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:39 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:40.296501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919c42d-dd53-4c35-8b66-97cdf68160e3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:40.298171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919c42d-dd53-4c35-8b66-97cdf68160e3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:40.298477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919c42d-dd53-4c35-8b66-97cdf68160e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:40.321958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2295/4544] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:04:40 2022] DELETE /identity/v3/users/a6f56334a9004d4c90f9b979ef80ec72 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:40.360405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e919c42d-dd53-4c35-8b66-97cdf68160e3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:40.364150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e919c42d-dd53-4c35-8b66-97cdf68160e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:40.414590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:40.415449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:40.540239 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2250/4545] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:40.546628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919c42d-dd53-4c35-8b66-97cdf68160e3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:40.560422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919c42d-dd53-4c35-8b66-97cdf68160e3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:40.566021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c07d2-a418-4a45-bec6-e880cbe4dcce admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:40.571741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4feed-39f4-46d9-a525-76b769904283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:40.572786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4feed-39f4-46d9-a525-76b769904283 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:40.572996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa26f5-1b22-4e11-9471-9cfefc312530 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:40.573609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4feed-39f4-46d9-a525-76b769904283 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:40.574264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa26f5-1b22-4e11-9471-9cfefc312530 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:40.574656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa26f5-1b22-4e11-9471-9cfefc312530 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:40.574942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa26f5-1b22-4e11-9471-9cfefc312530 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:40.576071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4feed-39f4-46d9-a525-76b769904283 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:40.577237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4feed-39f4-46d9-a525-76b769904283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:04:40.577380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-16aa26f5-1b22-4e11-9471-9cfefc312530 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:40.579585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4feed-39f4-46d9-a525-76b769904283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:40.581794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4feed-39f4-46d9-a525-76b769904283 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:40.598649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa26f5-1b22-4e11-9471-9cfefc312530 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:40.600716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa26f5-1b22-4e11-9471-9cfefc312530 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:40.604780 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2251/4546] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:04:40.610946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4feed-39f4-46d9-a525-76b769904283 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:40.617603 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2296/4547] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:04:40.647081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4feed-39f4-46d9-a525-76b769904283 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:40.660963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c44a0b-1c33-435a-84e3-9e3a54d91f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:40.664468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44a0b-1c33-435a-84e3-9e3a54d91f15 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:40.666313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44a0b-1c33-435a-84e3-9e3a54d91f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:40.667992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c44a0b-1c33-435a-84e3-9e3a54d91f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:40.669488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c44a0b-1c33-435a-84e3-9e3a54d91f15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:40.678725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c44a0b-1c33-435a-84e3-9e3a54d91f15 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:40.769954 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2252/4548] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:04:40 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:04:40.774335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa26f5-1b22-4e11-9471-9cfefc312530 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:40.793315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa26f5-1b22-4e11-9471-9cfefc312530 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:40.958073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd867b-44c3-406c-a8d7-314221efd1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:40.960582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd867b-44c3-406c-a8d7-314221efd1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:40.962761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd867b-44c3-406c-a8d7-314221efd1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:40.963513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd867b-44c3-406c-a8d7-314221efd1d7 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:40.965255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd867b-44c3-406c-a8d7-314221efd1d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:40.971652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd867b-44c3-406c-a8d7-314221efd1d7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:41.014555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c44a0b-1c33-435a-84e3-9e3a54d91f15 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:41.014818 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2297/4549] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:04:40 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:41.030302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c44a0b-1c33-435a-84e3-9e3a54d91f15 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:41.036998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d34d58-2c8e-4492-a344-aa6b90556149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:41.037951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d34d58-2c8e-4492-a344-aa6b90556149 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:41.038431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d34d58-2c8e-4492-a344-aa6b90556149 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:41.038865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d34d58-2c8e-4492-a344-aa6b90556149 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:41.039831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d34d58-2c8e-4492-a344-aa6b90556149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:41.042782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d34d58-2c8e-4492-a344-aa6b90556149 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:41.061031 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2253/4550] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:41.067128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd867b-44c3-406c-a8d7-314221efd1d7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:41.091487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd867b-44c3-406c-a8d7-314221efd1d7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:41.096727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94799ce0-8a57-43c2-ace1-5e4222d5d540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:41.097646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94799ce0-8a57-43c2-ace1-5e4222d5d540 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:41.098115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94799ce0-8a57-43c2-ace1-5e4222d5d540 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:41.098553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94799ce0-8a57-43c2-ace1-5e4222d5d540 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:41.099564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94799ce0-8a57-43c2-ace1-5e4222d5d540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:41.101842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94799ce0-8a57-43c2-ace1-5e4222d5d540 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:41.115460 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2298/4551] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:41.119839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d34d58-2c8e-4492-a344-aa6b90556149 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:41.133994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d34d58-2c8e-4492-a344-aa6b90556149 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:41.141487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553aae0-4622-468d-92ff-0f2b3b931c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:41.142779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553aae0-4622-468d-92ff-0f2b3b931c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:41.143600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553aae0-4622-468d-92ff-0f2b3b931c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:41.144144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a553aae0-4622-468d-92ff-0f2b3b931c4b admin admin] PATH_INFO: `/v3/projects/614df0ac05da469a932c527c1d5c0a12/users/f265820a8b974837949e9e3f36b58858/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:41.166154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553aae0-4622-468d-92ff-0f2b3b931c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=614df0ac05da469a932c527c1d5c0a12, user_id=f265820a8b974837949e9e3f36b58858, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:41.169887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a553aae0-4622-468d-92ff-0f2b3b931c4b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:41.197867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcb7dc-08f3-4e42-b0c8-c44212338e29 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:41.198741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcb7dc-08f3-4e42-b0c8-c44212338e29 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:41.200070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bcb7dc-08f3-4e42-b0c8-c44212338e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:41.203865 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2254/4552] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:41 2022] PUT /identity/v3/projects/614df0ac05da469a932c527c1d5c0a12/users/f265820a8b974837949e9e3f36b58858/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:41.231627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-40bcb7dc-08f3-4e42-b0c8-c44212338e29 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:41.234111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-40bcb7dc-08f3-4e42-b0c8-c44212338e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:41.356311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553aae0-4622-468d-92ff-0f2b3b931c4b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:41.361051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a553aae0-4622-468d-92ff-0f2b3b931c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:41.390780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2299/4553] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:41.427000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcb7dc-08f3-4e42-b0c8-c44212338e29 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:41.428623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-40bcb7dc-08f3-4e42-b0c8-c44212338e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:41.559354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a553aae0-4622-468d-92ff-0f2b3b931c4b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:41.565922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:41.567247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:41.567595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:41.567901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] PATH_INFO: `/v3/projects/a91e3682354d48e2920344adae38ccb4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:41.569785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91e3682354d48e2920344adae38ccb4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:41.573999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:41.584958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bcb7dc-08f3-4e42-b0c8-c44212338e29 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:41.594248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c14fca-e80d-49f1-bb02-9aa323bc3e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:41.595084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c14fca-e80d-49f1-bb02-9aa323bc3e18 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:41.599220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c14fca-e80d-49f1-bb02-9aa323bc3e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:41.599799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c14fca-e80d-49f1-bb02-9aa323bc3e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:41.627762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c14fca-e80d-49f1-bb02-9aa323bc3e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:41.633171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c14fca-e80d-49f1-bb02-9aa323bc3e18 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:41.668998 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2300/4554] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:04:41.696915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91e3682354d48e2920344adae38ccb4', 'request_id': 'req-3d7ba141-a1b6-442a-afc7-1564844d4b22'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:41.717169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91e3682354d48e2920344adae38ccb4', 'request_id': 'req-3d7ba141-a1b6-442a-afc7-1564844d4b22'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:41.726487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91e3682354d48e2920344adae38ccb4', 'request_id': 'req-3d7ba141-a1b6-442a-afc7-1564844d4b22'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:41.793929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] The token cache is being invalidate because project a91e3682354d48e2920344adae38ccb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:04:41.794518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:41.795794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d7ba141-a1b6-442a-afc7-1564844d4b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:41.807019 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2255/4555] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:04:41 2022] DELETE /identity/v3/projects/a91e3682354d48e2920344adae38ccb4 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:41.808883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3045c6-2e5a-41b8-854f-f0135ed13dc5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:41.809189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3045c6-2e5a-41b8-854f-f0135ed13dc5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:41.809486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3045c6-2e5a-41b8-854f-f0135ed13dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:41.844738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-aa3045c6-2e5a-41b8-854f-f0135ed13dc5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:41.845962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aa3045c6-2e5a-41b8-854f-f0135ed13dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:41.982092 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2301/4556] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:41.990428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890b90-a880-45b9-9577-9d9bfbd538b4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:41.991033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890b90-a880-45b9-9577-9d9bfbd538b4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:41.992308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c890b90-a880-45b9-9577-9d9bfbd538b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:42.030943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2c890b90-a880-45b9-9577-9d9bfbd538b4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:42.032286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2c890b90-a880-45b9-9577-9d9bfbd538b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:42.054959 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2256/4557] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:42.058939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3045c6-2e5a-41b8-854f-f0135ed13dc5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:42.075781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3045c6-2e5a-41b8-854f-f0135ed13dc5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:42.088814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa89ba6-5fdb-445d-8662-e156752a2118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:42.090059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa89ba6-5fdb-445d-8662-e156752a2118 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:42.091064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa89ba6-5fdb-445d-8662-e156752a2118 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:42.091064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa89ba6-5fdb-445d-8662-e156752a2118 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:42.091829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa89ba6-5fdb-445d-8662-e156752a2118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:04:42.092184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa89ba6-5fdb-445d-8662-e156752a2118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:42.099031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa89ba6-5fdb-445d-8662-e156752a2118 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:42.137907 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2302/4558] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:04:42.141997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c890b90-a880-45b9-9577-9d9bfbd538b4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:42.161168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c890b90-a880-45b9-9577-9d9bfbd538b4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:42.167785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edc200-f3b1-494a-9171-533a08c00842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:42.169763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edc200-f3b1-494a-9171-533a08c00842 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:42.170125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edc200-f3b1-494a-9171-533a08c00842 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:42.205473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edc200-f3b1-494a-9171-533a08c00842 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:42.206253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edc200-f3b1-494a-9171-533a08c00842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:42.213059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edc200-f3b1-494a-9171-533a08c00842 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:42.287206 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2257/4559] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:04:42 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:42.292081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa89ba6-5fdb-445d-8662-e156752a2118 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:42.313585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa89ba6-5fdb-445d-8662-e156752a2118 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:42.492325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041768a5-d2ce-4ab0-9a8e-f335c5dd704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:42.493473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041768a5-d2ce-4ab0-9a8e-f335c5dd704f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:42.493928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041768a5-d2ce-4ab0-9a8e-f335c5dd704f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:42.494370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041768a5-d2ce-4ab0-9a8e-f335c5dd704f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:42.496709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041768a5-d2ce-4ab0-9a8e-f335c5dd704f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:42.499169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041768a5-d2ce-4ab0-9a8e-f335c5dd704f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:42.533483 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2303/4560] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:04:42 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:42.537533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edc200-f3b1-494a-9171-533a08c00842 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:42.563215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edc200-f3b1-494a-9171-533a08c00842 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:42.583884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd881f1d-d92b-4f3f-a7b3-ba5b78799ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:42.587772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd881f1d-d92b-4f3f-a7b3-ba5b78799ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:42.589403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd881f1d-d92b-4f3f-a7b3-ba5b78799ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:42.589776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd881f1d-d92b-4f3f-a7b3-ba5b78799ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:42.594888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd881f1d-d92b-4f3f-a7b3-ba5b78799ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:42.600683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd881f1d-d92b-4f3f-a7b3-ba5b78799ba9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:42.646990 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2258/4561] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:42.651273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041768a5-d2ce-4ab0-9a8e-f335c5dd704f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:42.677516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041768a5-d2ce-4ab0-9a8e-f335c5dd704f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:42.696695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a357b1c-b9ea-42a9-892e-998dc78d6713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:42.697767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a357b1c-b9ea-42a9-892e-998dc78d6713 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:42.700868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a357b1c-b9ea-42a9-892e-998dc78d6713 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:42.701047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a357b1c-b9ea-42a9-892e-998dc78d6713 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:42.703350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a357b1c-b9ea-42a9-892e-998dc78d6713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:42.708182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a357b1c-b9ea-42a9-892e-998dc78d6713 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:42.758395 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2304/4562] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:42.759730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd881f1d-d92b-4f3f-a7b3-ba5b78799ba9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:42.778391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd881f1d-d92b-4f3f-a7b3-ba5b78799ba9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:42.804046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdf29dc-2e7b-45d5-8926-f44569a3e757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:42.809906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf29dc-2e7b-45d5-8926-f44569a3e757 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:42.810213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf29dc-2e7b-45d5-8926-f44569a3e757 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:42.810499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdf29dc-2e7b-45d5-8926-f44569a3e757 admin admin] PATH_INFO: `/v3/projects/9cb3a7ad720e4907adb342faacf61489/users/886e92bf0c794bbfaeddcd552df2a3cc/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:42.878277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf29dc-2e7b-45d5-8926-f44569a3e757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cb3a7ad720e4907adb342faacf61489, user_id=886e92bf0c794bbfaeddcd552df2a3cc, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:42.887904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdf29dc-2e7b-45d5-8926-f44569a3e757 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:42.918682 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2259/4563] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:42 2022] PUT /identity/v3/projects/9cb3a7ad720e4907adb342faacf61489/users/886e92bf0c794bbfaeddcd552df2a3cc/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:04:42.929614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56eac9-39c1-4950-8462-821889077ba4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:42.930112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56eac9-39c1-4950-8462-821889077ba4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:42.930747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56eac9-39c1-4950-8462-821889077ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:42.990290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-be56eac9-39c1-4950-8462-821889077ba4 None None] MFA Rules not processed for user `886e92bf0c794bbfaeddcd552df2a3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:42.993930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be56eac9-39c1-4950-8462-821889077ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:43.113431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911972-4bce-4784-b039-4aeb7e6cfbc2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:43.113692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911972-4bce-4784-b039-4aeb7e6cfbc2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:43.114011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70911972-4bce-4784-b039-4aeb7e6cfbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:43.148063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-70911972-4bce-4784-b039-4aeb7e6cfbc2 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:43.149677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-70911972-4bce-4784-b039-4aeb7e6cfbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:43.218655 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2305/4564] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:43.229476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56eac9-39c1-4950-8462-821889077ba4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:43.231840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be56eac9-39c1-4950-8462-821889077ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:43.242406 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2260/4565] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:04:43.272418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911972-4bce-4784-b039-4aeb7e6cfbc2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:43.278639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-70911972-4bce-4784-b039-4aeb7e6cfbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:43.340703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56eac9-39c1-4950-8462-821889077ba4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:43.350892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a416369-ec8e-44a4-8029-4b913bed1b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:43.351621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a416369-ec8e-44a4-8029-4b913bed1b1a service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:43.352736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a416369-ec8e-44a4-8029-4b913bed1b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:43.353445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a416369-ec8e-44a4-8029-4b913bed1b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:43.374034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a416369-ec8e-44a4-8029-4b913bed1b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:43.376094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a416369-ec8e-44a4-8029-4b913bed1b1a service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:43.392095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70911972-4bce-4784-b039-4aeb7e6cfbc2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:43.403631 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2306/4566] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:43.424215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4b0cbd-35bc-4a53-b56c-01a034b354a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:43.426447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b0cbd-35bc-4a53-b56c-01a034b354a4 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:43.426747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b0cbd-35bc-4a53-b56c-01a034b354a4 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:43.427242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4b0cbd-35bc-4a53-b56c-01a034b354a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:43.450268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b0cbd-35bc-4a53-b56c-01a034b354a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:43.453149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4b0cbd-35bc-4a53-b56c-01a034b354a4 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:43.469177 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2261/4567] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:04:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:04:43.715586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e595e-e303-45ae-b655-8ba46eae3159 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:43.716602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e595e-e303-45ae-b655-8ba46eae3159 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:43.717137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e595e-e303-45ae-b655-8ba46eae3159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:43.801640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-947e595e-e303-45ae-b655-8ba46eae3159 None None] MFA Rules not processed for user `f265820a8b974837949e9e3f36b58858`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:43.802322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-947e595e-e303-45ae-b655-8ba46eae3159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:44.116457 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2307/4568] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:44.129277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd0bef-adb1-473f-99a9-fc3c69f2f9ac None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:44.129875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd0bef-adb1-473f-99a9-fc3c69f2f9ac None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:44.129875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd0bef-adb1-473f-99a9-fc3c69f2f9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:44.206964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-28cd0bef-adb1-473f-99a9-fc3c69f2f9ac None None] MFA Rules not processed for user `f265820a8b974837949e9e3f36b58858`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:44.208248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-28cd0bef-adb1-473f-99a9-fc3c69f2f9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:44.242122 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2262/4569] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:44.491862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e595e-e303-45ae-b655-8ba46eae3159 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:44.499129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-947e595e-e303-45ae-b655-8ba46eae3159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:44.728299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e595e-e303-45ae-b655-8ba46eae3159 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:44.744618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a4821-8c79-4053-a7ad-c20850d26e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:44.747164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a4821-8c79-4053-a7ad-c20850d26e38 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:44.748038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a4821-8c79-4053-a7ad-c20850d26e38 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:44.750145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a4821-8c79-4053-a7ad-c20850d26e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:44.772907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a4821-8c79-4053-a7ad-c20850d26e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:44.777799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a4821-8c79-4053-a7ad-c20850d26e38 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:44.805267 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2308/4570] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:45.846195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd0bef-adb1-473f-99a9-fc3c69f2f9ac None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:45.847824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-28cd0bef-adb1-473f-99a9-fc3c69f2f9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:45.929997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd0bef-adb1-473f-99a9-fc3c69f2f9ac None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:45.938347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61085e9-306c-4d5f-a332-8efaa14e2277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:45.939440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61085e9-306c-4d5f-a332-8efaa14e2277 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:45.940071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61085e9-306c-4d5f-a332-8efaa14e2277 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:45.940666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61085e9-306c-4d5f-a332-8efaa14e2277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:45.944758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b61085e9-306c-4d5f-a332-8efaa14e2277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:45.962610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61085e9-306c-4d5f-a332-8efaa14e2277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:45.965841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61085e9-306c-4d5f-a332-8efaa14e2277 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:45.980478 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2263/4571] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:51.608784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a4821-8c79-4053-a7ad-c20850d26e38 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:51.763994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a4821-8c79-4053-a7ad-c20850d26e38 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:51.771967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:51.774439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:51.774749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:51.775019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] PATH_INFO: `/v3/users/886e92bf0c794bbfaeddcd552df2a3cc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:51.777617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886e92bf0c794bbfaeddcd552df2a3cc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:51.780779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:51.865779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886e92bf0c794bbfaeddcd552df2a3cc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:51.877586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886e92bf0c794bbfaeddcd552df2a3cc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:51.878435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886e92bf0c794bbfaeddcd552df2a3cc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:51.879745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886e92bf0c794bbfaeddcd552df2a3cc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:51.898222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886e92bf0c794bbfaeddcd552df2a3cc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:51.943559 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2309/4572] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:04:51 2022] DELETE /identity/v3/users/886e92bf0c794bbfaeddcd552df2a3cc => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:51.944361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e07610-058c-41db-8245-9aaf09e06d27 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:51.944860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e07610-058c-41db-8245-9aaf09e06d27 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:51.944966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e07610-058c-41db-8245-9aaf09e06d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:51.982357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e2e07610-058c-41db-8245-9aaf09e06d27 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:51.984448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e2e07610-058c-41db-8245-9aaf09e06d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:52.160915 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2264/4573] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:04:52.263224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:52.263224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:52.394003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ab4a1-30cc-455c-a9cc-0caa4c1ddda7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:52.403226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dfa2f-fe8c-4be2-b586-4e222a77985e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:52.404279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfa2f-fe8c-4be2-b586-4e222a77985e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:52.405148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfa2f-fe8c-4be2-b586-4e222a77985e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:52.405816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfa2f-fe8c-4be2-b586-4e222a77985e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:52.425207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dfa2f-fe8c-4be2-b586-4e222a77985e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:52.428053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dfa2f-fe8c-4be2-b586-4e222a77985e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:52.446447 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2310/4574] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:52.478834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e07610-058c-41db-8245-9aaf09e06d27 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:52.481432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e2e07610-058c-41db-8245-9aaf09e06d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:52.523495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e07610-058c-41db-8245-9aaf09e06d27 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:52.541158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344399b-39d4-4589-b71e-a56c38b50343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:52.541817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344399b-39d4-4589-b71e-a56c38b50343 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:52.542651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344399b-39d4-4589-b71e-a56c38b50343 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:52.546060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344399b-39d4-4589-b71e-a56c38b50343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:52.548165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8344399b-39d4-4589-b71e-a56c38b50343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:52.565437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344399b-39d4-4589-b71e-a56c38b50343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:52.567641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344399b-39d4-4589-b71e-a56c38b50343 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:52.582312 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2265/4575] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:54.240115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dfa2f-fe8c-4be2-b586-4e222a77985e service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:54.241934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a18dfa2f-fe8c-4be2-b586-4e222a77985e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:54.269271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dfa2f-fe8c-4be2-b586-4e222a77985e service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:54.286984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:54.288113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:54.289891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:54.292510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] PATH_INFO: `/v3/projects/9cb3a7ad720e4907adb342faacf61489` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:54.298613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cb3a7ad720e4907adb342faacf61489)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:54.304607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:54.422534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cb3a7ad720e4907adb342faacf61489', 'request_id': 'req-6ad99635-c0b0-47b0-b346-d0b229998e78'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:54.444409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cb3a7ad720e4907adb342faacf61489', 'request_id': 'req-6ad99635-c0b0-47b0-b346-d0b229998e78'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:54.458711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cb3a7ad720e4907adb342faacf61489', 'request_id': 'req-6ad99635-c0b0-47b0-b346-d0b229998e78'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:54.482954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] The token cache is being invalidate because project 9cb3a7ad720e4907adb342faacf61489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:04:54.484231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:54.485176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ad99635-c0b0-47b0-b346-d0b229998e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:04:54.486986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2311/4576] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:04:54 2022] DELETE /identity/v3/projects/9cb3a7ad720e4907adb342faacf61489 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:54.491893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912be1e-fb3c-484e-81bf-5381f948d427 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:54.493553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912be1e-fb3c-484e-81bf-5381f948d427 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:54.494096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912be1e-fb3c-484e-81bf-5381f948d427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:54.521884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d912be1e-fb3c-484e-81bf-5381f948d427 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:54.529226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d912be1e-fb3c-484e-81bf-5381f948d427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:54.645474 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2266/4577] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:54.656628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d49d7-c7e2-4676-a944-919292969a49 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:54.657178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d49d7-c7e2-4676-a944-919292969a49 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:54.657588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d49d7-c7e2-4676-a944-919292969a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:54.695325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2f8d49d7-c7e2-4676-a944-919292969a49 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:54.696815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2f8d49d7-c7e2-4676-a944-919292969a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:54.708025 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2312/4578] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:54.712076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912be1e-fb3c-484e-81bf-5381f948d427 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:54.724361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912be1e-fb3c-484e-81bf-5381f948d427 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:54.731355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54373d1-a934-4983-bca6-f7fd25362c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:54.733220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54373d1-a934-4983-bca6-f7fd25362c66 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:54.733777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54373d1-a934-4983-bca6-f7fd25362c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:54.734512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54373d1-a934-4983-bca6-f7fd25362c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:54.735543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54373d1-a934-4983-bca6-f7fd25362c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:04:54.736007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54373d1-a934-4983-bca6-f7fd25362c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:54.737839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54373d1-a934-4983-bca6-f7fd25362c66 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:54.758159 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2267/4579] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:04:54.759545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d49d7-c7e2-4676-a944-919292969a49 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:54.774869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d49d7-c7e2-4676-a944-919292969a49 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:54.781996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f5ce2-4bba-4769-90a9-ee189b30b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:54.782945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f5ce2-4bba-4769-90a9-ee189b30b397 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:54.783456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f5ce2-4bba-4769-90a9-ee189b30b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:54.784033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f5ce2-4bba-4769-90a9-ee189b30b397 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:54.784900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f5ce2-4bba-4769-90a9-ee189b30b397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:54.787670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f5ce2-4bba-4769-90a9-ee189b30b397 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:54.861991 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2313/4580] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:04:54 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:54.863742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54373d1-a934-4983-bca6-f7fd25362c66 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:54.883057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54373d1-a934-4983-bca6-f7fd25362c66 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:54.981094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bc089-84ca-413c-8f27-d07da80cec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:54.982234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bc089-84ca-413c-8f27-d07da80cec5f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:54.982678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bc089-84ca-413c-8f27-d07da80cec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:54.983155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bc089-84ca-413c-8f27-d07da80cec5f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:54.984010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bc089-84ca-413c-8f27-d07da80cec5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:54.986778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43bc089-84ca-413c-8f27-d07da80cec5f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:55.062640 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2268/4581] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:04:54 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:55.065109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f5ce2-4bba-4769-90a9-ee189b30b397 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:55.086039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f5ce2-4bba-4769-90a9-ee189b30b397 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:55.111671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716d3d-2291-49cd-8350-3ece2f5335c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:55.112672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716d3d-2291-49cd-8350-3ece2f5335c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:55.113190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716d3d-2291-49cd-8350-3ece2f5335c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:55.113686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716d3d-2291-49cd-8350-3ece2f5335c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:55.114632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716d3d-2291-49cd-8350-3ece2f5335c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:55.116874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716d3d-2291-49cd-8350-3ece2f5335c7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:55.133814 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2314/4582] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:55.136499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bc089-84ca-413c-8f27-d07da80cec5f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:55.158003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bc089-84ca-413c-8f27-d07da80cec5f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:55.168102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3abab9-e5cb-4486-84e9-545d2e88030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:55.170342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3abab9-e5cb-4486-84e9-545d2e88030e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:55.170930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3abab9-e5cb-4486-84e9-545d2e88030e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:55.171455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3abab9-e5cb-4486-84e9-545d2e88030e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:55.172534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3abab9-e5cb-4486-84e9-545d2e88030e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:55.177120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3abab9-e5cb-4486-84e9-545d2e88030e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:55.197888 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2269/4583] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:55.200735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716d3d-2291-49cd-8350-3ece2f5335c7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:55.217902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716d3d-2291-49cd-8350-3ece2f5335c7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:55.230349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c21cd6-00f6-4589-a6cc-6d42e5284713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:55.232594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c21cd6-00f6-4589-a6cc-6d42e5284713 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:55.233876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c21cd6-00f6-4589-a6cc-6d42e5284713 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:55.235514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c21cd6-00f6-4589-a6cc-6d42e5284713 admin admin] PATH_INFO: `/v3/projects/100b96fba71e4618bf68f23e69806e62/users/dd80ca6705034995858dda31338a9112/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:55.293994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c21cd6-00f6-4589-a6cc-6d42e5284713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100b96fba71e4618bf68f23e69806e62, user_id=dd80ca6705034995858dda31338a9112, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:55.304084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c21cd6-00f6-4589-a6cc-6d42e5284713 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:55.366041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fc73b-414a-42fd-b47d-43059d53bd53 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:55.366848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fc73b-414a-42fd-b47d-43059d53bd53 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:55.367139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307fc73b-414a-42fd-b47d-43059d53bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:55.368144 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2315/4584] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:55 2022] PUT /identity/v3/projects/100b96fba71e4618bf68f23e69806e62/users/dd80ca6705034995858dda31338a9112/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:04:55.461001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-307fc73b-414a-42fd-b47d-43059d53bd53 None None] MFA Rules not processed for user `dd80ca6705034995858dda31338a9112`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:55.462334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-307fc73b-414a-42fd-b47d-43059d53bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:55.640849 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2270/4585] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:04:55.644570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c21cd6-00f6-4589-a6cc-6d42e5284713 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:55.826587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c21cd6-00f6-4589-a6cc-6d42e5284713 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:55.838739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80456f48-7be7-4021-81c4-1d7fc6512966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:55.839909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80456f48-7be7-4021-81c4-1d7fc6512966 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:55.840581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80456f48-7be7-4021-81c4-1d7fc6512966 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:55.841154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80456f48-7be7-4021-81c4-1d7fc6512966 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:55.842205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80456f48-7be7-4021-81c4-1d7fc6512966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:55.846934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80456f48-7be7-4021-81c4-1d7fc6512966 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:55.920142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fc73b-414a-42fd-b47d-43059d53bd53 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:55.920369 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2316/4586] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:04:55 2022] POST /identity/v3/projects => generated 377 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:55.934799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307fc73b-414a-42fd-b47d-43059d53bd53 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:56.283545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253a75-729a-4ee1-bfdb-81b4dc2b8a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:56.284330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253a75-729a-4ee1-bfdb-81b4dc2b8a7c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:56.284622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253a75-729a-4ee1-bfdb-81b4dc2b8a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:56.284930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253a75-729a-4ee1-bfdb-81b4dc2b8a7c admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:56.285828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253a75-729a-4ee1-bfdb-81b4dc2b8a7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:56.288014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253a75-729a-4ee1-bfdb-81b4dc2b8a7c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:56.342583 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2271/4587] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:04:55 2022] POST /identity/v3/users => generated 289 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:04:56.347157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80456f48-7be7-4021-81c4-1d7fc6512966 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:56.364072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80456f48-7be7-4021-81c4-1d7fc6512966 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:56.380119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3880f74-23ed-4560-85fc-d8672f525089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:56.381143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3880f74-23ed-4560-85fc-d8672f525089 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:56.381601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3880f74-23ed-4560-85fc-d8672f525089 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:56.382195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3880f74-23ed-4560-85fc-d8672f525089 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:56.384182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3880f74-23ed-4560-85fc-d8672f525089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:56.387893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3880f74-23ed-4560-85fc-d8672f525089 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:56.419330 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2317/4588] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:56.420321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253a75-729a-4ee1-bfdb-81b4dc2b8a7c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:56.444167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253a75-729a-4ee1-bfdb-81b4dc2b8a7c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:56.452401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a6561-7473-4969-9a65-6ca0a80098bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:56.454034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a6561-7473-4969-9a65-6ca0a80098bb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:56.454505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a6561-7473-4969-9a65-6ca0a80098bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:56.454945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a6561-7473-4969-9a65-6ca0a80098bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:56.455844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a6561-7473-4969-9a65-6ca0a80098bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:56.458533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a6561-7473-4969-9a65-6ca0a80098bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:56.471021 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2272/4589] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:04:56.475464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3880f74-23ed-4560-85fc-d8672f525089 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:56.488558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3880f74-23ed-4560-85fc-d8672f525089 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:56.502097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd693178-aa0a-4ae3-af39-2f01ad7c0116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:56.503890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd693178-aa0a-4ae3-af39-2f01ad7c0116 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:56.504666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd693178-aa0a-4ae3-af39-2f01ad7c0116 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:56.505118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd693178-aa0a-4ae3-af39-2f01ad7c0116 admin admin] PATH_INFO: `/v3/projects/434a3f75bf8a4793b26e899cf3e9169c/users/bb24ad0d653f496f8a49f0fa22c4d220/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:56.530276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd693178-aa0a-4ae3-af39-2f01ad7c0116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=434a3f75bf8a4793b26e899cf3e9169c, user_id=bb24ad0d653f496f8a49f0fa22c4d220, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:56.534218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd693178-aa0a-4ae3-af39-2f01ad7c0116 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:56.571763 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2318/4590] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:56 2022] PUT /identity/v3/projects/434a3f75bf8a4793b26e899cf3e9169c/users/bb24ad0d653f496f8a49f0fa22c4d220/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:04:56.589788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee68cd-852b-40a7-bd14-ec798d88e942 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:56.590726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee68cd-852b-40a7-bd14-ec798d88e942 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:56.592006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee68cd-852b-40a7-bd14-ec798d88e942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:56.630772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d0ee68cd-852b-40a7-bd14-ec798d88e942 None None] MFA Rules not processed for user `bb24ad0d653f496f8a49f0fa22c4d220`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:56.632980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d0ee68cd-852b-40a7-bd14-ec798d88e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:56.750096 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2273/4591] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:56.754386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd693178-aa0a-4ae3-af39-2f01ad7c0116 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:56.908255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd693178-aa0a-4ae3-af39-2f01ad7c0116 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:56.912694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6805c33-6fbd-436f-85b3-65ea5b7f85bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:56.913806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6805c33-6fbd-436f-85b3-65ea5b7f85bf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:56.914096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6805c33-6fbd-436f-85b3-65ea5b7f85bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:56.914533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6805c33-6fbd-436f-85b3-65ea5b7f85bf admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:56.915479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6805c33-6fbd-436f-85b3-65ea5b7f85bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:56.918785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6805c33-6fbd-436f-85b3-65ea5b7f85bf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:56.968070 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2319/4592] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:04:56 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:56.968703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee68cd-852b-40a7-bd14-ec798d88e942 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:56.994370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee68cd-852b-40a7-bd14-ec798d88e942 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:57.171404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b972d6-dd2b-4020-905d-4f7c9906058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:57.174118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b972d6-dd2b-4020-905d-4f7c9906058e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:57.176365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b972d6-dd2b-4020-905d-4f7c9906058e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:57.176696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b972d6-dd2b-4020-905d-4f7c9906058e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:57.177419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b972d6-dd2b-4020-905d-4f7c9906058e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:57.179498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b972d6-dd2b-4020-905d-4f7c9906058e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:57.222382 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2274/4593] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:04:56 2022] POST /identity/v3/users => generated 295 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:04:57.229031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6805c33-6fbd-436f-85b3-65ea5b7f85bf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:57.257947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6805c33-6fbd-436f-85b3-65ea5b7f85bf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:57.272902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb189e-bb18-4f36-9cc3-56c696496238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:57.273792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb189e-bb18-4f36-9cc3-56c696496238 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:57.274209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb189e-bb18-4f36-9cc3-56c696496238 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:57.274602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb189e-bb18-4f36-9cc3-56c696496238 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:57.275498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb189e-bb18-4f36-9cc3-56c696496238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:57.278035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb189e-bb18-4f36-9cc3-56c696496238 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:57.313133 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2320/4594] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:57.313807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b972d6-dd2b-4020-905d-4f7c9906058e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:57.327512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b972d6-dd2b-4020-905d-4f7c9906058e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:57.341586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1b92-c6cf-4df7-a364-7bd7164531e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:57.342894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1b92-c6cf-4df7-a364-7bd7164531e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:57.345401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1b92-c6cf-4df7-a364-7bd7164531e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:57.345959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd1b92-c6cf-4df7-a364-7bd7164531e3 admin admin] PATH_INFO: `/v3/projects/3d5f2a2f6cea4a5894fe6d3688460870/users/6eb9c322364e43a9afb67ed4be4f04b3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:57.428662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd1b92-c6cf-4df7-a364-7bd7164531e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5f2a2f6cea4a5894fe6d3688460870, user_id=6eb9c322364e43a9afb67ed4be4f04b3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:57.438403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd1b92-c6cf-4df7-a364-7bd7164531e3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:57.464406 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2275/4595] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:57 2022] PUT /identity/v3/projects/3d5f2a2f6cea4a5894fe6d3688460870/users/6eb9c322364e43a9afb67ed4be4f04b3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:04:57.468785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb189e-bb18-4f36-9cc3-56c696496238 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:57.489824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb189e-bb18-4f36-9cc3-56c696496238 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:57.627727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2f4f9-cb9b-4474-a05b-8d335c03c1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:57.627727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2f4f9-cb9b-4474-a05b-8d335c03c1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:57.627727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2f4f9-cb9b-4474-a05b-8d335c03c1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:57.627727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2f4f9-cb9b-4474-a05b-8d335c03c1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:57.629442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2f4f9-cb9b-4474-a05b-8d335c03c1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:57.644104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2f4f9-cb9b-4474-a05b-8d335c03c1d6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:57.647470 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2321/4596] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:04:57.655509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1b92-c6cf-4df7-a364-7bd7164531e3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:57.677399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd1b92-c6cf-4df7-a364-7bd7164531e3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:57.689838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718fc2-51c1-40d1-99d9-68817a61cc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:57.691869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718fc2-51c1-40d1-99d9-68817a61cc5d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:57.692700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718fc2-51c1-40d1-99d9-68817a61cc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:57.693371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718fc2-51c1-40d1-99d9-68817a61cc5d admin admin] PATH_INFO: `/v3/projects/3d5f2a2f6cea4a5894fe6d3688460870/users/6eb9c322364e43a9afb67ed4be4f04b3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:57.698909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718fc2-51c1-40d1-99d9-68817a61cc5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d5f2a2f6cea4a5894fe6d3688460870, user_id=6eb9c322364e43a9afb67ed4be4f04b3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:57.704221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718fc2-51c1-40d1-99d9-68817a61cc5d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:57.716467 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2276/4597] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:04:57 2022] PUT /identity/v3/projects/3d5f2a2f6cea4a5894fe6d3688460870/users/6eb9c322364e43a9afb67ed4be4f04b3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:04:57.727620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e007c99-cd9a-47c7-8a51-2fa878ce19ed None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:57.728034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e007c99-cd9a-47c7-8a51-2fa878ce19ed None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:57.728212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e007c99-cd9a-47c7-8a51-2fa878ce19ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:57.784238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0e007c99-cd9a-47c7-8a51-2fa878ce19ed None None] MFA Rules not processed for user `6eb9c322364e43a9afb67ed4be4f04b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:04:57.789996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0e007c99-cd9a-47c7-8a51-2fa878ce19ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:57.975484 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2322/4598] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:04:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:04:57.996109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718fc2-51c1-40d1-99d9-68817a61cc5d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:57.998921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9c718fc2-51c1-40d1-99d9-68817a61cc5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:58.169186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718fc2-51c1-40d1-99d9-68817a61cc5d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:58.175769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72254b8f-f1e4-4f41-aba7-163cbf7deb04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:58.178566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72254b8f-f1e4-4f41-aba7-163cbf7deb04 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:58.178566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72254b8f-f1e4-4f41-aba7-163cbf7deb04 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:58.178566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72254b8f-f1e4-4f41-aba7-163cbf7deb04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:58.289033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72254b8f-f1e4-4f41-aba7-163cbf7deb04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:58.290757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72254b8f-f1e4-4f41-aba7-163cbf7deb04 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:58.304833 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2277/4599] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:04:59.321711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e007c99-cd9a-47c7-8a51-2fa878ce19ed None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:04:59.324235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0e007c99-cd9a-47c7-8a51-2fa878ce19ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:59.430313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e007c99-cd9a-47c7-8a51-2fa878ce19ed None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:04:59.438194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145fe62-17b1-4c9f-8911-c45d16b39442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:04:59.439044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145fe62-17b1-4c9f-8911-c45d16b39442 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:04:59.439504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145fe62-17b1-4c9f-8911-c45d16b39442 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:04:59.439899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145fe62-17b1-4c9f-8911-c45d16b39442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:04:59.442322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c145fe62-17b1-4c9f-8911-c45d16b39442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:04:59.500792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145fe62-17b1-4c9f-8911-c45d16b39442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:04:59.517578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145fe62-17b1-4c9f-8911-c45d16b39442 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:04:59.542587 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2323/4600] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:04:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:05:00.409140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5dc44-573e-423d-ae36-9a01aef2cf12 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:00.409664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5dc44-573e-423d-ae36-9a01aef2cf12 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:00.409780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5dc44-573e-423d-ae36-9a01aef2cf12 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:00.411467 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2278/4601] 10.222.0.16 () {54 vars in 962 bytes} [Sat Mar 26 21:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 26 21:05:00.420002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d869cd3-084e-4679-9892-6ae1c769940c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:00.420591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d869cd3-084e-4679-9892-6ae1c769940c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:00.420591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d869cd3-084e-4679-9892-6ae1c769940c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:00.514538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5d869cd3-084e-4679-9892-6ae1c769940c None None] MFA Rules not processed for user `416ac158078b4b678c236e0ad811acad`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:00.516055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5d869cd3-084e-4679-9892-6ae1c769940c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:00.542684 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2324/4602] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Mar 26 21:05:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:00.543648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5dc44-573e-423d-ae36-9a01aef2cf12 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:00.557775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5dc44-573e-423d-ae36-9a01aef2cf12 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:00.567041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a257dcb-2bbe-45f3-b58b-9be800054d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:00.567980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a257dcb-2bbe-45f3-b58b-9be800054d4f service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:00.568757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a257dcb-2bbe-45f3-b58b-9be800054d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:00.569209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a257dcb-2bbe-45f3-b58b-9be800054d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:00.652996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a257dcb-2bbe-45f3-b58b-9be800054d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:00.657609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a257dcb-2bbe-45f3-b58b-9be800054d4f service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:00.669544 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2279/4603] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:05:01.844344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d869cd3-084e-4679-9892-6ae1c769940c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:01.861872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d869cd3-084e-4679-9892-6ae1c769940c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:01.869626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b2118-b3b2-425d-a6c0-44d5ab1020e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:01.871335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b2118-b3b2-425d-a6c0-44d5ab1020e9 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:01.871637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b2118-b3b2-425d-a6c0-44d5ab1020e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:01.871951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b2118-b3b2-425d-a6c0-44d5ab1020e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:01.911016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b2118-b3b2-425d-a6c0-44d5ab1020e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:01.912704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b2118-b3b2-425d-a6c0-44d5ab1020e9 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:01.959601 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2325/4604] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:03.460612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a257dcb-2bbe-45f3-b58b-9be800054d4f service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:03.462209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4a257dcb-2bbe-45f3-b58b-9be800054d4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:03.653064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a257dcb-2bbe-45f3-b58b-9be800054d4f service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:03.667749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:03.668672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:03.668957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:03.669235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] PATH_INFO: `/v3/users/e891d0071e064b73b60609f0104d00f4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:03.670523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e891d0071e064b73b60609f0104d00f4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:03.672510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:03.793708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e891d0071e064b73b60609f0104d00f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:03.816290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e891d0071e064b73b60609f0104d00f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:03.817014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e891d0071e064b73b60609f0104d00f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:03.817968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e891d0071e064b73b60609f0104d00f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:03.869169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e891d0071e064b73b60609f0104d00f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:03.907773 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2280/4605] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:03 2022] DELETE /identity/v3/users/e891d0071e064b73b60609f0104d00f4 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:03.912340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b985-13ae-407f-b352-aed0b97c61c8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:03.912822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b985-13ae-407f-b352-aed0b97c61c8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:03.912916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b985-13ae-407f-b352-aed0b97c61c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:03.950132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-57a6b985-13ae-407f-b352-aed0b97c61c8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:03.951363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57a6b985-13ae-407f-b352-aed0b97c61c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:04.145459 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2326/4606] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:04.168712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:04.181664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:04.270577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7870795-a9d5-40f6-9a65-c57dd9408ed7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:04.274179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d5fd1-8ba8-4df0-9d75-3e35b9716376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:04.275119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5fd1-8ba8-4df0-9d75-3e35b9716376 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:04.275119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5fd1-8ba8-4df0-9d75-3e35b9716376 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:04.275360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d5fd1-8ba8-4df0-9d75-3e35b9716376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:04.289915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d5fd1-8ba8-4df0-9d75-3e35b9716376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:04.291896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d5fd1-8ba8-4df0-9d75-3e35b9716376 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:04.306005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2281/4607] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:04.666915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b985-13ae-407f-b352-aed0b97c61c8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:04.668916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57a6b985-13ae-407f-b352-aed0b97c61c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:04.685716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b985-13ae-407f-b352-aed0b97c61c8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:04.711826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:04.715577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:04.716713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:04.717493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] PATH_INFO: `/v3/projects/70b5ae85e2294d2f818d72b81ce595e1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:04.720099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b5ae85e2294d2f818d72b81ce595e1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:04.722194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:04.824342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b5ae85e2294d2f818d72b81ce595e1', 'request_id': 'req-21508e85-3ff1-4b85-b6c7-664706d824f3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:04.869236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b5ae85e2294d2f818d72b81ce595e1', 'request_id': 'req-21508e85-3ff1-4b85-b6c7-664706d824f3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:04.886364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b5ae85e2294d2f818d72b81ce595e1', 'request_id': 'req-21508e85-3ff1-4b85-b6c7-664706d824f3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:04.924662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] The token cache is being invalidate because project 70b5ae85e2294d2f818d72b81ce595e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:04.925724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:04.926614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:04.931678 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2327/4608] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:04 2022] DELETE /identity/v3/projects/70b5ae85e2294d2f818d72b81ce595e1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:04.934829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b357a-23c3-49c3-a298-91ff2f7f918a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:04.935727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b357a-23c3-49c3-a298-91ff2f7f918a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:04.936490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b357a-23c3-49c3-a298-91ff2f7f918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:04.999880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:05.002497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:05.007950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b06b357a-23c3-49c3-a298-91ff2f7f918a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:05.018121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b06b357a-23c3-49c3-a298-91ff2f7f918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:05.113861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21508e85-3ff1-4b85-b6c7-664706d824f3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:05.124555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e20a4b-f826-450c-9e8d-c4416d490f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:05.124555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e20a4b-f826-450c-9e8d-c4416d490f1a service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:05.124555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e20a4b-f826-450c-9e8d-c4416d490f1a service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:05.124555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e20a4b-f826-450c-9e8d-c4416d490f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:05.125277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a9e20a4b-f826-450c-9e8d-c4416d490f1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:05.189028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e20a4b-f826-450c-9e8d-c4416d490f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:05.190737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e20a4b-f826-450c-9e8d-c4416d490f1a service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:05.203134 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2282/4609] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:05.212736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ffb0b-672f-4b3f-a549-02a18cec6cf0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:05.214364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ffb0b-672f-4b3f-a549-02a18cec6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:05.215127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ffb0b-672f-4b3f-a549-02a18cec6cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:05.215572 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2328/4610] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:04 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:05.296767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cd4ffb0b-672f-4b3f-a549-02a18cec6cf0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:05.299203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cd4ffb0b-672f-4b3f-a549-02a18cec6cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:05.314059 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2283/4611] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:05.321495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e20a4b-f826-450c-9e8d-c4416d490f1a service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:05.349055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e20a4b-f826-450c-9e8d-c4416d490f1a service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:05.358432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12405923-afc7-4d55-9896-9a3f7b90dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:05.359754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12405923-afc7-4d55-9896-9a3f7b90dc08 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:05.360455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12405923-afc7-4d55-9896-9a3f7b90dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:05.361131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12405923-afc7-4d55-9896-9a3f7b90dc08 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:05.362980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12405923-afc7-4d55-9896-9a3f7b90dc08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:05:05.363615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12405923-afc7-4d55-9896-9a3f7b90dc08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:05.367479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12405923-afc7-4d55-9896-9a3f7b90dc08 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:05.415002 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2329/4612] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:05:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:05.419931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ffb0b-672f-4b3f-a549-02a18cec6cf0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:05.444859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ffb0b-672f-4b3f-a549-02a18cec6cf0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:05.455233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826b44-c0e7-45d6-98c8-4c79a21d8270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:05.456567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826b44-c0e7-45d6-98c8-4c79a21d8270 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:05.457281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826b44-c0e7-45d6-98c8-4c79a21d8270 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:05.457970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48826b44-c0e7-45d6-98c8-4c79a21d8270 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:05.459944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826b44-c0e7-45d6-98c8-4c79a21d8270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:05.464566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48826b44-c0e7-45d6-98c8-4c79a21d8270 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:05.538508 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2284/4613] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:05 2022] POST /identity/v3/projects => generated 359 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:05.542548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12405923-afc7-4d55-9896-9a3f7b90dc08 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:05.559886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12405923-afc7-4d55-9896-9a3f7b90dc08 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:05.730081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9e18f-07e3-48b8-a40c-a6e0820e9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:05.731023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9e18f-07e3-48b8-a40c-a6e0820e9fff admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:05.731377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9e18f-07e3-48b8-a40c-a6e0820e9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:05.731728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9e18f-07e3-48b8-a40c-a6e0820e9fff admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:05.732768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9e18f-07e3-48b8-a40c-a6e0820e9fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:05.735554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9e18f-07e3-48b8-a40c-a6e0820e9fff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:05.799591 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2330/4614] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:05 2022] POST /identity/v3/users => generated 280 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:05.802840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826b44-c0e7-45d6-98c8-4c79a21d8270 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:05.821072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48826b44-c0e7-45d6-98c8-4c79a21d8270 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:05.835508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589eb6-e89b-4b62-a0dc-2091980ea6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:05.837368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589eb6-e89b-4b62-a0dc-2091980ea6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:05.837945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589eb6-e89b-4b62-a0dc-2091980ea6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:05.839832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8589eb6-e89b-4b62-a0dc-2091980ea6f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:05.841028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8589eb6-e89b-4b62-a0dc-2091980ea6f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:05.842978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8589eb6-e89b-4b62-a0dc-2091980ea6f2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:05.863905 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2285/4615] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:05.869239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9e18f-07e3-48b8-a40c-a6e0820e9fff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:05.904811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9e18f-07e3-48b8-a40c-a6e0820e9fff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:05.915813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156d563-64e3-432a-8f6f-345254980e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:05.921721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156d563-64e3-432a-8f6f-345254980e3d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:05.922012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156d563-64e3-432a-8f6f-345254980e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:05.922536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156d563-64e3-432a-8f6f-345254980e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:05.923458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156d563-64e3-432a-8f6f-345254980e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:05.927906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156d563-64e3-432a-8f6f-345254980e3d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:05.962764 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2331/4616] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:05.963655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589eb6-e89b-4b62-a0dc-2091980ea6f2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:05.987696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8589eb6-e89b-4b62-a0dc-2091980ea6f2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:05.997908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d564be4-7235-4111-983a-baa880853de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:05.999417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d564be4-7235-4111-983a-baa880853de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:06.000147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d564be4-7235-4111-983a-baa880853de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:06.000572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d564be4-7235-4111-983a-baa880853de4 admin admin] PATH_INFO: `/v3/projects/cedd45db640644088124f54b89de447a/users/c831133806b34840bc6b555364573d0b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:06.052717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d564be4-7235-4111-983a-baa880853de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cedd45db640644088124f54b89de447a, user_id=c831133806b34840bc6b555364573d0b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:06.070655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d564be4-7235-4111-983a-baa880853de4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:06.090529 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2286/4617] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:05 2022] PUT /identity/v3/projects/cedd45db640644088124f54b89de447a/users/c831133806b34840bc6b555364573d0b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:06.101091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e0092-4ac5-4400-a7dd-a5157889b36b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:06.101376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e0092-4ac5-4400-a7dd-a5157889b36b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:06.101863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e0092-4ac5-4400-a7dd-a5157889b36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:06.133650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a98e0092-4ac5-4400-a7dd-a5157889b36b None None] MFA Rules not processed for user `c831133806b34840bc6b555364573d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:06.135163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a98e0092-4ac5-4400-a7dd-a5157889b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:06.261217 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2332/4618] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:06 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:06.276285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d564be4-7235-4111-983a-baa880853de4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:06.279032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1d564be4-7235-4111-983a-baa880853de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:06.432665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d564be4-7235-4111-983a-baa880853de4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:06.447763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ee1e4-5ad0-4293-9b7c-cfb2841ddd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:06.449029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ee1e4-5ad0-4293-9b7c-cfb2841ddd96 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:06.450137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ee1e4-5ad0-4293-9b7c-cfb2841ddd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:06.450628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ee1e4-5ad0-4293-9b7c-cfb2841ddd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:06.470313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ee1e4-5ad0-4293-9b7c-cfb2841ddd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:06.471802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295ee1e4-5ad0-4293-9b7c-cfb2841ddd96 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:06.483613 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2287/4619] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:06 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:06.764951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e0092-4ac5-4400-a7dd-a5157889b36b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:06.766625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a98e0092-4ac5-4400-a7dd-a5157889b36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:06.866677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e0092-4ac5-4400-a7dd-a5157889b36b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:06.872175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:06.873284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:06.873714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:06.874235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] PATH_INFO: `/v3/users/dd80ca6705034995858dda31338a9112` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:06.875853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd80ca6705034995858dda31338a9112)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:06.878265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:06.941794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd80ca6705034995858dda31338a9112'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:06.954547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd80ca6705034995858dda31338a9112'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:06.955707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd80ca6705034995858dda31338a9112'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:06.956437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd80ca6705034995858dda31338a9112'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:06.965935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd80ca6705034995858dda31338a9112'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:07.007158 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2333/4620] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:06 2022] DELETE /identity/v3/users/dd80ca6705034995858dda31338a9112 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:07.007594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551d30d-227c-4408-a900-85248ff7c046 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:07.008092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551d30d-227c-4408-a900-85248ff7c046 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:07.008321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551d30d-227c-4408-a900-85248ff7c046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:07.039821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6551d30d-227c-4408-a900-85248ff7c046 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:07.041288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6551d30d-227c-4408-a900-85248ff7c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:07.130141 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2288/4621] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:07.161966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:07.164197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:07.267855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aef853-cd26-421f-914a-2f32b69a0539 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:07.272128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da073b-4e5e-48f8-8a34-a2a3bb4ce15d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:07.272805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da073b-4e5e-48f8-8a34-a2a3bb4ce15d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:07.273091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da073b-4e5e-48f8-8a34-a2a3bb4ce15d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:07.273773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da073b-4e5e-48f8-8a34-a2a3bb4ce15d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:07.284108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da073b-4e5e-48f8-8a34-a2a3bb4ce15d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:07.285742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da073b-4e5e-48f8-8a34-a2a3bb4ce15d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:07.299083 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2334/4622] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:08.474987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551d30d-227c-4408-a900-85248ff7c046 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:08.476664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6551d30d-227c-4408-a900-85248ff7c046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:08.489775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551d30d-227c-4408-a900-85248ff7c046 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:08.494523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:08.495453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:08.495730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:08.496042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] PATH_INFO: `/v3/projects/100b96fba71e4618bf68f23e69806e62` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:08.497858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=100b96fba71e4618bf68f23e69806e62)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:08.499896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:08.579081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100b96fba71e4618bf68f23e69806e62', 'request_id': 'req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.590429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100b96fba71e4618bf68f23e69806e62', 'request_id': 'req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.598131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100b96fba71e4618bf68f23e69806e62', 'request_id': 'req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.610886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] The token cache is being invalidate because project 100b96fba71e4618bf68f23e69806e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:08.611174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.612072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.614523 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2289/4623] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:08 2022] DELETE /identity/v3/projects/100b96fba71e4618bf68f23e69806e62 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:08.618882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da073b-4e5e-48f8-8a34-a2a3bb4ce15d service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:08.629404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da073b-4e5e-48f8-8a34-a2a3bb4ce15d service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:08.729656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:08.731220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:08.731750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:08.732335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] PATH_INFO: `/v3/users/bb24ad0d653f496f8a49f0fa22c4d220` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:08.733825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb24ad0d653f496f8a49f0fa22c4d220)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:08.736235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:08.830747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb24ad0d653f496f8a49f0fa22c4d220'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.846957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb24ad0d653f496f8a49f0fa22c4d220'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.848793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb24ad0d653f496f8a49f0fa22c4d220'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.850542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb24ad0d653f496f8a49f0fa22c4d220'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.875269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb24ad0d653f496f8a49f0fa22c4d220'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:08.924492 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2335/4624] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:08 2022] DELETE /identity/v3/users/bb24ad0d653f496f8a49f0fa22c4d220 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:09.592818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:09.595360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:09.616671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:09.622320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:09.832799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68757e91-dea2-45ab-84d3-112fae20520e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:09.842954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6566db-bc37-4b60-b3e9-5c9cb93b0bf5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:09.843442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:09.844548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:09.845036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:09.845634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] PATH_INFO: `/v3/users/cbbebd48cec04499a06386f886c8f99c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:09.847233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbbebd48cec04499a06386f886c8f99c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:09.849509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:09.916062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbbebd48cec04499a06386f886c8f99c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:09.927291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbbebd48cec04499a06386f886c8f99c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:09.928370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbbebd48cec04499a06386f886c8f99c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:09.929245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbbebd48cec04499a06386f886c8f99c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:09.945070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbbebd48cec04499a06386f886c8f99c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:09.980967 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2336/4625] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:09 2022] DELETE /identity/v3/users/cbbebd48cec04499a06386f886c8f99c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:09.986201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:09.986201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:09.986478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:09.986591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:09.995451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:10.027519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:10.034733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:10.071484 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2290/4626] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:05:10.250656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:10.252671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:10.333836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:10.335785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:10.358321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7689c1-2e29-451b-ac59-ecff0710c4e7 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:10.414856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d33166-3310-49a3-bb73-d51ad2da70c3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:10.422973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:10.424704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:10.425265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:10.425804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] PATH_INFO: `/v3/projects/434a3f75bf8a4793b26e899cf3e9169c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:10.427651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=434a3f75bf8a4793b26e899cf3e9169c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:10.431277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:10.447409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:10.448638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:10.449568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:10.450375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] PATH_INFO: `/v3/projects/3652534f0b48491f895462536365ef07` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:10.452534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3652534f0b48491f895462536365ef07)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:10.455360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:10.520849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3652534f0b48491f895462536365ef07', 'request_id': 'req-2b260023-b303-4763-83d5-416c1d7a8002'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.537340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3652534f0b48491f895462536365ef07', 'request_id': 'req-2b260023-b303-4763-83d5-416c1d7a8002'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.546304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3652534f0b48491f895462536365ef07', 'request_id': 'req-2b260023-b303-4763-83d5-416c1d7a8002'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.554157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434a3f75bf8a4793b26e899cf3e9169c', 'request_id': 'req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.570868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434a3f75bf8a4793b26e899cf3e9169c', 'request_id': 'req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.573533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] The token cache is being invalidate because project 3652534f0b48491f895462536365ef07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:10.573849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.583415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b260023-b303-4763-83d5-416c1d7a8002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.588910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434a3f75bf8a4793b26e899cf3e9169c', 'request_id': 'req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.590345 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2291/4627] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:10 2022] DELETE /identity/v3/projects/3652534f0b48491f895462536365ef07 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:10.599098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f84c-4b36-4e06-9b07-d283d878f7e9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:10.600049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f84c-4b36-4e06-9b07-d283d878f7e9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:10.601025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600f84c-4b36-4e06-9b07-d283d878f7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:10.613040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] The token cache is being invalidate because project 434a3f75bf8a4793b26e899cf3e9169c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:10.613337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.614116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.616321 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2337/4628] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:10 2022] DELETE /identity/v3/projects/434a3f75bf8a4793b26e899cf3e9169c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:10.620504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:10.622940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:10.645836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5600f84c-4b36-4e06-9b07-d283d878f7e9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:10.650512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5600f84c-4b36-4e06-9b07-d283d878f7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:10.755181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4ed7c-0390-4042-b2a7-a11de5c43a8e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:10.781137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:10.781969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:10.782261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:10.782536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] PATH_INFO: `/v3/users/6eb9c322364e43a9afb67ed4be4f04b3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:10.785518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb9c322364e43a9afb67ed4be4f04b3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:10.791811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:10.821963 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2292/4629] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:10.824026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1c59-ad0e-42d1-9229-fc2dc62b86dc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:10.824490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1c59-ad0e-42d1-9229-fc2dc62b86dc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:10.824919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1c59-ad0e-42d1-9229-fc2dc62b86dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:10.865088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-046c1c59-ad0e-42d1-9229-fc2dc62b86dc None None] MFA Rules not processed for user `f265820a8b974837949e9e3f36b58858`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:10.866367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-046c1c59-ad0e-42d1-9229-fc2dc62b86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:10.868162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb9c322364e43a9afb67ed4be4f04b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.877155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb9c322364e43a9afb67ed4be4f04b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.878013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb9c322364e43a9afb67ed4be4f04b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.878982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb9c322364e43a9afb67ed4be4f04b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.892087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-82bdd01d-eaeb-49bf-b41c-d4f92b9e22c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb9c322364e43a9afb67ed4be4f04b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:10.932782 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2338/4630] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:10 2022] DELETE /identity/v3/users/6eb9c322364e43a9afb67ed4be4f04b3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:10.935973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c31d83-32d3-441a-aec6-dfbef62d4f2d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:10.936431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c31d83-32d3-441a-aec6-dfbef62d4f2d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:10.936893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c31d83-32d3-441a-aec6-dfbef62d4f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:11.014762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-85c31d83-32d3-441a-aec6-dfbef62d4f2d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:11.016008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-85c31d83-32d3-441a-aec6-dfbef62d4f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:11.032808 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2293/4631] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:11.210313 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2339/4632] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:11.214690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1c59-ad0e-42d1-9229-fc2dc62b86dc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:11.230844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1c59-ad0e-42d1-9229-fc2dc62b86dc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:11.247467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea781ea-15c7-42ff-9cc5-d17c3599a5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:11.251124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea781ea-15c7-42ff-9cc5-d17c3599a5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:11.253117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea781ea-15c7-42ff-9cc5-d17c3599a5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:11.253657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea781ea-15c7-42ff-9cc5-d17c3599a5e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:11.254653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea781ea-15c7-42ff-9cc5-d17c3599a5e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:05:11.257181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea781ea-15c7-42ff-9cc5-d17c3599a5e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:11.261381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea781ea-15c7-42ff-9cc5-d17c3599a5e5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:11.300582 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2294/4633] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:11.304838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c31d83-32d3-441a-aec6-dfbef62d4f2d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:11.323558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c31d83-32d3-441a-aec6-dfbef62d4f2d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:11.330856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d573-0130-4e7d-b7ee-40cee3724875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:11.332186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d573-0130-4e7d-b7ee-40cee3724875 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:11.332186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d573-0130-4e7d-b7ee-40cee3724875 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:11.332692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3d573-0130-4e7d-b7ee-40cee3724875 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:11.333700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3d573-0130-4e7d-b7ee-40cee3724875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:11.338869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3d573-0130-4e7d-b7ee-40cee3724875 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:11.407374 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2340/4634] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:11 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:11.412032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea781ea-15c7-42ff-9cc5-d17c3599a5e5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:11.426887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea781ea-15c7-42ff-9cc5-d17c3599a5e5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:11.566916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec2914-4695-458f-9cac-63bed809665e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:11.568092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec2914-4695-458f-9cac-63bed809665e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:11.568751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec2914-4695-458f-9cac-63bed809665e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:11.569179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec2914-4695-458f-9cac-63bed809665e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:11.570264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec2914-4695-458f-9cac-63bed809665e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:11.572624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec2914-4695-458f-9cac-63bed809665e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:11.623582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d573-0130-4e7d-b7ee-40cee3724875 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:11.624271 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2295/4635] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:11 2022] POST /identity/v3/users => generated 284 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:11.635775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3d573-0130-4e7d-b7ee-40cee3724875 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:11.655669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517a27e-b783-4a0d-b23e-7930a2a9c14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:11.656518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517a27e-b783-4a0d-b23e-7930a2a9c14d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:11.657016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517a27e-b783-4a0d-b23e-7930a2a9c14d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:11.657367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7517a27e-b783-4a0d-b23e-7930a2a9c14d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:11.658452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517a27e-b783-4a0d-b23e-7930a2a9c14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:11.660688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7517a27e-b783-4a0d-b23e-7930a2a9c14d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:11.677949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2341/4636] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:11.682698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec2914-4695-458f-9cac-63bed809665e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:11.693807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec2914-4695-458f-9cac-63bed809665e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:11.699540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5e571-5559-4463-9b75-734be7360b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:11.700555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e571-5559-4463-9b75-734be7360b5b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:11.701035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e571-5559-4463-9b75-734be7360b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:11.701661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5e571-5559-4463-9b75-734be7360b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:11.702587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5e571-5559-4463-9b75-734be7360b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:11.704520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5e571-5559-4463-9b75-734be7360b5b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:11.717202 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2296/4637] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:11.721612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517a27e-b783-4a0d-b23e-7930a2a9c14d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:11.735780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7517a27e-b783-4a0d-b23e-7930a2a9c14d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:11.741559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbee7b2-e669-449f-a201-407c88a444f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:11.743116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbee7b2-e669-449f-a201-407c88a444f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:11.743749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbee7b2-e669-449f-a201-407c88a444f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:11.744344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbee7b2-e669-449f-a201-407c88a444f8 admin admin] PATH_INFO: `/v3/projects/62670a489b2b43b78d9e1e71371e7886/users/4a76b26808b84a2ba82f49753035dd89/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:11.766145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbee7b2-e669-449f-a201-407c88a444f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62670a489b2b43b78d9e1e71371e7886, user_id=4a76b26808b84a2ba82f49753035dd89, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:11.769819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbee7b2-e669-449f-a201-407c88a444f8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:11.798491 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2342/4638] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:11 2022] PUT /identity/v3/projects/62670a489b2b43b78d9e1e71371e7886/users/4a76b26808b84a2ba82f49753035dd89/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:11.800095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f9db-e6ee-425b-990b-1e4c04a4622f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:11.800651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f9db-e6ee-425b-990b-1e4c04a4622f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:11.801178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294f9db-e6ee-425b-990b-1e4c04a4622f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:11.834738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3294f9db-e6ee-425b-990b-1e4c04a4622f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:11.836253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3294f9db-e6ee-425b-990b-1e4c04a4622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:11.860170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbee7b2-e669-449f-a201-407c88a444f8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:11.862949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3dbee7b2-e669-449f-a201-407c88a444f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:12.051856 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2297/4639] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:12.073497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f9db-e6ee-425b-990b-1e4c04a4622f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:12.075961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3294f9db-e6ee-425b-990b-1e4c04a4622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:12.106370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbee7b2-e669-449f-a201-407c88a444f8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:12.119207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:12.120515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:12.123073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:12.123621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:12.128539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:12.262780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294f9db-e6ee-425b-990b-1e4c04a4622f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:12.278796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce3dbb-5ef3-41c4-bb3d-c82934caf030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:12.279390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce3dbb-5ef3-41c4-bb3d-c82934caf030 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:12.279679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce3dbb-5ef3-41c4-bb3d-c82934caf030 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:12.280000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce3dbb-5ef3-41c4-bb3d-c82934caf030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:12.281934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c8ce3dbb-5ef3-41c4-bb3d-c82934caf030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:12.334103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce3dbb-5ef3-41c4-bb3d-c82934caf030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:12.337364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce3dbb-5ef3-41c4-bb3d-c82934caf030 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:12.350410 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2298/4640] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:05:12.355456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:12.357216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:12.361309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce3dbb-5ef3-41c4-bb3d-c82934caf030 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:12.377863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce3dbb-5ef3-41c4-bb3d-c82934caf030 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:12.387131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2e38d-8584-48ad-81eb-50d3bb369a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:12.387902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e38d-8584-48ad-81eb-50d3bb369a1f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:12.388206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e38d-8584-48ad-81eb-50d3bb369a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:12.388548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2e38d-8584-48ad-81eb-50d3bb369a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:12.410037 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2343/4641] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:12.435114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2e38d-8584-48ad-81eb-50d3bb369a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:12.436816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2e38d-8584-48ad-81eb-50d3bb369a1f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:12.463477 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2299/4642] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:12.554188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:12.555703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:12.588064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c534f4-ec50-47ab-91b7-2d76b0a75633 service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:12.599758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab07c7-ed4d-4570-b520-7f6963b0c17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:12.603321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab07c7-ed4d-4570-b520-7f6963b0c17a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:12.603516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab07c7-ed4d-4570-b520-7f6963b0c17a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:12.603840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab07c7-ed4d-4570-b520-7f6963b0c17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:12.609163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6dab07c7-ed4d-4570-b520-7f6963b0c17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:12.642323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab07c7-ed4d-4570-b520-7f6963b0c17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:12.644898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab07c7-ed4d-4570-b520-7f6963b0c17a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:12.667566 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2344/4643] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:12.757884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2e38d-8584-48ad-81eb-50d3bb369a1f service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:12.761820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f6b2e38d-8584-48ad-81eb-50d3bb369a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:12.781199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2e38d-8584-48ad-81eb-50d3bb369a1f service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:12.796944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:12.801513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:12.802922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:12.804341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] PATH_INFO: `/v3/projects/3d5f2a2f6cea4a5894fe6d3688460870` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:12.808028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d5f2a2f6cea4a5894fe6d3688460870)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:12.810649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:12.890036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5f2a2f6cea4a5894fe6d3688460870', 'request_id': 'req-0dc2f7af-c6db-4365-8d04-f7e4604232dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:12.905894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5f2a2f6cea4a5894fe6d3688460870', 'request_id': 'req-0dc2f7af-c6db-4365-8d04-f7e4604232dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:12.916874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5f2a2f6cea4a5894fe6d3688460870', 'request_id': 'req-0dc2f7af-c6db-4365-8d04-f7e4604232dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:12.934946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] The token cache is being invalidate because project 3d5f2a2f6cea4a5894fe6d3688460870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:12.935407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:12.936322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0dc2f7af-c6db-4365-8d04-f7e4604232dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:12.941269 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2300/4644] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:12 2022] DELETE /identity/v3/projects/3d5f2a2f6cea4a5894fe6d3688460870 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:12.944015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838152-9392-4da7-8df7-86ebdaa19c82 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:12.944220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838152-9392-4da7-8df7-86ebdaa19c82 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:12.944501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838152-9392-4da7-8df7-86ebdaa19c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:12.967173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-aa838152-9392-4da7-8df7-86ebdaa19c82 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:12.969142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aa838152-9392-4da7-8df7-86ebdaa19c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:13.129440 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2345/4645] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:13.135452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7586b1-fea8-4586-b053-c744f1de4698 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:13.135814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7586b1-fea8-4586-b053-c744f1de4698 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:13.136236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7586b1-fea8-4586-b053-c744f1de4698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:13.194415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9d7586b1-fea8-4586-b053-c744f1de4698 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:13.200809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d7586b1-fea8-4586-b053-c744f1de4698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:13.221315 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2301/4646] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:13.226462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838152-9392-4da7-8df7-86ebdaa19c82 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:13.244124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838152-9392-4da7-8df7-86ebdaa19c82 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:13.257557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f23ef-d29a-4d51-9ccd-08404bb09f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:13.258518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f23ef-d29a-4d51-9ccd-08404bb09f23 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:13.259001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f23ef-d29a-4d51-9ccd-08404bb09f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:13.259437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f23ef-d29a-4d51-9ccd-08404bb09f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:13.260476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f23ef-d29a-4d51-9ccd-08404bb09f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:05:13.261149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f23ef-d29a-4d51-9ccd-08404bb09f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:13.267106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f23ef-d29a-4d51-9ccd-08404bb09f23 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:13.299807 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2346/4647] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:13.305430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7586b1-fea8-4586-b053-c744f1de4698 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:13.323024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7586b1-fea8-4586-b053-c744f1de4698 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:13.336092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9423a-07f1-4655-a9d3-fd3bc37718ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:13.336866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9423a-07f1-4655-a9d3-fd3bc37718ab admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:13.337205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9423a-07f1-4655-a9d3-fd3bc37718ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:13.337538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9423a-07f1-4655-a9d3-fd3bc37718ab admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:13.341101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9423a-07f1-4655-a9d3-fd3bc37718ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:13.343889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9423a-07f1-4655-a9d3-fd3bc37718ab admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:13.413726 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2302/4648] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:13 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:13.414855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f23ef-d29a-4d51-9ccd-08404bb09f23 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:13.449103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f23ef-d29a-4d51-9ccd-08404bb09f23 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:13.765412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fd60f-0582-46e0-9c24-1e191ec59976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:13.768053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fd60f-0582-46e0-9c24-1e191ec59976 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:13.768859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fd60f-0582-46e0-9c24-1e191ec59976 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:13.771985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fd60f-0582-46e0-9c24-1e191ec59976 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:13.773530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fd60f-0582-46e0-9c24-1e191ec59976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:13.779843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fd60f-0582-46e0-9c24-1e191ec59976 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:13.871251 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2347/4649] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:13 2022] POST /identity/v3/users => generated 292 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:13.875744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9423a-07f1-4655-a9d3-fd3bc37718ab admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:13.891299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9423a-07f1-4655-a9d3-fd3bc37718ab admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:13.924709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430ec4-232f-41d9-be01-cfe96e28a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:13.925400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430ec4-232f-41d9-be01-cfe96e28a5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:13.925682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430ec4-232f-41d9-be01-cfe96e28a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:13.925964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430ec4-232f-41d9-be01-cfe96e28a5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:13.926766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6430ec4-232f-41d9-be01-cfe96e28a5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:13.929161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6430ec4-232f-41d9-be01-cfe96e28a5a0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:13.977911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fd60f-0582-46e0-9c24-1e191ec59976 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:13.993064 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2303/4650] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:13.996094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fd60f-0582-46e0-9c24-1e191ec59976 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:14.015588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912d463-f1ea-42fe-8a36-672155812a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:14.017406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912d463-f1ea-42fe-8a36-672155812a31 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:14.019869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912d463-f1ea-42fe-8a36-672155812a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:14.020372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912d463-f1ea-42fe-8a36-672155812a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:14.022188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912d463-f1ea-42fe-8a36-672155812a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:14.036284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912d463-f1ea-42fe-8a36-672155812a31 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:14.080949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2348/4651] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:14.085717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430ec4-232f-41d9-be01-cfe96e28a5a0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:14.106156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430ec4-232f-41d9-be01-cfe96e28a5a0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:14.135951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4de536-9966-4b08-b83f-f89e4c6eebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:14.137092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de536-9966-4b08-b83f-f89e4c6eebba admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:14.141108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de536-9966-4b08-b83f-f89e4c6eebba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:14.142063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de536-9966-4b08-b83f-f89e4c6eebba admin admin] PATH_INFO: `/v3/projects/ff7fbf8ed36f46d5934e9967cb604a8e/users/2cb760e247964721bf5933dac15c7669/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:14.206647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4de536-9966-4b08-b83f-f89e4c6eebba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7fbf8ed36f46d5934e9967cb604a8e, user_id=2cb760e247964721bf5933dac15c7669, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:14.215582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4de536-9966-4b08-b83f-f89e4c6eebba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:14.242583 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2304/4652] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:14 2022] PUT /identity/v3/projects/ff7fbf8ed36f46d5934e9967cb604a8e/users/2cb760e247964721bf5933dac15c7669/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:14.257803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efd27a-26e8-4f15-a4c4-4ae635d833fc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:14.257803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efd27a-26e8-4f15-a4c4-4ae635d833fc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:14.257803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efd27a-26e8-4f15-a4c4-4ae635d833fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:14.341493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e4efd27a-26e8-4f15-a4c4-4ae635d833fc None None] MFA Rules not processed for user `2cb760e247964721bf5933dac15c7669`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:14.343189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e4efd27a-26e8-4f15-a4c4-4ae635d833fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:14.496602 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2349/4653] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:14.501249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4de536-9966-4b08-b83f-f89e4c6eebba admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:14.688337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4de536-9966-4b08-b83f-f89e4c6eebba admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:14.702264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd897e7-b712-4cc4-a964-1d72ddc7a708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:14.702962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd897e7-b712-4cc4-a964-1d72ddc7a708 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:14.703254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd897e7-b712-4cc4-a964-1d72ddc7a708 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:14.703541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd897e7-b712-4cc4-a964-1d72ddc7a708 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:14.704324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd897e7-b712-4cc4-a964-1d72ddc7a708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:14.708389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd897e7-b712-4cc4-a964-1d72ddc7a708 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:14.753555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2305/4654] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:14 2022] POST /identity/v3/projects => generated 383 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:14.758081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efd27a-26e8-4f15-a4c4-4ae635d833fc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:14.779286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efd27a-26e8-4f15-a4c4-4ae635d833fc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:14.913260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80a1cc-562d-4ab5-b88b-2245f7bc58f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:14.914329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80a1cc-562d-4ab5-b88b-2245f7bc58f3 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:14.915311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80a1cc-562d-4ab5-b88b-2245f7bc58f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:14.916153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80a1cc-562d-4ab5-b88b-2245f7bc58f3 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:14.917123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80a1cc-562d-4ab5-b88b-2245f7bc58f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:14.919977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80a1cc-562d-4ab5-b88b-2245f7bc58f3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:14.956043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd897e7-b712-4cc4-a964-1d72ddc7a708 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:14.957775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2350/4655] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:14 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:14.972815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd897e7-b712-4cc4-a964-1d72ddc7a708 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:14.982908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385120-f3a0-4c0d-9b84-125dd4f748b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:14.983906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385120-f3a0-4c0d-9b84-125dd4f748b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:14.984434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385120-f3a0-4c0d-9b84-125dd4f748b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:14.984904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385120-f3a0-4c0d-9b84-125dd4f748b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:14.986204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53385120-f3a0-4c0d-9b84-125dd4f748b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:14.991336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53385120-f3a0-4c0d-9b84-125dd4f748b1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:15.018481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80a1cc-562d-4ab5-b88b-2245f7bc58f3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:15.019601 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2306/4656] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:05:15.036532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80a1cc-562d-4ab5-b88b-2245f7bc58f3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:15.044522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136526e-4126-4f96-937c-c9f0dc4d7a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:15.045907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136526e-4126-4f96-937c-c9f0dc4d7a7e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:15.046710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136526e-4126-4f96-937c-c9f0dc4d7a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:15.047451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136526e-4126-4f96-937c-c9f0dc4d7a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:15.048727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136526e-4126-4f96-937c-c9f0dc4d7a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:15.050873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136526e-4126-4f96-937c-c9f0dc4d7a7e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:15.086252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385120-f3a0-4c0d-9b84-125dd4f748b1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:15.099449 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2351/4657] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:05:15.105830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385120-f3a0-4c0d-9b84-125dd4f748b1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:15.112919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6b7af-6517-4766-943a-67c51af8a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:15.114395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6b7af-6517-4766-943a-67c51af8a515 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:15.115065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6b7af-6517-4766-943a-67c51af8a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:15.116481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6b7af-6517-4766-943a-67c51af8a515 admin admin] PATH_INFO: `/v3/projects/066fc36c76ce4f70865c7df75cced099/users/869d6d5d5d1742988f3d963bbacc3793/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:15.138699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6b7af-6517-4766-943a-67c51af8a515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=066fc36c76ce4f70865c7df75cced099, user_id=869d6d5d5d1742988f3d963bbacc3793, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:15.142213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6b7af-6517-4766-943a-67c51af8a515 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:15.188791 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2307/4658] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:15 2022] PUT /identity/v3/projects/066fc36c76ce4f70865c7df75cced099/users/869d6d5d5d1742988f3d963bbacc3793/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:15.189074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af63e-f457-4930-828b-619610b48f14 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:15.189527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af63e-f457-4930-828b-619610b48f14 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:15.190015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166af63e-f457-4930-828b-619610b48f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:15.233932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-166af63e-f457-4930-828b-619610b48f14 None None] MFA Rules not processed for user `869d6d5d5d1742988f3d963bbacc3793`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:15.235763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-166af63e-f457-4930-828b-619610b48f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:15.428832 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2352/4659] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:15.434818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6b7af-6517-4766-943a-67c51af8a515 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:15.591621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6b7af-6517-4766-943a-67c51af8a515 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:15.600788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595478b-dd98-462a-873e-19d120c01dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:15.603884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595478b-dd98-462a-873e-19d120c01dde admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:15.604568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595478b-dd98-462a-873e-19d120c01dde admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:15.605201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595478b-dd98-462a-873e-19d120c01dde admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:15.606086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595478b-dd98-462a-873e-19d120c01dde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:15.611788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595478b-dd98-462a-873e-19d120c01dde admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:15.662582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166af63e-f457-4930-828b-619610b48f14 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:15.663198 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2308/4660] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:15 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:15.681778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166af63e-f457-4930-828b-619610b48f14 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:15.811365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a033d-12a1-4159-b56a-60b7ead6418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:15.812495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a033d-12a1-4159-b56a-60b7ead6418d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:15.812495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a033d-12a1-4159-b56a-60b7ead6418d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:15.812776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a033d-12a1-4159-b56a-60b7ead6418d admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:15.813279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a033d-12a1-4159-b56a-60b7ead6418d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:15.815436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a033d-12a1-4159-b56a-60b7ead6418d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:15.898804 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2353/4661] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:15 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:15.905992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595478b-dd98-462a-873e-19d120c01dde admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:15.923009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595478b-dd98-462a-873e-19d120c01dde admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:15.933352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f484f-474b-4533-8076-40e678667748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:15.935188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f484f-474b-4533-8076-40e678667748 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:15.935600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f484f-474b-4533-8076-40e678667748 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:15.936040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f484f-474b-4533-8076-40e678667748 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:15.937700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f484f-474b-4533-8076-40e678667748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:15.939655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f484f-474b-4533-8076-40e678667748 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:15.963183 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2309/4662] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:15.966835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a033d-12a1-4159-b56a-60b7ead6418d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:16.007852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a033d-12a1-4159-b56a-60b7ead6418d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:16.015248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e902e-9ad5-43e4-b806-3a96f02b5278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:16.017610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e902e-9ad5-43e4-b806-3a96f02b5278 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:16.018259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e902e-9ad5-43e4-b806-3a96f02b5278 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:16.019038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e902e-9ad5-43e4-b806-3a96f02b5278 admin admin] PATH_INFO: `/v3/projects/7dc040735ea84212bb1d8d0408caf489/users/4b09fc0f61bc4ca1acbad97cb11376a5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:16.063063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e902e-9ad5-43e4-b806-3a96f02b5278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc040735ea84212bb1d8d0408caf489, user_id=4b09fc0f61bc4ca1acbad97cb11376a5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:16.067833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e902e-9ad5-43e4-b806-3a96f02b5278 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:16.113192 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2354/4663] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:15 2022] PUT /identity/v3/projects/7dc040735ea84212bb1d8d0408caf489/users/4b09fc0f61bc4ca1acbad97cb11376a5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:16.121165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f484f-474b-4533-8076-40e678667748 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:16.145340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f484f-474b-4533-8076-40e678667748 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:16.299723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b98510-83e0-4502-8c47-4992db1b4061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:16.300896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98510-83e0-4502-8c47-4992db1b4061 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:16.302031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98510-83e0-4502-8c47-4992db1b4061 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:16.302445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b98510-83e0-4502-8c47-4992db1b4061 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:16.303391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98510-83e0-4502-8c47-4992db1b4061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:16.306370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b98510-83e0-4502-8c47-4992db1b4061 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:16.324555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2310/4664] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:16.329054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e902e-9ad5-43e4-b806-3a96f02b5278 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:16.356057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e902e-9ad5-43e4-b806-3a96f02b5278 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:16.365277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d066336-febf-4e53-a95e-93704df49257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:16.376274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d066336-febf-4e53-a95e-93704df49257 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:16.377972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d066336-febf-4e53-a95e-93704df49257 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:16.382226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d066336-febf-4e53-a95e-93704df49257 admin admin] PATH_INFO: `/v3/projects/7dc040735ea84212bb1d8d0408caf489/users/4b09fc0f61bc4ca1acbad97cb11376a5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:16.391648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d066336-febf-4e53-a95e-93704df49257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc040735ea84212bb1d8d0408caf489, user_id=4b09fc0f61bc4ca1acbad97cb11376a5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:16.396875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d066336-febf-4e53-a95e-93704df49257 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:16.427395 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2355/4665] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:16 2022] PUT /identity/v3/projects/7dc040735ea84212bb1d8d0408caf489/users/4b09fc0f61bc4ca1acbad97cb11376a5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:16.438775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f8c7a-e9dd-4d25-86b9-17505d2234e3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:16.439056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f8c7a-e9dd-4d25-86b9-17505d2234e3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:16.439332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f8c7a-e9dd-4d25-86b9-17505d2234e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:16.493583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c84f8c7a-e9dd-4d25-86b9-17505d2234e3 None None] MFA Rules not processed for user `4b09fc0f61bc4ca1acbad97cb11376a5`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:16.496454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c84f8c7a-e9dd-4d25-86b9-17505d2234e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:16.659958 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2311/4666] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:16.667706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d066336-febf-4e53-a95e-93704df49257 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:16.669594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7d066336-febf-4e53-a95e-93704df49257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:16.778770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d066336-febf-4e53-a95e-93704df49257 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:16.787792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce5047-34b9-4f5f-815d-272168783d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:16.788815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5047-34b9-4f5f-815d-272168783d46 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:16.789425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5047-34b9-4f5f-815d-272168783d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:16.789741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce5047-34b9-4f5f-815d-272168783d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:16.875163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce5047-34b9-4f5f-815d-272168783d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:16.877205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce5047-34b9-4f5f-815d-272168783d46 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:16.890150 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2356/4667] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:17.191976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f8c7a-e9dd-4d25-86b9-17505d2234e3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:17.191976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c84f8c7a-e9dd-4d25-86b9-17505d2234e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:17.408577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f8c7a-e9dd-4d25-86b9-17505d2234e3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:17.425030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:17.425990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:17.426555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:17.427356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] PATH_INFO: `/v3/users/9491de6627b346fca21989a44e262429` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:17.430015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9491de6627b346fca21989a44e262429)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:17.436008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:17.570188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9491de6627b346fca21989a44e262429'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:17.586188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9491de6627b346fca21989a44e262429'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:17.587373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9491de6627b346fca21989a44e262429'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:17.589188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9491de6627b346fca21989a44e262429'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:17.624460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b0e9ebf-d6ae-4664-8245-832f81d2163d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9491de6627b346fca21989a44e262429'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:17.655833 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2312/4668] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:17 2022] DELETE /identity/v3/users/9491de6627b346fca21989a44e262429 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:17.716956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a693a-5734-41fc-b37f-95c35ad1f586 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:17.717712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a693a-5734-41fc-b37f-95c35ad1f586 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:17.718197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a693a-5734-41fc-b37f-95c35ad1f586 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:17.722336 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2357/4669] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 21:05:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:05:17.730148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be6de4-00fb-4c08-910b-b56348af8618 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:17.730148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be6de4-00fb-4c08-910b-b56348af8618 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:17.730148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26be6de4-00fb-4c08-910b-b56348af8618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:17.827936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-26be6de4-00fb-4c08-910b-b56348af8618 None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:17.829173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-26be6de4-00fb-4c08-910b-b56348af8618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:17.948577 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2313/4670] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:05:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Mar 26 21:05:17.984992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a693a-5734-41fc-b37f-95c35ad1f586 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:17.997665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8f1a693a-5734-41fc-b37f-95c35ad1f586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:18.049269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a693a-5734-41fc-b37f-95c35ad1f586 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:18.055937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed82b4-6ceb-4391-8bc2-d0525e260962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:18.063479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed82b4-6ceb-4391-8bc2-d0525e260962 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:18.064070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed82b4-6ceb-4391-8bc2-d0525e260962 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:18.064754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed82b4-6ceb-4391-8bc2-d0525e260962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:18.076209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed82b4-6ceb-4391-8bc2-d0525e260962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:18.078555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed82b4-6ceb-4391-8bc2-d0525e260962 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:18.090597 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2358/4671] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:18.674416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaba92-ae76-4133-af6b-f397081fa3de None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:18.674969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaba92-ae76-4133-af6b-f397081fa3de None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:18.674969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adaba92-ae76-4133-af6b-f397081fa3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:18.712444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1adaba92-ae76-4133-af6b-f397081fa3de None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:18.716204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1adaba92-ae76-4133-af6b-f397081fa3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:18.845114 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2314/4672] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:05:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:18.872232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed82b4-6ceb-4391-8bc2-d0525e260962 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:18.873931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-faed82b4-6ceb-4391-8bc2-d0525e260962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:18.896026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaba92-ae76-4133-af6b-f397081fa3de None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:18.897902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1adaba92-ae76-4133-af6b-f397081fa3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:19.125096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed82b4-6ceb-4391-8bc2-d0525e260962 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:19.139626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adaba92-ae76-4133-af6b-f397081fa3de None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:19.139899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d87dd-035c-4454-b378-97ed17546910 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:19.140766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d87dd-035c-4454-b378-97ed17546910 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:19.141261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d87dd-035c-4454-b378-97ed17546910 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:19.141559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d87dd-035c-4454-b378-97ed17546910 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:19.146129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:19.146998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:19.147278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:19.147555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] PATH_INFO: `/v3/projects/b97ee3626b824293b17899943c256a52` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:19.149671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97ee3626b824293b17899943c256a52)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:19.152426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:19.159094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d87dd-035c-4454-b378-97ed17546910 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:19.161611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d87dd-035c-4454-b378-97ed17546910 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:19.174087 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2359/4673] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:05:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:19.175401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d87dd-035c-4454-b378-97ed17546910 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:19.177956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a54d87dd-035c-4454-b378-97ed17546910 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:19.230771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97ee3626b824293b17899943c256a52', 'request_id': 'req-2f58c627-9142-47f5-8184-4b6e958f0eb3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.243113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97ee3626b824293b17899943c256a52', 'request_id': 'req-2f58c627-9142-47f5-8184-4b6e958f0eb3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.254900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97ee3626b824293b17899943c256a52', 'request_id': 'req-2f58c627-9142-47f5-8184-4b6e958f0eb3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.277232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] The token cache is being invalidate because project b97ee3626b824293b17899943c256a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:19.278479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.279583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.283310 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2315/4674] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:18 2022] DELETE /identity/v3/projects/b97ee3626b824293b17899943c256a52 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:19.298209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:19.309225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:19.334026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d87dd-035c-4454-b378-97ed17546910 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:19.462312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875a2b6-b4b9-4a40-9788-c1ed69ab0a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:19.463590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875a2b6-b4b9-4a40-9788-c1ed69ab0a47 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:19.464334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875a2b6-b4b9-4a40-9788-c1ed69ab0a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:19.465782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875a2b6-b4b9-4a40-9788-c1ed69ab0a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:19.468848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8875a2b6-b4b9-4a40-9788-c1ed69ab0a47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:19.573509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875a2b6-b4b9-4a40-9788-c1ed69ab0a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:19.576679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875a2b6-b4b9-4a40-9788-c1ed69ab0a47 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:19.590910 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2360/4675] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:19.691513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58c627-9142-47f5-8184-4b6e958f0eb3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:19.699085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:19.701638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:19.702261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:19.702916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] PATH_INFO: `/v3/users/7109ce5813564f6b9c6cacd0df98a550` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:19.705367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7109ce5813564f6b9c6cacd0df98a550)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:19.708418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:19.799582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7109ce5813564f6b9c6cacd0df98a550'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.818458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7109ce5813564f6b9c6cacd0df98a550'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.820347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7109ce5813564f6b9c6cacd0df98a550'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.822652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7109ce5813564f6b9c6cacd0df98a550'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.862548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7109ce5813564f6b9c6cacd0df98a550'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:19.899604 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2316/4676] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:19 2022] DELETE /identity/v3/users/7109ce5813564f6b9c6cacd0df98a550 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:20.373180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875a2b6-b4b9-4a40-9788-c1ed69ab0a47 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:20.392977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875a2b6-b4b9-4a40-9788-c1ed69ab0a47 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:20.602757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:20.608440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:20.609520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:20.610271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] PATH_INFO: `/v3/projects/875a90eb5cc94cc38f2ce52df8d72946` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:20.614098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=875a90eb5cc94cc38f2ce52df8d72946)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:20.620099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:20.726436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:20.727958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:20.803235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875a90eb5cc94cc38f2ce52df8d72946', 'request_id': 'req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:20.819991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875a90eb5cc94cc38f2ce52df8d72946', 'request_id': 'req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:20.828624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875a90eb5cc94cc38f2ce52df8d72946', 'request_id': 'req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:20.855849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] The token cache is being invalidate because project 875a90eb5cc94cc38f2ce52df8d72946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:20.856292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:20.862099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5bdf7d65-92a0-4bf3-a20f-d91e3656cc86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:20.865725 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2361/4677] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:20 2022] DELETE /identity/v3/projects/875a90eb5cc94cc38f2ce52df8d72946 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:20.871482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6094ec-71ec-4068-a1ef-9924057de624 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:20.872041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6094ec-71ec-4068-a1ef-9924057de624 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:20.872539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6094ec-71ec-4068-a1ef-9924057de624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:20.886109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ab618-05db-4862-87bd-0b0cd83b89a3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:20.920381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0f6094ec-71ec-4068-a1ef-9924057de624 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:20.921898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f6094ec-71ec-4068-a1ef-9924057de624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:21.039312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb38a5-bf47-498b-be4e-a418e325d52e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:21.040207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb38a5-bf47-498b-be4e-a418e325d52e service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:21.040679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb38a5-bf47-498b-be4e-a418e325d52e service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:21.041639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb38a5-bf47-498b-be4e-a418e325d52e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:21.046907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-84fb38a5-bf47-498b-be4e-a418e325d52e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:21.073939 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2362/4678] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:21.075583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e0ab6-3500-449c-b67c-225a0164b849 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:21.080312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e0ab6-3500-449c-b67c-225a0164b849 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:21.080831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05e0ab6-3500-449c-b67c-225a0164b849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:21.120521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d05e0ab6-3500-449c-b67c-225a0164b849 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:21.121852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d05e0ab6-3500-449c-b67c-225a0164b849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:21.141115 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2363/4679] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:21.145027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e0ab6-3500-449c-b67c-225a0164b849 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:21.163800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05e0ab6-3500-449c-b67c-225a0164b849 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:21.174454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2af46e-831a-4ba3-9b6b-c3367a1d8f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:21.175492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2af46e-831a-4ba3-9b6b-c3367a1d8f53 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:21.178201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2af46e-831a-4ba3-9b6b-c3367a1d8f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:21.178740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2af46e-831a-4ba3-9b6b-c3367a1d8f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:21.181174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2af46e-831a-4ba3-9b6b-c3367a1d8f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:05:21.182495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2af46e-831a-4ba3-9b6b-c3367a1d8f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:21.187800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb38a5-bf47-498b-be4e-a418e325d52e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:21.189337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb38a5-bf47-498b-be4e-a418e325d52e service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:21.190360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2af46e-831a-4ba3-9b6b-c3367a1d8f53 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:21.212966 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2364/4680] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:05:21.217432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2af46e-831a-4ba3-9b6b-c3367a1d8f53 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:21.217817 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2317/4681] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:21.264758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2af46e-831a-4ba3-9b6b-c3367a1d8f53 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:21.279124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b5c8-98c1-4233-a298-b73290137a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:21.279812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b5c8-98c1-4233-a298-b73290137a0c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:21.282307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b5c8-98c1-4233-a298-b73290137a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:21.282587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083b5c8-98c1-4233-a298-b73290137a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:21.283246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b5c8-98c1-4233-a298-b73290137a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:21.285255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083b5c8-98c1-4233-a298-b73290137a0c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:21.379150 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2365/4682] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:21 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:21.382142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb38a5-bf47-498b-be4e-a418e325d52e service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:21.405331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb38a5-bf47-498b-be4e-a418e325d52e service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:21.547385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb1c84-52c5-4f21-812f-dae1cbe38b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:21.548551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb1c84-52c5-4f21-812f-dae1cbe38b68 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:21.549068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb1c84-52c5-4f21-812f-dae1cbe38b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:21.549502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb1c84-52c5-4f21-812f-dae1cbe38b68 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:21.550401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb1c84-52c5-4f21-812f-dae1cbe38b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:21.552963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb1c84-52c5-4f21-812f-dae1cbe38b68 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:21.620724 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2318/4683] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:21 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:21.624341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b5c8-98c1-4233-a298-b73290137a0c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:21.637450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083b5c8-98c1-4233-a298-b73290137a0c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:21.670676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190c275-9c6f-43ec-a1e5-95f62f6a139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:21.671725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190c275-9c6f-43ec-a1e5-95f62f6a139b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:21.672235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190c275-9c6f-43ec-a1e5-95f62f6a139b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:21.672756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190c275-9c6f-43ec-a1e5-95f62f6a139b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:21.673812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190c275-9c6f-43ec-a1e5-95f62f6a139b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:21.684481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a190c275-9c6f-43ec-a1e5-95f62f6a139b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:21.706535 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2366/4684] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:21.711080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb1c84-52c5-4f21-812f-dae1cbe38b68 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:21.743390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb1c84-52c5-4f21-812f-dae1cbe38b68 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:21.762628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127902ad-7102-4f1f-b070-81fa273e295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:21.764191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127902ad-7102-4f1f-b070-81fa273e295a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:21.768647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127902ad-7102-4f1f-b070-81fa273e295a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:21.771057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127902ad-7102-4f1f-b070-81fa273e295a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:21.776588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127902ad-7102-4f1f-b070-81fa273e295a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:21.778847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127902ad-7102-4f1f-b070-81fa273e295a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:21.818458 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2319/4685] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:21.823242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190c275-9c6f-43ec-a1e5-95f62f6a139b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:21.833962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190c275-9c6f-43ec-a1e5-95f62f6a139b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:21.849150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c637f6e-a852-409e-b2ca-8d1a626ca069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:21.850082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c637f6e-a852-409e-b2ca-8d1a626ca069 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:21.850370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c637f6e-a852-409e-b2ca-8d1a626ca069 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:21.850699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c637f6e-a852-409e-b2ca-8d1a626ca069 admin admin] PATH_INFO: `/v3/projects/258cf569fc074fe6a826e67bf2a864ff/users/e9e0fa13f5ac4f5bad836e6c61f4b890/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:21.918104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c637f6e-a852-409e-b2ca-8d1a626ca069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=258cf569fc074fe6a826e67bf2a864ff, user_id=e9e0fa13f5ac4f5bad836e6c61f4b890, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:21.928492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c637f6e-a852-409e-b2ca-8d1a626ca069 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:21.971096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2367/4686] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:21 2022] PUT /identity/v3/projects/258cf569fc074fe6a826e67bf2a864ff/users/e9e0fa13f5ac4f5bad836e6c61f4b890/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:21.975214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984c7f4-8bef-4405-b84e-6202c172512c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:21.976654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984c7f4-8bef-4405-b84e-6202c172512c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:21.977053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984c7f4-8bef-4405-b84e-6202c172512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:22.079183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1984c7f4-8bef-4405-b84e-6202c172512c None None] MFA Rules not processed for user `e9e0fa13f5ac4f5bad836e6c61f4b890`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:22.083951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1984c7f4-8bef-4405-b84e-6202c172512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:22.340926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c637f6e-a852-409e-b2ca-8d1a626ca069 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:22.341421 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2320/4687] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:22.342708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c637f6e-a852-409e-b2ca-8d1a626ca069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:22.577132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c637f6e-a852-409e-b2ca-8d1a626ca069 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:22.602641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1e287-2062-4a38-8bb0-55ae04ec8970 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:22.603724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1e287-2062-4a38-8bb0-55ae04ec8970 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:22.604185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1e287-2062-4a38-8bb0-55ae04ec8970 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:22.604633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1e287-2062-4a38-8bb0-55ae04ec8970 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:22.632911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1e287-2062-4a38-8bb0-55ae04ec8970 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:22.634704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1e287-2062-4a38-8bb0-55ae04ec8970 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:22.662289 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2368/4688] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:25.773182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06660d6-c5f7-48dc-aaed-87afd35e5b24 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:25.773758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06660d6-c5f7-48dc-aaed-87afd35e5b24 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:25.773909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06660d6-c5f7-48dc-aaed-87afd35e5b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:25.870534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a06660d6-c5f7-48dc-aaed-87afd35e5b24 None None] MFA Rules not processed for user `4a76b26808b84a2ba82f49753035dd89`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:25.872205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a06660d6-c5f7-48dc-aaed-87afd35e5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:26.120844 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2321/4689] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:26.129823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1e287-2062-4a38-8bb0-55ae04ec8970 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:26.150053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1e287-2062-4a38-8bb0-55ae04ec8970 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:26.168644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aae24e-2be0-4917-bcbc-25e4f4c2b656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:26.169876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae24e-2be0-4917-bcbc-25e4f4c2b656 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:26.170350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae24e-2be0-4917-bcbc-25e4f4c2b656 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:26.170776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aae24e-2be0-4917-bcbc-25e4f4c2b656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:26.192567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae24e-2be0-4917-bcbc-25e4f4c2b656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:26.197642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aae24e-2be0-4917-bcbc-25e4f4c2b656 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:26.219948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2369/4690] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:26.471583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06660d6-c5f7-48dc-aaed-87afd35e5b24 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:26.473923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a06660d6-c5f7-48dc-aaed-87afd35e5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:26.675092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06660d6-c5f7-48dc-aaed-87afd35e5b24 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:26.706749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:26.707643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:26.708670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:26.708670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] PATH_INFO: `/v3/users/2cb760e247964721bf5933dac15c7669` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:26.716873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb760e247964721bf5933dac15c7669)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:26.718845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:26.840392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb760e247964721bf5933dac15c7669'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:26.856776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb760e247964721bf5933dac15c7669'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:26.857492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb760e247964721bf5933dac15c7669'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:26.858357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb760e247964721bf5933dac15c7669'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:26.886412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb760e247964721bf5933dac15c7669'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:26.919841 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2322/4691] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:26 2022] DELETE /identity/v3/users/2cb760e247964721bf5933dac15c7669 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:26.924329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937681-ffaf-4fb4-ac75-5078a71578bf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:26.925223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937681-ffaf-4fb4-ac75-5078a71578bf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:26.926716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937681-ffaf-4fb4-ac75-5078a71578bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:26.969118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ce937681-ffaf-4fb4-ac75-5078a71578bf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:26.971362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce937681-ffaf-4fb4-ac75-5078a71578bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:27.091480 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2370/4692] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:27.102677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:27.106382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:27.245433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9baee2-9a46-4765-880b-2858450732e7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:27.256729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43508dfd-f073-492e-8618-dd4478ac878c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:27.257399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43508dfd-f073-492e-8618-dd4478ac878c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:27.257729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43508dfd-f073-492e-8618-dd4478ac878c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:27.258199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43508dfd-f073-492e-8618-dd4478ac878c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:27.274820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43508dfd-f073-492e-8618-dd4478ac878c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:27.280814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43508dfd-f073-492e-8618-dd4478ac878c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:27.296899 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2323/4693] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:28.521629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937681-ffaf-4fb4-ac75-5078a71578bf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:28.523033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce937681-ffaf-4fb4-ac75-5078a71578bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:28.552455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937681-ffaf-4fb4-ac75-5078a71578bf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:28.559068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:28.560372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:28.560895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:28.561402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] PATH_INFO: `/v3/projects/ff7fbf8ed36f46d5934e9967cb604a8e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:28.562913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7fbf8ed36f46d5934e9967cb604a8e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:28.565145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:28.701127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7fbf8ed36f46d5934e9967cb604a8e', 'request_id': 'req-f3195516-f390-4df0-a0d1-1661e146ad8f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:28.715790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7fbf8ed36f46d5934e9967cb604a8e', 'request_id': 'req-f3195516-f390-4df0-a0d1-1661e146ad8f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:28.731429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7fbf8ed36f46d5934e9967cb604a8e', 'request_id': 'req-f3195516-f390-4df0-a0d1-1661e146ad8f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:28.750588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] The token cache is being invalidate because project ff7fbf8ed36f46d5934e9967cb604a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:28.751240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:28.755459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:28.762708 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2371/4694] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:28 2022] DELETE /identity/v3/projects/ff7fbf8ed36f46d5934e9967cb604a8e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:28.764032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43508dfd-f073-492e-8618-dd4478ac878c service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:28.782456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43508dfd-f073-492e-8618-dd4478ac878c service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:28.932873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:28.933900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:28.934192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:28.934826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] PATH_INFO: `/v3/users/869d6d5d5d1742988f3d963bbacc3793` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:28.937252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=869d6d5d5d1742988f3d963bbacc3793)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:28.942666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:29.039015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869d6d5d5d1742988f3d963bbacc3793'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:29.052265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869d6d5d5d1742988f3d963bbacc3793'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:29.053286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869d6d5d5d1742988f3d963bbacc3793'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:29.065703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869d6d5d5d1742988f3d963bbacc3793'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:29.080950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869d6d5d5d1742988f3d963bbacc3793'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:29.136206 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2324/4695] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:28 2022] DELETE /identity/v3/users/869d6d5d5d1742988f3d963bbacc3793 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:29.793287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:29.795764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:29.827773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:29.828913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:29.833695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3195516-f390-4df0-a0d1-1661e146ad8f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:29.914941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:29.917522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:29.918038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:29.918747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] PATH_INFO: `/v3/users/e9e0fa13f5ac4f5bad836e6c61f4b890` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:29.920553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e0fa13f5ac4f5bad836e6c61f4b890)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:29.924295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:30.022583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07ba91-168b-44be-9e03-ebac183ece7b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:30.038154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:30.039186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:30.039478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:30.039758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] PATH_INFO: `/v3/projects/066fc36c76ce4f70865c7df75cced099` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:30.042665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=066fc36c76ce4f70865c7df75cced099)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:30.044674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:30.066071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e0fa13f5ac4f5bad836e6c61f4b890'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.094400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e0fa13f5ac4f5bad836e6c61f4b890'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.097882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e0fa13f5ac4f5bad836e6c61f4b890'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.101691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e0fa13f5ac4f5bad836e6c61f4b890'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.133697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d8e66105-0cb1-400f-a73d-f5a62c80c791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e0fa13f5ac4f5bad836e6c61f4b890'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.169491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066fc36c76ce4f70865c7df75cced099', 'request_id': 'req-de155b91-38fc-4dc5-8878-d170c14c8b6d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.184605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066fc36c76ce4f70865c7df75cced099', 'request_id': 'req-de155b91-38fc-4dc5-8878-d170c14c8b6d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.197009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066fc36c76ce4f70865c7df75cced099', 'request_id': 'req-de155b91-38fc-4dc5-8878-d170c14c8b6d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.197246 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2372/4696] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:29 2022] DELETE /identity/v3/users/e9e0fa13f5ac4f5bad836e6c61f4b890 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:30.200025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294286d-17df-4550-97a2-59cdaa268cec None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:30.200964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294286d-17df-4550-97a2-59cdaa268cec None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:30.210074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2294286d-17df-4550-97a2-59cdaa268cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:30.234701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] The token cache is being invalidate because project 066fc36c76ce4f70865c7df75cced099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:30.235935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.237359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.242585 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2325/4697] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:29 2022] DELETE /identity/v3/projects/066fc36c76ce4f70865c7df75cced099 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:30.247089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:30.248535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:30.260672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2294286d-17df-4550-97a2-59cdaa268cec None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:30.274895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2294286d-17df-4550-97a2-59cdaa268cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:30.455070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de155b91-38fc-4dc5-8878-d170c14c8b6d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:30.486138 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2373/4698] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:30.503004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294286d-17df-4550-97a2-59cdaa268cec None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:30.504485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2294286d-17df-4550-97a2-59cdaa268cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:30.686194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2294286d-17df-4550-97a2-59cdaa268cec None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:30.697715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:30.701181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:30.701449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:30.701689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] PATH_INFO: `/v3/users/4b09fc0f61bc4ca1acbad97cb11376a5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:30.705783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b09fc0f61bc4ca1acbad97cb11376a5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:30.706733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a8948-5ad0-4f20-a31a-4c88a3729e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:30.707608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a8948-5ad0-4f20-a31a-4c88a3729e19 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:30.709260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a8948-5ad0-4f20-a31a-4c88a3729e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:30.709568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a8948-5ad0-4f20-a31a-4c88a3729e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:30.710264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:30.742125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a8948-5ad0-4f20-a31a-4c88a3729e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:30.743658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a8948-5ad0-4f20-a31a-4c88a3729e19 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:30.778911 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2374/4699] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:30.844050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b09fc0f61bc4ca1acbad97cb11376a5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.865909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b09fc0f61bc4ca1acbad97cb11376a5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.866998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b09fc0f61bc4ca1acbad97cb11376a5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.868921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b09fc0f61bc4ca1acbad97cb11376a5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.892792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a65cf976-0a9c-4a15-9472-f5f5661b6d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b09fc0f61bc4ca1acbad97cb11376a5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:30.915394 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2326/4700] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:30 2022] DELETE /identity/v3/users/4b09fc0f61bc4ca1acbad97cb11376a5 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:31.507259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a8948-5ad0-4f20-a31a-4c88a3729e19 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:31.508791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d26a8948-5ad0-4f20-a31a-4c88a3729e19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:31.556767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a8948-5ad0-4f20-a31a-4c88a3729e19 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:31.713267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:31.714164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:31.714513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:31.714796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] PATH_INFO: `/v3/projects/258cf569fc074fe6a826e67bf2a864ff` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:31.717787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] RBAC: Authorizing `identity:delete_project(project_id=258cf569fc074fe6a826e67bf2a864ff)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:31.719757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:31.859044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '258cf569fc074fe6a826e67bf2a864ff', 'request_id': 'req-444a09b7-164f-40f7-b972-e768560a657d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:31.872361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '258cf569fc074fe6a826e67bf2a864ff', 'request_id': 'req-444a09b7-164f-40f7-b972-e768560a657d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:31.878758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '258cf569fc074fe6a826e67bf2a864ff', 'request_id': 'req-444a09b7-164f-40f7-b972-e768560a657d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:31.906569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] The token cache is being invalidate because project 258cf569fc074fe6a826e67bf2a864ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:31.906929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:31.907668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-444a09b7-164f-40f7-b972-e768560a657d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:31.909288 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2375/4701] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:31 2022] DELETE /identity/v3/projects/258cf569fc074fe6a826e67bf2a864ff => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:31.925931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299d7b-3823-4c09-b8df-9f587b2444ce None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:31.926494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299d7b-3823-4c09-b8df-9f587b2444ce None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:31.926494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299d7b-3823-4c09-b8df-9f587b2444ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:31.969071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ff299d7b-3823-4c09-b8df-9f587b2444ce None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:31.975280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ff299d7b-3823-4c09-b8df-9f587b2444ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:32.237338 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2327/4702] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:32.245496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e04c54-782a-4f3e-b173-73c410b5091b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:32.245817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e04c54-782a-4f3e-b173-73c410b5091b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:32.246066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e04c54-782a-4f3e-b173-73c410b5091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:32.292007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-10e04c54-782a-4f3e-b173-73c410b5091b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:32.293257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-10e04c54-782a-4f3e-b173-73c410b5091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:32.315512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299d7b-3823-4c09-b8df-9f587b2444ce None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:32.320691 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2376/4703] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:32.330461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff299d7b-3823-4c09-b8df-9f587b2444ce None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:32.341444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd432-b603-45cb-8dc7-c4f480f20865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:32.342126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd432-b603-45cb-8dc7-c4f480f20865 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:32.342414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd432-b603-45cb-8dc7-c4f480f20865 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:32.342694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd432-b603-45cb-8dc7-c4f480f20865 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:32.343422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fd432-b603-45cb-8dc7-c4f480f20865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:05:32.354924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fd432-b603-45cb-8dc7-c4f480f20865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:32.363780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fd432-b603-45cb-8dc7-c4f480f20865 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:32.392822 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2328/4704] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:32.398515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e04c54-782a-4f3e-b173-73c410b5091b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:32.415739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e04c54-782a-4f3e-b173-73c410b5091b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:32.427736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ebba7-dbee-48e9-b401-d8c3c10a135d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:32.428740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ebba7-dbee-48e9-b401-d8c3c10a135d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:32.429188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ebba7-dbee-48e9-b401-d8c3c10a135d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:32.429621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ebba7-dbee-48e9-b401-d8c3c10a135d admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:32.430501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ebba7-dbee-48e9-b401-d8c3c10a135d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:32.432804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ebba7-dbee-48e9-b401-d8c3c10a135d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:32.495497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd432-b603-45cb-8dc7-c4f480f20865 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:32.500324 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2377/4705] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:32 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:32.512140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd432-b603-45cb-8dc7-c4f480f20865 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:32.659072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977cb4-1b4f-4e8b-9df7-f4a3618c6dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:32.659780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977cb4-1b4f-4e8b-9df7-f4a3618c6dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:32.660096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977cb4-1b4f-4e8b-9df7-f4a3618c6dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:32.660382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92977cb4-1b4f-4e8b-9df7-f4a3618c6dc5 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:32.661089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977cb4-1b4f-4e8b-9df7-f4a3618c6dc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:32.669670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92977cb4-1b4f-4e8b-9df7-f4a3618c6dc5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:32.728859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ebba7-dbee-48e9-b401-d8c3c10a135d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:32.742241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ebba7-dbee-48e9-b401-d8c3c10a135d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:32.742543 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2329/4706] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:32 2022] POST /identity/v3/users => generated 295 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:32.751789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f8ed6-f39b-4da6-9330-79e3435c2ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:32.755506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f8ed6-f39b-4da6-9330-79e3435c2ead admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:32.756122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f8ed6-f39b-4da6-9330-79e3435c2ead admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:32.756618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f8ed6-f39b-4da6-9330-79e3435c2ead admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:32.757740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f8ed6-f39b-4da6-9330-79e3435c2ead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:32.772397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977cb4-1b4f-4e8b-9df7-f4a3618c6dc5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:32.774488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-92977cb4-1b4f-4e8b-9df7-f4a3618c6dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:32.787194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f8ed6-f39b-4da6-9330-79e3435c2ead admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:32.807894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92977cb4-1b4f-4e8b-9df7-f4a3618c6dc5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:32.828281 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2378/4707] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:05:32.832680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:32.833768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:32.834101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:32.835317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f8ed6-f39b-4da6-9330-79e3435c2ead admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:32.835663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] PATH_INFO: `/v3/projects/7dc040735ea84212bb1d8d0408caf489` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:32.840660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc040735ea84212bb1d8d0408caf489)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:32.845218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:32.857883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f8ed6-f39b-4da6-9330-79e3435c2ead admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:32.863682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6585e9-fc80-4af8-b9e4-7d2f07921454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:32.865017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6585e9-fc80-4af8-b9e4-7d2f07921454 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:32.865546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6585e9-fc80-4af8-b9e4-7d2f07921454 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:32.865825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6585e9-fc80-4af8-b9e4-7d2f07921454 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:32.866572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6585e9-fc80-4af8-b9e4-7d2f07921454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:32.868930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6585e9-fc80-4af8-b9e4-7d2f07921454 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:32.884213 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2379/4708] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:32.891351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6585e9-fc80-4af8-b9e4-7d2f07921454 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:32.903867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6585e9-fc80-4af8-b9e4-7d2f07921454 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:32.910013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e510a1a-dafa-44df-a0b0-3677d5deacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:32.911558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510a1a-dafa-44df-a0b0-3677d5deacdf admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:32.911933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510a1a-dafa-44df-a0b0-3677d5deacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:32.912328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e510a1a-dafa-44df-a0b0-3677d5deacdf admin admin] PATH_INFO: `/v3/projects/7d4a77bb19484b37810f325091f040d3/users/e971783228074e4fab14696a73c4d19b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:32.936200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e510a1a-dafa-44df-a0b0-3677d5deacdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d4a77bb19484b37810f325091f040d3, user_id=e971783228074e4fab14696a73c4d19b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:32.939300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e510a1a-dafa-44df-a0b0-3677d5deacdf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:32.969832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc040735ea84212bb1d8d0408caf489', 'request_id': 'req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:32.970756 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2380/4709] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:32 2022] PUT /identity/v3/projects/7d4a77bb19484b37810f325091f040d3/users/e971783228074e4fab14696a73c4d19b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:32.972822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bce31-0d79-4756-87e8-7a5f90ed15d3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:32.973117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bce31-0d79-4756-87e8-7a5f90ed15d3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:32.973450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bce31-0d79-4756-87e8-7a5f90ed15d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:32.983447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc040735ea84212bb1d8d0408caf489', 'request_id': 'req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:33.002669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc040735ea84212bb1d8d0408caf489', 'request_id': 'req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:33.030312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-344bce31-0d79-4756-87e8-7a5f90ed15d3 None None] MFA Rules not processed for user `e971783228074e4fab14696a73c4d19b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:33.035274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-344bce31-0d79-4756-87e8-7a5f90ed15d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:33.046184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] The token cache is being invalidate because project 7dc040735ea84212bb1d8d0408caf489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:33.046480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:33.047359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-73ba73b3-9ebb-4f70-86f9-6a89be5acb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:33.049515 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2330/4710] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:32 2022] DELETE /identity/v3/projects/7dc040735ea84212bb1d8d0408caf489 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:33.056300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92569a6-3568-4948-9068-de826d56e1e0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.057357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92569a6-3568-4948-9068-de826d56e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.057849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92569a6-3568-4948-9068-de826d56e1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.081686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d92569a6-3568-4948-9068-de826d56e1e0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:33.083371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d92569a6-3568-4948-9068-de826d56e1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:33.139899 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2381/4711] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:33.141077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bce31-0d79-4756-87e8-7a5f90ed15d3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.142772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-344bce31-0d79-4756-87e8-7a5f90ed15d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:33.160489 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2331/4712] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:33.170719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1768028-6511-4bba-b81a-5e420c37bd25 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.171381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1768028-6511-4bba-b81a-5e420c37bd25 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.171934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1768028-6511-4bba-b81a-5e420c37bd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.193248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c1768028-6511-4bba-b81a-5e420c37bd25 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:33.195113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c1768028-6511-4bba-b81a-5e420c37bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:33.204743 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2332/4713] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:33.209296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1768028-6511-4bba-b81a-5e420c37bd25 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.220967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1768028-6511-4bba-b81a-5e420c37bd25 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.227615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc6d10-0250-4865-aa46-4d8c7869714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.229093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bce31-0d79-4756-87e8-7a5f90ed15d3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.229735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc6d10-0250-4865-aa46-4d8c7869714b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.230335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc6d10-0250-4865-aa46-4d8c7869714b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.232422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc6d10-0250-4865-aa46-4d8c7869714b admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.233711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc6d10-0250-4865-aa46-4d8c7869714b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:05:33.234368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc6d10-0250-4865-aa46-4d8c7869714b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.236281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640875-f7b7-4e16-96f5-53c0ffd7166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.236843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbc6d10-0250-4865-aa46-4d8c7869714b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.237796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640875-f7b7-4e16-96f5-53c0ffd7166c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.238724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640875-f7b7-4e16-96f5-53c0ffd7166c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.239088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640875-f7b7-4e16-96f5-53c0ffd7166c admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.239870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05640875-f7b7-4e16-96f5-53c0ffd7166c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.243461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05640875-f7b7-4e16-96f5-53c0ffd7166c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.257484 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2333/4714] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:33.258432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc6d10-0250-4865-aa46-4d8c7869714b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.272533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc6d10-0250-4865-aa46-4d8c7869714b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.280346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f992570-f940-405b-bdd6-c71ac60f5e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.281199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f992570-f940-405b-bdd6-c71ac60f5e0e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.281683 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2382/4715] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:33 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:33.281807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f992570-f940-405b-bdd6-c71ac60f5e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.282098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f992570-f940-405b-bdd6-c71ac60f5e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.283807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640875-f7b7-4e16-96f5-53c0ffd7166c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.284006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f992570-f940-405b-bdd6-c71ac60f5e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.285568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f992570-f940-405b-bdd6-c71ac60f5e0e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.326097 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2334/4716] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:33 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:33.330135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f992570-f940-405b-bdd6-c71ac60f5e0e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.410782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f992570-f940-405b-bdd6-c71ac60f5e0e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.411064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640875-f7b7-4e16-96f5-53c0ffd7166c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.417087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7d0da-f7dd-4318-a4d3-4dcef5990c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.417320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458c537-bdab-4c0d-9dcd-43e1fedd3e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.418036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c537-bdab-4c0d-9dcd-43e1fedd3e9b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.418240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7d0da-f7dd-4318-a4d3-4dcef5990c85 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.418362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c537-bdab-4c0d-9dcd-43e1fedd3e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.418619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458c537-bdab-4c0d-9dcd-43e1fedd3e9b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.419306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458c537-bdab-4c0d-9dcd-43e1fedd3e9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.419432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7d0da-f7dd-4318-a4d3-4dcef5990c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.419714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7d0da-f7dd-4318-a4d3-4dcef5990c85 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.420588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7d0da-f7dd-4318-a4d3-4dcef5990c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.421536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458c537-bdab-4c0d-9dcd-43e1fedd3e9b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.423573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7d0da-f7dd-4318-a4d3-4dcef5990c85 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.451839 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2383/4717] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:33 2022] POST /identity/v3/users => generated 301 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:33.454508 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2335/4718] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:33 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:33.455427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7d0da-f7dd-4318-a4d3-4dcef5990c85 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.455556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458c537-bdab-4c0d-9dcd-43e1fedd3e9b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.467312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7d0da-f7dd-4318-a4d3-4dcef5990c85 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.468997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458c537-bdab-4c0d-9dcd-43e1fedd3e9b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.472736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43574ff5-f4f5-4ba6-a9aa-11d8b352da9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.473459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43574ff5-f4f5-4ba6-a9aa-11d8b352da9c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.473750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43574ff5-f4f5-4ba6-a9aa-11d8b352da9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.474029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43574ff5-f4f5-4ba6-a9aa-11d8b352da9c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.474804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43574ff5-f4f5-4ba6-a9aa-11d8b352da9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.476519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43574ff5-f4f5-4ba6-a9aa-11d8b352da9c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.479955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61443c10-3455-4c6d-8e69-253726d07a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.480624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61443c10-3455-4c6d-8e69-253726d07a14 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.480905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61443c10-3455-4c6d-8e69-253726d07a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.481445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61443c10-3455-4c6d-8e69-253726d07a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.482232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61443c10-3455-4c6d-8e69-253726d07a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.484201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61443c10-3455-4c6d-8e69-253726d07a14 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.496353 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2384/4719] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:05:33.500135 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2336/4720] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:33.504133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43574ff5-f4f5-4ba6-a9aa-11d8b352da9c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.512641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61443c10-3455-4c6d-8e69-253726d07a14 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.517297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43574ff5-f4f5-4ba6-a9aa-11d8b352da9c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.524213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61443c10-3455-4c6d-8e69-253726d07a14 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.525701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4d8db-f5a9-4586-986e-28b02d1c9c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.526395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4d8db-f5a9-4586-986e-28b02d1c9c5a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.526680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4d8db-f5a9-4586-986e-28b02d1c9c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.526961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4d8db-f5a9-4586-986e-28b02d1c9c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.527889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4d8db-f5a9-4586-986e-28b02d1c9c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.530738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4d8db-f5a9-4586-986e-28b02d1c9c5a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.531038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49efd67-01e0-4705-8892-48e0f05a73c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.532063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49efd67-01e0-4705-8892-48e0f05a73c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.532411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49efd67-01e0-4705-8892-48e0f05a73c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.532759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49efd67-01e0-4705-8892-48e0f05a73c7 admin admin] PATH_INFO: `/v3/projects/ecf9e41842234ac0adfb3bf3a94ff568/users/421de670f17e42508264d1524e6bed82/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.546489 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2337/4721] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:33.551215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4d8db-f5a9-4586-986e-28b02d1c9c5a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.555129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49efd67-01e0-4705-8892-48e0f05a73c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf9e41842234ac0adfb3bf3a94ff568, user_id=421de670f17e42508264d1524e6bed82, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.558905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49efd67-01e0-4705-8892-48e0f05a73c7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.564264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4d8db-f5a9-4586-986e-28b02d1c9c5a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.569544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f851bf5-2e2d-4328-8b1b-24a5e1e7c5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.570491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851bf5-2e2d-4328-8b1b-24a5e1e7c5da admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.570779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851bf5-2e2d-4328-8b1b-24a5e1e7c5da admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.571068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851bf5-2e2d-4328-8b1b-24a5e1e7c5da admin admin] PATH_INFO: `/v3/projects/ffeef0caf635437194fed3721a8d1d0d/users/bfac7b943d654fc88c08d106d57201d6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.577413 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2385/4722] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:33 2022] PUT /identity/v3/projects/ecf9e41842234ac0adfb3bf3a94ff568/users/421de670f17e42508264d1524e6bed82/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:33.580890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49efd67-01e0-4705-8892-48e0f05a73c7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.588076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f851bf5-2e2d-4328-8b1b-24a5e1e7c5da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffeef0caf635437194fed3721a8d1d0d, user_id=bfac7b943d654fc88c08d106d57201d6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.591409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f851bf5-2e2d-4328-8b1b-24a5e1e7c5da admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.614062 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2338/4723] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:33 2022] PUT /identity/v3/projects/ffeef0caf635437194fed3721a8d1d0d/users/bfac7b943d654fc88c08d106d57201d6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:33.624990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e74f43-1daf-413c-818f-2659efcd35bf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.625272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e74f43-1daf-413c-818f-2659efcd35bf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.625555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e74f43-1daf-413c-818f-2659efcd35bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.672751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49efd67-01e0-4705-8892-48e0f05a73c7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.680546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-74e74f43-1daf-413c-818f-2659efcd35bf None None] MFA Rules not processed for user `bfac7b943d654fc88c08d106d57201d6`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:33.681827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-74e74f43-1daf-413c-818f-2659efcd35bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:33.796791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188b203-9bcc-485b-8c49-b0421da7cebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.797472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b203-9bcc-485b-8c49-b0421da7cebc admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.797764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b203-9bcc-485b-8c49-b0421da7cebc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.798049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188b203-9bcc-485b-8c49-b0421da7cebc admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.798788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188b203-9bcc-485b-8c49-b0421da7cebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.800919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188b203-9bcc-485b-8c49-b0421da7cebc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.826610 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2339/4724] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:33.827552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e74f43-1daf-413c-818f-2659efcd35bf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.829231 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2386/4725] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:33 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:33.840079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188b203-9bcc-485b-8c49-b0421da7cebc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:33.842551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4188b203-9bcc-485b-8c49-b0421da7cebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:33.848406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e74f43-1daf-413c-818f-2659efcd35bf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.861849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2614099-cd1a-4ff8-b5d7-cc17e7e8e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:33.868538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2614099-cd1a-4ff8-b5d7-cc17e7e8e9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.869626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2614099-cd1a-4ff8-b5d7-cc17e7e8e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.870022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2614099-cd1a-4ff8-b5d7-cc17e7e8e9bb admin admin] PATH_INFO: `/v3/projects/ecf9e41842234ac0adfb3bf3a94ff568/users/421de670f17e42508264d1524e6bed82/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.873886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2614099-cd1a-4ff8-b5d7-cc17e7e8e9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf9e41842234ac0adfb3bf3a94ff568, user_id=421de670f17e42508264d1524e6bed82, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:33.877161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2614099-cd1a-4ff8-b5d7-cc17e7e8e9bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:33.896569 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2340/4726] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:33 2022] PUT /identity/v3/projects/ecf9e41842234ac0adfb3bf3a94ff568/users/421de670f17e42508264d1524e6bed82/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:33.910400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6256-cf8f-4e56-a88e-f8f6fbbd6418 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:33.910967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6256-cf8f-4e56-a88e-f8f6fbbd6418 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:33.911251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef6256-cf8f-4e56-a88e-f8f6fbbd6418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:33.929319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188b203-9bcc-485b-8c49-b0421da7cebc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:33.950038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e0ef6256-cf8f-4e56-a88e-f8f6fbbd6418 None None] MFA Rules not processed for user `421de670f17e42508264d1524e6bed82`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:33.951609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e0ef6256-cf8f-4e56-a88e-f8f6fbbd6418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:34.027394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1e4a6-4a41-489b-994e-9aa60e6c3ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.028163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1e4a6-4a41-489b-994e-9aa60e6c3ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.028460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1e4a6-4a41-489b-994e-9aa60e6c3ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.028764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1e4a6-4a41-489b-994e-9aa60e6c3ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.059978 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2341/4727] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:34.069691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef6256-cf8f-4e56-a88e-f8f6fbbd6418 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.116657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef6256-cf8f-4e56-a88e-f8f6fbbd6418 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:34.123846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1e4a6-4a41-489b-994e-9aa60e6c3ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.125544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1e4a6-4a41-489b-994e-9aa60e6c3ca5 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.130393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd384dbd-7b22-445c-acf0-92239f163450 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.131083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384dbd-7b22-445c-acf0-92239f163450 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.131375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384dbd-7b22-445c-acf0-92239f163450 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.137686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd384dbd-7b22-445c-acf0-92239f163450 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.139782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd384dbd-7b22-445c-acf0-92239f163450 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.142723 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-bd384dbd-7b22-445c-acf0-92239f163450 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:34.142723 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:34.142723 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:34.144114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd384dbd-7b22-445c-acf0-92239f163450 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.147202 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2387/4728] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:34.174160 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2342/4729] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:05:34 2022] POST /identity/v3/domains => generated 276 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:34.178740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1e4a6-4a41-489b-994e-9aa60e6c3ca5 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.195760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1e4a6-4a41-489b-994e-9aa60e6c3ca5 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:34.322693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a9474-96ce-4d50-b624-6d01c14e93be tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.323569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a9474-96ce-4d50-b624-6d01c14e93be tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.323858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a9474-96ce-4d50-b624-6d01c14e93be tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.324170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a9474-96ce-4d50-b624-6d01c14e93be tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569/config` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.327158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a9474-96ce-4d50-b624-6d01c14e93be tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=5db531c924d0442ca08153156225e569)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.328394 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-e33a9474-96ce-4d50-b624-6d01c14e93be tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:34.328394 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:34.328394 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:34.329311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a9474-96ce-4d50-b624-6d01c14e93be tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.423690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1ec2b-b5a8-463d-bd43-f56ae0520237 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.424011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1ec2b-b5a8-463d-bd43-f56ae0520237 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.424342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1ec2b-b5a8-463d-bd43-f56ae0520237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.428986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2388/4730] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:05:34 2022] PUT /identity/v3/domains/5db531c924d0442ca08153156225e569/config => generated 138 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:34.433293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a9474-96ce-4d50-b624-6d01c14e93be tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.453510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a9474-96ce-4d50-b624-6d01c14e93be tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:34.463493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ffd1ec2b-b5a8-463d-bd43-f56ae0520237 None None] MFA Rules not processed for user `4a76b26808b84a2ba82f49753035dd89`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:34.465338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ffd1ec2b-b5a8-463d-bd43-f56ae0520237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:34.470725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd316d-dc66-44ee-b7db-2f5cb5103418 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.471705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd316d-dc66-44ee-b7db-2f5cb5103418 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.472736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd316d-dc66-44ee-b7db-2f5cb5103418 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.473120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd316d-dc66-44ee-b7db-2f5cb5103418 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569/config/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.474716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd316d-dc66-44ee-b7db-2f5cb5103418 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5db531c924d0442ca08153156225e569, group=identity)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.475860 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-19dd316d-dc66-44ee-b7db-2f5cb5103418 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:34.475860 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:34.475860 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:34.477191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd316d-dc66-44ee-b7db-2f5cb5103418 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.488583 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2389/4731] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:05:34 2022] GET /identity/v3/domains/5db531c924d0442ca08153156225e569/config/identity => generated 45 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:34.492873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd316d-dc66-44ee-b7db-2f5cb5103418 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.504656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd316d-dc66-44ee-b7db-2f5cb5103418 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:34.518966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe4231-bb88-4ceb-8904-3f1eb78432aa tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.520099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe4231-bb88-4ceb-8904-3f1eb78432aa tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.520485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe4231-bb88-4ceb-8904-3f1eb78432aa tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.521003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe4231-bb88-4ceb-8904-3f1eb78432aa tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569/config/identity/driver` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.526820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe4231-bb88-4ceb-8904-3f1eb78432aa tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5db531c924d0442ca08153156225e569, group=identity, option=driver)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.529186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe4231-bb88-4ceb-8904-3f1eb78432aa tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.537316 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2390/4732] 10.222.0.16 () {58 vars in 1295 bytes} [Sat Mar 26 21:05:34 2022] GET /identity/v3/domains/5db531c924d0442ca08153156225e569/config/identity/driver => generated 31 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Mar 26 21:05:34.541892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe4231-bb88-4ceb-8904-3f1eb78432aa tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.544323 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2343/4733] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:34.555140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe4231-bb88-4ceb-8904-3f1eb78432aa tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:34.566293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a777d-54d9-4232-9109-780717d73237 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.567591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a777d-54d9-4232-9109-780717d73237 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.568188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a777d-54d9-4232-9109-780717d73237 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.568481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a777d-54d9-4232-9109-780717d73237 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569/config/ldap` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.570031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a777d-54d9-4232-9109-780717d73237 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5db531c924d0442ca08153156225e569, group=ldap)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.585640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a777d-54d9-4232-9109-780717d73237 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.607555 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2391/4734] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 21:05:34 2022] GET /identity/v3/domains/5db531c924d0442ca08153156225e569/config/ldap => generated 106 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:34.612762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1ec2b-b5a8-463d-bd43-f56ae0520237 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.635330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1ec2b-b5a8-463d-bd43-f56ae0520237 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:34.650645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d3036-5423-4c40-842f-4ee1844462e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.652120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d3036-5423-4c40-842f-4ee1844462e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.652120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d3036-5423-4c40-842f-4ee1844462e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.652775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d3036-5423-4c40-842f-4ee1844462e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569/config/ldap/url` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.655070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d3036-5423-4c40-842f-4ee1844462e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5db531c924d0442ca08153156225e569, group=ldap, option=url)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.656264 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-046d3036-5423-4c40-842f-4ee1844462e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:34.656264 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:34.656264 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:34.658175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d3036-5423-4c40-842f-4ee1844462e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.668224 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2344/4735] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:05:34 2022] GET /identity/v3/domains/5db531c924d0442ca08153156225e569/config/ldap/url => generated 46 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:34.672113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a777d-54d9-4232-9109-780717d73237 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.704076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a777d-54d9-4232-9109-780717d73237 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:34.711601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcc2f2-d4cd-4a50-a088-05e7f9defd3c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.713487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcc2f2-d4cd-4a50-a088-05e7f9defd3c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.715099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcc2f2-d4cd-4a50-a088-05e7f9defd3c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.715610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdcc2f2-d4cd-4a50-a088-05e7f9defd3c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569/config/ldap/user_tree_dn` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.718053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcc2f2-d4cd-4a50-a088-05e7f9defd3c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=5db531c924d0442ca08153156225e569, group=ldap, option=user_tree_dn)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.721470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdcc2f2-d4cd-4a50-a088-05e7f9defd3c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.740189 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2392/4736] 10.222.0.16 () {58 vars in 1301 bytes} [Sat Mar 26 21:05:34 2022] GET /identity/v3/domains/5db531c924d0442ca08153156225e569/config/ldap/user_tree_dn => generated 63 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:34.742358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d3036-5423-4c40-842f-4ee1844462e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.762310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d3036-5423-4c40-842f-4ee1844462e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:34.774882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.776711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.777170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.777563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569/config` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.778611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=5db531c924d0442ca08153156225e569)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.780399 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:34.780399 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:34.780399 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:34.781976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.805307 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2345/4737] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:34 2022] DELETE /identity/v3/domains/5db531c924d0442ca08153156225e569/config => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:34.809433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcc2f2-d4cd-4a50-a088-05e7f9defd3c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.822875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdcc2f2-d4cd-4a50-a088-05e7f9defd3c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:34.839522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:34.840609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:34.841160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:34.841160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:34.842720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5db531c924d0442ca08153156225e569)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:34.843892 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:34.843892 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:34.843892 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:34.844816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:34.896643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5db531c924d0442ca08153156225e569'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:34.897532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5db531c924d0442ca08153156225e569'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:34.952477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5db531c924d0442ca08153156225e569'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:34.956685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5db531c924d0442ca08153156225e569'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:34.964347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:34.966374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:34.968815 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2393/4738] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:05:34 2022] PATCH /identity/v3/domains/5db531c924d0442ca08153156225e569 => generated 277 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:34.984580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19023cd-77a2-4aeb-881f-c52e67568b1b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.074133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.075120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.075404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.075677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.083157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.085232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:35.093419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5db531c924d0442ca08153156225e569)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.094736 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:35.094736 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:35.094736 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:35.095911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.126863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5db531c924d0442ca08153156225e569'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.135943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5db531c924d0442ca08153156225e569'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.168515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df5b3c-49cb-4057-ae56-6a542c06f702 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.173633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ae2b-ddb4-427a-bafd-fe8599837a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.174360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ae2b-ddb4-427a-bafd-fe8599837a33 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.174668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ae2b-ddb4-427a-bafd-fe8599837a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.175043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf9ae2b-ddb4-427a-bafd-fe8599837a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.177246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0bf9ae2b-ddb4-427a-bafd-fe8599837a33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:35.189685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ae2b-ddb4-427a-bafd-fe8599837a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.191568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf9ae2b-ddb4-427a-bafd-fe8599837a33 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.204002 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2394/4739] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:05:35.204412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db531c924d0442ca08153156225e569', 'request_id': 'req-036415fa-89c6-4910-a766-0c510d583d48'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.212604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db531c924d0442ca08153156225e569', 'request_id': 'req-036415fa-89c6-4910-a766-0c510d583d48'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.219386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db531c924d0442ca08153156225e569', 'request_id': 'req-036415fa-89c6-4910-a766-0c510d583d48'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.235715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] The token cache is being invalidate because project 5db531c924d0442ca08153156225e569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:35.236080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.237242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.245874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5db531c924d0442ca08153156225e569', 'request_id': 'req-036415fa-89c6-4910-a766-0c510d583d48'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.246671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5db531c924d0442ca08153156225e569', 'request_id': 'req-036415fa-89c6-4910-a766-0c510d583d48'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.247365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5db531c924d0442ca08153156225e569', 'request_id': 'req-036415fa-89c6-4910-a766-0c510d583d48'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.258059 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2346/4740] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:34 2022] DELETE /identity/v3/domains/5db531c924d0442ca08153156225e569 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:35.264226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ae2b-ddb4-427a-bafd-fe8599837a33 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.278095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf9ae2b-ddb4-427a-bafd-fe8599837a33 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.336195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356815b-eb48-40b4-bd27-5c2423a62e90 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.336924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356815b-eb48-40b4-bd27-5c2423a62e90 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.337469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356815b-eb48-40b4-bd27-5c2423a62e90 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.337608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8356815b-eb48-40b4-bd27-5c2423a62e90 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.338409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356815b-eb48-40b4-bd27-5c2423a62e90 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.339436 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-8356815b-eb48-40b4-bd27-5c2423a62e90 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:35.339436 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:35.339436 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:35.340372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8356815b-eb48-40b4-bd27-5c2423a62e90 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.357566 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2395/4741] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:05:35 2022] POST /identity/v3/domains => generated 276 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:35.361897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.363330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:35.376979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036415fa-89c6-4910-a766-0c510d583d48 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.445876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0d9b-6aa2-407f-884a-76761fa7957a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.446735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0d9b-6aa2-407f-884a-76761fa7957a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.447062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0d9b-6aa2-407f-884a-76761fa7957a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.447349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e0d9b-6aa2-407f-884a-76761fa7957a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/4c306b426b0946d9951381ea45000834/config` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.448141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e0d9b-6aa2-407f-884a-76761fa7957a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=4c306b426b0946d9951381ea45000834)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.449182 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-a25e0d9b-6aa2-407f-884a-76761fa7957a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:35.449182 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:35.449182 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:35.450086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e0d9b-6aa2-407f-884a-76761fa7957a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.496304 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2347/4742] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:05:35 2022] PUT /identity/v3/domains/4c306b426b0946d9951381ea45000834/config => generated 138 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:35.497274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356815b-eb48-40b4-bd27-5c2423a62e90 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.513649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8356815b-eb48-40b4-bd27-5c2423a62e90 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.525941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41273-0233-427c-af06-381ee8d93fd7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.526876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41273-0233-427c-af06-381ee8d93fd7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.527157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41273-0233-427c-af06-381ee8d93fd7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.527445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f41273-0233-427c-af06-381ee8d93fd7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/4c306b426b0946d9951381ea45000834/config` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.528408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41273-0233-427c-af06-381ee8d93fd7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=4c306b426b0946d9951381ea45000834)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.529918 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-c3f41273-0233-427c-af06-381ee8d93fd7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:35.529918 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:35.529918 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:35.530558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f41273-0233-427c-af06-381ee8d93fd7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.567822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0d9b-6aa2-407f-884a-76761fa7957a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.578830 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2396/4743] 10.222.0.16 () {60 vars in 1270 bytes} [Sat Mar 26 21:05:35 2022] PATCH /identity/v3/domains/4c306b426b0946d9951381ea45000834/config => generated 141 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:35.581023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e0d9b-6aa2-407f-884a-76761fa7957a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.587786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bada3-daea-4703-8dea-7a562d60fa87 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.589181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bada3-daea-4703-8dea-7a562d60fa87 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.589181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bada3-daea-4703-8dea-7a562d60fa87 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.589674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6bada3-daea-4703-8dea-7a562d60fa87 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/4c306b426b0946d9951381ea45000834/config` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.591012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bada3-daea-4703-8dea-7a562d60fa87 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4c306b426b0946d9951381ea45000834)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.592803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6bada3-daea-4703-8dea-7a562d60fa87 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.599979 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2348/4744] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:05:35 2022] GET /identity/v3/domains/4c306b426b0946d9951381ea45000834/config => generated 141 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:35.602807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41273-0233-427c-af06-381ee8d93fd7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.614976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f41273-0233-427c-af06-381ee8d93fd7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.623941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02985d1-5013-41c1-b3a6-baf5c17eb49e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.625245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02985d1-5013-41c1-b3a6-baf5c17eb49e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.625634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02985d1-5013-41c1-b3a6-baf5c17eb49e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.626015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02985d1-5013-41c1-b3a6-baf5c17eb49e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/4c306b426b0946d9951381ea45000834/config` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.626844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02985d1-5013-41c1-b3a6-baf5c17eb49e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=4c306b426b0946d9951381ea45000834)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.627981 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-b02985d1-5013-41c1-b3a6-baf5c17eb49e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:35.627981 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:35.627981 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:35.629219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02985d1-5013-41c1-b3a6-baf5c17eb49e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.653615 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2397/4745] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:35 2022] DELETE /identity/v3/domains/4c306b426b0946d9951381ea45000834/config => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:35.655067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bada3-daea-4703-8dea-7a562d60fa87 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.665615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6bada3-daea-4703-8dea-7a562d60fa87 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.671470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82216-7717-46a3-bbf9-221e52b9cf74 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.672351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82216-7717-46a3-bbf9-221e52b9cf74 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.673477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82216-7717-46a3-bbf9-221e52b9cf74 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.673477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a82216-7717-46a3-bbf9-221e52b9cf74 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/4c306b426b0946d9951381ea45000834/config` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.674221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a82216-7717-46a3-bbf9-221e52b9cf74 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=4c306b426b0946d9951381ea45000834)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.675836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a82216-7717-46a3-bbf9-221e52b9cf74 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.700807 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d9a82216-7717-46a3-bbf9-221e52b9cf74 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Could not find any options in domain configuration for domain 4c306b426b0946d9951381ea45000834.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 4c306b426b0946d9951381ea45000834. Mar 26 21:05:35.705321 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2349/4746] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:05:35 2022] GET /identity/v3/domains/4c306b426b0946d9951381ea45000834/config => generated 151 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:35.706549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02985d1-5013-41c1-b3a6-baf5c17eb49e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.719977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02985d1-5013-41c1-b3a6-baf5c17eb49e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.734379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5b18-9878-416e-8dae-c9dc2ff2386b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.736732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5b18-9878-416e-8dae-c9dc2ff2386b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.740306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5b18-9878-416e-8dae-c9dc2ff2386b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.740629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5b18-9878-416e-8dae-c9dc2ff2386b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/4c306b426b0946d9951381ea45000834/config` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.741315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c5b18-9878-416e-8dae-c9dc2ff2386b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=4c306b426b0946d9951381ea45000834)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.743188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c5b18-9878-416e-8dae-c9dc2ff2386b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.759385 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2398/4747] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:35 2022] DELETE /identity/v3/domains/4c306b426b0946d9951381ea45000834/config => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:35.763354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82216-7717-46a3-bbf9-221e52b9cf74 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.766980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0d3e9-d399-4c07-a118-9da429e20d00 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.767273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0d3e9-d399-4c07-a118-9da429e20d00 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.767551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0d3e9-d399-4c07-a118-9da429e20d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.777720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a82216-7717-46a3-bbf9-221e52b9cf74 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.786349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.786665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-51b0d3e9-d399-4c07-a118-9da429e20d00 None None] MFA Rules not processed for user `bfac7b943d654fc88c08d106d57201d6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:35.788040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-51b0d3e9-d399-4c07-a118-9da429e20d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:35.788713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.789634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.790096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/4c306b426b0946d9951381ea45000834` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.792381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4c306b426b0946d9951381ea45000834)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.794026 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:35.794026 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:35.794026 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:35.795849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:35.828799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4c306b426b0946d9951381ea45000834'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.829976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4c306b426b0946d9951381ea45000834'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.863520 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2399/4748] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:35.867332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4c306b426b0946d9951381ea45000834'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.868134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4c306b426b0946d9951381ea45000834'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:35.874912 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2350/4749] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:05:35 2022] PATCH /identity/v3/domains/4c306b426b0946d9951381ea45000834 => generated 277 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:35.876806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0d3e9-d399-4c07-a118-9da429e20d00 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:35.878009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-51b0d3e9-d399-4c07-a118-9da429e20d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:35.896581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0d3e9-d399-4c07-a118-9da429e20d00 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:35.979712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:35.980458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:35.980744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:35.981047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/4c306b426b0946d9951381ea45000834` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:35.992601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4c306b426b0946d9951381ea45000834)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:35.994151 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:35.994151 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:35.994151 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:35.995139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:36.023355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4c306b426b0946d9951381ea45000834'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.030342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4c306b426b0946d9951381ea45000834'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.095623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c306b426b0946d9951381ea45000834', 'request_id': 'req-49d89328-9932-4028-bb49-85111b518ca2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.105030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c306b426b0946d9951381ea45000834', 'request_id': 'req-49d89328-9932-4028-bb49-85111b518ca2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.112500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c306b426b0946d9951381ea45000834', 'request_id': 'req-49d89328-9932-4028-bb49-85111b518ca2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.129350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] The token cache is being invalidate because project 4c306b426b0946d9951381ea45000834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:36.129735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.130701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.142698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4c306b426b0946d9951381ea45000834', 'request_id': 'req-49d89328-9932-4028-bb49-85111b518ca2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.143528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4c306b426b0946d9951381ea45000834', 'request_id': 'req-49d89328-9932-4028-bb49-85111b518ca2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.144276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4c306b426b0946d9951381ea45000834', 'request_id': 'req-49d89328-9932-4028-bb49-85111b518ca2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:36.154477 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2400/4750] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:35 2022] DELETE /identity/v3/domains/4c306b426b0946d9951381ea45000834 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:36.159882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:36.161586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:36.176641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc1c26-5986-425f-b56e-5dfd9a4fa321 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:36.254993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841d209-ebc5-4807-a23a-cd00d153db0b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:36.255731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841d209-ebc5-4807-a23a-cd00d153db0b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:36.256105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841d209-ebc5-4807-a23a-cd00d153db0b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:36.256399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841d209-ebc5-4807-a23a-cd00d153db0b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:36.257236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841d209-ebc5-4807-a23a-cd00d153db0b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:36.259453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841d209-ebc5-4807-a23a-cd00d153db0b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:36.280177 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2351/4751] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:05:36 2022] POST /identity/v3/domains => generated 275 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:36.283571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:36.285544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:36.306954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d89328-9932-4028-bb49-85111b518ca2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:36.392450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd70109-c7ab-4c4f-bb7f-f7515758b746 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:36.393625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd70109-c7ab-4c4f-bb7f-f7515758b746 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:36.396018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd70109-c7ab-4c4f-bb7f-f7515758b746 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:36.396018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd70109-c7ab-4c4f-bb7f-f7515758b746 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:36.397793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd70109-c7ab-4c4f-bb7f-f7515758b746 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=77a6c68fa6784ff9b526ab93b466120b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:36.399776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd70109-c7ab-4c4f-bb7f-f7515758b746 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:36.453626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841d209-ebc5-4807-a23a-cd00d153db0b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:36.460134 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2401/4752] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:05:36 2022] PUT /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config => generated 138 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:36.466783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841d209-ebc5-4807-a23a-cd00d153db0b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:36.497173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16cb00-6dec-40a8-886b-8a22bf39994a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:36.498466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16cb00-6dec-40a8-886b-8a22bf39994a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:36.499001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16cb00-6dec-40a8-886b-8a22bf39994a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:36.499513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16cb00-6dec-40a8-886b-8a22bf39994a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:36.500702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16cb00-6dec-40a8-886b-8a22bf39994a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=77a6c68fa6784ff9b526ab93b466120b, group=identity)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:36.502092 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-1f16cb00-6dec-40a8-886b-8a22bf39994a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:36.502092 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:36.502092 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:36.511626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16cb00-6dec-40a8-886b-8a22bf39994a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:36.580918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd70109-c7ab-4c4f-bb7f-f7515758b746 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:36.581318 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2352/4753] 10.222.0.16 () {60 vars in 1296 bytes} [Sat Mar 26 21:05:36 2022] PATCH /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity => generated 176 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:36.600425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd70109-c7ab-4c4f-bb7f-f7515758b746 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:36.613984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d70e4-1a32-4ddb-85f7-97797130065a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:36.614895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d70e4-1a32-4ddb-85f7-97797130065a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:36.615210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d70e4-1a32-4ddb-85f7-97797130065a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:36.615485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d70e4-1a32-4ddb-85f7-97797130065a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity/driver` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:36.616333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d70e4-1a32-4ddb-85f7-97797130065a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=77a6c68fa6784ff9b526ab93b466120b, group=identity, option=driver)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:36.619823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d70e4-1a32-4ddb-85f7-97797130065a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:36.671999 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2402/4754] 10.222.0.16 () {60 vars in 1317 bytes} [Sat Mar 26 21:05:36 2022] PATCH /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity/driver => generated 176 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:05:36.675699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16cb00-6dec-40a8-886b-8a22bf39994a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:36.687486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16cb00-6dec-40a8-886b-8a22bf39994a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:36.703841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb792b-8504-4087-b0ee-0a3f6b3022c8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:36.705004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb792b-8504-4087-b0ee-0a3f6b3022c8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:36.705362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb792b-8504-4087-b0ee-0a3f6b3022c8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:36.705736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb792b-8504-4087-b0ee-0a3f6b3022c8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity/driver` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:36.706593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb792b-8504-4087-b0ee-0a3f6b3022c8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=77a6c68fa6784ff9b526ab93b466120b, group=identity, option=driver)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:36.709696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afb792b-8504-4087-b0ee-0a3f6b3022c8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:36.750688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2353/4755] 10.222.0.16 () {58 vars in 1298 bytes} [Sat Mar 26 21:05:36 2022] DELETE /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity/driver => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:36.754968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d70e4-1a32-4ddb-85f7-97797130065a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:36.784700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d70e4-1a32-4ddb-85f7-97797130065a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:36.798890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91821e11-e4d6-4426-a307-8db7183c95ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:36.800909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91821e11-e4d6-4426-a307-8db7183c95ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:36.803461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91821e11-e4d6-4426-a307-8db7183c95ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:36.803946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91821e11-e4d6-4426-a307-8db7183c95ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity/driver` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:36.805820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91821e11-e4d6-4426-a307-8db7183c95ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=77a6c68fa6784ff9b526ab93b466120b, group=identity, option=driver)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:36.810497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91821e11-e4d6-4426-a307-8db7183c95ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:36.849146 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-91821e11-e4d6-4426-a307-8db7183c95ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Could not find option driver in group identity in domain configuration for domain 77a6c68fa6784ff9b526ab93b466120b.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 77a6c68fa6784ff9b526ab93b466120b. Mar 26 21:05:36.854310 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2403/4756] 10.222.0.16 () {58 vars in 1295 bytes} [Sat Mar 26 21:05:36 2022] GET /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity/driver => generated 171 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:36.858854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb792b-8504-4087-b0ee-0a3f6b3022c8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:36.875183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb792b-8504-4087-b0ee-0a3f6b3022c8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:36.897435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7830b-52f2-4f15-ac23-a3235a882aff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:36.898563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7830b-52f2-4f15-ac23-a3235a882aff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:36.899088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7830b-52f2-4f15-ac23-a3235a882aff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:36.899689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7830b-52f2-4f15-ac23-a3235a882aff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:36.903663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7830b-52f2-4f15-ac23-a3235a882aff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=77a6c68fa6784ff9b526ab93b466120b, group=identity)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:36.908471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7830b-52f2-4f15-ac23-a3235a882aff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:36.955060 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2354/4757] 10.222.0.16 () {58 vars in 1277 bytes} [Sat Mar 26 21:05:36 2022] DELETE /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:36.956832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91821e11-e4d6-4426-a307-8db7183c95ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:36.989298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91821e11-e4d6-4426-a307-8db7183c95ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:37.012858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d35a-ca0e-4d91-86ee-129ee1d8ae37 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:37.013752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d35a-ca0e-4d91-86ee-129ee1d8ae37 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:37.014064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d35a-ca0e-4d91-86ee-129ee1d8ae37 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:37.014352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d35a-ca0e-4d91-86ee-129ee1d8ae37 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:37.016337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917d35a-ca0e-4d91-86ee-129ee1d8ae37 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=77a6c68fa6784ff9b526ab93b466120b, group=identity)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:37.017977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917d35a-ca0e-4d91-86ee-129ee1d8ae37 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:37.040030 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-0917d35a-ca0e-4d91-86ee-129ee1d8ae37 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Could not find group identity in domain configuration for domain 77a6c68fa6784ff9b526ab93b466120b.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 77a6c68fa6784ff9b526ab93b466120b. Mar 26 21:05:37.041971 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2404/4758] 10.222.0.16 () {58 vars in 1274 bytes} [Sat Mar 26 21:05:36 2022] GET /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config/identity => generated 154 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:37.047190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7830b-52f2-4f15-ac23-a3235a882aff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:37.061749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7830b-52f2-4f15-ac23-a3235a882aff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:37.071095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf561105-3076-460d-8c59-512decffd462 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:37.072521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf561105-3076-460d-8c59-512decffd462 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:37.072808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf561105-3076-460d-8c59-512decffd462 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:37.073088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf561105-3076-460d-8c59-512decffd462 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:37.079407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf561105-3076-460d-8c59-512decffd462 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=77a6c68fa6784ff9b526ab93b466120b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:37.085850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf561105-3076-460d-8c59-512decffd462 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:37.119970 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2355/4759] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:37 2022] DELETE /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b/config => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:37.133663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d35a-ca0e-4d91-86ee-129ee1d8ae37 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:37.147508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d35a-ca0e-4d91-86ee-129ee1d8ae37 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:37.155573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:37.156749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:37.157182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:37.157645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:37.159234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=77a6c68fa6784ff9b526ab93b466120b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:37.160954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:37.232754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.234059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.284245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.284917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.294733 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2405/4760] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:05:37 2022] PATCH /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b => generated 276 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:05:37.298891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf561105-3076-460d-8c59-512decffd462 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:37.301537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf561105-3076-460d-8c59-512decffd462 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:37.329529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf561105-3076-460d-8c59-512decffd462 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:37.434828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:37.435992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:37.436595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:37.437032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:37.453356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=77a6c68fa6784ff9b526ab93b466120b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:37.455100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:37.495001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.499352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.585012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b', 'request_id': 'req-23d8985e-5b0d-4af6-8769-942707ad75fc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.596731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b', 'request_id': 'req-23d8985e-5b0d-4af6-8769-942707ad75fc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.607565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b', 'request_id': 'req-23d8985e-5b0d-4af6-8769-942707ad75fc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.627207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] The token cache is being invalidate because project 77a6c68fa6784ff9b526ab93b466120b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:37.627499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.628388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.638020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b', 'request_id': 'req-23d8985e-5b0d-4af6-8769-942707ad75fc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.639163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b', 'request_id': 'req-23d8985e-5b0d-4af6-8769-942707ad75fc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.640034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '77a6c68fa6784ff9b526ab93b466120b', 'request_id': 'req-23d8985e-5b0d-4af6-8769-942707ad75fc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:37.657559 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2356/4761] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:37 2022] DELETE /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:37.662513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:37.679355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93724e-eec4-46bc-b739-9bea4cb3c1e3 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:37.775486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96215e03-2cfc-4dfb-82f7-9fb633cce1e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:37.776493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96215e03-2cfc-4dfb-82f7-9fb633cce1e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:37.776988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96215e03-2cfc-4dfb-82f7-9fb633cce1e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:37.777725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96215e03-2cfc-4dfb-82f7-9fb633cce1e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:37.780728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96215e03-2cfc-4dfb-82f7-9fb633cce1e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:37.783365 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-96215e03-2cfc-4dfb-82f7-9fb633cce1e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:37.783365 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:37.783365 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:37.784563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96215e03-2cfc-4dfb-82f7-9fb633cce1e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:37.794369 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2406/4762] 10.222.0.16 () {58 vars in 1172 bytes} [Sat Mar 26 21:05:37 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:37.796306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:37.798055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:37.827190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8985e-5b0d-4af6-8769-942707ad75fc tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:37.834966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0ac9-2657-4ec2-af39-2b3278aa06f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:37.836975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0ac9-2657-4ec2-af39-2b3278aa06f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:37.837742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0ac9-2657-4ec2-af39-2b3278aa06f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:37.838220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e0ac9-2657-4ec2-af39-2b3278aa06f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:37.839265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e0ac9-2657-4ec2-af39-2b3278aa06f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:37.842779 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-923e0ac9-2657-4ec2-af39-2b3278aa06f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:37.842779 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:37.842779 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:37.848259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e0ac9-2657-4ec2-af39-2b3278aa06f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:37.854339 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2357/4763] 10.222.0.16 () {58 vars in 1199 bytes} [Sat Mar 26 21:05:37 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:37.860330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96215e03-2cfc-4dfb-82f7-9fb633cce1e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:37.879071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96215e03-2cfc-4dfb-82f7-9fb633cce1e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:37.891643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61612ff4-2922-4427-91d3-bceb44fa643c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:37.892462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61612ff4-2922-4427-91d3-bceb44fa643c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:37.892740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61612ff4-2922-4427-91d3-bceb44fa643c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:37.893013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61612ff4-2922-4427-91d3-bceb44fa643c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:37.893666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61612ff4-2922-4427-91d3-bceb44fa643c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:37.896080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61612ff4-2922-4427-91d3-bceb44fa643c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:37.912492 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2407/4764] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:05:37 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:37.917692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0ac9-2657-4ec2-af39-2b3278aa06f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:37.932746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e0ac9-2657-4ec2-af39-2b3278aa06f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:37.948025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b557800-9d3c-4e6e-8d86-79e42ce53257 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:37.948878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b557800-9d3c-4e6e-8d86-79e42ce53257 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:37.949126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b557800-9d3c-4e6e-8d86-79e42ce53257 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:37.949411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b557800-9d3c-4e6e-8d86-79e42ce53257 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:37.950137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b557800-9d3c-4e6e-8d86-79e42ce53257 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:37.951786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b557800-9d3c-4e6e-8d86-79e42ce53257 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:37.952984 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2358/4765] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:37 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:37.957208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61612ff4-2922-4427-91d3-bceb44fa643c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:37.970266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61612ff4-2922-4427-91d3-bceb44fa643c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:37.988231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0430-a2bd-4fad-9644-5dfec8eceac4 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:37.988999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0430-a2bd-4fad-9644-5dfec8eceac4 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:37.989286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0430-a2bd-4fad-9644-5dfec8eceac4 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:37.989564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e0430-a2bd-4fad-9644-5dfec8eceac4 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:37.990227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e0430-a2bd-4fad-9644-5dfec8eceac4 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:37.991853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e0430-a2bd-4fad-9644-5dfec8eceac4 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:37.993447 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2408/4766] 10.222.0.16 () {58 vars in 1187 bytes} [Sat Mar 26 21:05:37 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:37.997883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b557800-9d3c-4e6e-8d86-79e42ce53257 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.014564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b557800-9d3c-4e6e-8d86-79e42ce53257 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.035365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e3e9e-dbc1-4f97-b723-393cae094488 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.036168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e3e9e-dbc1-4f97-b723-393cae094488 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.036453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e3e9e-dbc1-4f97-b723-393cae094488 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.036725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e3e9e-dbc1-4f97-b723-393cae094488 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.037381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e3e9e-dbc1-4f97-b723-393cae094488 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.038997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e3e9e-dbc1-4f97-b723-393cae094488 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.051728 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2359/4767] 10.222.0.16 () {58 vars in 1199 bytes} [Sat Mar 26 21:05:37 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.052968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0430-a2bd-4fad-9644-5dfec8eceac4 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.068750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e0430-a2bd-4fad-9644-5dfec8eceac4 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.081168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db617fc-67e6-43db-acd8-ae887a84a7c2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.086426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db617fc-67e6-43db-acd8-ae887a84a7c2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.086793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db617fc-67e6-43db-acd8-ae887a84a7c2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.087280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db617fc-67e6-43db-acd8-ae887a84a7c2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.092037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db617fc-67e6-43db-acd8-ae887a84a7c2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.093863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db617fc-67e6-43db-acd8-ae887a84a7c2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.097593 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2409/4768] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.101629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e3e9e-dbc1-4f97-b723-393cae094488 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.114468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e3e9e-dbc1-4f97-b723-393cae094488 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.120433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8131b-89bf-4400-9a28-529952b37b20 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.121619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8131b-89bf-4400-9a28-529952b37b20 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.122165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8131b-89bf-4400-9a28-529952b37b20 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.122663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8131b-89bf-4400-9a28-529952b37b20 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.124311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8131b-89bf-4400-9a28-529952b37b20 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.126396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8131b-89bf-4400-9a28-529952b37b20 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.128519 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2360/4769] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.132655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db617fc-67e6-43db-acd8-ae887a84a7c2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.145212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db617fc-67e6-43db-acd8-ae887a84a7c2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.160391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deb658-32b6-406e-88c4-33491928f0f5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.161369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deb658-32b6-406e-88c4-33491928f0f5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.161811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deb658-32b6-406e-88c4-33491928f0f5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.162770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deb658-32b6-406e-88c4-33491928f0f5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.166576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90deb658-32b6-406e-88c4-33491928f0f5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.169128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90deb658-32b6-406e-88c4-33491928f0f5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.174824 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2410/4770] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.179782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8131b-89bf-4400-9a28-529952b37b20 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.194395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8131b-89bf-4400-9a28-529952b37b20 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.206342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd7798-c201-4298-aaa7-d979202629d6 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.207602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd7798-c201-4298-aaa7-d979202629d6 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.207897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd7798-c201-4298-aaa7-d979202629d6 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.208204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd7798-c201-4298-aaa7-d979202629d6 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.210092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd7798-c201-4298-aaa7-d979202629d6 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.212068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd7798-c201-4298-aaa7-d979202629d6 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.218210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deb658-32b6-406e-88c4-33491928f0f5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.223552 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2361/4771] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.244000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deb658-32b6-406e-88c4-33491928f0f5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.266143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2b21d-13a4-428b-ba72-a6f25c5de159 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.266143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2b21d-13a4-428b-ba72-a6f25c5de159 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.266143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2b21d-13a4-428b-ba72-a6f25c5de159 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.266641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e2b21d-13a4-428b-ba72-a6f25c5de159 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.266641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2b21d-13a4-428b-ba72-a6f25c5de159 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.269186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e2b21d-13a4-428b-ba72-a6f25c5de159 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.271084 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2411/4772] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Mar 26 21:05:38.276481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd7798-c201-4298-aaa7-d979202629d6 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.310547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd7798-c201-4298-aaa7-d979202629d6 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.341389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78077ac-b570-4e0c-a39a-67c688084d02 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.342455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78077ac-b570-4e0c-a39a-67c688084d02 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.342955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78077ac-b570-4e0c-a39a-67c688084d02 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.343419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78077ac-b570-4e0c-a39a-67c688084d02 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.344291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78077ac-b570-4e0c-a39a-67c688084d02 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.346080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78077ac-b570-4e0c-a39a-67c688084d02 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.352560 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2362/4773] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Mar 26 21:05:38.356479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2b21d-13a4-428b-ba72-a6f25c5de159 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.369966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e2b21d-13a4-428b-ba72-a6f25c5de159 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.386514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29adc9f-be9f-47e9-af5c-22256c3b85ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.387321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29adc9f-be9f-47e9-af5c-22256c3b85ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.387605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29adc9f-be9f-47e9-af5c-22256c3b85ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.387889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29adc9f-be9f-47e9-af5c-22256c3b85ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.388573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29adc9f-be9f-47e9-af5c-22256c3b85ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.396406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29adc9f-be9f-47e9-af5c-22256c3b85ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.401269 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2412/4774] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.404257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78077ac-b570-4e0c-a39a-67c688084d02 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.420397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78077ac-b570-4e0c-a39a-67c688084d02 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.429575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eeba4-b35a-4e23-bdb6-1a0e72be533a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.430594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eeba4-b35a-4e23-bdb6-1a0e72be533a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.431649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eeba4-b35a-4e23-bdb6-1a0e72be533a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.432116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02eeba4-b35a-4e23-bdb6-1a0e72be533a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.435186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eeba4-b35a-4e23-bdb6-1a0e72be533a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.437617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02eeba4-b35a-4e23-bdb6-1a0e72be533a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.442296 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2363/4775] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.445464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29adc9f-be9f-47e9-af5c-22256c3b85ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.459131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29adc9f-be9f-47e9-af5c-22256c3b85ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.468221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047097a3-81ce-4559-bc56-ee75edda97b7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.469012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047097a3-81ce-4559-bc56-ee75edda97b7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.469294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047097a3-81ce-4559-bc56-ee75edda97b7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.469845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047097a3-81ce-4559-bc56-ee75edda97b7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.470521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047097a3-81ce-4559-bc56-ee75edda97b7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.472149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047097a3-81ce-4559-bc56-ee75edda97b7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.473934 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2413/4776] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.477691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eeba4-b35a-4e23-bdb6-1a0e72be533a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.496241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02eeba4-b35a-4e23-bdb6-1a0e72be533a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.502873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea0467-179b-436a-aed3-46ffef483b06 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.504173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea0467-179b-436a-aed3-46ffef483b06 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.504810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea0467-179b-436a-aed3-46ffef483b06 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.505261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fea0467-179b-436a-aed3-46ffef483b06 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.506075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea0467-179b-436a-aed3-46ffef483b06 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.510252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fea0467-179b-436a-aed3-46ffef483b06 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.515866 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2364/4777] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.518768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047097a3-81ce-4559-bc56-ee75edda97b7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.556825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047097a3-81ce-4559-bc56-ee75edda97b7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.574693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079805-b5a8-4807-b1b8-118fb4739999 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.576316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079805-b5a8-4807-b1b8-118fb4739999 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.576989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079805-b5a8-4807-b1b8-118fb4739999 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.577472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6079805-b5a8-4807-b1b8-118fb4739999 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.578327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6079805-b5a8-4807-b1b8-118fb4739999 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.580231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6079805-b5a8-4807-b1b8-118fb4739999 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.584136 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2414/4778] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.588773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea0467-179b-436a-aed3-46ffef483b06 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.601716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fea0467-179b-436a-aed3-46ffef483b06 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.607532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818e991-4ff2-4529-bc90-15dafaf98730 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.608687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818e991-4ff2-4529-bc90-15dafaf98730 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.609195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818e991-4ff2-4529-bc90-15dafaf98730 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.609962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818e991-4ff2-4529-bc90-15dafaf98730 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.610869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818e991-4ff2-4529-bc90-15dafaf98730 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.614081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818e991-4ff2-4529-bc90-15dafaf98730 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.616812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2365/4779] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.622974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079805-b5a8-4807-b1b8-118fb4739999 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.652456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6079805-b5a8-4807-b1b8-118fb4739999 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.659045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbad84-1709-4e5a-9162-2cc4c2f8af49 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.660771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbad84-1709-4e5a-9162-2cc4c2f8af49 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.661387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbad84-1709-4e5a-9162-2cc4c2f8af49 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.661982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbad84-1709-4e5a-9162-2cc4c2f8af49 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.663438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbad84-1709-4e5a-9162-2cc4c2f8af49 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.665716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbad84-1709-4e5a-9162-2cc4c2f8af49 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.667488 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2415/4780] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.671132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818e991-4ff2-4529-bc90-15dafaf98730 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.694571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818e991-4ff2-4529-bc90-15dafaf98730 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.705636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484a180-6590-4155-b961-f2efa34e1913 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.706563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484a180-6590-4155-b961-f2efa34e1913 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.707133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484a180-6590-4155-b961-f2efa34e1913 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.707704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484a180-6590-4155-b961-f2efa34e1913 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.708829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484a180-6590-4155-b961-f2efa34e1913 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.711245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484a180-6590-4155-b961-f2efa34e1913 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.713507 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2366/4781] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.717821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbad84-1709-4e5a-9162-2cc4c2f8af49 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.729218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbad84-1709-4e5a-9162-2cc4c2f8af49 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.736660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffed06-0635-4c2e-b0d4-4ee75b9fd34b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.748825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffed06-0635-4c2e-b0d4-4ee75b9fd34b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.749836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffed06-0635-4c2e-b0d4-4ee75b9fd34b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.750169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffed06-0635-4c2e-b0d4-4ee75b9fd34b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.751704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffed06-0635-4c2e-b0d4-4ee75b9fd34b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.755906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffed06-0635-4c2e-b0d4-4ee75b9fd34b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.763204 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2416/4782] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.765808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484a180-6590-4155-b961-f2efa34e1913 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.791223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484a180-6590-4155-b961-f2efa34e1913 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.803110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8955-c1dd-4fcf-989d-5cc4b774755e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.804238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8955-c1dd-4fcf-989d-5cc4b774755e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.804759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8955-c1dd-4fcf-989d-5cc4b774755e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.805050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e8955-c1dd-4fcf-989d-5cc4b774755e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.805709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e8955-c1dd-4fcf-989d-5cc4b774755e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.821254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e8955-c1dd-4fcf-989d-5cc4b774755e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.829183 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2367/4783] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.835768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffed06-0635-4c2e-b0d4-4ee75b9fd34b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.858925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffed06-0635-4c2e-b0d4-4ee75b9fd34b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.867044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a6ac8-bd80-4d95-af3f-150a13462230 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.868206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a6ac8-bd80-4d95-af3f-150a13462230 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.869051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a6ac8-bd80-4d95-af3f-150a13462230 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.869513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a6ac8-bd80-4d95-af3f-150a13462230 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.870357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a6ac8-bd80-4d95-af3f-150a13462230 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.872221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a6ac8-bd80-4d95-af3f-150a13462230 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.874835 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2417/4784] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.879266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8955-c1dd-4fcf-989d-5cc4b774755e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.899241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e8955-c1dd-4fcf-989d-5cc4b774755e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.904511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b4d41-ddb2-4549-9270-a6ba7e5a9e5f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.905304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b4d41-ddb2-4549-9270-a6ba7e5a9e5f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.905592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b4d41-ddb2-4549-9270-a6ba7e5a9e5f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.905876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b4d41-ddb2-4549-9270-a6ba7e5a9e5f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.906543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b4d41-ddb2-4549-9270-a6ba7e5a9e5f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.908236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b4d41-ddb2-4549-9270-a6ba7e5a9e5f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.909484 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2368/4785] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.913431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a6ac8-bd80-4d95-af3f-150a13462230 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.930381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a6ac8-bd80-4d95-af3f-150a13462230 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.944666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791d97a-e02e-4289-8cb3-e20acdf67dae tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.945535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791d97a-e02e-4289-8cb3-e20acdf67dae tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.945877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791d97a-e02e-4289-8cb3-e20acdf67dae tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.946170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791d97a-e02e-4289-8cb3-e20acdf67dae tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.947589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791d97a-e02e-4289-8cb3-e20acdf67dae tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.949443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791d97a-e02e-4289-8cb3-e20acdf67dae tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.951637 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2418/4786] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.955757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b4d41-ddb2-4549-9270-a6ba7e5a9e5f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.968907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b4d41-ddb2-4549-9270-a6ba7e5a9e5f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:38.974333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155c006-2caa-4e7d-b89e-426466751f32 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:38.975559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155c006-2caa-4e7d-b89e-426466751f32 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:38.976022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155c006-2caa-4e7d-b89e-426466751f32 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:38.976390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155c006-2caa-4e7d-b89e-426466751f32 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:38.977208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155c006-2caa-4e7d-b89e-426466751f32 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:38.981198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155c006-2caa-4e7d-b89e-426466751f32 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:38.986708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791d97a-e02e-4289-8cb3-e20acdf67dae tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:38.999009 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2369/4787] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:38.999690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791d97a-e02e-4289-8cb3-e20acdf67dae tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.013986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6f98-69cf-49d6-b8a1-6bf91f487d22 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.022800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6f98-69cf-49d6-b8a1-6bf91f487d22 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.023722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6f98-69cf-49d6-b8a1-6bf91f487d22 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.025195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c6f98-69cf-49d6-b8a1-6bf91f487d22 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.028865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c6f98-69cf-49d6-b8a1-6bf91f487d22 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.035760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c6f98-69cf-49d6-b8a1-6bf91f487d22 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.042397 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2419/4788] 10.222.0.16 () {58 vars in 1289 bytes} [Sat Mar 26 21:05:38 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.043802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155c006-2caa-4e7d-b89e-426466751f32 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.059731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155c006-2caa-4e7d-b89e-426466751f32 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.077089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e15df-c270-4f6a-85cd-a820d24b5176 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.078775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e15df-c270-4f6a-85cd-a820d24b5176 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.079616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e15df-c270-4f6a-85cd-a820d24b5176 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.080101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e15df-c270-4f6a-85cd-a820d24b5176 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.080970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e15df-c270-4f6a-85cd-a820d24b5176 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.084845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e15df-c270-4f6a-85cd-a820d24b5176 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.089318 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2370/4789] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.090731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6f98-69cf-49d6-b8a1-6bf91f487d22 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.101414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c6f98-69cf-49d6-b8a1-6bf91f487d22 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.113896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76588d-6e12-461b-a9de-56585a2de4e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.115184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76588d-6e12-461b-a9de-56585a2de4e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.115649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76588d-6e12-461b-a9de-56585a2de4e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.116165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76588d-6e12-461b-a9de-56585a2de4e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.117103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76588d-6e12-461b-a9de-56585a2de4e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.122699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76588d-6e12-461b-a9de-56585a2de4e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.126780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2420/4790] 10.222.0.16 () {58 vars in 1265 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.131142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e15df-c270-4f6a-85cd-a820d24b5176 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.143957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e15df-c270-4f6a-85cd-a820d24b5176 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.156579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83619285-429e-4272-b71e-efaac20ba395 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.157664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83619285-429e-4272-b71e-efaac20ba395 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.159563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83619285-429e-4272-b71e-efaac20ba395 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.160182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83619285-429e-4272-b71e-efaac20ba395 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.161089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83619285-429e-4272-b71e-efaac20ba395 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.162944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83619285-429e-4272-b71e-efaac20ba395 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.169555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2371/4791] 10.222.0.16 () {58 vars in 1307 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.169764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76588d-6e12-461b-a9de-56585a2de4e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.180075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76588d-6e12-461b-a9de-56585a2de4e7 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.187506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b4dff-7b72-4f58-9f82-d711cc06088e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.188745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b4dff-7b72-4f58-9f82-d711cc06088e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.189234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b4dff-7b72-4f58-9f82-d711cc06088e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.189710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b4dff-7b72-4f58-9f82-d711cc06088e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.190644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b4dff-7b72-4f58-9f82-d711cc06088e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.193258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b4dff-7b72-4f58-9f82-d711cc06088e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.199226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83619285-429e-4272-b71e-efaac20ba395 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.207788 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2421/4792] 10.222.0.16 () {58 vars in 1289 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Mar 26 21:05:39.217573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83619285-429e-4272-b71e-efaac20ba395 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.233791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16a871-6cc2-4f39-96b6-bf26f7f83381 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.234614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a871-6cc2-4f39-96b6-bf26f7f83381 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.236558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a871-6cc2-4f39-96b6-bf26f7f83381 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.236809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16a871-6cc2-4f39-96b6-bf26f7f83381 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.238644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a871-6cc2-4f39-96b6-bf26f7f83381 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.244555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16a871-6cc2-4f39-96b6-bf26f7f83381 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.250823 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2372/4793] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.252045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b4dff-7b72-4f58-9f82-d711cc06088e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.271268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b4dff-7b72-4f58-9f82-d711cc06088e tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.277537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291eb3-405e-479a-9023-3a5462cfbf94 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.278381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291eb3-405e-479a-9023-3a5462cfbf94 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.278668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291eb3-405e-479a-9023-3a5462cfbf94 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.279033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291eb3-405e-479a-9023-3a5462cfbf94 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.280278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b291eb3-405e-479a-9023-3a5462cfbf94 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.282174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b291eb3-405e-479a-9023-3a5462cfbf94 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.286402 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2422/4794] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.287430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16a871-6cc2-4f39-96b6-bf26f7f83381 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.311896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16a871-6cc2-4f39-96b6-bf26f7f83381 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.325770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674918a-5ee2-4d4d-b399-558ea4d676f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.327645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674918a-5ee2-4d4d-b399-558ea4d676f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.328138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674918a-5ee2-4d4d-b399-558ea4d676f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.328577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674918a-5ee2-4d4d-b399-558ea4d676f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.329894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674918a-5ee2-4d4d-b399-558ea4d676f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.364641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674918a-5ee2-4d4d-b399-558ea4d676f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.368115 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2373/4795] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.372608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291eb3-405e-479a-9023-3a5462cfbf94 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.393810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291eb3-405e-479a-9023-3a5462cfbf94 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.402830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0da663-eb42-47c1-b448-2ff5f6dfd098 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.404663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0da663-eb42-47c1-b448-2ff5f6dfd098 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.405330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0da663-eb42-47c1-b448-2ff5f6dfd098 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.405861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0da663-eb42-47c1-b448-2ff5f6dfd098 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.410972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0da663-eb42-47c1-b448-2ff5f6dfd098 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.417998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0da663-eb42-47c1-b448-2ff5f6dfd098 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.425680 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2423/4796] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.428459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674918a-5ee2-4d4d-b399-558ea4d676f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.446213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674918a-5ee2-4d4d-b399-558ea4d676f1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.460376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17287e6a-d69f-4856-a2ff-19b185bfb0e2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.466650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17287e6a-d69f-4856-a2ff-19b185bfb0e2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.466951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17287e6a-d69f-4856-a2ff-19b185bfb0e2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.467240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17287e6a-d69f-4856-a2ff-19b185bfb0e2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.470007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17287e6a-d69f-4856-a2ff-19b185bfb0e2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.472876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17287e6a-d69f-4856-a2ff-19b185bfb0e2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.475343 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2374/4797] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.479934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0da663-eb42-47c1-b448-2ff5f6dfd098 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.493086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0da663-eb42-47c1-b448-2ff5f6dfd098 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.508063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd4ff3-8dde-4cb0-8187-1e5af512f76f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.509537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd4ff3-8dde-4cb0-8187-1e5af512f76f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.509987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd4ff3-8dde-4cb0-8187-1e5af512f76f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.510427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd4ff3-8dde-4cb0-8187-1e5af512f76f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.511529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd4ff3-8dde-4cb0-8187-1e5af512f76f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.513365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd4ff3-8dde-4cb0-8187-1e5af512f76f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.515942 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2424/4798] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.520512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17287e6a-d69f-4856-a2ff-19b185bfb0e2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.541851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17287e6a-d69f-4856-a2ff-19b185bfb0e2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.568174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576d51-c9f5-460a-ad17-a28aa1c01bb5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.569413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576d51-c9f5-460a-ad17-a28aa1c01bb5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.569717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576d51-c9f5-460a-ad17-a28aa1c01bb5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.570062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27576d51-c9f5-460a-ad17-a28aa1c01bb5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.570774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576d51-c9f5-460a-ad17-a28aa1c01bb5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.586626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27576d51-c9f5-460a-ad17-a28aa1c01bb5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.594627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd4ff3-8dde-4cb0-8187-1e5af512f76f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.595308 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2375/4799] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Mar 26 21:05:39.611668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd4ff3-8dde-4cb0-8187-1e5af512f76f tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.652660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9118-4be5-45dd-a28a-6b3b73fec21d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.653537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9118-4be5-45dd-a28a-6b3b73fec21d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.653822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9118-4be5-45dd-a28a-6b3b73fec21d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.658129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc9118-4be5-45dd-a28a-6b3b73fec21d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.663608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc9118-4be5-45dd-a28a-6b3b73fec21d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.675179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc9118-4be5-45dd-a28a-6b3b73fec21d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.681099 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2425/4800] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.685504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576d51-c9f5-460a-ad17-a28aa1c01bb5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.707178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27576d51-c9f5-460a-ad17-a28aa1c01bb5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.727690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6510f31-4bdd-4a24-a83a-4cfdec537b2d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.730753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6510f31-4bdd-4a24-a83a-4cfdec537b2d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.733512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6510f31-4bdd-4a24-a83a-4cfdec537b2d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.734007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6510f31-4bdd-4a24-a83a-4cfdec537b2d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.735013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6510f31-4bdd-4a24-a83a-4cfdec537b2d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.740881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6510f31-4bdd-4a24-a83a-4cfdec537b2d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.742553 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2376/4801] 10.222.0.16 () {58 vars in 1256 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.747591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9118-4be5-45dd-a28a-6b3b73fec21d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.764606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc9118-4be5-45dd-a28a-6b3b73fec21d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.779435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa580b-3f62-4f3f-9a9d-3d55d3905158 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.780603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa580b-3f62-4f3f-9a9d-3d55d3905158 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.781093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa580b-3f62-4f3f-9a9d-3d55d3905158 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.781545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa580b-3f62-4f3f-9a9d-3d55d3905158 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.784687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa580b-3f62-4f3f-9a9d-3d55d3905158 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.786542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa580b-3f62-4f3f-9a9d-3d55d3905158 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.798050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6510f31-4bdd-4a24-a83a-4cfdec537b2d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.809751 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2426/4802] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.814517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6510f31-4bdd-4a24-a83a-4cfdec537b2d tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.825234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76719b-f86a-4659-990c-1f9c0041566b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.826092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76719b-f86a-4659-990c-1f9c0041566b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.826388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76719b-f86a-4659-990c-1f9c0041566b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.826677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76719b-f86a-4659-990c-1f9c0041566b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.827491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76719b-f86a-4659-990c-1f9c0041566b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.838732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76719b-f86a-4659-990c-1f9c0041566b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.840548 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2377/4803] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.846148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa580b-3f62-4f3f-9a9d-3d55d3905158 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.865693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa580b-3f62-4f3f-9a9d-3d55d3905158 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.878389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4cf11-91aa-498b-90e9-4be307439743 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.879580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4cf11-91aa-498b-90e9-4be307439743 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.880056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4cf11-91aa-498b-90e9-4be307439743 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.883628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4cf11-91aa-498b-90e9-4be307439743 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.885070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4cf11-91aa-498b-90e9-4be307439743 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.893001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4cf11-91aa-498b-90e9-4be307439743 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.895164 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2427/4804] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.899642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76719b-f86a-4659-990c-1f9c0041566b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.926728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76719b-f86a-4659-990c-1f9c0041566b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.937001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee42d8-2fc4-4141-9a05-81e25abc0a91 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.938204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee42d8-2fc4-4141-9a05-81e25abc0a91 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.938658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee42d8-2fc4-4141-9a05-81e25abc0a91 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.939127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee42d8-2fc4-4141-9a05-81e25abc0a91 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.940390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee42d8-2fc4-4141-9a05-81e25abc0a91 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.942574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee42d8-2fc4-4141-9a05-81e25abc0a91 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.948723 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2378/4805] 10.222.0.16 () {58 vars in 1211 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.950183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4cf11-91aa-498b-90e9-4be307439743 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:39.964821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4cf11-91aa-498b-90e9-4be307439743 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:39.975557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc44f-1f85-4969-8a12-0ea5f6727b5a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:39.976390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc44f-1f85-4969-8a12-0ea5f6727b5a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:39.976677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc44f-1f85-4969-8a12-0ea5f6727b5a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:39.976956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8dc44f-1f85-4969-8a12-0ea5f6727b5a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:39.977713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dc44f-1f85-4969-8a12-0ea5f6727b5a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:39.979262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8dc44f-1f85-4969-8a12-0ea5f6727b5a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:39.986685 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2428/4806] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:39.990446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee42d8-2fc4-4141-9a05-81e25abc0a91 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.015553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee42d8-2fc4-4141-9a05-81e25abc0a91 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.030861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe7122-c47e-4c8c-acee-b53c3bbb0fc1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.031661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7122-c47e-4c8c-acee-b53c3bbb0fc1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.031968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7122-c47e-4c8c-acee-b53c3bbb0fc1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.032251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe7122-c47e-4c8c-acee-b53c3bbb0fc1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.032917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe7122-c47e-4c8c-acee-b53c3bbb0fc1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.034552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe7122-c47e-4c8c-acee-b53c3bbb0fc1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.039951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc44f-1f85-4969-8a12-0ea5f6727b5a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.044120 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2379/4807] 10.222.0.16 () {58 vars in 1214 bytes} [Sat Mar 26 21:05:39 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:40.051726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8dc44f-1f85-4969-8a12-0ea5f6727b5a tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.078507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cc1bb-1d47-4d02-b915-4f6004e6c473 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.079185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cc1bb-1d47-4d02-b915-4f6004e6c473 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.079472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cc1bb-1d47-4d02-b915-4f6004e6c473 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.080368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189cc1bb-1d47-4d02-b915-4f6004e6c473 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.081233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cc1bb-1d47-4d02-b915-4f6004e6c473 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.083172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189cc1bb-1d47-4d02-b915-4f6004e6c473 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.086237 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2429/4808] 10.222.0.16 () {58 vars in 1217 bytes} [Sat Mar 26 21:05:40 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Mar 26 21:05:40.090692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe7122-c47e-4c8c-acee-b53c3bbb0fc1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.110824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe7122-c47e-4c8c-acee-b53c3bbb0fc1 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.126771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7095d8-a876-4e8b-80ea-6cb457c47771 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.127587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7095d8-a876-4e8b-80ea-6cb457c47771 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.127883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7095d8-a876-4e8b-80ea-6cb457c47771 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.128194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7095d8-a876-4e8b-80ea-6cb457c47771 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.128972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7095d8-a876-4e8b-80ea-6cb457c47771 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.136210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7095d8-a876-4e8b-80ea-6cb457c47771 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.137921 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2380/4809] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:40 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:40.141773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cc1bb-1d47-4d02-b915-4f6004e6c473 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.162318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189cc1bb-1d47-4d02-b915-4f6004e6c473 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.177233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f23c5f-38ee-4f10-b30d-04531da3aab5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.178240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f23c5f-38ee-4f10-b30d-04531da3aab5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.178690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f23c5f-38ee-4f10-b30d-04531da3aab5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.179451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f23c5f-38ee-4f10-b30d-04531da3aab5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.180518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f23c5f-38ee-4f10-b30d-04531da3aab5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.183010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f23c5f-38ee-4f10-b30d-04531da3aab5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.189199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7095d8-a876-4e8b-80ea-6cb457c47771 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.204283 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2430/4810] 10.222.0.16 () {58 vars in 1238 bytes} [Sat Mar 26 21:05:40 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:40.206564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7095d8-a876-4e8b-80ea-6cb457c47771 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.219546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e47ac7-2d09-47c5-ad29-a51a6c0a6dc8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.220508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e47ac7-2d09-47c5-ad29-a51a6c0a6dc8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.220944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e47ac7-2d09-47c5-ad29-a51a6c0a6dc8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.221373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e47ac7-2d09-47c5-ad29-a51a6c0a6dc8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.223177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e47ac7-2d09-47c5-ad29-a51a6c0a6dc8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.226429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e47ac7-2d09-47c5-ad29-a51a6c0a6dc8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.233520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f23c5f-38ee-4f10-b30d-04531da3aab5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.241562 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2381/4811] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 21:05:40 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:40.247199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f23c5f-38ee-4f10-b30d-04531da3aab5 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.253306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04485f-1fc4-401a-9bed-2ac5752705d2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.254459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04485f-1fc4-401a-9bed-2ac5752705d2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.254943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04485f-1fc4-401a-9bed-2ac5752705d2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.255387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04485f-1fc4-401a-9bed-2ac5752705d2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.256256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04485f-1fc4-401a-9bed-2ac5752705d2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.260436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04485f-1fc4-401a-9bed-2ac5752705d2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.266304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e47ac7-2d09-47c5-ad29-a51a6c0a6dc8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.276370 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2431/4812] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 21:05:40 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:40.280551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e47ac7-2d09-47c5-ad29-a51a6c0a6dc8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.287088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c2d9d-1e15-45c8-8b74-04973d06c544 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.288466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c2d9d-1e15-45c8-8b74-04973d06c544 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.289056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c2d9d-1e15-45c8-8b74-04973d06c544 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.289530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c2d9d-1e15-45c8-8b74-04973d06c544 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.290401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c2d9d-1e15-45c8-8b74-04973d06c544 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.292610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c2d9d-1e15-45c8-8b74-04973d06c544 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.298210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04485f-1fc4-401a-9bed-2ac5752705d2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.307034 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2382/4813] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:40 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:40.314172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04485f-1fc4-401a-9bed-2ac5752705d2 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.319899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba07705-b0c4-4728-b80c-1971022d3a51 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.320964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba07705-b0c4-4728-b80c-1971022d3a51 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.321431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba07705-b0c4-4728-b80c-1971022d3a51 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.322437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba07705-b0c4-4728-b80c-1971022d3a51 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.323559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba07705-b0c4-4728-b80c-1971022d3a51 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.325396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba07705-b0c4-4728-b80c-1971022d3a51 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.331652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c2d9d-1e15-45c8-8b74-04973d06c544 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.345260 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2432/4814] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:40 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:40.350298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c2d9d-1e15-45c8-8b74-04973d06c544 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.365277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caeb702-b0e4-42b4-a5c6-af439d87a99c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.366467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeb702-b0e4-42b4-a5c6-af439d87a99c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.366764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeb702-b0e4-42b4-a5c6-af439d87a99c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.367053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caeb702-b0e4-42b4-a5c6-af439d87a99c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.367727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caeb702-b0e4-42b4-a5c6-af439d87a99c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.369935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caeb702-b0e4-42b4-a5c6-af439d87a99c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.379050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba07705-b0c4-4728-b80c-1971022d3a51 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.387018 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2383/4815] 10.222.0.16 () {58 vars in 1277 bytes} [Sat Mar 26 21:05:40 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Mar 26 21:05:40.392960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba07705-b0c4-4728-b80c-1971022d3a51 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.406159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9effee-85b2-4051-99e8-f72e91ff06ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.407040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9effee-85b2-4051-99e8-f72e91ff06ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.407332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9effee-85b2-4051-99e8-f72e91ff06ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.407616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9effee-85b2-4051-99e8-f72e91ff06ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/77a6c68fa6784ff9b526ab93b466120b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.448853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9effee-85b2-4051-99e8-f72e91ff06ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:05:40.499058 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-9b9effee-85b2-4051-99e8-f72e91ff06ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Could not find domain: 77a6c68fa6784ff9b526ab93b466120b.: keystone.exception.DomainNotFound: Could not find domain: 77a6c68fa6784ff9b526ab93b466120b. Mar 26 21:05:40.501851 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2433/4816] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:05:40 2022] PATCH /identity/v3/domains/77a6c68fa6784ff9b526ab93b466120b => generated 112 bytes in 123 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:40.505608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caeb702-b0e4-42b4-a5c6-af439d87a99c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.516836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caeb702-b0e4-42b4-a5c6-af439d87a99c tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.540244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928241-67ef-4f9c-a5e1-7934e5b68f9b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.543147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928241-67ef-4f9c-a5e1-7934e5b68f9b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.543459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928241-67ef-4f9c-a5e1-7934e5b68f9b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.543740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f928241-67ef-4f9c-a5e1-7934e5b68f9b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/4c306b426b0946d9951381ea45000834` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.564544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f928241-67ef-4f9c-a5e1-7934e5b68f9b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:05:40.580807 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2f928241-67ef-4f9c-a5e1-7934e5b68f9b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Could not find domain: 4c306b426b0946d9951381ea45000834.: keystone.exception.DomainNotFound: Could not find domain: 4c306b426b0946d9951381ea45000834. Mar 26 21:05:40.584503 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2384/4817] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:05:40 2022] PATCH /identity/v3/domains/4c306b426b0946d9951381ea45000834 => generated 112 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:40.587124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9effee-85b2-4051-99e8-f72e91ff06ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.598177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9effee-85b2-4051-99e8-f72e91ff06ff tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.608781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54253cd0-3652-42d7-9444-9f638a6109e8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '421de670f17e42508264d1524e6bed82', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecf9e41842234ac0adfb3bf3a94ff568', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.610063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253cd0-3652-42d7-9444-9f638a6109e8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.610541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253cd0-3652-42d7-9444-9f638a6109e8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.611005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54253cd0-3652-42d7-9444-9f638a6109e8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] PATH_INFO: `/v3/domains/5db531c924d0442ca08153156225e569` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.624104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54253cd0-3652-42d7-9444-9f638a6109e8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:05:40.638224 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-54253cd0-3652-42d7-9444-9f638a6109e8 tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Could not find domain: 5db531c924d0442ca08153156225e569.: keystone.exception.DomainNotFound: Could not find domain: 5db531c924d0442ca08153156225e569. Mar 26 21:05:40.641850 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2434/4818] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:05:40 2022] PATCH /identity/v3/domains/5db531c924d0442ca08153156225e569 => generated 112 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:40.648335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928241-67ef-4f9c-a5e1-7934e5b68f9b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:40.654809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f928241-67ef-4f9c-a5e1-7934e5b68f9b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:40.787497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f928241-67ef-4f9c-a5e1-7934e5b68f9b tempest-DomainConfigurationTestJSON-757610040 tempest-DomainConfigurationTestJSON-757610040-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:40.797425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:40.804949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.805597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.806980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] PATH_INFO: `/v3/users/e971783228074e4fab14696a73c4d19b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:40.808699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e971783228074e4fab14696a73c4d19b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:40.811126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:40.918063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e971783228074e4fab14696a73c4d19b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:40.938577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e971783228074e4fab14696a73c4d19b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:40.939816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e971783228074e4fab14696a73c4d19b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:40.940415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e971783228074e4fab14696a73c4d19b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:40.965776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e971783228074e4fab14696a73c4d19b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:40.989759 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2385/4819] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:40 2022] DELETE /identity/v3/users/e971783228074e4fab14696a73c4d19b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:40.994559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ca2c6-648c-4318-bb7c-e2ec8ad3f9d7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:40.994833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ca2c6-648c-4318-bb7c-e2ec8ad3f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:40.995113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ca2c6-648c-4318-bb7c-e2ec8ad3f9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:41.079233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-793ca2c6-648c-4318-bb7c-e2ec8ad3f9d7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:41.080512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-793ca2c6-648c-4318-bb7c-e2ec8ad3f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:41.255232 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2435/4820] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:41.272653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:41.274887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:41.439896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f06d1-1331-4cee-adbd-b408fa5a3d0d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:41.447399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac820e-a0a7-4249-a6cc-adf27695410b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:41.449391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac820e-a0a7-4249-a6cc-adf27695410b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:41.449919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac820e-a0a7-4249-a6cc-adf27695410b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:41.450421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac820e-a0a7-4249-a6cc-adf27695410b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:41.466617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac820e-a0a7-4249-a6cc-adf27695410b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:41.468558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac820e-a0a7-4249-a6cc-adf27695410b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:41.483080 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2386/4821] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:42.732982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ca2c6-648c-4318-bb7c-e2ec8ad3f9d7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:42.734647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-793ca2c6-648c-4318-bb7c-e2ec8ad3f9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:42.749756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ca2c6-648c-4318-bb7c-e2ec8ad3f9d7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:42.755309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:42.756410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:42.756805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:42.757184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] PATH_INFO: `/v3/projects/7d4a77bb19484b37810f325091f040d3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:42.758563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d4a77bb19484b37810f325091f040d3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:42.760519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:42.815985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d4a77bb19484b37810f325091f040d3', 'request_id': 'req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:42.829976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d4a77bb19484b37810f325091f040d3', 'request_id': 'req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:42.840853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d4a77bb19484b37810f325091f040d3', 'request_id': 'req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:42.872635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] The token cache is being invalidate because project 7d4a77bb19484b37810f325091f040d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:42.873586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:42.874048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a2277d0-8efe-4b5b-b1ca-d579e7862eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:42.876225 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2436/4822] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:42 2022] DELETE /identity/v3/projects/7d4a77bb19484b37810f325091f040d3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:42.879735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac820e-a0a7-4249-a6cc-adf27695410b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:42.895959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac820e-a0a7-4249-a6cc-adf27695410b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:42.994921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:42.995800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:42.996117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:42.996397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] PATH_INFO: `/v3/users/421de670f17e42508264d1524e6bed82` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:43.004241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=421de670f17e42508264d1524e6bed82)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:43.006787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:43.016515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af795-0d66-436a-a740-1c3477fe4e74 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:43.016854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af795-0d66-436a-a740-1c3477fe4e74 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:43.017293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07af795-0d66-436a-a740-1c3477fe4e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:43.053309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f07af795-0d66-436a-a740-1c3477fe4e74 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:43.065042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f07af795-0d66-436a-a740-1c3477fe4e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:43.089388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421de670f17e42508264d1524e6bed82'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:43.114129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421de670f17e42508264d1524e6bed82'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:43.116498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421de670f17e42508264d1524e6bed82'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:43.120335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421de670f17e42508264d1524e6bed82'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:43.149523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421de670f17e42508264d1524e6bed82'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:43.150684 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2437/4823] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:43.167774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07af795-0d66-436a-a740-1c3477fe4e74 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:43.169213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f07af795-0d66-436a-a740-1c3477fe4e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:43.179968 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2387/4824] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:42 2022] DELETE /identity/v3/users/421de670f17e42508264d1524e6bed82 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:43.270297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07af795-0d66-436a-a740-1c3477fe4e74 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:43.425030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3cd82-3b49-4d4a-b275-20a8dc6a0417 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:43.425865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3cd82-3b49-4d4a-b275-20a8dc6a0417 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:43.426061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3cd82-3b49-4d4a-b275-20a8dc6a0417 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:43.427334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3cd82-3b49-4d4a-b275-20a8dc6a0417 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:43.498100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3cd82-3b49-4d4a-b275-20a8dc6a0417 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:43.499450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3cd82-3b49-4d4a-b275-20a8dc6a0417 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:43.508895 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2438/4825] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:05:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 21:05:43.936876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:43.946589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:44.118599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664f756-522a-4c6e-afdb-1a2a929e6246 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:44.134354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:44.135941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:44.136474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:44.136992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] PATH_INFO: `/v3/projects/ecf9e41842234ac0adfb3bf3a94ff568` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:44.140746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf9e41842234ac0adfb3bf3a94ff568)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:44.143771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:44.255011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf9e41842234ac0adfb3bf3a94ff568', 'request_id': 'req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:44.273605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf9e41842234ac0adfb3bf3a94ff568', 'request_id': 'req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:44.281932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf9e41842234ac0adfb3bf3a94ff568', 'request_id': 'req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:44.303420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] The token cache is being invalidate because project ecf9e41842234ac0adfb3bf3a94ff568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:44.304014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:44.306170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c09bba80-77c5-458a-8cf8-b7bcadecfb5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:44.311309 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2388/4826] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:43 2022] DELETE /identity/v3/projects/ecf9e41842234ac0adfb3bf3a94ff568 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:44.317653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd946d-6133-42d3-9b4d-163edc4dc0bb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:44.318493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd946d-6133-42d3-9b4d-163edc4dc0bb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:44.318588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd946d-6133-42d3-9b4d-163edc4dc0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:44.352227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b1bd946d-6133-42d3-9b4d-163edc4dc0bb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:44.354143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b1bd946d-6133-42d3-9b4d-163edc4dc0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:44.452397 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2439/4827] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:44.454836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d67d0-1ac4-41f0-9027-916524be4adc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:44.455143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d67d0-1ac4-41f0-9027-916524be4adc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:44.455427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d67d0-1ac4-41f0-9027-916524be4adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:44.487328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-486d67d0-1ac4-41f0-9027-916524be4adc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:44.489423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-486d67d0-1ac4-41f0-9027-916524be4adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:44.500497 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2389/4828] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:44.504504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd946d-6133-42d3-9b4d-163edc4dc0bb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:44.514602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd946d-6133-42d3-9b4d-163edc4dc0bb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:44.534748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5483d-fa6d-41e1-a14d-c4c1a776cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:44.534956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5483d-fa6d-41e1-a14d-c4c1a776cc0d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:44.535361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5483d-fa6d-41e1-a14d-c4c1a776cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:44.535757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5483d-fa6d-41e1-a14d-c4c1a776cc0d admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:44.536632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5483d-fa6d-41e1-a14d-c4c1a776cc0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:05:44.537049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5483d-fa6d-41e1-a14d-c4c1a776cc0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:44.538794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5483d-fa6d-41e1-a14d-c4c1a776cc0d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:44.570695 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2440/4829] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:44.574580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d67d0-1ac4-41f0-9027-916524be4adc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:44.598189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d67d0-1ac4-41f0-9027-916524be4adc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:44.609644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e2227-30e5-479c-a50b-854c310838b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:44.610346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e2227-30e5-479c-a50b-854c310838b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:44.610875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e2227-30e5-479c-a50b-854c310838b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:44.611365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e2227-30e5-479c-a50b-854c310838b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:44.612117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e2227-30e5-479c-a50b-854c310838b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:44.614231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e2227-30e5-479c-a50b-854c310838b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:44.655806 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2390/4830] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:44 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:44.660160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5483d-fa6d-41e1-a14d-c4c1a776cc0d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:44.672833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5483d-fa6d-41e1-a14d-c4c1a776cc0d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:44.777674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbc401-400e-4390-b545-a3134ff862e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:44.777991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbc401-400e-4390-b545-a3134ff862e1 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:44.778358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbc401-400e-4390-b545-a3134ff862e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:44.778708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbc401-400e-4390-b545-a3134ff862e1 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:44.779483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbc401-400e-4390-b545-a3134ff862e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:44.781697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edbc401-400e-4390-b545-a3134ff862e1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:44.811452 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2441/4831] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:44 2022] POST /identity/v3/users => generated 291 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:44.815877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e2227-30e5-479c-a50b-854c310838b0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:44.827106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e2227-30e5-479c-a50b-854c310838b0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:44.832488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b3899-0a5a-46b2-831c-9e99ab260c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:44.834069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b3899-0a5a-46b2-831c-9e99ab260c67 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:44.834773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b3899-0a5a-46b2-831c-9e99ab260c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:44.835282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9b3899-0a5a-46b2-831c-9e99ab260c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:44.837891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b3899-0a5a-46b2-831c-9e99ab260c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:44.840070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9b3899-0a5a-46b2-831c-9e99ab260c67 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:44.857442 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2391/4832] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:44.861695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbc401-400e-4390-b545-a3134ff862e1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:44.878452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbc401-400e-4390-b545-a3134ff862e1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:44.886740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb45d3a-26ba-49d9-aff1-72f34415c6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:44.892651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45d3a-26ba-49d9-aff1-72f34415c6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:44.893296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45d3a-26ba-49d9-aff1-72f34415c6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:44.893648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb45d3a-26ba-49d9-aff1-72f34415c6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:44.894518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45d3a-26ba-49d9-aff1-72f34415c6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:44.899365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb45d3a-26ba-49d9-aff1-72f34415c6b1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:44.916372 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2442/4833] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:44.923791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b3899-0a5a-46b2-831c-9e99ab260c67 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:44.931171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9b3899-0a5a-46b2-831c-9e99ab260c67 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:44.936540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea2472-736e-4bb3-92ca-995df5548956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:44.937580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea2472-736e-4bb3-92ca-995df5548956 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:44.938162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea2472-736e-4bb3-92ca-995df5548956 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:44.938301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea2472-736e-4bb3-92ca-995df5548956 admin admin] PATH_INFO: `/v3/projects/45e617bc4d2e436687e9feae75526124/users/7f8eb8d2047d455da4fb7349802c8b73/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:45.001077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea2472-736e-4bb3-92ca-995df5548956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e617bc4d2e436687e9feae75526124, user_id=7f8eb8d2047d455da4fb7349802c8b73, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:45.014373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea2472-736e-4bb3-92ca-995df5548956 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:45.050397 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2392/4834] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:44 2022] PUT /identity/v3/projects/45e617bc4d2e436687e9feae75526124/users/7f8eb8d2047d455da4fb7349802c8b73/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:45.056456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173af3b-0144-4204-8edc-1ae35004c408 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:45.056760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173af3b-0144-4204-8edc-1ae35004c408 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:45.057392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173af3b-0144-4204-8edc-1ae35004c408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:45.093951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5173af3b-0144-4204-8edc-1ae35004c408 None None] MFA Rules not processed for user `7f8eb8d2047d455da4fb7349802c8b73`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:45.095483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5173af3b-0144-4204-8edc-1ae35004c408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:45.243107 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2443/4835] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:45.248166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea2472-736e-4bb3-92ca-995df5548956 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:45.359209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea2472-736e-4bb3-92ca-995df5548956 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:45.366400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cda795-8353-4e8f-82bb-ab95f22e21b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:45.367836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cda795-8353-4e8f-82bb-ab95f22e21b5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:45.369369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cda795-8353-4e8f-82bb-ab95f22e21b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:45.369820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cda795-8353-4e8f-82bb-ab95f22e21b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:45.370788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cda795-8353-4e8f-82bb-ab95f22e21b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:45.376725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cda795-8353-4e8f-82bb-ab95f22e21b5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:45.410878 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2393/4836] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:45 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:45.415062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173af3b-0144-4204-8edc-1ae35004c408 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:45.429876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173af3b-0144-4204-8edc-1ae35004c408 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:45.491083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade595e1-d2e3-4d9a-bf0b-d4a236d3a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:45.491743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade595e1-d2e3-4d9a-bf0b-d4a236d3a209 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:45.492054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade595e1-d2e3-4d9a-bf0b-d4a236d3a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:45.492331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade595e1-d2e3-4d9a-bf0b-d4a236d3a209 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:45.493013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade595e1-d2e3-4d9a-bf0b-d4a236d3a209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:45.494948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade595e1-d2e3-4d9a-bf0b-d4a236d3a209 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:45.517196 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2444/4837] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:45 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:45.521576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cda795-8353-4e8f-82bb-ab95f22e21b5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:45.533055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cda795-8353-4e8f-82bb-ab95f22e21b5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:45.537929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b9d61-f016-44ff-9f8d-66cc7058e70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:45.538675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b9d61-f016-44ff-9f8d-66cc7058e70b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:45.538964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b9d61-f016-44ff-9f8d-66cc7058e70b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:45.539247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b9d61-f016-44ff-9f8d-66cc7058e70b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:45.540138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b9d61-f016-44ff-9f8d-66cc7058e70b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:45.542766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b9d61-f016-44ff-9f8d-66cc7058e70b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:45.554549 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2394/4838] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:45.558810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade595e1-d2e3-4d9a-bf0b-d4a236d3a209 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:45.569854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade595e1-d2e3-4d9a-bf0b-d4a236d3a209 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:45.574646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ca83-26fe-4f11-bb1b-3b9436fe8fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:45.575535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ca83-26fe-4f11-bb1b-3b9436fe8fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:45.575819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ca83-26fe-4f11-bb1b-3b9436fe8fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:45.576242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ca83-26fe-4f11-bb1b-3b9436fe8fb5 admin admin] PATH_INFO: `/v3/projects/86c9072b8faa4effa5b878506ba3d0ec/users/fb95474b22584b26b2e091e98b577666/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:45.596344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452ca83-26fe-4f11-bb1b-3b9436fe8fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c9072b8faa4effa5b878506ba3d0ec, user_id=fb95474b22584b26b2e091e98b577666, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:45.599144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452ca83-26fe-4f11-bb1b-3b9436fe8fb5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:45.635464 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2445/4839] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:45 2022] PUT /identity/v3/projects/86c9072b8faa4effa5b878506ba3d0ec/users/fb95474b22584b26b2e091e98b577666/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:45.636743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b9d61-f016-44ff-9f8d-66cc7058e70b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:45.649284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b9d61-f016-44ff-9f8d-66cc7058e70b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:45.786143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6193123-636f-4cfc-87fd-1e9b89cee0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:45.786834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6193123-636f-4cfc-87fd-1e9b89cee0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:45.787118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6193123-636f-4cfc-87fd-1e9b89cee0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:45.787394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6193123-636f-4cfc-87fd-1e9b89cee0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:45.788143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6193123-636f-4cfc-87fd-1e9b89cee0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:45.789770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6193123-636f-4cfc-87fd-1e9b89cee0f7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:45.803486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2395/4840] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:05:45.808033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ca83-26fe-4f11-bb1b-3b9436fe8fb5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:45.823540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ca83-26fe-4f11-bb1b-3b9436fe8fb5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:45.834084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d00b5-59c9-41d9-adce-393ee9c17188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:45.834989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d00b5-59c9-41d9-adce-393ee9c17188 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:45.835289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d00b5-59c9-41d9-adce-393ee9c17188 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:45.836013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d00b5-59c9-41d9-adce-393ee9c17188 admin admin] PATH_INFO: `/v3/projects/86c9072b8faa4effa5b878506ba3d0ec/users/fb95474b22584b26b2e091e98b577666/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:45.839436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d00b5-59c9-41d9-adce-393ee9c17188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c9072b8faa4effa5b878506ba3d0ec, user_id=fb95474b22584b26b2e091e98b577666, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:45.842768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d00b5-59c9-41d9-adce-393ee9c17188 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:45.867096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2446/4841] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:45 2022] PUT /identity/v3/projects/86c9072b8faa4effa5b878506ba3d0ec/users/fb95474b22584b26b2e091e98b577666/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:45.871672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52325a-5bb9-4848-9528-5f068f71847c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:45.871995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52325a-5bb9-4848-9528-5f068f71847c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:45.872673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb52325a-5bb9-4848-9528-5f068f71847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:45.919938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bb52325a-5bb9-4848-9528-5f068f71847c None None] MFA Rules not processed for user `fb95474b22584b26b2e091e98b577666`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:45.921204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bb52325a-5bb9-4848-9528-5f068f71847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:46.012555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2396/4842] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:46.017472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d00b5-59c9-41d9-adce-393ee9c17188 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:46.032899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d00b5-59c9-41d9-adce-393ee9c17188 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:46.038649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e2735-1354-49b5-b3f6-a717fc53288c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:46.041085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e2735-1354-49b5-b3f6-a717fc53288c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:46.041275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e2735-1354-49b5-b3f6-a717fc53288c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:46.043689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e2735-1354-49b5-b3f6-a717fc53288c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:46.044649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e2735-1354-49b5-b3f6-a717fc53288c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:46.046468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e2735-1354-49b5-b3f6-a717fc53288c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:46.054045 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-fb2e2735-1354-49b5-b3f6-a717fc53288c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invalid input for field 'name': '' is too short Mar 26 21:05:46.054045 ncdv-master-1 devstack@keystone.service[97202]: Failed validating 'minLength' in schema['properties']['name']: Mar 26 21:05:46.054045 ncdv-master-1 devstack@keystone.service[97202]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Mar 26 21:05:46.054045 ncdv-master-1 devstack@keystone.service[97202]: On instance['name']: Mar 26 21:05:46.054045 ncdv-master-1 devstack@keystone.service[97202]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Mar 26 21:05:46.055819 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2447/4843] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:05:46 2022] POST /identity/v3/domains => generated 283 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Mar 26 21:05:46.060981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52325a-5bb9-4848-9528-5f068f71847c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:46.072680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb52325a-5bb9-4848-9528-5f068f71847c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:46.085751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f1b3e-c257-40fc-af1c-ff4ff0061262 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:46.086592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f1b3e-c257-40fc-af1c-ff4ff0061262 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:46.086947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f1b3e-c257-40fc-af1c-ff4ff0061262 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:46.087855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f1b3e-c257-40fc-af1c-ff4ff0061262 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:46.088697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f1b3e-c257-40fc-af1c-ff4ff0061262 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:46.091090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f1b3e-c257-40fc-af1c-ff4ff0061262 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:46.102180 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-2c7f1b3e-c257-40fc-af1c-ff4ff0061262 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Mar 26 21:05:46.102180 ncdv-master-1 devstack@keystone.service[97203]: Failed validating 'maxLength' in schema['properties']['name']: Mar 26 21:05:46.102180 ncdv-master-1 devstack@keystone.service[97203]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Mar 26 21:05:46.102180 ncdv-master-1 devstack@keystone.service[97203]: On instance['name']: Mar 26 21:05:46.102180 ncdv-master-1 devstack@keystone.service[97203]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Mar 26 21:05:46.103806 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2397/4844] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:05:46 2022] POST /identity/v3/domains => generated 412 bytes in 43 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Mar 26 21:05:46.108395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e2735-1354-49b5-b3f6-a717fc53288c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:46.123758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e2735-1354-49b5-b3f6-a717fc53288c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:46.129916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08e4c7-0628-40cc-a58f-7269c1cf004e tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:46.130994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e4c7-0628-40cc-a58f-7269c1cf004e tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:46.131371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e4c7-0628-40cc-a58f-7269c1cf004e tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:46.132072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e4c7-0628-40cc-a58f-7269c1cf004e tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:46.132919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08e4c7-0628-40cc-a58f-7269c1cf004e tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:46.135652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c08e4c7-0628-40cc-a58f-7269c1cf004e tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:46.177135 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2448/4845] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:05:46 2022] POST /identity/v3/domains => generated 277 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:46.182615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f1b3e-c257-40fc-af1c-ff4ff0061262 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:46.197362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f1b3e-c257-40fc-af1c-ff4ff0061262 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:46.276803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:46.278796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:46.279086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:46.279363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains/d2b131e7482f482f8685ae6643cc209c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:46.293035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d2b131e7482f482f8685ae6643cc209c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:46.294685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:46.316787 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Mar 26 21:05:46.319039 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2398/4846] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:46 2022] DELETE /identity/v3/domains/d2b131e7482f482f8685ae6643cc209c => generated 120 bytes in 137 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:46.323220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08e4c7-0628-40cc-a58f-7269c1cf004e tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:46.334147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08e4c7-0628-40cc-a58f-7269c1cf004e tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:46.339867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:46.340777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:46.341063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:46.341341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains/d2b131e7482f482f8685ae6643cc209c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:46.342666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d2b131e7482f482f8685ae6643cc209c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:46.344464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:46.367054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.368444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.401485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.402403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.408470 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2449/4847] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:05:46 2022] PATCH /identity/v3/domains/d2b131e7482f482f8685ae6643cc209c => generated 278 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:46.411746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:46.413673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:46.456074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e986ec-cce5-4f16-b7f9-a0e70969f5ff tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:46.565532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:46.566550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:46.566840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:46.567120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains/d2b131e7482f482f8685ae6643cc209c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:46.581823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d2b131e7482f482f8685ae6643cc209c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:46.583481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:46.613818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.617806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.676657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c', 'request_id': 'req-588a24d3-647e-450e-8e17-b2e852cdbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.684875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c', 'request_id': 'req-588a24d3-647e-450e-8e17-b2e852cdbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.701921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c', 'request_id': 'req-588a24d3-647e-450e-8e17-b2e852cdbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.720826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] The token cache is being invalidate because project d2b131e7482f482f8685ae6643cc209c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:46.721012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.722308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.730649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c', 'request_id': 'req-588a24d3-647e-450e-8e17-b2e852cdbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.731511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c', 'request_id': 'req-588a24d3-647e-450e-8e17-b2e852cdbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.732241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd2b131e7482f482f8685ae6643cc209c', 'request_id': 'req-588a24d3-647e-450e-8e17-b2e852cdbe69'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:46.745197 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2399/4848] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:46 2022] DELETE /identity/v3/domains/d2b131e7482f482f8685ae6643cc209c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:46.749935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:46.761535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0be98-3149-45b7-a25b-2dadfd3bb4cd tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:46.843199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8060a6-a270-4780-9850-4c4f265843f6 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:46.844226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8060a6-a270-4780-9850-4c4f265843f6 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:46.844497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8060a6-a270-4780-9850-4c4f265843f6 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:46.844780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8060a6-a270-4780-9850-4c4f265843f6 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains/0fe443e70f7b417bb560d1dfbfebe899` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:46.854696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8060a6-a270-4780-9850-4c4f265843f6 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:05:46.865500 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-8f8060a6-a270-4780-9850-4c4f265843f6 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Could not find domain: 0fe443e70f7b417bb560d1dfbfebe899.: keystone.exception.DomainNotFound: Could not find domain: 0fe443e70f7b417bb560d1dfbfebe899. Mar 26 21:05:46.867237 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2450/4849] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:46 2022] DELETE /identity/v3/domains/0fe443e70f7b417bb560d1dfbfebe899 => generated 112 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:46.872200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:46.880794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:46.918426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a24d3-647e-450e-8e17-b2e852cdbe69 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:46.933879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d133007-e5c1-418a-bf14-154f42204284 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:46.934817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d133007-e5c1-418a-bf14-154f42204284 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:46.935108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d133007-e5c1-418a-bf14-154f42204284 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:46.935403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d133007-e5c1-418a-bf14-154f42204284 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:46.936194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d133007-e5c1-418a-bf14-154f42204284 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:46.937846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d133007-e5c1-418a-bf14-154f42204284 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:46.972181 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2400/4850] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:05:46 2022] POST /identity/v3/domains => generated 253 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:46.972993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8060a6-a270-4780-9850-4c4f265843f6 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:46.985973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8060a6-a270-4780-9850-4c4f265843f6 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:47.056732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:47.058092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:47.058513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:47.058884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:47.060013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:47.061844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:47.073677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.sql.core [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1037892013' for key 'project.ixu_project_name_domain_id'") Mar 26 21:05:47.073677 ncdv-master-1 devstack@keystone.service[97202]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 26 21:05:47.073677 ncdv-master-1 devstack@keystone.service[97202]: [parameters: {'id': 'e01d4581572448b8946c35cf8e2c5637', 'name': 'tempest-domain-dup-1037892013', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Mar 26 21:05:47.073677 ncdv-master-1 devstack@keystone.service[97202]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97202) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 26 21:05:47.197378 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1037892013.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1037892013. Mar 26 21:05:47.205078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d133007-e5c1-418a-bf14-154f42204284 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:47.218237 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2451/4851] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:05:46 2022] POST /identity/v3/domains => generated 212 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 26 21:05:47.219301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d133007-e5c1-418a-bf14-154f42204284 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:47.224288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:47.225908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:47.226256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:47.226532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains/b33e00d05ef14b99af23016c745ae598` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:47.242086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b33e00d05ef14b99af23016c745ae598)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:47.245787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:47.278328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b33e00d05ef14b99af23016c745ae598'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.279160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b33e00d05ef14b99af23016c745ae598'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.335374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b33e00d05ef14b99af23016c745ae598'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.336106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b33e00d05ef14b99af23016c745ae598'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.338896 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2401/4852] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:05:47 2022] PATCH /identity/v3/domains/b33e00d05ef14b99af23016c745ae598 => generated 254 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:47.342955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:47.344820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:47.360521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ba552-fdb8-4049-a0f3-5bd026102325 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:47.446318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:47.447637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:47.447780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:47.448336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains/b33e00d05ef14b99af23016c745ae598` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:47.482147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b33e00d05ef14b99af23016c745ae598)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:47.483869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:47.542668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b33e00d05ef14b99af23016c745ae598'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.551795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b33e00d05ef14b99af23016c745ae598'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.632232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33e00d05ef14b99af23016c745ae598', 'request_id': 'req-44bded92-18c6-43dc-bea9-115c09ed8a54'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.643865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33e00d05ef14b99af23016c745ae598', 'request_id': 'req-44bded92-18c6-43dc-bea9-115c09ed8a54'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.651239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33e00d05ef14b99af23016c745ae598', 'request_id': 'req-44bded92-18c6-43dc-bea9-115c09ed8a54'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.663885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] The token cache is being invalidate because project b33e00d05ef14b99af23016c745ae598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:47.664272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.664905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.682112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b33e00d05ef14b99af23016c745ae598', 'request_id': 'req-44bded92-18c6-43dc-bea9-115c09ed8a54'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.683173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b33e00d05ef14b99af23016c745ae598', 'request_id': 'req-44bded92-18c6-43dc-bea9-115c09ed8a54'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.685071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b33e00d05ef14b99af23016c745ae598', 'request_id': 'req-44bded92-18c6-43dc-bea9-115c09ed8a54'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:47.714930 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2452/4853] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:47 2022] DELETE /identity/v3/domains/b33e00d05ef14b99af23016c745ae598 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:47.720191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:47.732822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696932e-d11c-48b7-a968-56d62d2eebfe tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:47.841745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fbe45-cb9e-41bd-9aea-80eb83ac697c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb95474b22584b26b2e091e98b577666', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86c9072b8faa4effa5b878506ba3d0ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:47.843102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fbe45-cb9e-41bd-9aea-80eb83ac697c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:47.843395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fbe45-cb9e-41bd-9aea-80eb83ac697c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:47.843836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fbe45-cb9e-41bd-9aea-80eb83ac697c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] PATH_INFO: `/v3/domains/d2b131e7482f482f8685ae6643cc209c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:47.854318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fbe45-cb9e-41bd-9aea-80eb83ac697c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:05:47.866853 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-f81fbe45-cb9e-41bd-9aea-80eb83ac697c tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Could not find domain: d2b131e7482f482f8685ae6643cc209c.: keystone.exception.DomainNotFound: Could not find domain: d2b131e7482f482f8685ae6643cc209c. Mar 26 21:05:47.868693 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2402/4854] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:05:47 2022] PATCH /identity/v3/domains/d2b131e7482f482f8685ae6643cc209c => generated 112 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:47.873220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:47.874782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:47.966426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bded92-18c6-43dc-bea9-115c09ed8a54 tempest-DomainsNegativeTestJSON-837943443 tempest-DomainsNegativeTestJSON-837943443-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:47.972078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:47.972960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:47.973244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:47.973521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] PATH_INFO: `/v3/users/7f8eb8d2047d455da4fb7349802c8b73` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:47.974719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8eb8d2047d455da4fb7349802c8b73)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:47.976939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:48.072951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8eb8d2047d455da4fb7349802c8b73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:48.117805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8eb8d2047d455da4fb7349802c8b73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:48.120712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8eb8d2047d455da4fb7349802c8b73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:48.121816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8eb8d2047d455da4fb7349802c8b73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:48.133041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8eb8d2047d455da4fb7349802c8b73'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:48.175958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2453/4855] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:47 2022] DELETE /identity/v3/users/7f8eb8d2047d455da4fb7349802c8b73 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:48.179626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13a873-e583-480c-8d56-c990e74879cf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:48.180024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13a873-e583-480c-8d56-c990e74879cf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:48.180380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13a873-e583-480c-8d56-c990e74879cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:48.219526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2c13a873-e583-480c-8d56-c990e74879cf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:48.223783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2c13a873-e583-480c-8d56-c990e74879cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:48.327179 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2403/4856] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:48.336810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:48.340007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:48.450261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769902cf-3ef5-4a04-a780-1e1caa631a7a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:48.457790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35d329-963b-4df6-b20b-4e7f9088b053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:48.458694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35d329-963b-4df6-b20b-4e7f9088b053 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:48.459141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35d329-963b-4df6-b20b-4e7f9088b053 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:48.459637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35d329-963b-4df6-b20b-4e7f9088b053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:48.471386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35d329-963b-4df6-b20b-4e7f9088b053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:48.473356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35d329-963b-4df6-b20b-4e7f9088b053 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:48.489530 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2454/4857] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:49.046139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13a873-e583-480c-8d56-c990e74879cf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:49.047772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2c13a873-e583-480c-8d56-c990e74879cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:49.061901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13a873-e583-480c-8d56-c990e74879cf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:49.069093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:49.070801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:49.071533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:49.071869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] PATH_INFO: `/v3/projects/45e617bc4d2e436687e9feae75526124` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:49.073524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e617bc4d2e436687e9feae75526124)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:49.075727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:49.150084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e617bc4d2e436687e9feae75526124', 'request_id': 'req-124a3186-b027-4cd1-b319-a1864757d030'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.159167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e617bc4d2e436687e9feae75526124', 'request_id': 'req-124a3186-b027-4cd1-b319-a1864757d030'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.166653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e617bc4d2e436687e9feae75526124', 'request_id': 'req-124a3186-b027-4cd1-b319-a1864757d030'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.178586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] The token cache is being invalidate because project 45e617bc4d2e436687e9feae75526124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:49.179002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.179767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.181470 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2404/4858] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:49 2022] DELETE /identity/v3/projects/45e617bc4d2e436687e9feae75526124 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:49.185637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35d329-963b-4df6-b20b-4e7f9088b053 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:49.195410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35d329-963b-4df6-b20b-4e7f9088b053 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:49.259357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:49.260323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:49.260760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:49.261038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] PATH_INFO: `/v3/users/fb95474b22584b26b2e091e98b577666` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:49.262431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb95474b22584b26b2e091e98b577666)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:49.264794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:49.322606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb95474b22584b26b2e091e98b577666'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.329988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb95474b22584b26b2e091e98b577666'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.330702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb95474b22584b26b2e091e98b577666'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.331311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb95474b22584b26b2e091e98b577666'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.339187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ac11c7e4-e632-407c-9eed-35995b0c4059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb95474b22584b26b2e091e98b577666'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:49.358943 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2455/4859] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:49 2022] DELETE /identity/v3/users/fb95474b22584b26b2e091e98b577666 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:49.898342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:49.900470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:49.924175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a3186-b027-4cd1-b319-a1864757d030 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:50.002861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:50.003774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.004340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.004743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] PATH_INFO: `/v3/projects/86c9072b8faa4effa5b878506ba3d0ec` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.006190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c9072b8faa4effa5b878506ba3d0ec)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:50.008114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:50.070113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c9072b8faa4effa5b878506ba3d0ec', 'request_id': 'req-3486670d-cf04-4d7c-937a-ac80146981dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:50.082708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c9072b8faa4effa5b878506ba3d0ec', 'request_id': 'req-3486670d-cf04-4d7c-937a-ac80146981dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:50.090588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c9072b8faa4effa5b878506ba3d0ec', 'request_id': 'req-3486670d-cf04-4d7c-937a-ac80146981dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:50.125372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] The token cache is being invalidate because project 86c9072b8faa4effa5b878506ba3d0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:50.125993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:50.128735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3486670d-cf04-4d7c-937a-ac80146981dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:50.130735 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2405/4860] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:49 2022] DELETE /identity/v3/projects/86c9072b8faa4effa5b878506ba3d0ec => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:50.137817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdb30-d5c8-45b4-84f0-4a2c6df44fbf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.138207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdb30-d5c8-45b4-84f0-4a2c6df44fbf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.138494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdb30-d5c8-45b4-84f0-4a2c6df44fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.175085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-479fdb30-d5c8-45b4-84f0-4a2c6df44fbf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:50.176354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-479fdb30-d5c8-45b4-84f0-4a2c6df44fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:50.260561 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2456/4861] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:50.264039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d58d0-2df1-468c-bd9c-4f36d9908a5f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.264529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d58d0-2df1-468c-bd9c-4f36d9908a5f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.265002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d58d0-2df1-468c-bd9c-4f36d9908a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.275263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa0daf-d05d-4b45-b28f-4f810388d18d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.275605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa0daf-d05d-4b45-b28f-4f810388d18d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.275884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa0daf-d05d-4b45-b28f-4f810388d18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.289166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fb6d58d0-2df1-468c-bd9c-4f36d9908a5f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:50.291761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fb6d58d0-2df1-468c-bd9c-4f36d9908a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:50.294424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-eefa0daf-d05d-4b45-b28f-4f810388d18d None None] MFA Rules not processed for user `f265820a8b974837949e9e3f36b58858`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:50.295627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-eefa0daf-d05d-4b45-b28f-4f810388d18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:50.306350 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2406/4862] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:50.307263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d58d0-2df1-468c-bd9c-4f36d9908a5f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:50.317102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d58d0-2df1-468c-bd9c-4f36d9908a5f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:50.329497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deff10-7fb5-46b1-b215-65820e780c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:50.330147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deff10-7fb5-46b1-b215-65820e780c52 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.330439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deff10-7fb5-46b1-b215-65820e780c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.331029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80deff10-7fb5-46b1-b215-65820e780c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.331434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80deff10-7fb5-46b1-b215-65820e780c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:05:50.331749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80deff10-7fb5-46b1-b215-65820e780c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:50.333423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80deff10-7fb5-46b1-b215-65820e780c52 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:50.349017 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2407/4863] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:50.353866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deff10-7fb5-46b1-b215-65820e780c52 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:50.364962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80deff10-7fb5-46b1-b215-65820e780c52 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:50.371093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d10d7-a3d6-449b-b041-10862b44b449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:50.372284 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2457/4864] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:50.373088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d10d7-a3d6-449b-b041-10862b44b449 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.373538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d10d7-a3d6-449b-b041-10862b44b449 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.373969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d10d7-a3d6-449b-b041-10862b44b449 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.375642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d10d7-a3d6-449b-b041-10862b44b449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:50.378893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74d10d7-a3d6-449b-b041-10862b44b449 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:50.423275 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2408/4865] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:50 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:50.427391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa0daf-d05d-4b45-b28f-4f810388d18d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:50.441255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa0daf-d05d-4b45-b28f-4f810388d18d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:50.512433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c306565-e838-494f-a097-08fa94980543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:50.515496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c306565-e838-494f-a097-08fa94980543 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.515850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c306565-e838-494f-a097-08fa94980543 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.516278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c306565-e838-494f-a097-08fa94980543 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.517039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c306565-e838-494f-a097-08fa94980543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:50.519037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c306565-e838-494f-a097-08fa94980543 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:50.540956 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2458/4866] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:50 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:50.544962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d10d7-a3d6-449b-b041-10862b44b449 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:50.557529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d10d7-a3d6-449b-b041-10862b44b449 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:50.563432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256df58-a106-44bf-bff3-ceacbbb01c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:50.564205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256df58-a106-44bf-bff3-ceacbbb01c86 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.564705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256df58-a106-44bf-bff3-ceacbbb01c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.565105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256df58-a106-44bf-bff3-ceacbbb01c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.566038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256df58-a106-44bf-bff3-ceacbbb01c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:50.568018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256df58-a106-44bf-bff3-ceacbbb01c86 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:50.581149 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2409/4867] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:50.669259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c306565-e838-494f-a097-08fa94980543 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:50.695392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c306565-e838-494f-a097-08fa94980543 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:50.703195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e06db47-c610-47cd-b65d-6dac7d23b68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:50.705361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06db47-c610-47cd-b65d-6dac7d23b68f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.705361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06db47-c610-47cd-b65d-6dac7d23b68f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.705361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e06db47-c610-47cd-b65d-6dac7d23b68f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.705791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06db47-c610-47cd-b65d-6dac7d23b68f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:50.707462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e06db47-c610-47cd-b65d-6dac7d23b68f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:50.720633 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2459/4868] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:50.724865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256df58-a106-44bf-bff3-ceacbbb01c86 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:50.737286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256df58-a106-44bf-bff3-ceacbbb01c86 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:50.744302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20190-ba72-48f5-81e6-9721a53aa932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:50.745497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20190-ba72-48f5-81e6-9721a53aa932 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.746029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20190-ba72-48f5-81e6-9721a53aa932 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.746489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20190-ba72-48f5-81e6-9721a53aa932 admin admin] PATH_INFO: `/v3/projects/51b4094526dc41b88110dd10446a0925/users/8c17a0ab0c0f45de8b300c214ae3b4d0/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.768600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20190-ba72-48f5-81e6-9721a53aa932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b4094526dc41b88110dd10446a0925, user_id=8c17a0ab0c0f45de8b300c214ae3b4d0, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:50.771555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20190-ba72-48f5-81e6-9721a53aa932 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:50.797938 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2410/4869] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:50 2022] PUT /identity/v3/projects/51b4094526dc41b88110dd10446a0925/users/8c17a0ab0c0f45de8b300c214ae3b4d0/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:50.808475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3625-01ca-45aa-be91-01180af8c05c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:50.808849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3625-01ca-45aa-be91-01180af8c05c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:50.809198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace3625-01ca-45aa-be91-01180af8c05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:50.840046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4ace3625-01ca-45aa-be91-01180af8c05c None None] MFA Rules not processed for user `8c17a0ab0c0f45de8b300c214ae3b4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:50.841771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4ace3625-01ca-45aa-be91-01180af8c05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:50.934975 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2460/4870] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:50.939304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20190-ba72-48f5-81e6-9721a53aa932 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:51.020745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20190-ba72-48f5-81e6-9721a53aa932 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:51.027446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceec5c-756b-4f05-a4e8-510bf80e0ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:51.031436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceec5c-756b-4f05-a4e8-510bf80e0ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:51.032107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceec5c-756b-4f05-a4e8-510bf80e0ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:51.032768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acceec5c-756b-4f05-a4e8-510bf80e0ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:51.033686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceec5c-756b-4f05-a4e8-510bf80e0ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:51.035963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acceec5c-756b-4f05-a4e8-510bf80e0ce1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:51.078932 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2411/4871] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:50 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:51.082847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3625-01ca-45aa-be91-01180af8c05c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:51.097172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace3625-01ca-45aa-be91-01180af8c05c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:51.163041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a164a-e819-4421-88e5-2d28cc4d2187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:51.164355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a164a-e819-4421-88e5-2d28cc4d2187 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:51.164644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a164a-e819-4421-88e5-2d28cc4d2187 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:51.165693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a164a-e819-4421-88e5-2d28cc4d2187 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:51.166411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a164a-e819-4421-88e5-2d28cc4d2187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:51.168597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a164a-e819-4421-88e5-2d28cc4d2187 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:51.199566 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2461/4872] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:51 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:51.202998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceec5c-756b-4f05-a4e8-510bf80e0ce1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:51.214303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acceec5c-756b-4f05-a4e8-510bf80e0ce1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:51.220835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcf95f-d78c-44ec-937a-1434bfca48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:51.221504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcf95f-d78c-44ec-937a-1434bfca48e5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:51.221786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcf95f-d78c-44ec-937a-1434bfca48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:51.222338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcf95f-d78c-44ec-937a-1434bfca48e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:51.223105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcf95f-d78c-44ec-937a-1434bfca48e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:51.224689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcf95f-d78c-44ec-937a-1434bfca48e5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:51.264589 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2412/4873] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:05:51.268822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a164a-e819-4421-88e5-2d28cc4d2187 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:51.279236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a164a-e819-4421-88e5-2d28cc4d2187 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:51.292301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a973cbe-c468-42c0-9ed8-a0771997e857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:51.293197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a973cbe-c468-42c0-9ed8-a0771997e857 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:51.293475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a973cbe-c468-42c0-9ed8-a0771997e857 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:51.295909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a973cbe-c468-42c0-9ed8-a0771997e857 admin admin] PATH_INFO: `/v3/projects/ba1d65d939d641918789ede2dc53f7b3/users/e419aac1178f4585b11b7d559d85ab01/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:51.334254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a973cbe-c468-42c0-9ed8-a0771997e857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1d65d939d641918789ede2dc53f7b3, user_id=e419aac1178f4585b11b7d559d85ab01, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:51.337906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a973cbe-c468-42c0-9ed8-a0771997e857 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:51.377727 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2462/4874] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:51 2022] PUT /identity/v3/projects/ba1d65d939d641918789ede2dc53f7b3/users/e419aac1178f4585b11b7d559d85ab01/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:51.382466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcf95f-d78c-44ec-937a-1434bfca48e5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:51.401635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcf95f-d78c-44ec-937a-1434bfca48e5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:51.521132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02582a1c-9bd7-4923-800a-1229dcfed0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:51.524581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02582a1c-9bd7-4923-800a-1229dcfed0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:51.525077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02582a1c-9bd7-4923-800a-1229dcfed0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:51.525547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02582a1c-9bd7-4923-800a-1229dcfed0a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:51.526631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02582a1c-9bd7-4923-800a-1229dcfed0a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:51.529366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02582a1c-9bd7-4923-800a-1229dcfed0a7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:51.549198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a973cbe-c468-42c0-9ed8-a0771997e857 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:51.551540 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2413/4875] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:51.577782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a973cbe-c468-42c0-9ed8-a0771997e857 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:51.597523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f610e-520d-4515-a678-b3290d743afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:51.599289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f610e-520d-4515-a678-b3290d743afa admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:51.599797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f610e-520d-4515-a678-b3290d743afa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:51.600901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f610e-520d-4515-a678-b3290d743afa admin admin] PATH_INFO: `/v3/projects/ba1d65d939d641918789ede2dc53f7b3/users/e419aac1178f4585b11b7d559d85ab01/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:51.605180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f610e-520d-4515-a678-b3290d743afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba1d65d939d641918789ede2dc53f7b3, user_id=e419aac1178f4585b11b7d559d85ab01, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:51.614325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25f610e-520d-4515-a678-b3290d743afa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:51.645927 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2463/4876] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:51 2022] PUT /identity/v3/projects/ba1d65d939d641918789ede2dc53f7b3/users/e419aac1178f4585b11b7d559d85ab01/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:51.658723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714502c7-db73-4831-8724-2175a14d0c97 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:51.659185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714502c7-db73-4831-8724-2175a14d0c97 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:51.659640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714502c7-db73-4831-8724-2175a14d0c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:51.710852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-714502c7-db73-4831-8724-2175a14d0c97 None None] MFA Rules not processed for user `e419aac1178f4585b11b7d559d85ab01`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:51.712850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-714502c7-db73-4831-8724-2175a14d0c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:51.908516 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2414/4877] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:51.913094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f610e-520d-4515-a678-b3290d743afa admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:51.934265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f610e-520d-4515-a678-b3290d743afa admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:51.946388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:51.947894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:51.949928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:51.950681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:51.953301 ncdv-master-1 devstack@keystone.service[97202]: WARNING oslo_log.versionutils [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Mar 26 21:05:51.958410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:51.960080 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:51.960080 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:51.960080 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:51.962069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.009548 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2464/4878] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:05:51 2022] POST /identity/v3/policies => generated 229 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:52.011165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714502c7-db73-4831-8724-2175a14d0c97 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.021294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714502c7-db73-4831-8724-2175a14d0c97 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.051710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.054662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.054958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.057347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies/38c6115ff54c40a79e4d4bbaa57e71e3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.058408 ncdv-master-1 devstack@keystone.service[97203]: WARNING oslo_log.versionutils [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Mar 26 21:05:52.058962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=38c6115ff54c40a79e4d4bbaa57e71e3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.064505 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:52.064505 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:52.064505 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:52.065484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.108869 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2415/4879] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Mar 26 21:05:52 2022] PATCH /identity/v3/policies/38c6115ff54c40a79e4d4bbaa57e71e3 => generated 236 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:52.110536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.133514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a6a4b-a18c-4988-a501-c08b37af4ae5 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.147219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.148465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.151000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.151480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies/38c6115ff54c40a79e4d4bbaa57e71e3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.154139 ncdv-master-1 devstack@keystone.service[97202]: WARNING oslo_log.versionutils [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Mar 26 21:05:52.154963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=38c6115ff54c40a79e4d4bbaa57e71e3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.164514 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:52.164514 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:52.164514 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:52.165885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.189771 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2465/4880] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:05:52 2022] GET /identity/v3/policies/38c6115ff54c40a79e4d4bbaa57e71e3 => generated 236 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:52.190976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.205713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db6335-15e9-4e8e-be89-51dc91438922 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.228312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.229128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.229428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.229711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies/38c6115ff54c40a79e4d4bbaa57e71e3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.230514 ncdv-master-1 devstack@keystone.service[97203]: WARNING oslo_log.versionutils [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Mar 26 21:05:52.231143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=38c6115ff54c40a79e4d4bbaa57e71e3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.232497 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:52.232497 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:52.232497 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:52.233402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.262366 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2416/4881] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:52 2022] DELETE /identity/v3/policies/38c6115ff54c40a79e4d4bbaa57e71e3 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:52.272129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.303159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefe5d9-ba7f-413a-82d9-4ce1edf81753 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.308969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0835d3-5788-435d-9cab-e2b17db1a259 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.310525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0835d3-5788-435d-9cab-e2b17db1a259 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.311044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0835d3-5788-435d-9cab-e2b17db1a259 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.311531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0835d3-5788-435d-9cab-e2b17db1a259 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.313194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0835d3-5788-435d-9cab-e2b17db1a259 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.315661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0835d3-5788-435d-9cab-e2b17db1a259 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.338785 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2466/4882] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:05:52 2022] POST /identity/v3/policies => generated 230 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:52.343689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.361327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9421c62-c831-4bbc-96ad-7b449795dc8c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.376760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.377111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.377409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.377696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.378858 ncdv-master-1 devstack@keystone.service[97203]: WARNING oslo_log.versionutils [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Mar 26 21:05:52.380067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.383883 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:52.383883 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:52.383883 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:52.387727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.440757 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2417/4883] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:05:52 2022] POST /identity/v3/policies => generated 229 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:52.445196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0835d3-5788-435d-9cab-e2b17db1a259 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.458868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0835d3-5788-435d-9cab-e2b17db1a259 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.464666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e76ff-1e84-4d70-bc2f-df574d35878f tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.465645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e76ff-1e84-4d70-bc2f-df574d35878f tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.465996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e76ff-1e84-4d70-bc2f-df574d35878f tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.466355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e76ff-1e84-4d70-bc2f-df574d35878f tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.467682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e76ff-1e84-4d70-bc2f-df574d35878f tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.469754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e76ff-1e84-4d70-bc2f-df574d35878f tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.501036 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2467/4884] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:05:52 2022] POST /identity/v3/policies => generated 229 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:52.510959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.526398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c8d91e-c753-4d17-a689-bb6864739715 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.539770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.540991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.541532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.541840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.542828 ncdv-master-1 devstack@keystone.service[97203]: WARNING oslo_log.versionutils [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Mar 26 21:05:52.543530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.544828 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:52.544828 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:05:52.544828 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:05:52.545749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.560419 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2418/4885] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Mar 26 21:05:52 2022] GET /identity/v3/policies => generated 764 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:05:52.565075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e76ff-1e84-4d70-bc2f-df574d35878f tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.576574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e76ff-1e84-4d70-bc2f-df574d35878f tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.582182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.583331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.583795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.584288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies/c87d20be0c084aaabef0df4cc72911ea` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.585237 ncdv-master-1 devstack@keystone.service[97202]: WARNING oslo_log.versionutils [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Mar 26 21:05:52.586045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c87d20be0c084aaabef0df4cc72911ea)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.587726 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:52.587726 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:52.587726 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:52.588986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.613851 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2468/4886] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:52 2022] DELETE /identity/v3/policies/c87d20be0c084aaabef0df4cc72911ea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:52.618888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.632112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d8f04-0cef-40ad-acc5-ad142bc0b566 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.639150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633207fc-4cc9-4704-94ff-df8cc7377e7c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.640313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633207fc-4cc9-4704-94ff-df8cc7377e7c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.641107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633207fc-4cc9-4704-94ff-df8cc7377e7c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.641107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633207fc-4cc9-4704-94ff-df8cc7377e7c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies/9b8c6a2115e84004a12255388f5e1b15` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.643978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633207fc-4cc9-4704-94ff-df8cc7377e7c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=9b8c6a2115e84004a12255388f5e1b15)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.647033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633207fc-4cc9-4704-94ff-df8cc7377e7c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.673923 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2419/4887] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:52 2022] DELETE /identity/v3/policies/9b8c6a2115e84004a12255388f5e1b15 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:52.674674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.691716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63792f7d-5f70-4354-86b4-8f027fe90244 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.698149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4ad39-6ce1-4c3d-8d64-f15f561a66c7 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e419aac1178f4585b11b7d559d85ab01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba1d65d939d641918789ede2dc53f7b3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.699431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4ad39-6ce1-4c3d-8d64-f15f561a66c7 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.699884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4ad39-6ce1-4c3d-8d64-f15f561a66c7 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.700354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4ad39-6ce1-4c3d-8d64-f15f561a66c7 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] PATH_INFO: `/v3/policies/b7f115d6c9e34485a13c78375df761e5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.702050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4ad39-6ce1-4c3d-8d64-f15f561a66c7 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=b7f115d6c9e34485a13c78375df761e5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.704239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4ad39-6ce1-4c3d-8d64-f15f561a66c7 tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:52.732890 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2469/4888] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:52 2022] DELETE /identity/v3/policies/b7f115d6c9e34485a13c78375df761e5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:52.734139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633207fc-4cc9-4704-94ff-df8cc7377e7c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:52.870636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633207fc-4cc9-4704-94ff-df8cc7377e7c tempest-PoliciesTestJSON-61623889 tempest-PoliciesTestJSON-61623889-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:52.881216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:52.882104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:52.882388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:52.882661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] PATH_INFO: `/v3/users/8c17a0ab0c0f45de8b300c214ae3b4d0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:52.886219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c17a0ab0c0f45de8b300c214ae3b4d0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:52.891483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:53.018979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c17a0ab0c0f45de8b300c214ae3b4d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:53.033894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c17a0ab0c0f45de8b300c214ae3b4d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:53.034721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c17a0ab0c0f45de8b300c214ae3b4d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:53.035403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c17a0ab0c0f45de8b300c214ae3b4d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:53.060811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a109ae1a-89fb-43c7-a3e4-1cb374cc0e5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c17a0ab0c0f45de8b300c214ae3b4d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:53.083196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2432-c434-4bd3-9530-5b08c51953cc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:53.083748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2432-c434-4bd3-9530-5b08c51953cc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:53.084280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace2432-c434-4bd3-9530-5b08c51953cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:53.092775 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2420/4889] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:52 2022] DELETE /identity/v3/users/8c17a0ab0c0f45de8b300c214ae3b4d0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:53.097331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b468-3827-49cb-a581-e6118763c582 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:53.097710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b468-3827-49cb-a581-e6118763c582 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:53.098000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b468-3827-49cb-a581-e6118763c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:53.106875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6ace2432-c434-4bd3-9530-5b08c51953cc None None] MFA Rules not processed for user `f265820a8b974837949e9e3f36b58858`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:53.108808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6ace2432-c434-4bd3-9530-5b08c51953cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:53.128128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8e54b468-3827-49cb-a581-e6118763c582 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:53.130161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e54b468-3827-49cb-a581-e6118763c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:53.209368 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2470/4890] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:53.268959 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2421/4891] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:53.284709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace2432-c434-4bd3-9530-5b08c51953cc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:53.287543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6ace2432-c434-4bd3-9530-5b08c51953cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:53.373084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ace2432-c434-4bd3-9530-5b08c51953cc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:53.377282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fbe2c-0241-4bcd-b905-9450f815eb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:53.379381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fbe2c-0241-4bcd-b905-9450f815eb55 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:53.382056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fbe2c-0241-4bcd-b905-9450f815eb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:53.382628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fbe2c-0241-4bcd-b905-9450f815eb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:53.400621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fbe2c-0241-4bcd-b905-9450f815eb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:53.403806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43fbe2c-0241-4bcd-b905-9450f815eb55 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:53.418207 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2471/4892] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:54.101849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54b468-3827-49cb-a581-e6118763c582 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:54.104008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e54b468-3827-49cb-a581-e6118763c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:54.122417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54b468-3827-49cb-a581-e6118763c582 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:54.134647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:54.135705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:54.136116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:54.136486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] PATH_INFO: `/v3/projects/51b4094526dc41b88110dd10446a0925` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:54.137767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b4094526dc41b88110dd10446a0925)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:54.140069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:54.213454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b4094526dc41b88110dd10446a0925', 'request_id': 'req-cf74b577-1e51-4c58-b49e-ce239699397d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.227282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b4094526dc41b88110dd10446a0925', 'request_id': 'req-cf74b577-1e51-4c58-b49e-ce239699397d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.237168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b4094526dc41b88110dd10446a0925', 'request_id': 'req-cf74b577-1e51-4c58-b49e-ce239699397d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.277056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] The token cache is being invalidate because project 51b4094526dc41b88110dd10446a0925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:54.277542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.279195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.284834 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2422/4893] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:54 2022] DELETE /identity/v3/projects/51b4094526dc41b88110dd10446a0925 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:54.286357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fbe2c-0241-4bcd-b905-9450f815eb55 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:54.300713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fbe2c-0241-4bcd-b905-9450f815eb55 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:54.411798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:54.412840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:54.413202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:54.413550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] PATH_INFO: `/v3/users/e419aac1178f4585b11b7d559d85ab01` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:54.415812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e419aac1178f4585b11b7d559d85ab01)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:54.419375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:54.529809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e419aac1178f4585b11b7d559d85ab01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.546672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e419aac1178f4585b11b7d559d85ab01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.548655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e419aac1178f4585b11b7d559d85ab01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.549318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e419aac1178f4585b11b7d559d85ab01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.562818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9312411d-3148-4404-8583-881c7dcf8726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e419aac1178f4585b11b7d559d85ab01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:54.615790 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2472/4894] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:54 2022] DELETE /identity/v3/users/e419aac1178f4585b11b7d559d85ab01 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:55.000163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:55.002144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:55.036419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74b577-1e51-4c58-b49e-ce239699397d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:55.128252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:55.129138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.129424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.129705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] PATH_INFO: `/v3/projects/ba1d65d939d641918789ede2dc53f7b3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.131606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba1d65d939d641918789ede2dc53f7b3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:55.134085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:55.231260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba1d65d939d641918789ede2dc53f7b3', 'request_id': 'req-654a5a12-0514-456c-b53a-d929d72c5bbc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:55.245915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba1d65d939d641918789ede2dc53f7b3', 'request_id': 'req-654a5a12-0514-456c-b53a-d929d72c5bbc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:55.255047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba1d65d939d641918789ede2dc53f7b3', 'request_id': 'req-654a5a12-0514-456c-b53a-d929d72c5bbc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:55.269300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] The token cache is being invalidate because project ba1d65d939d641918789ede2dc53f7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:55.269711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:55.270630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-654a5a12-0514-456c-b53a-d929d72c5bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:55.275556 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2423/4895] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:54 2022] DELETE /identity/v3/projects/ba1d65d939d641918789ede2dc53f7b3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:55.279165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef83c-e5b8-4885-afa1-2be8847df946 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.279544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef83c-e5b8-4885-afa1-2be8847df946 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.279983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef83c-e5b8-4885-afa1-2be8847df946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.302626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0dfef83c-e5b8-4885-afa1-2be8847df946 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:55.304085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0dfef83c-e5b8-4885-afa1-2be8847df946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:55.372263 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2473/4896] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:55.383201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8748a01-ee1b-48eb-911e-079b5f43d752 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.384476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8748a01-ee1b-48eb-911e-079b5f43d752 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.384904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8748a01-ee1b-48eb-911e-079b5f43d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.407343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b8748a01-ee1b-48eb-911e-079b5f43d752 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:55.409152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b8748a01-ee1b-48eb-911e-079b5f43d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:55.425351 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2424/4897] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:55.426393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef83c-e5b8-4885-afa1-2be8847df946 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:55.440447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef83c-e5b8-4885-afa1-2be8847df946 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:55.447763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a291bc-71b0-46bf-b18f-b08ba9995dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:55.448541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a291bc-71b0-46bf-b18f-b08ba9995dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.448960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a291bc-71b0-46bf-b18f-b08ba9995dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.449306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a291bc-71b0-46bf-b18f-b08ba9995dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.458499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a291bc-71b0-46bf-b18f-b08ba9995dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:05:55.458499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a291bc-71b0-46bf-b18f-b08ba9995dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:55.458499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a291bc-71b0-46bf-b18f-b08ba9995dd1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:55.474299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8748a01-ee1b-48eb-911e-079b5f43d752 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:55.476077 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2474/4898] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:05:55.486111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8748a01-ee1b-48eb-911e-079b5f43d752 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:55.492497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7f7f-8ebd-43df-97cd-61f87cdde634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:55.493898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7f7f-8ebd-43df-97cd-61f87cdde634 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.494284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7f7f-8ebd-43df-97cd-61f87cdde634 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.494668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7f7f-8ebd-43df-97cd-61f87cdde634 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.495487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb7f7f-8ebd-43df-97cd-61f87cdde634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:55.498667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb7f7f-8ebd-43df-97cd-61f87cdde634 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:55.556931 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2425/4899] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:55 2022] POST /identity/v3/projects => generated 395 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:05:55.558314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a291bc-71b0-46bf-b18f-b08ba9995dd1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:55.570098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a291bc-71b0-46bf-b18f-b08ba9995dd1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:55.642581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018a851-2fee-40a4-adee-c3ab47635f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:55.643411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018a851-2fee-40a4-adee-c3ab47635f6d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.643699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018a851-2fee-40a4-adee-c3ab47635f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.643995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018a851-2fee-40a4-adee-c3ab47635f6d admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.644851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018a851-2fee-40a4-adee-c3ab47635f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:55.646843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018a851-2fee-40a4-adee-c3ab47635f6d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:55.678263 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2475/4900] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:55 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:55.679911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7f7f-8ebd-43df-97cd-61f87cdde634 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:55.693316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7f7f-8ebd-43df-97cd-61f87cdde634 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:55.699552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f5f56-1909-4ca0-96c6-2645838eec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:55.700514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5f56-1909-4ca0-96c6-2645838eec88 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.700910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5f56-1909-4ca0-96c6-2645838eec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.701735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f5f56-1909-4ca0-96c6-2645838eec88 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.702422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f5f56-1909-4ca0-96c6-2645838eec88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:55.704390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f5f56-1909-4ca0-96c6-2645838eec88 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:55.716532 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2426/4901] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:55.721353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018a851-2fee-40a4-adee-c3ab47635f6d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:55.736342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018a851-2fee-40a4-adee-c3ab47635f6d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:55.747297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59a006-387e-428e-9a88-8411fd1529e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:55.748198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59a006-387e-428e-9a88-8411fd1529e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.748594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59a006-387e-428e-9a88-8411fd1529e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.749038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59a006-387e-428e-9a88-8411fd1529e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.749998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59a006-387e-428e-9a88-8411fd1529e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:55.754331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b59a006-387e-428e-9a88-8411fd1529e7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:55.770245 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2476/4902] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:55.774208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f5f56-1909-4ca0-96c6-2645838eec88 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:55.784862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f5f56-1909-4ca0-96c6-2645838eec88 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:55.791174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747a095-a227-42f3-90d4-44c291478549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:55.792270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747a095-a227-42f3-90d4-44c291478549 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.792548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747a095-a227-42f3-90d4-44c291478549 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.792821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747a095-a227-42f3-90d4-44c291478549 admin admin] PATH_INFO: `/v3/projects/76348024566d4cd3a3717a7085c2c914/users/5d1c83e021e2470e80f4c1f08a9abb33/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.812301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747a095-a227-42f3-90d4-44c291478549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76348024566d4cd3a3717a7085c2c914, user_id=5d1c83e021e2470e80f4c1f08a9abb33, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:55.815152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b747a095-a227-42f3-90d4-44c291478549 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:55.841827 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2427/4903] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:55 2022] PUT /identity/v3/projects/76348024566d4cd3a3717a7085c2c914/users/5d1c83e021e2470e80f4c1f08a9abb33/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:55.844108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c70e38-747e-4763-a991-ac675a2de70a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:55.844330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c70e38-747e-4763-a991-ac675a2de70a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:55.844716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c70e38-747e-4763-a991-ac675a2de70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:55.876111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-09c70e38-747e-4763-a991-ac675a2de70a None None] MFA Rules not processed for user `5d1c83e021e2470e80f4c1f08a9abb33`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:55.877453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-09c70e38-747e-4763-a991-ac675a2de70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:55.945713 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2477/4904] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:55.952142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747a095-a227-42f3-90d4-44c291478549 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.046577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747a095-a227-42f3-90d4-44c291478549 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.052459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ce7e3-e518-4c8a-9a60-d47d81ee14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.053180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce7e3-e518-4c8a-9a60-d47d81ee14cd admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.053474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce7e3-e518-4c8a-9a60-d47d81ee14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.053744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ce7e3-e518-4c8a-9a60-d47d81ee14cd admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.054455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ce7e3-e518-4c8a-9a60-d47d81ee14cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.056666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ce7e3-e518-4c8a-9a60-d47d81ee14cd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:56.094962 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2428/4905] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:55 2022] POST /identity/v3/projects => generated 395 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:56.096433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c70e38-747e-4763-a991-ac675a2de70a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.107772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c70e38-747e-4763-a991-ac675a2de70a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.182750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ee63-11ae-4613-b8f4-1955e2389e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.183788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ee63-11ae-4613-b8f4-1955e2389e1f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.184196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ee63-11ae-4613-b8f4-1955e2389e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.184574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6ee63-11ae-4613-b8f4-1955e2389e1f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.185366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6ee63-11ae-4613-b8f4-1955e2389e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.187484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6ee63-11ae-4613-b8f4-1955e2389e1f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:56.248116 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2478/4906] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:05:56 2022] POST /identity/v3/users => generated 304 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:56.249301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ce7e3-e518-4c8a-9a60-d47d81ee14cd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.269739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ce7e3-e518-4c8a-9a60-d47d81ee14cd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.287682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8edf8a-91e4-4cba-8f96-dd76b2d84c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.288629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8edf8a-91e4-4cba-8f96-dd76b2d84c18 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.289082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8edf8a-91e4-4cba-8f96-dd76b2d84c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.289534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8edf8a-91e4-4cba-8f96-dd76b2d84c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.290991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8edf8a-91e4-4cba-8f96-dd76b2d84c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.294150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8edf8a-91e4-4cba-8f96-dd76b2d84c18 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:56.327616 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2429/4907] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:56.328819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ee63-11ae-4613-b8f4-1955e2389e1f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.344487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6ee63-11ae-4613-b8f4-1955e2389e1f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.356084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5ea7a-7562-4863-9412-8fb5f3f0ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.357160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5ea7a-7562-4863-9412-8fb5f3f0ef37 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.363037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5ea7a-7562-4863-9412-8fb5f3f0ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.364728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5ea7a-7562-4863-9412-8fb5f3f0ef37 admin admin] PATH_INFO: `/v3/projects/b417d10219354f0f9c7bd464f2f64006/users/365693dc167249a1812ba774483b0680/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.413202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5ea7a-7562-4863-9412-8fb5f3f0ef37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b417d10219354f0f9c7bd464f2f64006, user_id=365693dc167249a1812ba774483b0680, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.416030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5ea7a-7562-4863-9412-8fb5f3f0ef37 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:56.430561 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2479/4908] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:56 2022] PUT /identity/v3/projects/b417d10219354f0f9c7bd464f2f64006/users/365693dc167249a1812ba774483b0680/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:56.435654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8edf8a-91e4-4cba-8f96-dd76b2d84c18 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.449993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8edf8a-91e4-4cba-8f96-dd76b2d84c18 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.533664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe04d18-8f8f-4fd7-ba18-c0733356fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.534475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04d18-8f8f-4fd7-ba18-c0733356fc82 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.534865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04d18-8f8f-4fd7-ba18-c0733356fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.535248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe04d18-8f8f-4fd7-ba18-c0733356fc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.536109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe04d18-8f8f-4fd7-ba18-c0733356fc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.538172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe04d18-8f8f-4fd7-ba18-c0733356fc82 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:56.555749 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2430/4909] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:05:56.564177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5ea7a-7562-4863-9412-8fb5f3f0ef37 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.582855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5ea7a-7562-4863-9412-8fb5f3f0ef37 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.594145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1874017-1922-453f-b476-b1c96d03fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.595570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1874017-1922-453f-b476-b1c96d03fde1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.596055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1874017-1922-453f-b476-b1c96d03fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.596491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1874017-1922-453f-b476-b1c96d03fde1 admin admin] PATH_INFO: `/v3/projects/b417d10219354f0f9c7bd464f2f64006/users/365693dc167249a1812ba774483b0680/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.600570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1874017-1922-453f-b476-b1c96d03fde1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b417d10219354f0f9c7bd464f2f64006, user_id=365693dc167249a1812ba774483b0680, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.603444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1874017-1922-453f-b476-b1c96d03fde1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:56.628020 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2480/4910] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:05:56 2022] PUT /identity/v3/projects/b417d10219354f0f9c7bd464f2f64006/users/365693dc167249a1812ba774483b0680/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:56.639103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc3cdb-32b7-45ef-bd24-44be48b1aaa0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.639481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc3cdb-32b7-45ef-bd24-44be48b1aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.639841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc3cdb-32b7-45ef-bd24-44be48b1aaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.677238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e0cc3cdb-32b7-45ef-bd24-44be48b1aaa0 None None] MFA Rules not processed for user `365693dc167249a1812ba774483b0680`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:56.678888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e0cc3cdb-32b7-45ef-bd24-44be48b1aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:56.767787 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2431/4911] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:56.773640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1874017-1922-453f-b476-b1c96d03fde1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.854259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1874017-1922-453f-b476-b1c96d03fde1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.860835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f92e57-a02f-4112-8fab-1fceca4e5341 tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1c83e021e2470e80f4c1f08a9abb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76348024566d4cd3a3717a7085c2c914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.861779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f92e57-a02f-4112-8fab-1fceca4e5341 tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.862163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f92e57-a02f-4112-8fab-1fceca4e5341 tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.862637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f92e57-a02f-4112-8fab-1fceca4e5341 tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.863612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f92e57-a02f-4112-8fab-1fceca4e5341 tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.870749 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-45f92e57-a02f-4112-8fab-1fceca4e5341 tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Mar 26 21:05:56.872801 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2481/4912] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:05:56 2022] POST /identity/v3/projects => generated 136 bytes in 100 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:56.877905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc3cdb-32b7-45ef-bd24-44be48b1aaa0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.888999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc3cdb-32b7-45ef-bd24-44be48b1aaa0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.893975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8568d8d-83e1-423c-8968-992bb9861a6a tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '365693dc167249a1812ba774483b0680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b417d10219354f0f9c7bd464f2f64006', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.894641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568d8d-83e1-423c-8968-992bb9861a6a tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.894933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568d8d-83e1-423c-8968-992bb9861a6a tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.895213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8568d8d-83e1-423c-8968-992bb9861a6a tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.895902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8568d8d-83e1-423c-8968-992bb9861a6a tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.897937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8568d8d-83e1-423c-8968-992bb9861a6a tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:56.903437 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-e8568d8d-83e1-423c-8968-992bb9861a6a tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Invalid input for field 'name': '' is too short Mar 26 21:05:56.903437 ncdv-master-1 devstack@keystone.service[97203]: Failed validating 'minLength' in schema['properties']['name']: Mar 26 21:05:56.903437 ncdv-master-1 devstack@keystone.service[97203]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Mar 26 21:05:56.903437 ncdv-master-1 devstack@keystone.service[97203]: On instance['name']: Mar 26 21:05:56.903437 ncdv-master-1 devstack@keystone.service[97203]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Mar 26 21:05:56.904702 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2432/4913] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:05:56 2022] POST /identity/v3/projects => generated 283 bytes in 27 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Mar 26 21:05:56.910330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f92e57-a02f-4112-8fab-1fceca4e5341 tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.921326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f92e57-a02f-4112-8fab-1fceca4e5341 tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.926642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7dd3d-4405-4262-bd69-7adcd05be481 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '365693dc167249a1812ba774483b0680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b417d10219354f0f9c7bd464f2f64006', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.927174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7dd3d-4405-4262-bd69-7adcd05be481 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.927458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7dd3d-4405-4262-bd69-7adcd05be481 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.927735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7dd3d-4405-4262-bd69-7adcd05be481 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.928523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7dd3d-4405-4262-bd69-7adcd05be481 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.930978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7dd3d-4405-4262-bd69-7adcd05be481 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:56.937498 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-fdb7dd3d-4405-4262-bd69-7adcd05be481 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Mar 26 21:05:56.937498 ncdv-master-1 devstack@keystone.service[97202]: Failed validating 'maxLength' in schema['properties']['name']: Mar 26 21:05:56.937498 ncdv-master-1 devstack@keystone.service[97202]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Mar 26 21:05:56.937498 ncdv-master-1 devstack@keystone.service[97202]: On instance['name']: Mar 26 21:05:56.937498 ncdv-master-1 devstack@keystone.service[97202]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Mar 26 21:05:56.939264 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2482/4914] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:05:56 2022] POST /identity/v3/projects => generated 412 bytes in 30 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Mar 26 21:05:56.945880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8568d8d-83e1-423c-8968-992bb9861a6a tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:56.965186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8568d8d-83e1-423c-8968-992bb9861a6a tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:56.972809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692407a-4b96-4f73-8b4f-dfee92f39761 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '365693dc167249a1812ba774483b0680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b417d10219354f0f9c7bd464f2f64006', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:56.973671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692407a-4b96-4f73-8b4f-dfee92f39761 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:56.973954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692407a-4b96-4f73-8b4f-dfee92f39761 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:56.974702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692407a-4b96-4f73-8b4f-dfee92f39761 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] PATH_INFO: `/v3/projects/adddb03fb0964c4ea2136b2dfa95a199` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:56.983821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692407a-4b96-4f73-8b4f-dfee92f39761 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorizing `identity:delete_project(project_id=adddb03fb0964c4ea2136b2dfa95a199)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:56.985709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692407a-4b96-4f73-8b4f-dfee92f39761 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:57.017544 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-e692407a-4b96-4f73-8b4f-dfee92f39761 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Could not find project: adddb03fb0964c4ea2136b2dfa95a199.: keystone.exception.ProjectNotFound: Could not find project: adddb03fb0964c4ea2136b2dfa95a199. Mar 26 21:05:57.020488 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2433/4915] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:56 2022] DELETE /identity/v3/projects/adddb03fb0964c4ea2136b2dfa95a199 => generated 113 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:05:57.025393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7dd3d-4405-4262-bd69-7adcd05be481 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:57.049310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7dd3d-4405-4262-bd69-7adcd05be481 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:57.056195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb86f1-ecc3-471f-a3e4-a4caaaac039f tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5d1c83e021e2470e80f4c1f08a9abb33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '76348024566d4cd3a3717a7085c2c914', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:57.057021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb86f1-ecc3-471f-a3e4-a4caaaac039f tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:57.057313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb86f1-ecc3-471f-a3e4-a4caaaac039f tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:57.057635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb86f1-ecc3-471f-a3e4-a4caaaac039f tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:57.059095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb86f1-ecc3-471f-a3e4-a4caaaac039f tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:57.060277 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-b0cb86f1-ecc3-471f-a3e4-a4caaaac039f tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:05:57.060277 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:05:57.060277 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:05:57.069083 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-b0cb86f1-ecc3-471f-a3e4-a4caaaac039f tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Mar 26 21:05:57.074243 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2483/4916] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Mar 26 21:05:57 2022] GET /identity/v3/projects => generated 135 bytes in 45 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Mar 26 21:05:57.075386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692407a-4b96-4f73-8b4f-dfee92f39761 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:57.092728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692407a-4b96-4f73-8b4f-dfee92f39761 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:57.104171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807235-8563-40ab-baf5-c079ea077d1c tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '365693dc167249a1812ba774483b0680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b417d10219354f0f9c7bd464f2f64006', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:57.107320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807235-8563-40ab-baf5-c079ea077d1c tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:57.109335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807235-8563-40ab-baf5-c079ea077d1c tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:57.109826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf807235-8563-40ab-baf5-c079ea077d1c tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:57.110734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf807235-8563-40ab-baf5-c079ea077d1c tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:57.112844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf807235-8563-40ab-baf5-c079ea077d1c tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:57.178775 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2434/4917] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:05:57 2022] POST /identity/v3/projects => generated 358 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:05:57.183258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb86f1-ecc3-471f-a3e4-a4caaaac039f tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:57.196221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb86f1-ecc3-471f-a3e4-a4caaaac039f tempest-ProjectsNegativeStaticTestJSON-838899533 tempest-ProjectsNegativeStaticTestJSON-838899533-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:57.263061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '365693dc167249a1812ba774483b0680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b417d10219354f0f9c7bd464f2f64006', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:57.264516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:57.264765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:57.265235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:57.265933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:57.268504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:57.291217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.sql.core [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-439934096' for key 'project.ixu_project_name_domain_id'") Mar 26 21:05:57.291217 ncdv-master-1 devstack@keystone.service[97202]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 26 21:05:57.291217 ncdv-master-1 devstack@keystone.service[97202]: [parameters: {'id': '4064cf39529847d181a033d322128801', 'name': 'tempest-project-dup-439934096', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 26 21:05:57.291217 ncdv-master-1 devstack@keystone.service[97202]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=97202) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 26 21:05:57.297244 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-439934096, project id 4064cf39529847d181a033d322128801.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-439934096, project id 4064cf39529847d181a033d322128801. Mar 26 21:05:57.301657 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2484/4918] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:05:57 2022] POST /identity/v3/projects => generated 284 bytes in 116 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 26 21:05:57.303047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807235-8563-40ab-baf5-c079ea077d1c tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:57.315500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf807235-8563-40ab-baf5-c079ea077d1c tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:57.320719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '365693dc167249a1812ba774483b0680', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b417d10219354f0f9c7bd464f2f64006', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:57.321880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:57.322243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:57.323312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] PATH_INFO: `/v3/projects/6d51ff06d25b43e3bff2e662090bc9d4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:57.324637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d51ff06d25b43e3bff2e662090bc9d4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:57.327760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:57.404035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d51ff06d25b43e3bff2e662090bc9d4', 'request_id': 'req-f3161389-d6f2-4137-9d69-cb572fa1c8f3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.429388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d51ff06d25b43e3bff2e662090bc9d4', 'request_id': 'req-f3161389-d6f2-4137-9d69-cb572fa1c8f3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.444013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d51ff06d25b43e3bff2e662090bc9d4', 'request_id': 'req-f3161389-d6f2-4137-9d69-cb572fa1c8f3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.468021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] The token cache is being invalidate because project 6d51ff06d25b43e3bff2e662090bc9d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:57.471330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.474797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3161389-d6f2-4137-9d69-cb572fa1c8f3 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.478861 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2435/4919] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:57 2022] DELETE /identity/v3/projects/6d51ff06d25b43e3bff2e662090bc9d4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:57.483384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:57.486136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:57.613675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f200fa-044c-4eb7-86e2-f1d569a36b92 tempest-ProjectsNegativeStaticTestJSON-257906249 tempest-ProjectsNegativeStaticTestJSON-257906249-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:57.683588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:57.688143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:57.688428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:57.688707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] PATH_INFO: `/v3/users/5d1c83e021e2470e80f4c1f08a9abb33` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:57.690222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1c83e021e2470e80f4c1f08a9abb33)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:57.694573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:57.813138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1c83e021e2470e80f4c1f08a9abb33'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.822854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1c83e021e2470e80f4c1f08a9abb33'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.824008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1c83e021e2470e80f4c1f08a9abb33'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.824919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1c83e021e2470e80f4c1f08a9abb33'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.839882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-84d05932-5d18-49d1-b4ce-7db7f766886a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1c83e021e2470e80f4c1f08a9abb33'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:57.896431 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2485/4920] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:57 2022] DELETE /identity/v3/users/5d1c83e021e2470e80f4c1f08a9abb33 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:57.902773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90df86-2453-410b-ade3-c221f4cdf452 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:57.902989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90df86-2453-410b-ade3-c221f4cdf452 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:57.903277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90df86-2453-410b-ade3-c221f4cdf452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:57.911092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7888a-0307-4b96-8b25-f60f136f60fe None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:57.911717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7888a-0307-4b96-8b25-f60f136f60fe None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:57.912326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7888a-0307-4b96-8b25-f60f136f60fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:57.931536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-dd90df86-2453-410b-ade3-c221f4cdf452 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:57.934772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dd90df86-2453-410b-ade3-c221f4cdf452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:57.936761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7fa7888a-0307-4b96-8b25-f60f136f60fe None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:57.938319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7fa7888a-0307-4b96-8b25-f60f136f60fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:58.063576 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2486/4921] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:58.099279 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2436/4922] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:05:58.112171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7888a-0307-4b96-8b25-f60f136f60fe None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:58.114913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7fa7888a-0307-4b96-8b25-f60f136f60fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:58.125622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90df86-2453-410b-ade3-c221f4cdf452 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:58.129705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dd90df86-2453-410b-ade3-c221f4cdf452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:58.253940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90df86-2453-410b-ade3-c221f4cdf452 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:58.260314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248c81d-2d0a-48c0-aaf4-84f31be61c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:58.261277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248c81d-2d0a-48c0-aaf4-84f31be61c0a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:58.261580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248c81d-2d0a-48c0-aaf4-84f31be61c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:58.262082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248c81d-2d0a-48c0-aaf4-84f31be61c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:58.278339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7888a-0307-4b96-8b25-f60f136f60fe None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:58.288830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae40db-73a5-409e-98d5-3486f19f67a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:58.290124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae40db-73a5-409e-98d5-3486f19f67a7 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:58.290672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae40db-73a5-409e-98d5-3486f19f67a7 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:58.292292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae40db-73a5-409e-98d5-3486f19f67a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:58.302621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248c81d-2d0a-48c0-aaf4-84f31be61c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:58.304225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248c81d-2d0a-48c0-aaf4-84f31be61c0a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:58.327311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae40db-73a5-409e-98d5-3486f19f67a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:58.328729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2437/4923] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:05:58.329060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae40db-73a5-409e-98d5-3486f19f67a7 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:58.339165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2487/4924] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:59.061814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1278f5b-00f7-49e0-b717-1752b265cb9a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:59.062469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1278f5b-00f7-49e0-b717-1752b265cb9a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:59.062904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1278f5b-00f7-49e0-b717-1752b265cb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:59.065778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae40db-73a5-409e-98d5-3486f19f67a7 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:59.068956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-29ae40db-73a5-409e-98d5-3486f19f67a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:59.099016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae40db-73a5-409e-98d5-3486f19f67a7 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:59.100207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a1278f5b-00f7-49e0-b717-1752b265cb9a None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:59.102854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a1278f5b-00f7-49e0-b717-1752b265cb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:59.111358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:59.111711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:59.112106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:59.112449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] PATH_INFO: `/v3/projects/76348024566d4cd3a3717a7085c2c914` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:59.114608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76348024566d4cd3a3717a7085c2c914)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:59.116774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:59.126645 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2438/4925] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:59.139135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1278f5b-00f7-49e0-b717-1752b265cb9a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:59.163500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1278f5b-00f7-49e0-b717-1752b265cb9a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:59.169492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b2cf1-1f71-4230-ad4c-f937316b4493 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:59.170392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b2cf1-1f71-4230-ad4c-f937316b4493 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:59.170392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b2cf1-1f71-4230-ad4c-f937316b4493 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:59.170710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b2cf1-1f71-4230-ad4c-f937316b4493 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:59.183900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b2cf1-1f71-4230-ad4c-f937316b4493 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:59.186798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b2cf1-1f71-4230-ad4c-f937316b4493 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:59.201233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76348024566d4cd3a3717a7085c2c914', 'request_id': 'req-fdd0414c-128c-4292-b8c5-8d46b4a3e199'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.208494 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2439/4926] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:05:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:59.210549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76348024566d4cd3a3717a7085c2c914', 'request_id': 'req-fdd0414c-128c-4292-b8c5-8d46b4a3e199'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.217956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76348024566d4cd3a3717a7085c2c914', 'request_id': 'req-fdd0414c-128c-4292-b8c5-8d46b4a3e199'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.237269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] The token cache is being invalidate because project 76348024566d4cd3a3717a7085c2c914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:05:59.237620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.238433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdd0414c-128c-4292-b8c5-8d46b4a3e199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.240668 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2488/4927] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:59 2022] DELETE /identity/v3/projects/76348024566d4cd3a3717a7085c2c914 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:05:59.244613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b2cf1-1f71-4230-ad4c-f937316b4493 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:59.257858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b2cf1-1f71-4230-ad4c-f937316b4493 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:59.347078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:59.348927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:59.349097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:59.349313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] PATH_INFO: `/v3/users/365693dc167249a1812ba774483b0680` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:59.351067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=365693dc167249a1812ba774483b0680)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:59.352813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:59.428055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365693dc167249a1812ba774483b0680'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.440658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365693dc167249a1812ba774483b0680'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.441816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365693dc167249a1812ba774483b0680'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.443202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365693dc167249a1812ba774483b0680'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.464965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365693dc167249a1812ba774483b0680'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:05:59.484198 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2440/4928] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:05:59 2022] DELETE /identity/v3/users/365693dc167249a1812ba774483b0680 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:05:59.513671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b81460-8d6e-4747-9e67-170168a0be74 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:59.513952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b81460-8d6e-4747-9e67-170168a0be74 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:59.515297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b81460-8d6e-4747-9e67-170168a0be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:59.540476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d4b81460-8d6e-4747-9e67-170168a0be74 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:05:59.541886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d4b81460-8d6e-4747-9e67-170168a0be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:59.676167 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2489/4929] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:05:59.693341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:59.697562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:05:59.795751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28131e35-8cf6-4966-ba59-82b1c4150b4a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:05:59.803022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49113aeb-2abe-43c1-b00a-d78355c167e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:05:59.803894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49113aeb-2abe-43c1-b00a-d78355c167e5 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:05:59.804370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49113aeb-2abe-43c1-b00a-d78355c167e5 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:05:59.805164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49113aeb-2abe-43c1-b00a-d78355c167e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:05:59.818336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49113aeb-2abe-43c1-b00a-d78355c167e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:05:59.820340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49113aeb-2abe-43c1-b00a-d78355c167e5 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:05:59.837315 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2441/4930] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:05:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:05:59.986071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b81460-8d6e-4747-9e67-170168a0be74 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:05:59.988381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d4b81460-8d6e-4747-9e67-170168a0be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:00.188004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b81460-8d6e-4747-9e67-170168a0be74 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:00.202206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:00.203456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:00.205565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:00.205857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] PATH_INFO: `/v3/projects/b417d10219354f0f9c7bd464f2f64006` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:00.210767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b417d10219354f0f9c7bd464f2f64006)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:00.217066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:00.317380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b417d10219354f0f9c7bd464f2f64006', 'request_id': 'req-c3e31a7d-d2eb-477f-854f-57896ea41f9f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:00.335576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b417d10219354f0f9c7bd464f2f64006', 'request_id': 'req-c3e31a7d-d2eb-477f-854f-57896ea41f9f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:00.343380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b417d10219354f0f9c7bd464f2f64006', 'request_id': 'req-c3e31a7d-d2eb-477f-854f-57896ea41f9f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:00.371573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] The token cache is being invalidate because project b417d10219354f0f9c7bd464f2f64006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:00.371871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:00.372707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3e31a7d-d2eb-477f-854f-57896ea41f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:00.374660 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2490/4931] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:05:59 2022] DELETE /identity/v3/projects/b417d10219354f0f9c7bd464f2f64006 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:00.380649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5df8-95b7-4486-bc3e-7e778aa290f7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:00.381247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5df8-95b7-4486-bc3e-7e778aa290f7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:00.381247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d5df8-95b7-4486-bc3e-7e778aa290f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:00.416471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-085d5df8-95b7-4486-bc3e-7e778aa290f7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:00.418055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-085d5df8-95b7-4486-bc3e-7e778aa290f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:00.421208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85144-41c3-4a9e-95e2-6ef7ce9ad321 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:00.421498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85144-41c3-4a9e-95e2-6ef7ce9ad321 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:00.421779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85144-41c3-4a9e-95e2-6ef7ce9ad321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:00.450575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-65b85144-41c3-4a9e-95e2-6ef7ce9ad321 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:00.452222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65b85144-41c3-4a9e-95e2-6ef7ce9ad321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:00.523412 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2442/4932] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:00.530544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c3b01-026d-4742-a774-393a4b2e3893 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:00.531056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c3b01-026d-4742-a774-393a4b2e3893 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:00.531522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c3b01-026d-4742-a774-393a4b2e3893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:00.550495 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2491/4933] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:00.557335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5e1c3b01-026d-4742-a774-393a4b2e3893 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:00.558531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5e1c3b01-026d-4742-a774-393a4b2e3893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:00.568967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85144-41c3-4a9e-95e2-6ef7ce9ad321 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:00.570415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65b85144-41c3-4a9e-95e2-6ef7ce9ad321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:00.592088 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2443/4934] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:00.597445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c3b01-026d-4742-a774-393a4b2e3893 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:00.609327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c3b01-026d-4742-a774-393a4b2e3893 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:00.615425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4521df3-96eb-4f5f-bc91-ecc4f53917c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:00.616427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4521df3-96eb-4f5f-bc91-ecc4f53917c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:00.616955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4521df3-96eb-4f5f-bc91-ecc4f53917c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:00.617715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4521df3-96eb-4f5f-bc91-ecc4f53917c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:00.619224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4521df3-96eb-4f5f-bc91-ecc4f53917c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:06:00.619770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4521df3-96eb-4f5f-bc91-ecc4f53917c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:00.621657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4521df3-96eb-4f5f-bc91-ecc4f53917c2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:00.655154 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2444/4935] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:06:00.657619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4521df3-96eb-4f5f-bc91-ecc4f53917c2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:00.666200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85144-41c3-4a9e-95e2-6ef7ce9ad321 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:00.673609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4521df3-96eb-4f5f-bc91-ecc4f53917c2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:00.679982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bff76-62d4-49e5-be62-1accbbc61ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:00.682434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bff76-62d4-49e5-be62-1accbbc61ffa admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:00.683077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bff76-62d4-49e5-be62-1accbbc61ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:00.683554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bff76-62d4-49e5-be62-1accbbc61ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:00.684459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bff76-62d4-49e5-be62-1accbbc61ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:00.686414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99747127-c9b6-40cc-8012-d5e69662b5f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:00.687075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99747127-c9b6-40cc-8012-d5e69662b5f2 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:00.687359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99747127-c9b6-40cc-8012-d5e69662b5f2 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:00.687633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99747127-c9b6-40cc-8012-d5e69662b5f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:00.687958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bff76-62d4-49e5-be62-1accbbc61ffa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:00.707905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99747127-c9b6-40cc-8012-d5e69662b5f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:00.709665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99747127-c9b6-40cc-8012-d5e69662b5f2 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:00.719312 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2492/4936] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 21:06:00.749387 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2445/4937] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:00 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:00.753609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99747127-c9b6-40cc-8012-d5e69662b5f2 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:00.779026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99747127-c9b6-40cc-8012-d5e69662b5f2 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:00.926576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c90fdf-0164-4c87-8dc3-c6c9383b329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:00.927506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c90fdf-0164-4c87-8dc3-c6c9383b329c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:00.927859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c90fdf-0164-4c87-8dc3-c6c9383b329c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:00.928251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c90fdf-0164-4c87-8dc3-c6c9383b329c admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:00.929215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c90fdf-0164-4c87-8dc3-c6c9383b329c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:00.931992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c90fdf-0164-4c87-8dc3-c6c9383b329c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:00.967166 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2493/4938] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:00 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:06:00.968441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bff76-62d4-49e5-be62-1accbbc61ffa admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:00.982972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bff76-62d4-49e5-be62-1accbbc61ffa admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:00.995477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa37ecb-3c03-4508-adeb-c7bed45a9632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:00.996295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa37ecb-3c03-4508-adeb-c7bed45a9632 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:00.996654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa37ecb-3c03-4508-adeb-c7bed45a9632 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:00.997075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa37ecb-3c03-4508-adeb-c7bed45a9632 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:00.997791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa37ecb-3c03-4508-adeb-c7bed45a9632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:01.004545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa37ecb-3c03-4508-adeb-c7bed45a9632 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:01.037107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c90fdf-0164-4c87-8dc3-c6c9383b329c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:01.044015 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2446/4939] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:06:01.051749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c90fdf-0164-4c87-8dc3-c6c9383b329c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:01.059606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726efcc-032f-4177-aa4c-8a3d69a99cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:01.060319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726efcc-032f-4177-aa4c-8a3d69a99cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.060935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726efcc-032f-4177-aa4c-8a3d69a99cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.061891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726efcc-032f-4177-aa4c-8a3d69a99cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.062632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726efcc-032f-4177-aa4c-8a3d69a99cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:01.064331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726efcc-032f-4177-aa4c-8a3d69a99cf5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:01.081406 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2494/4940] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:06:01.083240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa37ecb-3c03-4508-adeb-c7bed45a9632 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:01.106470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa37ecb-3c03-4508-adeb-c7bed45a9632 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:01.122077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71798df-a930-4109-8d33-748b693f5363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:01.126926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71798df-a930-4109-8d33-748b693f5363 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.126926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71798df-a930-4109-8d33-748b693f5363 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.126926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71798df-a930-4109-8d33-748b693f5363 admin admin] PATH_INFO: `/v3/projects/b6fc5081a2a245f7a1d5681a4cda8d4d/users/2fd574ade43d4461b133a90bedcf99bf/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.169823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71798df-a930-4109-8d33-748b693f5363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6fc5081a2a245f7a1d5681a4cda8d4d, user_id=2fd574ade43d4461b133a90bedcf99bf, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:01.173386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71798df-a930-4109-8d33-748b693f5363 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:01.207009 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2447/4941] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:01 2022] PUT /identity/v3/projects/b6fc5081a2a245f7a1d5681a4cda8d4d/users/2fd574ade43d4461b133a90bedcf99bf/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:01.217862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdb72f-a8b9-4f82-b7a9-a0a4ebf9cd2b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.218627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdb72f-a8b9-4f82-b7a9-a0a4ebf9cd2b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.218938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdb72f-a8b9-4f82-b7a9-a0a4ebf9cd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.246818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-85bdb72f-a8b9-4f82-b7a9-a0a4ebf9cd2b None None] MFA Rules not processed for user `2fd574ade43d4461b133a90bedcf99bf`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:01.248144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-85bdb72f-a8b9-4f82-b7a9-a0a4ebf9cd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:01.323946 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2495/4942] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:01.328221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71798df-a930-4109-8d33-748b693f5363 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:01.417044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71798df-a930-4109-8d33-748b693f5363 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:01.421892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81e23b-3d86-4d1b-acd9-39d099129c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:01.422559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81e23b-3d86-4d1b-acd9-39d099129c8f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.422990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81e23b-3d86-4d1b-acd9-39d099129c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.423275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81e23b-3d86-4d1b-acd9-39d099129c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.424014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81e23b-3d86-4d1b-acd9-39d099129c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:01.425951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba81e23b-3d86-4d1b-acd9-39d099129c8f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:01.454368 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2448/4943] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:01 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:01.458633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdb72f-a8b9-4f82-b7a9-a0a4ebf9cd2b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:01.478828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdb72f-a8b9-4f82-b7a9-a0a4ebf9cd2b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:01.544076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b1df-dab3-4fb6-b1e0-a31a018d6215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:01.547575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b1df-dab3-4fb6-b1e0-a31a018d6215 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.547575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b1df-dab3-4fb6-b1e0-a31a018d6215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.547575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b1df-dab3-4fb6-b1e0-a31a018d6215 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.547575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b1df-dab3-4fb6-b1e0-a31a018d6215 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:01.548414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b1df-dab3-4fb6-b1e0-a31a018d6215 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:01.575675 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2496/4944] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:01 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:06:01.576956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81e23b-3d86-4d1b-acd9-39d099129c8f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:01.589731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba81e23b-3d86-4d1b-acd9-39d099129c8f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:01.594670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46b2bb-4fe3-4e62-abbd-40035f6969f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:01.595410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b2bb-4fe3-4e62-abbd-40035f6969f9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.595986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b2bb-4fe3-4e62-abbd-40035f6969f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.596336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46b2bb-4fe3-4e62-abbd-40035f6969f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.597130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46b2bb-4fe3-4e62-abbd-40035f6969f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:01.598957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46b2bb-4fe3-4e62-abbd-40035f6969f9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:01.616048 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2449/4945] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:01.620475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b1df-dab3-4fb6-b1e0-a31a018d6215 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:01.631604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b1df-dab3-4fb6-b1e0-a31a018d6215 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:01.638551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b40b5e-e234-454a-b481-61410c69a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:01.639857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b40b5e-e234-454a-b481-61410c69a8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.640256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b40b5e-e234-454a-b481-61410c69a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.640609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b40b5e-e234-454a-b481-61410c69a8e7 admin admin] PATH_INFO: `/v3/projects/2f5ee8bab4c045a6a098cabae6b9f37c/users/a711f50563cd449ea87c3c9e954f4047/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.663364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b40b5e-e234-454a-b481-61410c69a8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5ee8bab4c045a6a098cabae6b9f37c, user_id=a711f50563cd449ea87c3c9e954f4047, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:01.666746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b40b5e-e234-454a-b481-61410c69a8e7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:01.684240 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2497/4946] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:01 2022] PUT /identity/v3/projects/2f5ee8bab4c045a6a098cabae6b9f37c/users/a711f50563cd449ea87c3c9e954f4047/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:01.690169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46b2bb-4fe3-4e62-abbd-40035f6969f9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:01.703839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46b2bb-4fe3-4e62-abbd-40035f6969f9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:01.814237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f43c4-bebe-446c-8e61-2b98faf8a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:01.815424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f43c4-bebe-446c-8e61-2b98faf8a076 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.815810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f43c4-bebe-446c-8e61-2b98faf8a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.816213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f43c4-bebe-446c-8e61-2b98faf8a076 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.818222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f43c4-bebe-446c-8e61-2b98faf8a076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:01.820587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f43c4-bebe-446c-8e61-2b98faf8a076 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:01.843416 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2450/4947] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:01.854775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b40b5e-e234-454a-b481-61410c69a8e7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:01.870650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b40b5e-e234-454a-b481-61410c69a8e7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:01.877271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dc511-d6e5-458a-a4d6-20c644d46b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:01.878274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dc511-d6e5-458a-a4d6-20c644d46b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.878661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dc511-d6e5-458a-a4d6-20c644d46b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.879073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dc511-d6e5-458a-a4d6-20c644d46b6f admin admin] PATH_INFO: `/v3/projects/2f5ee8bab4c045a6a098cabae6b9f37c/users/a711f50563cd449ea87c3c9e954f4047/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.881823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dc511-d6e5-458a-a4d6-20c644d46b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f5ee8bab4c045a6a098cabae6b9f37c, user_id=a711f50563cd449ea87c3c9e954f4047, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:01.887081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dc511-d6e5-458a-a4d6-20c644d46b6f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:01.902770 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2498/4948] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:01 2022] PUT /identity/v3/projects/2f5ee8bab4c045a6a098cabae6b9f37c/users/a711f50563cd449ea87c3c9e954f4047/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:01.912534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56701a-27eb-48d2-808e-8a2e15776526 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:01.912829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56701a-27eb-48d2-808e-8a2e15776526 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:01.913117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56701a-27eb-48d2-808e-8a2e15776526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:01.984805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2d56701a-27eb-48d2-808e-8a2e15776526 None None] MFA Rules not processed for user `a711f50563cd449ea87c3c9e954f4047`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:01.986003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2d56701a-27eb-48d2-808e-8a2e15776526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:02.115746 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2451/4949] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:02.126924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dc511-d6e5-458a-a4d6-20c644d46b6f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:02.153341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dc511-d6e5-458a-a4d6-20c644d46b6f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:02.160130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4627-a2e3-47b1-982a-d0c6d8e5f45d tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711f50563cd449ea87c3c9e954f4047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f5ee8bab4c045a6a098cabae6b9f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:02.161105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4627-a2e3-47b1-982a-d0c6d8e5f45d tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:02.161650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4627-a2e3-47b1-982a-d0c6d8e5f45d tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:02.162641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cf4627-a2e3-47b1-982a-d0c6d8e5f45d tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:02.163745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4627-a2e3-47b1-982a-d0c6d8e5f45d tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:02.167582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cf4627-a2e3-47b1-982a-d0c6d8e5f45d tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:02.239975 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2499/4950] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:02 2022] POST /identity/v3/projects => generated 358 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:02.243490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56701a-27eb-48d2-808e-8a2e15776526 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:02.383707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56701a-27eb-48d2-808e-8a2e15776526 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:02.481357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fa50c-4c95-49cd-8bd1-e2d08ed2513a tempest-ProjectsNegativeTestJSON-1480557677 tempest-ProjectsNegativeTestJSON-1480557677-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fd574ade43d4461b133a90bedcf99bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6fc5081a2a245f7a1d5681a4cda8d4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:02.482576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fa50c-4c95-49cd-8bd1-e2d08ed2513a tempest-ProjectsNegativeTestJSON-1480557677 tempest-ProjectsNegativeTestJSON-1480557677-project] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:02.482937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fa50c-4c95-49cd-8bd1-e2d08ed2513a tempest-ProjectsNegativeTestJSON-1480557677 tempest-ProjectsNegativeTestJSON-1480557677-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:02.483474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fa50c-4c95-49cd-8bd1-e2d08ed2513a tempest-ProjectsNegativeTestJSON-1480557677 tempest-ProjectsNegativeTestJSON-1480557677-project] PATH_INFO: `/v3/projects/3868dc2a8bc14de298a86715adf3bf00` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:02.484956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fa50c-4c95-49cd-8bd1-e2d08ed2513a tempest-ProjectsNegativeTestJSON-1480557677 tempest-ProjectsNegativeTestJSON-1480557677-project] RBAC: Authorizing `identity:delete_project(project_id=3868dc2a8bc14de298a86715adf3bf00)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:02.496639 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-ec0fa50c-4c95-49cd-8bd1-e2d08ed2513a tempest-ProjectsNegativeTestJSON-1480557677 tempest-ProjectsNegativeTestJSON-1480557677-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Mar 26 21:06:02.498031 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2452/4951] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:02 2022] DELETE /identity/v3/projects/3868dc2a8bc14de298a86715adf3bf00 => generated 136 bytes in 256 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:06:02.502613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4627-a2e3-47b1-982a-d0c6d8e5f45d tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:02.582035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cf4627-a2e3-47b1-982a-d0c6d8e5f45d tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:02.590550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a711f50563cd449ea87c3c9e954f4047', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2f5ee8bab4c045a6a098cabae6b9f37c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:02.592011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:02.592644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:02.593348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] PATH_INFO: `/v3/projects/3868dc2a8bc14de298a86715adf3bf00` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:02.594665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3868dc2a8bc14de298a86715adf3bf00)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:02.597985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:02.651536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3868dc2a8bc14de298a86715adf3bf00', 'request_id': 'req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.661310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3868dc2a8bc14de298a86715adf3bf00', 'request_id': 'req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.668293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3868dc2a8bc14de298a86715adf3bf00', 'request_id': 'req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.680105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] The token cache is being invalidate because project 3868dc2a8bc14de298a86715adf3bf00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:02.680927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.681684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e52197d2-2bd8-4b9b-821e-7bcdfc91441a tempest-ProjectsNegativeTestJSON-448571543 tempest-ProjectsNegativeTestJSON-448571543-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.683297 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2500/4952] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:02 2022] DELETE /identity/v3/projects/3868dc2a8bc14de298a86715adf3bf00 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:06:02.688557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fa50c-4c95-49cd-8bd1-e2d08ed2513a tempest-ProjectsNegativeTestJSON-1480557677 tempest-ProjectsNegativeTestJSON-1480557677-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:02.690508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ec0fa50c-4c95-49cd-8bd1-e2d08ed2513a tempest-ProjectsNegativeTestJSON-1480557677 tempest-ProjectsNegativeTestJSON-1480557677-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:02.765899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fa50c-4c95-49cd-8bd1-e2d08ed2513a tempest-ProjectsNegativeTestJSON-1480557677 tempest-ProjectsNegativeTestJSON-1480557677-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:02.827831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:02.828766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:02.829047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:02.829508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] PATH_INFO: `/v3/users/2fd574ade43d4461b133a90bedcf99bf` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:02.830727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd574ade43d4461b133a90bedcf99bf)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:02.832772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:02.883132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd574ade43d4461b133a90bedcf99bf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.891308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd574ade43d4461b133a90bedcf99bf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.891959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd574ade43d4461b133a90bedcf99bf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.892625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd574ade43d4461b133a90bedcf99bf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.904266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd574ade43d4461b133a90bedcf99bf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:02.929168 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2453/4953] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:02 2022] DELETE /identity/v3/users/2fd574ade43d4461b133a90bedcf99bf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:06:02.934301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c0c1-9b26-4d4f-9643-730222be689e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:02.934594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c0c1-9b26-4d4f-9643-730222be689e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:02.935120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525c0c1-9b26-4d4f-9643-730222be689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:02.955832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f525c0c1-9b26-4d4f-9643-730222be689e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:02.957375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f525c0c1-9b26-4d4f-9643-730222be689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:03.032078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:03.033669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:03.071560 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2501/4954] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:03.082894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c0c1-9b26-4d4f-9643-730222be689e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:03.085000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f525c0c1-9b26-4d4f-9643-730222be689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:03.108809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaf880-8619-4da0-b463-ba5d97f51faf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:03.114158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:03.115348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:03.115802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:03.116274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] PATH_INFO: `/v3/users/bfac7b943d654fc88c08d106d57201d6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:03.117705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfac7b943d654fc88c08d106d57201d6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:03.119826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:03.162088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525c0c1-9b26-4d4f-9643-730222be689e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:03.166118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2784456-f106-43b6-bf47-e756cca267e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:03.166704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2784456-f106-43b6-bf47-e756cca267e1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:03.167046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2784456-f106-43b6-bf47-e756cca267e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:03.167350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2784456-f106-43b6-bf47-e756cca267e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:03.177489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2784456-f106-43b6-bf47-e756cca267e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:03.178991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfac7b943d654fc88c08d106d57201d6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:03.179183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2784456-f106-43b6-bf47-e756cca267e1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:03.190935 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2502/4955] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:06:03.191471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfac7b943d654fc88c08d106d57201d6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:03.192260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfac7b943d654fc88c08d106d57201d6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:03.193141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfac7b943d654fc88c08d106d57201d6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:03.206389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfac7b943d654fc88c08d106d57201d6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:03.220475 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2454/4956] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:03 2022] DELETE /identity/v3/users/bfac7b943d654fc88c08d106d57201d6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:06:03.226613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7812d8a-7402-4b4d-a121-faa25a3ab5a0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:03.226923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7812d8a-7402-4b4d-a121-faa25a3ab5a0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:03.227216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7812d8a-7402-4b4d-a121-faa25a3ab5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:03.245876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d7812d8a-7402-4b4d-a121-faa25a3ab5a0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:03.247084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d7812d8a-7402-4b4d-a121-faa25a3ab5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:03.313361 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2503/4957] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:03.325197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:03.326700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:03.392604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf70d9-7a41-4312-a2db-acc8fa4125cc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:03.396684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7481e8-ca77-4779-a148-7652824463d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:03.397437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7481e8-ca77-4779-a148-7652824463d6 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:03.397806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7481e8-ca77-4779-a148-7652824463d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:03.398291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7481e8-ca77-4779-a148-7652824463d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:03.409228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7481e8-ca77-4779-a148-7652824463d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:03.411006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7481e8-ca77-4779-a148-7652824463d6 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:03.423737 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2455/4958] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:06:03.861261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7812d8a-7402-4b4d-a121-faa25a3ab5a0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:03.863044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d7812d8a-7402-4b4d-a121-faa25a3ab5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:03.884251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7812d8a-7402-4b4d-a121-faa25a3ab5a0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:03.890183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:03.891298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:03.891790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:03.892289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] PATH_INFO: `/v3/projects/ffeef0caf635437194fed3721a8d1d0d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:03.893734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffeef0caf635437194fed3721a8d1d0d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:03.895849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:03.911665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7481e8-ca77-4779-a148-7652824463d6 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:03.913120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7b7481e8-ca77-4779-a148-7652824463d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:03.937093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7481e8-ca77-4779-a148-7652824463d6 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:03.953005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:03.955268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:03.955763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:03.956279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] PATH_INFO: `/v3/projects/b6fc5081a2a245f7a1d5681a4cda8d4d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:03.957851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6fc5081a2a245f7a1d5681a4cda8d4d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:03.960821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:03.991450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffeef0caf635437194fed3721a8d1d0d', 'request_id': 'req-fdbb7258-edb7-4a6b-b733-d22532e0064c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.006075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffeef0caf635437194fed3721a8d1d0d', 'request_id': 'req-fdbb7258-edb7-4a6b-b733-d22532e0064c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.016449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffeef0caf635437194fed3721a8d1d0d', 'request_id': 'req-fdbb7258-edb7-4a6b-b733-d22532e0064c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.031833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] The token cache is being invalidate because project ffeef0caf635437194fed3721a8d1d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:04.032431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.033433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fdbb7258-edb7-4a6b-b733-d22532e0064c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.048261 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2504/4959] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:03 2022] DELETE /identity/v3/projects/ffeef0caf635437194fed3721a8d1d0d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:04.053927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffab00-7167-4130-bcbf-82998e03881d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.054306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffab00-7167-4130-bcbf-82998e03881d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.054751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffab00-7167-4130-bcbf-82998e03881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.095959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6fc5081a2a245f7a1d5681a4cda8d4d', 'request_id': 'req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.105144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dfffab00-7167-4130-bcbf-82998e03881d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:04.106759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dfffab00-7167-4130-bcbf-82998e03881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:04.109574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6fc5081a2a245f7a1d5681a4cda8d4d', 'request_id': 'req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.128484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6fc5081a2a245f7a1d5681a4cda8d4d', 'request_id': 'req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.144469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] The token cache is being invalidate because project b6fc5081a2a245f7a1d5681a4cda8d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:04.145345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.145582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.152477 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2456/4960] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:03 2022] DELETE /identity/v3/projects/b6fc5081a2a245f7a1d5681a4cda8d4d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:06:04.155199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:04.158965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:04.237826 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2505/4961] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:04.246611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c13eb-344d-4ed4-9b43-a1a863df0e34 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.247244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c13eb-344d-4ed4-9b43-a1a863df0e34 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.247244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c13eb-344d-4ed4-9b43-a1a863df0e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.281366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cffb22f-e673-4fd4-871f-58f8a84f3e0d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:04.286565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e84c13eb-344d-4ed4-9b43-a1a863df0e34 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:04.287791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e84c13eb-344d-4ed4-9b43-a1a863df0e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:04.293847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:04.294918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.295046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.295265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] PATH_INFO: `/v3/users/a711f50563cd449ea87c3c9e954f4047` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.297408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a711f50563cd449ea87c3c9e954f4047)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:04.300521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:04.308410 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2506/4962] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:04.312541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c13eb-344d-4ed4-9b43-a1a863df0e34 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:04.328496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c13eb-344d-4ed4-9b43-a1a863df0e34 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:04.340298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf61ce-60c8-4ee6-999a-497900e80701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:04.342490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf61ce-60c8-4ee6-999a-497900e80701 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.343946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf61ce-60c8-4ee6-999a-497900e80701 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.344655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf61ce-60c8-4ee6-999a-497900e80701 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.345439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf61ce-60c8-4ee6-999a-497900e80701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:06:04.347887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf61ce-60c8-4ee6-999a-497900e80701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:04.351856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf61ce-60c8-4ee6-999a-497900e80701 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:04.373418 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2507/4963] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:06:04.384950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf61ce-60c8-4ee6-999a-497900e80701 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:04.399513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a711f50563cd449ea87c3c9e954f4047'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.420717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf61ce-60c8-4ee6-999a-497900e80701 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:04.425701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a711f50563cd449ea87c3c9e954f4047'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.427227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a711f50563cd449ea87c3c9e954f4047'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.428143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a711f50563cd449ea87c3c9e954f4047'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.434790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf5e4-12cf-4856-9061-6c89569e8a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:04.435456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf5e4-12cf-4856-9061-6c89569e8a05 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.435734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf5e4-12cf-4856-9061-6c89569e8a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.436043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbf5e4-12cf-4856-9061-6c89569e8a05 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.436785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbf5e4-12cf-4856-9061-6c89569e8a05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:04.438766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbf5e4-12cf-4856-9061-6c89569e8a05 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:04.459730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a711f50563cd449ea87c3c9e954f4047'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:04.477912 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2508/4964] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:04 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:04.479058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf5e4-12cf-4856-9061-6c89569e8a05 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:04.483185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-62dbf5e4-12cf-4856-9061-6c89569e8a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:04.490337 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2457/4965] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:04 2022] DELETE /identity/v3/users/a711f50563cd449ea87c3c9e954f4047 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:06:04.573133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbf5e4-12cf-4856-9061-6c89569e8a05 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:04.649876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5129f-c830-4776-aee0-0c71aa796eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:04.650668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5129f-c830-4776-aee0-0c71aa796eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.651018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5129f-c830-4776-aee0-0c71aa796eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.651561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5129f-c830-4776-aee0-0c71aa796eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.652384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5129f-c830-4776-aee0-0c71aa796eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:04.654407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5129f-c830-4776-aee0-0c71aa796eb8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:04.679615 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2509/4966] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:04 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:04.684604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:04.706755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fa1a1-2047-40e7-b306-6834cecdf312 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:04.725073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b6be8-1bce-4738-a639-2f5d4fc08ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:04.725863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6be8-1bce-4738-a639-2f5d4fc08ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.727383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6be8-1bce-4738-a639-2f5d4fc08ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.727838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8b6be8-1bce-4738-a639-2f5d4fc08ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.728714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b6be8-1bce-4738-a639-2f5d4fc08ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:04.731575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8b6be8-1bce-4738-a639-2f5d4fc08ec6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:04.748369 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2458/4967] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:04.750659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5129f-c830-4776-aee0-0c71aa796eb8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:04.763727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5129f-c830-4776-aee0-0c71aa796eb8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:04.771332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa075d47-a0d5-4eb7-a4ad-749e61221f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:04.772779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa075d47-a0d5-4eb7-a4ad-749e61221f1e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.773178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa075d47-a0d5-4eb7-a4ad-749e61221f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.773556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa075d47-a0d5-4eb7-a4ad-749e61221f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.775250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa075d47-a0d5-4eb7-a4ad-749e61221f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:04.776800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa075d47-a0d5-4eb7-a4ad-749e61221f1e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:04.796239 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2510/4968] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:04.797658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b6be8-1bce-4738-a639-2f5d4fc08ec6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:04.808677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8b6be8-1bce-4738-a639-2f5d4fc08ec6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:04.813763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e47b-3caa-4894-a589-a65dfdca70be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:04.814748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e47b-3caa-4894-a589-a65dfdca70be admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.815107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e47b-3caa-4894-a589-a65dfdca70be admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.815461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58e47b-3caa-4894-a589-a65dfdca70be admin admin] PATH_INFO: `/v3/projects/fb6a3637d7d24266999a5d31a8c37bc2/users/bd919e062b7940c8a48fbf40517cb489/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.832483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58e47b-3caa-4894-a589-a65dfdca70be admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6a3637d7d24266999a5d31a8c37bc2, user_id=bd919e062b7940c8a48fbf40517cb489, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:04.836258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58e47b-3caa-4894-a589-a65dfdca70be admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:04.855029 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2459/4969] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:04 2022] PUT /identity/v3/projects/fb6a3637d7d24266999a5d31a8c37bc2/users/bd919e062b7940c8a48fbf40517cb489/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:04.861289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e4d0f-5b63-4864-b470-40827d80d440 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:04.861940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e4d0f-5b63-4864-b470-40827d80d440 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:04.862697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e4d0f-5b63-4864-b470-40827d80d440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:04.890500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-416e4d0f-5b63-4864-b470-40827d80d440 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:04.891735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-416e4d0f-5b63-4864-b470-40827d80d440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:04.962048 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2511/4970] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:04.973855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e47b-3caa-4894-a589-a65dfdca70be admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:04.975851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ec58e47b-3caa-4894-a589-a65dfdca70be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:05.043885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58e47b-3caa-4894-a589-a65dfdca70be admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:05.048258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba9a7d-d29e-4070-8743-6ec64ac705b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:05.049404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba9a7d-d29e-4070-8743-6ec64ac705b0 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.049788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba9a7d-d29e-4070-8743-6ec64ac705b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.050313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba9a7d-d29e-4070-8743-6ec64ac705b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.061373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba9a7d-d29e-4070-8743-6ec64ac705b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:05.063447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba9a7d-d29e-4070-8743-6ec64ac705b0 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:05.077665 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2460/4971] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:05.183411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e4d0f-5b63-4864-b470-40827d80d440 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:05.185391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-416e4d0f-5b63-4864-b470-40827d80d440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:05.199900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e4d0f-5b63-4864-b470-40827d80d440 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:05.208859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:05.210239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.211553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.212124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] PATH_INFO: `/v3/projects/2f5ee8bab4c045a6a098cabae6b9f37c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.213949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f5ee8bab4c045a6a098cabae6b9f37c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:05.230238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:05.306190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f5ee8bab4c045a6a098cabae6b9f37c', 'request_id': 'req-28874094-5dd6-4d2c-86e7-366e3cf162af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:05.320866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f5ee8bab4c045a6a098cabae6b9f37c', 'request_id': 'req-28874094-5dd6-4d2c-86e7-366e3cf162af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:05.327199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f5ee8bab4c045a6a098cabae6b9f37c', 'request_id': 'req-28874094-5dd6-4d2c-86e7-366e3cf162af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:05.339377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] The token cache is being invalidate because project 2f5ee8bab4c045a6a098cabae6b9f37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:05.339694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:05.340441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-28874094-5dd6-4d2c-86e7-366e3cf162af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:05.342352 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2512/4972] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:05 2022] DELETE /identity/v3/projects/2f5ee8bab4c045a6a098cabae6b9f37c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:05.346975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771569-cf92-4370-a5d1-e889b1a4f2a2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.347281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771569-cf92-4370-a5d1-e889b1a4f2a2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.347542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3771569-cf92-4370-a5d1-e889b1a4f2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.369204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b3771569-cf92-4370-a5d1-e889b1a4f2a2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:05.370667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b3771569-cf92-4370-a5d1-e889b1a4f2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:05.451991 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2461/4973] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:05.459701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660adb5e-1738-4ea8-9a8e-c315e4e3c7af None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.460015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660adb5e-1738-4ea8-9a8e-c315e4e3c7af None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.460297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660adb5e-1738-4ea8-9a8e-c315e4e3c7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.484677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-660adb5e-1738-4ea8-9a8e-c315e4e3c7af None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:05.486478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-660adb5e-1738-4ea8-9a8e-c315e4e3c7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:05.500456 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2513/4974] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:05.501660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771569-cf92-4370-a5d1-e889b1a4f2a2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:05.517469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3771569-cf92-4370-a5d1-e889b1a4f2a2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:05.524612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e520e-d2f1-4c0b-bb9e-e3e0b4af8a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:05.526342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e520e-d2f1-4c0b-bb9e-e3e0b4af8a27 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.526806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e520e-d2f1-4c0b-bb9e-e3e0b4af8a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.527286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e520e-d2f1-4c0b-bb9e-e3e0b4af8a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.528319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e520e-d2f1-4c0b-bb9e-e3e0b4af8a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:06:05.528683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e520e-d2f1-4c0b-bb9e-e3e0b4af8a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:05.530666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e520e-d2f1-4c0b-bb9e-e3e0b4af8a27 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:05.550735 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2462/4975] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:06:05.554048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660adb5e-1738-4ea8-9a8e-c315e4e3c7af None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:05.572626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660adb5e-1738-4ea8-9a8e-c315e4e3c7af None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:05.581875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c14cd-1265-4c59-9d31-3cbff37d20be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:05.581875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c14cd-1265-4c59-9d31-3cbff37d20be admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.581875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c14cd-1265-4c59-9d31-3cbff37d20be admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.581875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c14cd-1265-4c59-9d31-3cbff37d20be admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.582436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c14cd-1265-4c59-9d31-3cbff37d20be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:05.585840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c14cd-1265-4c59-9d31-3cbff37d20be admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:05.634898 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2514/4976] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:05 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:06:05.639244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e520e-d2f1-4c0b-bb9e-e3e0b4af8a27 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:05.650944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e520e-d2f1-4c0b-bb9e-e3e0b4af8a27 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:05.722141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b671b32-beac-437f-b82a-c943b5a5f80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:05.722729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b671b32-beac-437f-b82a-c943b5a5f80e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.723004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b671b32-beac-437f-b82a-c943b5a5f80e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.723488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b671b32-beac-437f-b82a-c943b5a5f80e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.724375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b671b32-beac-437f-b82a-c943b5a5f80e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:05.726539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b671b32-beac-437f-b82a-c943b5a5f80e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:05.750871 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2463/4977] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:05 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:05.754684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c14cd-1265-4c59-9d31-3cbff37d20be admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:05.766691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c14cd-1265-4c59-9d31-3cbff37d20be admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:05.773787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e53c8-3d78-45e8-b66f-1a20d0f7ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:05.775225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e53c8-3d78-45e8-b66f-1a20d0f7ad99 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.775663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e53c8-3d78-45e8-b66f-1a20d0f7ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.776091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e53c8-3d78-45e8-b66f-1a20d0f7ad99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.777050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e53c8-3d78-45e8-b66f-1a20d0f7ad99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:05.780193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e53c8-3d78-45e8-b66f-1a20d0f7ad99 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:05.797353 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2515/4978] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:05.801873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b671b32-beac-437f-b82a-c943b5a5f80e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:05.814854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b671b32-beac-437f-b82a-c943b5a5f80e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:05.822754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c611c3-f7de-4fdd-a138-8a479eaa7ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:05.823986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c611c3-f7de-4fdd-a138-8a479eaa7ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.824575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c611c3-f7de-4fdd-a138-8a479eaa7ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.825087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c611c3-f7de-4fdd-a138-8a479eaa7ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.826160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c611c3-f7de-4fdd-a138-8a479eaa7ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:05.828132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c611c3-f7de-4fdd-a138-8a479eaa7ac9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:05.844956 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2464/4979] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:05.847084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e53c8-3d78-45e8-b66f-1a20d0f7ad99 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:05.870614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e53c8-3d78-45e8-b66f-1a20d0f7ad99 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:05.884650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f930d-dd75-442b-9470-62e475ec60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:05.886398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f930d-dd75-442b-9470-62e475ec60ca admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.886745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f930d-dd75-442b-9470-62e475ec60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.887098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f930d-dd75-442b-9470-62e475ec60ca admin admin] PATH_INFO: `/v3/projects/d4589b33ca534c89a7002eb4fc740dca/users/79d98a99891e43e7b3c6db7173003d15/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:05.918414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f930d-dd75-442b-9470-62e475ec60ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4589b33ca534c89a7002eb4fc740dca, user_id=79d98a99891e43e7b3c6db7173003d15, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:05.923678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f930d-dd75-442b-9470-62e475ec60ca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:05.955037 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2516/4980] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:05 2022] PUT /identity/v3/projects/d4589b33ca534c89a7002eb4fc740dca/users/79d98a99891e43e7b3c6db7173003d15/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:05.966374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84f2a6-ee0d-49ec-add2-46d27e4f6e43 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:05.967140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84f2a6-ee0d-49ec-add2-46d27e4f6e43 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:05.967647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84f2a6-ee0d-49ec-add2-46d27e4f6e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:06.001178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-eb84f2a6-ee0d-49ec-add2-46d27e4f6e43 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:06.003413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eb84f2a6-ee0d-49ec-add2-46d27e4f6e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:06.152048 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2465/4981] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:06.157508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f930d-dd75-442b-9470-62e475ec60ca admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:06.173654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f930d-dd75-442b-9470-62e475ec60ca admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:06.178253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed2b7-4d93-4213-a87e-98144e54f158 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:06.179115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed2b7-4d93-4213-a87e-98144e54f158 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:06.179417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed2b7-4d93-4213-a87e-98144e54f158 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:06.179725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed2b7-4d93-4213-a87e-98144e54f158 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:06.249858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-60eed2b7-4d93-4213-a87e-98144e54f158 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:06.262287 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2517/4982] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:06 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:07.267144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89835d9-3e23-42f5-9016-72b7bf0d1a57 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:07.268101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89835d9-3e23-42f5-9016-72b7bf0d1a57 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:07.268550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89835d9-3e23-42f5-9016-72b7bf0d1a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:07.298022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c89835d9-3e23-42f5-9016-72b7bf0d1a57 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:07.299356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c89835d9-3e23-42f5-9016-72b7bf0d1a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:07.308398 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2466/4983] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:07 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:07.309200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb14ff-982d-43b5-89ac-0f5e9e151f8e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:07.312859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb14ff-982d-43b5-89ac-0f5e9e151f8e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:07.313884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb14ff-982d-43b5-89ac-0f5e9e151f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:07.342034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0ffb14ff-982d-43b5-89ac-0f5e9e151f8e None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:07.344918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0ffb14ff-982d-43b5-89ac-0f5e9e151f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:07.360879 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2518/4984] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:07.362317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89835d9-3e23-42f5-9016-72b7bf0d1a57 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:07.378771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89835d9-3e23-42f5-9016-72b7bf0d1a57 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:07.387387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306d47-9930-4417-be19-11ba9e293a82 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:07.388379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306d47-9930-4417-be19-11ba9e293a82 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:07.388742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306d47-9930-4417-be19-11ba9e293a82 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:07.389085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d306d47-9930-4417-be19-11ba9e293a82 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:07.436604 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-4d306d47-9930-4417-be19-11ba9e293a82 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Mar 26 21:06:07.438138 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2467/4985] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:07 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 188 bytes in 76 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Mar 26 21:06:07.442138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb14ff-982d-43b5-89ac-0f5e9e151f8e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:07.451385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb14ff-982d-43b5-89ac-0f5e9e151f8e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:07.455942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270e8d6-6748-406e-805f-289401938d9c tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:07.456837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270e8d6-6748-406e-805f-289401938d9c tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:07.457228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270e8d6-6748-406e-805f-289401938d9c tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:07.457512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270e8d6-6748-406e-805f-289401938d9c tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:07.504766 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d270e8d6-6748-406e-805f-289401938d9c tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Mar 26 21:06:07.506988 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2519/4986] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:07 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 188 bytes in 65 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Mar 26 21:06:07.511410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306d47-9930-4417-be19-11ba9e293a82 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:07.522350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d306d47-9930-4417-be19-11ba9e293a82 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:07.528454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3813074-53ed-47a2-9947-f1ddddb52954 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:07.529551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3813074-53ed-47a2-9947-f1ddddb52954 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:07.530002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3813074-53ed-47a2-9947-f1ddddb52954 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:07.530434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3813074-53ed-47a2-9947-f1ddddb52954 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:07.602852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d3813074-53ed-47a2-9947-f1ddddb52954 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:07.623510 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2468/4987] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:07 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:08.628005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c729153-08e9-4304-845c-5340635e4777 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:08.628576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c729153-08e9-4304-845c-5340635e4777 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:08.628576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c729153-08e9-4304-845c-5340635e4777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:08.662213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1c729153-08e9-4304-845c-5340635e4777 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:08.663689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1c729153-08e9-4304-845c-5340635e4777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:08.673452 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2520/4988] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:08 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:08.678497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28408890-c0af-4f09-8160-33d2e62bf3f4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:08.680019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28408890-c0af-4f09-8160-33d2e62bf3f4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:08.680487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28408890-c0af-4f09-8160-33d2e62bf3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:08.712998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-28408890-c0af-4f09-8160-33d2e62bf3f4 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:08.714461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-28408890-c0af-4f09-8160-33d2e62bf3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:08.742598 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2469/4989] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:08.744860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c729153-08e9-4304-845c-5340635e4777 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:08.772434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c729153-08e9-4304-845c-5340635e4777 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:08.783062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5e8f6-6c2a-44d0-81ff-26c838cbba14 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:08.784096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5e8f6-6c2a-44d0-81ff-26c838cbba14 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:08.784398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5e8f6-6c2a-44d0-81ff-26c838cbba14 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:08.788384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5e8f6-6c2a-44d0-81ff-26c838cbba14 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:08.906121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a7d5e8f6-6c2a-44d0-81ff-26c838cbba14 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:08.921219 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2521/4990] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:08 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:09.926875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e20da-80da-4c6d-beb6-25ab13cc3b53 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:09.927453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e20da-80da-4c6d-beb6-25ab13cc3b53 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:09.927453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e20da-80da-4c6d-beb6-25ab13cc3b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:09.946913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e05e20da-80da-4c6d-beb6-25ab13cc3b53 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:09.948663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e05e20da-80da-4c6d-beb6-25ab13cc3b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:09.957286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f908f6-b327-4e60-8e9e-d542b6c32c54 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:09.958308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f908f6-b327-4e60-8e9e-d542b6c32c54 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:09.958827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f908f6-b327-4e60-8e9e-d542b6c32c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:09.968248 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2470/4991] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:09 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:09.981421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-35f908f6-b327-4e60-8e9e-d542b6c32c54 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:09.982990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-35f908f6-b327-4e60-8e9e-d542b6c32c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:10.010339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e20da-80da-4c6d-beb6-25ab13cc3b53 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:10.012536 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2522/4992] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:10.030738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2900c14-6440-48a7-9057-61350ddaefb6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:10.031022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2900c14-6440-48a7-9057-61350ddaefb6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:10.031300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2900c14-6440-48a7-9057-61350ddaefb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:10.037060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e20da-80da-4c6d-beb6-25ab13cc3b53 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:10.062701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08491f9e-93fc-4e12-8ac5-21aa467cd4b6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:10.064902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08491f9e-93fc-4e12-8ac5-21aa467cd4b6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:10.065271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08491f9e-93fc-4e12-8ac5-21aa467cd4b6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:10.067623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08491f9e-93fc-4e12-8ac5-21aa467cd4b6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:10.077648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f2900c14-6440-48a7-9057-61350ddaefb6 None None] MFA Rules not processed for user `f265820a8b974837949e9e3f36b58858`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:10.081441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f2900c14-6440-48a7-9057-61350ddaefb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:10.181130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-08491f9e-93fc-4e12-8ac5-21aa467cd4b6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:10.202982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2471/4993] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:10 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:10.215353 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2523/4994] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:11.194927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f4b0-1217-4353-b086-8233573117ba None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.195514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f4b0-1217-4353-b086-8233573117ba None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.196301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5f4b0-1217-4353-b086-8233573117ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.208404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a8154-2700-4e03-a62e-54bb889ae1da None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.209523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a8154-2700-4e03-a62e-54bb889ae1da None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.210048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a8154-2700-4e03-a62e-54bb889ae1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.234918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-42c5f4b0-1217-4353-b086-8233573117ba None None] MFA Rules not processed for user `bd919e062b7940c8a48fbf40517cb489`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:11.238655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42c5f4b0-1217-4353-b086-8233573117ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:11.246019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-be5a8154-2700-4e03-a62e-54bb889ae1da None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:11.247740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be5a8154-2700-4e03-a62e-54bb889ae1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:11.260088 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2524/4995] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:11 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:11.261499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fca9a-202a-495c-9dfb-a60b10cce9cd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.261785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fca9a-202a-495c-9dfb-a60b10cce9cd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.262263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fca9a-202a-495c-9dfb-a60b10cce9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.314417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-784fca9a-202a-495c-9dfb-a60b10cce9cd None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:11.317008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-784fca9a-202a-495c-9dfb-a60b10cce9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:11.325762 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2525/4996] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:11.338691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fca9a-202a-495c-9dfb-a60b10cce9cd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:11.358554 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2472/4997] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:11.362937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fca9a-202a-495c-9dfb-a60b10cce9cd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:11.363187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5f4b0-1217-4353-b086-8233573117ba None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:11.365182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42c5f4b0-1217-4353-b086-8233573117ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:11.370496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37362bef-4c4a-4ebe-b726-e48837b52d67 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:11.371597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362bef-4c4a-4ebe-b726-e48837b52d67 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.372092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362bef-4c4a-4ebe-b726-e48837b52d67 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.372542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37362bef-4c4a-4ebe-b726-e48837b52d67 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.457901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-37362bef-4c4a-4ebe-b726-e48837b52d67 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:11.473373 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2526/4998] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:11 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:11.495147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5f4b0-1217-4353-b086-8233573117ba None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:11.501437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f91c2a-3beb-450f-8232-400c8a025d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:11.502106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f91c2a-3beb-450f-8232-400c8a025d96 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.502390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f91c2a-3beb-450f-8232-400c8a025d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.502670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f91c2a-3beb-450f-8232-400c8a025d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.503424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f91c2a-3beb-450f-8232-400c8a025d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:11.506152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f91c2a-3beb-450f-8232-400c8a025d96 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:11.554164 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2473/4999] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:11 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:06:11.558550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37362bef-4c4a-4ebe-b726-e48837b52d67 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:11.573173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37362bef-4c4a-4ebe-b726-e48837b52d67 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:11.671333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208407-2ab7-4e35-a978-612664acf2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:11.672169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208407-2ab7-4e35-a978-612664acf2fd admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.672528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208407-2ab7-4e35-a978-612664acf2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.672882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208407-2ab7-4e35-a978-612664acf2fd admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.674104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17208407-2ab7-4e35-a978-612664acf2fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:11.677557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17208407-2ab7-4e35-a978-612664acf2fd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:11.709415 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2527/5000] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:11 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:11.710673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f91c2a-3beb-450f-8232-400c8a025d96 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:11.724379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f91c2a-3beb-450f-8232-400c8a025d96 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:11.730972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aba08f-3951-4637-af73-ddc5d1b14f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:11.732217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba08f-3951-4637-af73-ddc5d1b14f3d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.732728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba08f-3951-4637-af73-ddc5d1b14f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.733262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aba08f-3951-4637-af73-ddc5d1b14f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.734237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aba08f-3951-4637-af73-ddc5d1b14f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:11.736197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aba08f-3951-4637-af73-ddc5d1b14f3d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:11.750731 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2474/5001] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:11.755697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208407-2ab7-4e35-a978-612664acf2fd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:11.771829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208407-2ab7-4e35-a978-612664acf2fd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:11.790696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f90c5-909f-4a86-a94e-a0856b383a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:11.791786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f90c5-909f-4a86-a94e-a0856b383a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.792190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f90c5-909f-4a86-a94e-a0856b383a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.792570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f90c5-909f-4a86-a94e-a0856b383a2d admin admin] PATH_INFO: `/v3/projects/896bb4fe6e9e47a88b5b0d8a4e2f7bf7/users/d0b5e7bff65746f39b2243a4dd053699/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.820563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f90c5-909f-4a86-a94e-a0856b383a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=896bb4fe6e9e47a88b5b0d8a4e2f7bf7, user_id=d0b5e7bff65746f39b2243a4dd053699, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:11.823643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f90c5-909f-4a86-a94e-a0856b383a2d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:11.843850 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2528/5002] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:11 2022] PUT /identity/v3/projects/896bb4fe6e9e47a88b5b0d8a4e2f7bf7/users/d0b5e7bff65746f39b2243a4dd053699/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:11.848534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aba08f-3951-4637-af73-ddc5d1b14f3d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:11.864892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aba08f-3951-4637-af73-ddc5d1b14f3d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:11.943197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08309007-d397-49ba-a49c-e8819030fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:11.944259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08309007-d397-49ba-a49c-e8819030fc6b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.944546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08309007-d397-49ba-a49c-e8819030fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.944824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08309007-d397-49ba-a49c-e8819030fc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.945596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08309007-d397-49ba-a49c-e8819030fc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:11.948200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08309007-d397-49ba-a49c-e8819030fc6b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:11.960001 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2475/5003] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:11.964606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f90c5-909f-4a86-a94e-a0856b383a2d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:11.981124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f90c5-909f-4a86-a94e-a0856b383a2d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:11.986466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69044bb-3e9a-45aa-b306-f29dafadd739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:11.987756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69044bb-3e9a-45aa-b306-f29dafadd739 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:11.988068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69044bb-3e9a-45aa-b306-f29dafadd739 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:11.988538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69044bb-3e9a-45aa-b306-f29dafadd739 admin admin] PATH_INFO: `/v3/projects/896bb4fe6e9e47a88b5b0d8a4e2f7bf7/users/d0b5e7bff65746f39b2243a4dd053699/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:11.991628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69044bb-3e9a-45aa-b306-f29dafadd739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896bb4fe6e9e47a88b5b0d8a4e2f7bf7, user_id=d0b5e7bff65746f39b2243a4dd053699, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:11.995783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69044bb-3e9a-45aa-b306-f29dafadd739 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:12.009030 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2529/5004] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:11 2022] PUT /identity/v3/projects/896bb4fe6e9e47a88b5b0d8a4e2f7bf7/users/d0b5e7bff65746f39b2243a4dd053699/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:12.478529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d69679-2fa4-4757-be57-2f2967627b5c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:12.479116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d69679-2fa4-4757-be57-2f2967627b5c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:12.479631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d69679-2fa4-4757-be57-2f2967627b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:12.502748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c7d69679-2fa4-4757-be57-2f2967627b5c None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:12.510459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c7d69679-2fa4-4757-be57-2f2967627b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:12.517556 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2476/5005] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:12 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:13.521982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f50b0-2ccc-4591-8e5a-aee068facb21 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:13.522499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f50b0-2ccc-4591-8e5a-aee068facb21 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:13.522772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f50b0-2ccc-4591-8e5a-aee068facb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:13.553309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b97f50b0-2ccc-4591-8e5a-aee068facb21 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:13.555491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b97f50b0-2ccc-4591-8e5a-aee068facb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:13.642773 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2530/5006] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:13.653578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae5c6f-abd0-4f29-b063-050943165b18 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:13.654430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae5c6f-abd0-4f29-b063-050943165b18 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:13.654946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae5c6f-abd0-4f29-b063-050943165b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:13.685085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-27ae5c6f-abd0-4f29-b063-050943165b18 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:13.686893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-27ae5c6f-abd0-4f29-b063-050943165b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:13.697809 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2477/5007] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:13 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:13.699425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844facc-aaeb-457d-ba07-ea22c99fcbc8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:13.700021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844facc-aaeb-457d-ba07-ea22c99fcbc8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:13.700269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844facc-aaeb-457d-ba07-ea22c99fcbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:13.891095 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-e844facc-aaeb-457d-ba07-ea22c99fcbc8 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Mar 26 21:06:13.896032 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2531/5008] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:13 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 195 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Mar 26 21:06:13.898240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422a885-32cc-4983-a273-f6c58fdaaf36 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:13.899468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422a885-32cc-4983-a273-f6c58fdaaf36 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:13.899983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422a885-32cc-4983-a273-f6c58fdaaf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:13.973424 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b422a885-32cc-4983-a273-f6c58fdaaf36 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Mar 26 21:06:13.974924 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2478/5009] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:13 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 78 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Mar 26 21:06:13.979798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0187ee-4ddc-4a3e-a08c-4858d12258ec None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:13.983942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0187ee-4ddc-4a3e-a08c-4858d12258ec None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:13.984461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0187ee-4ddc-4a3e-a08c-4858d12258ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:14.016437 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-0c0187ee-4ddc-4a3e-a08c-4858d12258ec None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Mar 26 21:06:14.018063 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2532/5010] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:13 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 39 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Mar 26 21:06:20.023251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d8fa-ada1-4aa9-83ea-8ef1f2c46491 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:20.023857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d8fa-ada1-4aa9-83ea-8ef1f2c46491 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:20.023857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76d8fa-ada1-4aa9-83ea-8ef1f2c46491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:20.102552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ff76d8fa-ada1-4aa9-83ea-8ef1f2c46491 None None] MFA Rules not processed for user `d0b5e7bff65746f39b2243a4dd053699`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:20.108347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ff76d8fa-ada1-4aa9-83ea-8ef1f2c46491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:20.221604 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2479/5011] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:20.330080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0187ee-4ddc-4a3e-a08c-4858d12258ec None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:20.332057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0c0187ee-4ddc-4a3e-a08c-4858d12258ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:20.484096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0187ee-4ddc-4a3e-a08c-4858d12258ec None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:20.490824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dcd2d-2ce1-429c-9264-60aeb37733e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:20.503437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dcd2d-2ce1-429c-9264-60aeb37733e1 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:20.504374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dcd2d-2ce1-429c-9264-60aeb37733e1 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:20.507036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6dcd2d-2ce1-429c-9264-60aeb37733e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:20.520801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dcd2d-2ce1-429c-9264-60aeb37733e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:20.522828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6dcd2d-2ce1-429c-9264-60aeb37733e1 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:20.543369 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2533/5012] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:20.855707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d8fa-ada1-4aa9-83ea-8ef1f2c46491 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:20.857743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ff76d8fa-ada1-4aa9-83ea-8ef1f2c46491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:20.956523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76d8fa-ada1-4aa9-83ea-8ef1f2c46491 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:20.964350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede844d6-df8d-4b50-9030-0d63eebc939d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:20.965111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede844d6-df8d-4b50-9030-0d63eebc939d service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:20.965397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede844d6-df8d-4b50-9030-0d63eebc939d service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:20.965683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede844d6-df8d-4b50-9030-0d63eebc939d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:20.970908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ede844d6-df8d-4b50-9030-0d63eebc939d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:20.985519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede844d6-df8d-4b50-9030-0d63eebc939d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:20.987604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede844d6-df8d-4b50-9030-0d63eebc939d service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:20.998956 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2480/5013] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:21.316530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dcd2d-2ce1-429c-9264-60aeb37733e1 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:21.319341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ad6dcd2d-2ce1-429c-9264-60aeb37733e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:21.353430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6dcd2d-2ce1-429c-9264-60aeb37733e1 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:21.361811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab811a-30ca-4202-bbc5-3d4c250031ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:21.362543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab811a-30ca-4202-bbc5-3d4c250031ae service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:21.362871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab811a-30ca-4202-bbc5-3d4c250031ae service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:21.363773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab811a-30ca-4202-bbc5-3d4c250031ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:21.366803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e7ab811a-30ca-4202-bbc5-3d4c250031ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:21.386769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab811a-30ca-4202-bbc5-3d4c250031ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:21.388465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab811a-30ca-4202-bbc5-3d4c250031ae service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:21.403515 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2534/5014] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:25.038542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870144c3-f07c-4e80-861f-40964a098ad6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:25.039552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870144c3-f07c-4e80-861f-40964a098ad6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:25.039552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870144c3-f07c-4e80-861f-40964a098ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:25.206237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-870144c3-f07c-4e80-861f-40964a098ad6 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:25.210903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-870144c3-f07c-4e80-861f-40964a098ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:25.221532 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2481/5015] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:25 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:25.227542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab811a-30ca-4202-bbc5-3d4c250031ae service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:25.247103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab811a-30ca-4202-bbc5-3d4c250031ae service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:25.260992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d9e36-3591-497a-9658-a7233358df5b tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:25.261887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d9e36-3591-497a-9658-a7233358df5b tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:25.262160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d9e36-3591-497a-9658-a7233358df5b tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:25.262436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d9e36-3591-497a-9658-a7233358df5b tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:25.365407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fa8d9e36-3591-497a-9658-a7233358df5b tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:25.401723 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2535/5016] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:25 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:26.411940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b063cf-385d-4198-9758-31f58a22548e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:26.413608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b063cf-385d-4198-9758-31f58a22548e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:26.414744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b063cf-385d-4198-9758-31f58a22548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:26.459308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f5b063cf-385d-4198-9758-31f58a22548e None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:26.462849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f5b063cf-385d-4198-9758-31f58a22548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:26.468295 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2482/5017] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:26 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:26.472446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d5d2b-45b4-4909-bb35-53ed42c64df0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:26.473062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d5d2b-45b4-4909-bb35-53ed42c64df0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:26.473762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d5d2b-45b4-4909-bb35-53ed42c64df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:26.497990 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-1f6d5d2b-45b4-4909-bb35-53ed42c64df0 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Mar 26 21:06:26.499798 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2536/5018] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:26 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 21:06:26.506253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39407eb4-0223-45b3-9c32-bd028d1d51a6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:26.508955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39407eb4-0223-45b3-9c32-bd028d1d51a6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:26.509576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39407eb4-0223-45b3-9c32-bd028d1d51a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:26.605330 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-39407eb4-0223-45b3-9c32-bd028d1d51a6 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Mar 26 21:06:26.610475 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2483/5019] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:26 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 107 msecs (HTTP/1.1 401) 6 headers in 252 bytes (2 switches on core 0) Mar 26 21:06:26.613314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef1d9d-d420-428e-87d9-569f1dd7f6f5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:26.614886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef1d9d-d420-428e-87d9-569f1dd7f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:26.615352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef1d9d-d420-428e-87d9-569f1dd7f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:26.680526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-73ef1d9d-d420-428e-87d9-569f1dd7f6f5 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:26.682013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-73ef1d9d-d420-428e-87d9-569f1dd7f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:26.700459 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2537/5020] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:26.704762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39407eb4-0223-45b3-9c32-bd028d1d51a6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:26.731433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39407eb4-0223-45b3-9c32-bd028d1d51a6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:26.748183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe8888-14f1-42cf-9e75-b6bf19fb1eb6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:26.750204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe8888-14f1-42cf-9e75-b6bf19fb1eb6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:26.751356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe8888-14f1-42cf-9e75-b6bf19fb1eb6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:26.751816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe8888-14f1-42cf-9e75-b6bf19fb1eb6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:26.840315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3fe8888-14f1-42cf-9e75-b6bf19fb1eb6 tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:26.856973 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2484/5021] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:26 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:06:27.862776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ace1-0f65-428d-90ce-40bb29bc83d1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:27.863689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ace1-0f65-428d-90ce-40bb29bc83d1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:27.864194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ace1-0f65-428d-90ce-40bb29bc83d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:27.925811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a470ace1-0f65-428d-90ce-40bb29bc83d1 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:27.933537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a470ace1-0f65-428d-90ce-40bb29bc83d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:27.946347 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2538/5022] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:27 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:27.950836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15e704-8119-4548-9110-cfc8ab4212a1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:27.951329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15e704-8119-4548-9110-cfc8ab4212a1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:27.951629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15e704-8119-4548-9110-cfc8ab4212a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:27.994720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-be15e704-8119-4548-9110-cfc8ab4212a1 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:28.000497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be15e704-8119-4548-9110-cfc8ab4212a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:28.026627 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2485/5023] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:28.031644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ace1-0f65-428d-90ce-40bb29bc83d1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:28.061400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ace1-0f65-428d-90ce-40bb29bc83d1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:28.073553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99d691-4206-4f7d-bf5a-26a92461daad tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:28.076690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99d691-4206-4f7d-bf5a-26a92461daad tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:28.077035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99d691-4206-4f7d-bf5a-26a92461daad tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:28.077387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99d691-4206-4f7d-bf5a-26a92461daad tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:28.186835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd99d691-4206-4f7d-bf5a-26a92461daad tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:28.209951 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2539/5024] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:28 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:29.217155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8343c-89fe-4c9d-aec4-d88a43b6fe73 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:29.217938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8343c-89fe-4c9d-aec4-d88a43b6fe73 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:29.217938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8343c-89fe-4c9d-aec4-d88a43b6fe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:29.253186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bce8343c-89fe-4c9d-aec4-d88a43b6fe73 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:29.254779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bce8343c-89fe-4c9d-aec4-d88a43b6fe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:29.265290 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2486/5025] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:29 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:29.270393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b26a-8e00-4aea-87bf-9ab35349cdf2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:29.271328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b26a-8e00-4aea-87bf-9ab35349cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:29.271854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa7b26a-8e00-4aea-87bf-9ab35349cdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:29.321016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-baa7b26a-8e00-4aea-87bf-9ab35349cdf2 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:29.334617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-baa7b26a-8e00-4aea-87bf-9ab35349cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:29.347440 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2540/5026] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:29.351688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8343c-89fe-4c9d-aec4-d88a43b6fe73 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:29.370648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8343c-89fe-4c9d-aec4-d88a43b6fe73 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:29.377167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40112ff9-06a4-4ca8-80a8-d150f1fb2bae tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '79d98a99891e43e7b3c6db7173003d15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4589b33ca534c89a7002eb4fc740dca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:29.378082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40112ff9-06a4-4ca8-80a8-d150f1fb2bae tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:29.378370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40112ff9-06a4-4ca8-80a8-d150f1fb2bae tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:29.378647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40112ff9-06a4-4ca8-80a8-d150f1fb2bae tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15/password` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:29.489073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-40112ff9-06a4-4ca8-80a8-d150f1fb2bae tempest-IdentityV3UsersTest-1878975829 tempest-IdentityV3UsersTest-1878975829-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:29.510766 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2487/5027] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:06:29 2022] POST /identity/v3/users/79d98a99891e43e7b3c6db7173003d15/password => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:06:30.516461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adaea-af34-4d8b-8e66-bb55c5db2072 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:30.517548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adaea-af34-4d8b-8e66-bb55c5db2072 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:30.518004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2adaea-af34-4d8b-8e66-bb55c5db2072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:30.560981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bc2adaea-af34-4d8b-8e66-bb55c5db2072 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:30.562542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bc2adaea-af34-4d8b-8e66-bb55c5db2072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:30.568951 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2541/5028] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:30 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:06:31.575221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96739e-373a-4731-8b01-e0adab704924 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:31.576440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96739e-373a-4731-8b01-e0adab704924 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:31.577017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96739e-373a-4731-8b01-e0adab704924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:31.606540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ed96739e-373a-4731-8b01-e0adab704924 None None] MFA Rules not processed for user `79d98a99891e43e7b3c6db7173003d15`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:31.608088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ed96739e-373a-4731-8b01-e0adab704924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:31.617339 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2488/5029] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:31.622991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2adaea-af34-4d8b-8e66-bb55c5db2072 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:31.777446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2adaea-af34-4d8b-8e66-bb55c5db2072 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:31.790198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:31.792061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:31.793415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:31.794314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] PATH_INFO: `/v3/users/79d98a99891e43e7b3c6db7173003d15` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:31.797053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79d98a99891e43e7b3c6db7173003d15)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:31.802529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:31.908576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:31.925718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:31.926909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:31.928283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:31.942383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79d98a99891e43e7b3c6db7173003d15'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:31.973314 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2542/5030] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:31 2022] DELETE /identity/v3/users/79d98a99891e43e7b3c6db7173003d15 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:31.975096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79cfb-f4e8-4513-b86f-e155b45a22c0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:31.975443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79cfb-f4e8-4513-b86f-e155b45a22c0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:31.976190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf79cfb-f4e8-4513-b86f-e155b45a22c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:32.002228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4cf79cfb-f4e8-4513-b86f-e155b45a22c0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:32.004510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4cf79cfb-f4e8-4513-b86f-e155b45a22c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:32.103798 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2489/5031] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:32.122951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:32.124592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:32.272074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab60d39f-516d-424c-903b-f83c4979b347 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:32.277624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d057c-3fdd-4c02-b37e-468941e9e4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:32.279187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d057c-3fdd-4c02-b37e-468941e9e4da service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:32.279589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d057c-3fdd-4c02-b37e-468941e9e4da service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:32.280020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d057c-3fdd-4c02-b37e-468941e9e4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:32.291361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d057c-3fdd-4c02-b37e-468941e9e4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:32.293359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d057c-3fdd-4c02-b37e-468941e9e4da service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:32.305405 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2543/5032] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:33.951350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf79cfb-f4e8-4513-b86f-e155b45a22c0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:33.955562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4cf79cfb-f4e8-4513-b86f-e155b45a22c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:33.979400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf79cfb-f4e8-4513-b86f-e155b45a22c0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:33.988421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:33.990409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:33.994922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:33.995499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] PATH_INFO: `/v3/projects/d4589b33ca534c89a7002eb4fc740dca` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:33.998571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4589b33ca534c89a7002eb4fc740dca)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:34.001108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:34.090487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4589b33ca534c89a7002eb4fc740dca', 'request_id': 'req-51d1df1d-f81e-4c07-9e40-5d9db42433c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:34.100875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4589b33ca534c89a7002eb4fc740dca', 'request_id': 'req-51d1df1d-f81e-4c07-9e40-5d9db42433c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:34.115013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4589b33ca534c89a7002eb4fc740dca', 'request_id': 'req-51d1df1d-f81e-4c07-9e40-5d9db42433c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:34.142770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] The token cache is being invalidate because project d4589b33ca534c89a7002eb4fc740dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:34.143073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:34.143752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51d1df1d-f81e-4c07-9e40-5d9db42433c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:34.145341 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2490/5033] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:33 2022] DELETE /identity/v3/projects/d4589b33ca534c89a7002eb4fc740dca => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:34.151430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad62c9-b582-4c71-a50c-d20498c518ab None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:34.152403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad62c9-b582-4c71-a50c-d20498c518ab None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:34.152687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad62c9-b582-4c71-a50c-d20498c518ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:34.192359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-90ad62c9-b582-4c71-a50c-d20498c518ab None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:34.193584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-90ad62c9-b582-4c71-a50c-d20498c518ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:34.324389 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2544/5034] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:34.336537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9930f7e-4b77-4fe3-b678-0b0a7c257045 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:34.337275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9930f7e-4b77-4fe3-b678-0b0a7c257045 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:34.337275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9930f7e-4b77-4fe3-b678-0b0a7c257045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:34.378596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f9930f7e-4b77-4fe3-b678-0b0a7c257045 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:34.386309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f9930f7e-4b77-4fe3-b678-0b0a7c257045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:34.406901 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2491/5035] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:34.411538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad62c9-b582-4c71-a50c-d20498c518ab None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:34.426965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad62c9-b582-4c71-a50c-d20498c518ab None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:34.441750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dc56d-7e05-4a09-b3bd-a0dd5dec64ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:34.442692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dc56d-7e05-4a09-b3bd-a0dd5dec64ac admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:34.442975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dc56d-7e05-4a09-b3bd-a0dd5dec64ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:34.443253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6dc56d-7e05-4a09-b3bd-a0dd5dec64ac admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:34.446322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dc56d-7e05-4a09-b3bd-a0dd5dec64ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:06:34.447459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dc56d-7e05-4a09-b3bd-a0dd5dec64ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:34.449334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6dc56d-7e05-4a09-b3bd-a0dd5dec64ac admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:34.478054 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2545/5036] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:06:34.482625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9930f7e-4b77-4fe3-b678-0b0a7c257045 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:34.493243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9930f7e-4b77-4fe3-b678-0b0a7c257045 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:34.499783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ce0c1-b6b6-4296-bfe9-157fdeae94cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:34.500542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ce0c1-b6b6-4296-bfe9-157fdeae94cc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:34.501115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ce0c1-b6b6-4296-bfe9-157fdeae94cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:34.501224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ce0c1-b6b6-4296-bfe9-157fdeae94cc admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:34.502019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ce0c1-b6b6-4296-bfe9-157fdeae94cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:34.504627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ce0c1-b6b6-4296-bfe9-157fdeae94cc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:34.551032 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2492/5037] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:34 2022] POST /identity/v3/projects => generated 395 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:34.552639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dc56d-7e05-4a09-b3bd-a0dd5dec64ac admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:34.577271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6dc56d-7e05-4a09-b3bd-a0dd5dec64ac admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:34.653522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375406b3-f5dd-4a5a-bcf3-c757e26aa99e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:34.654015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375406b3-f5dd-4a5a-bcf3-c757e26aa99e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:34.654366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375406b3-f5dd-4a5a-bcf3-c757e26aa99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:34.722397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-375406b3-f5dd-4a5a-bcf3-c757e26aa99e None None] MFA Rules not processed for user `321431f1b82447d28c58e7d03fd20515`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:34.729158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-375406b3-f5dd-4a5a-bcf3-c757e26aa99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:34.737210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3750-af1c-45b1-8b59-c9e9a09082b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:34.738034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3750-af1c-45b1-8b59-c9e9a09082b1 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:34.738288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3750-af1c-45b1-8b59-c9e9a09082b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:34.739230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac3750-af1c-45b1-8b59-c9e9a09082b1 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:34.744531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac3750-af1c-45b1-8b59-c9e9a09082b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:34.747730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac3750-af1c-45b1-8b59-c9e9a09082b1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:34.811067 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2546/5038] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:34 2022] POST /identity/v3/users => generated 304 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:06:34.816345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3750-af1c-45b1-8b59-c9e9a09082b1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:34.905911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac3750-af1c-45b1-8b59-c9e9a09082b1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:34.933242 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2493/5039] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:34.937759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e6f7d-66dc-4d7f-815f-6490c978d686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:34.938840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e6f7d-66dc-4d7f-815f-6490c978d686 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:34.943234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e6f7d-66dc-4d7f-815f-6490c978d686 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:34.943590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e6f7d-66dc-4d7f-815f-6490c978d686 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:34.944410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e6f7d-66dc-4d7f-815f-6490c978d686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:34.949655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e6f7d-66dc-4d7f-815f-6490c978d686 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:34.985209 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2547/5040] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:34.989703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375406b3-f5dd-4a5a-bcf3-c757e26aa99e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:35.008584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375406b3-f5dd-4a5a-bcf3-c757e26aa99e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:35.026476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc2e4c-18e9-418c-bc3a-88db4dcf08d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:35.030495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc2e4c-18e9-418c-bc3a-88db4dcf08d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:35.030787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc2e4c-18e9-418c-bc3a-88db4dcf08d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:35.031068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc2e4c-18e9-418c-bc3a-88db4dcf08d8 admin admin] PATH_INFO: `/v3/projects/b971ac0103d74ad39a84fe9e299f9a9e/users/b48feadc6474453e8b4501077b9b1ac1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:35.069693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc2e4c-18e9-418c-bc3a-88db4dcf08d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971ac0103d74ad39a84fe9e299f9a9e, user_id=b48feadc6474453e8b4501077b9b1ac1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:35.073431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc2e4c-18e9-418c-bc3a-88db4dcf08d8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:35.104244 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2494/5041] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:34 2022] PUT /identity/v3/projects/b971ac0103d74ad39a84fe9e299f9a9e/users/b48feadc6474453e8b4501077b9b1ac1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:35.106960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e6f7d-66dc-4d7f-815f-6490c978d686 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:35.118465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e6f7d-66dc-4d7f-815f-6490c978d686 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:35.259845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa80bf-26a8-4104-bc4a-fb6b841769e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:35.261346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa80bf-26a8-4104-bc4a-fb6b841769e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:35.261806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa80bf-26a8-4104-bc4a-fb6b841769e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:35.262245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa80bf-26a8-4104-bc4a-fb6b841769e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:35.263156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa80bf-26a8-4104-bc4a-fb6b841769e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:35.265015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa80bf-26a8-4104-bc4a-fb6b841769e9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:35.276381 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2548/5042] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:35.285289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc2e4c-18e9-418c-bc3a-88db4dcf08d8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:35.298713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc2e4c-18e9-418c-bc3a-88db4dcf08d8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:35.305087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43031cea-7412-47e1-b24c-2726ae0cb63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:35.306489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031cea-7412-47e1-b24c-2726ae0cb63b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:35.307129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031cea-7412-47e1-b24c-2726ae0cb63b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:35.307579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031cea-7412-47e1-b24c-2726ae0cb63b admin admin] PATH_INFO: `/v3/projects/b971ac0103d74ad39a84fe9e299f9a9e/users/b48feadc6474453e8b4501077b9b1ac1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:35.310029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43031cea-7412-47e1-b24c-2726ae0cb63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b971ac0103d74ad39a84fe9e299f9a9e, user_id=b48feadc6474453e8b4501077b9b1ac1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:35.313205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43031cea-7412-47e1-b24c-2726ae0cb63b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:35.344025 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2495/5043] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:35 2022] PUT /identity/v3/projects/b971ac0103d74ad39a84fe9e299f9a9e/users/b48feadc6474453e8b4501077b9b1ac1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:35.346395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82d33c-05ea-4ab4-b8c3-4135c6993a6b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:35.346706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82d33c-05ea-4ab4-b8c3-4135c6993a6b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:35.347018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d82d33c-05ea-4ab4-b8c3-4135c6993a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:35.423116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0d82d33c-05ea-4ab4-b8c3-4135c6993a6b None None] MFA Rules not processed for user `b48feadc6474453e8b4501077b9b1ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:35.426047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0d82d33c-05ea-4ab4-b8c3-4135c6993a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:35.559697 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2549/5044] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:35.564224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43031cea-7412-47e1-b24c-2726ae0cb63b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:35.672584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43031cea-7412-47e1-b24c-2726ae0cb63b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:35.684873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0ecd-ceca-4426-8e9d-7fa7c2832d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:35.685671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0ecd-ceca-4426-8e9d-7fa7c2832d97 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:35.686229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0ecd-ceca-4426-8e9d-7fa7c2832d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:35.686578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0ecd-ceca-4426-8e9d-7fa7c2832d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:35.687393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c0ecd-ceca-4426-8e9d-7fa7c2832d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:35.692613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c0ecd-ceca-4426-8e9d-7fa7c2832d97 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:35.751888 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2496/5045] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:35 2022] POST /identity/v3/projects => generated 395 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:35.755616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82d33c-05ea-4ab4-b8c3-4135c6993a6b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:35.770654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d82d33c-05ea-4ab4-b8c3-4135c6993a6b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:35.868227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af7960-45b8-4c37-80be-4ba174669237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:35.869350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af7960-45b8-4c37-80be-4ba174669237 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:35.869814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af7960-45b8-4c37-80be-4ba174669237 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:35.870354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af7960-45b8-4c37-80be-4ba174669237 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:35.871322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af7960-45b8-4c37-80be-4ba174669237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:35.874436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af7960-45b8-4c37-80be-4ba174669237 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:35.912166 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2550/5046] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:35 2022] POST /identity/v3/users => generated 298 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:06:35.916565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0ecd-ceca-4426-8e9d-7fa7c2832d97 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:35.948635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0ecd-ceca-4426-8e9d-7fa7c2832d97 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:35.977310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062c15-db60-4210-853d-2aa2e9c73de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:35.978405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062c15-db60-4210-853d-2aa2e9c73de0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:35.978693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062c15-db60-4210-853d-2aa2e9c73de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:35.979257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2062c15-db60-4210-853d-2aa2e9c73de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:35.980252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062c15-db60-4210-853d-2aa2e9c73de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:35.985308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2062c15-db60-4210-853d-2aa2e9c73de0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:36.004606 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2497/5047] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:36.015074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af7960-45b8-4c37-80be-4ba174669237 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:36.036881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af7960-45b8-4c37-80be-4ba174669237 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:36.045809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef56bc9-d650-41bf-878e-229ab487e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:36.046521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef56bc9-d650-41bf-878e-229ab487e415 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:36.046817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef56bc9-d650-41bf-878e-229ab487e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:36.047096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef56bc9-d650-41bf-878e-229ab487e415 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:36.047870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef56bc9-d650-41bf-878e-229ab487e415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:36.049825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef56bc9-d650-41bf-878e-229ab487e415 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:36.089792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2551/5048] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:36.093215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062c15-db60-4210-853d-2aa2e9c73de0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:36.118327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2062c15-db60-4210-853d-2aa2e9c73de0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:36.125265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901473-bbf4-4f8f-ac1b-e21e5f49c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:36.126315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901473-bbf4-4f8f-ac1b-e21e5f49c15a admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:36.126602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901473-bbf4-4f8f-ac1b-e21e5f49c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:36.126875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901473-bbf4-4f8f-ac1b-e21e5f49c15a admin admin] PATH_INFO: `/v3/projects/f0afed9cf82248e18ebbef38b1d8a56d/users/85a1bdc0886d424dbb9ee61f29647e89/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:36.152883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901473-bbf4-4f8f-ac1b-e21e5f49c15a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0afed9cf82248e18ebbef38b1d8a56d, user_id=85a1bdc0886d424dbb9ee61f29647e89, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:36.157511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901473-bbf4-4f8f-ac1b-e21e5f49c15a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:36.187582 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2498/5049] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:36 2022] PUT /identity/v3/projects/f0afed9cf82248e18ebbef38b1d8a56d/users/85a1bdc0886d424dbb9ee61f29647e89/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:36.198540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093691-6d5a-41af-a1f4-2a741a137bc9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:36.198920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093691-6d5a-41af-a1f4-2a741a137bc9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:36.199638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34093691-6d5a-41af-a1f4-2a741a137bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:36.248567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-34093691-6d5a-41af-a1f4-2a741a137bc9 None None] MFA Rules not processed for user `85a1bdc0886d424dbb9ee61f29647e89`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:36.250585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-34093691-6d5a-41af-a1f4-2a741a137bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:36.342986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2552/5050] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:36.350600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901473-bbf4-4f8f-ac1b-e21e5f49c15a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:36.352926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-38901473-bbf4-4f8f-ac1b-e21e5f49c15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:36.505829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901473-bbf4-4f8f-ac1b-e21e5f49c15a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:36.512761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d257a-348d-47aa-a23b-5444a348df1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:36.514699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d257a-348d-47aa-a23b-5444a348df1f service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:36.515010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d257a-348d-47aa-a23b-5444a348df1f service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:36.515395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d257a-348d-47aa-a23b-5444a348df1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:36.599593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d257a-348d-47aa-a23b-5444a348df1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:36.601915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d257a-348d-47aa-a23b-5444a348df1f service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:36.617007 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2499/5051] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:36 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:37.129665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34093691-6d5a-41af-a1f4-2a741a137bc9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:37.218359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34093691-6d5a-41af-a1f4-2a741a137bc9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:37.224138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:37.226226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:37.226687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:37.227276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] PATH_INFO: `/v3/users/b48feadc6474453e8b4501077b9b1ac1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:37.229143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48feadc6474453e8b4501077b9b1ac1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:37.232773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:37.310596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48feadc6474453e8b4501077b9b1ac1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:37.324841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48feadc6474453e8b4501077b9b1ac1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:37.326236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48feadc6474453e8b4501077b9b1ac1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:37.327055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48feadc6474453e8b4501077b9b1ac1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:37.341641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48feadc6474453e8b4501077b9b1ac1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:37.370112 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2553/5052] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:37 2022] DELETE /identity/v3/users/b48feadc6474453e8b4501077b9b1ac1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:37.374801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7926-bd38-4949-89d8-290cc5c962cf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:37.375252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7926-bd38-4949-89d8-290cc5c962cf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:37.375383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a7926-bd38-4949-89d8-290cc5c962cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:37.399777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9c0a7926-bd38-4949-89d8-290cc5c962cf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:37.401288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9c0a7926-bd38-4949-89d8-290cc5c962cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:37.468143 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2500/5053] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:37.515740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:37.517513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:37.615304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7135f-6b8e-45ee-b271-53f1de8c1abb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:37.622201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad16f59-9f97-439f-ac7b-e1a0164b776b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:37.622876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad16f59-9f97-439f-ac7b-e1a0164b776b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:37.623166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad16f59-9f97-439f-ac7b-e1a0164b776b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:37.623445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad16f59-9f97-439f-ac7b-e1a0164b776b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:37.639482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad16f59-9f97-439f-ac7b-e1a0164b776b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:37.642139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad16f59-9f97-439f-ac7b-e1a0164b776b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:37.661606 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2554/5054] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:38.690289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a7926-bd38-4949-89d8-290cc5c962cf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:38.693688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9c0a7926-bd38-4949-89d8-290cc5c962cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:38.725482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a7926-bd38-4949-89d8-290cc5c962cf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:38.768268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:38.773146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:38.776820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:38.777165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] PATH_INFO: `/v3/projects/b971ac0103d74ad39a84fe9e299f9a9e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:38.784292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b971ac0103d74ad39a84fe9e299f9a9e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:38.788624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:38.921039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b971ac0103d74ad39a84fe9e299f9a9e', 'request_id': 'req-b3393df4-80ff-4c35-ab73-ab2087ce95ed'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:38.940266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b971ac0103d74ad39a84fe9e299f9a9e', 'request_id': 'req-b3393df4-80ff-4c35-ab73-ab2087ce95ed'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:38.992354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b971ac0103d74ad39a84fe9e299f9a9e', 'request_id': 'req-b3393df4-80ff-4c35-ab73-ab2087ce95ed'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:39.062472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] The token cache is being invalidate because project b971ac0103d74ad39a84fe9e299f9a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:39.062920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:39.067218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:39.070667 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2501/5055] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:38 2022] DELETE /identity/v3/projects/b971ac0103d74ad39a84fe9e299f9a9e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:39.074962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad16f59-9f97-439f-ac7b-e1a0164b776b service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:39.088876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad16f59-9f97-439f-ac7b-e1a0164b776b service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:39.186794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:39.186794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:39.186794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:39.186794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] PATH_INFO: `/v3/users/85a1bdc0886d424dbb9ee61f29647e89` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:39.187281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a1bdc0886d424dbb9ee61f29647e89)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:39.191005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:39.339249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a1bdc0886d424dbb9ee61f29647e89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:39.361616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a1bdc0886d424dbb9ee61f29647e89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:39.364879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a1bdc0886d424dbb9ee61f29647e89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:39.365538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a1bdc0886d424dbb9ee61f29647e89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:39.382565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1abb418f-7aa4-437d-bd36-f78dac61418e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a1bdc0886d424dbb9ee61f29647e89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:39.423757 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2555/5056] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:39 2022] DELETE /identity/v3/users/85a1bdc0886d424dbb9ee61f29647e89 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:40.198766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:40.201215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:40.234195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3393df4-80ff-4c35-ab73-ab2087ce95ed admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:40.430648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:40.431544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:40.431890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:40.432277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] PATH_INFO: `/v3/projects/f0afed9cf82248e18ebbef38b1d8a56d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:40.434050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0afed9cf82248e18ebbef38b1d8a56d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:40.437181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:40.564711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0afed9cf82248e18ebbef38b1d8a56d', 'request_id': 'req-882f0edf-80c6-466c-b43d-bc18eddf42fa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:40.581710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0afed9cf82248e18ebbef38b1d8a56d', 'request_id': 'req-882f0edf-80c6-466c-b43d-bc18eddf42fa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:40.596613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0afed9cf82248e18ebbef38b1d8a56d', 'request_id': 'req-882f0edf-80c6-466c-b43d-bc18eddf42fa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:40.634554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] The token cache is being invalidate because project f0afed9cf82248e18ebbef38b1d8a56d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:40.634934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:40.636737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-882f0edf-80c6-466c-b43d-bc18eddf42fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:40.644446 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2502/5057] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:40 2022] DELETE /identity/v3/projects/f0afed9cf82248e18ebbef38b1d8a56d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:40.646474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7be8d6-175f-499d-b1c7-321a622b9187 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:40.646931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7be8d6-175f-499d-b1c7-321a622b9187 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:40.647023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7be8d6-175f-499d-b1c7-321a622b9187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:40.694366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4b7be8d6-175f-499d-b1c7-321a622b9187 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:40.703123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4b7be8d6-175f-499d-b1c7-321a622b9187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:40.924694 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2556/5058] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:40.938960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5cb4c-1ffb-430c-a77e-33b1af05a82d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:40.939613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5cb4c-1ffb-430c-a77e-33b1af05a82d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:40.940651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5cb4c-1ffb-430c-a77e-33b1af05a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:40.979541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-03c5cb4c-1ffb-430c-a77e-33b1af05a82d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:40.980891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-03c5cb4c-1ffb-430c-a77e-33b1af05a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:41.002210 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2503/5059] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:41.006436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7be8d6-175f-499d-b1c7-321a622b9187 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:41.021464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7be8d6-175f-499d-b1c7-321a622b9187 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:41.035723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e66cb1-adf1-41f9-a8fa-6948c5f91687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:41.037841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e66cb1-adf1-41f9-a8fa-6948c5f91687 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:41.038874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e66cb1-adf1-41f9-a8fa-6948c5f91687 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:41.039349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e66cb1-adf1-41f9-a8fa-6948c5f91687 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:41.040325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e66cb1-adf1-41f9-a8fa-6948c5f91687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:06:41.040959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e66cb1-adf1-41f9-a8fa-6948c5f91687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:41.042943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e66cb1-adf1-41f9-a8fa-6948c5f91687 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:41.080045 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2557/5060] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:06:41.084081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5cb4c-1ffb-430c-a77e-33b1af05a82d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:41.100355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5cb4c-1ffb-430c-a77e-33b1af05a82d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:41.115295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc2dfd-416e-483b-837e-5c54a83c4d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:41.116014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc2dfd-416e-483b-837e-5c54a83c4d70 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:41.116340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc2dfd-416e-483b-837e-5c54a83c4d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:41.116618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc2dfd-416e-483b-837e-5c54a83c4d70 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:41.117336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc2dfd-416e-483b-837e-5c54a83c4d70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:41.119294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc2dfd-416e-483b-837e-5c54a83c4d70 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:41.161501 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2504/5061] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:41 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:41.165934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e66cb1-adf1-41f9-a8fa-6948c5f91687 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:41.218626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e66cb1-adf1-41f9-a8fa-6948c5f91687 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:41.359799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011980e-843b-468c-9f6c-639dd1109c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:41.360488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011980e-843b-468c-9f6c-639dd1109c17 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:41.360989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011980e-843b-468c-9f6c-639dd1109c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:41.361440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011980e-843b-468c-9f6c-639dd1109c17 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:41.362652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011980e-843b-468c-9f6c-639dd1109c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:41.367046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011980e-843b-468c-9f6c-639dd1109c17 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:41.459429 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2558/5062] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:41 2022] POST /identity/v3/users => generated 300 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:41.464919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc2dfd-416e-483b-837e-5c54a83c4d70 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:41.479889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc2dfd-416e-483b-837e-5c54a83c4d70 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:41.487296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011980e-843b-468c-9f6c-639dd1109c17 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:41.489926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5011980e-843b-468c-9f6c-639dd1109c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:41.496043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf11c6-42a2-4338-8c38-886285d4e436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:41.497653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf11c6-42a2-4338-8c38-886285d4e436 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:41.498031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf11c6-42a2-4338-8c38-886285d4e436 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:41.498315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf11c6-42a2-4338-8c38-886285d4e436 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:41.500646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf11c6-42a2-4338-8c38-886285d4e436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:41.508550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf11c6-42a2-4338-8c38-886285d4e436 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:41.508746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011980e-843b-468c-9f6c-639dd1109c17 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:41.531522 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2505/5063] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:41.535578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf11c6-42a2-4338-8c38-886285d4e436 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:41.546307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:41.547517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:41.548136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:41.548636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] PATH_INFO: `/v3/users/bd919e062b7940c8a48fbf40517cb489` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:41.550521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd919e062b7940c8a48fbf40517cb489)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:41.557106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:41.560926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf11c6-42a2-4338-8c38-886285d4e436 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:41.596490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdfeb3-d355-4eb8-acb7-75aa5dc46dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:41.596490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdfeb3-d355-4eb8-acb7-75aa5dc46dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:41.596490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdfeb3-d355-4eb8-acb7-75aa5dc46dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:41.596490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdfeb3-d355-4eb8-acb7-75aa5dc46dcd admin admin] PATH_INFO: `/v3/projects/64d3ef3418f54305bbaddbfd760e54d7/users/a9927a9055e1405e97578002069d0c98/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:41.620978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdfeb3-d355-4eb8-acb7-75aa5dc46dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d3ef3418f54305bbaddbfd760e54d7, user_id=a9927a9055e1405e97578002069d0c98, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:41.625223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdfeb3-d355-4eb8-acb7-75aa5dc46dcd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:41.655243 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2506/5064] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:41 2022] PUT /identity/v3/projects/64d3ef3418f54305bbaddbfd760e54d7/users/a9927a9055e1405e97578002069d0c98/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:41.659759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdfeb3-d355-4eb8-acb7-75aa5dc46dcd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:41.685532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd919e062b7940c8a48fbf40517cb489'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:41.706967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd919e062b7940c8a48fbf40517cb489'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:41.708852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd919e062b7940c8a48fbf40517cb489'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:41.711394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd919e062b7940c8a48fbf40517cb489'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:41.737426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd919e062b7940c8a48fbf40517cb489'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:41.778192 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2559/5065] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:41 2022] DELETE /identity/v3/users/bd919e062b7940c8a48fbf40517cb489 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:41.818275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdfeb3-d355-4eb8-acb7-75aa5dc46dcd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:41.954878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d65ef-a967-493e-9a74-410bb3244088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:41.954878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d65ef-a967-493e-9a74-410bb3244088 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:41.954878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d65ef-a967-493e-9a74-410bb3244088 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:41.955343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d65ef-a967-493e-9a74-410bb3244088 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:41.956037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d65ef-a967-493e-9a74-410bb3244088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:41.957711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d65ef-a967-493e-9a74-410bb3244088 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:41.971486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2507/5066] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:41 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:41.976438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:41.981091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:42.019079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5151311-4ea1-4a14-829b-8e1ff8bd3d25 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:42.039567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a077b61-eb7f-4e67-89ff-a6463ea88570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:42.040914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a077b61-eb7f-4e67-89ff-a6463ea88570 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:42.041372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a077b61-eb7f-4e67-89ff-a6463ea88570 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:42.042251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a077b61-eb7f-4e67-89ff-a6463ea88570 admin admin] PATH_INFO: `/v3/projects/64d3ef3418f54305bbaddbfd760e54d7/users/a9927a9055e1405e97578002069d0c98/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:42.047340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a077b61-eb7f-4e67-89ff-a6463ea88570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d3ef3418f54305bbaddbfd760e54d7, user_id=a9927a9055e1405e97578002069d0c98, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:42.058511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a077b61-eb7f-4e67-89ff-a6463ea88570 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:42.094442 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2560/5067] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:41 2022] PUT /identity/v3/projects/64d3ef3418f54305bbaddbfd760e54d7/users/a9927a9055e1405e97578002069d0c98/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:42.105344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1369c9-cf0e-4a27-b4ca-19613257ff67 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:42.105929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1369c9-cf0e-4a27-b4ca-19613257ff67 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:42.106380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1369c9-cf0e-4a27-b4ca-19613257ff67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:42.170254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1a1369c9-cf0e-4a27-b4ca-19613257ff67 None None] MFA Rules not processed for user `a9927a9055e1405e97578002069d0c98`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:42.171492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1a1369c9-cf0e-4a27-b4ca-19613257ff67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:42.430887 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2508/5068] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:42.431100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a077b61-eb7f-4e67-89ff-a6463ea88570 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:42.570156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a077b61-eb7f-4e67-89ff-a6463ea88570 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:42.588769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e02a32-0306-4032-9c94-b92e3843f799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:42.589461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e02a32-0306-4032-9c94-b92e3843f799 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:42.589751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e02a32-0306-4032-9c94-b92e3843f799 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:42.590030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e02a32-0306-4032-9c94-b92e3843f799 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:42.590736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e02a32-0306-4032-9c94-b92e3843f799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:42.595090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e02a32-0306-4032-9c94-b92e3843f799 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:42.651130 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2561/5069] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:42 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:42.655363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1369c9-cf0e-4a27-b4ca-19613257ff67 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:42.674461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1369c9-cf0e-4a27-b4ca-19613257ff67 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:42.840965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb820d3-9641-4b3d-aa8e-76ea95a56a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:42.840965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb820d3-9641-4b3d-aa8e-76ea95a56a32 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:42.840965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb820d3-9641-4b3d-aa8e-76ea95a56a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:42.840965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb820d3-9641-4b3d-aa8e-76ea95a56a32 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:42.841539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb820d3-9641-4b3d-aa8e-76ea95a56a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:42.843425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb820d3-9641-4b3d-aa8e-76ea95a56a32 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:42.885103 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2509/5070] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:42 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:42.889460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e02a32-0306-4032-9c94-b92e3843f799 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:42.901679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e02a32-0306-4032-9c94-b92e3843f799 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:42.906858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753121ee-7ed1-4d2c-b611-48493135fca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:42.907876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753121ee-7ed1-4d2c-b611-48493135fca5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:42.908425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753121ee-7ed1-4d2c-b611-48493135fca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:42.908914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753121ee-7ed1-4d2c-b611-48493135fca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:42.909872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753121ee-7ed1-4d2c-b611-48493135fca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:42.911748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753121ee-7ed1-4d2c-b611-48493135fca5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:42.924433 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2562/5071] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:06:42.928362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb820d3-9641-4b3d-aa8e-76ea95a56a32 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:42.939525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb820d3-9641-4b3d-aa8e-76ea95a56a32 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:42.947241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edac90-e582-4367-838f-3f5d86ee5405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:42.948565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edac90-e582-4367-838f-3f5d86ee5405 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:42.950309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edac90-e582-4367-838f-3f5d86ee5405 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:42.950865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edac90-e582-4367-838f-3f5d86ee5405 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:42.953684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edac90-e582-4367-838f-3f5d86ee5405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:42.955822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edac90-e582-4367-838f-3f5d86ee5405 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:42.982691 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2510/5072] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:42.990326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753121ee-7ed1-4d2c-b611-48493135fca5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:43.009125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753121ee-7ed1-4d2c-b611-48493135fca5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:43.020155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf391d-0cb7-4149-b1c5-285fab6e81df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:43.022223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf391d-0cb7-4149-b1c5-285fab6e81df admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:43.023169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf391d-0cb7-4149-b1c5-285fab6e81df admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:43.024411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf391d-0cb7-4149-b1c5-285fab6e81df admin admin] PATH_INFO: `/v3/projects/4bb65667acff49849f147e6a0d968135/users/700e558654514ca9ba08b0108430dd42/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:43.049791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf391d-0cb7-4149-b1c5-285fab6e81df admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb65667acff49849f147e6a0d968135, user_id=700e558654514ca9ba08b0108430dd42, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:43.058153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf391d-0cb7-4149-b1c5-285fab6e81df admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:43.082716 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2563/5073] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:42 2022] PUT /identity/v3/projects/4bb65667acff49849f147e6a0d968135/users/700e558654514ca9ba08b0108430dd42/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:43.094529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a182b4-eea4-4506-af06-f4c27d604bc4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:43.096090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a182b4-eea4-4506-af06-f4c27d604bc4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:43.096493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a182b4-eea4-4506-af06-f4c27d604bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:43.159251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-42a182b4-eea4-4506-af06-f4c27d604bc4 None None] MFA Rules not processed for user `700e558654514ca9ba08b0108430dd42`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:43.161651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42a182b4-eea4-4506-af06-f4c27d604bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:43.233022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf391d-0cb7-4149-b1c5-285fab6e81df admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:43.234911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b0bf391d-0cb7-4149-b1c5-285fab6e81df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:43.315080 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2511/5074] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:43.329821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a182b4-eea4-4506-af06-f4c27d604bc4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:43.331410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42a182b4-eea4-4506-af06-f4c27d604bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:43.408059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf391d-0cb7-4149-b1c5-285fab6e81df admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:43.424910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:43.426557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:43.427743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:43.429781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] PATH_INFO: `/v3/projects/fb6a3637d7d24266999a5d31a8c37bc2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:43.433391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6a3637d7d24266999a5d31a8c37bc2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:43.436241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:43.518055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6a3637d7d24266999a5d31a8c37bc2', 'request_id': 'req-5f975e08-8ed3-4c18-83d2-3a3280c550d2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:43.532532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6a3637d7d24266999a5d31a8c37bc2', 'request_id': 'req-5f975e08-8ed3-4c18-83d2-3a3280c550d2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:43.548703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6a3637d7d24266999a5d31a8c37bc2', 'request_id': 'req-5f975e08-8ed3-4c18-83d2-3a3280c550d2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:43.552914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a182b4-eea4-4506-af06-f4c27d604bc4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:43.577452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] The token cache is being invalidate because project fb6a3637d7d24266999a5d31a8c37bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:43.577848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:43.579135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:43.583867 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2564/5075] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:43 2022] DELETE /identity/v3/projects/fb6a3637d7d24266999a5d31a8c37bc2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:43.585680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:43.587521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:43.668687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:43.669349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:43.669659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:43.669909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:43.679780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:43.731956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f975e08-8ed3-4c18-83d2-3a3280c550d2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:43.748180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:43.749328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:43.749940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:43.750212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] PATH_INFO: `/v3/users/d0b5e7bff65746f39b2243a4dd053699` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:43.754899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b5e7bff65746f39b2243a4dd053699)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:43.756984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:43.816400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:43.820032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:43.867235 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2512/5076] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:06:43.917246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b5e7bff65746f39b2243a4dd053699'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:43.951061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b5e7bff65746f39b2243a4dd053699'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:43.954540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b5e7bff65746f39b2243a4dd053699'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:43.955958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b5e7bff65746f39b2243a4dd053699'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:43.988622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-09868d3a-644c-489e-bbae-fbcbdcc66028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b5e7bff65746f39b2243a4dd053699'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:44.051340 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2565/5077] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:43 2022] DELETE /identity/v3/users/d0b5e7bff65746f39b2243a4dd053699 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:45.173709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:45.175271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:45.204698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18e25c-36e1-4338-ac27-a05d6529d7ea service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:45.331407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:45.332656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:45.333126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:45.333656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] PATH_INFO: `/v3/users/a9927a9055e1405e97578002069d0c98` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:45.335648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9927a9055e1405e97578002069d0c98)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:45.337833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:45.411297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9927a9055e1405e97578002069d0c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:45.434462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9927a9055e1405e97578002069d0c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:45.435461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9927a9055e1405e97578002069d0c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:45.436293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9927a9055e1405e97578002069d0c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:45.456927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9927a9055e1405e97578002069d0c98'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:45.473128 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2513/5078] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:45 2022] DELETE /identity/v3/users/a9927a9055e1405e97578002069d0c98 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:45.476893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ee72e-b865-453a-b4f1-99002c3295e6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:45.477408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ee72e-b865-453a-b4f1-99002c3295e6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:45.477698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672ee72e-b865-453a-b4f1-99002c3295e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:45.505916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-672ee72e-b865-453a-b4f1-99002c3295e6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:45.509210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-672ee72e-b865-453a-b4f1-99002c3295e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:45.622985 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2566/5079] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:45.665269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:45.667031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:45.791851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f370255-8a32-4ac7-89d2-bf2b7a095e5f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:45.801947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dfc2b-9eac-4fd0-9dcf-1f7a05a404f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:45.802780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dfc2b-9eac-4fd0-9dcf-1f7a05a404f1 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:45.803171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dfc2b-9eac-4fd0-9dcf-1f7a05a404f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:45.808283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dfc2b-9eac-4fd0-9dcf-1f7a05a404f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:45.825644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dfc2b-9eac-4fd0-9dcf-1f7a05a404f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:45.829714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dfc2b-9eac-4fd0-9dcf-1f7a05a404f1 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:45.854996 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2514/5080] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:46.041267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ee72e-b865-453a-b4f1-99002c3295e6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:46.043272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-672ee72e-b865-453a-b4f1-99002c3295e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:46.063664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672ee72e-b865-453a-b4f1-99002c3295e6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:46.075556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:46.077001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:46.077575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:46.078128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] PATH_INFO: `/v3/projects/896bb4fe6e9e47a88b5b0d8a4e2f7bf7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:46.080171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=896bb4fe6e9e47a88b5b0d8a4e2f7bf7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:46.084543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:46.237631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896bb4fe6e9e47a88b5b0d8a4e2f7bf7', 'request_id': 'req-bd699c96-2a62-430c-9a25-57e6b7222d44'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.253342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896bb4fe6e9e47a88b5b0d8a4e2f7bf7', 'request_id': 'req-bd699c96-2a62-430c-9a25-57e6b7222d44'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.265257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896bb4fe6e9e47a88b5b0d8a4e2f7bf7', 'request_id': 'req-bd699c96-2a62-430c-9a25-57e6b7222d44'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.284699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] The token cache is being invalidate because project 896bb4fe6e9e47a88b5b0d8a4e2f7bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:46.285338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.286318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd699c96-2a62-430c-9a25-57e6b7222d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.292533 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2567/5081] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:46 2022] DELETE /identity/v3/projects/896bb4fe6e9e47a88b5b0d8a4e2f7bf7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:46.298923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ce94f-00c3-4058-94e9-01b33914cf33 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:46.299793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ce94f-00c3-4058-94e9-01b33914cf33 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:46.300333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ce94f-00c3-4058-94e9-01b33914cf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:46.329798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7d4ce94f-00c3-4058-94e9-01b33914cf33 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:46.331481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d4ce94f-00c3-4058-94e9-01b33914cf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:46.481682 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2515/5082] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:46.489207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4436-6906-49a7-a2b0-d99ea123eec9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:46.489677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4436-6906-49a7-a2b0-d99ea123eec9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:46.489790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ae4436-6906-49a7-a2b0-d99ea123eec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:46.514858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d1ae4436-6906-49a7-a2b0-d99ea123eec9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:46.516101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d1ae4436-6906-49a7-a2b0-d99ea123eec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:46.533987 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2568/5083] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:46.538034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ce94f-00c3-4058-94e9-01b33914cf33 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:46.550144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ce94f-00c3-4058-94e9-01b33914cf33 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:46.562150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa131f2-7237-4ff7-a771-7336d6cfb02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:46.563062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa131f2-7237-4ff7-a771-7336d6cfb02a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:46.563550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa131f2-7237-4ff7-a771-7336d6cfb02a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:46.564216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa131f2-7237-4ff7-a771-7336d6cfb02a admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:46.565235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa131f2-7237-4ff7-a771-7336d6cfb02a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:06:46.565767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa131f2-7237-4ff7-a771-7336d6cfb02a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:46.567941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa131f2-7237-4ff7-a771-7336d6cfb02a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:46.581204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae4436-6906-49a7-a2b0-d99ea123eec9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:46.582934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d1ae4436-6906-49a7-a2b0-d99ea123eec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:46.604157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ae4436-6906-49a7-a2b0-d99ea123eec9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:46.604439 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2516/5084] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:06:46.606594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa131f2-7237-4ff7-a771-7336d6cfb02a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:46.610086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:46.611372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:46.611876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:46.612400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] PATH_INFO: `/v3/users/4a76b26808b84a2ba82f49753035dd89` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:46.613878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a76b26808b84a2ba82f49753035dd89)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:46.617511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:46.622881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa131f2-7237-4ff7-a771-7336d6cfb02a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:46.637802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b601a-d1c0-42b6-ba8a-b2a5f8e596e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:46.638498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b601a-d1c0-42b6-ba8a-b2a5f8e596e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:46.638781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b601a-d1c0-42b6-ba8a-b2a5f8e596e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:46.639063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b601a-d1c0-42b6-ba8a-b2a5f8e596e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:46.639764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b601a-d1c0-42b6-ba8a-b2a5f8e596e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:46.645512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b601a-d1c0-42b6-ba8a-b2a5f8e596e3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:46.708479 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2517/5085] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:46 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:06:46.711020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b601a-d1c0-42b6-ba8a-b2a5f8e596e3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:46.726854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a76b26808b84a2ba82f49753035dd89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.737457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a76b26808b84a2ba82f49753035dd89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.738558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a76b26808b84a2ba82f49753035dd89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.739246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a76b26808b84a2ba82f49753035dd89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.756550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a76b26808b84a2ba82f49753035dd89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:46.811056 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2569/5086] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:46 2022] DELETE /identity/v3/users/4a76b26808b84a2ba82f49753035dd89 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:46.855036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b601a-d1c0-42b6-ba8a-b2a5f8e596e3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:47.056714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909423a-25d0-4060-8319-4e20ca72f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:47.057646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909423a-25d0-4060-8319-4e20ca72f365 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:47.058166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909423a-25d0-4060-8319-4e20ca72f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:47.058668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909423a-25d0-4060-8319-4e20ca72f365 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:47.059579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909423a-25d0-4060-8319-4e20ca72f365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:47.063808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909423a-25d0-4060-8319-4e20ca72f365 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:47.120050 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2518/5087] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:46 2022] POST /identity/v3/users => generated 289 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:47.124575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:47.126830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:47.170956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2bc9-7e49-4de0-8a4d-57dd584db778 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:47.183989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1beba-fb9d-489b-af3f-f668f70c0e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:47.184241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1beba-fb9d-489b-af3f-f668f70c0e8c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:47.184743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1beba-fb9d-489b-af3f-f668f70c0e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:47.185510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1beba-fb9d-489b-af3f-f668f70c0e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:47.186416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1beba-fb9d-489b-af3f-f668f70c0e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:47.190090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1beba-fb9d-489b-af3f-f668f70c0e8c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:47.214841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909423a-25d0-4060-8319-4e20ca72f365 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:47.217747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6909423a-25d0-4060-8319-4e20ca72f365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:47.222913 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2570/5088] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:47.224759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1beba-fb9d-489b-af3f-f668f70c0e8c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:47.252950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909423a-25d0-4060-8319-4e20ca72f365 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:47.255362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1beba-fb9d-489b-af3f-f668f70c0e8c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:47.264783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5342fa6-9614-4608-a0c9-61dbab9bddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:47.265713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5342fa6-9614-4608-a0c9-61dbab9bddf1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:47.266080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5342fa6-9614-4608-a0c9-61dbab9bddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:47.266372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5342fa6-9614-4608-a0c9-61dbab9bddf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:47.267199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5342fa6-9614-4608-a0c9-61dbab9bddf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:47.268827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:47.269935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:47.270225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:47.270507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] PATH_INFO: `/v3/projects/64d3ef3418f54305bbaddbfd760e54d7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:47.272101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d3ef3418f54305bbaddbfd760e54d7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:47.273070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5342fa6-9614-4608-a0c9-61dbab9bddf1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:47.275423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:47.302110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2571/5089] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:47.306420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5342fa6-9614-4608-a0c9-61dbab9bddf1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:47.320659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5342fa6-9614-4608-a0c9-61dbab9bddf1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:47.327284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75834e-1476-4a09-a80d-6d25d4657493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:47.329349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75834e-1476-4a09-a80d-6d25d4657493 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:47.329858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75834e-1476-4a09-a80d-6d25d4657493 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:47.330414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75834e-1476-4a09-a80d-6d25d4657493 admin admin] PATH_INFO: `/v3/projects/ddb5f339350b4d5facba9a6ffd84aa1b/users/0bfee91285f94b2eba5cd89004babf2e/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:47.354624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75834e-1476-4a09-a80d-6d25d4657493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddb5f339350b4d5facba9a6ffd84aa1b, user_id=0bfee91285f94b2eba5cd89004babf2e, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:47.358619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75834e-1476-4a09-a80d-6d25d4657493 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:47.369825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d3ef3418f54305bbaddbfd760e54d7', 'request_id': 'req-6260ec69-a3cc-4013-b377-84725bdd38af'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.386514 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2572/5090] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:47 2022] PUT /identity/v3/projects/ddb5f339350b4d5facba9a6ffd84aa1b/users/0bfee91285f94b2eba5cd89004babf2e/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:47.393901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d3ef3418f54305bbaddbfd760e54d7', 'request_id': 'req-6260ec69-a3cc-4013-b377-84725bdd38af'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.396934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971187af-2610-4d69-b9f0-e55cbd4cdc90 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:47.397717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971187af-2610-4d69-b9f0-e55cbd4cdc90 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:47.399682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971187af-2610-4d69-b9f0-e55cbd4cdc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:47.401379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d3ef3418f54305bbaddbfd760e54d7', 'request_id': 'req-6260ec69-a3cc-4013-b377-84725bdd38af'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.428061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] The token cache is being invalidate because project 64d3ef3418f54305bbaddbfd760e54d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:47.429188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.432551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.439734 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2519/5091] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:47 2022] DELETE /identity/v3/projects/64d3ef3418f54305bbaddbfd760e54d7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:47.442307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:47.444817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:47.461474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-971187af-2610-4d69-b9f0-e55cbd4cdc90 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:47.462885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-971187af-2610-4d69-b9f0-e55cbd4cdc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:47.612482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260ec69-a3cc-4013-b377-84725bdd38af admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:47.620539 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2573/5092] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:47.631677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:47.634003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:47.634297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:47.634559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] PATH_INFO: `/v3/users/700e558654514ca9ba08b0108430dd42` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:47.636091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971187af-2610-4d69-b9f0-e55cbd4cdc90 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:47.638056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=700e558654514ca9ba08b0108430dd42)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:47.638677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-971187af-2610-4d69-b9f0-e55cbd4cdc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:47.642291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:47.702655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '700e558654514ca9ba08b0108430dd42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.716113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '700e558654514ca9ba08b0108430dd42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.717227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '700e558654514ca9ba08b0108430dd42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.718728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '700e558654514ca9ba08b0108430dd42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.745123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '700e558654514ca9ba08b0108430dd42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:47.759599 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2520/5093] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:47 2022] DELETE /identity/v3/users/700e558654514ca9ba08b0108430dd42 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:47.801256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971187af-2610-4d69-b9f0-e55cbd4cdc90 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:47.868507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1a922-8b55-40ab-b309-a6af2c4d9f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:47.870039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a922-8b55-40ab-b309-a6af2c4d9f98 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:47.870464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a922-8b55-40ab-b309-a6af2c4d9f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:47.870930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1a922-8b55-40ab-b309-a6af2c4d9f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:47.873264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-66e1a922-8b55-40ab-b309-a6af2c4d9f98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:47.939256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:47.940783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:47.997709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1a922-8b55-40ab-b309-a6af2c4d9f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:48.000907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1a922-8b55-40ab-b309-a6af2c4d9f98 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:48.021145 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2574/5094] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:06:48.178948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cfae12-d925-4c37-91cc-4fcf325cb521 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:48.192077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:48.193341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:48.194806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:48.195383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] PATH_INFO: `/v3/projects/62670a489b2b43b78d9e1e71371e7886` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:48.197182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62670a489b2b43b78d9e1e71371e7886)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:48.199391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:48.282852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62670a489b2b43b78d9e1e71371e7886', 'request_id': 'req-c47c7023-ca40-4316-af43-6dff2ad30974'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:48.293843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62670a489b2b43b78d9e1e71371e7886', 'request_id': 'req-c47c7023-ca40-4316-af43-6dff2ad30974'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:48.310231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62670a489b2b43b78d9e1e71371e7886', 'request_id': 'req-c47c7023-ca40-4316-af43-6dff2ad30974'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:48.327262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] The token cache is being invalidate because project 62670a489b2b43b78d9e1e71371e7886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:48.327570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:48.328991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c47c7023-ca40-4316-af43-6dff2ad30974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:48.332570 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2521/5095] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:47 2022] DELETE /identity/v3/projects/62670a489b2b43b78d9e1e71371e7886 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:48.337709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84da5-4270-4d1a-9fcc-1eaa33e2fde8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:48.337997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84da5-4270-4d1a-9fcc-1eaa33e2fde8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:48.338278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc84da5-4270-4d1a-9fcc-1eaa33e2fde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:48.377049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ecc84da5-4270-4d1a-9fcc-1eaa33e2fde8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:48.378771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ecc84da5-4270-4d1a-9fcc-1eaa33e2fde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:48.468325 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2575/5096] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:48.476527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96996d2c-a7ac-4de9-bc98-32dfe57646bd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:48.477035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96996d2c-a7ac-4de9-bc98-32dfe57646bd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:48.477174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96996d2c-a7ac-4de9-bc98-32dfe57646bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:48.511652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-96996d2c-a7ac-4de9-bc98-32dfe57646bd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:48.513932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-96996d2c-a7ac-4de9-bc98-32dfe57646bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:48.527489 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2522/5097] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:48.531783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc84da5-4270-4d1a-9fcc-1eaa33e2fde8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:48.544610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc84da5-4270-4d1a-9fcc-1eaa33e2fde8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:48.550825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f81c-c497-45a3-b8e2-1ee430288d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:48.552396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f81c-c497-45a3-b8e2-1ee430288d22 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:48.553025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f81c-c497-45a3-b8e2-1ee430288d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:48.554014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81f81c-c497-45a3-b8e2-1ee430288d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:48.555035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81f81c-c497-45a3-b8e2-1ee430288d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:06:48.555522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81f81c-c497-45a3-b8e2-1ee430288d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:48.557581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81f81c-c497-45a3-b8e2-1ee430288d22 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:48.574944 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2576/5098] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:06:48.579346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96996d2c-a7ac-4de9-bc98-32dfe57646bd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:48.594964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96996d2c-a7ac-4de9-bc98-32dfe57646bd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:48.602377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0b7d5-1209-493f-a56d-a352b987b92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:48.603049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0b7d5-1209-493f-a56d-a352b987b92b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:48.603326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0b7d5-1209-493f-a56d-a352b987b92b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:48.603606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0b7d5-1209-493f-a56d-a352b987b92b admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:48.604528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0b7d5-1209-493f-a56d-a352b987b92b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:48.606685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0b7d5-1209-493f-a56d-a352b987b92b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:48.656255 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2523/5099] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:48 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:48.661311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f81c-c497-45a3-b8e2-1ee430288d22 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:48.677746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81f81c-c497-45a3-b8e2-1ee430288d22 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:48.840759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7205b-6192-45f7-8505-870de21163d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:48.842109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7205b-6192-45f7-8505-870de21163d4 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:48.842834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7205b-6192-45f7-8505-870de21163d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:48.843285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7205b-6192-45f7-8505-870de21163d4 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:48.844570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7205b-6192-45f7-8505-870de21163d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:48.847060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7205b-6192-45f7-8505-870de21163d4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:48.886052 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2577/5100] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:48 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:48.890479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0b7d5-1209-493f-a56d-a352b987b92b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:48.905887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0b7d5-1209-493f-a56d-a352b987b92b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:48.918912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3f03a-25f5-48a5-ba1e-ab74b2d80c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:48.919954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f03a-25f5-48a5-ba1e-ab74b2d80c31 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:48.920241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f03a-25f5-48a5-ba1e-ab74b2d80c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:48.920522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f03a-25f5-48a5-ba1e-ab74b2d80c31 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:48.921258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3f03a-25f5-48a5-ba1e-ab74b2d80c31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:48.928381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3f03a-25f5-48a5-ba1e-ab74b2d80c31 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:48.953297 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2524/5101] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:48.958008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7205b-6192-45f7-8505-870de21163d4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:48.974669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7205b-6192-45f7-8505-870de21163d4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:48.989965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4177a0-3d48-4d72-9302-56851df4cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:48.989965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4177a0-3d48-4d72-9302-56851df4cf58 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:48.989965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4177a0-3d48-4d72-9302-56851df4cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:48.989965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4177a0-3d48-4d72-9302-56851df4cf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:48.990718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4177a0-3d48-4d72-9302-56851df4cf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:48.994600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4177a0-3d48-4d72-9302-56851df4cf58 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:49.039644 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2578/5102] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:49.041397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3f03a-25f5-48a5-ba1e-ab74b2d80c31 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:49.044675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4177a0-3d48-4d72-9302-56851df4cf58 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:49.047126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ef4177a0-3d48-4d72-9302-56851df4cf58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:49.054821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3f03a-25f5-48a5-ba1e-ab74b2d80c31 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:49.074478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4177a0-3d48-4d72-9302-56851df4cf58 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:49.075058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4861c7-8234-44d3-ba0d-cdf5da6684e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:49.076300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4861c7-8234-44d3-ba0d-cdf5da6684e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.076768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4861c7-8234-44d3-ba0d-cdf5da6684e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.077549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4861c7-8234-44d3-ba0d-cdf5da6684e0 admin admin] PATH_INFO: `/v3/projects/c58247395bea4447bc23f219d3c1cbc0/users/c87af7ce66f048e3942c2846edb30c10/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.095216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:49.096210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.096560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.096902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] PATH_INFO: `/v3/projects/4bb65667acff49849f147e6a0d968135` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.099700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb65667acff49849f147e6a0d968135)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:49.104035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4861c7-8234-44d3-ba0d-cdf5da6684e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c58247395bea4447bc23f219d3c1cbc0, user_id=c87af7ce66f048e3942c2846edb30c10, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:49.104907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:49.111612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4861c7-8234-44d3-ba0d-cdf5da6684e0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:49.157271 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2525/5103] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:49 2022] PUT /identity/v3/projects/c58247395bea4447bc23f219d3c1cbc0/users/c87af7ce66f048e3942c2846edb30c10/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:49.162963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea8e8-1ede-4b49-871e-7137dbc7a615 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.163260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea8e8-1ede-4b49-871e-7137dbc7a615 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.163542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea8e8-1ede-4b49-871e-7137dbc7a615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.232404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-302ea8e8-1ede-4b49-871e-7137dbc7a615 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:49.238162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-302ea8e8-1ede-4b49-871e-7137dbc7a615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:49.252520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb65667acff49849f147e6a0d968135', 'request_id': 'req-aea669d2-4a2e-4103-9d79-c470f4d2ff21'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:49.274498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb65667acff49849f147e6a0d968135', 'request_id': 'req-aea669d2-4a2e-4103-9d79-c470f4d2ff21'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:49.291887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb65667acff49849f147e6a0d968135', 'request_id': 'req-aea669d2-4a2e-4103-9d79-c470f4d2ff21'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:49.328767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] The token cache is being invalidate because project 4bb65667acff49849f147e6a0d968135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:49.329065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:49.331044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aea669d2-4a2e-4103-9d79-c470f4d2ff21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:49.333536 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2579/5104] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:49 2022] DELETE /identity/v3/projects/4bb65667acff49849f147e6a0d968135 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:49.340021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa30c6-3ad9-4b0e-879a-1a01f04bebda None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.340297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa30c6-3ad9-4b0e-879a-1a01f04bebda None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.340575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa30c6-3ad9-4b0e-879a-1a01f04bebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.385416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d0fa30c6-3ad9-4b0e-879a-1a01f04bebda None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:49.386805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d0fa30c6-3ad9-4b0e-879a-1a01f04bebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:49.399398 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2526/5105] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:49.412407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec109-422e-4015-9b7e-ce485ed88441 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.413910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec109-422e-4015-9b7e-ce485ed88441 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.414410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec109-422e-4015-9b7e-ce485ed88441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.417189 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2580/5106] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:49.419171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa30c6-3ad9-4b0e-879a-1a01f04bebda None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:49.423883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d0fa30c6-3ad9-4b0e-879a-1a01f04bebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:49.451453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-796ec109-422e-4015-9b7e-ce485ed88441 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:49.455521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-796ec109-422e-4015-9b7e-ce485ed88441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:49.482724 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2527/5107] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:49.484482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec109-422e-4015-9b7e-ce485ed88441 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:49.499349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec109-422e-4015-9b7e-ce485ed88441 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:49.514791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166f3d-ef59-4e01-91cc-4e59b458e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:49.516020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166f3d-ef59-4e01-91cc-4e59b458e1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.517887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166f3d-ef59-4e01-91cc-4e59b458e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.518405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c166f3d-ef59-4e01-91cc-4e59b458e1e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.520971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c166f3d-ef59-4e01-91cc-4e59b458e1e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:06:49.522055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c166f3d-ef59-4e01-91cc-4e59b458e1e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:49.526800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c166f3d-ef59-4e01-91cc-4e59b458e1e5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:49.557907 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2528/5108] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:06:49.562729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa30c6-3ad9-4b0e-879a-1a01f04bebda None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:49.564616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166f3d-ef59-4e01-91cc-4e59b458e1e5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:49.576296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce923a-bed3-4ac1-8d53-c3eb691dabc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:49.577353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce923a-bed3-4ac1-8d53-c3eb691dabc2 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.577824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce923a-bed3-4ac1-8d53-c3eb691dabc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.578411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce923a-bed3-4ac1-8d53-c3eb691dabc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.587509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c166f3d-ef59-4e01-91cc-4e59b458e1e5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:49.596947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce923a-bed3-4ac1-8d53-c3eb691dabc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:49.599368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5660be5-c908-4c45-8294-b348a2a8b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:49.600351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5660be5-c908-4c45-8294-b348a2a8b898 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.603582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce923a-bed3-4ac1-8d53-c3eb691dabc2 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:49.604480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5660be5-c908-4c45-8294-b348a2a8b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.611367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5660be5-c908-4c45-8294-b348a2a8b898 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.613975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5660be5-c908-4c45-8294-b348a2a8b898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:49.619607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5660be5-c908-4c45-8294-b348a2a8b898 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:49.635949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2581/5109] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:49.669175 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2529/5110] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:49 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:49.670670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce923a-bed3-4ac1-8d53-c3eb691dabc2 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:49.686154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce923a-bed3-4ac1-8d53-c3eb691dabc2 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:49.783514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdaf54-e11b-4f57-bb23-1dd8b7ec2413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:49.785481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdaf54-e11b-4f57-bb23-1dd8b7ec2413 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.787180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdaf54-e11b-4f57-bb23-1dd8b7ec2413 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.787620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdaf54-e11b-4f57-bb23-1dd8b7ec2413 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.791804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdaf54-e11b-4f57-bb23-1dd8b7ec2413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:49.793987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdaf54-e11b-4f57-bb23-1dd8b7ec2413 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:49.828932 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2582/5111] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:49 2022] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:49.832967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5660be5-c908-4c45-8294-b348a2a8b898 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:49.881650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5660be5-c908-4c45-8294-b348a2a8b898 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:49.889354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986de2c7-6956-4acf-ba80-bfb786735cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:49.890203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986de2c7-6956-4acf-ba80-bfb786735cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.890911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986de2c7-6956-4acf-ba80-bfb786735cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.891291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986de2c7-6956-4acf-ba80-bfb786735cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.892223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986de2c7-6956-4acf-ba80-bfb786735cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:49.894742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986de2c7-6956-4acf-ba80-bfb786735cf4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:49.909051 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2530/5112] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:06:49.912697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdaf54-e11b-4f57-bb23-1dd8b7ec2413 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:49.927091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdaf54-e11b-4f57-bb23-1dd8b7ec2413 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:49.933901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b238d4-e7b4-4ce0-8062-4cfd65104cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:49.935752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b238d4-e7b4-4ce0-8062-4cfd65104cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:49.936209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b238d4-e7b4-4ce0-8062-4cfd65104cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:49.936588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b238d4-e7b4-4ce0-8062-4cfd65104cb1 admin admin] PATH_INFO: `/v3/projects/d6d8fea2866d488f956d6f340769fde5/users/6f4e41c76a4746f1b3a296d0c1154932/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:49.958625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b238d4-e7b4-4ce0-8062-4cfd65104cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d8fea2866d488f956d6f340769fde5, user_id=6f4e41c76a4746f1b3a296d0c1154932, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:49.966520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b238d4-e7b4-4ce0-8062-4cfd65104cb1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:50.004809 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2583/5113] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:49 2022] PUT /identity/v3/projects/d6d8fea2866d488f956d6f340769fde5/users/6f4e41c76a4746f1b3a296d0c1154932/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:06:50.008685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986de2c7-6956-4acf-ba80-bfb786735cf4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:50.031585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986de2c7-6956-4acf-ba80-bfb786735cf4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:50.165757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc926450-d139-446d-9bd6-c4182c85f49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:50.166615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc926450-d139-446d-9bd6-c4182c85f49a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:50.167037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc926450-d139-446d-9bd6-c4182c85f49a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:50.167554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc926450-d139-446d-9bd6-c4182c85f49a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:50.168543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc926450-d139-446d-9bd6-c4182c85f49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:50.170823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc926450-d139-446d-9bd6-c4182c85f49a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:50.188012 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2531/5114] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:50.188969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b238d4-e7b4-4ce0-8062-4cfd65104cb1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:50.203314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b238d4-e7b4-4ce0-8062-4cfd65104cb1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:50.221286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196556f5-8dd3-452c-9de2-185fed99324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:50.222495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196556f5-8dd3-452c-9de2-185fed99324d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:50.222786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196556f5-8dd3-452c-9de2-185fed99324d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:50.223110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196556f5-8dd3-452c-9de2-185fed99324d admin admin] PATH_INFO: `/v3/projects/d6d8fea2866d488f956d6f340769fde5/users/6f4e41c76a4746f1b3a296d0c1154932/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:50.227141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196556f5-8dd3-452c-9de2-185fed99324d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6d8fea2866d488f956d6f340769fde5, user_id=6f4e41c76a4746f1b3a296d0c1154932, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:50.231635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196556f5-8dd3-452c-9de2-185fed99324d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:50.280097 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2584/5115] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:50 2022] PUT /identity/v3/projects/d6d8fea2866d488f956d6f340769fde5/users/6f4e41c76a4746f1b3a296d0c1154932/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:50.288584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1768b-619a-4146-b874-df74a600bbb7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:50.288584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1768b-619a-4146-b874-df74a600bbb7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:50.288584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1768b-619a-4146-b874-df74a600bbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:50.348658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bab1768b-619a-4146-b874-df74a600bbb7 None None] MFA Rules not processed for user `6f4e41c76a4746f1b3a296d0c1154932`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:50.349925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bab1768b-619a-4146-b874-df74a600bbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:50.452332 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2532/5116] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:50.455578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196556f5-8dd3-452c-9de2-185fed99324d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:50.533465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196556f5-8dd3-452c-9de2-185fed99324d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:50.539073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ea7df-cc94-4dab-89bc-f92943339077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:50.539667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ea7df-cc94-4dab-89bc-f92943339077 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:50.539970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ea7df-cc94-4dab-89bc-f92943339077 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:50.540308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ea7df-cc94-4dab-89bc-f92943339077 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:50.541003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ea7df-cc94-4dab-89bc-f92943339077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:50.542949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ea7df-cc94-4dab-89bc-f92943339077 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:50.574602 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2585/5117] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:50 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:50.578824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1768b-619a-4146-b874-df74a600bbb7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:50.592483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1768b-619a-4146-b874-df74a600bbb7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:50.668699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb099b-1f71-4d4d-bdf9-9b22a7886c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:50.669276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb099b-1f71-4d4d-bdf9-9b22a7886c65 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:50.669587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb099b-1f71-4d4d-bdf9-9b22a7886c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:50.669867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb099b-1f71-4d4d-bdf9-9b22a7886c65 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:50.670722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb099b-1f71-4d4d-bdf9-9b22a7886c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:50.673422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb099b-1f71-4d4d-bdf9-9b22a7886c65 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:50.700859 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2533/5118] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:50 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:50.706054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ea7df-cc94-4dab-89bc-f92943339077 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:50.727027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ea7df-cc94-4dab-89bc-f92943339077 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:50.732528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8245a22-0b7b-409c-a100-4401818fdc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:50.733980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8245a22-0b7b-409c-a100-4401818fdc1a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:50.734278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8245a22-0b7b-409c-a100-4401818fdc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:50.734527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8245a22-0b7b-409c-a100-4401818fdc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:50.735254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8245a22-0b7b-409c-a100-4401818fdc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:50.737149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8245a22-0b7b-409c-a100-4401818fdc1a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:50.752004 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2586/5119] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:50.754763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb099b-1f71-4d4d-bdf9-9b22a7886c65 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:50.772581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb099b-1f71-4d4d-bdf9-9b22a7886c65 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:50.779583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3676a5-abf0-4e89-9094-2c29248b3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:50.780615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3676a5-abf0-4e89-9094-2c29248b3025 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:50.780976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3676a5-abf0-4e89-9094-2c29248b3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:50.781331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3676a5-abf0-4e89-9094-2c29248b3025 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:50.782123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3676a5-abf0-4e89-9094-2c29248b3025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:50.783822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3676a5-abf0-4e89-9094-2c29248b3025 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:50.796047 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2534/5120] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:50.800504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8245a22-0b7b-409c-a100-4401818fdc1a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:50.812005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8245a22-0b7b-409c-a100-4401818fdc1a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:50.817704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffce55-a20a-4bf1-b1a3-fc0955bd0aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:50.818596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffce55-a20a-4bf1-b1a3-fc0955bd0aae admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:50.818856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffce55-a20a-4bf1-b1a3-fc0955bd0aae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:50.819679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bffce55-a20a-4bf1-b1a3-fc0955bd0aae admin admin] PATH_INFO: `/v3/projects/7e78ea5e86dc4d92b9446bb120361cd0/users/c89f4e2430854bdbad38ada65d6a1cff/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:50.835833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffce55-a20a-4bf1-b1a3-fc0955bd0aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e78ea5e86dc4d92b9446bb120361cd0, user_id=c89f4e2430854bdbad38ada65d6a1cff, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:50.838837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bffce55-a20a-4bf1-b1a3-fc0955bd0aae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:50.861990 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2587/5121] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:50 2022] PUT /identity/v3/projects/7e78ea5e86dc4d92b9446bb120361cd0/users/c89f4e2430854bdbad38ada65d6a1cff/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:50.873742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34d202-2223-4dab-aa59-8ba09d92bacf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:50.874108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34d202-2223-4dab-aa59-8ba09d92bacf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:50.874396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f34d202-2223-4dab-aa59-8ba09d92bacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:50.913761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8f34d202-2223-4dab-aa59-8ba09d92bacf None None] MFA Rules not processed for user `c89f4e2430854bdbad38ada65d6a1cff`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:50.919773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f34d202-2223-4dab-aa59-8ba09d92bacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:51.004574 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2535/5122] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:51.035325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffce55-a20a-4bf1-b1a3-fc0955bd0aae admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:51.037331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0bffce55-a20a-4bf1-b1a3-fc0955bd0aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:51.184169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bffce55-a20a-4bf1-b1a3-fc0955bd0aae admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:51.189867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e51239-cb26-4f9b-9022-8ca15aa8908d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:51.190537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e51239-cb26-4f9b-9022-8ca15aa8908d service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:51.190819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e51239-cb26-4f9b-9022-8ca15aa8908d service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:51.191096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e51239-cb26-4f9b-9022-8ca15aa8908d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:51.312173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e51239-cb26-4f9b-9022-8ca15aa8908d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:51.313747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e51239-cb26-4f9b-9022-8ca15aa8908d service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:51.335371 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2588/5123] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:51.409760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11359cca-3058-4129-b2fa-63ffe0334a73 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:51.410445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11359cca-3058-4129-b2fa-63ffe0334a73 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:51.411086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11359cca-3058-4129-b2fa-63ffe0334a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:51.443197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-11359cca-3058-4129-b2fa-63ffe0334a73 None None] MFA Rules not processed for user `8cab4cf432764bb487de9abc0f283898`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:51.445844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-11359cca-3058-4129-b2fa-63ffe0334a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:51.496230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d0ea2-b697-4f96-a168-50784c7494a2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:51.496802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d0ea2-b697-4f96-a168-50784c7494a2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:51.497260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d0ea2-b697-4f96-a168-50784c7494a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:51.548852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-062d0ea2-b697-4f96-a168-50784c7494a2 None None] MFA Rules not processed for user `0bfee91285f94b2eba5cd89004babf2e`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:51.550773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-062d0ea2-b697-4f96-a168-50784c7494a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:51.556426 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2536/5124] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:51.669991 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2589/5125] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:51.673014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11359cca-3058-4129-b2fa-63ffe0334a73 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:51.677197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-11359cca-3058-4129-b2fa-63ffe0334a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:51.772952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11359cca-3058-4129-b2fa-63ffe0334a73 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:51.778714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1da69-8208-411b-81d2-3ca460709b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:51.779507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1da69-8208-411b-81d2-3ca460709b76 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:51.780103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1da69-8208-411b-81d2-3ca460709b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:51.780488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1da69-8208-411b-81d2-3ca460709b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:51.781281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1da69-8208-411b-81d2-3ca460709b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:51.783745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1da69-8208-411b-81d2-3ca460709b76 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:51.825792 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2537/5126] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:51 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:51.827232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d0ea2-b697-4f96-a168-50784c7494a2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:51.839653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d0ea2-b697-4f96-a168-50784c7494a2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:51.955219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21def85f-cf7b-4d1d-b748-717eed5c57e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:51.955891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21def85f-cf7b-4d1d-b748-717eed5c57e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:51.956200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21def85f-cf7b-4d1d-b748-717eed5c57e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:51.956476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21def85f-cf7b-4d1d-b748-717eed5c57e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:51.957380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21def85f-cf7b-4d1d-b748-717eed5c57e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:51.960023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21def85f-cf7b-4d1d-b748-717eed5c57e6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:52.000647 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2590/5127] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:51 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:52.002703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1da69-8208-411b-81d2-3ca460709b76 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:52.021360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1da69-8208-411b-81d2-3ca460709b76 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:52.032348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e4923-de32-4a90-a73b-035decf33dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:52.033108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e4923-de32-4a90-a73b-035decf33dec admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:52.033405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e4923-de32-4a90-a73b-035decf33dec admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:52.033690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e4923-de32-4a90-a73b-035decf33dec admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:52.034490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e4923-de32-4a90-a73b-035decf33dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:52.036205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e4923-de32-4a90-a73b-035decf33dec admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:52.079608 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2538/5128] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:52.083539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21def85f-cf7b-4d1d-b748-717eed5c57e6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:52.099413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21def85f-cf7b-4d1d-b748-717eed5c57e6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:52.111759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f76c9-df31-4786-b51c-0dc5f3b9fd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:52.112678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f76c9-df31-4786-b51c-0dc5f3b9fd6b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:52.112947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f76c9-df31-4786-b51c-0dc5f3b9fd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:52.113227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f76c9-df31-4786-b51c-0dc5f3b9fd6b admin admin] PATH_INFO: `/v3/projects/301595631073479dbf5b2832a81d3e01/users/27cec5f2d6fd48e7861aab535615d43c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:52.140272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f76c9-df31-4786-b51c-0dc5f3b9fd6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=301595631073479dbf5b2832a81d3e01, user_id=27cec5f2d6fd48e7861aab535615d43c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:52.143048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f76c9-df31-4786-b51c-0dc5f3b9fd6b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:52.180770 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2591/5129] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:52 2022] PUT /identity/v3/projects/301595631073479dbf5b2832a81d3e01/users/27cec5f2d6fd48e7861aab535615d43c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:52.184378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e4923-de32-4a90-a73b-035decf33dec admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:52.184729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f76c9-df31-4786-b51c-0dc5f3b9fd6b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:52.197720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e4923-de32-4a90-a73b-035decf33dec admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:52.289963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f76c9-df31-4786-b51c-0dc5f3b9fd6b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:52.295896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab365f9c-a6de-444f-a038-894e9d1dd15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:52.297973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365f9c-a6de-444f-a038-894e9d1dd15b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:52.298225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:52.298377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365f9c-a6de-444f-a038-894e9d1dd15b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:52.298604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab365f9c-a6de-444f-a038-894e9d1dd15b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:52.298992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:52.299289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:52.299419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab365f9c-a6de-444f-a038-894e9d1dd15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:52.299586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] PATH_INFO: `/v3/users/6f4e41c76a4746f1b3a296d0c1154932` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:52.301102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f4e41c76a4746f1b3a296d0c1154932)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:52.301299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab365f9c-a6de-444f-a038-894e9d1dd15b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:52.302811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:52.317058 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2592/5130] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:06:52.325725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab365f9c-a6de-444f-a038-894e9d1dd15b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:52.352231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab365f9c-a6de-444f-a038-894e9d1dd15b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:52.365396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86735996-e078-43a5-81a0-fd5566ec8c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:52.367069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86735996-e078-43a5-81a0-fd5566ec8c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:52.367350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86735996-e078-43a5-81a0-fd5566ec8c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:52.367786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86735996-e078-43a5-81a0-fd5566ec8c66 admin admin] PATH_INFO: `/v3/projects/301595631073479dbf5b2832a81d3e01/users/27cec5f2d6fd48e7861aab535615d43c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:52.370992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f4e41c76a4746f1b3a296d0c1154932'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:52.371364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86735996-e078-43a5-81a0-fd5566ec8c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301595631073479dbf5b2832a81d3e01, user_id=27cec5f2d6fd48e7861aab535615d43c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:52.378191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86735996-e078-43a5-81a0-fd5566ec8c66 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:52.384233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f4e41c76a4746f1b3a296d0c1154932'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:52.388867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f4e41c76a4746f1b3a296d0c1154932'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:52.391399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f4e41c76a4746f1b3a296d0c1154932'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:52.399648 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2593/5131] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:52 2022] PUT /identity/v3/projects/301595631073479dbf5b2832a81d3e01/users/27cec5f2d6fd48e7861aab535615d43c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:52.415184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f4e41c76a4746f1b3a296d0c1154932'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:52.435461 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2539/5132] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:52 2022] DELETE /identity/v3/users/6f4e41c76a4746f1b3a296d0c1154932 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:06:52.436187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c458e-03d6-4007-a0b2-0ebd0e688f4a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:52.436532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c458e-03d6-4007-a0b2-0ebd0e688f4a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:52.436862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c458e-03d6-4007-a0b2-0ebd0e688f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:52.470254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1f8c458e-03d6-4007-a0b2-0ebd0e688f4a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:52.471980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1f8c458e-03d6-4007-a0b2-0ebd0e688f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:52.587658 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2594/5133] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:06:52.607397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:52.612632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:52.713613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b81cb7-78da-4ac4-94c8-7d983c476eb8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:52.718683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84789897-6bdb-4d43-80c8-6dfb60992e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:52.720189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84789897-6bdb-4d43-80c8-6dfb60992e12 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:52.720482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84789897-6bdb-4d43-80c8-6dfb60992e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:52.722916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84789897-6bdb-4d43-80c8-6dfb60992e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:52.740310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84789897-6bdb-4d43-80c8-6dfb60992e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:52.742968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84789897-6bdb-4d43-80c8-6dfb60992e12 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:52.759345 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2540/5134] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:53.274152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c458e-03d6-4007-a0b2-0ebd0e688f4a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:53.275758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1f8c458e-03d6-4007-a0b2-0ebd0e688f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:53.299790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c458e-03d6-4007-a0b2-0ebd0e688f4a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:53.306294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:53.307393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:53.307854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:53.308400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] PATH_INFO: `/v3/projects/d6d8fea2866d488f956d6f340769fde5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:53.309878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6d8fea2866d488f956d6f340769fde5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:53.324883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:53.400285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6d8fea2866d488f956d6f340769fde5', 'request_id': 'req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.412593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6d8fea2866d488f956d6f340769fde5', 'request_id': 'req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.427550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6d8fea2866d488f956d6f340769fde5', 'request_id': 'req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.448258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] The token cache is being invalidate because project d6d8fea2866d488f956d6f340769fde5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:53.448986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.449935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.451821 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2595/5135] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:53 2022] DELETE /identity/v3/projects/d6d8fea2866d488f956d6f340769fde5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:53.455846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84789897-6bdb-4d43-80c8-6dfb60992e12 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:53.471884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84789897-6bdb-4d43-80c8-6dfb60992e12 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:53.567265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:53.568715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:53.569289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:53.569804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] PATH_INFO: `/v3/users/c89f4e2430854bdbad38ada65d6a1cff` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:53.575344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89f4e2430854bdbad38ada65d6a1cff)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:53.578738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:53.685785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89f4e2430854bdbad38ada65d6a1cff'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.705294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89f4e2430854bdbad38ada65d6a1cff'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.705957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89f4e2430854bdbad38ada65d6a1cff'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.706582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89f4e2430854bdbad38ada65d6a1cff'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.727796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-65c01e28-3a04-4146-a5e2-965f417ebc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89f4e2430854bdbad38ada65d6a1cff'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:53.752832 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2541/5136] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:06:53 2022] DELETE /identity/v3/users/c89f4e2430854bdbad38ada65d6a1cff => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:54.227376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:54.228883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:54.251664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d30ce-95cc-4fa0-b94c-8b8c93e656d7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:54.364074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:54.365304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:54.366722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:54.366722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] PATH_INFO: `/v3/projects/7e78ea5e86dc4d92b9446bb120361cd0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:54.368086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e78ea5e86dc4d92b9446bb120361cd0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:54.370451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:54.433940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e78ea5e86dc4d92b9446bb120361cd0', 'request_id': 'req-726da59c-203d-4dc9-a4cf-dde93c237277'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:54.444576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e78ea5e86dc4d92b9446bb120361cd0', 'request_id': 'req-726da59c-203d-4dc9-a4cf-dde93c237277'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:54.456068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e78ea5e86dc4d92b9446bb120361cd0', 'request_id': 'req-726da59c-203d-4dc9-a4cf-dde93c237277'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:54.477318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] The token cache is being invalidate because project 7e78ea5e86dc4d92b9446bb120361cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:06:54.477318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:54.477855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-726da59c-203d-4dc9-a4cf-dde93c237277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:06:54.483018 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2596/5137] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:06:54 2022] DELETE /identity/v3/projects/7e78ea5e86dc4d92b9446bb120361cd0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:54.484726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0202e4-80fa-4c9f-bd79-db61a14bff8c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:54.485018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0202e4-80fa-4c9f-bd79-db61a14bff8c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:54.485312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0202e4-80fa-4c9f-bd79-db61a14bff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:54.514769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7e0202e4-80fa-4c9f-bd79-db61a14bff8c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:54.516189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e0202e4-80fa-4c9f-bd79-db61a14bff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:54.653135 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2542/5138] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:54.660817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c443b0-d5dd-4074-9785-5288c369df53 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:54.661335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c443b0-d5dd-4074-9785-5288c369df53 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:54.661617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c443b0-d5dd-4074-9785-5288c369df53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:54.690257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-13c443b0-d5dd-4074-9785-5288c369df53 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:54.692067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-13c443b0-d5dd-4074-9785-5288c369df53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:54.705062 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2597/5139] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:54.710952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0202e4-80fa-4c9f-bd79-db61a14bff8c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:54.725599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0202e4-80fa-4c9f-bd79-db61a14bff8c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:54.733303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5fc8d-4bf2-46cc-8bcf-6aa5ac11a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:54.733981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5fc8d-4bf2-46cc-8bcf-6aa5ac11a06f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:54.734266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5fc8d-4bf2-46cc-8bcf-6aa5ac11a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:54.737752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5fc8d-4bf2-46cc-8bcf-6aa5ac11a06f admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:54.740598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5fc8d-4bf2-46cc-8bcf-6aa5ac11a06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:06:54.742218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5fc8d-4bf2-46cc-8bcf-6aa5ac11a06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:54.746347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5fc8d-4bf2-46cc-8bcf-6aa5ac11a06f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:54.776265 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2543/5140] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:06:54.779759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c443b0-d5dd-4074-9785-5288c369df53 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:54.793188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c443b0-d5dd-4074-9785-5288c369df53 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:54.808164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a759d7-cd75-4763-ad62-3bd1fb6b826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:54.809139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a759d7-cd75-4763-ad62-3bd1fb6b826f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:54.809644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a759d7-cd75-4763-ad62-3bd1fb6b826f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:54.810118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a759d7-cd75-4763-ad62-3bd1fb6b826f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:54.811030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a759d7-cd75-4763-ad62-3bd1fb6b826f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:54.814298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a759d7-cd75-4763-ad62-3bd1fb6b826f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:54.906751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5fc8d-4bf2-46cc-8bcf-6aa5ac11a06f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:54.911472 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2598/5141] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:54 2022] POST /identity/v3/projects => generated 367 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:54.950543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5fc8d-4bf2-46cc-8bcf-6aa5ac11a06f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:55.084053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ea17a-4d40-4236-8855-ee5b54c2864d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:55.085113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ea17a-4d40-4236-8855-ee5b54c2864d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:55.085564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ea17a-4d40-4236-8855-ee5b54c2864d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:55.086000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ea17a-4d40-4236-8855-ee5b54c2864d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:55.086855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ea17a-4d40-4236-8855-ee5b54c2864d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:55.089052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ea17a-4d40-4236-8855-ee5b54c2864d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:55.132444 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2544/5142] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:54 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:55.132807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a759d7-cd75-4763-ad62-3bd1fb6b826f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:55.150672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a759d7-cd75-4763-ad62-3bd1fb6b826f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:55.157043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e0fe4-59d3-402a-9b2e-36fb153bc308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:55.157725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0fe4-59d3-402a-9b2e-36fb153bc308 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:55.158005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0fe4-59d3-402a-9b2e-36fb153bc308 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:55.158279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e0fe4-59d3-402a-9b2e-36fb153bc308 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:55.159095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e0fe4-59d3-402a-9b2e-36fb153bc308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:55.160724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e0fe4-59d3-402a-9b2e-36fb153bc308 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:55.194286 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2599/5143] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:55.195587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ea17a-4d40-4236-8855-ee5b54c2864d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:55.210674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ea17a-4d40-4236-8855-ee5b54c2864d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:55.232019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2351cd9-5aab-485d-8a40-4d2b87d130ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:55.232860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2351cd9-5aab-485d-8a40-4d2b87d130ac admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:55.233156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2351cd9-5aab-485d-8a40-4d2b87d130ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:55.233438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2351cd9-5aab-485d-8a40-4d2b87d130ac admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:55.234172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2351cd9-5aab-485d-8a40-4d2b87d130ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:55.236262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2351cd9-5aab-485d-8a40-4d2b87d130ac admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:55.258326 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2545/5144] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:55.259382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e0fe4-59d3-402a-9b2e-36fb153bc308 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:55.273080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e0fe4-59d3-402a-9b2e-36fb153bc308 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:55.286728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bcdd1-699c-487b-92e4-168c369beffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:55.288120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bcdd1-699c-487b-92e4-168c369beffb admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:55.288570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bcdd1-699c-487b-92e4-168c369beffb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:55.289049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bcdd1-699c-487b-92e4-168c369beffb admin admin] PATH_INFO: `/v3/projects/eb7e4d14596f43e6b006464a3e8f9415/users/fa9491d141c74065a3726c89cfde5d2f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:55.326098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bcdd1-699c-487b-92e4-168c369beffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb7e4d14596f43e6b006464a3e8f9415, user_id=fa9491d141c74065a3726c89cfde5d2f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:55.329196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bcdd1-699c-487b-92e4-168c369beffb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:55.358762 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2600/5145] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:55 2022] PUT /identity/v3/projects/eb7e4d14596f43e6b006464a3e8f9415/users/fa9491d141c74065a3726c89cfde5d2f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:55.371413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e1618-c352-42ef-9a46-5a5d4d572a58 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:55.371673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e1618-c352-42ef-9a46-5a5d4d572a58 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:55.372038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e1618-c352-42ef-9a46-5a5d4d572a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:55.381900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60b2e7-4602-4047-924d-9311a0f4098c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:55.384581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60b2e7-4602-4047-924d-9311a0f4098c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:55.384764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60b2e7-4602-4047-924d-9311a0f4098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:55.449865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4e4e1618-c352-42ef-9a46-5a5d4d572a58 None None] MFA Rules not processed for user `fa9491d141c74065a3726c89cfde5d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:55.458295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4e4e1618-c352-42ef-9a46-5a5d4d572a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:55.470893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0c60b2e7-4602-4047-924d-9311a0f4098c None None] MFA Rules not processed for user `27cec5f2d6fd48e7861aab535615d43c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:55.474607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0c60b2e7-4602-4047-924d-9311a0f4098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:55.629845 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2546/5146] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:55.638502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e1618-c352-42ef-9a46-5a5d4d572a58 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:55.664482 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2601/5147] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:55.682144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb00bb-d8dd-4de9-9b7c-488634f6b9b2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:55.682740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb00bb-d8dd-4de9-9b7c-488634f6b9b2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:55.683193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb00bb-d8dd-4de9-9b7c-488634f6b9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:55.717720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fbfb00bb-d8dd-4de9-9b7c-488634f6b9b2 None None] MFA Rules not processed for user `0bfee91285f94b2eba5cd89004babf2e`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:55.721191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fbfb00bb-d8dd-4de9-9b7c-488634f6b9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:55.809989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e1618-c352-42ef-9a46-5a5d4d572a58 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:55.825171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3dcc3-7a01-47ca-b581-3faf81e898b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:55.828120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3dcc3-7a01-47ca-b581-3faf81e898b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:55.828638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3dcc3-7a01-47ca-b581-3faf81e898b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:55.829940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3dcc3-7a01-47ca-b581-3faf81e898b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:55.830840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3dcc3-7a01-47ca-b581-3faf81e898b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:55.838482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3dcc3-7a01-47ca-b581-3faf81e898b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:55.893632 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2602/5148] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:55.915683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb00bb-d8dd-4de9-9b7c-488634f6b9b2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:55.924430 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2547/5149] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:06:55 2022] POST /identity/v3/projects => generated 369 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:55.935436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb00bb-d8dd-4de9-9b7c-488634f6b9b2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:55.993336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3dcc3-7a01-47ca-b581-3faf81e898b0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:55.996611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a4b3dcc3-7a01-47ca-b581-3faf81e898b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:56.153512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402a69-7674-44a8-aa41-4f67ef33f1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:56.154969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402a69-7674-44a8-aa41-4f67ef33f1af admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:56.155264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402a69-7674-44a8-aa41-4f67ef33f1af admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:56.156640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402a69-7674-44a8-aa41-4f67ef33f1af admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:56.159374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402a69-7674-44a8-aa41-4f67ef33f1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:56.165798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402a69-7674-44a8-aa41-4f67ef33f1af admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:56.232766 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2603/5150] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:06:55 2022] POST /identity/v3/users => generated 285 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:06:56.238656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402a69-7674-44a8-aa41-4f67ef33f1af admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:56.262635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402a69-7674-44a8-aa41-4f67ef33f1af admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:56.270386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818c0d-8a4a-4d1d-a6b7-8a5cbf524030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:56.271374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818c0d-8a4a-4d1d-a6b7-8a5cbf524030 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:56.271845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818c0d-8a4a-4d1d-a6b7-8a5cbf524030 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:56.272846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1818c0d-8a4a-4d1d-a6b7-8a5cbf524030 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:56.273761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1818c0d-8a4a-4d1d-a6b7-8a5cbf524030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:56.276314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1818c0d-8a4a-4d1d-a6b7-8a5cbf524030 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:56.289579 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2604/5151] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:56.293711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818c0d-8a4a-4d1d-a6b7-8a5cbf524030 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:56.307435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1818c0d-8a4a-4d1d-a6b7-8a5cbf524030 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:56.315869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3dcc3-7a01-47ca-b581-3faf81e898b0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:56.316051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d98f-3c73-4682-9af1-6d5ddc6718c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:56.319624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d98f-3c73-4682-9af1-6d5ddc6718c7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:56.320891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d98f-3c73-4682-9af1-6d5ddc6718c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:56.321489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d98f-3c73-4682-9af1-6d5ddc6718c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:56.322929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95d98f-3c73-4682-9af1-6d5ddc6718c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:56.323067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:56.324186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:56.325556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95d98f-3c73-4682-9af1-6d5ddc6718c7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:56.325785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:56.326129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:56.330507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:56.381257 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2605/5152] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:06:56.417816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d98f-3c73-4682-9af1-6d5ddc6718c7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:56.471443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d98f-3c73-4682-9af1-6d5ddc6718c7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:56.495652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629eb87-e382-4ead-a56d-89c612483e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:56.497218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629eb87-e382-4ead-a56d-89c612483e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:56.497515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629eb87-e382-4ead-a56d-89c612483e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:56.497805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629eb87-e382-4ead-a56d-89c612483e5a admin admin] PATH_INFO: `/v3/projects/7c1b909fb2684b2d9b2f68797cad1a22/users/b123c997f585407481cd716afe1f502b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:56.552962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629eb87-e382-4ead-a56d-89c612483e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1b909fb2684b2d9b2f68797cad1a22, user_id=b123c997f585407481cd716afe1f502b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:56.558844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629eb87-e382-4ead-a56d-89c612483e5a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:56.607051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:56.610242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:56.611483 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2606/5153] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:06:56 2022] PUT /identity/v3/projects/7c1b909fb2684b2d9b2f68797cad1a22/users/b123c997f585407481cd716afe1f502b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:06:56.613816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11263ddd-3635-4437-9c6a-d429bcfebe8c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:56.614293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11263ddd-3635-4437-9c6a-d429bcfebe8c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:56.614745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11263ddd-3635-4437-9c6a-d429bcfebe8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:56.658018 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2548/5154] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:06:56.699723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-11263ddd-3635-4437-9c6a-d429bcfebe8c None None] MFA Rules not processed for user `b123c997f585407481cd716afe1f502b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:06:56.704642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-11263ddd-3635-4437-9c6a-d429bcfebe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:56.804163 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2607/5155] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:06:56.810707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:56.812345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:06:56.974174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a46aa-3903-40cb-8e7c-4626f6f96241 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:57.098663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be3026-22b3-49e5-b7a8-b2f70307184a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:57.099441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3026-22b3-49e5-b7a8-b2f70307184a service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:57.099731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3026-22b3-49e5-b7a8-b2f70307184a service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:57.100091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be3026-22b3-49e5-b7a8-b2f70307184a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:57.203322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be3026-22b3-49e5-b7a8-b2f70307184a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:57.207039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be3026-22b3-49e5-b7a8-b2f70307184a service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:57.246311 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2549/5156] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:06:57.505358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11263ddd-3635-4437-9c6a-d429bcfebe8c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:06:57.531369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11263ddd-3635-4437-9c6a-d429bcfebe8c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:06:57.536421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40646915-e980-4139-a05f-03e853714490 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:06:57.538208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40646915-e980-4139-a05f-03e853714490 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:06:57.538797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40646915-e980-4139-a05f-03e853714490 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:06:57.539403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40646915-e980-4139-a05f-03e853714490 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:06:57.553712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40646915-e980-4139-a05f-03e853714490 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:06:57.555560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40646915-e980-4139-a05f-03e853714490 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:06:57.597013 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2608/5157] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:06:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:00.214875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be3026-22b3-49e5-b7a8-b2f70307184a service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:00.349697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be3026-22b3-49e5-b7a8-b2f70307184a service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:00.363963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:00.368191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:00.370117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:00.370614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] PATH_INFO: `/v3/users/fa9491d141c74065a3726c89cfde5d2f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:00.373505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa9491d141c74065a3726c89cfde5d2f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:00.380486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:00.507666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa9491d141c74065a3726c89cfde5d2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:00.526218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa9491d141c74065a3726c89cfde5d2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:00.527585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa9491d141c74065a3726c89cfde5d2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:00.529449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa9491d141c74065a3726c89cfde5d2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:00.557148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa9491d141c74065a3726c89cfde5d2f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:00.591632 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2550/5158] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:00 2022] DELETE /identity/v3/users/fa9491d141c74065a3726c89cfde5d2f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:00.593127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e317-2b00-4c5c-bf3a-2a2326fb67a8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:00.594090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e317-2b00-4c5c-bf3a-2a2326fb67a8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:00.594553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e317-2b00-4c5c-bf3a-2a2326fb67a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:00.631537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4781e317-2b00-4c5c-bf3a-2a2326fb67a8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:00.638044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4781e317-2b00-4c5c-bf3a-2a2326fb67a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:00.807287 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2609/5159] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:00.867567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:00.869451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:01.080989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe075f-22d0-4ab0-80e8-28703305a37f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:01.096292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9567509-7da8-41b6-9789-49556229bd32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:01.097422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9567509-7da8-41b6-9789-49556229bd32 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:01.097818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9567509-7da8-41b6-9789-49556229bd32 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:01.098239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9567509-7da8-41b6-9789-49556229bd32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:01.119602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9567509-7da8-41b6-9789-49556229bd32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:01.124501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9567509-7da8-41b6-9789-49556229bd32 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:01.143541 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2551/5160] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:02.425490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb579f8-4fe9-4def-ba77-d7db0c52e68e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:02.426364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb579f8-4fe9-4def-ba77-d7db0c52e68e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:02.426895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb579f8-4fe9-4def-ba77-d7db0c52e68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:02.452516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0cb579f8-4fe9-4def-ba77-d7db0c52e68e None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:02.454096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0cb579f8-4fe9-4def-ba77-d7db0c52e68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:02.628894 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2610/5161] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:07:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:02.720551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9567509-7da8-41b6-9789-49556229bd32 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:02.722216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c9567509-7da8-41b6-9789-49556229bd32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:02.823564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9567509-7da8-41b6-9789-49556229bd32 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:02.832960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf0302-ccdc-4292-8b5d-d57c02342f07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:02.834554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0302-ccdc-4292-8b5d-d57c02342f07 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:02.834554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0302-ccdc-4292-8b5d-d57c02342f07 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:02.834922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf0302-ccdc-4292-8b5d-d57c02342f07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:02.845601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf0302-ccdc-4292-8b5d-d57c02342f07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:02.847771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf0302-ccdc-4292-8b5d-d57c02342f07 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:02.860715 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2552/5162] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:07:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:07:03.916839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb579f8-4fe9-4def-ba77-d7db0c52e68e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:03.918997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0cb579f8-4fe9-4def-ba77-d7db0c52e68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:03.952002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb579f8-4fe9-4def-ba77-d7db0c52e68e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:03.970244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:03.972321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:03.972613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:03.976555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] PATH_INFO: `/v3/projects/eb7e4d14596f43e6b006464a3e8f9415` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:03.981617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb7e4d14596f43e6b006464a3e8f9415)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:03.989128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:04.133043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb7e4d14596f43e6b006464a3e8f9415', 'request_id': 'req-4bf2c191-8702-4f24-8213-55b313020105'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.153401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb7e4d14596f43e6b006464a3e8f9415', 'request_id': 'req-4bf2c191-8702-4f24-8213-55b313020105'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.160706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb7e4d14596f43e6b006464a3e8f9415', 'request_id': 'req-4bf2c191-8702-4f24-8213-55b313020105'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.195281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] The token cache is being invalidate because project eb7e4d14596f43e6b006464a3e8f9415 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:04.195572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.208095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bf2c191-8702-4f24-8213-55b313020105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.210902 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2611/5163] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:03 2022] DELETE /identity/v3/projects/eb7e4d14596f43e6b006464a3e8f9415 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:04.214941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf0302-ccdc-4292-8b5d-d57c02342f07 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:04.233658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf0302-ccdc-4292-8b5d-d57c02342f07 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:04.443098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:04.452127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:04.454061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:04.454379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] PATH_INFO: `/v3/users/b123c997f585407481cd716afe1f502b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:04.460171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b123c997f585407481cd716afe1f502b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:04.462189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:04.589594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b123c997f585407481cd716afe1f502b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.607076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b123c997f585407481cd716afe1f502b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.608217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b123c997f585407481cd716afe1f502b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.609037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b123c997f585407481cd716afe1f502b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.637485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b123c997f585407481cd716afe1f502b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:04.661937 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2553/5164] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:04 2022] DELETE /identity/v3/users/b123c997f585407481cd716afe1f502b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:06.083159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0eb71-7c3c-4a08-8257-4cd7d1750609 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:06.083754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0eb71-7c3c-4a08-8257-4cd7d1750609 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:06.083754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0eb71-7c3c-4a08-8257-4cd7d1750609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:06.151412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-12d0eb71-7c3c-4a08-8257-4cd7d1750609 None None] MFA Rules not processed for user `c87af7ce66f048e3942c2846edb30c10`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:06.152697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-12d0eb71-7c3c-4a08-8257-4cd7d1750609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:06.291299 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2612/5165] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:06.554432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:06.555803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:06.709915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0eb71-7c3c-4a08-8257-4cd7d1750609 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:06.711566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-12d0eb71-7c3c-4a08-8257-4cd7d1750609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:06.757976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4257517-e5de-41e5-8a74-81666a8024ae admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:06.768118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324ab60-5e6b-4c14-a7f8-0f931e251ddd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:06.768788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324ab60-5e6b-4c14-a7f8-0f931e251ddd service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:06.769590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324ab60-5e6b-4c14-a7f8-0f931e251ddd service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:06.769590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324ab60-5e6b-4c14-a7f8-0f931e251ddd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:06.790639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324ab60-5e6b-4c14-a7f8-0f931e251ddd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:06.792320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324ab60-5e6b-4c14-a7f8-0f931e251ddd service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:06.814011 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2554/5166] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:06.964022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0eb71-7c3c-4a08-8257-4cd7d1750609 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:06.980642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:06.981532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:06.981815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:06.982090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] PATH_INFO: `/v3/projects/7c1b909fb2684b2d9b2f68797cad1a22` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:06.988837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1b909fb2684b2d9b2f68797cad1a22)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:06.991365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:07.087264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1b909fb2684b2d9b2f68797cad1a22', 'request_id': 'req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:07.112812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1b909fb2684b2d9b2f68797cad1a22', 'request_id': 'req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:07.125360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1b909fb2684b2d9b2f68797cad1a22', 'request_id': 'req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:07.137707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] The token cache is being invalidate because project 7c1b909fb2684b2d9b2f68797cad1a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:07.138395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:07.139285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fbf44175-cb1a-41ef-92ff-e1ef6e0e8ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:07.141109 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2613/5167] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:06 2022] DELETE /identity/v3/projects/7c1b909fb2684b2d9b2f68797cad1a22 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:07:07.147565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79521e-ad29-44b6-9c3b-e72c69adc443 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:07.148317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79521e-ad29-44b6-9c3b-e72c69adc443 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:07.148852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79521e-ad29-44b6-9c3b-e72c69adc443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:07.176551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4f79521e-ad29-44b6-9c3b-e72c69adc443 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:07.178207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4f79521e-ad29-44b6-9c3b-e72c69adc443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:07.250409 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2555/5168] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:07.258847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703477f-11c7-4ab6-b209-309210bbd1e3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:07.259498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703477f-11c7-4ab6-b209-309210bbd1e3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:07.260035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a703477f-11c7-4ab6-b209-309210bbd1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:07.294775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a703477f-11c7-4ab6-b209-309210bbd1e3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:07.298089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a703477f-11c7-4ab6-b209-309210bbd1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:07.317798 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2614/5169] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:07.322216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79521e-ad29-44b6-9c3b-e72c69adc443 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:07.333210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79521e-ad29-44b6-9c3b-e72c69adc443 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:07.349066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475bb01-8695-41ed-987d-2115b3663fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:07.350480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475bb01-8695-41ed-987d-2115b3663fdd admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:07.350866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475bb01-8695-41ed-987d-2115b3663fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:07.351248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475bb01-8695-41ed-987d-2115b3663fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:07.352122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475bb01-8695-41ed-987d-2115b3663fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:07:07.355679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475bb01-8695-41ed-987d-2115b3663fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:07.358126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475bb01-8695-41ed-987d-2115b3663fdd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:07.386405 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2556/5170] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:07:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:07:07.391045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703477f-11c7-4ab6-b209-309210bbd1e3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:07.403484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a703477f-11c7-4ab6-b209-309210bbd1e3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:07.409869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3a03-7fec-44e6-8f4f-2b5609f428a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:07.411022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3a03-7fec-44e6-8f4f-2b5609f428a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:07.411739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3a03-7fec-44e6-8f4f-2b5609f428a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:07.412848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a3a03-7fec-44e6-8f4f-2b5609f428a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:07.413998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a3a03-7fec-44e6-8f4f-2b5609f428a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:07.416401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35a3a03-7fec-44e6-8f4f-2b5609f428a0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:07.473529 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2615/5171] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:07 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:07:07.476709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475bb01-8695-41ed-987d-2115b3663fdd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:07.489095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475bb01-8695-41ed-987d-2115b3663fdd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:07.572426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bc657-94b3-4aa2-b9a1-acde4ac5475e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:07.574157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bc657-94b3-4aa2-b9a1-acde4ac5475e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:07.575023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bc657-94b3-4aa2-b9a1-acde4ac5475e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:07.575542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bc657-94b3-4aa2-b9a1-acde4ac5475e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:07.577402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bc657-94b3-4aa2-b9a1-acde4ac5475e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:07.599309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bc657-94b3-4aa2-b9a1-acde4ac5475e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:07.650397 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2557/5172] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:07:07 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:07.654620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3a03-7fec-44e6-8f4f-2b5609f428a0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:07.669967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a3a03-7fec-44e6-8f4f-2b5609f428a0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:07.684783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4c20b-3bca-4708-948f-2509b3f125ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:07.685667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4c20b-3bca-4708-948f-2509b3f125ea admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:07.686198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4c20b-3bca-4708-948f-2509b3f125ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:07.686889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4c20b-3bca-4708-948f-2509b3f125ea admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:07.687852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4c20b-3bca-4708-948f-2509b3f125ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:07.689765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4c20b-3bca-4708-948f-2509b3f125ea admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:07.721059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bc657-94b3-4aa2-b9a1-acde4ac5475e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:07.732919 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2616/5173] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:07.736377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bc657-94b3-4aa2-b9a1-acde4ac5475e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:07.752976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8482884d-78e8-4e4c-beeb-edc5903625de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:07.754258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482884d-78e8-4e4c-beeb-edc5903625de admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:07.754822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482884d-78e8-4e4c-beeb-edc5903625de admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:07.755522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8482884d-78e8-4e4c-beeb-edc5903625de admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:07.757243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482884d-78e8-4e4c-beeb-edc5903625de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:07.759180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8482884d-78e8-4e4c-beeb-edc5903625de admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:07.787458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4c20b-3bca-4708-948f-2509b3f125ea admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:07.800308 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2558/5174] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:07.803819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4c20b-3bca-4708-948f-2509b3f125ea admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:07.816425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8c83b-d848-4aef-bf13-437db5dff148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:07.819809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8c83b-d848-4aef-bf13-437db5dff148 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:07.820117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8c83b-d848-4aef-bf13-437db5dff148 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:07.821582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8c83b-d848-4aef-bf13-437db5dff148 admin admin] PATH_INFO: `/v3/projects/6ba52620a259451b980af355d2b6f6f1/users/9dbd0898e3e44a2b9d28c38ce516b95f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:07.863382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8c83b-d848-4aef-bf13-437db5dff148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ba52620a259451b980af355d2b6f6f1, user_id=9dbd0898e3e44a2b9d28c38ce516b95f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:07.866541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8c83b-d848-4aef-bf13-437db5dff148 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:07.915053 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2617/5175] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:07 2022] PUT /identity/v3/projects/6ba52620a259451b980af355d2b6f6f1/users/9dbd0898e3e44a2b9d28c38ce516b95f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:07.927562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d80d24-ac63-4212-9a99-7f70edc7f6bb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:07.928429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d80d24-ac63-4212-9a99-7f70edc7f6bb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:07.928837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d80d24-ac63-4212-9a99-7f70edc7f6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:08.049236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a9d80d24-ac63-4212-9a99-7f70edc7f6bb None None] MFA Rules not processed for user `9dbd0898e3e44a2b9d28c38ce516b95f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:08.053392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a9d80d24-ac63-4212-9a99-7f70edc7f6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:08.269762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8c83b-d848-4aef-bf13-437db5dff148 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:08.271462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2fe8c83b-d848-4aef-bf13-437db5dff148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:08.315142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2559/5176] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:08.319611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d80d24-ac63-4212-9a99-7f70edc7f6bb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:08.522314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d80d24-ac63-4212-9a99-7f70edc7f6bb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:08.535306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8c83b-d848-4aef-bf13-437db5dff148 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:08.540530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5926c4-b248-4d0c-9caa-8a262e1ecbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:08.541204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5926c4-b248-4d0c-9caa-8a262e1ecbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:08.541513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5926c4-b248-4d0c-9caa-8a262e1ecbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:08.541767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5926c4-b248-4d0c-9caa-8a262e1ecbd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:08.542499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5926c4-b248-4d0c-9caa-8a262e1ecbd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:08.544522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5926c4-b248-4d0c-9caa-8a262e1ecbd6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:08.554219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609505d-c77d-4353-9d4e-805e8e0394dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:08.555191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609505d-c77d-4353-9d4e-805e8e0394dc service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:08.555636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609505d-c77d-4353-9d4e-805e8e0394dc service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:08.556144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609505d-c77d-4353-9d4e-805e8e0394dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:08.560985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c609505d-c77d-4353-9d4e-805e8e0394dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:08.590115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609505d-c77d-4353-9d4e-805e8e0394dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:08.594946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609505d-c77d-4353-9d4e-805e8e0394dc service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:08.618705 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2560/5177] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:08 2022] POST /identity/v3/projects => generated 385 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:08.623381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5926c4-b248-4d0c-9caa-8a262e1ecbd6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:08.632703 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2618/5178] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:07:08.700110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5926c4-b248-4d0c-9caa-8a262e1ecbd6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:08.706939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5da34-abbc-4e30-be30-ade22c723d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:08.707906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5da34-abbc-4e30-be30-ade22c723d8a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:08.708923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5da34-abbc-4e30-be30-ade22c723d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:08.709893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5da34-abbc-4e30-be30-ade22c723d8a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:08.711507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5da34-abbc-4e30-be30-ade22c723d8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:08.716930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5da34-abbc-4e30-be30-ade22c723d8a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:08.764263 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2561/5179] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:07:08 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:08.766208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609505d-c77d-4353-9d4e-805e8e0394dc service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:08.782585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609505d-c77d-4353-9d4e-805e8e0394dc service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:08.794933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b27ed6-e2ca-45cc-87e9-e3e2f650e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:08.795610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27ed6-e2ca-45cc-87e9-e3e2f650e683 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:08.795890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27ed6-e2ca-45cc-87e9-e3e2f650e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:08.796187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27ed6-e2ca-45cc-87e9-e3e2f650e683 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:08.796916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b27ed6-e2ca-45cc-87e9-e3e2f650e683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:08.798519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b27ed6-e2ca-45cc-87e9-e3e2f650e683 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:08.826417 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2619/5180] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:08.829100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5da34-abbc-4e30-be30-ade22c723d8a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:08.843091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5da34-abbc-4e30-be30-ade22c723d8a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:08.870939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eddba-0b89-4b82-aaed-1cc2f7c5f35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:08.871633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eddba-0b89-4b82-aaed-1cc2f7c5f35d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:08.872302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eddba-0b89-4b82-aaed-1cc2f7c5f35d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:08.872600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eddba-0b89-4b82-aaed-1cc2f7c5f35d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:08.873312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3eddba-0b89-4b82-aaed-1cc2f7c5f35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:08.874939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3eddba-0b89-4b82-aaed-1cc2f7c5f35d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:08.909872 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2562/5181] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:08.914815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b27ed6-e2ca-45cc-87e9-e3e2f650e683 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:08.928227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b27ed6-e2ca-45cc-87e9-e3e2f650e683 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:08.964700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58387d67-ed30-4ac7-b0dc-4f97e9b873de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:08.965607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58387d67-ed30-4ac7-b0dc-4f97e9b873de admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:08.965891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58387d67-ed30-4ac7-b0dc-4f97e9b873de admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:08.968274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58387d67-ed30-4ac7-b0dc-4f97e9b873de admin admin] PATH_INFO: `/v3/projects/a0af6e1590124c94a0abe9f3aa151979/users/8f86c5ea0aa648dc8dde3e56474684d1/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:09.030123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58387d67-ed30-4ac7-b0dc-4f97e9b873de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0af6e1590124c94a0abe9f3aa151979, user_id=8f86c5ea0aa648dc8dde3e56474684d1, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:09.032945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58387d67-ed30-4ac7-b0dc-4f97e9b873de admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:09.064406 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2620/5182] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:08 2022] PUT /identity/v3/projects/a0af6e1590124c94a0abe9f3aa151979/users/8f86c5ea0aa648dc8dde3e56474684d1/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:09.076535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11426c2-f64c-46d6-98c4-d77cced14596 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:09.076822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11426c2-f64c-46d6-98c4-d77cced14596 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:09.077106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11426c2-f64c-46d6-98c4-d77cced14596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:09.135557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b11426c2-f64c-46d6-98c4-d77cced14596 None None] MFA Rules not processed for user `8f86c5ea0aa648dc8dde3e56474684d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:09.136577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b11426c2-f64c-46d6-98c4-d77cced14596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:09.275932 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2563/5183] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:09.292170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58387d67-ed30-4ac7-b0dc-4f97e9b873de admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:09.293906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-58387d67-ed30-4ac7-b0dc-4f97e9b873de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:09.471089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58387d67-ed30-4ac7-b0dc-4f97e9b873de admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:09.486841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78000c7e-4e4b-48af-a334-bb4a279b1381 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:09.488053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78000c7e-4e4b-48af-a334-bb4a279b1381 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:09.488705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78000c7e-4e4b-48af-a334-bb4a279b1381 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:09.489467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78000c7e-4e4b-48af-a334-bb4a279b1381 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:09.661585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78000c7e-4e4b-48af-a334-bb4a279b1381 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:09.664531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78000c7e-4e4b-48af-a334-bb4a279b1381 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:09.702354 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2621/5184] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:09.918590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11426c2-f64c-46d6-98c4-d77cced14596 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:09.938012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11426c2-f64c-46d6-98c4-d77cced14596 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:09.961782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf4719-054d-4000-9487-6433d14b8d42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:09.965315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4719-054d-4000-9487-6433d14b8d42 service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:09.969086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4719-054d-4000-9487-6433d14b8d42 service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:09.970205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf4719-054d-4000-9487-6433d14b8d42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:10.025758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf4719-054d-4000-9487-6433d14b8d42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:10.027515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf4719-054d-4000-9487-6433d14b8d42 service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:10.041155 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2564/5185] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:10.849556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78000c7e-4e4b-48af-a334-bb4a279b1381 service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:11.040747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78000c7e-4e4b-48af-a334-bb4a279b1381 service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:11.054445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:11.055343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:11.056129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:11.056587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] PATH_INFO: `/v3/users/9dbd0898e3e44a2b9d28c38ce516b95f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:11.058051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbd0898e3e44a2b9d28c38ce516b95f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:11.085577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:11.182292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbd0898e3e44a2b9d28c38ce516b95f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:11.193000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbd0898e3e44a2b9d28c38ce516b95f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:11.194682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbd0898e3e44a2b9d28c38ce516b95f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:11.197288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbd0898e3e44a2b9d28c38ce516b95f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:11.229776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbd0898e3e44a2b9d28c38ce516b95f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:11.282360 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2622/5186] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:10 2022] DELETE /identity/v3/users/9dbd0898e3e44a2b9d28c38ce516b95f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:11.286719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758b4c-def5-4fa9-957f-223bac97a069 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:11.287736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758b4c-def5-4fa9-957f-223bac97a069 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:11.287941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758b4c-def5-4fa9-957f-223bac97a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:11.347117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-83758b4c-def5-4fa9-957f-223bac97a069 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:11.349326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-83758b4c-def5-4fa9-957f-223bac97a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:11.506761 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2565/5187] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:11.535132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:11.536655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:11.730690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bae2ef-2582-4e3c-8338-18cac0347689 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:11.743658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fedf54-b66b-4d2d-8ca0-404b3afb00d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:11.744604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fedf54-b66b-4d2d-8ca0-404b3afb00d4 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:11.745082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fedf54-b66b-4d2d-8ca0-404b3afb00d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:11.745529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fedf54-b66b-4d2d-8ca0-404b3afb00d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:11.766004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fedf54-b66b-4d2d-8ca0-404b3afb00d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:11.772144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fedf54-b66b-4d2d-8ca0-404b3afb00d4 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:11.813044 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2623/5188] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:12.438549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83758b4c-def5-4fa9-957f-223bac97a069 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:12.440902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-83758b4c-def5-4fa9-957f-223bac97a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:12.456689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83758b4c-def5-4fa9-957f-223bac97a069 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:12.465787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:12.466784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:12.467159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:12.467524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] PATH_INFO: `/v3/projects/6ba52620a259451b980af355d2b6f6f1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:12.472646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ba52620a259451b980af355d2b6f6f1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:12.475388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:12.576501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ba52620a259451b980af355d2b6f6f1', 'request_id': 'req-e85e9b29-2111-42df-97e2-00209ca832b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:12.595082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ba52620a259451b980af355d2b6f6f1', 'request_id': 'req-e85e9b29-2111-42df-97e2-00209ca832b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:12.603972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ba52620a259451b980af355d2b6f6f1', 'request_id': 'req-e85e9b29-2111-42df-97e2-00209ca832b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:12.648585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] The token cache is being invalidate because project 6ba52620a259451b980af355d2b6f6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:12.649207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:12.651044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e85e9b29-2111-42df-97e2-00209ca832b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:12.654333 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2566/5189] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:12 2022] DELETE /identity/v3/projects/6ba52620a259451b980af355d2b6f6f1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:12.657987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fedf54-b66b-4d2d-8ca0-404b3afb00d4 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:12.680098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fedf54-b66b-4d2d-8ca0-404b3afb00d4 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:12.904708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:12.905716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:12.906067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:12.906404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] PATH_INFO: `/v3/users/8f86c5ea0aa648dc8dde3e56474684d1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:12.907732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f86c5ea0aa648dc8dde3e56474684d1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:12.909780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:13.001488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f86c5ea0aa648dc8dde3e56474684d1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:13.031606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f86c5ea0aa648dc8dde3e56474684d1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:13.032455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f86c5ea0aa648dc8dde3e56474684d1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:13.033187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f86c5ea0aa648dc8dde3e56474684d1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:13.052751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f86c5ea0aa648dc8dde3e56474684d1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:13.099848 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2624/5190] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:12 2022] DELETE /identity/v3/users/8f86c5ea0aa648dc8dde3e56474684d1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:07:13.845055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55df2-224e-4ade-9968-adcdef53d509 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:13.845959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55df2-224e-4ade-9968-adcdef53d509 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:13.846438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c55df2-224e-4ade-9968-adcdef53d509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:13.878673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a9c55df2-224e-4ade-9968-adcdef53d509 None None] MFA Rules not processed for user `c87af7ce66f048e3942c2846edb30c10`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:13.880941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a9c55df2-224e-4ade-9968-adcdef53d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:14.012093 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2567/5191] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:14.421938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:14.424176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:14.565729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6b14f-a742-4cb8-98ed-0f496d7554cd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:14.574875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43502981-22cf-4f04-802b-1aca1455267e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:14.575549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43502981-22cf-4f04-802b-1aca1455267e service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:14.575833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43502981-22cf-4f04-802b-1aca1455267e service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:14.576140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43502981-22cf-4f04-802b-1aca1455267e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:14.578624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-43502981-22cf-4f04-802b-1aca1455267e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:14.596167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43502981-22cf-4f04-802b-1aca1455267e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:14.597948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43502981-22cf-4f04-802b-1aca1455267e service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:14.624271 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2625/5192] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:15.638693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c55df2-224e-4ade-9968-adcdef53d509 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:15.645528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a9c55df2-224e-4ade-9968-adcdef53d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:15.766258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c55df2-224e-4ade-9968-adcdef53d509 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:15.774018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:15.775377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:15.775891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:15.776426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] PATH_INFO: `/v3/projects/a0af6e1590124c94a0abe9f3aa151979` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:15.779411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0af6e1590124c94a0abe9f3aa151979)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:15.781980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:15.904935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0af6e1590124c94a0abe9f3aa151979', 'request_id': 'req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:15.916226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0af6e1590124c94a0abe9f3aa151979', 'request_id': 'req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:15.926516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0af6e1590124c94a0abe9f3aa151979', 'request_id': 'req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:15.970543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] The token cache is being invalidate because project a0af6e1590124c94a0abe9f3aa151979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:15.970681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:15.971334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-afbe2c7f-a615-414a-bd0b-6714cd99bdc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:15.973791 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2568/5193] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:15 2022] DELETE /identity/v3/projects/a0af6e1590124c94a0abe9f3aa151979 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:15.981430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e66563-f496-432d-a115-ae0990c255f5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:15.981990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e66563-f496-432d-a115-ae0990c255f5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:15.981990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e66563-f496-432d-a115-ae0990c255f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:16.003199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f6e66563-f496-432d-a115-ae0990c255f5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:16.004552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f6e66563-f496-432d-a115-ae0990c255f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:16.154852 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2626/5194] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:16.163992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459d286-e269-40ac-90be-d3500ead2450 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:16.164285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459d286-e269-40ac-90be-d3500ead2450 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:16.164561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b459d286-e269-40ac-90be-d3500ead2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:16.211960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b459d286-e269-40ac-90be-d3500ead2450 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:16.213207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b459d286-e269-40ac-90be-d3500ead2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:16.260851 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2569/5195] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:16.264939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e66563-f496-432d-a115-ae0990c255f5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:16.286500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e66563-f496-432d-a115-ae0990c255f5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:16.302315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d830c37-1c11-47c9-820d-7e914185b855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:16.303080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d830c37-1c11-47c9-820d-7e914185b855 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:16.303287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d830c37-1c11-47c9-820d-7e914185b855 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:16.303564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d830c37-1c11-47c9-820d-7e914185b855 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:16.308487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d830c37-1c11-47c9-820d-7e914185b855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:07:16.308876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d830c37-1c11-47c9-820d-7e914185b855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:16.311381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d830c37-1c11-47c9-820d-7e914185b855 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:16.367835 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2627/5196] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:07:16.372239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459d286-e269-40ac-90be-d3500ead2450 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:16.385985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b459d286-e269-40ac-90be-d3500ead2450 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:16.400662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac4da9-04e4-4e82-b995-f130f968ec1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:16.402199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac4da9-04e4-4e82-b995-f130f968ec1d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:16.406711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac4da9-04e4-4e82-b995-f130f968ec1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:16.407767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac4da9-04e4-4e82-b995-f130f968ec1d admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:16.411407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac4da9-04e4-4e82-b995-f130f968ec1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:16.413901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac4da9-04e4-4e82-b995-f130f968ec1d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:16.477450 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2570/5197] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:16 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:16.481397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d830c37-1c11-47c9-820d-7e914185b855 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:16.507322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d830c37-1c11-47c9-820d-7e914185b855 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:16.669972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda5c9f-ee4e-4dff-88b3-c366ef6f95a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:16.670767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda5c9f-ee4e-4dff-88b3-c366ef6f95a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:16.671274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda5c9f-ee4e-4dff-88b3-c366ef6f95a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:16.671672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda5c9f-ee4e-4dff-88b3-c366ef6f95a0 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:16.672529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda5c9f-ee4e-4dff-88b3-c366ef6f95a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:16.677020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda5c9f-ee4e-4dff-88b3-c366ef6f95a0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:16.729428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac4da9-04e4-4e82-b995-f130f968ec1d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:16.732799 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2628/5198] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:07:16 2022] POST /identity/v3/users => generated 279 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:16.745220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac4da9-04e4-4e82-b995-f130f968ec1d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:16.776894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d67b59-2d82-412e-a214-95afd0b2f6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:16.778696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67b59-2d82-412e-a214-95afd0b2f6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:16.781720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67b59-2d82-412e-a214-95afd0b2f6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:16.782920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d67b59-2d82-412e-a214-95afd0b2f6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:16.787075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d67b59-2d82-412e-a214-95afd0b2f6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:16.792382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d67b59-2d82-412e-a214-95afd0b2f6b9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:16.840747 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2571/5199] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:16.842314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda5c9f-ee4e-4dff-88b3-c366ef6f95a0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:16.911455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda5c9f-ee4e-4dff-88b3-c366ef6f95a0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:16.918512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b4c1e-021d-455a-ac14-9dc3addf779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:16.919415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b4c1e-021d-455a-ac14-9dc3addf779a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:16.919652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b4c1e-021d-455a-ac14-9dc3addf779a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:16.920770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b4c1e-021d-455a-ac14-9dc3addf779a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:16.924097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b4c1e-021d-455a-ac14-9dc3addf779a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:16.926408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b4c1e-021d-455a-ac14-9dc3addf779a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:16.953258 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2629/5200] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:16.953508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d67b59-2d82-412e-a214-95afd0b2f6b9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:16.975035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d67b59-2d82-412e-a214-95afd0b2f6b9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:16.993904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed7d40-6380-4aae-a44f-a4444133cfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:16.994909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed7d40-6380-4aae-a44f-a4444133cfe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:16.995244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed7d40-6380-4aae-a44f-a4444133cfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:16.995713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed7d40-6380-4aae-a44f-a4444133cfe1 admin admin] PATH_INFO: `/v3/projects/96d4342325114cc898aa857a553ed958/users/fa3fd24ba1eb4353b5dad9b0a098506c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:17.076299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed7d40-6380-4aae-a44f-a4444133cfe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d4342325114cc898aa857a553ed958, user_id=fa3fd24ba1eb4353b5dad9b0a098506c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:17.082029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed7d40-6380-4aae-a44f-a4444133cfe1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:17.137450 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2572/5201] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:16 2022] PUT /identity/v3/projects/96d4342325114cc898aa857a553ed958/users/fa3fd24ba1eb4353b5dad9b0a098506c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:17.137821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73906fc-d15d-469b-862b-9d2b6e6714e5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:17.138288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73906fc-d15d-469b-862b-9d2b6e6714e5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:17.138398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73906fc-d15d-469b-862b-9d2b6e6714e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:17.218584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f73906fc-d15d-469b-862b-9d2b6e6714e5 None None] MFA Rules not processed for user `fa3fd24ba1eb4353b5dad9b0a098506c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:17.219834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f73906fc-d15d-469b-862b-9d2b6e6714e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:17.369210 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2630/5202] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Mar 26 21:07:17.373940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed7d40-6380-4aae-a44f-a4444133cfe1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:17.501419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed7d40-6380-4aae-a44f-a4444133cfe1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:17.515325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffa160-961b-43f3-b03d-9c7ccca8678c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:17.517406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa160-961b-43f3-b03d-9c7ccca8678c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:17.517693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa160-961b-43f3-b03d-9c7ccca8678c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:17.518063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffa160-961b-43f3-b03d-9c7ccca8678c admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:17.520835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffa160-961b-43f3-b03d-9c7ccca8678c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:17.524471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffa160-961b-43f3-b03d-9c7ccca8678c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:17.594032 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2573/5203] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:17 2022] POST /identity/v3/projects => generated 357 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:17.595249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73906fc-d15d-469b-862b-9d2b6e6714e5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:17.613011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73906fc-d15d-469b-862b-9d2b6e6714e5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:17.828533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f5aac-eb61-447a-b60e-e5b82121c11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:17.830906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f5aac-eb61-447a-b60e-e5b82121c11a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:17.831287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f5aac-eb61-447a-b60e-e5b82121c11a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:17.831693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f5aac-eb61-447a-b60e-e5b82121c11a admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:17.832932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f5aac-eb61-447a-b60e-e5b82121c11a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:17.835135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069f5aac-eb61-447a-b60e-e5b82121c11a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:17.885495 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2631/5204] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:07:17 2022] POST /identity/v3/users => generated 285 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:07:17.890081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffa160-961b-43f3-b03d-9c7ccca8678c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:17.913745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffa160-961b-43f3-b03d-9c7ccca8678c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:17.920974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7f53c-51aa-4488-826c-8d6e108cb6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:17.921778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f53c-51aa-4488-826c-8d6e108cb6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:17.922163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f53c-51aa-4488-826c-8d6e108cb6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:17.924052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f53c-51aa-4488-826c-8d6e108cb6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:17.925319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7f53c-51aa-4488-826c-8d6e108cb6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:17.927759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7f53c-51aa-4488-826c-8d6e108cb6b2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:17.950375 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2574/5205] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:17.951784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f5aac-eb61-447a-b60e-e5b82121c11a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:17.965258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069f5aac-eb61-447a-b60e-e5b82121c11a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:17.984979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693d02-30f6-4a88-8017-7151f6fd582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:17.987278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693d02-30f6-4a88-8017-7151f6fd582d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:17.990023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693d02-30f6-4a88-8017-7151f6fd582d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:17.990603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31693d02-30f6-4a88-8017-7151f6fd582d admin admin] PATH_INFO: `/v3/projects/233ddbe3a45640159135c257774bcc19/users/821f01a0e7cb4643bee04332cac92b70/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:18.038150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31693d02-30f6-4a88-8017-7151f6fd582d admin admin] RBAC: Authorizing `identity:create_grant(project_id=233ddbe3a45640159135c257774bcc19, user_id=821f01a0e7cb4643bee04332cac92b70, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:18.048366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31693d02-30f6-4a88-8017-7151f6fd582d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:18.108783 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2632/5206] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:17 2022] PUT /identity/v3/projects/233ddbe3a45640159135c257774bcc19/users/821f01a0e7cb4643bee04332cac92b70/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:18.112573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7f53c-51aa-4488-826c-8d6e108cb6b2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:18.141950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7f53c-51aa-4488-826c-8d6e108cb6b2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:18.259110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001641bf-bf18-4dfe-96f6-c6938c176f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:18.260468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001641bf-bf18-4dfe-96f6-c6938c176f35 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:18.261181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001641bf-bf18-4dfe-96f6-c6938c176f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:18.261743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001641bf-bf18-4dfe-96f6-c6938c176f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:18.264658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001641bf-bf18-4dfe-96f6-c6938c176f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:18.275328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001641bf-bf18-4dfe-96f6-c6938c176f35 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:18.294864 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2575/5207] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:07:18.299187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693d02-30f6-4a88-8017-7151f6fd582d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:18.319893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31693d02-30f6-4a88-8017-7151f6fd582d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:18.334805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65917f58-7ca4-453d-8579-7e5016801691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:18.336551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65917f58-7ca4-453d-8579-7e5016801691 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:18.336839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65917f58-7ca4-453d-8579-7e5016801691 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:18.339391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65917f58-7ca4-453d-8579-7e5016801691 admin admin] PATH_INFO: `/v3/projects/233ddbe3a45640159135c257774bcc19/users/821f01a0e7cb4643bee04332cac92b70/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:18.345136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65917f58-7ca4-453d-8579-7e5016801691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=233ddbe3a45640159135c257774bcc19, user_id=821f01a0e7cb4643bee04332cac92b70, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:18.355475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65917f58-7ca4-453d-8579-7e5016801691 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:18.415179 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2633/5208] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:18 2022] PUT /identity/v3/projects/233ddbe3a45640159135c257774bcc19/users/821f01a0e7cb4643bee04332cac92b70/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:18.417452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564174b9-598a-49ef-a5d1-1d40d1a7fe3e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:18.417810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564174b9-598a-49ef-a5d1-1d40d1a7fe3e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:18.418114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564174b9-598a-49ef-a5d1-1d40d1a7fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:18.549816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-564174b9-598a-49ef-a5d1-1d40d1a7fe3e None None] MFA Rules not processed for user `821f01a0e7cb4643bee04332cac92b70`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:18.551062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-564174b9-598a-49ef-a5d1-1d40d1a7fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:18.705043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65917f58-7ca4-453d-8579-7e5016801691 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:18.705973 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2576/5209] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:18 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:18.721678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65917f58-7ca4-453d-8579-7e5016801691 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:18.738205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc122d-9bce-4351-bd10-eb2718868d32 tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821f01a0e7cb4643bee04332cac92b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '233ddbe3a45640159135c257774bcc19', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:18.739202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc122d-9bce-4351-bd10-eb2718868d32 tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:18.739497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc122d-9bce-4351-bd10-eb2718868d32 tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:18.739781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc122d-9bce-4351-bd10-eb2718868d32 tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:18.741062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc122d-9bce-4351-bd10-eb2718868d32 tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:07:18.741397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc122d-9bce-4351-bd10-eb2718868d32 tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:18.743068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc122d-9bce-4351-bd10-eb2718868d32 tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:18.769909 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2634/5210] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:07:18.774555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564174b9-598a-49ef-a5d1-1d40d1a7fe3e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:18.801921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564174b9-598a-49ef-a5d1-1d40d1a7fe3e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:18.826736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53b78-fc6b-4c76-aac2-b0823097aaea tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821f01a0e7cb4643bee04332cac92b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '233ddbe3a45640159135c257774bcc19', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:18.827650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53b78-fc6b-4c76-aac2-b0823097aaea tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:18.828099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53b78-fc6b-4c76-aac2-b0823097aaea tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:18.828417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53b78-fc6b-4c76-aac2-b0823097aaea tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:18.829187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d53b78-fc6b-4c76-aac2-b0823097aaea tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:18.838105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d53b78-fc6b-4c76-aac2-b0823097aaea tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:18.914234 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2577/5211] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:18 2022] POST /identity/v3/projects => generated 350 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:18.915534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc122d-9bce-4351-bd10-eb2718868d32 tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:18.927474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc122d-9bce-4351-bd10-eb2718868d32 tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:19.034706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48659aa-b48a-448c-b28a-f03f85594afe tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821f01a0e7cb4643bee04332cac92b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '233ddbe3a45640159135c257774bcc19', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:19.035517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48659aa-b48a-448c-b28a-f03f85594afe tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:19.035902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48659aa-b48a-448c-b28a-f03f85594afe tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:19.036309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48659aa-b48a-448c-b28a-f03f85594afe tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:19.037316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48659aa-b48a-448c-b28a-f03f85594afe tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:07:19.037836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48659aa-b48a-448c-b28a-f03f85594afe tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:19.039959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48659aa-b48a-448c-b28a-f03f85594afe tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:19.057347 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2635/5212] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:07:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:07:19.069823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53b78-fc6b-4c76-aac2-b0823097aaea tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:19.081528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-46d53b78-fc6b-4c76-aac2-b0823097aaea tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:19.181468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53b78-fc6b-4c76-aac2-b0823097aaea tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:19.187954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eff87-44d6-4553-a983-e0d4209e1fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:19.189510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eff87-44d6-4553-a983-e0d4209e1fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:19.190015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eff87-44d6-4553-a983-e0d4209e1fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:19.190517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98eff87-44d6-4553-a983-e0d4209e1fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:19.205002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98eff87-44d6-4553-a983-e0d4209e1fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:19.207026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98eff87-44d6-4553-a983-e0d4209e1fd4 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:19.219392 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2578/5213] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:19 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:19.843747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48659aa-b48a-448c-b28a-f03f85594afe tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:19.865084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48659aa-b48a-448c-b28a-f03f85594afe tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:19.877976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821f01a0e7cb4643bee04332cac92b70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '233ddbe3a45640159135c257774bcc19', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:19.879112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:19.879574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:19.880105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] PATH_INFO: `/v3/projects/46ef465e07114dbcb9dc06d758723aaf` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:19.885306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Authorizing `identity:delete_project(project_id=46ef465e07114dbcb9dc06d758723aaf)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:19.888104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:20.014808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46ef465e07114dbcb9dc06d758723aaf', 'request_id': 'req-8d1fceba-0947-496c-834d-fc1580f260ab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:20.038492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46ef465e07114dbcb9dc06d758723aaf', 'request_id': 'req-8d1fceba-0947-496c-834d-fc1580f260ab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:20.058824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46ef465e07114dbcb9dc06d758723aaf', 'request_id': 'req-8d1fceba-0947-496c-834d-fc1580f260ab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:20.096347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] The token cache is being invalidate because project 46ef465e07114dbcb9dc06d758723aaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:20.096640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:20.097299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:20.103376 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2636/5214] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:19 2022] DELETE /identity/v3/projects/46ef465e07114dbcb9dc06d758723aaf => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:20.771639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eff87-44d6-4553-a983-e0d4209e1fd4 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:20.773740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e98eff87-44d6-4553-a983-e0d4209e1fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:20.957201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98eff87-44d6-4553-a983-e0d4209e1fd4 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:21.162628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e5aec-a827-43bd-893b-2b61c61fad12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:21.163340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e5aec-a827-43bd-893b-2b61c61fad12 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:21.163627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e5aec-a827-43bd-893b-2b61c61fad12 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:21.163900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e5aec-a827-43bd-893b-2b61c61fad12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:21.175072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d1e5aec-a827-43bd-893b-2b61c61fad12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:21.184666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:21.187135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:21.351492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1fceba-0947-496c-834d-fc1580f260ab tempest-QuotasTest-1011489452 tempest-QuotasTest-1011489452-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:21.361921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:21.363299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:21.364435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:21.365550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] PATH_INFO: `/v3/users/fa3fd24ba1eb4353b5dad9b0a098506c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:21.367374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3fd24ba1eb4353b5dad9b0a098506c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:21.370375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:21.371334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e5aec-a827-43bd-893b-2b61c61fad12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:21.373183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e5aec-a827-43bd-893b-2b61c61fad12 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:21.440126 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2579/5215] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:07:21.532778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3fd24ba1eb4353b5dad9b0a098506c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:21.559732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3fd24ba1eb4353b5dad9b0a098506c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:21.569469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3fd24ba1eb4353b5dad9b0a098506c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:21.571438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3fd24ba1eb4353b5dad9b0a098506c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:21.590622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3fd24ba1eb4353b5dad9b0a098506c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:21.653996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90065c9a-b610-41b8-83ed-07fe0045002c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:21.654285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90065c9a-b610-41b8-83ed-07fe0045002c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:21.654569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90065c9a-b610-41b8-83ed-07fe0045002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:21.656464 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2637/5216] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:21 2022] DELETE /identity/v3/users/fa3fd24ba1eb4353b5dad9b0a098506c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:21.715077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-90065c9a-b610-41b8-83ed-07fe0045002c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:21.716440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-90065c9a-b610-41b8-83ed-07fe0045002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:21.929210 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2580/5217] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:21.956921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:21.958501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:22.107685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a8c23-40bb-489e-8037-3587145ce524 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:22.117042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b557b4-fb36-4321-aa74-099a2dcd3203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:22.117774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b557b4-fb36-4321-aa74-099a2dcd3203 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:22.118142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b557b4-fb36-4321-aa74-099a2dcd3203 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:22.118474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b557b4-fb36-4321-aa74-099a2dcd3203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:22.152981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b557b4-fb36-4321-aa74-099a2dcd3203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:22.154475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b557b4-fb36-4321-aa74-099a2dcd3203 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:22.173508 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2638/5218] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:23.053361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90065c9a-b610-41b8-83ed-07fe0045002c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:23.055163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-90065c9a-b610-41b8-83ed-07fe0045002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:23.072970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90065c9a-b610-41b8-83ed-07fe0045002c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:23.080358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:23.081229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:23.081517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:23.081821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] PATH_INFO: `/v3/projects/96d4342325114cc898aa857a553ed958` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:23.083038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d4342325114cc898aa857a553ed958)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:23.086700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:23.220685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d4342325114cc898aa857a553ed958', 'request_id': 'req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.237747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d4342325114cc898aa857a553ed958', 'request_id': 'req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.246447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d4342325114cc898aa857a553ed958', 'request_id': 'req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.281893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] The token cache is being invalidate because project 96d4342325114cc898aa857a553ed958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:23.282440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.283848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.292363 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2581/5219] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:23 2022] DELETE /identity/v3/projects/96d4342325114cc898aa857a553ed958 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:23.294162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b557b4-fb36-4321-aa74-099a2dcd3203 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:23.310671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b557b4-fb36-4321-aa74-099a2dcd3203 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:23.414966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:23.415840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:23.416161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:23.416607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] PATH_INFO: `/v3/users/821f01a0e7cb4643bee04332cac92b70` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:23.417844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=821f01a0e7cb4643bee04332cac92b70)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:23.419829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:23.556431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821f01a0e7cb4643bee04332cac92b70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.577960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821f01a0e7cb4643bee04332cac92b70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.579821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821f01a0e7cb4643bee04332cac92b70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.580904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821f01a0e7cb4643bee04332cac92b70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.601498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f169a50a-d88f-41bf-bec6-e80617efa2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821f01a0e7cb4643bee04332cac92b70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:23.638738 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2639/5220] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:23 2022] DELETE /identity/v3/users/821f01a0e7cb4643bee04332cac92b70 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:24.868298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:24.869849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:24.890513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad36bd4-a8ca-4a8c-a01b-cffbe337b277 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:24.971424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:24.972426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:24.972739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:24.973124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] PATH_INFO: `/v3/projects/233ddbe3a45640159135c257774bcc19` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:24.975053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=233ddbe3a45640159135c257774bcc19)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:24.977099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:25.032777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233ddbe3a45640159135c257774bcc19', 'request_id': 'req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:25.047765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233ddbe3a45640159135c257774bcc19', 'request_id': 'req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:25.064624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233ddbe3a45640159135c257774bcc19', 'request_id': 'req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:25.082306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] The token cache is being invalidate because project 233ddbe3a45640159135c257774bcc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:25.082606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:25.083283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9611bb4d-8dd2-4c2b-8e53-1a0b51e4c3ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:25.085411 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2582/5221] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:24 2022] DELETE /identity/v3/projects/233ddbe3a45640159135c257774bcc19 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:25.092281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063a96-8dcc-4802-9edf-369fe555349e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:25.092281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063a96-8dcc-4802-9edf-369fe555349e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:25.092768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b063a96-8dcc-4802-9edf-369fe555349e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:25.139635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9b063a96-8dcc-4802-9edf-369fe555349e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:25.141070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9b063a96-8dcc-4802-9edf-369fe555349e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:25.224631 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2640/5222] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:25.229656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d4ad-b4fe-47fd-a6f8-755afe74574a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:25.229947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d4ad-b4fe-47fd-a6f8-755afe74574a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:25.230228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57d4ad-b4fe-47fd-a6f8-755afe74574a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:25.254946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8f57d4ad-b4fe-47fd-a6f8-755afe74574a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:25.256633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f57d4ad-b4fe-47fd-a6f8-755afe74574a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:25.290886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063a96-8dcc-4802-9edf-369fe555349e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:25.292313 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2583/5223] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:25.307214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b063a96-8dcc-4802-9edf-369fe555349e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:25.320488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015444fc-fd80-4052-8fd1-988fbbc6943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:25.321173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015444fc-fd80-4052-8fd1-988fbbc6943c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:25.321469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015444fc-fd80-4052-8fd1-988fbbc6943c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:25.321936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015444fc-fd80-4052-8fd1-988fbbc6943c admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:25.323326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015444fc-fd80-4052-8fd1-988fbbc6943c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:07:25.323645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015444fc-fd80-4052-8fd1-988fbbc6943c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:25.325817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015444fc-fd80-4052-8fd1-988fbbc6943c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:25.357001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d4ad-b4fe-47fd-a6f8-755afe74574a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:25.364562 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2641/5224] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:07:25.368601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57d4ad-b4fe-47fd-a6f8-755afe74574a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:25.384195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456dc46-c97d-4cfb-badd-efbdab540611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:25.384929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456dc46-c97d-4cfb-badd-efbdab540611 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:25.385211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456dc46-c97d-4cfb-badd-efbdab540611 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:25.385503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456dc46-c97d-4cfb-badd-efbdab540611 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:25.386592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456dc46-c97d-4cfb-badd-efbdab540611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:25.388633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456dc46-c97d-4cfb-badd-efbdab540611 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:25.435000 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2584/5225] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:25 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:25.438932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015444fc-fd80-4052-8fd1-988fbbc6943c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:25.449922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015444fc-fd80-4052-8fd1-988fbbc6943c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:25.528226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b6eb-8a58-4788-b9b2-b5bf2b9c9341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:25.529662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b6eb-8a58-4788-b9b2-b5bf2b9c9341 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:25.529944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b6eb-8a58-4788-b9b2-b5bf2b9c9341 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:25.530288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353b6eb-8a58-4788-b9b2-b5bf2b9c9341 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:25.531056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353b6eb-8a58-4788-b9b2-b5bf2b9c9341 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:25.533644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353b6eb-8a58-4788-b9b2-b5bf2b9c9341 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:25.560255 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2642/5226] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:07:25 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:25.564953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456dc46-c97d-4cfb-badd-efbdab540611 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:25.585763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456dc46-c97d-4cfb-badd-efbdab540611 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:25.591269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84951706-ed07-461a-947d-d10d30a26a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:25.592078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84951706-ed07-461a-947d-d10d30a26a1b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:25.592957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84951706-ed07-461a-947d-d10d30a26a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:25.593350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84951706-ed07-461a-947d-d10d30a26a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:25.594154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84951706-ed07-461a-947d-d10d30a26a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:25.595878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84951706-ed07-461a-947d-d10d30a26a1b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:25.614056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b6eb-8a58-4788-b9b2-b5bf2b9c9341 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:25.615870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2585/5227] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:25.624576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353b6eb-8a58-4788-b9b2-b5bf2b9c9341 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:25.632791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa083db-c46b-4ff8-80d0-9895c6a3d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:25.633465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa083db-c46b-4ff8-80d0-9895c6a3d763 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:25.633750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa083db-c46b-4ff8-80d0-9895c6a3d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:25.634026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa083db-c46b-4ff8-80d0-9895c6a3d763 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:25.634755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa083db-c46b-4ff8-80d0-9895c6a3d763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:25.636921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa083db-c46b-4ff8-80d0-9895c6a3d763 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:25.652384 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2643/5228] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:25.656154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84951706-ed07-461a-947d-d10d30a26a1b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:25.667446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84951706-ed07-461a-947d-d10d30a26a1b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:25.673362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff09c9-95a1-408e-9ea7-8ccb01c5d0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:25.674524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff09c9-95a1-408e-9ea7-8ccb01c5d0df admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:25.674915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff09c9-95a1-408e-9ea7-8ccb01c5d0df admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:25.675291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff09c9-95a1-408e-9ea7-8ccb01c5d0df admin admin] PATH_INFO: `/v3/projects/788ea3250f28418c9cb3dc09bd2e0eaf/users/ad2f3b3ec57a47758b19935059213d6b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:25.703265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff09c9-95a1-408e-9ea7-8ccb01c5d0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=788ea3250f28418c9cb3dc09bd2e0eaf, user_id=ad2f3b3ec57a47758b19935059213d6b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:25.707313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff09c9-95a1-408e-9ea7-8ccb01c5d0df admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:25.724650 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2586/5229] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:25 2022] PUT /identity/v3/projects/788ea3250f28418c9cb3dc09bd2e0eaf/users/ad2f3b3ec57a47758b19935059213d6b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:25.824185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eb653-32e9-4427-9ae1-11772828026e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:25.824492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eb653-32e9-4427-9ae1-11772828026e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:25.824765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3eb653-32e9-4427-9ae1-11772828026e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:25.874876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4b3eb653-32e9-4427-9ae1-11772828026e None None] MFA Rules not processed for user `ad2f3b3ec57a47758b19935059213d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:25.876181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4b3eb653-32e9-4427-9ae1-11772828026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:25.994408 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2644/5230] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:26.041566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff09c9-95a1-408e-9ea7-8ccb01c5d0df admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:26.046201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-13ff09c9-95a1-408e-9ea7-8ccb01c5d0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:26.132491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff09c9-95a1-408e-9ea7-8ccb01c5d0df admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:26.140416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64b13c-5fea-4ba2-8f40-2b638fbf2f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:26.141389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64b13c-5fea-4ba2-8f40-2b638fbf2f79 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:26.142257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64b13c-5fea-4ba2-8f40-2b638fbf2f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:26.142719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64b13c-5fea-4ba2-8f40-2b638fbf2f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:26.153938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64b13c-5fea-4ba2-8f40-2b638fbf2f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:26.155999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64b13c-5fea-4ba2-8f40-2b638fbf2f79 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:26.171208 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2587/5231] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:29.729853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e52f07-b61d-4938-b250-0226f080f0ed None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:29.730370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e52f07-b61d-4938-b250-0226f080f0ed None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:29.730478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e52f07-b61d-4938-b250-0226f080f0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:29.754765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-01e52f07-b61d-4938-b250-0226f080f0ed None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:29.760605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-01e52f07-b61d-4938-b250-0226f080f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:29.885689 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2645/5232] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:07:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:07:29.907327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64b13c-5fea-4ba2-8f40-2b638fbf2f79 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:29.908943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cc64b13c-5fea-4ba2-8f40-2b638fbf2f79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:30.082226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64b13c-5fea-4ba2-8f40-2b638fbf2f79 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:30.089396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca24f7-5d3f-4b8e-97cc-69f329804bf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:30.091464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca24f7-5d3f-4b8e-97cc-69f329804bf3 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:30.092182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca24f7-5d3f-4b8e-97cc-69f329804bf3 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:30.092819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca24f7-5d3f-4b8e-97cc-69f329804bf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:30.113503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca24f7-5d3f-4b8e-97cc-69f329804bf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:30.115876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca24f7-5d3f-4b8e-97cc-69f329804bf3 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:30.136451 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2588/5233] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:07:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:07:32.647267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e52f07-b61d-4938-b250-0226f080f0ed None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:32.649514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-01e52f07-b61d-4938-b250-0226f080f0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:32.766754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e52f07-b61d-4938-b250-0226f080f0ed None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:32.776281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:32.777823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:32.778333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:32.779549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:32.783050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:32.799004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:32.801377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:32.818414 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2646/5234] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:33.322670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95028a-254a-481c-9797-f022202eb715 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:33.323230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95028a-254a-481c-9797-f022202eb715 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:33.323230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95028a-254a-481c-9797-f022202eb715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:33.370726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fe95028a-254a-481c-9797-f022202eb715 None None] MFA Rules not processed for user `f265820a8b974837949e9e3f36b58858`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:33.375623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fe95028a-254a-481c-9797-f022202eb715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:33.499244 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2589/5235] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:40.628822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:40.632533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:40.845563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b34767-3a6a-4c05-94e1-7d91d91d3f49 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:40.851149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:40.852350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:40.852832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:40.853330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] PATH_INFO: `/v3/users/c831133806b34840bc6b555364573d0b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:40.854819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c831133806b34840bc6b555364573d0b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:40.857056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:40.922588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c831133806b34840bc6b555364573d0b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:40.931823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c831133806b34840bc6b555364573d0b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:40.933077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c831133806b34840bc6b555364573d0b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:40.933883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c831133806b34840bc6b555364573d0b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:40.946517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c831133806b34840bc6b555364573d0b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:40.967956 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2647/5236] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:40 2022] DELETE /identity/v3/users/c831133806b34840bc6b555364573d0b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:40.974363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726ae1a-1504-409d-98fe-e1e9bbeaa9a9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:40.975438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726ae1a-1504-409d-98fe-e1e9bbeaa9a9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:40.975884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726ae1a-1504-409d-98fe-e1e9bbeaa9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:41.013602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4726ae1a-1504-409d-98fe-e1e9bbeaa9a9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:41.017716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4726ae1a-1504-409d-98fe-e1e9bbeaa9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:41.128082 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2590/5237] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:41.138087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:41.139759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:41.219631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d00c5-1d03-4cd7-aedc-de4301208b9e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:41.225025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d270235-c9ca-4cf1-9a13-a666230c6f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:41.225815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d270235-c9ca-4cf1-9a13-a666230c6f53 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:41.226635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d270235-c9ca-4cf1-9a13-a666230c6f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:41.226635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d270235-c9ca-4cf1-9a13-a666230c6f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:41.236676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d270235-c9ca-4cf1-9a13-a666230c6f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:41.238556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d270235-c9ca-4cf1-9a13-a666230c6f53 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:41.249116 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2648/5238] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:41.639298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726ae1a-1504-409d-98fe-e1e9bbeaa9a9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:41.641539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4726ae1a-1504-409d-98fe-e1e9bbeaa9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:41.659845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726ae1a-1504-409d-98fe-e1e9bbeaa9a9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:41.667473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:41.668794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:41.669283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:41.669803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] PATH_INFO: `/v3/projects/cedd45db640644088124f54b89de447a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:41.671469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cedd45db640644088124f54b89de447a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:41.673847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:41.751316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cedd45db640644088124f54b89de447a', 'request_id': 'req-b22ae937-7e92-4599-9b77-f365271de205'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:41.799405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cedd45db640644088124f54b89de447a', 'request_id': 'req-b22ae937-7e92-4599-9b77-f365271de205'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:41.811426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cedd45db640644088124f54b89de447a', 'request_id': 'req-b22ae937-7e92-4599-9b77-f365271de205'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:41.838313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] The token cache is being invalidate because project cedd45db640644088124f54b89de447a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:41.838651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:41.844395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b22ae937-7e92-4599-9b77-f365271de205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:41.848023 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2591/5239] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:41 2022] DELETE /identity/v3/projects/cedd45db640644088124f54b89de447a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:41.851195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74f797-bae6-45e6-8375-55fbceedc29d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:41.851653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74f797-bae6-45e6-8375-55fbceedc29d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:41.852334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74f797-bae6-45e6-8375-55fbceedc29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:41.877991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dc74f797-bae6-45e6-8375-55fbceedc29d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:41.881463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dc74f797-bae6-45e6-8375-55fbceedc29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:41.965847 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2649/5240] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:41.974024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eea2d-d95a-4878-953a-5974816786f4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:41.974332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eea2d-d95a-4878-953a-5974816786f4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:41.974611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eea2d-d95a-4878-953a-5974816786f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.007052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-aa6eea2d-d95a-4878-953a-5974816786f4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:42.008292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aa6eea2d-d95a-4878-953a-5974816786f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:42.019304 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2592/5241] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:42.021333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74f797-bae6-45e6-8375-55fbceedc29d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:42.033795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74f797-bae6-45e6-8375-55fbceedc29d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:42.039995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84b286-71b3-4694-a6a5-94ee94e8d527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:42.040844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84b286-71b3-4694-a6a5-94ee94e8d527 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.041337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84b286-71b3-4694-a6a5-94ee94e8d527 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.041794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84b286-71b3-4694-a6a5-94ee94e8d527 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.042683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84b286-71b3-4694-a6a5-94ee94e8d527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:07:42.042996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84b286-71b3-4694-a6a5-94ee94e8d527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:42.050528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84b286-71b3-4694-a6a5-94ee94e8d527 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:42.070107 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2650/5242] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:07:42.071073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eea2d-d95a-4878-953a-5974816786f4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:42.082529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6eea2d-d95a-4878-953a-5974816786f4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:42.088039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e546e-9de6-4919-b88c-37dfc96e47c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:42.088786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e546e-9de6-4919-b88c-37dfc96e47c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.089134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e546e-9de6-4919-b88c-37dfc96e47c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.089571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e546e-9de6-4919-b88c-37dfc96e47c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.090301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e546e-9de6-4919-b88c-37dfc96e47c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:42.092396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e546e-9de6-4919-b88c-37dfc96e47c5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:42.140615 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2593/5243] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:42 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:07:42.141978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84b286-71b3-4694-a6a5-94ee94e8d527 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:42.153659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84b286-71b3-4694-a6a5-94ee94e8d527 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:42.237281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd308798-9e91-409b-8e62-9c3a114126a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:42.238197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd308798-9e91-409b-8e62-9c3a114126a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.238616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd308798-9e91-409b-8e62-9c3a114126a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.239081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd308798-9e91-409b-8e62-9c3a114126a7 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.240545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd308798-9e91-409b-8e62-9c3a114126a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:42.242674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd308798-9e91-409b-8e62-9c3a114126a7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:42.267955 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2651/5244] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:07:42 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:42.269712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e546e-9de6-4919-b88c-37dfc96e47c5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:42.282627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e546e-9de6-4919-b88c-37dfc96e47c5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:42.287990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340b2e0-b049-43a0-a2ed-8217ef2db4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:42.288727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340b2e0-b049-43a0-a2ed-8217ef2db4da admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.289084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340b2e0-b049-43a0-a2ed-8217ef2db4da admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.289433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340b2e0-b049-43a0-a2ed-8217ef2db4da admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.290226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340b2e0-b049-43a0-a2ed-8217ef2db4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:42.292989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340b2e0-b049-43a0-a2ed-8217ef2db4da admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:42.308094 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2594/5245] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:42.309342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd308798-9e91-409b-8e62-9c3a114126a7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:42.322492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd308798-9e91-409b-8e62-9c3a114126a7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:42.329013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d783ced-c256-4d6b-af63-298841d153d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:42.329878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783ced-c256-4d6b-af63-298841d153d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.330135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783ced-c256-4d6b-af63-298841d153d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.330988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d783ced-c256-4d6b-af63-298841d153d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.331716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783ced-c256-4d6b-af63-298841d153d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:42.335261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d783ced-c256-4d6b-af63-298841d153d8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:42.351757 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2652/5246] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:42.353084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340b2e0-b049-43a0-a2ed-8217ef2db4da admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:42.365056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340b2e0-b049-43a0-a2ed-8217ef2db4da admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:42.375587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1ec0b-91c1-42ba-87ac-0775ed4c1cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:42.376893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1ec0b-91c1-42ba-87ac-0775ed4c1cad admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.377002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1ec0b-91c1-42ba-87ac-0775ed4c1cad admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.377204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1ec0b-91c1-42ba-87ac-0775ed4c1cad admin admin] PATH_INFO: `/v3/projects/b9ebf11478374113a9a77f6cec70ddcc/users/862fa016d9854080964fe8c8122b8290/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.414264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1ec0b-91c1-42ba-87ac-0775ed4c1cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ebf11478374113a9a77f6cec70ddcc, user_id=862fa016d9854080964fe8c8122b8290, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:42.417252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1ec0b-91c1-42ba-87ac-0775ed4c1cad admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:42.447369 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2595/5247] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:42 2022] PUT /identity/v3/projects/b9ebf11478374113a9a77f6cec70ddcc/users/862fa016d9854080964fe8c8122b8290/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:42.450207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cd70-241f-4898-903c-fd0871b7ad84 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.450207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cd70-241f-4898-903c-fd0871b7ad84 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.450207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cd70-241f-4898-903c-fd0871b7ad84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.515680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-09b6cd70-241f-4898-903c-fd0871b7ad84 None None] MFA Rules not processed for user `862fa016d9854080964fe8c8122b8290`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:42.517524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-09b6cd70-241f-4898-903c-fd0871b7ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:42.659033 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2653/5248] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:42.685235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1ec0b-91c1-42ba-87ac-0775ed4c1cad admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:42.687583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1ff1ec0b-91c1-42ba-87ac-0775ed4c1cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:42.760463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cd70-241f-4898-903c-fd0871b7ad84 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:42.762215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-09b6cd70-241f-4898-903c-fd0871b7ad84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:42.783714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1ec0b-91c1-42ba-87ac-0775ed4c1cad admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:42.789311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e793-7305-4b05-922e-c017f42a6d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:42.792197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e793-7305-4b05-922e-c017f42a6d3d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.794076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e793-7305-4b05-922e-c017f42a6d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.794399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19e793-7305-4b05-922e-c017f42a6d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.809443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e793-7305-4b05-922e-c017f42a6d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:42.811014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19e793-7305-4b05-922e-c017f42a6d3d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:42.831036 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2596/5249] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:42.860373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cd70-241f-4898-903c-fd0871b7ad84 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:42.867625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:42.870828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.871160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.871598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] PATH_INFO: `/v3/users/ad2f3b3ec57a47758b19935059213d6b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.874433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2f3b3ec57a47758b19935059213d6b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:42.877995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:42.896117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e793-7305-4b05-922e-c017f42a6d3d service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:42.944587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19e793-7305-4b05-922e-c017f42a6d3d service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:42.952183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:42.953292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:42.953712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:42.954124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] PATH_INFO: `/v3/users/862fa016d9854080964fe8c8122b8290` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:42.955888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=862fa016d9854080964fe8c8122b8290)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:42.956127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2f3b3ec57a47758b19935059213d6b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:42.958374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:42.964114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2f3b3ec57a47758b19935059213d6b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:42.965103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2f3b3ec57a47758b19935059213d6b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:42.965900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2f3b3ec57a47758b19935059213d6b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:42.978579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1a48378-2d9e-4cc1-9e2d-a64faacae0df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2f3b3ec57a47758b19935059213d6b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.021391 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2654/5250] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:42 2022] DELETE /identity/v3/users/ad2f3b3ec57a47758b19935059213d6b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:07:43.025200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3261f-6f55-42d0-a975-98dca6596ae0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:43.025518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3261f-6f55-42d0-a975-98dca6596ae0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:43.025823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3261f-6f55-42d0-a975-98dca6596ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:43.040949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '862fa016d9854080964fe8c8122b8290'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.048913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2af3261f-6f55-42d0-a975-98dca6596ae0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:43.050364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2af3261f-6f55-42d0-a975-98dca6596ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:43.054085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '862fa016d9854080964fe8c8122b8290'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.055308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '862fa016d9854080964fe8c8122b8290'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.056365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '862fa016d9854080964fe8c8122b8290'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.106440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '862fa016d9854080964fe8c8122b8290'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.131582 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2655/5251] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:43.147240 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2597/5252] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:42 2022] DELETE /identity/v3/users/862fa016d9854080964fe8c8122b8290 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:43.148002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af643b7-1c30-4cb6-a33b-26167e84c212 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:43.148120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af643b7-1c30-4cb6-a33b-26167e84c212 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:43.148456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af643b7-1c30-4cb6-a33b-26167e84c212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:43.149522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:43.150976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:43.172598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3af643b7-1c30-4cb6-a33b-26167e84c212 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:43.173931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3af643b7-1c30-4cb6-a33b-26167e84c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:43.235209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26513bc5-80e7-45c5-9c26-d88d5dad51bb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:43.239424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8263d2-8b69-4908-a54c-544b8a3617f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:43.240136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8263d2-8b69-4908-a54c-544b8a3617f4 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:43.240424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8263d2-8b69-4908-a54c-544b8a3617f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:43.240709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8263d2-8b69-4908-a54c-544b8a3617f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:43.241215 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2656/5253] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:07:43.250698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8263d2-8b69-4908-a54c-544b8a3617f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:43.252069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af643b7-1c30-4cb6-a33b-26167e84c212 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:43.252407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8263d2-8b69-4908-a54c-544b8a3617f4 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:43.254486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3af643b7-1c30-4cb6-a33b-26167e84c212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:43.264971 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2598/5254] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:43.270895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af643b7-1c30-4cb6-a33b-26167e84c212 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:43.275014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139b91b-eb23-4452-a45d-4cb272faa574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:43.275871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139b91b-eb23-4452-a45d-4cb272faa574 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:43.276290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139b91b-eb23-4452-a45d-4cb272faa574 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:43.277120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139b91b-eb23-4452-a45d-4cb272faa574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:43.296362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139b91b-eb23-4452-a45d-4cb272faa574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:43.298626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139b91b-eb23-4452-a45d-4cb272faa574 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:43.315849 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2657/5255] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:07:43.482750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8263d2-8b69-4908-a54c-544b8a3617f4 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:43.484660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4d8263d2-8b69-4908-a54c-544b8a3617f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:43.506423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8263d2-8b69-4908-a54c-544b8a3617f4 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:43.516004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:43.517808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:43.519155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:43.519771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] PATH_INFO: `/v3/projects/788ea3250f28418c9cb3dc09bd2e0eaf` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:43.522173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=788ea3250f28418c9cb3dc09bd2e0eaf)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:43.525248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:43.600850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788ea3250f28418c9cb3dc09bd2e0eaf', 'request_id': 'req-583d88f9-f446-456d-9c2e-5d761ee6ce60'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.611259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788ea3250f28418c9cb3dc09bd2e0eaf', 'request_id': 'req-583d88f9-f446-456d-9c2e-5d761ee6ce60'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.617996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788ea3250f28418c9cb3dc09bd2e0eaf', 'request_id': 'req-583d88f9-f446-456d-9c2e-5d761ee6ce60'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.632215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] The token cache is being invalidate because project 788ea3250f28418c9cb3dc09bd2e0eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:43.632984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.633553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-583d88f9-f446-456d-9c2e-5d761ee6ce60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:43.635603 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2599/5256] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:43 2022] DELETE /identity/v3/projects/788ea3250f28418c9cb3dc09bd2e0eaf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:43.640410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e2f2-c45e-41e1-b611-e35f1150c63c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:43.640707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e2f2-c45e-41e1-b611-e35f1150c63c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:43.640987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3e2f2-c45e-41e1-b611-e35f1150c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:43.669949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b4d3e2f2-c45e-41e1-b611-e35f1150c63c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:43.673398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b4d3e2f2-c45e-41e1-b611-e35f1150c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:43.767400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2658/5257] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:43.775611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db1c79-43e3-46be-954b-f6592cb312ad None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:43.775966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db1c79-43e3-46be-954b-f6592cb312ad None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:43.776214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db1c79-43e3-46be-954b-f6592cb312ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:43.802730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-98db1c79-43e3-46be-954b-f6592cb312ad None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:43.802730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-98db1c79-43e3-46be-954b-f6592cb312ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:43.816839 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2600/5258] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:43.818484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e2f2-c45e-41e1-b611-e35f1150c63c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:43.829404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3e2f2-c45e-41e1-b611-e35f1150c63c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:43.835542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40846-7caa-404c-9c20-5fa97f86b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:43.836400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40846-7caa-404c-9c20-5fa97f86b374 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:43.836808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40846-7caa-404c-9c20-5fa97f86b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:43.837185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f40846-7caa-404c-9c20-5fa97f86b374 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:43.838037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f40846-7caa-404c-9c20-5fa97f86b374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:07:43.838445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f40846-7caa-404c-9c20-5fa97f86b374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:43.840543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f40846-7caa-404c-9c20-5fa97f86b374 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:43.854030 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2659/5259] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:07:43.858372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db1c79-43e3-46be-954b-f6592cb312ad None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:43.873895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db1c79-43e3-46be-954b-f6592cb312ad None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:43.879457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2ae5f-c73e-467a-9db2-05deed23da68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:43.881062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2ae5f-c73e-467a-9db2-05deed23da68 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:43.881411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2ae5f-c73e-467a-9db2-05deed23da68 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:43.881758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2ae5f-c73e-467a-9db2-05deed23da68 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:43.882530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2ae5f-c73e-467a-9db2-05deed23da68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:43.884586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2ae5f-c73e-467a-9db2-05deed23da68 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:43.918848 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2601/5260] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:43 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:43.923297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40846-7caa-404c-9c20-5fa97f86b374 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:43.934330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f40846-7caa-404c-9c20-5fa97f86b374 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.066315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2412765-36d3-4a3f-8b63-8c3f57650e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.067381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2412765-36d3-4a3f-8b63-8c3f57650e2b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.068342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2412765-36d3-4a3f-8b63-8c3f57650e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.068773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2412765-36d3-4a3f-8b63-8c3f57650e2b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.070043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2412765-36d3-4a3f-8b63-8c3f57650e2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.074172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2412765-36d3-4a3f-8b63-8c3f57650e2b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.093888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2ae5f-c73e-467a-9db2-05deed23da68 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.095891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a3a2ae5f-c73e-467a-9db2-05deed23da68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:44.128686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2ae5f-c73e-467a-9db2-05deed23da68 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.131416 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2660/5261] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:07:43 2022] POST /identity/v3/users => generated 285 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:07:44.132414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2412765-36d3-4a3f-8b63-8c3f57650e2b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.140640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.145991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.146311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.146600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] PATH_INFO: `/v3/projects/b9ebf11478374113a9a77f6cec70ddcc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.149826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ebf11478374113a9a77f6cec70ddcc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.151790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.153099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2412765-36d3-4a3f-8b63-8c3f57650e2b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.177737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d41cc8-4400-46cc-ae76-2e6b7c0bb03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.178631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d41cc8-4400-46cc-ae76-2e6b7c0bb03f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.179955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d41cc8-4400-46cc-ae76-2e6b7c0bb03f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.180819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d41cc8-4400-46cc-ae76-2e6b7c0bb03f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.182460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d41cc8-4400-46cc-ae76-2e6b7c0bb03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.187513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d41cc8-4400-46cc-ae76-2e6b7c0bb03f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.224923 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2661/5262] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:44.227379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d41cc8-4400-46cc-ae76-2e6b7c0bb03f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.238626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d41cc8-4400-46cc-ae76-2e6b7c0bb03f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.257203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ebf11478374113a9a77f6cec70ddcc', 'request_id': 'req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:44.269202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ebf11478374113a9a77f6cec70ddcc', 'request_id': 'req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:44.288459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ebf11478374113a9a77f6cec70ddcc', 'request_id': 'req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:44.311807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] The token cache is being invalidate because project b9ebf11478374113a9a77f6cec70ddcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:44.312220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:44.314887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6f7d5ee-2fb4-4e8d-83f9-89923d206f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:44.319497 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2602/5263] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:44 2022] DELETE /identity/v3/projects/b9ebf11478374113a9a77f6cec70ddcc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:44.325420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5ff9a-b1b2-42f1-8858-50891024436e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.326502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5ff9a-b1b2-42f1-8858-50891024436e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.326863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5ff9a-b1b2-42f1-8858-50891024436e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.347467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3cb5ff9a-b1b2-42f1-8858-50891024436e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:44.348990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3cb5ff9a-b1b2-42f1-8858-50891024436e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:44.355476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1604ad7-fd92-4d5c-a662-b78795798f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.356959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1604ad7-fd92-4d5c-a662-b78795798f06 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.357452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1604ad7-fd92-4d5c-a662-b78795798f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.357808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1604ad7-fd92-4d5c-a662-b78795798f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.358601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1604ad7-fd92-4d5c-a662-b78795798f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.360931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1604ad7-fd92-4d5c-a662-b78795798f06 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.364786 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2603/5264] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:44.366706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8853be1-032a-46d3-81e4-ed1e17360362 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.367004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8853be1-032a-46d3-81e4-ed1e17360362 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.367392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8853be1-032a-46d3-81e4-ed1e17360362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.373231 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2662/5265] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:44.378130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1604ad7-fd92-4d5c-a662-b78795798f06 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.385668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a1604ad7-fd92-4d5c-a662-b78795798f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:44.405079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f8853be1-032a-46d3-81e4-ed1e17360362 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:44.407508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f8853be1-032a-46d3-81e4-ed1e17360362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:44.409508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1604ad7-fd92-4d5c-a662-b78795798f06 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.417465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbd254-a077-4c26-8580-645adcb762c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.418265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbd254-a077-4c26-8580-645adcb762c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.418621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbd254-a077-4c26-8580-645adcb762c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.418905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbd254-a077-4c26-8580-645adcb762c1 admin admin] PATH_INFO: `/v3/projects/652f7c6047dc4f8ca870623f7503e142/users/2b2addd59dcd49e988e33c2cff696ff4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.421748 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2604/5266] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:44.426027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8853be1-032a-46d3-81e4-ed1e17360362 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.436536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbd254-a077-4c26-8580-645adcb762c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652f7c6047dc4f8ca870623f7503e142, user_id=2b2addd59dcd49e988e33c2cff696ff4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.440039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbd254-a077-4c26-8580-645adcb762c1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.441833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8853be1-032a-46d3-81e4-ed1e17360362 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.448302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b324ea-6ea8-48ae-8150-df0918a7564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.449386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b324ea-6ea8-48ae-8150-df0918a7564f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.449901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b324ea-6ea8-48ae-8150-df0918a7564f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.451340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b324ea-6ea8-48ae-8150-df0918a7564f admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.452478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b324ea-6ea8-48ae-8150-df0918a7564f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:07:44.453216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b324ea-6ea8-48ae-8150-df0918a7564f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.455057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b324ea-6ea8-48ae-8150-df0918a7564f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.460613 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2663/5267] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:44 2022] PUT /identity/v3/projects/652f7c6047dc4f8ca870623f7503e142/users/2b2addd59dcd49e988e33c2cff696ff4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:44.471676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6db8-cbf1-4d3b-963c-4a515c9c08fc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.472083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6db8-cbf1-4d3b-963c-4a515c9c08fc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.472443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad6db8-cbf1-4d3b-963c-4a515c9c08fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.476652 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2605/5268] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:07:44.477768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b324ea-6ea8-48ae-8150-df0918a7564f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.488902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b324ea-6ea8-48ae-8150-df0918a7564f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.511709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1aad6db8-cbf1-4d3b-963c-4a515c9c08fc None None] MFA Rules not processed for user `2b2addd59dcd49e988e33c2cff696ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:44.514876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1aad6db8-cbf1-4d3b-963c-4a515c9c08fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:44.556616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10cdfe-ab05-4d25-888f-08a09160f2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.558287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10cdfe-ab05-4d25-888f-08a09160f2ec admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.559631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10cdfe-ab05-4d25-888f-08a09160f2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.560462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10cdfe-ab05-4d25-888f-08a09160f2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.561371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10cdfe-ab05-4d25-888f-08a09160f2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.564402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10cdfe-ab05-4d25-888f-08a09160f2ec admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.604553 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2664/5269] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:07:44.617567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6db8-cbf1-4d3b-963c-4a515c9c08fc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.619243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1aad6db8-cbf1-4d3b-963c-4a515c9c08fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:44.624319 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2606/5270] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:44 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:44.625373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10cdfe-ab05-4d25-888f-08a09160f2ec admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.699203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad6db8-cbf1-4d3b-963c-4a515c9c08fc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.725949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10cdfe-ab05-4d25-888f-08a09160f2ec admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.734648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62447a-c88d-40e8-85bb-277142ca6d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.735669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62447a-c88d-40e8-85bb-277142ca6d28 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.736523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62447a-c88d-40e8-85bb-277142ca6d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.738090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62447a-c88d-40e8-85bb-277142ca6d28 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.738643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62447a-c88d-40e8-85bb-277142ca6d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.742501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62447a-c88d-40e8-85bb-277142ca6d28 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.778820 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2607/5271] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:07:44 2022] POST /identity/v3/users => generated 282 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:44.787678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62447a-c88d-40e8-85bb-277142ca6d28 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.809485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62447a-c88d-40e8-85bb-277142ca6d28 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.818662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24fe61-01d6-4758-a877-454f06377bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.818885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a3636-3623-4e5f-b527-4923712d108b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.819316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a3636-3623-4e5f-b527-4923712d108b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.819603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a3636-3623-4e5f-b527-4923712d108b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.819947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a3636-3623-4e5f-b527-4923712d108b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.820251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24fe61-01d6-4758-a877-454f06377bbd admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.820611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24fe61-01d6-4758-a877-454f06377bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.820960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24fe61-01d6-4758-a877-454f06377bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.821846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24fe61-01d6-4758-a877-454f06377bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.823731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24fe61-01d6-4758-a877-454f06377bbd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.834887 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2608/5272] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:44.838585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24fe61-01d6-4758-a877-454f06377bbd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.850051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24fe61-01d6-4758-a877-454f06377bbd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.855796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5abaa-295e-41b4-b955-426f9ff6e9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.856628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5abaa-295e-41b4-b955-426f9ff6e9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.857010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5abaa-295e-41b4-b955-426f9ff6e9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.857386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5abaa-295e-41b4-b955-426f9ff6e9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.858259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5abaa-295e-41b4-b955-426f9ff6e9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.860185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5abaa-295e-41b4-b955-426f9ff6e9a0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.876832 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2609/5273] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:07:44.878110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5abaa-295e-41b4-b955-426f9ff6e9a0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:44.895995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5abaa-295e-41b4-b955-426f9ff6e9a0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:44.901667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b71df-6807-4fc0-8a2d-28bed2abfd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:44.902929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b71df-6807-4fc0-8a2d-28bed2abfd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.903314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b71df-6807-4fc0-8a2d-28bed2abfd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.903789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b71df-6807-4fc0-8a2d-28bed2abfd2c admin admin] PATH_INFO: `/v3/projects/8fe0ac400cb14a409d8b96581772ca43/users/65fba680497542c7b71781a3edc7d5c6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:44.925874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b71df-6807-4fc0-8a2d-28bed2abfd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fe0ac400cb14a409d8b96581772ca43, user_id=65fba680497542c7b71781a3edc7d5c6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.931671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b71df-6807-4fc0-8a2d-28bed2abfd2c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.933815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a3636-3623-4e5f-b527-4923712d108b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:44.936083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a3636-3623-4e5f-b527-4923712d108b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:44.950774 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2665/5274] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:44.964383 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2610/5275] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:44 2022] PUT /identity/v3/projects/8fe0ac400cb14a409d8b96581772ca43/users/65fba680497542c7b71781a3edc7d5c6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:44.968038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3e24-e5c0-4fa3-bbc1-dfb95991fe8d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:44.971215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3e24-e5c0-4fa3-bbc1-dfb95991fe8d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:44.971673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c3e24-e5c0-4fa3-bbc1-dfb95991fe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:45.037356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-825c3e24-e5c0-4fa3-bbc1-dfb95991fe8d None None] MFA Rules not processed for user `65fba680497542c7b71781a3edc7d5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:45.038825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-825c3e24-e5c0-4fa3-bbc1-dfb95991fe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:45.158967 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2666/5276] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:45.160147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b71df-6807-4fc0-8a2d-28bed2abfd2c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:45.250267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b71df-6807-4fc0-8a2d-28bed2abfd2c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:45.257010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5f7a4-5560-4880-9e30-7820d1fe44c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:45.258313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5f7a4-5560-4880-9e30-7820d1fe44c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:45.258808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5f7a4-5560-4880-9e30-7820d1fe44c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:45.259479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5f7a4-5560-4880-9e30-7820d1fe44c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:45.260443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5f7a4-5560-4880-9e30-7820d1fe44c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:45.262938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5f7a4-5560-4880-9e30-7820d1fe44c7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:45.297170 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2611/5277] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:07:45 2022] POST /identity/v3/projects => generated 363 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:45.300925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3e24-e5c0-4fa3-bbc1-dfb95991fe8d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:45.334423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c3e24-e5c0-4fa3-bbc1-dfb95991fe8d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:45.472501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692b121-e0d1-4667-b9e0-295d13e321a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:45.473184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692b121-e0d1-4667-b9e0-295d13e321a2 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:45.474006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692b121-e0d1-4667-b9e0-295d13e321a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:45.474273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692b121-e0d1-4667-b9e0-295d13e321a2 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:45.474974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692b121-e0d1-4667-b9e0-295d13e321a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:45.477256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692b121-e0d1-4667-b9e0-295d13e321a2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:45.513659 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2667/5278] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:07:45 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:07:45.518146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5f7a4-5560-4880-9e30-7820d1fe44c7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:45.547063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5f7a4-5560-4880-9e30-7820d1fe44c7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:45.553203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e97bc-9136-4d15-b954-c138cca35f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:45.554102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e97bc-9136-4d15-b954-c138cca35f3e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:45.555071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e97bc-9136-4d15-b954-c138cca35f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:45.555364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e97bc-9136-4d15-b954-c138cca35f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:45.556154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e97bc-9136-4d15-b954-c138cca35f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:45.558862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e97bc-9136-4d15-b954-c138cca35f3e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:45.580414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692b121-e0d1-4667-b9e0-295d13e321a2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:45.587611 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2612/5279] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:45.614767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692b121-e0d1-4667-b9e0-295d13e321a2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:45.633815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bf42c-deae-4d37-addd-a829f517acac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:45.634717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf42c-deae-4d37-addd-a829f517acac admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:45.635019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf42c-deae-4d37-addd-a829f517acac admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:45.635261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3bf42c-deae-4d37-addd-a829f517acac admin admin] PATH_INFO: `/v3/projects/4c1d7c0a085841b186137dd729a8704b/users/d99d0240b07f4b81be4d324eb7ea276d/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:45.692202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bf42c-deae-4d37-addd-a829f517acac admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1d7c0a085841b186137dd729a8704b, user_id=d99d0240b07f4b81be4d324eb7ea276d, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:45.707193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3bf42c-deae-4d37-addd-a829f517acac admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:45.752347 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2668/5280] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:45 2022] PUT /identity/v3/projects/4c1d7c0a085841b186137dd729a8704b/users/d99d0240b07f4b81be4d324eb7ea276d/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:07:45.756038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e97bc-9136-4d15-b954-c138cca35f3e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:45.773647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e97bc-9136-4d15-b954-c138cca35f3e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:45.896876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c46b7-0e9e-450b-939a-501c4bbbc6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:45.897938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c46b7-0e9e-450b-939a-501c4bbbc6bb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:45.905959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c46b7-0e9e-450b-939a-501c4bbbc6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:45.906806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c46b7-0e9e-450b-939a-501c4bbbc6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:45.908889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c46b7-0e9e-450b-939a-501c4bbbc6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:45.911117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c46b7-0e9e-450b-939a-501c4bbbc6bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:45.928699 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2613/5281] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:07:45.932486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bf42c-deae-4d37-addd-a829f517acac admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:45.953619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3bf42c-deae-4d37-addd-a829f517acac admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:45.965240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b9d2-ce14-419b-8f70-ef94f48d569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:45.967077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b9d2-ce14-419b-8f70-ef94f48d569c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:45.967585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b9d2-ce14-419b-8f70-ef94f48d569c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:45.968160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564b9d2-ce14-419b-8f70-ef94f48d569c admin admin] PATH_INFO: `/v3/projects/4c1d7c0a085841b186137dd729a8704b/users/d99d0240b07f4b81be4d324eb7ea276d/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:45.972559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564b9d2-ce14-419b-8f70-ef94f48d569c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1d7c0a085841b186137dd729a8704b, user_id=d99d0240b07f4b81be4d324eb7ea276d, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:45.978455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564b9d2-ce14-419b-8f70-ef94f48d569c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:45.994153 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2669/5282] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:07:45 2022] PUT /identity/v3/projects/4c1d7c0a085841b186137dd729a8704b/users/d99d0240b07f4b81be4d324eb7ea276d/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:46.006494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947be3-1a2c-407f-83f5-c842a422ed75 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:46.007398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947be3-1a2c-407f-83f5-c842a422ed75 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:46.007884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947be3-1a2c-407f-83f5-c842a422ed75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:46.058947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-86947be3-1a2c-407f-83f5-c842a422ed75 None None] MFA Rules not processed for user `d99d0240b07f4b81be4d324eb7ea276d`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:46.060679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-86947be3-1a2c-407f-83f5-c842a422ed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:46.117643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b9d2-ce14-419b-8f70-ef94f48d569c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:46.119845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2564b9d2-ce14-419b-8f70-ef94f48d569c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:46.185719 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2614/5283] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:46.193114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947be3-1a2c-407f-83f5-c842a422ed75 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:46.197026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-86947be3-1a2c-407f-83f5-c842a422ed75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:46.241856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564b9d2-ce14-419b-8f70-ef94f48d569c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:46.258670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:46.262279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:46.262780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:46.263490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] PATH_INFO: `/v3/users/0bfee91285f94b2eba5cd89004babf2e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:46.268035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bfee91285f94b2eba5cd89004babf2e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:46.273049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:46.281247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947be3-1a2c-407f-83f5-c842a422ed75 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:46.285853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28e620-5fb6-4d7b-b3f6-e964eb9ad707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:46.286824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28e620-5fb6-4d7b-b3f6-e964eb9ad707 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:46.287254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28e620-5fb6-4d7b-b3f6-e964eb9ad707 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:46.287663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28e620-5fb6-4d7b-b3f6-e964eb9ad707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:46.297898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28e620-5fb6-4d7b-b3f6-e964eb9ad707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:46.299556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28e620-5fb6-4d7b-b3f6-e964eb9ad707 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:46.333817 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2615/5284] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:46.381069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bfee91285f94b2eba5cd89004babf2e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:46.398471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bfee91285f94b2eba5cd89004babf2e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:46.400399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bfee91285f94b2eba5cd89004babf2e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:46.401935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bfee91285f94b2eba5cd89004babf2e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:46.436857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bfee91285f94b2eba5cd89004babf2e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:46.446879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28e620-5fb6-4d7b-b3f6-e964eb9ad707 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:46.461319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28e620-5fb6-4d7b-b3f6-e964eb9ad707 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:46.474429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd5c5c-b1ec-4e3a-ac35-f9861792a8cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:46.475262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd5c5c-b1ec-4e3a-ac35-f9861792a8cd service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:46.475551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd5c5c-b1ec-4e3a-ac35-f9861792a8cd service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:46.475843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd5c5c-b1ec-4e3a-ac35-f9861792a8cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:46.480693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8dfd5c5c-b1ec-4e3a-ac35-f9861792a8cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:46.490265 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2670/5285] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:46 2022] DELETE /identity/v3/users/0bfee91285f94b2eba5cd89004babf2e => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:46.578916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd5c5c-b1ec-4e3a-ac35-f9861792a8cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:46.581167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfd5c5c-b1ec-4e3a-ac35-f9861792a8cd service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:46.599534 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2616/5286] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:07:46.819130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:46.821151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:46.922948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6f10b-45e8-471f-84dd-c8f1a0c0de2c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:46.932782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:46.934233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:46.934702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:46.935095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] PATH_INFO: `/v3/projects/ddb5f339350b4d5facba9a6ffd84aa1b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:46.937231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddb5f339350b4d5facba9a6ffd84aa1b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:46.939535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:47.016755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'request_id': 'req-dede370d-1459-483f-b960-b94a5d36e859'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.031576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'request_id': 'req-dede370d-1459-483f-b960-b94a5d36e859'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.040678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb5f339350b4d5facba9a6ffd84aa1b', 'request_id': 'req-dede370d-1459-483f-b960-b94a5d36e859'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.055129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] The token cache is being invalidate because project ddb5f339350b4d5facba9a6ffd84aa1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:47.055541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.056468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.058407 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2671/5287] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:46 2022] DELETE /identity/v3/projects/ddb5f339350b4d5facba9a6ffd84aa1b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:47.063960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd5c5c-b1ec-4e3a-ac35-f9861792a8cd service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:47.075857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd5c5c-b1ec-4e3a-ac35-f9861792a8cd service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:47.152778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:47.153613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:47.153904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:47.154265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] PATH_INFO: `/v3/users/27cec5f2d6fd48e7861aab535615d43c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:47.156232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27cec5f2d6fd48e7861aab535615d43c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:47.158721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:47.222900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cec5f2d6fd48e7861aab535615d43c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.232456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cec5f2d6fd48e7861aab535615d43c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.233110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cec5f2d6fd48e7861aab535615d43c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.233761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cec5f2d6fd48e7861aab535615d43c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.248227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cec5f2d6fd48e7861aab535615d43c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:47.263688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2617/5288] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:47 2022] DELETE /identity/v3/users/27cec5f2d6fd48e7861aab535615d43c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:07:47.795460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:47.797142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:47.824125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede370d-1459-483f-b960-b94a5d36e859 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:47.933500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:47.934398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:47.934693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:47.934951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] PATH_INFO: `/v3/projects/301595631073479dbf5b2832a81d3e01` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:47.941398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301595631073479dbf5b2832a81d3e01)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:47.943355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:48.032374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301595631073479dbf5b2832a81d3e01', 'request_id': 'req-ec4e216c-826e-4093-a8d8-098724d70258'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:48.045616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301595631073479dbf5b2832a81d3e01', 'request_id': 'req-ec4e216c-826e-4093-a8d8-098724d70258'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:48.057234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301595631073479dbf5b2832a81d3e01', 'request_id': 'req-ec4e216c-826e-4093-a8d8-098724d70258'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:48.075089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] The token cache is being invalidate because project 301595631073479dbf5b2832a81d3e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:48.075410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:48.076774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec4e216c-826e-4093-a8d8-098724d70258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:48.080188 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2672/5289] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:47 2022] DELETE /identity/v3/projects/301595631073479dbf5b2832a81d3e01 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:49.287369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:49.288870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:49.382145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ade8ae-2eb4-4668-859b-a9cca4148ff7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:49.463325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:49.464501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:49.464797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:49.465080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:49.468006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:49.587509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:49.592268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:49.641065 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2618/5290] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:55.109122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a8e8-8cd5-4630-8fe9-798c6d7e9a9b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:55.109624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a8e8-8cd5-4630-8fe9-798c6d7e9a9b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:55.109739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56a8e8-8cd5-4630-8fe9-798c6d7e9a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:55.151726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0f56a8e8-8cd5-4630-8fe9-798c6d7e9a9b None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:55.156347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f56a8e8-8cd5-4630-8fe9-798c6d7e9a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:55.250074 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2673/5291] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:07:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:55.268865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:55.270394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:55.462733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9d77c-3288-4643-8ebf-82d024253c9b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:55.471972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257595b-9065-4354-9422-90466d4a6013 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:55.472923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257595b-9065-4354-9422-90466d4a6013 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:55.473485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257595b-9065-4354-9422-90466d4a6013 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:55.473938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257595b-9065-4354-9422-90466d4a6013 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:55.491337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257595b-9065-4354-9422-90466d4a6013 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:55.514500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257595b-9065-4354-9422-90466d4a6013 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:55.548355 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2619/5292] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:07:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:07:56.670353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a8e8-8cd5-4630-8fe9-798c6d7e9a9b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:56.671909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f56a8e8-8cd5-4630-8fe9-798c6d7e9a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:56.707958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f56a8e8-8cd5-4630-8fe9-798c6d7e9a9b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:56.718689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:56.719758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:56.722359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:56.722911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] PATH_INFO: `/v3/users/65fba680497542c7b71781a3edc7d5c6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:56.725153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fba680497542c7b71781a3edc7d5c6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:56.734575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:56.854410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fba680497542c7b71781a3edc7d5c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:56.870956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fba680497542c7b71781a3edc7d5c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:56.873185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fba680497542c7b71781a3edc7d5c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:56.873857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fba680497542c7b71781a3edc7d5c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:56.899738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fba680497542c7b71781a3edc7d5c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:56.949700 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2674/5293] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:56 2022] DELETE /identity/v3/users/65fba680497542c7b71781a3edc7d5c6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:56.954192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40179e-4a21-4147-adf6-5c42def796a7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:56.955012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40179e-4a21-4147-adf6-5c42def796a7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:56.955442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40179e-4a21-4147-adf6-5c42def796a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:56.988446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5a40179e-4a21-4147-adf6-5c42def796a7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:07:56.991028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5a40179e-4a21-4147-adf6-5c42def796a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:57.089984 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2620/5294] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:07:57.125364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:57.127487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:57.326677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3810e7f-765a-4087-8326-4dcde0545235 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:57.363326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541db7fc-42b2-47e5-8277-637b9a113803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:57.364963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541db7fc-42b2-47e5-8277-637b9a113803 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:57.365878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541db7fc-42b2-47e5-8277-637b9a113803 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:57.366463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541db7fc-42b2-47e5-8277-637b9a113803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:57.397196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541db7fc-42b2-47e5-8277-637b9a113803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:57.407286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541db7fc-42b2-47e5-8277-637b9a113803 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:57.427490 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2675/5295] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:07:58.889275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40179e-4a21-4147-adf6-5c42def796a7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:58.890803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5a40179e-4a21-4147-adf6-5c42def796a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:07:58.945854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40179e-4a21-4147-adf6-5c42def796a7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:59.037799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:59.038985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:59.039410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:59.039855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] PATH_INFO: `/v3/projects/8fe0ac400cb14a409d8b96581772ca43` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:59.041333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fe0ac400cb14a409d8b96581772ca43)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:59.043489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:59.108271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fe0ac400cb14a409d8b96581772ca43', 'request_id': 'req-ec0a2cc1-353f-4bc1-8f30-825165d0142b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.120388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fe0ac400cb14a409d8b96581772ca43', 'request_id': 'req-ec0a2cc1-353f-4bc1-8f30-825165d0142b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.130791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fe0ac400cb14a409d8b96581772ca43', 'request_id': 'req-ec0a2cc1-353f-4bc1-8f30-825165d0142b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.150210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] The token cache is being invalidate because project 8fe0ac400cb14a409d8b96581772ca43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:07:59.150743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.151611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.155523 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2621/5296] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:07:58 2022] DELETE /identity/v3/projects/8fe0ac400cb14a409d8b96581772ca43 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:07:59.160925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541db7fc-42b2-47e5-8277-637b9a113803 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:07:59.179109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541db7fc-42b2-47e5-8277-637b9a113803 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:07:59.287535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:07:59.288545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:07:59.288993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:07:59.289413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] PATH_INFO: `/v3/users/d99d0240b07f4b81be4d324eb7ea276d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:07:59.290855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d99d0240b07f4b81be4d324eb7ea276d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:07:59.297848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:07:59.399941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd99d0240b07f4b81be4d324eb7ea276d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.429741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd99d0240b07f4b81be4d324eb7ea276d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.430997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd99d0240b07f4b81be4d324eb7ea276d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.432026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd99d0240b07f4b81be4d324eb7ea276d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.455819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3063ab34-4fed-4b4b-b988-dce4cb8189e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd99d0240b07f4b81be4d324eb7ea276d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:07:59.502146 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2676/5297] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:07:59 2022] DELETE /identity/v3/users/d99d0240b07f4b81be4d324eb7ea276d => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:00.359834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:00.361397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:00.391585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a2cc1-353f-4bc1-8f30-825165d0142b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:00.628395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:00.635370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:00.635669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:00.638329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] PATH_INFO: `/v3/projects/4c1d7c0a085841b186137dd729a8704b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:00.642257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1d7c0a085841b186137dd729a8704b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:00.644243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:00.809666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1d7c0a085841b186137dd729a8704b', 'request_id': 'req-6ba450c2-3a88-470d-883a-d1a5acbc746c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:00.837017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1d7c0a085841b186137dd729a8704b', 'request_id': 'req-6ba450c2-3a88-470d-883a-d1a5acbc746c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:00.843751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1d7c0a085841b186137dd729a8704b', 'request_id': 'req-6ba450c2-3a88-470d-883a-d1a5acbc746c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:00.866943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] The token cache is being invalidate because project 4c1d7c0a085841b186137dd729a8704b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:00.868338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:00.869374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6ba450c2-3a88-470d-883a-d1a5acbc746c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:00.874178 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2622/5298] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:00 2022] DELETE /identity/v3/projects/4c1d7c0a085841b186137dd729a8704b => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:00.878917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249fd86-7c23-459a-b8d1-94fce3ea6574 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:00.879722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249fd86-7c23-459a-b8d1-94fce3ea6574 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:00.880165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249fd86-7c23-459a-b8d1-94fce3ea6574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:00.917359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d249fd86-7c23-459a-b8d1-94fce3ea6574 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:00.920582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d249fd86-7c23-459a-b8d1-94fce3ea6574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:01.145571 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2677/5299] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:01.152547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd63f-1b54-4faf-ba2c-90b40f829d36 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:01.152957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd63f-1b54-4faf-ba2c-90b40f829d36 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:01.153464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bd63f-1b54-4faf-ba2c-90b40f829d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:01.201544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fc6bd63f-1b54-4faf-ba2c-90b40f829d36 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:01.208371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fc6bd63f-1b54-4faf-ba2c-90b40f829d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:01.232169 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2623/5300] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:01.240968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249fd86-7c23-459a-b8d1-94fce3ea6574 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:01.252210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249fd86-7c23-459a-b8d1-94fce3ea6574 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:01.257737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f800fb-055d-4099-b0e9-758ad2e1e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:01.258592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f800fb-055d-4099-b0e9-758ad2e1e0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:01.258693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f800fb-055d-4099-b0e9-758ad2e1e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:01.258921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f800fb-055d-4099-b0e9-758ad2e1e0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:01.259647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f800fb-055d-4099-b0e9-758ad2e1e0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:01.260148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f800fb-055d-4099-b0e9-758ad2e1e0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:01.261966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f800fb-055d-4099-b0e9-758ad2e1e0a4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:01.287624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bd63f-1b54-4faf-ba2c-90b40f829d36 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:01.295655 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2678/5301] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:01.301550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bd63f-1b54-4faf-ba2c-90b40f829d36 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:01.313774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590e3c-3d17-4340-a230-c61160017388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:01.314463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590e3c-3d17-4340-a230-c61160017388 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:01.314746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590e3c-3d17-4340-a230-c61160017388 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:01.315265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2590e3c-3d17-4340-a230-c61160017388 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:01.317181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590e3c-3d17-4340-a230-c61160017388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:01.321916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2590e3c-3d17-4340-a230-c61160017388 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:01.377753 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2624/5302] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:01 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:01.381928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f800fb-055d-4099-b0e9-758ad2e1e0a4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:01.399712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f800fb-055d-4099-b0e9-758ad2e1e0a4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:01.552558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad0b9d-4841-4c53-a99b-875373c11194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:01.553502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad0b9d-4841-4c53-a99b-875373c11194 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:01.553935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad0b9d-4841-4c53-a99b-875373c11194 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:01.554357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad0b9d-4841-4c53-a99b-875373c11194 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:01.555214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad0b9d-4841-4c53-a99b-875373c11194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:01.557354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad0b9d-4841-4c53-a99b-875373c11194 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:01.629507 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2679/5303] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:01 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:01.631113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590e3c-3d17-4340-a230-c61160017388 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:01.655566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2590e3c-3d17-4340-a230-c61160017388 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:01.665888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7dc2f-2775-48d8-a545-184a5f8a08dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:01.667031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7dc2f-2775-48d8-a545-184a5f8a08dc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:01.668517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7dc2f-2775-48d8-a545-184a5f8a08dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:01.669243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7dc2f-2775-48d8-a545-184a5f8a08dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:01.671077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7dc2f-2775-48d8-a545-184a5f8a08dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:01.673505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7dc2f-2775-48d8-a545-184a5f8a08dc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:01.700944 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2625/5304] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:01.702213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad0b9d-4841-4c53-a99b-875373c11194 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:01.719733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad0b9d-4841-4c53-a99b-875373c11194 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:01.734925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881876e-9a2b-4043-8984-3cd7f9af86a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:01.735603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881876e-9a2b-4043-8984-3cd7f9af86a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:01.735888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881876e-9a2b-4043-8984-3cd7f9af86a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:01.736189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881876e-9a2b-4043-8984-3cd7f9af86a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:01.736918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881876e-9a2b-4043-8984-3cd7f9af86a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:01.738611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881876e-9a2b-4043-8984-3cd7f9af86a4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:01.759073 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2680/5305] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:01.764374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7dc2f-2775-48d8-a545-184a5f8a08dc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:01.790809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7dc2f-2775-48d8-a545-184a5f8a08dc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:01.803528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eb651-09c2-4caa-a1fa-b0829fea2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:01.804664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb651-09c2-4caa-a1fa-b0829fea2304 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:01.805143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb651-09c2-4caa-a1fa-b0829fea2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:01.805601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eb651-09c2-4caa-a1fa-b0829fea2304 admin admin] PATH_INFO: `/v3/projects/a5526fc717a14eba9f157df0279254f2/users/b3c4dbd85cec428fb86318db6e8e301d/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:01.829749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eb651-09c2-4caa-a1fa-b0829fea2304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5526fc717a14eba9f157df0279254f2, user_id=b3c4dbd85cec428fb86318db6e8e301d, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:01.854509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eb651-09c2-4caa-a1fa-b0829fea2304 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:01.901168 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2626/5306] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:01 2022] PUT /identity/v3/projects/a5526fc717a14eba9f157df0279254f2/users/b3c4dbd85cec428fb86318db6e8e301d/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:01.913302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a10b5-a690-4d48-bd8c-dc43d03fb5d1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:01.913853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a10b5-a690-4d48-bd8c-dc43d03fb5d1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:01.913853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a10b5-a690-4d48-bd8c-dc43d03fb5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:01.947434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c36a10b5-a690-4d48-bd8c-dc43d03fb5d1 None None] MFA Rules not processed for user `b3c4dbd85cec428fb86318db6e8e301d`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:01.949862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c36a10b5-a690-4d48-bd8c-dc43d03fb5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:02.065961 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2681/5307] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:02.067986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eb651-09c2-4caa-a1fa-b0829fea2304 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:02.275236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eb651-09c2-4caa-a1fa-b0829fea2304 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:02.287215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b712a-4806-4eb9-88af-0b4701a8e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:02.288189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b712a-4806-4eb9-88af-0b4701a8e4ff admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:02.288734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b712a-4806-4eb9-88af-0b4701a8e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:02.289172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b712a-4806-4eb9-88af-0b4701a8e4ff admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:02.290124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b712a-4806-4eb9-88af-0b4701a8e4ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:02.292267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b712a-4806-4eb9-88af-0b4701a8e4ff admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:02.371751 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2627/5308] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:02 2022] POST /identity/v3/projects => generated 385 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:02.375834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a10b5-a690-4d48-bd8c-dc43d03fb5d1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:02.396568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a10b5-a690-4d48-bd8c-dc43d03fb5d1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:02.553313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df018caf-73fd-4546-a914-ca9658e8d0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:02.554323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df018caf-73fd-4546-a914-ca9658e8d0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:02.554605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df018caf-73fd-4546-a914-ca9658e8d0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:02.554983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df018caf-73fd-4546-a914-ca9658e8d0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:02.555803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df018caf-73fd-4546-a914-ca9658e8d0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:02.558081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df018caf-73fd-4546-a914-ca9658e8d0a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:02.606062 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2682/5309] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:02 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:02.610339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b712a-4806-4eb9-88af-0b4701a8e4ff admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:02.628322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b712a-4806-4eb9-88af-0b4701a8e4ff admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:02.648030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d3c13-c3f5-4a2c-b98a-c45aa963e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:02.650334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d3c13-c3f5-4a2c-b98a-c45aa963e88a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:02.650799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d3c13-c3f5-4a2c-b98a-c45aa963e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:02.658234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d3c13-c3f5-4a2c-b98a-c45aa963e88a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:02.660529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d3c13-c3f5-4a2c-b98a-c45aa963e88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:02.667519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034d3c13-c3f5-4a2c-b98a-c45aa963e88a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:02.686994 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2628/5310] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:02.687536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df018caf-73fd-4546-a914-ca9658e8d0a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:02.706200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df018caf-73fd-4546-a914-ca9658e8d0a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:02.722650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8e25f-e79e-47ef-91c6-638e833983f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:02.723549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8e25f-e79e-47ef-91c6-638e833983f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:02.723836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8e25f-e79e-47ef-91c6-638e833983f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:02.724279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8e25f-e79e-47ef-91c6-638e833983f7 admin admin] PATH_INFO: `/v3/projects/4709cd9978df48b59f9b3caacce46a0a/users/d5f1b52f16bc40338395fa83c7e0405d/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:02.765919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8e25f-e79e-47ef-91c6-638e833983f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4709cd9978df48b59f9b3caacce46a0a, user_id=d5f1b52f16bc40338395fa83c7e0405d, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:02.773578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8e25f-e79e-47ef-91c6-638e833983f7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:02.812638 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2683/5311] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:02 2022] PUT /identity/v3/projects/4709cd9978df48b59f9b3caacce46a0a/users/d5f1b52f16bc40338395fa83c7e0405d/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:02.817573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d3c13-c3f5-4a2c-b98a-c45aa963e88a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:02.852947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d3c13-c3f5-4a2c-b98a-c45aa963e88a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:03.021970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312320ab-1013-4d93-b2aa-21259f91d61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:03.025129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312320ab-1013-4d93-b2aa-21259f91d61a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:03.025415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312320ab-1013-4d93-b2aa-21259f91d61a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:03.025696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312320ab-1013-4d93-b2aa-21259f91d61a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:03.026444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312320ab-1013-4d93-b2aa-21259f91d61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:03.028115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312320ab-1013-4d93-b2aa-21259f91d61a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:03.070572 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2629/5312] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:03.071813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8e25f-e79e-47ef-91c6-638e833983f7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:03.090990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8e25f-e79e-47ef-91c6-638e833983f7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:03.099538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb654d67-729b-4d11-af29-d0b45ddc4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:03.100494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb654d67-729b-4d11-af29-d0b45ddc4b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:03.100773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb654d67-729b-4d11-af29-d0b45ddc4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:03.101049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb654d67-729b-4d11-af29-d0b45ddc4b60 admin admin] PATH_INFO: `/v3/projects/4709cd9978df48b59f9b3caacce46a0a/users/d5f1b52f16bc40338395fa83c7e0405d/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:03.104572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb654d67-729b-4d11-af29-d0b45ddc4b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4709cd9978df48b59f9b3caacce46a0a, user_id=d5f1b52f16bc40338395fa83c7e0405d, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:03.109415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb654d67-729b-4d11-af29-d0b45ddc4b60 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:03.138316 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2684/5313] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:03 2022] PUT /identity/v3/projects/4709cd9978df48b59f9b3caacce46a0a/users/d5f1b52f16bc40338395fa83c7e0405d/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:03.138510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fd3d-3e86-4a45-8abb-91acbd05f0d2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:03.138820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fd3d-3e86-4a45-8abb-91acbd05f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:03.139096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151fd3d-3e86-4a45-8abb-91acbd05f0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:03.220864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9151fd3d-3e86-4a45-8abb-91acbd05f0d2 None None] MFA Rules not processed for user `d5f1b52f16bc40338395fa83c7e0405d`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:03.232363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9151fd3d-3e86-4a45-8abb-91acbd05f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:03.636207 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2630/5314] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:03.646728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb654d67-729b-4d11-af29-d0b45ddc4b60 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:03.649051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cb654d67-729b-4d11-af29-d0b45ddc4b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:03.775149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb654d67-729b-4d11-af29-d0b45ddc4b60 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:03.780455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70701e-0546-4d0e-a3ef-b5147a1fd42e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:03.781237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70701e-0546-4d0e-a3ef-b5147a1fd42e service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:03.781626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70701e-0546-4d0e-a3ef-b5147a1fd42e service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:03.782046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70701e-0546-4d0e-a3ef-b5147a1fd42e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:03.800656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70701e-0546-4d0e-a3ef-b5147a1fd42e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:03.802726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70701e-0546-4d0e-a3ef-b5147a1fd42e service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:03.819006 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2685/5315] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:04.111109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fd3d-3e86-4a45-8abb-91acbd05f0d2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:04.279760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151fd3d-3e86-4a45-8abb-91acbd05f0d2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:04.296640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:04.297537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:04.297812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:04.301848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] PATH_INFO: `/v3/users/b3c4dbd85cec428fb86318db6e8e301d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:04.305629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3c4dbd85cec428fb86318db6e8e301d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:04.308804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:04.416602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3c4dbd85cec428fb86318db6e8e301d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.438626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3c4dbd85cec428fb86318db6e8e301d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.440395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3c4dbd85cec428fb86318db6e8e301d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.441341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3c4dbd85cec428fb86318db6e8e301d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.468903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70701e-0546-4d0e-a3ef-b5147a1fd42e service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:04.470834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a59ea32b-ca27-4773-9b65-2e53d6c435fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3c4dbd85cec428fb86318db6e8e301d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.475389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ae70701e-0546-4d0e-a3ef-b5147a1fd42e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:04.506074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70701e-0546-4d0e-a3ef-b5147a1fd42e service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:04.514533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:04.515612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:04.516082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:04.518248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] PATH_INFO: `/v3/users/87a1de01e7de440d86084c1b5b5aede4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:04.522364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a1de01e7de440d86084c1b5b5aede4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:04.522768 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2631/5316] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:04 2022] DELETE /identity/v3/users/b3c4dbd85cec428fb86318db6e8e301d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:04.525964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:04.534013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f0005-8340-402b-a35c-ff28f68b6ac2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:04.539308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f0005-8340-402b-a35c-ff28f68b6ac2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:04.539803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f0005-8340-402b-a35c-ff28f68b6ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:04.586379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b61f0005-8340-402b-a35c-ff28f68b6ac2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:04.592568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b61f0005-8340-402b-a35c-ff28f68b6ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:04.660861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a1de01e7de440d86084c1b5b5aede4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.701689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a1de01e7de440d86084c1b5b5aede4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.703058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a1de01e7de440d86084c1b5b5aede4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.704310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a1de01e7de440d86084c1b5b5aede4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.718179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a1de01e7de440d86084c1b5b5aede4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:04.721019 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2632/5317] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:04.736963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f0005-8340-402b-a35c-ff28f68b6ac2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:04.740588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b61f0005-8340-402b-a35c-ff28f68b6ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:04.751433 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2686/5318] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:04 2022] DELETE /identity/v3/users/87a1de01e7de440d86084c1b5b5aede4 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:04.865389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f0005-8340-402b-a35c-ff28f68b6ac2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:04.968167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c791-bb94-41aa-8686-853d7c574d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:04.968828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c791-bb94-41aa-8686-853d7c574d44 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:04.970058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c791-bb94-41aa-8686-853d7c574d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:04.970340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c791-bb94-41aa-8686-853d7c574d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:05.048925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:05.050440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:05.089707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994c791-bb94-41aa-8686-853d7c574d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:05.091374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994c791-bb94-41aa-8686-853d7c574d44 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:05.123099 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2633/5319] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:05.168777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283ddb17-f25a-4b0d-8b50-f8520131d472 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:05.175056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:05.176222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:05.176603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:05.176980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] PATH_INFO: `/v3/projects/9643f439b26e41cda482b9533143d636` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:05.178350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9643f439b26e41cda482b9533143d636)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:05.180584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:05.247403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9643f439b26e41cda482b9533143d636', 'request_id': 'req-def375a1-4717-40a4-ad43-43f1c1ed399c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.261585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9643f439b26e41cda482b9533143d636', 'request_id': 'req-def375a1-4717-40a4-ad43-43f1c1ed399c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.271394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9643f439b26e41cda482b9533143d636', 'request_id': 'req-def375a1-4717-40a4-ad43-43f1c1ed399c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.310612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] The token cache is being invalidate because project 9643f439b26e41cda482b9533143d636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:05.310884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.311969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.317318 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2687/5320] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:05 2022] DELETE /identity/v3/projects/9643f439b26e41cda482b9533143d636 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:05.319713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c791-bb94-41aa-8686-853d7c574d44 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:05.340572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c791-bb94-41aa-8686-853d7c574d44 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:05.428673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:05.430140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:05.430833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:05.432375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] PATH_INFO: `/v3/users/1d0473b9b2a24e1c94e825a803a00e15` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:05.434036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0473b9b2a24e1c94e825a803a00e15)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:05.436982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:05.536340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0473b9b2a24e1c94e825a803a00e15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.557758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0473b9b2a24e1c94e825a803a00e15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.559424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0473b9b2a24e1c94e825a803a00e15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.560569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0473b9b2a24e1c94e825a803a00e15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.587715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:05.592371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:05.596321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0473b9b2a24e1c94e825a803a00e15'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.630663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def375a1-4717-40a4-ad43-43f1c1ed399c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:05.645201 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2634/5321] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:05 2022] DELETE /identity/v3/users/1d0473b9b2a24e1c94e825a803a00e15 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:05.651702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:05.652712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:05.659735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:05.660220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] PATH_INFO: `/v3/projects/a5526fc717a14eba9f157df0279254f2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:05.661861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5526fc717a14eba9f157df0279254f2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:05.663904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:05.778488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5526fc717a14eba9f157df0279254f2', 'request_id': 'req-aba70492-45ef-4eba-ba50-9c54fb4794eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.822410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5526fc717a14eba9f157df0279254f2', 'request_id': 'req-aba70492-45ef-4eba-ba50-9c54fb4794eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.836263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5526fc717a14eba9f157df0279254f2', 'request_id': 'req-aba70492-45ef-4eba-ba50-9c54fb4794eb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.859865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] The token cache is being invalidate because project a5526fc717a14eba9f157df0279254f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:05.860611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.861889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:05.864902 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2688/5322] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:05 2022] DELETE /identity/v3/projects/a5526fc717a14eba9f157df0279254f2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:05.868591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:05.871187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:05.997607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468a029-7735-4ff8-b83e-a40773158e98 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:06.046687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:06.048353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:06.179455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:06.180761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:06.181051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:06.182795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] PATH_INFO: `/v3/users/d5f1b52f16bc40338395fa83c7e0405d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:06.185498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f1b52f16bc40338395fa83c7e0405d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:06.196092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:06.215308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba70492-45ef-4eba-ba50-9c54fb4794eb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:06.233605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:06.234746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:06.235029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:06.235308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] PATH_INFO: `/v3/projects/0c00094084934413b62c2a79ef898316` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:06.239406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c00094084934413b62c2a79ef898316)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:06.244574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:06.299907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f1b52f16bc40338395fa83c7e0405d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.317361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f1b52f16bc40338395fa83c7e0405d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.318449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f1b52f16bc40338395fa83c7e0405d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.319468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f1b52f16bc40338395fa83c7e0405d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.349589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-738b2881-36e7-4fc4-8e2e-4d9758d8d921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f1b52f16bc40338395fa83c7e0405d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.356825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c00094084934413b62c2a79ef898316', 'request_id': 'req-331db22e-86a1-4eec-bbc8-227f3955880f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.376346 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2635/5323] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:05 2022] DELETE /identity/v3/users/d5f1b52f16bc40338395fa83c7e0405d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:06.379457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c00094084934413b62c2a79ef898316', 'request_id': 'req-331db22e-86a1-4eec-bbc8-227f3955880f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.386011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c00094084934413b62c2a79ef898316', 'request_id': 'req-331db22e-86a1-4eec-bbc8-227f3955880f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.412043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] The token cache is being invalidate because project 0c00094084934413b62c2a79ef898316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:06.413172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.414150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-331db22e-86a1-4eec-bbc8-227f3955880f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:06.420609 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2689/5324] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:06 2022] DELETE /identity/v3/projects/0c00094084934413b62c2a79ef898316 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:06.421597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc8ca-790d-4e64-8f65-8f821b703de7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:06.421906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc8ca-790d-4e64-8f65-8f821b703de7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:06.422165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162bc8ca-790d-4e64-8f65-8f821b703de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:06.455218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-162bc8ca-790d-4e64-8f65-8f821b703de7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:06.456414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-162bc8ca-790d-4e64-8f65-8f821b703de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:06.631894 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2636/5325] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:06.639673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f91a2-7964-474a-9a3c-d2a2dc947333 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:06.640230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f91a2-7964-474a-9a3c-d2a2dc947333 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:06.640523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f91a2-7964-474a-9a3c-d2a2dc947333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:06.674675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-291f91a2-7964-474a-9a3c-d2a2dc947333 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:06.684249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-291f91a2-7964-474a-9a3c-d2a2dc947333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:06.705623 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2690/5326] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:06.709692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bc8ca-790d-4e64-8f65-8f821b703de7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:06.724599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162bc8ca-790d-4e64-8f65-8f821b703de7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:06.740424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c10a4-3e2b-469a-8f54-24c5669d4def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:06.741563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c10a4-3e2b-469a-8f54-24c5669d4def admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:06.741995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c10a4-3e2b-469a-8f54-24c5669d4def admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:06.742417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c10a4-3e2b-469a-8f54-24c5669d4def admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:06.743291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c10a4-3e2b-469a-8f54-24c5669d4def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:06.743743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c10a4-3e2b-469a-8f54-24c5669d4def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:06.745571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c10a4-3e2b-469a-8f54-24c5669d4def admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:06.776850 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2637/5327] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:06.780936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f91a2-7964-474a-9a3c-d2a2dc947333 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:06.796431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f91a2-7964-474a-9a3c-d2a2dc947333 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:06.811055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354389f-fb1b-40af-a8b0-3dc7edcddeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:06.812259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354389f-fb1b-40af-a8b0-3dc7edcddeba admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:06.812854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354389f-fb1b-40af-a8b0-3dc7edcddeba admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:06.813376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354389f-fb1b-40af-a8b0-3dc7edcddeba admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:06.814193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354389f-fb1b-40af-a8b0-3dc7edcddeba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:06.816966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354389f-fb1b-40af-a8b0-3dc7edcddeba admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:06.914673 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2691/5328] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:06 2022] POST /identity/v3/projects => generated 397 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:06.916939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c10a4-3e2b-469a-8f54-24c5669d4def admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:06.935127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c10a4-3e2b-469a-8f54-24c5669d4def admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:07.126844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06f82b-3e77-4cd0-870c-d6607344505e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:07.127746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06f82b-3e77-4cd0-870c-d6607344505e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.128189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06f82b-3e77-4cd0-870c-d6607344505e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.128711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06f82b-3e77-4cd0-870c-d6607344505e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.129795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06f82b-3e77-4cd0-870c-d6607344505e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:07.133798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a06f82b-3e77-4cd0-870c-d6607344505e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:07.181911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354389f-fb1b-40af-a8b0-3dc7edcddeba admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:07.182170 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2638/5329] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:06 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:07.201922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354389f-fb1b-40af-a8b0-3dc7edcddeba admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:07.215598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e009741-3c9f-4dae-9ba3-cc6f0d24a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:07.216525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e009741-3c9f-4dae-9ba3-cc6f0d24a46e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.217292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e009741-3c9f-4dae-9ba3-cc6f0d24a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.217292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e009741-3c9f-4dae-9ba3-cc6f0d24a46e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.218133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e009741-3c9f-4dae-9ba3-cc6f0d24a46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:07.219857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e009741-3c9f-4dae-9ba3-cc6f0d24a46e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:07.241284 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2692/5330] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:07.246099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06f82b-3e77-4cd0-870c-d6607344505e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:07.259129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e009741-3c9f-4dae-9ba3-cc6f0d24a46e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:07.263450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06f82b-3e77-4cd0-870c-d6607344505e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:07.265678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6e009741-3c9f-4dae-9ba3-cc6f0d24a46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:07.292690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9099792-e4e0-4e28-b4b5-2c874d7c905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:07.292690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9099792-e4e0-4e28-b4b5-2c874d7c905a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.292690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9099792-e4e0-4e28-b4b5-2c874d7c905a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.292690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9099792-e4e0-4e28-b4b5-2c874d7c905a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.293043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9099792-e4e0-4e28-b4b5-2c874d7c905a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:07.293043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9099792-e4e0-4e28-b4b5-2c874d7c905a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:07.300784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e009741-3c9f-4dae-9ba3-cc6f0d24a46e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:07.316080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:07.320780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.321096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.322027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] PATH_INFO: `/v3/projects/4709cd9978df48b59f9b3caacce46a0a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.323736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4709cd9978df48b59f9b3caacce46a0a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:07.324776 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2639/5331] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:07.335090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9099792-e4e0-4e28-b4b5-2c874d7c905a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:07.338002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:07.361947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9099792-e4e0-4e28-b4b5-2c874d7c905a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:07.380734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2826a-536e-47f3-9157-62b5062e00fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:07.381644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2826a-536e-47f3-9157-62b5062e00fe admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.381980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2826a-536e-47f3-9157-62b5062e00fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.382262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2826a-536e-47f3-9157-62b5062e00fe admin admin] PATH_INFO: `/v3/projects/c3207a76425a4ba8878eb3aecb42f258/users/6d268a020a264de79c87e0d0f27a02d3/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.430418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2826a-536e-47f3-9157-62b5062e00fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3207a76425a4ba8878eb3aecb42f258, user_id=6d268a020a264de79c87e0d0f27a02d3, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:07.434004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2826a-536e-47f3-9157-62b5062e00fe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:07.437148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4709cd9978df48b59f9b3caacce46a0a', 'request_id': 'req-1227f20b-b854-4020-9f6a-b357c2802214'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:07.448408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4709cd9978df48b59f9b3caacce46a0a', 'request_id': 'req-1227f20b-b854-4020-9f6a-b357c2802214'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:07.467813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4709cd9978df48b59f9b3caacce46a0a', 'request_id': 'req-1227f20b-b854-4020-9f6a-b357c2802214'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:07.486284 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2640/5332] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:07 2022] PUT /identity/v3/projects/c3207a76425a4ba8878eb3aecb42f258/users/6d268a020a264de79c87e0d0f27a02d3/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:07.488499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761cc7-d3cc-4186-b843-10c7b50f766a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.488968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761cc7-d3cc-4186-b843-10c7b50f766a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.489756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74761cc7-d3cc-4186-b843-10c7b50f766a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.497432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] The token cache is being invalidate because project 4709cd9978df48b59f9b3caacce46a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:07.498358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:07.500483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1227f20b-b854-4020-9f6a-b357c2802214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:07.506517 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2693/5333] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:07 2022] DELETE /identity/v3/projects/4709cd9978df48b59f9b3caacce46a0a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:07.511326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7a40-744c-4354-a53b-f9a71675b104 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.511944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7a40-744c-4354-a53b-f9a71675b104 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.512362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7a40-744c-4354-a53b-f9a71675b104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.551708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-74761cc7-d3cc-4186-b843-10c7b50f766a None None] MFA Rules not processed for user `6d268a020a264de79c87e0d0f27a02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:07.552879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9e3c7a40-744c-4354-a53b-f9a71675b104 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:07.554330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-74761cc7-d3cc-4186-b843-10c7b50f766a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:07.557398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9e3c7a40-744c-4354-a53b-f9a71675b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:07.661840 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2694/5334] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:07.671895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d18a-739b-4809-b199-7d41f295ca17 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.672185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d18a-739b-4809-b199-7d41f295ca17 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.672459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135d18a-739b-4809-b199-7d41f295ca17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.686590 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2641/5335] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:07.692762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad06852-d742-4550-aa25-e4d67f484432 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.693851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad06852-d742-4550-aa25-e4d67f484432 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.697320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad06852-d742-4550-aa25-e4d67f484432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.718877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8135d18a-739b-4809-b199-7d41f295ca17 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:07.720505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8135d18a-739b-4809-b199-7d41f295ca17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:07.742651 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2695/5336] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:07.744803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d18a-739b-4809-b199-7d41f295ca17 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:07.755168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5ad06852-d742-4550-aa25-e4d67f484432 None None] MFA Rules not processed for user `6d268a020a264de79c87e0d0f27a02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:07.758605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5ad06852-d742-4550-aa25-e4d67f484432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:07.765696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135d18a-739b-4809-b199-7d41f295ca17 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:07.771397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f85ccb-1751-4446-b661-1927bbac1b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:07.772132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f85ccb-1751-4446-b661-1927bbac1b72 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.772403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f85ccb-1751-4446-b661-1927bbac1b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.772686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f85ccb-1751-4446-b661-1927bbac1b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.775641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f85ccb-1751-4446-b661-1927bbac1b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:07.775989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f85ccb-1751-4446-b661-1927bbac1b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:07.781645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f85ccb-1751-4446-b661-1927bbac1b72 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:07.791062 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2642/5337] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:07.792144 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2696/5338] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:08:07.793363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad06852-d742-4550-aa25-e4d67f484432 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:07.795203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5ad06852-d742-4550-aa25-e4d67f484432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:07.797553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f85ccb-1751-4446-b661-1927bbac1b72 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:07.810012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f85ccb-1751-4446-b661-1927bbac1b72 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:07.815672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee739e1-b9e1-4b0f-a771-282dd2994ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:07.817190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee739e1-b9e1-4b0f-a771-282dd2994ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.817819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee739e1-b9e1-4b0f-a771-282dd2994ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.818367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee739e1-b9e1-4b0f-a771-282dd2994ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.819329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee739e1-b9e1-4b0f-a771-282dd2994ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:07.821980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee739e1-b9e1-4b0f-a771-282dd2994ee6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:07.860510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2697/5339] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:07 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:07.864348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee739e1-b9e1-4b0f-a771-282dd2994ee6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:07.969114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad06852-d742-4550-aa25-e4d67f484432 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:07.976616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee739e1-b9e1-4b0f-a771-282dd2994ee6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:07.982019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aa767-54dd-4809-a2db-96598a49e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:07.983085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aa767-54dd-4809-a2db-96598a49e238 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:07.983841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aa767-54dd-4809-a2db-96598a49e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:07.984228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0aa767-54dd-4809-a2db-96598a49e238 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:07.984995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0aa767-54dd-4809-a2db-96598a49e238 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:07.988023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0aa767-54dd-4809-a2db-96598a49e238 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:08.027235 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2698/5340] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:07 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:08.032465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aa767-54dd-4809-a2db-96598a49e238 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:08.051555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0aa767-54dd-4809-a2db-96598a49e238 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:08.074245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd5920-1e63-46bd-a3a0-3841d07114eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:08.076966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5920-1e63-46bd-a3a0-3841d07114eb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.078367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5920-1e63-46bd-a3a0-3841d07114eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.079823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5920-1e63-46bd-a3a0-3841d07114eb admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.082627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd5920-1e63-46bd-a3a0-3841d07114eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:08.087597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd5920-1e63-46bd-a3a0-3841d07114eb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:08.090115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3bf13-9887-4a7f-b59c-8bb4d5030198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:08.091173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3bf13-9887-4a7f-b59c-8bb4d5030198 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.091528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3bf13-9887-4a7f-b59c-8bb4d5030198 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.091822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3bf13-9887-4a7f-b59c-8bb4d5030198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.122972 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2699/5341] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:08.126921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd5920-1e63-46bd-a3a0-3841d07114eb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:08.158184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd5920-1e63-46bd-a3a0-3841d07114eb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:08.181869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3bf13-9887-4a7f-b59c-8bb4d5030198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:08.184100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f3bf13-9887-4a7f-b59c-8bb4d5030198 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:08.184715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78efcd-3fad-4ae4-beed-4342e91e1d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:08.185998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78efcd-3fad-4ae4-beed-4342e91e1d83 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.188955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78efcd-3fad-4ae4-beed-4342e91e1d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.196968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78efcd-3fad-4ae4-beed-4342e91e1d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.197887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78efcd-3fad-4ae4-beed-4342e91e1d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:08.199617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d78efcd-3fad-4ae4-beed-4342e91e1d83 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:08.204230 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2643/5342] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:08.226830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362bc93-ed36-45c7-b061-b4ac5f1147ee None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.227297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362bc93-ed36-45c7-b061-b4ac5f1147ee None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.227721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362bc93-ed36-45c7-b061-b4ac5f1147ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.237818 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2700/5343] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:08:08.239513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78efcd-3fad-4ae4-beed-4342e91e1d83 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:08.255643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d362bc93-ed36-45c7-b061-b4ac5f1147ee None None] MFA Rules not processed for user `6d268a020a264de79c87e0d0f27a02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:08.256893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d362bc93-ed36-45c7-b061-b4ac5f1147ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:08.261552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78efcd-3fad-4ae4-beed-4342e91e1d83 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:08.273306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db69ab7-4972-421d-aa56-3a3416bf70f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:08.274922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db69ab7-4972-421d-aa56-3a3416bf70f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.276200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db69ab7-4972-421d-aa56-3a3416bf70f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.276488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db69ab7-4972-421d-aa56-3a3416bf70f9 admin admin] PATH_INFO: `/v3/projects/5381593fedb44d56a2c5548129a63079/users/82da3cd5f1c44e35800d092d64579308/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.277908 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2644/5344] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:08.296787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db69ab7-4972-421d-aa56-3a3416bf70f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5381593fedb44d56a2c5548129a63079, user_id=82da3cd5f1c44e35800d092d64579308, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:08.299710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db69ab7-4972-421d-aa56-3a3416bf70f9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:08.341377 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2701/5345] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:08 2022] PUT /identity/v3/projects/5381593fedb44d56a2c5548129a63079/users/82da3cd5f1c44e35800d092d64579308/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:08.353347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa8b8a-6394-44fd-9168-67052f8f1f0f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.353687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa8b8a-6394-44fd-9168-67052f8f1f0f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.354013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa8b8a-6394-44fd-9168-67052f8f1f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.393692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-76aa8b8a-6394-44fd-9168-67052f8f1f0f None None] MFA Rules not processed for user `82da3cd5f1c44e35800d092d64579308`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:08.397753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-76aa8b8a-6394-44fd-9168-67052f8f1f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:08.506792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b48b-d8be-409f-a5c6-f155d36b1136 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.507166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b48b-d8be-409f-a5c6-f155d36b1136 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.507547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01b48b-d8be-409f-a5c6-f155d36b1136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.541146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2b01b48b-d8be-409f-a5c6-f155d36b1136 None None] MFA Rules not processed for user `6d268a020a264de79c87e0d0f27a02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:08.543394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2b01b48b-d8be-409f-a5c6-f155d36b1136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:08.548867 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2645/5346] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:08.553873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa8b8a-6394-44fd-9168-67052f8f1f0f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:08.683765 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2702/5347] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:08.710333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa8b8a-6394-44fd-9168-67052f8f1f0f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:08.727627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8885dc3-da36-4eb4-bd5e-b1f08ee7e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:08.728339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885dc3-da36-4eb4-bd5e-b1f08ee7e60f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.728623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885dc3-da36-4eb4-bd5e-b1f08ee7e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.733900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8885dc3-da36-4eb4-bd5e-b1f08ee7e60f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.745202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8885dc3-da36-4eb4-bd5e-b1f08ee7e60f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:08.752863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8885dc3-da36-4eb4-bd5e-b1f08ee7e60f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:08.783796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250849-a06f-4a36-91b2-efd37e5c7757 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.784179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250849-a06f-4a36-91b2-efd37e5c7757 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.788231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c250849-a06f-4a36-91b2-efd37e5c7757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.824179 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2646/5348] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:08 2022] POST /identity/v3/projects => generated 377 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:08.827644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8885dc3-da36-4eb4-bd5e-b1f08ee7e60f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:08.839379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8c250849-a06f-4a36-91b2-efd37e5c7757 None None] MFA Rules not processed for user `6d268a020a264de79c87e0d0f27a02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:08.847416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8c250849-a06f-4a36-91b2-efd37e5c7757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:08.961481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8885dc3-da36-4eb4-bd5e-b1f08ee7e60f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:08.964505 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2703/5349] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:08.967368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339f061-9868-4cd4-b21b-43371ea3e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:08.968687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339f061-9868-4cd4-b21b-43371ea3e9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.969151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339f061-9868-4cd4-b21b-43371ea3e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.970067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339f061-9868-4cd4-b21b-43371ea3e9b0 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:08.970988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339f061-9868-4cd4-b21b-43371ea3e9b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:08.973989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339f061-9868-4cd4-b21b-43371ea3e9b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:08.988974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4a8b-5d81-45a7-bf58-909c99f82106 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:08.989410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4a8b-5d81-45a7-bf58-909c99f82106 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:08.989620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b4a8b-5d81-45a7-bf58-909c99f82106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:09.007885 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2647/5350] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:08 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:09.009565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339f061-9868-4cd4-b21b-43371ea3e9b0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:09.025411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339f061-9868-4cd4-b21b-43371ea3e9b0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:09.032302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1f7b7-7346-48f7-baf9-ddcc134a70b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:09.032655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f7b7-7346-48f7-baf9-ddcc134a70b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:09.033082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f7b7-7346-48f7-baf9-ddcc134a70b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:09.033502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1f7b7-7346-48f7-baf9-ddcc134a70b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:09.034785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1f7b7-7346-48f7-baf9-ddcc134a70b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:09.037430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1f7b7-7346-48f7-baf9-ddcc134a70b9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:09.041495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3d0b4a8b-5d81-45a7-bf58-909c99f82106 None None] MFA Rules not processed for user `6d268a020a264de79c87e0d0f27a02d3`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:09.042971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3d0b4a8b-5d81-45a7-bf58-909c99f82106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:09.054250 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2648/5351] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:09.055488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1f7b7-7346-48f7-baf9-ddcc134a70b9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:09.076164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1f7b7-7346-48f7-baf9-ddcc134a70b9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:09.084097 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2704/5352] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:09.089673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e25b54-0649-4c7f-b5da-869e0ba661d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:09.092455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e25b54-0649-4c7f-b5da-869e0ba661d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:09.092739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e25b54-0649-4c7f-b5da-869e0ba661d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:09.093019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e25b54-0649-4c7f-b5da-869e0ba661d7 admin admin] PATH_INFO: `/v3/projects/6fa2d438f3814f4aa01b583c2c493650/users/5aa8be7ef43f4b008833b7ea4e156bcc/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:09.101437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4a8b-5d81-45a7-bf58-909c99f82106 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:09.103004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3d0b4a8b-5d81-45a7-bf58-909c99f82106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:09.119263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b4a8b-5d81-45a7-bf58-909c99f82106 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:09.130297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e25b54-0649-4c7f-b5da-869e0ba661d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa2d438f3814f4aa01b583c2c493650, user_id=5aa8be7ef43f4b008833b7ea4e156bcc, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:09.134813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e25b54-0649-4c7f-b5da-869e0ba661d7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:09.137289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:09.138186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:09.138966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:09.139235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] PATH_INFO: `/v3/users/6d268a020a264de79c87e0d0f27a02d3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:09.140529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d268a020a264de79c87e0d0f27a02d3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:09.142813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:09.174960 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2649/5353] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:09 2022] PUT /identity/v3/projects/6fa2d438f3814f4aa01b583c2c493650/users/5aa8be7ef43f4b008833b7ea4e156bcc/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:09.178254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e25b54-0649-4c7f-b5da-869e0ba661d7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:09.302222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d268a020a264de79c87e0d0f27a02d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:09.321764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d268a020a264de79c87e0d0f27a02d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:09.326909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d268a020a264de79c87e0d0f27a02d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:09.327872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d268a020a264de79c87e0d0f27a02d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:09.342359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ccc934bf-3b94-4213-8558-3522fe25df96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d268a020a264de79c87e0d0f27a02d3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:09.386668 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2705/5354] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:09 2022] DELETE /identity/v3/users/6d268a020a264de79c87e0d0f27a02d3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:09.394895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a13e87-00d4-40bc-bea5-b004e14a3fc5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:09.395236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a13e87-00d4-40bc-bea5-b004e14a3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:09.395521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a13e87-00d4-40bc-bea5-b004e14a3fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:09.398251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e25b54-0649-4c7f-b5da-869e0ba661d7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:09.433364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a8a13e87-00d4-40bc-bea5-b004e14a3fc5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:09.436243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a8a13e87-00d4-40bc-bea5-b004e14a3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:09.530578 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2706/5355] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:09.542787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a13e87-00d4-40bc-bea5-b004e14a3fc5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:09.544119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf36ed-795a-46cf-8117-44c9c11feedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:09.544836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf36ed-795a-46cf-8117-44c9c11feedf admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:09.545294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a8a13e87-00d4-40bc-bea5-b004e14a3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:09.545804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf36ed-795a-46cf-8117-44c9c11feedf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:09.546102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf36ed-795a-46cf-8117-44c9c11feedf admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:09.547474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf36ed-795a-46cf-8117-44c9c11feedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:09.549930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf36ed-795a-46cf-8117-44c9c11feedf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:09.571346 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2650/5356] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:09.576224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf36ed-795a-46cf-8117-44c9c11feedf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:09.583743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7aaf36ed-795a-46cf-8117-44c9c11feedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:09.615411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf36ed-795a-46cf-8117-44c9c11feedf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:09.637320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b1c75e-0bb1-47b3-8d9b-88283cfb2dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:09.638615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1c75e-0bb1-47b3-8d9b-88283cfb2dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:09.638615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1c75e-0bb1-47b3-8d9b-88283cfb2dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:09.638857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b1c75e-0bb1-47b3-8d9b-88283cfb2dc3 admin admin] PATH_INFO: `/v3/projects/6fa2d438f3814f4aa01b583c2c493650/users/5aa8be7ef43f4b008833b7ea4e156bcc/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:09.641730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1c75e-0bb1-47b3-8d9b-88283cfb2dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa2d438f3814f4aa01b583c2c493650, user_id=5aa8be7ef43f4b008833b7ea4e156bcc, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:09.646079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b1c75e-0bb1-47b3-8d9b-88283cfb2dc3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:09.681229 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2651/5357] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:09 2022] PUT /identity/v3/projects/6fa2d438f3814f4aa01b583c2c493650/users/5aa8be7ef43f4b008833b7ea4e156bcc/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:09.685371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281bf81-f460-4828-84d3-720c5ffe9ae7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:09.685669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281bf81-f460-4828-84d3-720c5ffe9ae7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:09.686082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281bf81-f460-4828-84d3-720c5ffe9ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:09.695977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a13e87-00d4-40bc-bea5-b004e14a3fc5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:09.730548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3281bf81-f460-4828-84d3-720c5ffe9ae7 None None] MFA Rules not processed for user `5aa8be7ef43f4b008833b7ea4e156bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:09.732231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3281bf81-f460-4828-84d3-720c5ffe9ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:09.821116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839682-4cf2-4c8c-811e-2919d6785d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:09.822323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839682-4cf2-4c8c-811e-2919d6785d51 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:09.825639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839682-4cf2-4c8c-811e-2919d6785d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:09.841263 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2652/5358] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:09.879791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839682-4cf2-4c8c-811e-2919d6785d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:09.882157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281bf81-f460-4828-84d3-720c5ffe9ae7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:09.887954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3281bf81-f460-4828-84d3-720c5ffe9ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:10.142038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281bf81-f460-4828-84d3-720c5ffe9ae7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:10.151384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d0195-c1b1-4bac-b163-7a07e2aa7024 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:10.154389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0195-c1b1-4bac-b163-7a07e2aa7024 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:10.154838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0195-c1b1-4bac-b163-7a07e2aa7024 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:10.155503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d0195-c1b1-4bac-b163-7a07e2aa7024 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:10.174720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d0195-c1b1-4bac-b163-7a07e2aa7024 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:10.176860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d0195-c1b1-4bac-b163-7a07e2aa7024 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:10.194688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2653/5359] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:10.236748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839682-4cf2-4c8c-811e-2919d6785d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:10.248261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839682-4cf2-4c8c-811e-2919d6785d51 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:10.307597 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2707/5360] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:08:10.826111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d0195-c1b1-4bac-b163-7a07e2aa7024 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:10.840132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d0195-c1b1-4bac-b163-7a07e2aa7024 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:10.858826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf825-a45f-4da8-afac-906a86d946cb tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa8be7ef43f4b008833b7ea4e156bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fa2d438f3814f4aa01b583c2c493650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:10.859520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf825-a45f-4da8-afac-906a86d946cb tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:10.859806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf825-a45f-4da8-afac-906a86d946cb tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:10.860117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaf825-a45f-4da8-afac-906a86d946cb tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:10.874491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf825-a45f-4da8-afac-906a86d946cb tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:10.875721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf825-a45f-4da8-afac-906a86d946cb tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:10.880630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaf825-a45f-4da8-afac-906a86d946cb tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:10.898506 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2654/5361] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:10.902828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839682-4cf2-4c8c-811e-2919d6785d51 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:10.923990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839682-4cf2-4c8c-811e-2919d6785d51 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:10.941568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db677be5-f310-48be-9b09-9b83b96ea73b tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa8be7ef43f4b008833b7ea4e156bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fa2d438f3814f4aa01b583c2c493650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:10.943007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db677be5-f310-48be-9b09-9b83b96ea73b tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:10.943007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db677be5-f310-48be-9b09-9b83b96ea73b tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:10.943588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db677be5-f310-48be-9b09-9b83b96ea73b tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:10.945034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db677be5-f310-48be-9b09-9b83b96ea73b tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:10.946617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db677be5-f310-48be-9b09-9b83b96ea73b tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:10.980720 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2708/5362] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:10 2022] POST /identity/v3/projects => generated 353 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:10.984657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf825-a45f-4da8-afac-906a86d946cb tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:10.996849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaf825-a45f-4da8-afac-906a86d946cb tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:11.107197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa8be7ef43f4b008833b7ea4e156bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fa2d438f3814f4aa01b583c2c493650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:11.108556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:11.109555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:11.110112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:11.111613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:11.112259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:11.115583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:11.133626 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2655/5363] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:08:11.200063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db677be5-f310-48be-9b09-9b83b96ea73b tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:11.224645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db677be5-f310-48be-9b09-9b83b96ea73b tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:11.235106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5aa8be7ef43f4b008833b7ea4e156bcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6fa2d438f3814f4aa01b583c2c493650', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:11.236079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:11.236370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:11.236712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] PATH_INFO: `/v3/projects/e9148a83a5ab447280950f180a7de6db` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:11.239299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9148a83a5ab447280950f180a7de6db)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:11.243477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:11.359347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9148a83a5ab447280950f180a7de6db', 'request_id': 'req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:11.383596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9148a83a5ab447280950f180a7de6db', 'request_id': 'req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:11.396318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9148a83a5ab447280950f180a7de6db', 'request_id': 'req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:11.420178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] The token cache is being invalidate because project e9148a83a5ab447280950f180a7de6db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:11.420485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:11.421560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:11.428081 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2709/5364] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:11 2022] DELETE /identity/v3/projects/e9148a83a5ab447280950f180a7de6db => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:11.883067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:11.887360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:11.918635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:11.924755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:12.134574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2123-128f-40a6-8950-36d9b4744aba tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:12.176896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2ce2ab-4773-41ca-aab3-aa545c9b45c8 tempest-VolumeQuotaClassesTest-80697376 tempest-VolumeQuotaClassesTest-80697376-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:12.195126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:12.199512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:12.199512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:12.199512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:12.204562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:12.289284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:12.295722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:12.295955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:12.296271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] PATH_INFO: `/v3/users/82da3cd5f1c44e35800d092d64579308` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:12.300828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82da3cd5f1c44e35800d092d64579308)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:12.306361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:12.385376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:12.387047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:12.427323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2710/5365] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:12.429982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:12.431876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:12.443686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82da3cd5f1c44e35800d092d64579308'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.464248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82da3cd5f1c44e35800d092d64579308'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.465141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82da3cd5f1c44e35800d092d64579308'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.465730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82da3cd5f1c44e35800d092d64579308'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.479633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0be76-e0a7-4b2a-ab85-787375a3007e service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:12.495371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:12.496340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:12.496632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:12.496909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] PATH_INFO: `/v3/projects/c3207a76425a4ba8878eb3aecb42f258` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:12.499609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd9666ac-e0b0-44fb-ab75-70e74eced44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82da3cd5f1c44e35800d092d64579308'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.505955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3207a76425a4ba8878eb3aecb42f258)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:12.512974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:12.549109 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2656/5366] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:11 2022] DELETE /identity/v3/users/82da3cd5f1c44e35800d092d64579308 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:12.569607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a4f8-1fba-485d-bba6-2ecb0954e766 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:12.571415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a4f8-1fba-485d-bba6-2ecb0954e766 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:12.572428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f190a4f8-1fba-485d-bba6-2ecb0954e766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:12.628732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f190a4f8-1fba-485d-bba6-2ecb0954e766 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:12.631493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f190a4f8-1fba-485d-bba6-2ecb0954e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:12.672959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3207a76425a4ba8878eb3aecb42f258', 'request_id': 'req-c4e9a100-494f-469d-b525-bb5f2f3896a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.686692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3207a76425a4ba8878eb3aecb42f258', 'request_id': 'req-c4e9a100-494f-469d-b525-bb5f2f3896a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.693360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3207a76425a4ba8878eb3aecb42f258', 'request_id': 'req-c4e9a100-494f-469d-b525-bb5f2f3896a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.718320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] The token cache is being invalidate because project c3207a76425a4ba8878eb3aecb42f258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:12.718610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.723628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e9a100-494f-469d-b525-bb5f2f3896a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:12.736652 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2711/5367] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:12 2022] DELETE /identity/v3/projects/c3207a76425a4ba8878eb3aecb42f258 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:12.738385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8001-c245-4a4b-a7fe-7c9fd5e7cc93 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:12.738523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8001-c245-4a4b-a7fe-7c9fd5e7cc93 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:12.738723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8001-c245-4a4b-a7fe-7c9fd5e7cc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:12.780263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b80e8001-c245-4a4b-a7fe-7c9fd5e7cc93 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:12.781496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b80e8001-c245-4a4b-a7fe-7c9fd5e7cc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:12.809616 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2657/5368] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:12.873318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a4f8-1fba-485d-bba6-2ecb0954e766 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:12.875248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f190a4f8-1fba-485d-bba6-2ecb0954e766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:12.910601 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2712/5369] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:12.925686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030c23-f3d0-460f-8f2f-0ba0ae415939 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:12.926579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030c23-f3d0-460f-8f2f-0ba0ae415939 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:12.926999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030c23-f3d0-460f-8f2f-0ba0ae415939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:12.992705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-86030c23-f3d0-460f-8f2f-0ba0ae415939 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:12.997181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-86030c23-f3d0-460f-8f2f-0ba0ae415939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:13.021192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f190a4f8-1fba-485d-bba6-2ecb0954e766 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:13.041428 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2713/5370] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:13.045737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030c23-f3d0-460f-8f2f-0ba0ae415939 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:13.059009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030c23-f3d0-460f-8f2f-0ba0ae415939 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:13.073910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3263-6edc-4d1f-adf3-1f7f13db5ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:13.074499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3263-6edc-4d1f-adf3-1f7f13db5ffe admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:13.075356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3263-6edc-4d1f-adf3-1f7f13db5ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:13.075645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3263-6edc-4d1f-adf3-1f7f13db5ffe admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:13.076494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3263-6edc-4d1f-adf3-1f7f13db5ffe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:13.077426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3263-6edc-4d1f-adf3-1f7f13db5ffe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:13.078550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3263-6edc-4d1f-adf3-1f7f13db5ffe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:13.092492 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2714/5371] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:08:13.096990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3263-6edc-4d1f-adf3-1f7f13db5ffe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:13.125030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3263-6edc-4d1f-adf3-1f7f13db5ffe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:13.141832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae46a3e-67ff-4016-8216-ea25947c27cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:13.142537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46a3e-67ff-4016-8216-ea25947c27cb admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:13.142829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46a3e-67ff-4016-8216-ea25947c27cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:13.143833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae46a3e-67ff-4016-8216-ea25947c27cb admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:13.145124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae46a3e-67ff-4016-8216-ea25947c27cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:13.147121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae46a3e-67ff-4016-8216-ea25947c27cb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:13.188464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c3b7b-6c4a-4540-b6bc-97f7a9eacd7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:13.189183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c3b7b-6c4a-4540-b6bc-97f7a9eacd7a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:13.190109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c3b7b-6c4a-4540-b6bc-97f7a9eacd7a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:13.190369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c3b7b-6c4a-4540-b6bc-97f7a9eacd7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:13.207400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2715/5372] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:13 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:13.208492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae46a3e-67ff-4016-8216-ea25947c27cb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:13.214479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c3b7b-6c4a-4540-b6bc-97f7a9eacd7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:13.215771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c3b7b-6c4a-4540-b6bc-97f7a9eacd7a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:13.239794 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2658/5373] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:13.344397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae46a3e-67ff-4016-8216-ea25947c27cb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:13.350363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d024c-5e68-4d27-9821-14bfcdc32fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:13.351345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d024c-5e68-4d27-9821-14bfcdc32fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:13.351871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d024c-5e68-4d27-9821-14bfcdc32fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:13.352406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d024c-5e68-4d27-9821-14bfcdc32fb5 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:13.353311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d024c-5e68-4d27-9821-14bfcdc32fb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:13.355470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d024c-5e68-4d27-9821-14bfcdc32fb5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:13.401106 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2716/5374] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:13 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:13.406213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c3b7b-6c4a-4540-b6bc-97f7a9eacd7a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:13.422072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c3b7b-6c4a-4540-b6bc-97f7a9eacd7a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:13.438799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd872f-e301-455d-a066-456fa656472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:13.439480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd872f-e301-455d-a066-456fa656472b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:13.440215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd872f-e301-455d-a066-456fa656472b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:13.440648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd872f-e301-455d-a066-456fa656472b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:13.441571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd872f-e301-455d-a066-456fa656472b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:13.443371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd872f-e301-455d-a066-456fa656472b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:13.475334 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2659/5375] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:13.479494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d024c-5e68-4d27-9821-14bfcdc32fb5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:13.497210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d024c-5e68-4d27-9821-14bfcdc32fb5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:13.516267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154051f-1314-41c7-af39-adec1da340e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:13.524637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154051f-1314-41c7-af39-adec1da340e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:13.529678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154051f-1314-41c7-af39-adec1da340e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:13.530108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154051f-1314-41c7-af39-adec1da340e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:13.533644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154051f-1314-41c7-af39-adec1da340e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:13.542163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154051f-1314-41c7-af39-adec1da340e3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:13.571296 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2717/5376] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:13.575238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd872f-e301-455d-a066-456fa656472b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:13.592463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd872f-e301-455d-a066-456fa656472b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:13.617218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc026c13-8f21-4852-a368-16d289bf17ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:13.619457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc026c13-8f21-4852-a368-16d289bf17ba admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:13.620616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc026c13-8f21-4852-a368-16d289bf17ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:13.621178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc026c13-8f21-4852-a368-16d289bf17ba admin admin] PATH_INFO: `/v3/projects/bdbeae943588491d9f3a6c18c9671a8a/users/722acaff4a96454285de3e32aab91466/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:13.705589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc026c13-8f21-4852-a368-16d289bf17ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbeae943588491d9f3a6c18c9671a8a, user_id=722acaff4a96454285de3e32aab91466, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:13.720149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc026c13-8f21-4852-a368-16d289bf17ba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:13.747374 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2660/5377] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:13 2022] PUT /identity/v3/projects/bdbeae943588491d9f3a6c18c9671a8a/users/722acaff4a96454285de3e32aab91466/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:13.758475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cabdb-4921-4b39-8d86-b7bdc922e28a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:13.758842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cabdb-4921-4b39-8d86-b7bdc922e28a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:13.759586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6cabdb-4921-4b39-8d86-b7bdc922e28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:13.806023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9f6cabdb-4921-4b39-8d86-b7bdc922e28a None None] MFA Rules not processed for user `722acaff4a96454285de3e32aab91466`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:13.807507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9f6cabdb-4921-4b39-8d86-b7bdc922e28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:13.917548 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2718/5378] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:13.918437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452bd96-cc22-489a-9ca7-2c40ccd68dad None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:13.918726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452bd96-cc22-489a-9ca7-2c40ccd68dad None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:13.919005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452bd96-cc22-489a-9ca7-2c40ccd68dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:13.944588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2452bd96-cc22-489a-9ca7-2c40ccd68dad None None] MFA Rules not processed for user `722acaff4a96454285de3e32aab91466`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:13.946291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2452bd96-cc22-489a-9ca7-2c40ccd68dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:13.969100 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2661/5379] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:13.979766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cabdb-4921-4b39-8d86-b7bdc922e28a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:13.981201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9f6cabdb-4921-4b39-8d86-b7bdc922e28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:14.093238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452bd96-cc22-489a-9ca7-2c40ccd68dad None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:14.094687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2452bd96-cc22-489a-9ca7-2c40ccd68dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:14.297170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452bd96-cc22-489a-9ca7-2c40ccd68dad None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:14.315110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:14.316061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:14.316347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:14.316622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] PATH_INFO: `/v3/projects/5381593fedb44d56a2c5548129a63079` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:14.325266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5381593fedb44d56a2c5548129a63079)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:14.328675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:14.359507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6cabdb-4921-4b39-8d86-b7bdc922e28a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:14.365909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eff52-a119-4615-8669-c4eb2db3b0aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:14.367213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eff52-a119-4615-8669-c4eb2db3b0aa service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:14.367213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eff52-a119-4615-8669-c4eb2db3b0aa service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:14.367414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297eff52-a119-4615-8669-c4eb2db3b0aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:14.378728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297eff52-a119-4615-8669-c4eb2db3b0aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:14.380377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297eff52-a119-4615-8669-c4eb2db3b0aa service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:14.393707 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2719/5380] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:14.461141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5381593fedb44d56a2c5548129a63079', 'request_id': 'req-bc2f3e60-7a21-4528-8859-51346de84827'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.484705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5381593fedb44d56a2c5548129a63079', 'request_id': 'req-bc2f3e60-7a21-4528-8859-51346de84827'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.505353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5381593fedb44d56a2c5548129a63079', 'request_id': 'req-bc2f3e60-7a21-4528-8859-51346de84827'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.543732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] The token cache is being invalidate because project 5381593fedb44d56a2c5548129a63079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:14.547148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.548419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.555640 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2662/5381] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:14 2022] DELETE /identity/v3/projects/5381593fedb44d56a2c5548129a63079 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:14.560371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eff52-a119-4615-8669-c4eb2db3b0aa service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:14.583703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297eff52-a119-4615-8669-c4eb2db3b0aa service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:14.720656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:14.721754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:14.721754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:14.721754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] PATH_INFO: `/v3/users/5aa8be7ef43f4b008833b7ea4e156bcc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:14.725012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa8be7ef43f4b008833b7ea4e156bcc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:14.730142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:14.874541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa8be7ef43f4b008833b7ea4e156bcc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.884737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa8be7ef43f4b008833b7ea4e156bcc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.887843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa8be7ef43f4b008833b7ea4e156bcc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.889196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa8be7ef43f4b008833b7ea4e156bcc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.901431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-120fab5c-6da2-47b8-a43b-c9a55b8b1ed6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa8be7ef43f4b008833b7ea4e156bcc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:14.949321 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2720/5382] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:14 2022] DELETE /identity/v3/users/5aa8be7ef43f4b008833b7ea4e156bcc => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:16.602705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:16.604280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:16.643478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2f3e60-7a21-4528-8859-51346de84827 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:16.854871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:16.855879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:16.856199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:16.856475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] PATH_INFO: `/v3/projects/6fa2d438f3814f4aa01b583c2c493650` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:16.857717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa2d438f3814f4aa01b583c2c493650)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:16.860448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:16.947169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa2d438f3814f4aa01b583c2c493650', 'request_id': 'req-22a25a28-ccc0-44e7-9697-cbb892995fd6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:16.967476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa2d438f3814f4aa01b583c2c493650', 'request_id': 'req-22a25a28-ccc0-44e7-9697-cbb892995fd6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:16.980018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa2d438f3814f4aa01b583c2c493650', 'request_id': 'req-22a25a28-ccc0-44e7-9697-cbb892995fd6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:17.031269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] The token cache is being invalidate because project 6fa2d438f3814f4aa01b583c2c493650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:17.031462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:17.033664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22a25a28-ccc0-44e7-9697-cbb892995fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:17.036878 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2663/5383] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:16 2022] DELETE /identity/v3/projects/6fa2d438f3814f4aa01b583c2c493650 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:17.042543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bcadd-54df-4f05-8eee-3318d4cb9ad3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:17.043049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bcadd-54df-4f05-8eee-3318d4cb9ad3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:17.043367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bcadd-54df-4f05-8eee-3318d4cb9ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:17.084182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a52bcadd-54df-4f05-8eee-3318d4cb9ad3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:17.087512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a52bcadd-54df-4f05-8eee-3318d4cb9ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:17.203871 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2721/5384] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:17.211977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018cec4-4aec-4303-8496-d1ff3577ff6d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:17.212790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018cec4-4aec-4303-8496-d1ff3577ff6d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:17.213171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018cec4-4aec-4303-8496-d1ff3577ff6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:17.239516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3018cec4-4aec-4303-8496-d1ff3577ff6d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:17.242165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3018cec4-4aec-4303-8496-d1ff3577ff6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:17.257007 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2664/5385] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:17.262173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bcadd-54df-4f05-8eee-3318d4cb9ad3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:17.277244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bcadd-54df-4f05-8eee-3318d4cb9ad3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:17.286261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29cadd-0528-48d9-867f-f95645065935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:17.286949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29cadd-0528-48d9-867f-f95645065935 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:17.287230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29cadd-0528-48d9-867f-f95645065935 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:17.287508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29cadd-0528-48d9-867f-f95645065935 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:17.288301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29cadd-0528-48d9-867f-f95645065935 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:17.288619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29cadd-0528-48d9-867f-f95645065935 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:17.296246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29cadd-0528-48d9-867f-f95645065935 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:17.322419 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2722/5386] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:17.326141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018cec4-4aec-4303-8496-d1ff3577ff6d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:17.341864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018cec4-4aec-4303-8496-d1ff3577ff6d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:17.355238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0e19f-9b7c-4a28-8f48-12bf144c24a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:17.356201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0e19f-9b7c-4a28-8f48-12bf144c24a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:17.356510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0e19f-9b7c-4a28-8f48-12bf144c24a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:17.356837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0e19f-9b7c-4a28-8f48-12bf144c24a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:17.357634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0e19f-9b7c-4a28-8f48-12bf144c24a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:17.360258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c0e19f-9b7c-4a28-8f48-12bf144c24a0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:17.452456 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2665/5387] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:17 2022] POST /identity/v3/projects => generated 409 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:17.478731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29cadd-0528-48d9-867f-f95645065935 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:17.549785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29cadd-0528-48d9-867f-f95645065935 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:17.702310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc3d0c-3dba-418f-81af-36960c652de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:17.703019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc3d0c-3dba-418f-81af-36960c652de1 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:17.703281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc3d0c-3dba-418f-81af-36960c652de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:17.703563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc3d0c-3dba-418f-81af-36960c652de1 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:17.704939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc3d0c-3dba-418f-81af-36960c652de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:17.706534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc3d0c-3dba-418f-81af-36960c652de1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:17.751543 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2723/5388] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:17 2022] POST /identity/v3/users => generated 305 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:17.754916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0e19f-9b7c-4a28-8f48-12bf144c24a0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:17.796769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c0e19f-9b7c-4a28-8f48-12bf144c24a0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:17.811574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c3469-a23d-4cae-9987-a7a465f98448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:17.812530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c3469-a23d-4cae-9987-a7a465f98448 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:17.813506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c3469-a23d-4cae-9987-a7a465f98448 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:17.814119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c3469-a23d-4cae-9987-a7a465f98448 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:17.815465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c3469-a23d-4cae-9987-a7a465f98448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:17.821342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c3469-a23d-4cae-9987-a7a465f98448 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:17.854109 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2666/5389] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:17.858935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc3d0c-3dba-418f-81af-36960c652de1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:17.882736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc3d0c-3dba-418f-81af-36960c652de1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:17.905643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749ad25-0db5-4df1-891d-57fcb2e72519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:17.906702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749ad25-0db5-4df1-891d-57fcb2e72519 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:17.908100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749ad25-0db5-4df1-891d-57fcb2e72519 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:17.908637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749ad25-0db5-4df1-891d-57fcb2e72519 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:17.922809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749ad25-0db5-4df1-891d-57fcb2e72519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:17.930762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749ad25-0db5-4df1-891d-57fcb2e72519 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:18.023004 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2724/5390] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:18.026928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c3469-a23d-4cae-9987-a7a465f98448 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:18.044040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c3469-a23d-4cae-9987-a7a465f98448 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:18.067833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b37beb-cd0b-44be-9b76-b8395808c173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:18.069237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b37beb-cd0b-44be-9b76-b8395808c173 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:18.069663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b37beb-cd0b-44be-9b76-b8395808c173 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:18.070353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b37beb-cd0b-44be-9b76-b8395808c173 admin admin] PATH_INFO: `/v3/projects/6314ab85a88d4e189f6bd773093b8152/users/98f6f31825584a7ebc9b83ce6f26161b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:18.099155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b37beb-cd0b-44be-9b76-b8395808c173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6314ab85a88d4e189f6bd773093b8152, user_id=98f6f31825584a7ebc9b83ce6f26161b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:18.102296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b37beb-cd0b-44be-9b76-b8395808c173 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:18.151165 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2667/5391] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:18 2022] PUT /identity/v3/projects/6314ab85a88d4e189f6bd773093b8152/users/98f6f31825584a7ebc9b83ce6f26161b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:18.153927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad02a7-bbf4-4d9f-9dd1-fcf8e56c420e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:18.155426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad02a7-bbf4-4d9f-9dd1-fcf8e56c420e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:18.155715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad02a7-bbf4-4d9f-9dd1-fcf8e56c420e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:18.213735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5dad02a7-bbf4-4d9f-9dd1-fcf8e56c420e None None] MFA Rules not processed for user `98f6f31825584a7ebc9b83ce6f26161b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:18.215675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5dad02a7-bbf4-4d9f-9dd1-fcf8e56c420e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:18.379270 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2725/5392] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:18 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:18.384546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b37beb-cd0b-44be-9b76-b8395808c173 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:18.510910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b37beb-cd0b-44be-9b76-b8395808c173 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:18.542455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eacf5-c7e0-4e7d-84d5-d82ebfe9e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:18.548715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eacf5-c7e0-4e7d-84d5-d82ebfe9e84c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:18.550697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eacf5-c7e0-4e7d-84d5-d82ebfe9e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:18.551293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eacf5-c7e0-4e7d-84d5-d82ebfe9e84c admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:18.552340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eacf5-c7e0-4e7d-84d5-d82ebfe9e84c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:18.554325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eacf5-c7e0-4e7d-84d5-d82ebfe9e84c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:18.621916 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2668/5393] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:18 2022] POST /identity/v3/projects => generated 407 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:18.626540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad02a7-bbf4-4d9f-9dd1-fcf8e56c420e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:18.648521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad02a7-bbf4-4d9f-9dd1-fcf8e56c420e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:18.869769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef0588-44c6-4df1-b11f-e0a49760faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:18.870458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef0588-44c6-4df1-b11f-e0a49760faff admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:18.870861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef0588-44c6-4df1-b11f-e0a49760faff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:18.871591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef0588-44c6-4df1-b11f-e0a49760faff admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:18.872581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef0588-44c6-4df1-b11f-e0a49760faff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:18.878060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef0588-44c6-4df1-b11f-e0a49760faff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:18.927414 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2726/5394] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:18 2022] POST /identity/v3/users => generated 310 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:18.931507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eacf5-c7e0-4e7d-84d5-d82ebfe9e84c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:18.949808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eacf5-c7e0-4e7d-84d5-d82ebfe9e84c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:18.959799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b30df-0fb5-415a-8e42-86fa1a839523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:18.960694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b30df-0fb5-415a-8e42-86fa1a839523 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:18.961088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b30df-0fb5-415a-8e42-86fa1a839523 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:18.961469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b30df-0fb5-415a-8e42-86fa1a839523 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:18.962289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b30df-0fb5-415a-8e42-86fa1a839523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:18.965473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b30df-0fb5-415a-8e42-86fa1a839523 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:18.991510 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2669/5395] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:18.992714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef0588-44c6-4df1-b11f-e0a49760faff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:19.008083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef0588-44c6-4df1-b11f-e0a49760faff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:19.017568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae4c88-c982-4eb1-bdf9-5badef2d36a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:19.018975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae4c88-c982-4eb1-bdf9-5badef2d36a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:19.019399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae4c88-c982-4eb1-bdf9-5badef2d36a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:19.019812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae4c88-c982-4eb1-bdf9-5badef2d36a0 admin admin] PATH_INFO: `/v3/projects/507ff9ee1ac848729db1c605869727aa/users/a82661b98f394783b2c4c22ef0c2873e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:19.046916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae4c88-c982-4eb1-bdf9-5badef2d36a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507ff9ee1ac848729db1c605869727aa, user_id=a82661b98f394783b2c4c22ef0c2873e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:19.053642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae4c88-c982-4eb1-bdf9-5badef2d36a0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:19.120736 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2727/5396] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:18 2022] PUT /identity/v3/projects/507ff9ee1ac848729db1c605869727aa/users/a82661b98f394783b2c4c22ef0c2873e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:19.122642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b30df-0fb5-415a-8e42-86fa1a839523 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:19.140167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b30df-0fb5-415a-8e42-86fa1a839523 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:19.249901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f25983-f6a5-49b4-a897-8f6657a3d44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:19.250900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f25983-f6a5-49b4-a897-8f6657a3d44e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:19.251370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f25983-f6a5-49b4-a897-8f6657a3d44e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:19.251809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f25983-f6a5-49b4-a897-8f6657a3d44e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:19.252853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f25983-f6a5-49b4-a897-8f6657a3d44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:19.255824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f25983-f6a5-49b4-a897-8f6657a3d44e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:19.274038 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2670/5397] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:19 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:19.274230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae4c88-c982-4eb1-bdf9-5badef2d36a0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:19.297500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae4c88-c982-4eb1-bdf9-5badef2d36a0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:19.318040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef70e60-76c2-4ad5-8902-6c2c6432c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:19.320106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef70e60-76c2-4ad5-8902-6c2c6432c012 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:19.320669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef70e60-76c2-4ad5-8902-6c2c6432c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:19.321089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef70e60-76c2-4ad5-8902-6c2c6432c012 admin admin] PATH_INFO: `/v3/projects/507ff9ee1ac848729db1c605869727aa/users/a82661b98f394783b2c4c22ef0c2873e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:19.323804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef70e60-76c2-4ad5-8902-6c2c6432c012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507ff9ee1ac848729db1c605869727aa, user_id=a82661b98f394783b2c4c22ef0c2873e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:19.326919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef70e60-76c2-4ad5-8902-6c2c6432c012 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:19.348572 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2728/5398] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:19 2022] PUT /identity/v3/projects/507ff9ee1ac848729db1c605869727aa/users/a82661b98f394783b2c4c22ef0c2873e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:19.359374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b797a-eff4-48cf-b453-df951ca1643a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:19.359905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b797a-eff4-48cf-b453-df951ca1643a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:19.360691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b797a-eff4-48cf-b453-df951ca1643a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:19.416422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f50b797a-eff4-48cf-b453-df951ca1643a None None] MFA Rules not processed for user `a82661b98f394783b2c4c22ef0c2873e`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:19.418557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f50b797a-eff4-48cf-b453-df951ca1643a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:19.546464 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2671/5399] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:19 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:19.561686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef70e60-76c2-4ad5-8902-6c2c6432c012 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:19.563906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5ef70e60-76c2-4ad5-8902-6c2c6432c012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:19.646238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef70e60-76c2-4ad5-8902-6c2c6432c012 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:19.651135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5cd6b-0ac0-4050-9956-dfbba6fc92c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:19.652030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5cd6b-0ac0-4050-9956-dfbba6fc92c7 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:19.652576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5cd6b-0ac0-4050-9956-dfbba6fc92c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:19.652953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5cd6b-0ac0-4050-9956-dfbba6fc92c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:19.665041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5cd6b-0ac0-4050-9956-dfbba6fc92c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:19.667568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5cd6b-0ac0-4050-9956-dfbba6fc92c7 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:19.694318 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2729/5400] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:19 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:08:19.967360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b797a-eff4-48cf-b453-df951ca1643a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:19.982593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b797a-eff4-48cf-b453-df951ca1643a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:19.987184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dabf1-43fc-451b-a9d1-cc6eddb0a247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:19.988202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dabf1-43fc-451b-a9d1-cc6eddb0a247 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:19.988810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dabf1-43fc-451b-a9d1-cc6eddb0a247 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:19.989296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998dabf1-43fc-451b-a9d1-cc6eddb0a247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:20.095337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dabf1-43fc-451b-a9d1-cc6eddb0a247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:20.100250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998dabf1-43fc-451b-a9d1-cc6eddb0a247 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:20.128637 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2672/5401] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:19 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:22.304151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5cd6b-0ac0-4050-9956-dfbba6fc92c7 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:22.305856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aae5cd6b-0ac0-4050-9956-dfbba6fc92c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:22.416434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5cd6b-0ac0-4050-9956-dfbba6fc92c7 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:22.426296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13551477-edc2-485d-8efe-ad5621e0985a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:22.428087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13551477-edc2-485d-8efe-ad5621e0985a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:22.428590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13551477-edc2-485d-8efe-ad5621e0985a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:22.429015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13551477-edc2-485d-8efe-ad5621e0985a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:22.431702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-13551477-edc2-485d-8efe-ad5621e0985a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:22.521424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13551477-edc2-485d-8efe-ad5621e0985a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:22.523220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13551477-edc2-485d-8efe-ad5621e0985a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:22.548820 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2730/5402] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:24.464979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dabf1-43fc-451b-a9d1-cc6eddb0a247 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:24.469492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-998dabf1-43fc-451b-a9d1-cc6eddb0a247 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:24.486795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998dabf1-43fc-451b-a9d1-cc6eddb0a247 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:24.493275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:24.494456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:24.494948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:24.495444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] PATH_INFO: `/v3/users/722acaff4a96454285de3e32aab91466` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:24.497524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=722acaff4a96454285de3e32aab91466)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:24.500439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:24.574621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722acaff4a96454285de3e32aab91466'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:24.588511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722acaff4a96454285de3e32aab91466'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:24.589861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722acaff4a96454285de3e32aab91466'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:24.590692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722acaff4a96454285de3e32aab91466'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:24.617777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722acaff4a96454285de3e32aab91466'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:24.632168 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2673/5403] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:24 2022] DELETE /identity/v3/users/722acaff4a96454285de3e32aab91466 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:24.636336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3a9d0-2af7-4b6f-8b52-feba3adf6ff9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:24.636825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3a9d0-2af7-4b6f-8b52-feba3adf6ff9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:24.636903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3a9d0-2af7-4b6f-8b52-feba3adf6ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:24.662818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9dd3a9d0-2af7-4b6f-8b52-feba3adf6ff9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:24.664504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9dd3a9d0-2af7-4b6f-8b52-feba3adf6ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:24.761672 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2731/5404] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:24.784015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:24.786054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:24.901508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45516af4-c2e4-4fb8-96ee-fcc8d8f35a71 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:24.910600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ba5c3-8826-4ebf-8cec-dd73664ccd6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:24.911742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba5c3-8826-4ebf-8cec-dd73664ccd6c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:24.912475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba5c3-8826-4ebf-8cec-dd73664ccd6c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:24.912475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ba5c3-8826-4ebf-8cec-dd73664ccd6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:24.945901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ba5c3-8826-4ebf-8cec-dd73664ccd6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:24.947795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ba5c3-8826-4ebf-8cec-dd73664ccd6c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:24.960936 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2674/5405] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:08:25.998949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3a9d0-2af7-4b6f-8b52-feba3adf6ff9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:26.000421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9dd3a9d0-2af7-4b6f-8b52-feba3adf6ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:26.027050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3a9d0-2af7-4b6f-8b52-feba3adf6ff9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:26.033657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:26.036851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.040357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.040734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] PATH_INFO: `/v3/projects/bdbeae943588491d9f3a6c18c9671a8a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.042392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdbeae943588491d9f3a6c18c9671a8a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:26.044505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:26.143201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdbeae943588491d9f3a6c18c9671a8a', 'request_id': 'req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:26.155805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdbeae943588491d9f3a6c18c9671a8a', 'request_id': 'req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:26.173946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdbeae943588491d9f3a6c18c9671a8a', 'request_id': 'req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:26.199702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] The token cache is being invalidate because project bdbeae943588491d9f3a6c18c9671a8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:26.200160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:26.201788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:26.204490 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2732/5406] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:25 2022] DELETE /identity/v3/projects/bdbeae943588491d9f3a6c18c9671a8a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:26.210642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28dff5-eef3-4b8f-87fc-9113e5938d35 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.211111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28dff5-eef3-4b8f-87fc-9113e5938d35 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.211189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28dff5-eef3-4b8f-87fc-9113e5938d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.251904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1c28dff5-eef3-4b8f-87fc-9113e5938d35 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:26.253463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1c28dff5-eef3-4b8f-87fc-9113e5938d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:26.274291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:26.275835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:26.374104 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2675/5407] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:26.383714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42f4a2-2ef8-4096-b753-baa3ea657d07 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.384042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42f4a2-2ef8-4096-b753-baa3ea657d07 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.384331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42f4a2-2ef8-4096-b753-baa3ea657d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.421302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4e42f4a2-2ef8-4096-b753-baa3ea657d07 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:26.422587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4e42f4a2-2ef8-4096-b753-baa3ea657d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:26.434637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3755137-7bc3-4f5a-9a4a-7781dd1a40d1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:26.437637 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2676/5408] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:26.439875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42f4a2-2ef8-4096-b753-baa3ea657d07 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:26.440235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b910a2-eb96-441d-af90-d8a311d84229 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:26.441437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b910a2-eb96-441d-af90-d8a311d84229 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.441718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b910a2-eb96-441d-af90-d8a311d84229 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.441999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b910a2-eb96-441d-af90-d8a311d84229 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.453478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42f4a2-2ef8-4096-b753-baa3ea657d07 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:26.453629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82b910a2-eb96-441d-af90-d8a311d84229 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:26.474662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bb8c5-39a7-4996-b27f-8ed01be8294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:26.479849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bb8c5-39a7-4996-b27f-8ed01be8294a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.480183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bb8c5-39a7-4996-b27f-8ed01be8294a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.480469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bb8c5-39a7-4996-b27f-8ed01be8294a admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.481229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bb8c5-39a7-4996-b27f-8ed01be8294a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:26.481541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bb8c5-39a7-4996-b27f-8ed01be8294a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:26.488693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bb8c5-39a7-4996-b27f-8ed01be8294a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:26.527393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2677/5409] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:26.532235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bb8c5-39a7-4996-b27f-8ed01be8294a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:26.568765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bb8c5-39a7-4996-b27f-8ed01be8294a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:26.586806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9412597-105a-404f-a3d5-b9b2132d5398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:26.588516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9412597-105a-404f-a3d5-b9b2132d5398 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.589268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9412597-105a-404f-a3d5-b9b2132d5398 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.589947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9412597-105a-404f-a3d5-b9b2132d5398 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.590685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9412597-105a-404f-a3d5-b9b2132d5398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:26.594231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9412597-105a-404f-a3d5-b9b2132d5398 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:26.629741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b910a2-eb96-441d-af90-d8a311d84229 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:26.632009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b910a2-eb96-441d-af90-d8a311d84229 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:26.650473 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2733/5410] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:08:26.684627 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2678/5411] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:26 2022] POST /identity/v3/projects => generated 399 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:26.685262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b910a2-eb96-441d-af90-d8a311d84229 service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:26.703601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b910a2-eb96-441d-af90-d8a311d84229 service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:26.735963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b623-4167-47d2-82f4-d5e07d7c3609 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.736587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b623-4167-47d2-82f4-d5e07d7c3609 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.737016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b623-4167-47d2-82f4-d5e07d7c3609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.771289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8e91b623-4167-47d2-82f4-d5e07d7c3609 None None] MFA Rules not processed for user `f265820a8b974837949e9e3f36b58858`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:26.772800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e91b623-4167-47d2-82f4-d5e07d7c3609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:26.802647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acac075-6219-4a76-affd-54c8eaa17313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:26.803449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acac075-6219-4a76-affd-54c8eaa17313 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.803746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acac075-6219-4a76-affd-54c8eaa17313 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.804263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acac075-6219-4a76-affd-54c8eaa17313 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.805310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acac075-6219-4a76-affd-54c8eaa17313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:26.807447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acac075-6219-4a76-affd-54c8eaa17313 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:26.840206 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2734/5412] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:26 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:26.841502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acac075-6219-4a76-affd-54c8eaa17313 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:26.843805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9acac075-6219-4a76-affd-54c8eaa17313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:26.904315 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2679/5413] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:26.907562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b623-4167-47d2-82f4-d5e07d7c3609 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:26.923542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b623-4167-47d2-82f4-d5e07d7c3609 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:26.936653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29feeb0-0fc2-4b5c-a2d0-1070c6c770b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:26.938999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29feeb0-0fc2-4b5c-a2d0-1070c6c770b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.939193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29feeb0-0fc2-4b5c-a2d0-1070c6c770b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.939382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29feeb0-0fc2-4b5c-a2d0-1070c6c770b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.945505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29feeb0-0fc2-4b5c-a2d0-1070c6c770b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:26.951361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29feeb0-0fc2-4b5c-a2d0-1070c6c770b2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:26.981406 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2680/5414] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:26.983080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acac075-6219-4a76-affd-54c8eaa17313 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:26.987068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29feeb0-0fc2-4b5c-a2d0-1070c6c770b2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:26.992115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07116685-d8de-480d-bc04-d7734f03f615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:26.993004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07116685-d8de-480d-bc04-d7734f03f615 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:26.993377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07116685-d8de-480d-bc04-d7734f03f615 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:26.994338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07116685-d8de-480d-bc04-d7734f03f615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:26.997783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07116685-d8de-480d-bc04-d7734f03f615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:27.017101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29feeb0-0fc2-4b5c-a2d0-1070c6c770b2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:27.026079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06860a56-0382-40c0-a3a6-68c0889e488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:27.026886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06860a56-0382-40c0-a3a6-68c0889e488c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:27.027175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06860a56-0382-40c0-a3a6-68c0889e488c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:27.027451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06860a56-0382-40c0-a3a6-68c0889e488c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:27.028214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06860a56-0382-40c0-a3a6-68c0889e488c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:27.029826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06860a56-0382-40c0-a3a6-68c0889e488c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:27.047074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07116685-d8de-480d-bc04-d7734f03f615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:27.051800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07116685-d8de-480d-bc04-d7734f03f615 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:27.066824 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2681/5415] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:08:27.114853 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2735/5416] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:27.156364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06860a56-0382-40c0-a3a6-68c0889e488c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:27.181339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06860a56-0382-40c0-a3a6-68c0889e488c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:27.188817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787e932-e6dd-4504-8306-86737b31ad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:27.190043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787e932-e6dd-4504-8306-86737b31ad2e admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:27.190325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787e932-e6dd-4504-8306-86737b31ad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:27.190636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787e932-e6dd-4504-8306-86737b31ad2e admin admin] PATH_INFO: `/v3/projects/cc51d0de03ed49c08738d431ef274427/users/d5cbc0bf9ae44ad08d706bb23f7c979a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:27.214073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787e932-e6dd-4504-8306-86737b31ad2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc51d0de03ed49c08738d431ef274427, user_id=d5cbc0bf9ae44ad08d706bb23f7c979a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:27.217118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787e932-e6dd-4504-8306-86737b31ad2e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:27.259813 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2682/5417] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:27 2022] PUT /identity/v3/projects/cc51d0de03ed49c08738d431ef274427/users/d5cbc0bf9ae44ad08d706bb23f7c979a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:27.261688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d608a-ac19-49de-901e-c1d74a78e3be None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:27.261971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d608a-ac19-49de-901e-c1d74a78e3be None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:27.262243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d608a-ac19-49de-901e-c1d74a78e3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:27.314794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-db7d608a-ac19-49de-901e-c1d74a78e3be None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:27.330523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-db7d608a-ac19-49de-901e-c1d74a78e3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:27.449249 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2736/5418] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:27.474590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787e932-e6dd-4504-8306-86737b31ad2e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:27.479893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d787e932-e6dd-4504-8306-86737b31ad2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:27.619992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d608a-ac19-49de-901e-c1d74a78e3be None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:27.658914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787e932-e6dd-4504-8306-86737b31ad2e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:27.663621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd17794-d09a-4a77-9dc2-a47402d92701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:27.664499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd17794-d09a-4a77-9dc2-a47402d92701 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:27.665375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd17794-d09a-4a77-9dc2-a47402d92701 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:27.665580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd17794-d09a-4a77-9dc2-a47402d92701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:27.692634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd17794-d09a-4a77-9dc2-a47402d92701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:27.694346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd17794-d09a-4a77-9dc2-a47402d92701 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:27.717928 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2683/5419] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:27.810620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd17794-d09a-4a77-9dc2-a47402d92701 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:27.812524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8fd17794-d09a-4a77-9dc2-a47402d92701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:27.813446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d608a-ac19-49de-901e-c1d74a78e3be None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:27.828137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e26a1-82d4-4507-b952-19fafb89f3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:27.828797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e26a1-82d4-4507-b952-19fafb89f3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:27.828915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd17794-d09a-4a77-9dc2-a47402d92701 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:27.829077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e26a1-82d4-4507-b952-19fafb89f3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:27.829350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e26a1-82d4-4507-b952-19fafb89f3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:27.832387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-559e26a1-82d4-4507-b952-19fafb89f3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:27.834951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:27.835905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:27.836291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:27.836657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] PATH_INFO: `/v3/users/98f6f31825584a7ebc9b83ce6f26161b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:27.838046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f6f31825584a7ebc9b83ce6f26161b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:27.841401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:27.941405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f6f31825584a7ebc9b83ce6f26161b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:27.953844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f6f31825584a7ebc9b83ce6f26161b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:27.955121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f6f31825584a7ebc9b83ce6f26161b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:27.956584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f6f31825584a7ebc9b83ce6f26161b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:27.997232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e26a1-82d4-4507-b952-19fafb89f3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:27.999594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bb3e0c5a-948b-4d39-acc0-8cafa9054dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f6f31825584a7ebc9b83ce6f26161b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:28.001441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e26a1-82d4-4507-b952-19fafb89f3c4 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:28.033594 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2684/5420] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:27 2022] DELETE /identity/v3/users/98f6f31825584a7ebc9b83ce6f26161b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:28.033756 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2737/5421] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:08:28.035259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3374-7f89-4ed6-83d9-1d41d1775822 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:28.035550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3374-7f89-4ed6-83d9-1d41d1775822 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:28.035831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c3374-7f89-4ed6-83d9-1d41d1775822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:28.077737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f08c3374-7f89-4ed6-83d9-1d41d1775822 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:28.079043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f08c3374-7f89-4ed6-83d9-1d41d1775822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:28.211783 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2685/5422] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:28.254993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e26a1-82d4-4507-b952-19fafb89f3c4 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:28.264978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e26a1-82d4-4507-b952-19fafb89f3c4 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:28.408560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f877-aedf-49a6-a798-a6fea57c89a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:28.409959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f877-aedf-49a6-a798-a6fea57c89a1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:28.410245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f877-aedf-49a6-a798-a6fea57c89a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:28.410533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47f877-aedf-49a6-a798-a6fea57c89a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:28.438408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47f877-aedf-49a6-a798-a6fea57c89a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:28.445300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47f877-aedf-49a6-a798-a6fea57c89a1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:28.469979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2738/5423] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:30.036692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3374-7f89-4ed6-83d9-1d41d1775822 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:30.038419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f08c3374-7f89-4ed6-83d9-1d41d1775822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:30.057578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c3374-7f89-4ed6-83d9-1d41d1775822 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:30.098577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:30.100514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:30.101018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:30.102693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] PATH_INFO: `/v3/projects/6314ab85a88d4e189f6bd773093b8152` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:30.107367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6314ab85a88d4e189f6bd773093b8152)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:30.116588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:30.233108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6314ab85a88d4e189f6bd773093b8152', 'request_id': 'req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.251200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6314ab85a88d4e189f6bd773093b8152', 'request_id': 'req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.259212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6314ab85a88d4e189f6bd773093b8152', 'request_id': 'req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.272379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] The token cache is being invalidate because project 6314ab85a88d4e189f6bd773093b8152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:30.272821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.273766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-991e7cff-5b1f-4a7b-b3fe-fb620fbb0088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.276102 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2686/5424] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:30 2022] DELETE /identity/v3/projects/6314ab85a88d4e189f6bd773093b8152 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:30.279939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f877-aedf-49a6-a798-a6fea57c89a1 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:30.296368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47f877-aedf-49a6-a798-a6fea57c89a1 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:30.372727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:30.374051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:30.374712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:30.375134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] PATH_INFO: `/v3/users/a82661b98f394783b2c4c22ef0c2873e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:30.376919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82661b98f394783b2c4c22ef0c2873e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:30.382023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:30.460354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82661b98f394783b2c4c22ef0c2873e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.468985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82661b98f394783b2c4c22ef0c2873e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.469769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82661b98f394783b2c4c22ef0c2873e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.470648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82661b98f394783b2c4c22ef0c2873e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.479292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82661b98f394783b2c4c22ef0c2873e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:30.499797 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2739/5425] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:30 2022] DELETE /identity/v3/users/a82661b98f394783b2c4c22ef0c2873e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:31.692841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0339550-0c3b-4b5c-a549-e10ab421bb9b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:31.693845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0339550-0c3b-4b5c-a549-e10ab421bb9b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:31.694522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0339550-0c3b-4b5c-a549-e10ab421bb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:31.796064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c0339550-0c3b-4b5c-a549-e10ab421bb9b None None] MFA Rules not processed for user `d5cbc0bf9ae44ad08d706bb23f7c979a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:31.798222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c0339550-0c3b-4b5c-a549-e10ab421bb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:31.844855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:31.846754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:31.968456 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2687/5426] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:31.978514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774c78-bc4c-42ba-a956-973d92c84b59 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:31.978901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774c78-bc4c-42ba-a956-973d92c84b59 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:31.981892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774c78-bc4c-42ba-a956-973d92c84b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:31.985103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a8b9d-c05d-4e1e-84f7-68a59414a646 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:31.990458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:31.991865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:31.992374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:31.992834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] PATH_INFO: `/v3/projects/507ff9ee1ac848729db1c605869727aa` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:31.994237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507ff9ee1ac848729db1c605869727aa)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:31.997021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:32.051997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-72774c78-bc4c-42ba-a956-973d92c84b59 None None] MFA Rules not processed for user `d5cbc0bf9ae44ad08d706bb23f7c979a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:32.052871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507ff9ee1ac848729db1c605869727aa', 'request_id': 'req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:32.054344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-72774c78-bc4c-42ba-a956-973d92c84b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:32.061585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507ff9ee1ac848729db1c605869727aa', 'request_id': 'req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:32.074838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507ff9ee1ac848729db1c605869727aa', 'request_id': 'req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:32.090362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] The token cache is being invalidate because project 507ff9ee1ac848729db1c605869727aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:32.090568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:32.091237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bf5a08f9-bbfe-4fa2-a062-d8de5e553e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:32.093790 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2740/5427] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:31 2022] DELETE /identity/v3/projects/507ff9ee1ac848729db1c605869727aa => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:32.095178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b172-ca24-4ea0-8fde-1f2da72d0572 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:32.095606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b172-ca24-4ea0-8fde-1f2da72d0572 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:32.096087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075b172-ca24-4ea0-8fde-1f2da72d0572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:32.118094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1075b172-ca24-4ea0-8fde-1f2da72d0572 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:32.120127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1075b172-ca24-4ea0-8fde-1f2da72d0572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:32.218509 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2688/5428] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:32.220477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dae421-32a0-48ca-a370-eb11f7ae8b1f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:32.220770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dae421-32a0-48ca-a370-eb11f7ae8b1f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:32.221051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dae421-32a0-48ca-a370-eb11f7ae8b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:32.263947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-29dae421-32a0-48ca-a370-eb11f7ae8b1f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:32.265339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-29dae421-32a0-48ca-a370-eb11f7ae8b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:32.290183 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2741/5429] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:32.291219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075b172-ca24-4ea0-8fde-1f2da72d0572 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:32.294991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1075b172-ca24-4ea0-8fde-1f2da72d0572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:32.346389 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2689/5430] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:32.346389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dae421-32a0-48ca-a370-eb11f7ae8b1f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:32.346389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-29dae421-32a0-48ca-a370-eb11f7ae8b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:32.432406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dae421-32a0-48ca-a370-eb11f7ae8b1f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:32.443333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f6ab5-766f-4a6c-b2af-195cd4a34857 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:32.444035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f6ab5-766f-4a6c-b2af-195cd4a34857 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:32.444438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f6ab5-766f-4a6c-b2af-195cd4a34857 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:32.444723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f6ab5-766f-4a6c-b2af-195cd4a34857 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:32.460505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f6ab5-766f-4a6c-b2af-195cd4a34857 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:32.461459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6f6ab5-766f-4a6c-b2af-195cd4a34857 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:32.471281 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2690/5431] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:32.473504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded2fd-9f57-4f54-9f02-1e50163865ee None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:32.473757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded2fd-9f57-4f54-9f02-1e50163865ee None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:32.473837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ded2fd-9f57-4f54-9f02-1e50163865ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:32.498806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f2ded2fd-9f57-4f54-9f02-1e50163865ee None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:32.500911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f2ded2fd-9f57-4f54-9f02-1e50163865ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:32.529825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075b172-ca24-4ea0-8fde-1f2da72d0572 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:32.532628 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2691/5432] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:32.542012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded2fd-9f57-4f54-9f02-1e50163865ee None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:32.568814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654436-ed5a-40f6-b766-741c4a241d71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:32.569492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654436-ed5a-40f6-b766-741c4a241d71 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:32.569775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654436-ed5a-40f6-b766-741c4a241d71 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:32.570051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd654436-ed5a-40f6-b766-741c4a241d71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:32.582826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ded2fd-9f57-4f54-9f02-1e50163865ee None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:32.589919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dd654436-ed5a-40f6-b766-741c4a241d71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:32.617730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb87e-d0c6-4716-8cd9-fadcc4925b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:32.618485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb87e-d0c6-4716-8cd9-fadcc4925b88 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:32.618767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb87e-d0c6-4716-8cd9-fadcc4925b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:32.619120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bb87e-d0c6-4716-8cd9-fadcc4925b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:32.620081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb87e-d0c6-4716-8cd9-fadcc4925b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:32.620441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb87e-d0c6-4716-8cd9-fadcc4925b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:32.631341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bb87e-d0c6-4716-8cd9-fadcc4925b88 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:32.633739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654436-ed5a-40f6-b766-741c4a241d71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:32.635409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd654436-ed5a-40f6-b766-741c4a241d71 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:32.672793 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2742/5433] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:32 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:32.673606 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2692/5434] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:32.678640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654436-ed5a-40f6-b766-741c4a241d71 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:32.708480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd654436-ed5a-40f6-b766-741c4a241d71 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:32.719555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ecbc-61a5-4e41-866d-75562aa0da9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:32.720358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ecbc-61a5-4e41-866d-75562aa0da9e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:32.720726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ecbc-61a5-4e41-866d-75562aa0da9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:32.721085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb6ecbc-61a5-4e41-866d-75562aa0da9e admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:32.722432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6ecbc-61a5-4e41-866d-75562aa0da9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:32.724961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb6ecbc-61a5-4e41-866d-75562aa0da9e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:32.813894 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2743/5435] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:32 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:32.814843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb87e-d0c6-4716-8cd9-fadcc4925b88 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:32.831090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bb87e-d0c6-4716-8cd9-fadcc4925b88 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:32.976843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599aae0-dc8f-48f4-a50f-eb1e724ba3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:32.978040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599aae0-dc8f-48f4-a50f-eb1e724ba3f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:32.978601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599aae0-dc8f-48f4-a50f-eb1e724ba3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:32.979089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599aae0-dc8f-48f4-a50f-eb1e724ba3f6 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:32.980085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599aae0-dc8f-48f4-a50f-eb1e724ba3f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:32.982663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599aae0-dc8f-48f4-a50f-eb1e724ba3f6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:33.018703 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2693/5436] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:32 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:33.022599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ecbc-61a5-4e41-866d-75562aa0da9e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:33.041254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb6ecbc-61a5-4e41-866d-75562aa0da9e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:33.064793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f659ce-3ccc-467c-9108-6cd76ee1e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:33.065506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f659ce-3ccc-467c-9108-6cd76ee1e754 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:33.065798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f659ce-3ccc-467c-9108-6cd76ee1e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:33.066095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f659ce-3ccc-467c-9108-6cd76ee1e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:33.066841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f659ce-3ccc-467c-9108-6cd76ee1e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:33.073785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f659ce-3ccc-467c-9108-6cd76ee1e754 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:33.120248 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2744/5437] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:33.125086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599aae0-dc8f-48f4-a50f-eb1e724ba3f6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:33.153190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599aae0-dc8f-48f4-a50f-eb1e724ba3f6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:33.168560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cedfd4-10b5-49a0-9607-fff1c96f7509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:33.169251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cedfd4-10b5-49a0-9607-fff1c96f7509 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:33.169538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cedfd4-10b5-49a0-9607-fff1c96f7509 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:33.169821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cedfd4-10b5-49a0-9607-fff1c96f7509 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:33.173362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cedfd4-10b5-49a0-9607-fff1c96f7509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:33.175733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cedfd4-10b5-49a0-9607-fff1c96f7509 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:33.205016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f659ce-3ccc-467c-9108-6cd76ee1e754 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:33.206883 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2694/5438] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:33.219067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f659ce-3ccc-467c-9108-6cd76ee1e754 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:33.241362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63aaec2-fc4c-45d4-949d-7b6f243d95e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:33.242625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aaec2-fc4c-45d4-949d-7b6f243d95e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:33.249618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aaec2-fc4c-45d4-949d-7b6f243d95e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:33.250108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63aaec2-fc4c-45d4-949d-7b6f243d95e4 admin admin] PATH_INFO: `/v3/projects/1aec050c7b634ce0801bf8c166cda19e/users/2d8b31eba4544e0eb48b7f6e16a9c9ce/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:33.295483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63aaec2-fc4c-45d4-949d-7b6f243d95e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aec050c7b634ce0801bf8c166cda19e, user_id=2d8b31eba4544e0eb48b7f6e16a9c9ce, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:33.298361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63aaec2-fc4c-45d4-949d-7b6f243d95e4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:33.327478 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2745/5439] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:33 2022] PUT /identity/v3/projects/1aec050c7b634ce0801bf8c166cda19e/users/2d8b31eba4544e0eb48b7f6e16a9c9ce/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:33.342136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cd3c1-b201-4c2f-acd2-5ba35c835385 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:33.342527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cd3c1-b201-4c2f-acd2-5ba35c835385 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:33.343032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cd3c1-b201-4c2f-acd2-5ba35c835385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:33.380457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b61cd3c1-b201-4c2f-acd2-5ba35c835385 None None] MFA Rules not processed for user `2d8b31eba4544e0eb48b7f6e16a9c9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:33.383234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b61cd3c1-b201-4c2f-acd2-5ba35c835385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:33.561975 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2695/5440] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:33.563296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63aaec2-fc4c-45d4-949d-7b6f243d95e4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:33.786441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63aaec2-fc4c-45d4-949d-7b6f243d95e4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:33.794263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a463ce9-613b-478a-9686-e074940cce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:33.795030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463ce9-613b-478a-9686-e074940cce56 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:33.795504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463ce9-613b-478a-9686-e074940cce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:33.796062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a463ce9-613b-478a-9686-e074940cce56 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:33.796993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a463ce9-613b-478a-9686-e074940cce56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:33.799382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a463ce9-613b-478a-9686-e074940cce56 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:33.861871 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2746/5441] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:33 2022] POST /identity/v3/projects => generated 387 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:33.869958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cd3c1-b201-4c2f-acd2-5ba35c835385 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:33.897125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cd3c1-b201-4c2f-acd2-5ba35c835385 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:34.075559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f141049-d61e-40cb-a4a8-508fd55fc3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:34.076272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141049-d61e-40cb-a4a8-508fd55fc3ea admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:34.076563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141049-d61e-40cb-a4a8-508fd55fc3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:34.076847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f141049-d61e-40cb-a4a8-508fd55fc3ea admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:34.077617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f141049-d61e-40cb-a4a8-508fd55fc3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:34.079525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f141049-d61e-40cb-a4a8-508fd55fc3ea admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:34.118699 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2696/5442] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:33 2022] POST /identity/v3/users => generated 300 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:34.122790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a463ce9-613b-478a-9686-e074940cce56 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:34.148309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a463ce9-613b-478a-9686-e074940cce56 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:34.166534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe0e00-ba89-495c-9834-326b83273882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:34.171740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe0e00-ba89-495c-9834-326b83273882 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:34.176840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe0e00-ba89-495c-9834-326b83273882 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:34.178397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe0e00-ba89-495c-9834-326b83273882 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:34.182095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe0e00-ba89-495c-9834-326b83273882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:34.191276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe0e00-ba89-495c-9834-326b83273882 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:34.221925 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2747/5443] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:34.226236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f141049-d61e-40cb-a4a8-508fd55fc3ea admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:34.243063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f141049-d61e-40cb-a4a8-508fd55fc3ea admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:34.260746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f3854-7980-4949-a8c7-85297820cf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:34.261673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f3854-7980-4949-a8c7-85297820cf36 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:34.261962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f3854-7980-4949-a8c7-85297820cf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:34.262250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f3854-7980-4949-a8c7-85297820cf36 admin admin] PATH_INFO: `/v3/projects/612c971a4d2d4a69a5a2cd9189ad4dfd/users/c30fd4f4df5b4376b1112535fc41a6e2/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:34.291322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f3854-7980-4949-a8c7-85297820cf36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612c971a4d2d4a69a5a2cd9189ad4dfd, user_id=c30fd4f4df5b4376b1112535fc41a6e2, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:34.294201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f3854-7980-4949-a8c7-85297820cf36 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:34.315697 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2697/5444] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:34 2022] PUT /identity/v3/projects/612c971a4d2d4a69a5a2cd9189ad4dfd/users/c30fd4f4df5b4376b1112535fc41a6e2/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:34.320933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe0e00-ba89-495c-9834-326b83273882 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:34.338618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe0e00-ba89-495c-9834-326b83273882 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:34.484753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3e4e5-0899-4cfa-87e7-cd1f3647796b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:34.485862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3e4e5-0899-4cfa-87e7-cd1f3647796b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:34.486622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3e4e5-0899-4cfa-87e7-cd1f3647796b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:34.487090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac3e4e5-0899-4cfa-87e7-cd1f3647796b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:34.488909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3e4e5-0899-4cfa-87e7-cd1f3647796b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:34.492018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac3e4e5-0899-4cfa-87e7-cd1f3647796b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:34.532182 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2748/5445] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:34.532978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f3854-7980-4949-a8c7-85297820cf36 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:34.561087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3e4e5-0899-4cfa-87e7-cd1f3647796b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:34.563474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1ac3e4e5-0899-4cfa-87e7-cd1f3647796b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:34.584236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f3854-7980-4949-a8c7-85297820cf36 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:34.594854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db13633-0601-4018-8b2d-7b9fe9271ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:34.600710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13633-0601-4018-8b2d-7b9fe9271ab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:34.602031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13633-0601-4018-8b2d-7b9fe9271ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:34.602777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db13633-0601-4018-8b2d-7b9fe9271ab1 admin admin] PATH_INFO: `/v3/projects/612c971a4d2d4a69a5a2cd9189ad4dfd/users/c30fd4f4df5b4376b1112535fc41a6e2/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:34.609059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db13633-0601-4018-8b2d-7b9fe9271ab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612c971a4d2d4a69a5a2cd9189ad4dfd, user_id=c30fd4f4df5b4376b1112535fc41a6e2, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:34.614217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac3e4e5-0899-4cfa-87e7-cd1f3647796b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:34.622006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db13633-0601-4018-8b2d-7b9fe9271ab1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:34.640239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:34.645999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:34.646286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:34.649168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] PATH_INFO: `/v3/users/8cab4cf432764bb487de9abc0f283898` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:34.671305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cab4cf432764bb487de9abc0f283898)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:34.673721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:34.702874 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2698/5446] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:34 2022] PUT /identity/v3/projects/612c971a4d2d4a69a5a2cd9189ad4dfd/users/c30fd4f4df5b4376b1112535fc41a6e2/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:34.713598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a466-3829-403f-9515-6e2de6973383 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:34.714016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a466-3829-403f-9515-6e2de6973383 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:34.714304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94a466-3829-403f-9515-6e2de6973383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:34.774204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-db94a466-3829-403f-9515-6e2de6973383 None None] MFA Rules not processed for user `c30fd4f4df5b4376b1112535fc41a6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:34.776300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-db94a466-3829-403f-9515-6e2de6973383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:34.780877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cab4cf432764bb487de9abc0f283898'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:34.797260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cab4cf432764bb487de9abc0f283898'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:34.798200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cab4cf432764bb487de9abc0f283898'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:34.798826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cab4cf432764bb487de9abc0f283898'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:34.814889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cab4cf432764bb487de9abc0f283898'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:34.855379 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2749/5447] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:34 2022] DELETE /identity/v3/users/8cab4cf432764bb487de9abc0f283898 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:35.084709 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2699/5448] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:35.095894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:35.097390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:35.273381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5215262-0b4e-4277-947b-de742f5f02f9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:35.293851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e382f-7635-4f15-a6cb-defc035940a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:35.294528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e382f-7635-4f15-a6cb-defc035940a1 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:35.298902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e382f-7635-4f15-a6cb-defc035940a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:35.299228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e382f-7635-4f15-a6cb-defc035940a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:35.473476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e382f-7635-4f15-a6cb-defc035940a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:35.475119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e382f-7635-4f15-a6cb-defc035940a1 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:35.504420 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2750/5449] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:36.026028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94a466-3829-403f-9515-6e2de6973383 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:36.028000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-db94a466-3829-403f-9515-6e2de6973383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:36.192168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94a466-3829-403f-9515-6e2de6973383 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:36.323643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:36.324559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:36.324843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:36.325120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] PATH_INFO: `/v3/projects/32df8b04107445c89edb0d809d87d6fc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:36.333348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32df8b04107445c89edb0d809d87d6fc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:36.335425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:36.493463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32df8b04107445c89edb0d809d87d6fc', 'request_id': 'req-f0598e38-1b28-4448-b954-8e26e5a9baa4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:36.518229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32df8b04107445c89edb0d809d87d6fc', 'request_id': 'req-f0598e38-1b28-4448-b954-8e26e5a9baa4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:36.553072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32df8b04107445c89edb0d809d87d6fc', 'request_id': 'req-f0598e38-1b28-4448-b954-8e26e5a9baa4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:36.582029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] The token cache is being invalidate because project 32df8b04107445c89edb0d809d87d6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:36.582483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:36.583312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:36.589767 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2700/5450] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:36 2022] DELETE /identity/v3/projects/32df8b04107445c89edb0d809d87d6fc => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:36.596221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac4d18-aad3-4196-acb6-a235cf94a6d2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:36.596752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac4d18-aad3-4196-acb6-a235cf94a6d2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:36.596864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac4d18-aad3-4196-acb6-a235cf94a6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:36.638552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:36.641349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:36.672938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-03ac4d18-aad3-4196-acb6-a235cf94a6d2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:36.676169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-03ac4d18-aad3-4196-acb6-a235cf94a6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:36.863298 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2751/5451] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:36.863498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0598e38-1b28-4448-b954-8e26e5a9baa4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:36.864904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac4d18-aad3-4196-acb6-a235cf94a6d2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:36.866561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-03ac4d18-aad3-4196-acb6-a235cf94a6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:36.880228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac4d18-aad3-4196-acb6-a235cf94a6d2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:36.884737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:36.887002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:36.887154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:36.888262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:36.888719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:36.888836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:36.889066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] PATH_INFO: `/v3/users/2d8b31eba4544e0eb48b7f6e16a9c9ce` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:36.889496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] PATH_INFO: `/v3/users/c87af7ce66f048e3942c2846edb30c10` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:36.890600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8b31eba4544e0eb48b7f6e16a9c9ce)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:36.892750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:36.898735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87af7ce66f048e3942c2846edb30c10)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:36.906559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:36.963022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8b31eba4544e0eb48b7f6e16a9c9ce'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:36.974461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8b31eba4544e0eb48b7f6e16a9c9ce'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:36.975597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8b31eba4544e0eb48b7f6e16a9c9ce'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:36.976437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8b31eba4544e0eb48b7f6e16a9c9ce'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:36.988520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-457503bd-26cf-46fb-8ed4-f671123c5313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8b31eba4544e0eb48b7f6e16a9c9ce'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:37.048127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87af7ce66f048e3942c2846edb30c10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:37.049047 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2752/5452] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:36 2022] DELETE /identity/v3/users/2d8b31eba4544e0eb48b7f6e16a9c9ce => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:37.051368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7a819-8ef0-470c-8c28-65decfb46b89 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.051857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7a819-8ef0-470c-8c28-65decfb46b89 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.052223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7a819-8ef0-470c-8c28-65decfb46b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:37.067490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87af7ce66f048e3942c2846edb30c10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:37.068581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87af7ce66f048e3942c2846edb30c10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:37.069679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87af7ce66f048e3942c2846edb30c10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:37.077261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c9f7a819-8ef0-470c-8c28-65decfb46b89 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:37.079128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c9f7a819-8ef0-470c-8c28-65decfb46b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:37.105253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-562cbdab-302b-4566-a826-a95fd43491f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87af7ce66f048e3942c2846edb30c10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:37.132070 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2701/5453] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:36 2022] DELETE /identity/v3/users/c87af7ce66f048e3942c2846edb30c10 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:37.136497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db0d21-8ef0-4e38-a2e0-8ee3d4234924 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.138523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db0d21-8ef0-4e38-a2e0-8ee3d4234924 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.138980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db0d21-8ef0-4e38-a2e0-8ee3d4234924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:37.171025 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2753/5454] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:37.176435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7a819-8ef0-470c-8c28-65decfb46b89 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:37.191418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7a819-8ef0-470c-8c28-65decfb46b89 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:37.195434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a5db0d21-8ef0-4e38-a2e0-8ee3d4234924 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:37.197370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a5db0d21-8ef0-4e38-a2e0-8ee3d4234924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:37.285223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3086-6c4f-4863-a24f-bc557dd1e0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:37.286357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3086-6c4f-4863-a24f-bc557dd1e0ab admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.287182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3086-6c4f-4863-a24f-bc557dd1e0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.287528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a3086-6c4f-4863-a24f-bc557dd1e0ab admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:37.288352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3086-6c4f-4863-a24f-bc557dd1e0ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:37.288903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3086-6c4f-4863-a24f-bc557dd1e0ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:37.291817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a3086-6c4f-4863-a24f-bc557dd1e0ab admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:37.316078 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2754/5455] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:37.319169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3086-6c4f-4863-a24f-bc557dd1e0ab admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:37.348909 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2702/5456] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:37.370390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a3086-6c4f-4863-a24f-bc557dd1e0ab admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:37.374040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db0d21-8ef0-4e38-a2e0-8ee3d4234924 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:37.382788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c9def-4971-41fa-b760-031aa5f43e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:37.384288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a5db0d21-8ef0-4e38-a2e0-8ee3d4234924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:37.384421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c9def-4971-41fa-b760-031aa5f43e32 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.385369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c9def-4971-41fa-b760-031aa5f43e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.385369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c9def-4971-41fa-b760-031aa5f43e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:37.385692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c9def-4971-41fa-b760-031aa5f43e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:37.398920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c9def-4971-41fa-b760-031aa5f43e32 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:37.453573 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2755/5457] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:37 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:37.458187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c9def-4971-41fa-b760-031aa5f43e32 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:37.511315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db0d21-8ef0-4e38-a2e0-8ee3d4234924 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:37.606915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c9def-4971-41fa-b760-031aa5f43e32 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:37.623570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a275e-20cf-43f2-848d-7f3f24a5c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:37.624304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a275e-20cf-43f2-848d-7f3f24a5c069 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.624584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a275e-20cf-43f2-848d-7f3f24a5c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.624862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a275e-20cf-43f2-848d-7f3f24a5c069 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:37.625545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a275e-20cf-43f2-848d-7f3f24a5c069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:37.628027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a275e-20cf-43f2-848d-7f3f24a5c069 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:37.668929 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2756/5458] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:37 2022] POST /identity/v3/users => generated 284 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:37.670467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a275e-20cf-43f2-848d-7f3f24a5c069 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:37.694100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a275e-20cf-43f2-848d-7f3f24a5c069 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:37.695168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a6ba9-ce6a-4586-8447-7dded4fbb749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:37.695969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6ba9-ce6a-4586-8447-7dded4fbb749 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.701816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6ba9-ce6a-4586-8447-7dded4fbb749 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.704103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6ba9-ce6a-4586-8447-7dded4fbb749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:37.711771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf101-6419-4a12-adcb-c5b993793f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:37.712482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf101-6419-4a12-adcb-c5b993793f0e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.712764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf101-6419-4a12-adcb-c5b993793f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.713036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bf101-6419-4a12-adcb-c5b993793f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:37.713858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bf101-6419-4a12-adcb-c5b993793f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:37.717338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bf101-6419-4a12-adcb-c5b993793f0e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:37.745743 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2757/5459] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:37.749149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a6ba9-ce6a-4586-8447-7dded4fbb749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:37.749712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf101-6419-4a12-adcb-c5b993793f0e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:37.751437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a6ba9-ce6a-4586-8447-7dded4fbb749 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:37.776442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bf101-6419-4a12-adcb-c5b993793f0e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:37.788766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c0ce56-9ac9-4741-bc41-06e00446efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:37.789462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0ce56-9ac9-4741-bc41-06e00446efe8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.789744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0ce56-9ac9-4741-bc41-06e00446efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.790141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c0ce56-9ac9-4741-bc41-06e00446efe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:37.790737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0ce56-9ac9-4741-bc41-06e00446efe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:37.792391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c0ce56-9ac9-4741-bc41-06e00446efe8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:37.816886 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2703/5460] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:37.824327 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2758/5461] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:37 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:37.825586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a6ba9-ce6a-4586-8447-7dded4fbb749 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:37.844433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a6ba9-ce6a-4586-8447-7dded4fbb749 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:37.860409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbe01a-e764-4723-83e9-1e640893f071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:37.861490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe01a-e764-4723-83e9-1e640893f071 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.861939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe01a-e764-4723-83e9-1e640893f071 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.862815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe01a-e764-4723-83e9-1e640893f071 admin admin] PATH_INFO: `/v3/projects/1b5a5b535c92443bb84038b6a8e91eb5/users/059deef0354d4687b7f82a8fff5ae8c6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:37.900477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbe01a-e764-4723-83e9-1e640893f071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b5a5b535c92443bb84038b6a8e91eb5, user_id=059deef0354d4687b7f82a8fff5ae8c6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:37.903727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbe01a-e764-4723-83e9-1e640893f071 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:37.935369 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2704/5462] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:37 2022] PUT /identity/v3/projects/1b5a5b535c92443bb84038b6a8e91eb5/users/059deef0354d4687b7f82a8fff5ae8c6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:37.947101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986bf4a-bd4f-42bc-9fe4-1d3b40b9eb6e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:37.947295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986bf4a-bd4f-42bc-9fe4-1d3b40b9eb6e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:37.947651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986bf4a-bd4f-42bc-9fe4-1d3b40b9eb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:38.058847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f986bf4a-bd4f-42bc-9fe4-1d3b40b9eb6e None None] MFA Rules not processed for user `059deef0354d4687b7f82a8fff5ae8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:38.065697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f986bf4a-bd4f-42bc-9fe4-1d3b40b9eb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:38.203815 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2759/5463] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:38.208627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbe01a-e764-4723-83e9-1e640893f071 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:38.358972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbe01a-e764-4723-83e9-1e640893f071 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:38.372401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07860373-9e1d-431a-8325-20dfb7033960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:38.373095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07860373-9e1d-431a-8325-20dfb7033960 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:38.373389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07860373-9e1d-431a-8325-20dfb7033960 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:38.373671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07860373-9e1d-431a-8325-20dfb7033960 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:38.374417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07860373-9e1d-431a-8325-20dfb7033960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:38.376366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07860373-9e1d-431a-8325-20dfb7033960 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:38.418594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986bf4a-bd4f-42bc-9fe4-1d3b40b9eb6e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:38.420285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f986bf4a-bd4f-42bc-9fe4-1d3b40b9eb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:38.452078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986bf4a-bd4f-42bc-9fe4-1d3b40b9eb6e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:38.462786 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2705/5464] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:38 2022] POST /identity/v3/projects => generated 369 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:38.465871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:38.466034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07860373-9e1d-431a-8325-20dfb7033960 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:38.467747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:38.469359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:38.470121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] PATH_INFO: `/v3/projects/c58247395bea4447bc23f219d3c1cbc0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:38.477118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c58247395bea4447bc23f219d3c1cbc0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:38.479246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:38.589340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07860373-9e1d-431a-8325-20dfb7033960 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:38.593233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c58247395bea4447bc23f219d3c1cbc0', 'request_id': 'req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:38.607597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c58247395bea4447bc23f219d3c1cbc0', 'request_id': 'req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:38.616855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c58247395bea4447bc23f219d3c1cbc0', 'request_id': 'req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:38.647112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] The token cache is being invalidate because project c58247395bea4447bc23f219d3c1cbc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:38.647399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:38.649283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c7219c6-136d-4dbe-a9ae-b46a6d5cd805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:38.662914 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2760/5465] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:38 2022] DELETE /identity/v3/projects/c58247395bea4447bc23f219d3c1cbc0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:38.664730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa2f8d-7603-4db8-b383-b4e73438a036 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:38.665018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa2f8d-7603-4db8-b383-b4e73438a036 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:38.665310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa2f8d-7603-4db8-b383-b4e73438a036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:38.669374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef333aec-8bac-49e0-a8d8-2c0ce1392dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:38.670598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef333aec-8bac-49e0-a8d8-2c0ce1392dcf admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:38.670912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef333aec-8bac-49e0-a8d8-2c0ce1392dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:38.671158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef333aec-8bac-49e0-a8d8-2c0ce1392dcf admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:38.671862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef333aec-8bac-49e0-a8d8-2c0ce1392dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:38.674928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef333aec-8bac-49e0-a8d8-2c0ce1392dcf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:38.705362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ddaa2f8d-7603-4db8-b383-b4e73438a036 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:38.710257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ddaa2f8d-7603-4db8-b383-b4e73438a036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:38.719623 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2706/5466] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:38 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:38.720654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef333aec-8bac-49e0-a8d8-2c0ce1392dcf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:38.725547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ef333aec-8bac-49e0-a8d8-2c0ce1392dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:38.732584 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2761/5467] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:38.742189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5839-cfb1-4232-ab5d-2e54b5dca1f7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:38.742478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5839-cfb1-4232-ab5d-2e54b5dca1f7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:38.742864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5839-cfb1-4232-ab5d-2e54b5dca1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:38.766944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef333aec-8bac-49e0-a8d8-2c0ce1392dcf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:38.784242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-497b5839-cfb1-4232-ab5d-2e54b5dca1f7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:38.785602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-497b5839-cfb1-4232-ab5d-2e54b5dca1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:38.786215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095fe66-d25d-4f11-aa67-987114cc0a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:38.787308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095fe66-d25d-4f11-aa67-987114cc0a30 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:38.787308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095fe66-d25d-4f11-aa67-987114cc0a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:38.787485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095fe66-d25d-4f11-aa67-987114cc0a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:38.788303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095fe66-d25d-4f11-aa67-987114cc0a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:38.791820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095fe66-d25d-4f11-aa67-987114cc0a30 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:38.815603 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2762/5468] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:38.815603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b5839-cfb1-4232-ab5d-2e54b5dca1f7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:38.815859 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2707/5469] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:38.817792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-497b5839-cfb1-4232-ab5d-2e54b5dca1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:38.821175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095fe66-d25d-4f11-aa67-987114cc0a30 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:38.848855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095fe66-d25d-4f11-aa67-987114cc0a30 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:38.849074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b5839-cfb1-4232-ab5d-2e54b5dca1f7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:38.856357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f755a2-2f46-4633-8c84-d3cca9c13f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:38.858970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f755a2-2f46-4633-8c84-d3cca9c13f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:38.859560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:38.860264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f755a2-2f46-4633-8c84-d3cca9c13f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:38.860476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:38.860780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:38.861008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] PATH_INFO: `/v3/users/2b2addd59dcd49e988e33c2cff696ff4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:38.861968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f755a2-2f46-4633-8c84-d3cca9c13f39 admin admin] PATH_INFO: `/v3/projects/4f4971f74d97430990f6135a57d443dd/users/7978c6e75ee14fa39f4cdaed47297775/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:38.868970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2addd59dcd49e988e33c2cff696ff4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:38.871354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:38.901482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f755a2-2f46-4633-8c84-d3cca9c13f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4971f74d97430990f6135a57d443dd, user_id=7978c6e75ee14fa39f4cdaed47297775, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:38.905978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f755a2-2f46-4633-8c84-d3cca9c13f39 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:38.935986 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2708/5470] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:38 2022] PUT /identity/v3/projects/4f4971f74d97430990f6135a57d443dd/users/7978c6e75ee14fa39f4cdaed47297775/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:38.942303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f755a2-2f46-4633-8c84-d3cca9c13f39 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:38.992604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2addd59dcd49e988e33c2cff696ff4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.011999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2addd59dcd49e988e33c2cff696ff4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.013991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2addd59dcd49e988e33c2cff696ff4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.014697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2addd59dcd49e988e33c2cff696ff4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.034969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f755a2-2f46-4633-8c84-d3cca9c13f39 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:39.039197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2addd59dcd49e988e33c2cff696ff4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.043383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:39.044165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.044453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.045133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.046807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:39.047223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:39.050584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:39.072623 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2709/5471] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:39.072623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:39.073071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:39.090585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742d7ec-be90-4d35-8bf0-4963a03e6677 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:39.098272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85900aed-5e11-429f-a611-6d4846db5c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:39.098846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85900aed-5e11-429f-a611-6d4846db5c63 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.099217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85900aed-5e11-429f-a611-6d4846db5c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.099709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85900aed-5e11-429f-a611-6d4846db5c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.101164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85900aed-5e11-429f-a611-6d4846db5c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:39.103037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85900aed-5e11-429f-a611-6d4846db5c63 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:39.106417 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2763/5472] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:38 2022] DELETE /identity/v3/users/2b2addd59dcd49e988e33c2cff696ff4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:39.107404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:39.108869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:39.119637 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2710/5473] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:39.122241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ed0e-638b-4e73-912f-61c30e7ceb1c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.122559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ed0e-638b-4e73-912f-61c30e7ceb1c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.122852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ed0e-638b-4e73-912f-61c30e7ceb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.154110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7054ed0e-638b-4e73-912f-61c30e7ceb1c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:39.155428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7054ed0e-638b-4e73-912f-61c30e7ceb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:39.187491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47658934-b30c-4a37-8321-dab5f7481ac9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:39.194820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b7681-1b8c-4610-8762-ebe27dd0356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:39.195682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b7681-1b8c-4610-8762-ebe27dd0356f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.196038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b7681-1b8c-4610-8762-ebe27dd0356f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.196418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b7681-1b8c-4610-8762-ebe27dd0356f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.197360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b7681-1b8c-4610-8762-ebe27dd0356f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:39.200565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b7681-1b8c-4610-8762-ebe27dd0356f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:39.239155 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2764/5474] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:39 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:39.239155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b7681-1b8c-4610-8762-ebe27dd0356f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:39.247050 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2711/5475] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:39.248194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ed0e-638b-4e73-912f-61c30e7ceb1c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:39.277555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ed0e-638b-4e73-912f-61c30e7ceb1c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:39.339124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b7681-1b8c-4610-8762-ebe27dd0356f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:39.345550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf468-e631-42cd-9860-0805d926ffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:39.346650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf468-e631-42cd-9860-0805d926ffe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.347034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf468-e631-42cd-9860-0805d926ffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.347462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bf468-e631-42cd-9860-0805d926ffe1 admin admin] PATH_INFO: `/v3/projects/4f4971f74d97430990f6135a57d443dd/users/7978c6e75ee14fa39f4cdaed47297775/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.349775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bf468-e631-42cd-9860-0805d926ffe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f4971f74d97430990f6135a57d443dd, user_id=7978c6e75ee14fa39f4cdaed47297775, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:39.352640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7bf468-e631-42cd-9860-0805d926ffe1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:39.370572 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2765/5476] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:39 2022] PUT /identity/v3/projects/4f4971f74d97430990f6135a57d443dd/users/7978c6e75ee14fa39f4cdaed47297775/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:39.371802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf468-e631-42cd-9860-0805d926ffe1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:39.373811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bc7bf468-e631-42cd-9860-0805d926ffe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:39.421317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff1ba9-a15b-49e9-b141-634f99058fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:39.422186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff1ba9-a15b-49e9-b141-634f99058fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.424136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff1ba9-a15b-49e9-b141-634f99058fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.424945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff1ba9-a15b-49e9-b141-634f99058fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.425654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff1ba9-a15b-49e9-b141-634f99058fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:39.427620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff1ba9-a15b-49e9-b141-634f99058fe7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:39.481491 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2712/5477] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:39 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:39.482783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0228dc-1385-4a28-bf3e-6c95b8374ea6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.483072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0228dc-1385-4a28-bf3e-6c95b8374ea6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.483346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0228dc-1385-4a28-bf3e-6c95b8374ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.493084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bf468-e631-42cd-9860-0805d926ffe1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:39.528536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc02e39-c420-42a5-9e41-ce13ddaec9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:39.532152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc02e39-c420-42a5-9e41-ce13ddaec9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.533308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc02e39-c420-42a5-9e41-ce13ddaec9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.533872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc02e39-c420-42a5-9e41-ce13ddaec9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.574634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9e0228dc-1385-4a28-bf3e-6c95b8374ea6 None None] MFA Rules not processed for user `7978c6e75ee14fa39f4cdaed47297775`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:39.584109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9e0228dc-1385-4a28-bf3e-6c95b8374ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:39.726822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc02e39-c420-42a5-9e41-ce13ddaec9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:39.733534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc02e39-c420-42a5-9e41-ce13ddaec9d8 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:39.771248 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2766/5478] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:39.772249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc02e39-c420-42a5-9e41-ce13ddaec9d8 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:39.775524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-edc02e39-c420-42a5-9e41-ce13ddaec9d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:39.793297 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2713/5479] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:39.794372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0228dc-1385-4a28-bf3e-6c95b8374ea6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:39.805449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc02e39-c420-42a5-9e41-ce13ddaec9d8 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:39.814141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:39.816883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.817415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.817802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] PATH_INFO: `/v3/projects/1aec050c7b634ce0801bf8c166cda19e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.818755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0228dc-1385-4a28-bf3e-6c95b8374ea6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:39.825452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aec050c7b634ce0801bf8c166cda19e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:39.830743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:39.834828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7f0ca-7e7c-4f99-a986-0aaa02aa2855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:39.836900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7f0ca-7e7c-4f99-a986-0aaa02aa2855 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:39.838065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7f0ca-7e7c-4f99-a986-0aaa02aa2855 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:39.840503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7f0ca-7e7c-4f99-a986-0aaa02aa2855 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:39.842035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7f0ca-7e7c-4f99-a986-0aaa02aa2855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:39.846764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7f0ca-7e7c-4f99-a986-0aaa02aa2855 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:39.878677 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2714/5480] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:39.883890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7f0ca-7e7c-4f99-a986-0aaa02aa2855 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:39.902009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aec050c7b634ce0801bf8c166cda19e', 'request_id': 'req-8c6bcf5b-33a3-4f43-8483-5327a546ab28'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.907302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7f0ca-7e7c-4f99-a986-0aaa02aa2855 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:39.913175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aec050c7b634ce0801bf8c166cda19e', 'request_id': 'req-8c6bcf5b-33a3-4f43-8483-5327a546ab28'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.930903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aec050c7b634ce0801bf8c166cda19e', 'request_id': 'req-8c6bcf5b-33a3-4f43-8483-5327a546ab28'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.953947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] The token cache is being invalidate because project 1aec050c7b634ce0801bf8c166cda19e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:39.954327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.955160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:39.957791 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2767/5481] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:39 2022] DELETE /identity/v3/projects/1aec050c7b634ce0801bf8c166cda19e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:39.958536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:39.959816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:40.039764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d90d-bbc0-44a1-b17a-0b2d86e4b77f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:40.041741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d90d-bbc0-44a1-b17a-0b2d86e4b77f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.043037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d90d-bbc0-44a1-b17a-0b2d86e4b77f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.043464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117d90d-bbc0-44a1-b17a-0b2d86e4b77f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.047086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117d90d-bbc0-44a1-b17a-0b2d86e4b77f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:40.048613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8117d90d-bbc0-44a1-b17a-0b2d86e4b77f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:40.069853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bcf5b-33a3-4f43-8483-5327a546ab28 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:40.074799 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2715/5482] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:08:39 2022] POST /identity/v3/domains => generated 277 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:40.076366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d90d-bbc0-44a1-b17a-0b2d86e4b77f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:40.083002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8117d90d-bbc0-44a1-b17a-0b2d86e4b77f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:40.088515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe5f44-5cc8-45aa-99cb-659ec87fa7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:40.091791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5f44-5cc8-45aa-99cb-659ec87fa7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.092364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5f44-5cc8-45aa-99cb-659ec87fa7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.092837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5f44-5cc8-45aa-99cb-659ec87fa7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.094037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe5f44-5cc8-45aa-99cb-659ec87fa7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:40.097257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe5f44-5cc8-45aa-99cb-659ec87fa7e6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:40.112508 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2768/5483] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:40.114158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe5f44-5cc8-45aa-99cb-659ec87fa7e6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:40.116542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c8fe5f44-5cc8-45aa-99cb-659ec87fa7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:40.140226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe5f44-5cc8-45aa-99cb-659ec87fa7e6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:40.216798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117d90d-bbc0-44a1-b17a-0b2d86e4b77f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:40.229970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:40.231026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.231315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.231638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] PATH_INFO: `/v3/users/c30fd4f4df5b4376b1112535fc41a6e2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.235273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30fd4f4df5b4376b1112535fc41a6e2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:40.237783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:40.304198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:40.304896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.305192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.305514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.306268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:40.312477 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:40.312477 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:08:40.312477 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:08:40.313878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:40.336450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30fd4f4df5b4376b1112535fc41a6e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:40.349755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30fd4f4df5b4376b1112535fc41a6e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:40.350552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30fd4f4df5b4376b1112535fc41a6e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:40.351476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30fd4f4df5b4376b1112535fc41a6e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:40.395029 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2769/5484] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:40 2022] POST /identity/v3/groups => generated 279 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:40.395761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:40.399151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30fd4f4df5b4376b1112535fc41a6e2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:40.403192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:40.429255 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2716/5485] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:40 2022] DELETE /identity/v3/users/c30fd4f4df5b4376b1112535fc41a6e2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:40.433199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:40.440389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb8c97c-1a05-4835-a5cb-4338d36f8b89 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:40.441128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:40.648821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa4020-e8cc-4977-957d-72973846c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:40.649923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa4020-e8cc-4977-957d-72973846c6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.650328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa4020-e8cc-4977-957d-72973846c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.650719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa4020-e8cc-4977-957d-72973846c6e0 admin admin] PATH_INFO: `/v3/projects/5b7d84d914bd48ddbd9e2801f8a9c616/users/102a4f93d75c4f219861f8e3e119fd82/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.652732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca25b66-403b-4866-bf1d-e9c9cf05ea04 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:40.664867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12077c-f912-4e5f-bce9-89a22d953f3d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:40.666195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12077c-f912-4e5f-bce9-89a22d953f3d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.666650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12077c-f912-4e5f-bce9-89a22d953f3d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.667085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12077c-f912-4e5f-bce9-89a22d953f3d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/f645ff2f2eda440181ba6c29e7d5d6ee` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.675186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa4020-e8cc-4977-957d-72973846c6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b7d84d914bd48ddbd9e2801f8a9c616, user_id=102a4f93d75c4f219861f8e3e119fd82, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:40.678690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aa4020-e8cc-4977-957d-72973846c6e0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:40.680330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12077c-f912-4e5f-bce9-89a22d953f3d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:update_group(group_id=f645ff2f2eda440181ba6c29e7d5d6ee)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:40.681585 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-ed12077c-f912-4e5f-bce9-89a22d953f3d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:40.681585 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:08:40.681585 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:08:40.683267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12077c-f912-4e5f-bce9-89a22d953f3d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:40.704792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2770/5486] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:40 2022] PUT /identity/v3/projects/5b7d84d914bd48ddbd9e2801f8a9c616/users/102a4f93d75c4f219861f8e3e119fd82/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:40.707447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccf38d-4814-42e6-bfb8-b593ea569c40 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.707740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccf38d-4814-42e6-bfb8-b593ea569c40 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.708046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccf38d-4814-42e6-bfb8-b593ea569c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.732313 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2717/5487] 10.222.0.16 () {60 vars in 1246 bytes} [Sat Mar 26 21:08:40 2022] PATCH /identity/v3/groups/f645ff2f2eda440181ba6c29e7d5d6ee => generated 293 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:40.737770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12077c-f912-4e5f-bce9-89a22d953f3d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:40.764240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12077c-f912-4e5f-bce9-89a22d953f3d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:40.769610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c4ccf38d-4814-42e6-bfb8-b593ea569c40 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:40.773944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c4ccf38d-4814-42e6-bfb8-b593ea569c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:40.848281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6273e94-6fc5-4e97-b2c1-13eba75eb1b9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:40.849284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6273e94-6fc5-4e97-b2c1-13eba75eb1b9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.849646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6273e94-6fc5-4e97-b2c1-13eba75eb1b9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.849899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6273e94-6fc5-4e97-b2c1-13eba75eb1b9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/f645ff2f2eda440181ba6c29e7d5d6ee` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.864530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6273e94-6fc5-4e97-b2c1-13eba75eb1b9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:get_group(group_id=f645ff2f2eda440181ba6c29e7d5d6ee)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:40.865743 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-a6273e94-6fc5-4e97-b2c1-13eba75eb1b9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:40.865743 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:08:40.865743 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:08:40.868275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6273e94-6fc5-4e97-b2c1-13eba75eb1b9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:40.870392 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2718/5488] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:40 2022] GET /identity/v3/groups/f645ff2f2eda440181ba6c29e7d5d6ee => generated 293 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:40.874922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6273e94-6fc5-4e97-b2c1-13eba75eb1b9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:40.887808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6273e94-6fc5-4e97-b2c1-13eba75eb1b9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:40.888639 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2771/5489] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:40.899442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192d9a0-bdde-49c4-8143-e17ede8cf1c1 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:40.901333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccf38d-4814-42e6-bfb8-b593ea569c40 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:40.902814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c4ccf38d-4814-42e6-bfb8-b593ea569c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:40.904389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192d9a0-bdde-49c4-8143-e17ede8cf1c1 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.905551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192d9a0-bdde-49c4-8143-e17ede8cf1c1 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.905929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192d9a0-bdde-49c4-8143-e17ede8cf1c1 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/f645ff2f2eda440181ba6c29e7d5d6ee` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.909700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192d9a0-bdde-49c4-8143-e17ede8cf1c1 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:update_group(group_id=f645ff2f2eda440181ba6c29e7d5d6ee)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:40.913735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192d9a0-bdde-49c4-8143-e17ede8cf1c1 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:40.942568 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2719/5490] 10.222.0.16 () {60 vars in 1245 bytes} [Sat Mar 26 21:08:40 2022] PATCH /identity/v3/groups/f645ff2f2eda440181ba6c29e7d5d6ee => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:40.946307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192d9a0-bdde-49c4-8143-e17ede8cf1c1 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:40.963139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192d9a0-bdde-49c4-8143-e17ede8cf1c1 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:40.977984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aa8a3-4863-464e-b716-7c759b3aa6fd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:40.979166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aa8a3-4863-464e-b716-7c759b3aa6fd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:40.979617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aa8a3-4863-464e-b716-7c759b3aa6fd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:40.980117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aa8a3-4863-464e-b716-7c759b3aa6fd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/f645ff2f2eda440181ba6c29e7d5d6ee` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:40.988688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccf38d-4814-42e6-bfb8-b593ea569c40 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:40.991451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aa8a3-4863-464e-b716-7c759b3aa6fd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f645ff2f2eda440181ba6c29e7d5d6ee)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:40.996211 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-0a6aa8a3-4863-464e-b716-7c759b3aa6fd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:40.996211 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:08:40.996211 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:08:40.999644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aa8a3-4863-464e-b716-7c759b3aa6fd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:41.000653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5ff58-366d-4a4d-a45b-c4912b758d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:41.001570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5ff58-366d-4a4d-a45b-c4912b758d37 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:41.001861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5ff58-366d-4a4d-a45b-c4912b758d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:41.002131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5ff58-366d-4a4d-a45b-c4912b758d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:41.023536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5ff58-366d-4a4d-a45b-c4912b758d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:41.024917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5ff58-366d-4a4d-a45b-c4912b758d37 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:41.038467 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2772/5491] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:08:41.151384 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2720/5492] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:08:40 2022] DELETE /identity/v3/groups/f645ff2f2eda440181ba6c29e7d5d6ee => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:41.153369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5ff58-366d-4a4d-a45b-c4912b758d37 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:41.168852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5ff58-366d-4a4d-a45b-c4912b758d37 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:41.293466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fb26b-ed05-438d-bb82-f7401aa7aa1c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:41.295769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fb26b-ed05-438d-bb82-f7401aa7aa1c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:41.296140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fb26b-ed05-438d-bb82-f7401aa7aa1c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:41.297223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fb26b-ed05-438d-bb82-f7401aa7aa1c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:41.298419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fb26b-ed05-438d-bb82-f7401aa7aa1c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:41.304346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fb26b-ed05-438d-bb82-f7401aa7aa1c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:41.331046 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2773/5493] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:41 2022] POST /identity/v3/groups => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:41.332212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aa8a3-4863-464e-b716-7c759b3aa6fd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:41.343356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aa8a3-4863-464e-b716-7c759b3aa6fd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:41.350398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777112f-e823-49f4-b39e-00f600fc4265 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:41.351164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777112f-e823-49f4-b39e-00f600fc4265 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:41.351531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777112f-e823-49f4-b39e-00f600fc4265 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:41.352045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777112f-e823-49f4-b39e-00f600fc4265 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:41.352706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777112f-e823-49f4-b39e-00f600fc4265 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:41.354899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777112f-e823-49f4-b39e-00f600fc4265 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:41.391361 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2721/5494] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:41 2022] POST /identity/v3/users => generated 321 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:41.395872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fb26b-ed05-438d-bb82-f7401aa7aa1c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:41.416936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fb26b-ed05-438d-bb82-f7401aa7aa1c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:41.428025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345bd19-30dd-4f18-b0d7-a13dbdf289a5 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:41.437081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345bd19-30dd-4f18-b0d7-a13dbdf289a5 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:41.438355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345bd19-30dd-4f18-b0d7-a13dbdf289a5 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:41.439948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345bd19-30dd-4f18-b0d7-a13dbdf289a5 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/28a7a3514c504b9cba6ea54427955b8b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:41.489507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345bd19-30dd-4f18-b0d7-a13dbdf289a5 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc, user_id=28a7a3514c504b9cba6ea54427955b8b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:41.490822 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-e345bd19-30dd-4f18-b0d7-a13dbdf289a5 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:41.490822 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:08:41.490822 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:08:41.492610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345bd19-30dd-4f18-b0d7-a13dbdf289a5 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:41.553254 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2774/5495] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Mar 26 21:08:41 2022] PUT /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/28a7a3514c504b9cba6ea54427955b8b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:41.557363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777112f-e823-49f4-b39e-00f600fc4265 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:41.574710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777112f-e823-49f4-b39e-00f600fc4265 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:41.700195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d149-ba6e-4805-b2a5-271d63b713ed tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:41.700852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d149-ba6e-4805-b2a5-271d63b713ed tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:41.704805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d149-ba6e-4805-b2a5-271d63b713ed tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:41.705151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d149-ba6e-4805-b2a5-271d63b713ed tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:41.706440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d149-ba6e-4805-b2a5-271d63b713ed tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:41.712713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d149-ba6e-4805-b2a5-271d63b713ed tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:41.762831 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2722/5496] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:41 2022] POST /identity/v3/users => generated 323 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:41.764952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345bd19-30dd-4f18-b0d7-a13dbdf289a5 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:41.788551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345bd19-30dd-4f18-b0d7-a13dbdf289a5 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:41.806737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa4535-b1d9-4681-b641-e422e7a755d9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:41.809255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa4535-b1d9-4681-b641-e422e7a755d9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:41.810691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa4535-b1d9-4681-b641-e422e7a755d9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:41.811054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa4535-b1d9-4681-b641-e422e7a755d9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/78182dbb81a5402ea94ce5c7a83f327b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:41.868511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa4535-b1d9-4681-b641-e422e7a755d9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc, user_id=78182dbb81a5402ea94ce5c7a83f327b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:41.868625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa4535-b1d9-4681-b641-e422e7a755d9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:41.869224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d149-ba6e-4805-b2a5-271d63b713ed tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:41.871175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7198d149-ba6e-4805-b2a5-271d63b713ed tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:41.923819 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2775/5497] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Mar 26 21:08:41 2022] PUT /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/78182dbb81a5402ea94ce5c7a83f327b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:41.924833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa4535-b1d9-4681-b641-e422e7a755d9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:42.055944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa4535-b1d9-4681-b641-e422e7a755d9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:42.063738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f091-fef7-44e2-9b4a-b20e4009e85c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:42.065416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f091-fef7-44e2-9b4a-b20e4009e85c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.076277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f091-fef7-44e2-9b4a-b20e4009e85c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.080218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2f091-fef7-44e2-9b4a-b20e4009e85c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.088850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d149-ba6e-4805-b2a5-271d63b713ed tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:42.089326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2f091-fef7-44e2-9b4a-b20e4009e85c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:42.100920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2f091-fef7-44e2-9b4a-b20e4009e85c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:42.158612 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2776/5498] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:41 2022] POST /identity/v3/users => generated 323 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:42.159763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f091-fef7-44e2-9b4a-b20e4009e85c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:42.186056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2f091-fef7-44e2-9b4a-b20e4009e85c tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:42.190679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:42.191629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.192012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.192357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] PATH_INFO: `/v3/projects/652f7c6047dc4f8ca870623f7503e142` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.193661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652f7c6047dc4f8ca870623f7503e142)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:42.196707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:42.205025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1205-2486-4155-9ed2-e78b5bfa9bee tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:42.206230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1205-2486-4155-9ed2-e78b5bfa9bee tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.206609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1205-2486-4155-9ed2-e78b5bfa9bee tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.206917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c1205-2486-4155-9ed2-e78b5bfa9bee tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/0ba5ef0906fc47fdb3614370446e3146` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.252841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1205-2486-4155-9ed2-e78b5bfa9bee tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc, user_id=0ba5ef0906fc47fdb3614370446e3146)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:42.256108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c1205-2486-4155-9ed2-e78b5bfa9bee tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:42.317347 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2777/5499] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Mar 26 21:08:42 2022] PUT /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/0ba5ef0906fc47fdb3614370446e3146 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:42.324322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1205-2486-4155-9ed2-e78b5bfa9bee tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:42.335837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652f7c6047dc4f8ca870623f7503e142', 'request_id': 'req-51680dd2-739e-4d91-982d-7869e1b0b2e1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:42.350477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652f7c6047dc4f8ca870623f7503e142', 'request_id': 'req-51680dd2-739e-4d91-982d-7869e1b0b2e1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:42.367867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652f7c6047dc4f8ca870623f7503e142', 'request_id': 'req-51680dd2-739e-4d91-982d-7869e1b0b2e1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:42.385968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] The token cache is being invalidate because project 652f7c6047dc4f8ca870623f7503e142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:42.386259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:42.387170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51680dd2-739e-4d91-982d-7869e1b0b2e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:42.392796 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2723/5500] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:41 2022] DELETE /identity/v3/projects/652f7c6047dc4f8ca870623f7503e142 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:42.395416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef602fc-5103-484d-bc1d-c9d9a7696f77 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.395416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef602fc-5103-484d-bc1d-c9d9a7696f77 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.395641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef602fc-5103-484d-bc1d-c9d9a7696f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.419183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cef602fc-5103-484d-bc1d-c9d9a7696f77 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:42.421099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cef602fc-5103-484d-bc1d-c9d9a7696f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:42.487252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c1205-2486-4155-9ed2-e78b5bfa9bee tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:42.674804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:42.675736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.675859 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2724/5501] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:42.676079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.676269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.677613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:42.677843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce7c0-777f-4913-be34-ea347377db29 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.678361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce7c0-777f-4913-be34-ea347377db29 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.678663 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:42.678663 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:08:42.678663 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:08:42.678905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce7c0-777f-4913-be34-ea347377db29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.680071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:42.706803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b7cce7c0-777f-4913-be34-ea347377db29 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:42.708785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b7cce7c0-777f-4913-be34-ea347377db29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:42.736414 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2778/5502] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 21:08:42 2022] GET /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users => generated 1083 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:42.737823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:42.739825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:42.751891 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2725/5503] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:42.756940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0313d80-fdc5-48fc-bf59-371782cef790 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:42.760504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cce7c0-777f-4913-be34-ea347377db29 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:42.766420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcff859-8c79-41f3-93af-73217e6f5cab tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:42.768479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcff859-8c79-41f3-93af-73217e6f5cab tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.768773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcff859-8c79-41f3-93af-73217e6f5cab tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.769061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcff859-8c79-41f3-93af-73217e6f5cab tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/28a7a3514c504b9cba6ea54427955b8b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.770904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcff859-8c79-41f3-93af-73217e6f5cab tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc, user_id=28a7a3514c504b9cba6ea54427955b8b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:42.771989 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-0bcff859-8c79-41f3-93af-73217e6f5cab tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:42.771989 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:08:42.771989 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:08:42.773272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcff859-8c79-41f3-93af-73217e6f5cab tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:42.782868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cce7c0-777f-4913-be34-ea347377db29 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:42.794130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb568d-f449-4453-8ef7-a1bddf76ab2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:42.795025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb568d-f449-4453-8ef7-a1bddf76ab2a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.795435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb568d-f449-4453-8ef7-a1bddf76ab2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.795806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb568d-f449-4453-8ef7-a1bddf76ab2a admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.798088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb568d-f449-4453-8ef7-a1bddf76ab2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:42.800897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb568d-f449-4453-8ef7-a1bddf76ab2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:42.806350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bb568d-f449-4453-8ef7-a1bddf76ab2a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:42.808681 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2779/5504] 10.222.0.16 () {58 vars in 1341 bytes} [Sat Mar 26 21:08:42 2022] HEAD /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/28a7a3514c504b9cba6ea54427955b8b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:42.813055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcff859-8c79-41f3-93af-73217e6f5cab tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:42.824763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcff859-8c79-41f3-93af-73217e6f5cab tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:42.830148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:42.831242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.831541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.831872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/28a7a3514c504b9cba6ea54427955b8b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.834294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc, user_id=28a7a3514c504b9cba6ea54427955b8b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:42.835339 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:42.835339 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:08:42.835339 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:08:42.836725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:42.843683 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2726/5505] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:42.848806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb568d-f449-4453-8ef7-a1bddf76ab2a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:42.858288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '28a7a3514c504b9cba6ea54427955b8b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:42.870392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb568d-f449-4453-8ef7-a1bddf76ab2a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:42.884722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1fb13-8e88-4cf6-b4c5-e3733fa64e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:42.885339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1fb13-8e88-4cf6-b4c5-e3733fa64e28 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:42.885875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1fb13-8e88-4cf6-b4c5-e3733fa64e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:42.886001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1fb13-8e88-4cf6-b4c5-e3733fa64e28 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:42.886976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1fb13-8e88-4cf6-b4c5-e3733fa64e28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:42.889347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1fb13-8e88-4cf6-b4c5-e3733fa64e28 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:42.892159 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2780/5506] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Mar 26 21:08:42 2022] DELETE /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/28a7a3514c504b9cba6ea54427955b8b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:42.893773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:42.946002 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2727/5507] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:42 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:42.950069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1fb13-8e88-4cf6-b4c5-e3733fa64e28 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:43.005277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c325c84-1322-4b47-a797-0c8f2c1bbc29 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:43.073710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1ed16-badd-43d3-82f1-7ff960098a1d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:43.074862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ed16-badd-43d3-82f1-7ff960098a1d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.075308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ed16-badd-43d3-82f1-7ff960098a1d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.075701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1ed16-badd-43d3-82f1-7ff960098a1d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/78182dbb81a5402ea94ce5c7a83f327b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.077638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1ed16-badd-43d3-82f1-7ff960098a1d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc, user_id=78182dbb81a5402ea94ce5c7a83f327b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:43.079996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c1ed16-badd-43d3-82f1-7ff960098a1d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:43.101669 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2781/5508] 10.222.0.16 () {58 vars in 1341 bytes} [Sat Mar 26 21:08:42 2022] HEAD /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/78182dbb81a5402ea94ce5c7a83f327b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:43.102415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1fb13-8e88-4cf6-b4c5-e3733fa64e28 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:43.104156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cffcb-72a2-475e-9b23-f22285a9d31a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.104581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cffcb-72a2-475e-9b23-f22285a9d31a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.105202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488cffcb-72a2-475e-9b23-f22285a9d31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.132910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23971-46f8-4cd3-ad83-0fdf21113b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:43.133616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23971-46f8-4cd3-ad83-0fdf21113b42 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.133904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23971-46f8-4cd3-ad83-0fdf21113b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.134194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab23971-46f8-4cd3-ad83-0fdf21113b42 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.136762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab23971-46f8-4cd3-ad83-0fdf21113b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:43.138841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab23971-46f8-4cd3-ad83-0fdf21113b42 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:43.144724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-488cffcb-72a2-475e-9b23-f22285a9d31a None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:43.146636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-488cffcb-72a2-475e-9b23-f22285a9d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:43.216996 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2728/5509] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:42 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:43.216996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23971-46f8-4cd3-ad83-0fdf21113b42 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:43.219062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eab23971-46f8-4cd3-ad83-0fdf21113b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:43.233899 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2782/5510] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:43.234959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cffcb-72a2-475e-9b23-f22285a9d31a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:43.249036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488cffcb-72a2-475e-9b23-f22285a9d31a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:43.254673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f672015-8c51-4ec1-b78f-66c05ab54b92 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:43.255102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab23971-46f8-4cd3-ad83-0fdf21113b42 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:43.256047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f672015-8c51-4ec1-b78f-66c05ab54b92 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.256432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f672015-8c51-4ec1-b78f-66c05ab54b92 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.257100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f672015-8c51-4ec1-b78f-66c05ab54b92 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/78182dbb81a5402ea94ce5c7a83f327b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.264521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f672015-8c51-4ec1-b78f-66c05ab54b92 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc, user_id=78182dbb81a5402ea94ce5c7a83f327b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:43.264724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:43.264724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.264724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.264986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f672015-8c51-4ec1-b78f-66c05ab54b92 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:43.265085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] PATH_INFO: `/v3/projects/612c971a4d2d4a69a5a2cd9189ad4dfd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.265085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=612c971a4d2d4a69a5a2cd9189ad4dfd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:43.265771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:43.275576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f672015-8c51-4ec1-b78f-66c05ab54b92 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '78182dbb81a5402ea94ce5c7a83f327b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:43.306377 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2783/5511] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Mar 26 21:08:43 2022] DELETE /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/78182dbb81a5402ea94ce5c7a83f327b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:43.307760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f672015-8c51-4ec1-b78f-66c05ab54b92 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:43.382763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f672015-8c51-4ec1-b78f-66c05ab54b92 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:43.411122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612c971a4d2d4a69a5a2cd9189ad4dfd', 'request_id': 'req-a6aed776-24f9-4cc2-bce1-48b932665c74'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:43.448195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612c971a4d2d4a69a5a2cd9189ad4dfd', 'request_id': 'req-a6aed776-24f9-4cc2-bce1-48b932665c74'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:43.453493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd8bca-4aab-4455-b4f8-ac6d77f85a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:43.454323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd8bca-4aab-4455-b4f8-ac6d77f85a9f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.454630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd8bca-4aab-4455-b4f8-ac6d77f85a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.455008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd8bca-4aab-4455-b4f8-ac6d77f85a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.456663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd8bca-4aab-4455-b4f8-ac6d77f85a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:43.458426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd8bca-4aab-4455-b4f8-ac6d77f85a9f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:43.473926 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2784/5512] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:43.473926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2602b-bf1f-45c8-9845-b9a6e59edcf1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.473926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2602b-bf1f-45c8-9845-b9a6e59edcf1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.473926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2602b-bf1f-45c8-9845-b9a6e59edcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.480259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612c971a4d2d4a69a5a2cd9189ad4dfd', 'request_id': 'req-a6aed776-24f9-4cc2-bce1-48b932665c74'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:43.500039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9bc2602b-bf1f-45c8-9845-b9a6e59edcf1 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:43.501815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9bc2602b-bf1f-45c8-9845-b9a6e59edcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:43.516078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] The token cache is being invalidate because project 612c971a4d2d4a69a5a2cd9189ad4dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:43.516550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:43.517396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:43.520016 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2729/5513] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:43 2022] DELETE /identity/v3/projects/612c971a4d2d4a69a5a2cd9189ad4dfd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:43.521000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:43.522489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:43.615969 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2785/5514] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:43.616851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2602b-bf1f-45c8-9845-b9a6e59edcf1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:43.626782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9bc2602b-bf1f-45c8-9845-b9a6e59edcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:43.631502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aed776-24f9-4cc2-bce1-48b932665c74 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:43.644803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d89bae-c869-41a7-851b-eee5454a4bd9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:43.646013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d89bae-c869-41a7-851b-eee5454a4bd9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.646377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d89bae-c869-41a7-851b-eee5454a4bd9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.646908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d89bae-c869-41a7-851b-eee5454a4bd9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/0ba5ef0906fc47fdb3614370446e3146` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.650145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d89bae-c869-41a7-851b-eee5454a4bd9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc, user_id=0ba5ef0906fc47fdb3614370446e3146)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:43.653383 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-46d89bae-c869-41a7-851b-eee5454a4bd9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:43.653383 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:08:43.653383 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:08:43.657336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d89bae-c869-41a7-851b-eee5454a4bd9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:43.662978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2602b-bf1f-45c8-9845-b9a6e59edcf1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:43.675791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b57a82-1a3c-447b-bc0e-ce16baf63c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:43.681198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b57a82-1a3c-447b-bc0e-ce16baf63c50 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.681545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b57a82-1a3c-447b-bc0e-ce16baf63c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.681832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b57a82-1a3c-447b-bc0e-ce16baf63c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.682652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b57a82-1a3c-447b-bc0e-ce16baf63c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:43.685717 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2730/5515] 10.222.0.16 () {58 vars in 1341 bytes} [Sat Mar 26 21:08:43 2022] HEAD /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/0ba5ef0906fc47fdb3614370446e3146 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:43.687640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa67c-5929-4542-ba9e-bc8f8cbd3351 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.687962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa67c-5929-4542-ba9e-bc8f8cbd3351 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.688253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa67c-5929-4542-ba9e-bc8f8cbd3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.688438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b57a82-1a3c-447b-bc0e-ce16baf63c50 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:43.733076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d19aa67c-5929-4542-ba9e-bc8f8cbd3351 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:43.734336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d19aa67c-5929-4542-ba9e-bc8f8cbd3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:43.739515 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2786/5516] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:43.744265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b57a82-1a3c-447b-bc0e-ce16baf63c50 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:43.752920 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2731/5517] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:43.753948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa67c-5929-4542-ba9e-bc8f8cbd3351 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:43.772934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b57a82-1a3c-447b-bc0e-ce16baf63c50 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:43.778520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa67c-5929-4542-ba9e-bc8f8cbd3351 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:43.780493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b529ea6b-a2d7-4fa3-b7c0-a6dcb428ed88 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:43.781444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529ea6b-a2d7-4fa3-b7c0-a6dcb428ed88 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.781817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529ea6b-a2d7-4fa3-b7c0-a6dcb428ed88 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.782112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b529ea6b-a2d7-4fa3-b7c0-a6dcb428ed88 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/0ba5ef0906fc47fdb3614370446e3146` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.784957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529ea6b-a2d7-4fa3-b7c0-a6dcb428ed88 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc, user_id=0ba5ef0906fc47fdb3614370446e3146)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:43.789080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b529ea6b-a2d7-4fa3-b7c0-a6dcb428ed88 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:43.790044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4130166-f105-4014-935e-26236619eafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:43.790954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130166-f105-4014-935e-26236619eafe admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.791240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130166-f105-4014-935e-26236619eafe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.791525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130166-f105-4014-935e-26236619eafe admin admin] PATH_INFO: `/v3/projects/3b9c6849aa874b98b765ddbee781dadb/users/800a379a2a9a40a4b66109740909874f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.817413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b529ea6b-a2d7-4fa3-b7c0-a6dcb428ed88 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '0ba5ef0906fc47fdb3614370446e3146'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:43.832367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4130166-f105-4014-935e-26236619eafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9c6849aa874b98b765ddbee781dadb, user_id=800a379a2a9a40a4b66109740909874f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:43.835645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4130166-f105-4014-935e-26236619eafe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:43.852415 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2787/5518] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Mar 26 21:08:43 2022] DELETE /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users/0ba5ef0906fc47fdb3614370446e3146 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:43.858104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a2940-0b6c-49a3-bb50-456ecdef3038 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:43.858526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a2940-0b6c-49a3-bb50-456ecdef3038 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:43.858868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a2940-0b6c-49a3-bb50-456ecdef3038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:43.885811 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2732/5519] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:43 2022] PUT /identity/v3/projects/3b9c6849aa874b98b765ddbee781dadb/users/800a379a2a9a40a4b66109740909874f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:43.885811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4130166-f105-4014-935e-26236619eafe admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:43.903821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-849a2940-0b6c-49a3-bb50-456ecdef3038 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:43.913793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-849a2940-0b6c-49a3-bb50-456ecdef3038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:44.051169 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2788/5520] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:44.054736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4130166-f105-4014-935e-26236619eafe admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.057174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f1fe-fe36-4758-b084-db52b0b5582a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.057975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f1fe-fe36-4758-b084-db52b0b5582a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.058512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f1fe-fe36-4758-b084-db52b0b5582a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.065504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.066357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.066641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.066920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.076562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.080443 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:44.080443 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:08:44.080443 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:08:44.085001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.116774 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2733/5521] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 21:08:43 2022] GET /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc/users => generated 145 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:44.117955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.120889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:44.123435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3e40f1fe-fe36-4758-b084-db52b0b5582a None None] MFA Rules not processed for user `800a379a2a9a40a4b66109740909874f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:44.125961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3e40f1fe-fe36-4758-b084-db52b0b5582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:44.225054 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2789/5522] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:44.225054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40f1fe-fe36-4758-b084-db52b0b5582a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.231416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d85d70-91cc-4114-8f05-86a75234fe02 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.238182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40f1fe-fe36-4758-b084-db52b0b5582a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.238338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043112c-4929-4f8c-8f1c-290ba2ba0f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.238924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043112c-4929-4f8c-8f1c-290ba2ba0f0f service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.239213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043112c-4929-4f8c-8f1c-290ba2ba0f0f service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.239496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043112c-4929-4f8c-8f1c-290ba2ba0f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.241311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8043112c-4929-4f8c-8f1c-290ba2ba0f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:44.244969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767bd3e-a1e2-4afd-903a-d7bb7b422d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.245836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767bd3e-a1e2-4afd-903a-d7bb7b422d7c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.246774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767bd3e-a1e2-4afd-903a-d7bb7b422d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.247775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767bd3e-a1e2-4afd-903a-d7bb7b422d7c admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.249015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767bd3e-a1e2-4afd-903a-d7bb7b422d7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:44.249586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767bd3e-a1e2-4afd-903a-d7bb7b422d7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.252264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767bd3e-a1e2-4afd-903a-d7bb7b422d7c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.269130 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2790/5523] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:44.269130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767bd3e-a1e2-4afd-903a-d7bb7b422d7c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.279481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767bd3e-a1e2-4afd-903a-d7bb7b422d7c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.285094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.286219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.286219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.286679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/users/0ba5ef0906fc47fdb3614370446e3146` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.288859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0ba5ef0906fc47fdb3614370446e3146)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.290196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.314491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043112c-4929-4f8c-8f1c-290ba2ba0f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.316816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043112c-4929-4f8c-8f1c-290ba2ba0f0f service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.327389 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2734/5524] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:44.328455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043112c-4929-4f8c-8f1c-290ba2ba0f0f service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.342719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043112c-4929-4f8c-8f1c-290ba2ba0f0f service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.349790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45383a-cb8f-475d-a7ea-58495d66b0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.350607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45383a-cb8f-475d-a7ea-58495d66b0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.351020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45383a-cb8f-475d-a7ea-58495d66b0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.352196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45383a-cb8f-475d-a7ea-58495d66b0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.353098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45383a-cb8f-475d-a7ea-58495d66b0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.354116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba5ef0906fc47fdb3614370446e3146'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.356126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45383a-cb8f-475d-a7ea-58495d66b0e3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.376066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba5ef0906fc47fdb3614370446e3146'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.377910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba5ef0906fc47fdb3614370446e3146'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.378642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba5ef0906fc47fdb3614370446e3146'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.390153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba5ef0906fc47fdb3614370446e3146'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.397719 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2735/5525] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:44 2022] POST /identity/v3/projects => generated 387 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:44.398505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45383a-cb8f-475d-a7ea-58495d66b0e3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.400367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f45383a-cb8f-475d-a7ea-58495d66b0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:44.424855 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2791/5526] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:44 2022] DELETE /identity/v3/users/0ba5ef0906fc47fdb3614370446e3146 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:44.424855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.427364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:44.497661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45383a-cb8f-475d-a7ea-58495d66b0e3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.523162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475f74e-fe50-4015-aa47-a09d0d2821be tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.530007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156e5a8-7f51-4e53-92bc-142736c6fd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.530781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbd23-57c3-40df-a2f1-4557fd1206f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.531535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbd23-57c3-40df-a2f1-4557fd1206f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.531884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbd23-57c3-40df-a2f1-4557fd1206f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.532581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbd23-57c3-40df-a2f1-4557fd1206f0 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.532858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156e5a8-7f51-4e53-92bc-142736c6fd1f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.533314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156e5a8-7f51-4e53-92bc-142736c6fd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.533664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbd23-57c3-40df-a2f1-4557fd1206f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.535895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbd23-57c3-40df-a2f1-4557fd1206f0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.536505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156e5a8-7f51-4e53-92bc-142736c6fd1f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.537450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156e5a8-7f51-4e53-92bc-142736c6fd1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.541388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156e5a8-7f51-4e53-92bc-142736c6fd1f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.576994 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2792/5527] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:44 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:44.576994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbd23-57c3-40df-a2f1-4557fd1206f0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.578830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-19ddbd23-57c3-40df-a2f1-4557fd1206f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:44.608945 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2736/5528] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:44 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:44.608945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156e5a8-7f51-4e53-92bc-142736c6fd1f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.675712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbd23-57c3-40df-a2f1-4557fd1206f0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.697965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156e5a8-7f51-4e53-92bc-142736c6fd1f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.703414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd6e8-5860-4821-8acb-057da25ff2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.704126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd6e8-5860-4821-8acb-057da25ff2b4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.704554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd6e8-5860-4821-8acb-057da25ff2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.704843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243cd6e8-5860-4821-8acb-057da25ff2b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.705616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cd6e8-5860-4821-8acb-057da25ff2b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.708478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243cd6e8-5860-4821-8acb-057da25ff2b4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.724100 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2737/5529] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:44.725139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd6e8-5860-4821-8acb-057da25ff2b4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.741671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243cd6e8-5860-4821-8acb-057da25ff2b4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.748397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.749358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.750272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.750645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/users/78182dbb81a5402ea94ce5c7a83f327b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.752209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_user(user_id=78182dbb81a5402ea94ce5c7a83f327b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.754278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026bf54-2738-408d-9364-e9e9464b1787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.755034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026bf54-2738-408d-9364-e9e9464b1787 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.755349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.755550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026bf54-2738-408d-9364-e9e9464b1787 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.755884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026bf54-2738-408d-9364-e9e9464b1787 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.757747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026bf54-2738-408d-9364-e9e9464b1787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.760693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026bf54-2738-408d-9364-e9e9464b1787 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.791328 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2738/5530] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:44 2022] POST /identity/v3/users => generated 287 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:44.791328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026bf54-2738-408d-9364-e9e9464b1787 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.801909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026bf54-2738-408d-9364-e9e9464b1787 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.807013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd69a9-b6f2-4fe4-94e8-c9dd981f210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.807676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd69a9-b6f2-4fe4-94e8-c9dd981f210d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.808042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd69a9-b6f2-4fe4-94e8-c9dd981f210d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.808327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd69a9-b6f2-4fe4-94e8-c9dd981f210d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.809234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd69a9-b6f2-4fe4-94e8-c9dd981f210d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.810148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78182dbb81a5402ea94ce5c7a83f327b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.811030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd69a9-b6f2-4fe4-94e8-c9dd981f210d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.822006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78182dbb81a5402ea94ce5c7a83f327b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.823471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78182dbb81a5402ea94ce5c7a83f327b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.824169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78182dbb81a5402ea94ce5c7a83f327b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.827645 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2739/5531] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:44.828756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd69a9-b6f2-4fe4-94e8-c9dd981f210d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.830702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-05fd69a9-b6f2-4fe4-94e8-c9dd981f210d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:44.836481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78182dbb81a5402ea94ce5c7a83f327b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:44.857591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd69a9-b6f2-4fe4-94e8-c9dd981f210d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.862780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2793/5532] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:44 2022] DELETE /identity/v3/users/78182dbb81a5402ea94ce5c7a83f327b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:44.863659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.866586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:44.937042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ff741-fffc-412e-9ac0-ffa7f5a38fa9 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:44.946047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffac42c-b9f6-47b5-94ea-575e402135d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.948109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffac42c-b9f6-47b5-94ea-575e402135d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.948109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffac42c-b9f6-47b5-94ea-575e402135d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.948589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffac42c-b9f6-47b5-94ea-575e402135d5 admin admin] PATH_INFO: `/v3/projects/b20ee0dab0fe4d64b485757b15278abe/users/56dca9e8a3f54fe2bb45a01720065792/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.962350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721ef6-e98b-4767-b721-aea717cedc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:44.963135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721ef6-e98b-4767-b721-aea717cedc88 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:44.963531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721ef6-e98b-4767-b721-aea717cedc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:44.964074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721ef6-e98b-4767-b721-aea717cedc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:44.965280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20721ef6-e98b-4767-b721-aea717cedc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.967250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20721ef6-e98b-4767-b721-aea717cedc88 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.970283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffac42c-b9f6-47b5-94ea-575e402135d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20ee0dab0fe4d64b485757b15278abe, user_id=56dca9e8a3f54fe2bb45a01720065792, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:44.973653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffac42c-b9f6-47b5-94ea-575e402135d5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:44.983703 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2740/5533] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:44.988283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721ef6-e98b-4767-b721-aea717cedc88 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:44.990481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-20721ef6-e98b-4767-b721-aea717cedc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:45.003200 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2794/5534] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:44 2022] PUT /identity/v3/projects/b20ee0dab0fe4d64b485757b15278abe/users/56dca9e8a3f54fe2bb45a01720065792/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:45.003200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffac42c-b9f6-47b5-94ea-575e402135d5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.162974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721ef6-e98b-4767-b721-aea717cedc88 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.205966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffac42c-b9f6-47b5-94ea-575e402135d5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.211239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1538d-3c30-4105-a61b-4a4b607f4bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.212210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1538d-3c30-4105-a61b-4a4b607f4bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.212367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1538d-3c30-4105-a61b-4a4b607f4bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.212761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1538d-3c30-4105-a61b-4a4b607f4bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.213711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1538d-3c30-4105-a61b-4a4b607f4bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.215329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1538d-3c30-4105-a61b-4a4b607f4bb4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.235616 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2795/5535] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:45.238399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d2075-1e05-4f01-8f2c-b7bd6ac08b9e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.238703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d2075-1e05-4f01-8f2c-b7bd6ac08b9e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.238990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6d2075-1e05-4f01-8f2c-b7bd6ac08b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.287504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1e6d2075-1e05-4f01-8f2c-b7bd6ac08b9e None None] MFA Rules not processed for user `56dca9e8a3f54fe2bb45a01720065792`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:45.289050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1e6d2075-1e05-4f01-8f2c-b7bd6ac08b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:45.296439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.297323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.297606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.297881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/users/28a7a3514c504b9cba6ea54427955b8b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.299667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_user(user_id=28a7a3514c504b9cba6ea54427955b8b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.301853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.358198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28a7a3514c504b9cba6ea54427955b8b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.366798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28a7a3514c504b9cba6ea54427955b8b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.367002 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2796/5536] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:45.368093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d2075-1e05-4f01-8f2c-b7bd6ac08b9e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.371118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28a7a3514c504b9cba6ea54427955b8b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.372067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28a7a3514c504b9cba6ea54427955b8b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.379343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6d2075-1e05-4f01-8f2c-b7bd6ac08b9e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.384496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5caba-7932-44d8-9857-a908a3fdef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.385466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5caba-7932-44d8-9857-a908a3fdef33 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.385873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5caba-7932-44d8-9857-a908a3fdef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.386033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5caba-7932-44d8-9857-a908a3fdef33 admin admin] PATH_INFO: `/v3/projects/dfebcce661db41159f866a69ecb27659/users/64253232b10546f4b7a8eca845e9b2f4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.387213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28a7a3514c504b9cba6ea54427955b8b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.401657 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2741/5537] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:44 2022] DELETE /identity/v3/users/28a7a3514c504b9cba6ea54427955b8b => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:45.402491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.404594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:45.406768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5caba-7932-44d8-9857-a908a3fdef33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfebcce661db41159f866a69ecb27659, user_id=64253232b10546f4b7a8eca845e9b2f4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.410269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5caba-7932-44d8-9857-a908a3fdef33 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.425238 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2797/5538] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:45 2022] PUT /identity/v3/projects/dfebcce661db41159f866a69ecb27659/users/64253232b10546f4b7a8eca845e9b2f4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:45.425899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5caba-7932-44d8-9857-a908a3fdef33 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.427508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a1a5caba-7932-44d8-9857-a908a3fdef33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:45.485879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a52a3-f5ed-4734-9c4f-e7f889e88993 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.494549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5caba-7932-44d8-9857-a908a3fdef33 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.499799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef5440-c2e4-4a01-b9d2-3b2862ccdf2f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.500684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5440-c2e4-4a01-b9d2-3b2862ccdf2f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.500969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5440-c2e4-4a01-b9d2-3b2862ccdf2f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.501246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef5440-c2e4-4a01-b9d2-3b2862ccdf2f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.502569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef5440-c2e4-4a01-b9d2-3b2862ccdf2f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7702d9b4a77d44e998a5f17d66d99dcc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.503740 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-59ef5440-c2e4-4a01-b9d2-3b2862ccdf2f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:45.503740 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:08:45.503740 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:08:45.504984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef5440-c2e4-4a01-b9d2-3b2862ccdf2f tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.548708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0141a-6493-4eb3-ae8e-cb4c8a90238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.549430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0141a-6493-4eb3-ae8e-cb4c8a90238b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.549886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0141a-6493-4eb3-ae8e-cb4c8a90238b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.550311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0141a-6493-4eb3-ae8e-cb4c8a90238b admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.551077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0141a-6493-4eb3-ae8e-cb4c8a90238b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.553133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0141a-6493-4eb3-ae8e-cb4c8a90238b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.555571 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2798/5539] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:08:45 2022] DELETE /identity/v3/groups/7702d9b4a77d44e998a5f17d66d99dcc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:45.556932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62f9b5-4c68-4774-bf70-0511406b69db None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.557247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62f9b5-4c68-4774-bf70-0511406b69db None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.557504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62f9b5-4c68-4774-bf70-0511406b69db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.589839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7b62f9b5-4c68-4774-bf70-0511406b69db None None] MFA Rules not processed for user `64253232b10546f4b7a8eca845e9b2f4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:45.590814 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2742/5540] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:45 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:45.591042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7b62f9b5-4c68-4774-bf70-0511406b69db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:45.591708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0141a-6493-4eb3-ae8e-cb4c8a90238b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.658065 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2799/5541] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:45.659718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62f9b5-4c68-4774-bf70-0511406b69db None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.666372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0141a-6493-4eb3-ae8e-cb4c8a90238b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.673328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.673851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.674188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.674489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.675183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.676404 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:45.676404 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:08:45.676404 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:08:45.677943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.696447 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2743/5542] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:45 2022] POST /identity/v3/groups => generated 325 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:45.696447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.696447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:45.740859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62f9b5-4c68-4774-bf70-0511406b69db None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.747287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ce20c-0e13-494c-9853-3fb4674fbbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.748926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ce20c-0e13-494c-9853-3fb4674fbbda admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.749849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ce20c-0e13-494c-9853-3fb4674fbbda admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.750206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ce20c-0e13-494c-9853-3fb4674fbbda admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.750951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ce20c-0e13-494c-9853-3fb4674fbbda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.753021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ce20c-0e13-494c-9853-3fb4674fbbda admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.764240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed38c3-ba6c-4688-9180-3a58227d84f8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.771511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d860e-9652-4395-bc8c-b2e5373674e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.772427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d860e-9652-4395-bc8c-b2e5373674e3 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.773015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d860e-9652-4395-bc8c-b2e5373674e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.773836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801d860e-9652-4395-bc8c-b2e5373674e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.778816 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2800/5543] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:45 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:45.779703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ce20c-0e13-494c-9853-3fb4674fbbda admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.785341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d860e-9652-4395-bc8c-b2e5373674e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.787116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801d860e-9652-4395-bc8c-b2e5373674e3 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.794384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ce20c-0e13-494c-9853-3fb4674fbbda admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.798464 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2744/5544] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:45.800213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d860e-9652-4395-bc8c-b2e5373674e3 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.822340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e4f45-ee86-47ba-bcca-1ada1b2d76d8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.822836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801d860e-9652-4395-bc8c-b2e5373674e3 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.822949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e4f45-ee86-47ba-bcca-1ada1b2d76d8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.822949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e4f45-ee86-47ba-bcca-1ada1b2d76d8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.822949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e4f45-ee86-47ba-bcca-1ada1b2d76d8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.822949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e4f45-ee86-47ba-bcca-1ada1b2d76d8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.822949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748e4f45-ee86-47ba-bcca-1ada1b2d76d8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.823343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5efe57-eee7-46da-be80-384e5a65790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.823343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5efe57-eee7-46da-be80-384e5a65790a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.823343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5efe57-eee7-46da-be80-384e5a65790a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.823742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5efe57-eee7-46da-be80-384e5a65790a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.824618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5efe57-eee7-46da-be80-384e5a65790a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.826426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5efe57-eee7-46da-be80-384e5a65790a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.841714 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2745/5545] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:45.842706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5efe57-eee7-46da-be80-384e5a65790a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.844583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1a5efe57-eee7-46da-be80-384e5a65790a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:45.845161 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2801/5546] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:45 2022] POST /identity/v3/groups => generated 325 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:45.846221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e4f45-ee86-47ba-bcca-1ada1b2d76d8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.861450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5efe57-eee7-46da-be80-384e5a65790a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.861743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e4f45-ee86-47ba-bcca-1ada1b2d76d8 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.868021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018788fb-634e-440e-a696-2a0553c66de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.868418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018788fb-634e-440e-a696-2a0553c66de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.868706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018788fb-634e-440e-a696-2a0553c66de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.869039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018788fb-634e-440e-a696-2a0553c66de7 admin admin] PATH_INFO: `/v3/projects/05ad6707f15045a6a5b2497a5f62371d/users/c898c7ab7d4a4d99b2ec11a5d04adc9c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.871524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:45.872551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:45.872930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:45.873307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] PATH_INFO: `/v3/users/64253232b10546f4b7a8eca845e9b2f4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:45.874650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64253232b10546f4b7a8eca845e9b2f4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.879740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.888128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018788fb-634e-440e-a696-2a0553c66de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ad6707f15045a6a5b2497a5f62371d, user_id=c898c7ab7d4a4d99b2ec11a5d04adc9c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:45.890992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018788fb-634e-440e-a696-2a0553c66de7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:45.910756 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2802/5547] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:45 2022] PUT /identity/v3/projects/05ad6707f15045a6a5b2497a5f62371d/users/c898c7ab7d4a4d99b2ec11a5d04adc9c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:45.911986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018788fb-634e-440e-a696-2a0553c66de7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.934658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64253232b10546f4b7a8eca845e9b2f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.948748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64253232b10546f4b7a8eca845e9b2f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.949577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64253232b10546f4b7a8eca845e9b2f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.950295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64253232b10546f4b7a8eca845e9b2f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.968043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64253232b10546f4b7a8eca845e9b2f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:45.986357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018788fb-634e-440e-a696-2a0553c66de7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:45.987125 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2746/5548] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:45 2022] DELETE /identity/v3/users/64253232b10546f4b7a8eca845e9b2f4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:45.988350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:45.989763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:46.055394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417d24b-83f1-4e60-abd0-cb1051616982 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.056261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417d24b-83f1-4e60-abd0-cb1051616982 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.056620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417d24b-83f1-4e60-abd0-cb1051616982 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.057491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417d24b-83f1-4e60-abd0-cb1051616982 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.058512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417d24b-83f1-4e60-abd0-cb1051616982 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.061140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417d24b-83f1-4e60-abd0-cb1051616982 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:46.090058 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2803/5549] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:45 2022] POST /identity/v3/groups => generated 326 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:46.091600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e0393-6a70-4f41-b09e-3bf5e393e073 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.091957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e0393-6a70-4f41-b09e-3bf5e393e073 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.092298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e0393-6a70-4f41-b09e-3bf5e393e073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.108266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedada7-baa9-4344-8f49-43f122a50667 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:46.113547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46646-844f-4d07-a55c-ed2b592e7204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.114587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46646-844f-4d07-a55c-ed2b592e7204 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.115772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46646-844f-4d07-a55c-ed2b592e7204 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.116388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e46646-844f-4d07-a55c-ed2b592e7204 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.117643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e46646-844f-4d07-a55c-ed2b592e7204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.119612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7c8e0393-6a70-4f41-b09e-3bf5e393e073 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:46.119911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e46646-844f-4d07-a55c-ed2b592e7204 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:46.120865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7c8e0393-6a70-4f41-b09e-3bf5e393e073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:46.133045 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2804/5550] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:46.133045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e0393-6a70-4f41-b09e-3bf5e393e073 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:46.136305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7c8e0393-6a70-4f41-b09e-3bf5e393e073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:46.143524 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2747/5551] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:46.145006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46646-844f-4d07-a55c-ed2b592e7204 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:46.147483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-76e46646-844f-4d07-a55c-ed2b592e7204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:46.159108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e0393-6a70-4f41-b09e-3bf5e393e073 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:46.164329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c200fad-ba5a-4281-b3d3-c4081c84ae4a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.165297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c200fad-ba5a-4281-b3d3-c4081c84ae4a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.165796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c200fad-ba5a-4281-b3d3-c4081c84ae4a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.166278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c200fad-ba5a-4281-b3d3-c4081c84ae4a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.167141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c200fad-ba5a-4281-b3d3-c4081c84ae4a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.168285 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-6c200fad-ba5a-4281-b3d3-c4081c84ae4a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:46.168285 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:08:46.168285 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:08:46.169854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c200fad-ba5a-4281-b3d3-c4081c84ae4a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:46.178575 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2805/5552] 10.222.0.16 () {58 vars in 1124 bytes} [Sat Mar 26 21:08:46 2022] GET /identity/v3/groups => generated 1486 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:46.179650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c200fad-ba5a-4281-b3d3-c4081c84ae4a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:46.192888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c200fad-ba5a-4281-b3d3-c4081c84ae4a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:46.198458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1660844-532b-4485-aae8-7a81c6d376fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.199511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1660844-532b-4485-aae8-7a81c6d376fe admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.200059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1660844-532b-4485-aae8-7a81c6d376fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.200530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1660844-532b-4485-aae8-7a81c6d376fe admin admin] PATH_INFO: `/v3/projects/05ad6707f15045a6a5b2497a5f62371d/users/c898c7ab7d4a4d99b2ec11a5d04adc9c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.202653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1660844-532b-4485-aae8-7a81c6d376fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=05ad6707f15045a6a5b2497a5f62371d, user_id=c898c7ab7d4a4d99b2ec11a5d04adc9c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.207550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1660844-532b-4485-aae8-7a81c6d376fe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:46.214404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e46646-844f-4d07-a55c-ed2b592e7204 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:46.219644 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2806/5553] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:46 2022] PUT /identity/v3/projects/05ad6707f15045a6a5b2497a5f62371d/users/c898c7ab7d4a4d99b2ec11a5d04adc9c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:46.220749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1660844-532b-4485-aae8-7a81c6d376fe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:46.300175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6f219-ce48-44d5-8b73-9971328335b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.301824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f219-ce48-44d5-8b73-9971328335b9 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.302115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f219-ce48-44d5-8b73-9971328335b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.303850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f219-ce48-44d5-8b73-9971328335b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.327653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1660844-532b-4485-aae8-7a81c6d376fe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:46.342625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c36ed-3c91-4360-97ac-ddbc6b0fbe1a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.344517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c36ed-3c91-4360-97ac-ddbc6b0fbe1a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.345042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c36ed-3c91-4360-97ac-ddbc6b0fbe1a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.346684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c36ed-3c91-4360-97ac-ddbc6b0fbe1a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/ccf6bb0959fe44078da75386e7584164` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.362486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c36ed-3c91-4360-97ac-ddbc6b0fbe1a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_group(group_id=ccf6bb0959fe44078da75386e7584164)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.365540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c36ed-3c91-4360-97ac-ddbc6b0fbe1a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:46.395502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6f219-ce48-44d5-8b73-9971328335b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.400564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6f219-ce48-44d5-8b73-9971328335b9 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:46.414764 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2748/5554] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:46.416034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b00dc-56e7-410e-b380-72a09efd4ad0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.416339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b00dc-56e7-410e-b380-72a09efd4ad0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.416624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036b00dc-56e7-410e-b380-72a09efd4ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.432355 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2807/5555] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:08:46 2022] DELETE /identity/v3/groups/ccf6bb0959fe44078da75386e7584164 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:46.436429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c36ed-3c91-4360-97ac-ddbc6b0fbe1a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:46.459294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-036b00dc-56e7-410e-b380-72a09efd4ad0 None None] MFA Rules not processed for user `c898c7ab7d4a4d99b2ec11a5d04adc9c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:46.460603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-036b00dc-56e7-410e-b380-72a09efd4ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:46.543727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c36ed-3c91-4360-97ac-ddbc6b0fbe1a tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:46.553821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89a92b-e820-44b2-80ee-fdeb1048e966 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.556577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89a92b-e820-44b2-80ee-fdeb1048e966 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.557241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89a92b-e820-44b2-80ee-fdeb1048e966 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.558300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89a92b-e820-44b2-80ee-fdeb1048e966 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/1c4d0f4073e246d3a17736d830d8aae8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.576254 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2749/5556] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:46.583301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89a92b-e820-44b2-80ee-fdeb1048e966 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1c4d0f4073e246d3a17736d830d8aae8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.588355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b00dc-56e7-410e-b380-72a09efd4ad0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:46.591070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-036b00dc-56e7-410e-b380-72a09efd4ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:46.591851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89a92b-e820-44b2-80ee-fdeb1048e966 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:46.685211 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2808/5557] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:08:46 2022] DELETE /identity/v3/groups/1c4d0f4073e246d3a17736d830d8aae8 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:46.687986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89a92b-e820-44b2-80ee-fdeb1048e966 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:46.741135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036b00dc-56e7-410e-b380-72a09efd4ad0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:46.807107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89a92b-e820-44b2-80ee-fdeb1048e966 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:46.814383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36871a-1dc5-478b-820c-142917b86840 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.815393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36871a-1dc5-478b-820c-142917b86840 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.815775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36871a-1dc5-478b-820c-142917b86840 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.816162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36871a-1dc5-478b-820c-142917b86840 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/35c07b1a36944795b51ed44f3ca8e8c1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.822782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2c546-6cd7-4b29-9cc1-f6bf491fcf8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.823009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36871a-1dc5-478b-820c-142917b86840 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_group(group_id=35c07b1a36944795b51ed44f3ca8e8c1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.823604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2c546-6cd7-4b29-9cc1-f6bf491fcf8b service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.824012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2c546-6cd7-4b29-9cc1-f6bf491fcf8b service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.824347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec2c546-6cd7-4b29-9cc1-f6bf491fcf8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.825583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36871a-1dc5-478b-820c-142917b86840 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:46.884341 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2809/5558] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:08:46 2022] DELETE /identity/v3/groups/35c07b1a36944795b51ed44f3ca8e8c1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:46.890025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36871a-1dc5-478b-820c-142917b86840 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:46.929246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2c546-6cd7-4b29-9cc1-f6bf491fcf8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.930726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec2c546-6cd7-4b29-9cc1-f6bf491fcf8b service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:46.942651 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2750/5559] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:08:46.965915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36871a-1dc5-478b-820c-142917b86840 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:46.972232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f4b9e-baf0-4721-8657-939107281048 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:46.972901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f4b9e-baf0-4721-8657-939107281048 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:46.973216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f4b9e-baf0-4721-8657-939107281048 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:46.973457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f4b9e-baf0-4721-8657-939107281048 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:46.974548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f4b9e-baf0-4721-8657-939107281048 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:46.977549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f4b9e-baf0-4721-8657-939107281048 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.024203 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2810/5560] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:46 2022] POST /identity/v3/users => generated 323 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:47.025291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2c546-6cd7-4b29-9cc1-f6bf491fcf8b service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.041776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec2c546-6cd7-4b29-9cc1-f6bf491fcf8b service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.047224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961c12f-314d-42a4-b723-d869d3362524 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.047892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961c12f-314d-42a4-b723-d869d3362524 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.048238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961c12f-314d-42a4-b723-d869d3362524 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.048521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1961c12f-314d-42a4-b723-d869d3362524 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.049710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961c12f-314d-42a4-b723-d869d3362524 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.051771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1961c12f-314d-42a4-b723-d869d3362524 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.072125 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2751/5561] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:47 2022] POST /identity/v3/groups => generated 326 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:47.076353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f4b9e-baf0-4721-8657-939107281048 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.088457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f4b9e-baf0-4721-8657-939107281048 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.094435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961c12f-314d-42a4-b723-d869d3362524 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.096708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1961c12f-314d-42a4-b723-d869d3362524 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:47.104152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018768-fb76-409f-a5a3-080a96c5c0dd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.105969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018768-fb76-409f-a5a3-080a96c5c0dd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.106262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018768-fb76-409f-a5a3-080a96c5c0dd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.106545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018768-fb76-409f-a5a3-080a96c5c0dd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/0e9c26a590da449f8a8aae1b0a713ac4/users/0232ad004ee94b9ebd8b32b2b2d8759e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.155402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d018768-fb76-409f-a5a3-080a96c5c0dd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=0e9c26a590da449f8a8aae1b0a713ac4, user_id=0232ad004ee94b9ebd8b32b2b2d8759e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.157914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d018768-fb76-409f-a5a3-080a96c5c0dd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.200955 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2811/5562] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Mar 26 21:08:47 2022] PUT /identity/v3/groups/0e9c26a590da449f8a8aae1b0a713ac4/users/0232ad004ee94b9ebd8b32b2b2d8759e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:47.201908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018768-fb76-409f-a5a3-080a96c5c0dd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.204072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1961c12f-314d-42a4-b723-d869d3362524 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.275713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.277582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.277582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.277582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] PATH_INFO: `/v3/projects/dfebcce661db41159f866a69ecb27659` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.279936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfebcce661db41159f866a69ecb27659)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.281900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.294803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018768-fb76-409f-a5a3-080a96c5c0dd tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.300847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3782c-2997-4c84-8211-b7f30e73afaf tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.301779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3782c-2997-4c84-8211-b7f30e73afaf tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.302191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3782c-2997-4c84-8211-b7f30e73afaf tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.302672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3782c-2997-4c84-8211-b7f30e73afaf tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.303658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3782c-2997-4c84-8211-b7f30e73afaf tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.306552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3782c-2997-4c84-8211-b7f30e73afaf tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.327969 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2812/5563] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:08:47 2022] POST /identity/v3/groups => generated 326 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:47.330769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3782c-2997-4c84-8211-b7f30e73afaf tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.345398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3782c-2997-4c84-8211-b7f30e73afaf tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.347009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfebcce661db41159f866a69ecb27659', 'request_id': 'req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:47.359055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfebcce661db41159f866a69ecb27659', 'request_id': 'req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:47.367292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfebcce661db41159f866a69ecb27659', 'request_id': 'req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:47.385351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] The token cache is being invalidate because project dfebcce661db41159f866a69ecb27659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:47.385643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:47.392457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32cb5fde-fbc2-4ef7-b2d1-00536d28bbcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:47.392457 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2752/5564] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:47 2022] DELETE /identity/v3/projects/dfebcce661db41159f866a69ecb27659 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:47.393364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb040-6b53-420c-b506-17d7972ab671 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.393653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb040-6b53-420c-b506-17d7972ab671 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.393930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbb040-6b53-420c-b506-17d7972ab671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.413600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b7cbb040-6b53-420c-b506-17d7972ab671 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:47.414807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b7cbb040-6b53-420c-b506-17d7972ab671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:47.425857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b467b47-be8b-46cf-a885-9e9c71fb84ae tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.427157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b467b47-be8b-46cf-a885-9e9c71fb84ae tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.427444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b467b47-be8b-46cf-a885-9e9c71fb84ae tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.427724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b467b47-be8b-46cf-a885-9e9c71fb84ae tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/5efc1cb5a9954dd59759cbf9b12b79b1/users/0232ad004ee94b9ebd8b32b2b2d8759e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.447390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b467b47-be8b-46cf-a885-9e9c71fb84ae tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=5efc1cb5a9954dd59759cbf9b12b79b1, user_id=0232ad004ee94b9ebd8b32b2b2d8759e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.449819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b467b47-be8b-46cf-a885-9e9c71fb84ae tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.485594 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2813/5565] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Mar 26 21:08:47 2022] PUT /identity/v3/groups/5efc1cb5a9954dd59759cbf9b12b79b1/users/0232ad004ee94b9ebd8b32b2b2d8759e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:47.490455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b467b47-be8b-46cf-a885-9e9c71fb84ae tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.492876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b467b47-be8b-46cf-a885-9e9c71fb84ae tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:47.499209 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2753/5566] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:47.500920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f00d4-be59-450a-a116-f4adceb71c5d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.501215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f00d4-be59-450a-a116-f4adceb71c5d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.501491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f00d4-be59-450a-a116-f4adceb71c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.525179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-614f00d4-be59-450a-a116-f4adceb71c5d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:47.526376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-614f00d4-be59-450a-a116-f4adceb71c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:47.578711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b467b47-be8b-46cf-a885-9e9c71fb84ae tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.583608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc978-9e25-4a60-912b-fefa956126f0 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.584511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc978-9e25-4a60-912b-fefa956126f0 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.584797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc978-9e25-4a60-912b-fefa956126f0 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.585072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9cc978-9e25-4a60-912b-fefa956126f0 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/users/0232ad004ee94b9ebd8b32b2b2d8759e/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.586339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cc978-9e25-4a60-912b-fefa956126f0 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=0232ad004ee94b9ebd8b32b2b2d8759e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.588507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9cc978-9e25-4a60-912b-fefa956126f0 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.608956 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2754/5567] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:47.610438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f00d4-be59-450a-a116-f4adceb71c5d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.612631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-614f00d4-be59-450a-a116-f4adceb71c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:47.614673 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2814/5568] 10.222.0.16 () {58 vars in 1241 bytes} [Sat Mar 26 21:08:47 2022] GET /identity/v3/users/0232ad004ee94b9ebd8b32b2b2d8759e/groups => generated 838 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:47.615450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc978-9e25-4a60-912b-fefa956126f0 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.626047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9cc978-9e25-4a60-912b-fefa956126f0 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.631625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ecbbd-1a3a-482a-82e9-e8877b3c858e tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.633233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ecbbd-1a3a-482a-82e9-e8877b3c858e tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.633233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ecbbd-1a3a-482a-82e9-e8877b3c858e tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.633517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ecbbd-1a3a-482a-82e9-e8877b3c858e tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/5efc1cb5a9954dd59759cbf9b12b79b1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.634875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ecbbd-1a3a-482a-82e9-e8877b3c858e tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_group(group_id=5efc1cb5a9954dd59759cbf9b12b79b1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.637368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ecbbd-1a3a-482a-82e9-e8877b3c858e tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.681533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f00d4-be59-450a-a116-f4adceb71c5d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.683370 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2815/5569] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:08:47 2022] DELETE /identity/v3/groups/5efc1cb5a9954dd59759cbf9b12b79b1 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:47.684027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ecbbd-1a3a-482a-82e9-e8877b3c858e tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.796351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e126f57-85c3-4713-89ab-47a68a47b20a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.797548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126f57-85c3-4713-89ab-47a68a47b20a service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.798021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126f57-85c3-4713-89ab-47a68a47b20a service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.798451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126f57-85c3-4713-89ab-47a68a47b20a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.802902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6e126f57-85c3-4713-89ab-47a68a47b20a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:47.807863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ecbbd-1a3a-482a-82e9-e8877b3c858e tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.814298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beca77-9c36-4a96-a282-44915ebc3bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.815011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beca77-9c36-4a96-a282-44915ebc3bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.815361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beca77-9c36-4a96-a282-44915ebc3bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.815633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beca77-9c36-4a96-a282-44915ebc3bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.816393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beca77-9c36-4a96-a282-44915ebc3bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:47.816694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beca77-9c36-4a96-a282-44915ebc3bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.818314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24beca77-9c36-4a96-a282-44915ebc3bf2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.840040 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2816/5570] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:47.841781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beca77-9c36-4a96-a282-44915ebc3bf2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:47.932355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e126f57-85c3-4713-89ab-47a68a47b20a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.933835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e126f57-85c3-4713-89ab-47a68a47b20a service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.945160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24beca77-9c36-4a96-a282-44915ebc3bf2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:47.950690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0da5dc-b68f-45e3-9a88-4a17828e6785 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:47.951515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0da5dc-b68f-45e3-9a88-4a17828e6785 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:47.951810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0da5dc-b68f-45e3-9a88-4a17828e6785 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:47.952173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0da5dc-b68f-45e3-9a88-4a17828e6785 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/groups/0e9c26a590da449f8a8aae1b0a713ac4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:47.953586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0da5dc-b68f-45e3-9a88-4a17828e6785 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_group(group_id=0e9c26a590da449f8a8aae1b0a713ac4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:47.956207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0da5dc-b68f-45e3-9a88-4a17828e6785 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:47.960044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2755/5571] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:47.961018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e126f57-85c3-4713-89ab-47a68a47b20a service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:48.005155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e126f57-85c3-4713-89ab-47a68a47b20a service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:48.012803 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2817/5572] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:08:47 2022] DELETE /identity/v3/groups/0e9c26a590da449f8a8aae1b0a713ac4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:48.017511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0da5dc-b68f-45e3-9a88-4a17828e6785 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:48.026128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98c501-3c9d-4c53-8f44-dd5f8155d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:48.026347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c501-3c9d-4c53-8f44-dd5f8155d030 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:48.026673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c501-3c9d-4c53-8f44-dd5f8155d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:48.027124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98c501-3c9d-4c53-8f44-dd5f8155d030 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:48.027956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98c501-3c9d-4c53-8f44-dd5f8155d030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:48.032382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e98c501-3c9d-4c53-8f44-dd5f8155d030 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:48.100121 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2756/5573] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:47 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:48.103907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98c501-3c9d-4c53-8f44-dd5f8155d030 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:48.111289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0da5dc-b68f-45e3-9a88-4a17828e6785 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:48.186214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:48.187504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:48.188867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:48.190169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/users/0232ad004ee94b9ebd8b32b2b2d8759e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:48.192804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0232ad004ee94b9ebd8b32b2b2d8759e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:48.195883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:48.265803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0232ad004ee94b9ebd8b32b2b2d8759e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.270054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98c501-3c9d-4c53-8f44-dd5f8155d030 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:48.278903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0232ad004ee94b9ebd8b32b2b2d8759e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.281551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13080fc8-7089-470b-87eb-a677fbe14776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:48.281732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0232ad004ee94b9ebd8b32b2b2d8759e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.282233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13080fc8-7089-470b-87eb-a677fbe14776 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:48.282522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13080fc8-7089-470b-87eb-a677fbe14776 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:48.282819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0232ad004ee94b9ebd8b32b2b2d8759e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.282934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13080fc8-7089-470b-87eb-a677fbe14776 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:48.285798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13080fc8-7089-470b-87eb-a677fbe14776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:48.293805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13080fc8-7089-470b-87eb-a677fbe14776 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:48.296552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0232ad004ee94b9ebd8b32b2b2d8759e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.347430 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2757/5574] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:48 2022] POST /identity/v3/users => generated 288 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:48.347597 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2818/5575] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:48 2022] DELETE /identity/v3/users/0232ad004ee94b9ebd8b32b2b2d8759e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:48.351457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:48.351899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13080fc8-7089-470b-87eb-a677fbe14776 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:48.353556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:48.356100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-13080fc8-7089-470b-87eb-a677fbe14776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:48.385908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13080fc8-7089-470b-87eb-a677fbe14776 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:48.473073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cdcf60-c21a-4642-93f2-26b2616b8a7d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:48.478502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:48.479385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:48.479675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:48.479991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/domains/24f442c4651243beaf94e87b721a711e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:48.481381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=24f442c4651243beaf94e87b721a711e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:48.483156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:48.507642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '24f442c4651243beaf94e87b721a711e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.508559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '24f442c4651243beaf94e87b721a711e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.546532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '24f442c4651243beaf94e87b721a711e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.547231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '24f442c4651243beaf94e87b721a711e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.553782 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2819/5576] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:08:48 2022] PATCH /identity/v3/domains/24f442c4651243beaf94e87b721a711e => generated 278 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:48.555284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:48.557782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:48.570095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48485e02-23dd-4aa4-bf04-b4c9e4cda617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:48.570095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48485e02-23dd-4aa4-bf04-b4c9e4cda617 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:48.570095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48485e02-23dd-4aa4-bf04-b4c9e4cda617 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:48.570095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48485e02-23dd-4aa4-bf04-b4c9e4cda617 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:48.570591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48485e02-23dd-4aa4-bf04-b4c9e4cda617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:48.570591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48485e02-23dd-4aa4-bf04-b4c9e4cda617 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:48.583642 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2758/5577] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:48.585239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48485e02-23dd-4aa4-bf04-b4c9e4cda617 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:48.588084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-48485e02-23dd-4aa4-bf04-b4c9e4cda617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:48.604878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48485e02-23dd-4aa4-bf04-b4c9e4cda617 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:48.692266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef80d5-0610-487e-948c-e077435275f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:48.694487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef80d5-0610-487e-948c-e077435275f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:48.695015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef80d5-0610-487e-948c-e077435275f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:48.695618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef80d5-0610-487e-948c-e077435275f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:48.696873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef80d5-0610-487e-948c-e077435275f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:48.700150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ef80d5-0610-487e-948c-e077435275f1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:48.719893 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2759/5578] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:48.720075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95f4b6-57c3-45c2-83a3-fa641a95768d tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:48.729724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef80d5-0610-487e-948c-e077435275f1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:48.732578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7978c6e75ee14fa39f4cdaed47297775', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4f4971f74d97430990f6135a57d443dd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:48.733463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:48.733752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:48.734032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] PATH_INFO: `/v3/domains/24f442c4651243beaf94e87b721a711e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:48.749710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef80d5-0610-487e-948c-e077435275f1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:48.758054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=24f442c4651243beaf94e87b721a711e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:48.759710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:48.766206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba328233-a0dc-4e2c-8bc8-9ec53297193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:48.768318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba328233-a0dc-4e2c-8bc8-9ec53297193a admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:48.768527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba328233-a0dc-4e2c-8bc8-9ec53297193a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:48.768868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba328233-a0dc-4e2c-8bc8-9ec53297193a admin admin] PATH_INFO: `/v3/projects/7283f04bcbb04e179915e4b52786ee15/users/8ed8d3c39e1043a995c8ff6e116a2944/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:48.806271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba328233-a0dc-4e2c-8bc8-9ec53297193a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7283f04bcbb04e179915e4b52786ee15, user_id=8ed8d3c39e1043a995c8ff6e116a2944, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:48.810114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba328233-a0dc-4e2c-8bc8-9ec53297193a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:48.850291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '24f442c4651243beaf94e87b721a711e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.855958 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2760/5579] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:48 2022] PUT /identity/v3/projects/7283f04bcbb04e179915e4b52786ee15/users/8ed8d3c39e1043a995c8ff6e116a2944/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:48.860060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '24f442c4651243beaf94e87b721a711e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.954056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f442c4651243beaf94e87b721a711e', 'request_id': 'req-25ca6675-924c-4de9-bf4d-0dc25f249872'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.965621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f442c4651243beaf94e87b721a711e', 'request_id': 'req-25ca6675-924c-4de9-bf4d-0dc25f249872'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.966576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27831082-50e0-4d2f-93c2-79d406275930 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:48.967015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27831082-50e0-4d2f-93c2-79d406275930 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:48.967650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27831082-50e0-4d2f-93c2-79d406275930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:48.975025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f442c4651243beaf94e87b721a711e', 'request_id': 'req-25ca6675-924c-4de9-bf4d-0dc25f249872'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.993790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] The token cache is being invalidate because project 24f442c4651243beaf94e87b721a711e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:48.995158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:48.999176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:49.038125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '24f442c4651243beaf94e87b721a711e', 'request_id': 'req-25ca6675-924c-4de9-bf4d-0dc25f249872'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:49.042424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '24f442c4651243beaf94e87b721a711e', 'request_id': 'req-25ca6675-924c-4de9-bf4d-0dc25f249872'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:49.043737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '24f442c4651243beaf94e87b721a711e', 'request_id': 'req-25ca6675-924c-4de9-bf4d-0dc25f249872'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:49.044037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-27831082-50e0-4d2f-93c2-79d406275930 None None] MFA Rules not processed for user `8ed8d3c39e1043a995c8ff6e116a2944`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:49.046238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-27831082-50e0-4d2f-93c2-79d406275930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:49.060660 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2820/5580] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:08:48 2022] DELETE /identity/v3/domains/24f442c4651243beaf94e87b721a711e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:49.065285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:49.070226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:49.227141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca6675-924c-4de9-bf4d-0dc25f249872 tempest-GroupsV3TestJSON-1536630090 tempest-GroupsV3TestJSON-1536630090-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:49.234507 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2761/5581] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:49.237999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27831082-50e0-4d2f-93c2-79d406275930 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:49.240957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-27831082-50e0-4d2f-93c2-79d406275930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:49.245768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:49.246968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.248146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.249400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] PATH_INFO: `/v3/users/059deef0354d4687b7f82a8fff5ae8c6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.254732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=059deef0354d4687b7f82a8fff5ae8c6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:49.257580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:49.275477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27831082-50e0-4d2f-93c2-79d406275930 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:49.288540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084b73c-d92d-4d71-9deb-9a3e87a8fe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:49.289555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084b73c-d92d-4d71-9deb-9a3e87a8fe58 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.290219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084b73c-d92d-4d71-9deb-9a3e87a8fe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.291297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084b73c-d92d-4d71-9deb-9a3e87a8fe58 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.292251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084b73c-d92d-4d71-9deb-9a3e87a8fe58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:49.294349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084b73c-d92d-4d71-9deb-9a3e87a8fe58 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:49.338567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059deef0354d4687b7f82a8fff5ae8c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:49.340821 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2762/5582] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:49 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:49.344474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084b73c-d92d-4d71-9deb-9a3e87a8fe58 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:49.346441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059deef0354d4687b7f82a8fff5ae8c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:49.347285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059deef0354d4687b7f82a8fff5ae8c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:49.348079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059deef0354d4687b7f82a8fff5ae8c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:49.383854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c3a52ff-eeea-4ffd-93c8-f7f8a2e8c1fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059deef0354d4687b7f82a8fff5ae8c6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:49.408565 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2821/5583] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:49 2022] DELETE /identity/v3/users/059deef0354d4687b7f82a8fff5ae8c6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:49.413105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411e987-1d87-4edc-81f5-b88a33a850d0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.413660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411e987-1d87-4edc-81f5-b88a33a850d0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.414507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f411e987-1d87-4edc-81f5-b88a33a850d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.431572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084b73c-d92d-4d71-9deb-9a3e87a8fe58 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:49.450953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f411e987-1d87-4edc-81f5-b88a33a850d0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:49.452168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f411e987-1d87-4edc-81f5-b88a33a850d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:49.525252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a418-57bf-407a-8025-cf0e2d9f50df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:49.526523 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2822/5584] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:49.534014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411e987-1d87-4edc-81f5-b88a33a850d0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:49.534434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a418-57bf-407a-8025-cf0e2d9f50df admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.535081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a418-57bf-407a-8025-cf0e2d9f50df admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.535506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7a418-57bf-407a-8025-cf0e2d9f50df admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.535791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f411e987-1d87-4edc-81f5-b88a33a850d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:49.536540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7a418-57bf-407a-8025-cf0e2d9f50df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:49.539020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7a418-57bf-407a-8025-cf0e2d9f50df admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:49.580243 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2763/5585] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:49 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:49.581229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a418-57bf-407a-8025-cf0e2d9f50df admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:49.584619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-01e7a418-57bf-407a-8025-cf0e2d9f50df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:49.601019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7a418-57bf-407a-8025-cf0e2d9f50df admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:49.607888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3174f-37b7-445e-979f-f508fed2266c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:49.608742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3174f-37b7-445e-979f-f508fed2266c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.609029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3174f-37b7-445e-979f-f508fed2266c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.609474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3174f-37b7-445e-979f-f508fed2266c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.610322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3174f-37b7-445e-979f-f508fed2266c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:49.613317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3174f-37b7-445e-979f-f508fed2266c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:49.620566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f411e987-1d87-4edc-81f5-b88a33a850d0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:49.625159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ff206-fbd0-4874-a139-29704468ff73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:49.626337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ff206-fbd0-4874-a139-29704468ff73 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.627675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ff206-fbd0-4874-a139-29704468ff73 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.628212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ff206-fbd0-4874-a139-29704468ff73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.633712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2764/5586] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:49.637862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3174f-37b7-445e-979f-f508fed2266c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:49.646771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ff206-fbd0-4874-a139-29704468ff73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:49.648254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3174f-37b7-445e-979f-f508fed2266c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:49.648494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5ff206-fbd0-4874-a139-29704468ff73 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:49.660348 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2823/5587] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:08:49.675956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13779091-486f-409c-bd40-6fda6dfd8fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:49.678209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779091-486f-409c-bd40-6fda6dfd8fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.678502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779091-486f-409c-bd40-6fda6dfd8fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.679666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13779091-486f-409c-bd40-6fda6dfd8fe4 admin admin] PATH_INFO: `/v3/projects/db79be3c900c49909c969c1d96fb747c/users/1543460762424c789b88f146cd22df17/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.709822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13779091-486f-409c-bd40-6fda6dfd8fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db79be3c900c49909c969c1d96fb747c, user_id=1543460762424c789b88f146cd22df17, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:49.712746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13779091-486f-409c-bd40-6fda6dfd8fe4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:49.733720 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2765/5588] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:49 2022] PUT /identity/v3/projects/db79be3c900c49909c969c1d96fb747c/users/1543460762424c789b88f146cd22df17/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:49.743135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ff206-fbd0-4874-a139-29704468ff73 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:49.757769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ff206-fbd0-4874-a139-29704468ff73 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:49.848887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745ac6f-4039-44c4-89ab-676f6bb76c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:49.849873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745ac6f-4039-44c4-89ab-676f6bb76c29 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.850171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745ac6f-4039-44c4-89ab-676f6bb76c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.850749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745ac6f-4039-44c4-89ab-676f6bb76c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.851881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745ac6f-4039-44c4-89ab-676f6bb76c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:49.853859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745ac6f-4039-44c4-89ab-676f6bb76c29 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:49.871895 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2824/5589] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:49.875052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13779091-486f-409c-bd40-6fda6dfd8fe4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:49.893756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13779091-486f-409c-bd40-6fda6dfd8fe4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:49.910313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7ef7a-4966-47c8-89c4-f2663a2b8cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:49.911364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7ef7a-4966-47c8-89c4-f2663a2b8cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.913265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7ef7a-4966-47c8-89c4-f2663a2b8cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.914974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7ef7a-4966-47c8-89c4-f2663a2b8cf4 admin admin] PATH_INFO: `/v3/projects/db79be3c900c49909c969c1d96fb747c/users/1543460762424c789b88f146cd22df17/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.921092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7ef7a-4966-47c8-89c4-f2663a2b8cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db79be3c900c49909c969c1d96fb747c, user_id=1543460762424c789b88f146cd22df17, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:49.924408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7ef7a-4966-47c8-89c4-f2663a2b8cf4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:49.940034 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2766/5590] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:49 2022] PUT /identity/v3/projects/db79be3c900c49909c969c1d96fb747c/users/1543460762424c789b88f146cd22df17/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:49.954006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb97b9c-b85f-4595-b5fb-2e6ded0cb818 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:49.954303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb97b9c-b85f-4595-b5fb-2e6ded0cb818 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:49.954583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb97b9c-b85f-4595-b5fb-2e6ded0cb818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:49.994279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cbb97b9c-b85f-4595-b5fb-2e6ded0cb818 None None] MFA Rules not processed for user `1543460762424c789b88f146cd22df17`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:49.996264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cbb97b9c-b85f-4595-b5fb-2e6ded0cb818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:50.084983 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2825/5591] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:50.100334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7ef7a-4966-47c8-89c4-f2663a2b8cf4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:50.103147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-36f7ef7a-4966-47c8-89c4-f2663a2b8cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:50.170267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7ef7a-4966-47c8-89c4-f2663a2b8cf4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:50.175190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290d2cb-5278-4453-9188-9a8a1ef17a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:50.176227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d2cb-5278-4453-9188-9a8a1ef17a82 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:50.176898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d2cb-5278-4453-9188-9a8a1ef17a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:50.176898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290d2cb-5278-4453-9188-9a8a1ef17a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:50.181088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7290d2cb-5278-4453-9188-9a8a1ef17a82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:50.225196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb97b9c-b85f-4595-b5fb-2e6ded0cb818 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:50.226819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cbb97b9c-b85f-4595-b5fb-2e6ded0cb818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:50.319057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290d2cb-5278-4453-9188-9a8a1ef17a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:50.323697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290d2cb-5278-4453-9188-9a8a1ef17a82 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:50.340284 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2767/5592] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:50.341689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a7ca7-6710-4fdc-ba8f-423e1b5e13de None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:50.342002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a7ca7-6710-4fdc-ba8f-423e1b5e13de None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:50.342326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a7ca7-6710-4fdc-ba8f-423e1b5e13de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:50.370384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8e3a7ca7-6710-4fdc-ba8f-423e1b5e13de None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:50.371622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e3a7ca7-6710-4fdc-ba8f-423e1b5e13de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:50.381265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb97b9c-b85f-4595-b5fb-2e6ded0cb818 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:50.397063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:50.398113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:50.398402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:50.398680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] PATH_INFO: `/v3/projects/1b5a5b535c92443bb84038b6a8e91eb5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:50.400733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b5a5b535c92443bb84038b6a8e91eb5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:50.403153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:50.527157 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2768/5593] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:08:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:50.528357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a7ca7-6710-4fdc-ba8f-423e1b5e13de None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:50.535783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e3a7ca7-6710-4fdc-ba8f-423e1b5e13de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:50.537172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b5a5b535c92443bb84038b6a8e91eb5', 'request_id': 'req-4b82b145-e83c-475e-abe1-5dcd147fb6f9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.554108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b5a5b535c92443bb84038b6a8e91eb5', 'request_id': 'req-4b82b145-e83c-475e-abe1-5dcd147fb6f9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.566982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b5a5b535c92443bb84038b6a8e91eb5', 'request_id': 'req-4b82b145-e83c-475e-abe1-5dcd147fb6f9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.594756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] The token cache is being invalidate because project 1b5a5b535c92443bb84038b6a8e91eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:50.595077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.602212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.602212 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2826/5594] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:50 2022] DELETE /identity/v3/projects/1b5a5b535c92443bb84038b6a8e91eb5 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:50.606433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:50.607817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:50.662284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a7ca7-6710-4fdc-ba8f-423e1b5e13de None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:50.746485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f8e9f-1151-4748-88cd-e4e7c6e5b061 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:50.747254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8e9f-1151-4748-88cd-e4e7c6e5b061 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:50.748314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8e9f-1151-4748-88cd-e4e7c6e5b061 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:50.748314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f8e9f-1151-4748-88cd-e4e7c6e5b061 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:50.751055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-437f8e9f-1151-4748-88cd-e4e7c6e5b061 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:50.772029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82b145-e83c-475e-abe1-5dcd147fb6f9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:50.783609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:50.784456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:50.784735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:50.785002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] PATH_INFO: `/v3/users/7978c6e75ee14fa39f4cdaed47297775` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:50.789424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7978c6e75ee14fa39f4cdaed47297775)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:50.791378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:50.871950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f8e9f-1151-4748-88cd-e4e7c6e5b061 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:50.873867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f8e9f-1151-4748-88cd-e4e7c6e5b061 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:50.874143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7978c6e75ee14fa39f4cdaed47297775'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.884745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7978c6e75ee14fa39f4cdaed47297775'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.885625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7978c6e75ee14fa39f4cdaed47297775'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.886427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7978c6e75ee14fa39f4cdaed47297775'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.894713 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2769/5595] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:08:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:08:50.898153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-02f08982-0627-43ad-af6b-139c25772388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7978c6e75ee14fa39f4cdaed47297775'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:50.942111 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2827/5596] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:50 2022] DELETE /identity/v3/users/7978c6e75ee14fa39f4cdaed47297775 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:51.918381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f8e9f-1151-4748-88cd-e4e7c6e5b061 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:51.946685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f8e9f-1151-4748-88cd-e4e7c6e5b061 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:52.021516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:52.022564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.023008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.023417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] PATH_INFO: `/v3/projects/4f4971f74d97430990f6135a57d443dd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.026545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f4971f74d97430990f6135a57d443dd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:52.028858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:52.085089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f4971f74d97430990f6135a57d443dd', 'request_id': 'req-09905097-b6f3-4de8-8435-3a3037484168'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:52.095507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f4971f74d97430990f6135a57d443dd', 'request_id': 'req-09905097-b6f3-4de8-8435-3a3037484168'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:52.103032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f4971f74d97430990f6135a57d443dd', 'request_id': 'req-09905097-b6f3-4de8-8435-3a3037484168'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:52.120299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] The token cache is being invalidate because project 4f4971f74d97430990f6135a57d443dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:52.120860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:52.121541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-09905097-b6f3-4de8-8435-3a3037484168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:52.123414 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2770/5597] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:51 2022] DELETE /identity/v3/projects/4f4971f74d97430990f6135a57d443dd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:52.128759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99454d-93b3-4762-82cd-3c936ca4f994 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.129277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99454d-93b3-4762-82cd-3c936ca4f994 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.129849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99454d-93b3-4762-82cd-3c936ca4f994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.152528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cb99454d-93b3-4762-82cd-3c936ca4f994 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:52.153777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cb99454d-93b3-4762-82cd-3c936ca4f994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:52.216253 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2828/5598] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:52.225287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096748e-7323-470d-98c5-f9986bad53e0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.225625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096748e-7323-470d-98c5-f9986bad53e0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.226108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096748e-7323-470d-98c5-f9986bad53e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.246765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3096748e-7323-470d-98c5-f9986bad53e0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:52.248103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3096748e-7323-470d-98c5-f9986bad53e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:52.258850 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2771/5599] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:52.264722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99454d-93b3-4762-82cd-3c936ca4f994 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:52.281585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99454d-93b3-4762-82cd-3c936ca4f994 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:52.287622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08b841-a5c3-4fc3-afcf-293e01121c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:52.288351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b841-a5c3-4fc3-afcf-293e01121c7d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.288671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b841-a5c3-4fc3-afcf-293e01121c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.288973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b08b841-a5c3-4fc3-afcf-293e01121c7d admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.290090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08b841-a5c3-4fc3-afcf-293e01121c7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:52.290707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08b841-a5c3-4fc3-afcf-293e01121c7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:52.292519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b08b841-a5c3-4fc3-afcf-293e01121c7d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:52.307384 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2829/5600] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:52.312145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096748e-7323-470d-98c5-f9986bad53e0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:52.322681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096748e-7323-470d-98c5-f9986bad53e0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:52.330689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0abb8-c9dd-43b4-a002-ac479ab5b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:52.332012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0abb8-c9dd-43b4-a002-ac479ab5b908 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.332484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0abb8-c9dd-43b4-a002-ac479ab5b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.333582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0abb8-c9dd-43b4-a002-ac479ab5b908 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.334544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0abb8-c9dd-43b4-a002-ac479ab5b908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:52.336785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0abb8-c9dd-43b4-a002-ac479ab5b908 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:52.382460 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2772/5601] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:52 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:52.386582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08b841-a5c3-4fc3-afcf-293e01121c7d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:52.397798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b08b841-a5c3-4fc3-afcf-293e01121c7d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:52.464543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ca52-452b-402d-bcb7-3ec306a4e4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:52.465159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ca52-452b-402d-bcb7-3ec306a4e4ce admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.465682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ca52-452b-402d-bcb7-3ec306a4e4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.465819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1ca52-452b-402d-bcb7-3ec306a4e4ce admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.466416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1ca52-452b-402d-bcb7-3ec306a4e4ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:52.469196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd1ca52-452b-402d-bcb7-3ec306a4e4ce admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:52.495999 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2830/5602] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:52 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:52.501037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0abb8-c9dd-43b4-a002-ac479ab5b908 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:52.512653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0abb8-c9dd-43b4-a002-ac479ab5b908 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:52.520225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93531eb3-93fa-4cc9-b791-49f406d30ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:52.522531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93531eb3-93fa-4cc9-b791-49f406d30ecb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.522875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93531eb3-93fa-4cc9-b791-49f406d30ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.523186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93531eb3-93fa-4cc9-b791-49f406d30ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.524055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93531eb3-93fa-4cc9-b791-49f406d30ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:52.525747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93531eb3-93fa-4cc9-b791-49f406d30ecb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:52.541860 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2773/5603] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:52.543639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ca52-452b-402d-bcb7-3ec306a4e4ce admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:52.557880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1ca52-452b-402d-bcb7-3ec306a4e4ce admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:52.563120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24d05b-dc22-497a-b8af-0fd9ecd0790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:52.563779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24d05b-dc22-497a-b8af-0fd9ecd0790a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.564889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24d05b-dc22-497a-b8af-0fd9ecd0790a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.565304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24d05b-dc22-497a-b8af-0fd9ecd0790a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.566029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24d05b-dc22-497a-b8af-0fd9ecd0790a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:52.567731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24d05b-dc22-497a-b8af-0fd9ecd0790a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:52.579147 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2831/5604] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:52.584304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93531eb3-93fa-4cc9-b791-49f406d30ecb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:52.595474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93531eb3-93fa-4cc9-b791-49f406d30ecb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:52.602014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2fb34-487a-49c5-995d-5b6c1e36c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:52.603201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2fb34-487a-49c5-995d-5b6c1e36c15b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.603831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2fb34-487a-49c5-995d-5b6c1e36c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.604333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2fb34-487a-49c5-995d-5b6c1e36c15b admin admin] PATH_INFO: `/v3/projects/c9b9541fa06942a284369334e1068d48/users/851e42c6e6534107a18315523604c4c9/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.622354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2fb34-487a-49c5-995d-5b6c1e36c15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b9541fa06942a284369334e1068d48, user_id=851e42c6e6534107a18315523604c4c9, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:52.625235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2fb34-487a-49c5-995d-5b6c1e36c15b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:52.640271 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2774/5605] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:52 2022] PUT /identity/v3/projects/c9b9541fa06942a284369334e1068d48/users/851e42c6e6534107a18315523604c4c9/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:52.650950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727364cc-aea2-4ae8-bd7b-4d0ce1f065d8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.651246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727364cc-aea2-4ae8-bd7b-4d0ce1f065d8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.651532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727364cc-aea2-4ae8-bd7b-4d0ce1f065d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.688136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-727364cc-aea2-4ae8-bd7b-4d0ce1f065d8 None None] MFA Rules not processed for user `851e42c6e6534107a18315523604c4c9`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:52.692514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-727364cc-aea2-4ae8-bd7b-4d0ce1f065d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:52.713891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2fb34-487a-49c5-995d-5b6c1e36c15b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:52.715522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8ae2fb34-487a-49c5-995d-5b6c1e36c15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:52.776938 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2832/5606] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:52.781372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727364cc-aea2-4ae8-bd7b-4d0ce1f065d8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:52.810965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2fb34-487a-49c5-995d-5b6c1e36c15b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:52.816216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e74dc2-604d-43a8-b09b-2043f5577968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:52.816861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e74dc2-604d-43a8-b09b-2043f5577968 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.817215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e74dc2-604d-43a8-b09b-2043f5577968 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.817421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e74dc2-604d-43a8-b09b-2043f5577968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.819378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f3e74dc2-604d-43a8-b09b-2043f5577968 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:52.854633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727364cc-aea2-4ae8-bd7b-4d0ce1f065d8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:52.860066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b0f22-ac40-4274-a913-616477f64e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:52.860934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b0f22-ac40-4274-a913-616477f64e1e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:52.861254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b0f22-ac40-4274-a913-616477f64e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:52.861539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b0f22-ac40-4274-a913-616477f64e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:52.862222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b0f22-ac40-4274-a913-616477f64e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:52.867385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b0f22-ac40-4274-a913-616477f64e1e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:52.884296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e74dc2-604d-43a8-b09b-2043f5577968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:52.886055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e74dc2-604d-43a8-b09b-2043f5577968 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:52.897926 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2775/5607] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:08:52.901155 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2833/5608] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:52 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:52.901831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e74dc2-604d-43a8-b09b-2043f5577968 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:52.912626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e74dc2-604d-43a8-b09b-2043f5577968 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.003249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d0f2e-f2d9-4d1f-85ed-04f82a64222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.003861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d0f2e-f2d9-4d1f-85ed-04f82a64222a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.004208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d0f2e-f2d9-4d1f-85ed-04f82a64222a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.004491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d0f2e-f2d9-4d1f-85ed-04f82a64222a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.005190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d0f2e-f2d9-4d1f-85ed-04f82a64222a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.007465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d0f2e-f2d9-4d1f-85ed-04f82a64222a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.037889 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2776/5609] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:52 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:53.041377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b0f22-ac40-4274-a913-616477f64e1e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.053557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b0f22-ac40-4274-a913-616477f64e1e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.059773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536992f-66c9-4b56-8726-fedea34651e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.060989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536992f-66c9-4b56-8726-fedea34651e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.060989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536992f-66c9-4b56-8726-fedea34651e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.061472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536992f-66c9-4b56-8726-fedea34651e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.062275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536992f-66c9-4b56-8726-fedea34651e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.065355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536992f-66c9-4b56-8726-fedea34651e9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.081502 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2834/5610] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:08:53.085701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d0f2e-f2d9-4d1f-85ed-04f82a64222a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.097722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d0f2e-f2d9-4d1f-85ed-04f82a64222a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.103173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2d110-6f26-4742-a11c-bf693112e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.104148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2d110-6f26-4742-a11c-bf693112e4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.104444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2d110-6f26-4742-a11c-bf693112e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.105231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2d110-6f26-4742-a11c-bf693112e4f1 admin admin] PATH_INFO: `/v3/projects/f05bb10c7c1d4ee8b0d0007ba7f98f27/users/26df018b31fd434799e69fbd5ce238bd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.126686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2d110-6f26-4742-a11c-bf693112e4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05bb10c7c1d4ee8b0d0007ba7f98f27, user_id=26df018b31fd434799e69fbd5ce238bd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.130190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f2d110-6f26-4742-a11c-bf693112e4f1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.148108 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2777/5611] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:53 2022] PUT /identity/v3/projects/f05bb10c7c1d4ee8b0d0007ba7f98f27/users/26df018b31fd434799e69fbd5ce238bd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:53.150309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536992f-66c9-4b56-8726-fedea34651e9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.163815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536992f-66c9-4b56-8726-fedea34651e9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.191140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2d110-6f26-4742-a11c-bf693112e4f1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.193369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d7f2d110-6f26-4742-a11c-bf693112e4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:53.245209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89aa423-999a-455e-8ffa-8dba90f19502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.246338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89aa423-999a-455e-8ffa-8dba90f19502 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.246849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89aa423-999a-455e-8ffa-8dba90f19502 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.247314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89aa423-999a-455e-8ffa-8dba90f19502 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.248346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89aa423-999a-455e-8ffa-8dba90f19502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.250995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89aa423-999a-455e-8ffa-8dba90f19502 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.265007 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2835/5612] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:53.269169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89aa423-999a-455e-8ffa-8dba90f19502 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.281362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89aa423-999a-455e-8ffa-8dba90f19502 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.281524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f2d110-6f26-4742-a11c-bf693112e4f1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.288476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41760f5a-a09f-47b7-a98c-a26cb43bc4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.289853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41760f5a-a09f-47b7-a98c-a26cb43bc4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.290155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.290588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41760f5a-a09f-47b7-a98c-a26cb43bc4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.291250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41760f5a-a09f-47b7-a98c-a26cb43bc4f1 admin admin] PATH_INFO: `/v3/projects/f05bb10c7c1d4ee8b0d0007ba7f98f27/users/26df018b31fd434799e69fbd5ce238bd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.291612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.291911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.292292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] PATH_INFO: `/v3/users/8ed8d3c39e1043a995c8ff6e116a2944` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.293902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed8d3c39e1043a995c8ff6e116a2944)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.294108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41760f5a-a09f-47b7-a98c-a26cb43bc4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f05bb10c7c1d4ee8b0d0007ba7f98f27, user_id=26df018b31fd434799e69fbd5ce238bd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.295966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.297264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41760f5a-a09f-47b7-a98c-a26cb43bc4f1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.316590 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2836/5613] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:53 2022] PUT /identity/v3/projects/f05bb10c7c1d4ee8b0d0007ba7f98f27/users/26df018b31fd434799e69fbd5ce238bd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:53.334077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8a46d-c278-4fa6-b778-c8bca74a2770 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.334376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8a46d-c278-4fa6-b778-c8bca74a2770 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.334662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8a46d-c278-4fa6-b778-c8bca74a2770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.368699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-10d8a46d-c278-4fa6-b778-c8bca74a2770 None None] MFA Rules not processed for user `26df018b31fd434799e69fbd5ce238bd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:53.370240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-10d8a46d-c278-4fa6-b778-c8bca74a2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:53.370885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed8d3c39e1043a995c8ff6e116a2944'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.382759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed8d3c39e1043a995c8ff6e116a2944'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.383521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed8d3c39e1043a995c8ff6e116a2944'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.384304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed8d3c39e1043a995c8ff6e116a2944'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.415558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8a29a920-4e75-4ae5-97a5-1a1a5218bd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed8d3c39e1043a995c8ff6e116a2944'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.434688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2778/5614] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:53 2022] DELETE /identity/v3/users/8ed8d3c39e1043a995c8ff6e116a2944 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:53.439669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2f913-5840-41bb-a23b-4887e3e0e820 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.440181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2f913-5840-41bb-a23b-4887e3e0e820 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.441474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2f913-5840-41bb-a23b-4887e3e0e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.474403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b9b2f913-5840-41bb-a23b-4887e3e0e820 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:53.475636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b9b2f913-5840-41bb-a23b-4887e3e0e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:53.529127 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2837/5615] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:53.529995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8a46d-c278-4fa6-b778-c8bca74a2770 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.531338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-10d8a46d-c278-4fa6-b778-c8bca74a2770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:53.558731 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2779/5616] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:53.559638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2f913-5840-41bb-a23b-4887e3e0e820 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.641724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8a46d-c278-4fa6-b778-c8bca74a2770 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.644356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2f913-5840-41bb-a23b-4887e3e0e820 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.648746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.649620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.649894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.650155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] PATH_INFO: `/v3/users/f265820a8b974837949e9e3f36b58858` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.651395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f265820a8b974837949e9e3f36b58858)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.653427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.654456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ed7b9-bea9-4af6-9adc-b5284f887143 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.655202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ed7b9-bea9-4af6-9adc-b5284f887143 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.655412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ed7b9-bea9-4af6-9adc-b5284f887143 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.655767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ed7b9-bea9-4af6-9adc-b5284f887143 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.656501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ed7b9-bea9-4af6-9adc-b5284f887143 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.658156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ed7b9-bea9-4af6-9adc-b5284f887143 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.678222 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2780/5617] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:08:53 2022] POST /identity/v3/domains => generated 276 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:53.678222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ed7b9-bea9-4af6-9adc-b5284f887143 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.681011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ed0ed7b9-bea9-4af6-9adc-b5284f887143 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:53.709801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f265820a8b974837949e9e3f36b58858'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.719022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f265820a8b974837949e9e3f36b58858'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.719826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f265820a8b974837949e9e3f36b58858'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.720716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f265820a8b974837949e9e3f36b58858'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.733149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f265820a8b974837949e9e3f36b58858'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:53.754873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ed7b9-bea9-4af6-9adc-b5284f887143 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.759608 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2838/5618] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:53 2022] DELETE /identity/v3/users/f265820a8b974837949e9e3f36b58858 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:53.760089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbe323-3a37-4f9f-a4f6-9f9444534c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.761875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbe323-3a37-4f9f-a4f6-9f9444534c0c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.762405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbe323-3a37-4f9f-a4f6-9f9444534c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.762824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbe323-3a37-4f9f-a4f6-9f9444534c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.764223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.765409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2cbbe323-3a37-4f9f-a4f6-9f9444534c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:53.765580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:53.848457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbe323-3a37-4f9f-a4f6-9f9444534c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.850231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbbe323-3a37-4f9f-a4f6-9f9444534c0c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.856884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12229ac0-2669-4675-a0a4-fb5576db05d0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.861687 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2781/5619] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:53.862783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2616335-b5f3-47ab-ace7-dc57f27c8777 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.863655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2616335-b5f3-47ab-ace7-dc57f27c8777 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.863869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2616335-b5f3-47ab-ace7-dc57f27c8777 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.864182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2616335-b5f3-47ab-ace7-dc57f27c8777 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.864947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2616335-b5f3-47ab-ace7-dc57f27c8777 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:53.867017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2616335-b5f3-47ab-ace7-dc57f27c8777 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:53.902098 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2839/5620] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:53 2022] POST /identity/v3/users => generated 347 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:53.905856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbe323-3a37-4f9f-a4f6-9f9444534c0c service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:53.989126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbe323-3a37-4f9f-a4f6-9f9444534c0c service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:53.995910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f931f-5630-404b-ad14-2b141c124a32 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:53.996811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f931f-5630-404b-ad14-2b141c124a32 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:53.997225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f931f-5630-404b-ad14-2b141c124a32 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:53.997564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f931f-5630-404b-ad14-2b141c124a32 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:53.998354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f931f-5630-404b-ad14-2b141c124a32 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.000569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f931f-5630-404b-ad14-2b141c124a32 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.040348 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2782/5621] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:53 2022] POST /identity/v3/users => generated 323 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:54.046440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2616335-b5f3-47ab-ace7-dc57f27c8777 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.054431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f931f-5630-404b-ad14-2b141c124a32 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.056879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5e3f931f-5630-404b-ad14-2b141c124a32 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.060497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2616335-b5f3-47ab-ace7-dc57f27c8777 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.069986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3827621-63c8-47e6-a461-add775f8702b tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.071897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3827621-63c8-47e6-a461-add775f8702b tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.072215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3827621-63c8-47e6-a461-add775f8702b tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.072497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3827621-63c8-47e6-a461-add775f8702b tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/users/bc848fed9ef44682bab5b26dd740ff70` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.109124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3827621-63c8-47e6-a461-add775f8702b tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:get_user(user_id=bc848fed9ef44682bab5b26dd740ff70)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.114285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3827621-63c8-47e6-a461-add775f8702b tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.135215 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2840/5622] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:08:54 2022] GET /identity/v3/users/bc848fed9ef44682bab5b26dd740ff70 => generated 347 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:54.137052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3827621-63c8-47e6-a461-add775f8702b tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.140733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f931f-5630-404b-ad14-2b141c124a32 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.146826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.148061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.148061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.148273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] PATH_INFO: `/v3/projects/614df0ac05da469a932c527c1d5c0a12` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.149509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=614df0ac05da469a932c527c1d5c0a12)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.151788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.163951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3827621-63c8-47e6-a461-add775f8702b tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.184150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.185700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.187326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.188265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.190219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Adding query filter params (domain_id=ef78b6d7a89d4838926ecf066a384b99) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:54.190782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.192890 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:54.192890 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:08:54.192890 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:08:54.194238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.211104 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2841/5623] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Mar 26 21:08:54 2022] GET /identity/v3/users?domain_id=ef78b6d7a89d4838926ecf066a384b99 => generated 484 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:54.216254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.227158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf72c5-e200-4821-bf40-c0a56c2ad7e7 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.229931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614df0ac05da469a932c527c1d5c0a12', 'request_id': 'req-da39d991-785b-48dd-9ec6-73dd6badbdf8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.241448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614df0ac05da469a932c527c1d5c0a12', 'request_id': 'req-da39d991-785b-48dd-9ec6-73dd6badbdf8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.260008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614df0ac05da469a932c527c1d5c0a12', 'request_id': 'req-da39d991-785b-48dd-9ec6-73dd6badbdf8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.284742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] The token cache is being invalidate because project 614df0ac05da469a932c527c1d5c0a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:54.285366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.286503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da39d991-785b-48dd-9ec6-73dd6badbdf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.292815 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2783/5624] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:54 2022] DELETE /identity/v3/projects/614df0ac05da469a932c527c1d5c0a12 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:54.295280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb32e90-c14a-4e78-91cb-6917dffd622a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.295649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb32e90-c14a-4e78-91cb-6917dffd622a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.296137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb32e90-c14a-4e78-91cb-6917dffd622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.309167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781730aa-d34e-4ca5-998a-a088189fbd81 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.310330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781730aa-d34e-4ca5-998a-a088189fbd81 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.310904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781730aa-d34e-4ca5-998a-a088189fbd81 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.312728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781730aa-d34e-4ca5-998a-a088189fbd81 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.313247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781730aa-d34e-4ca5-998a-a088189fbd81 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.317054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781730aa-d34e-4ca5-998a-a088189fbd81 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.322063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6fb32e90-c14a-4e78-91cb-6917dffd622a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:54.323357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6fb32e90-c14a-4e78-91cb-6917dffd622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.359109 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2842/5625] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:54 2022] GET /identity/v3/users => generated 8326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:54.364672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781730aa-d34e-4ca5-998a-a088189fbd81 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.366996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-781730aa-d34e-4ca5-998a-a088189fbd81 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.381450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781730aa-d34e-4ca5-998a-a088189fbd81 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.386490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.387221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.387612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.388188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.389079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Adding query filter params (name=tempest-test_user-877790383) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:54.389468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.391748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.409612 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2843/5626] 10.222.0.16 () {58 vars in 1186 bytes} [Sat Mar 26 21:08:54 2022] GET /identity/v3/users?name=tempest-test_user-877790383 => generated 474 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:54.410498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.412166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.416474 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2784/5627] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:08:54.419904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb32e90-c14a-4e78-91cb-6917dffd622a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.428601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3975954-d3cb-484a-a25d-223bc30cc787 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.430651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb32e90-c14a-4e78-91cb-6917dffd622a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.433244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.434094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.434490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.434813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] PATH_INFO: `/v3/projects/7283f04bcbb04e179915e4b52786ee15` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.436342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7283f04bcbb04e179915e4b52786ee15)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.437893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481dee0-b2c2-46c6-b4d3-21a225ca34cb tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.438034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.438747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481dee0-b2c2-46c6-b4d3-21a225ca34cb tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.440139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481dee0-b2c2-46c6-b4d3-21a225ca34cb tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.440612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481dee0-b2c2-46c6-b4d3-21a225ca34cb tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.441842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481dee0-b2c2-46c6-b4d3-21a225ca34cb tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:54.442270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481dee0-b2c2-46c6-b4d3-21a225ca34cb tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.443523 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-8481dee0-b2c2-46c6-b4d3-21a225ca34cb tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:08:54.443523 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:08:54.443523 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:08:54.445229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481dee0-b2c2-46c6-b4d3-21a225ca34cb tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.473348 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2785/5628] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 21:08:54 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:54.473348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaaecd-8c43-4585-bfa6-b152a6eba81b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.473348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaaecd-8c43-4585-bfa6-b152a6eba81b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.473348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babaaecd-8c43-4585-bfa6-b152a6eba81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.491719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-babaaecd-8c43-4585-bfa6-b152a6eba81b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:54.492966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-babaaecd-8c43-4585-bfa6-b152a6eba81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.494287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7283f04bcbb04e179915e4b52786ee15', 'request_id': 'req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.504431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7283f04bcbb04e179915e4b52786ee15', 'request_id': 'req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.510175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7283f04bcbb04e179915e4b52786ee15', 'request_id': 'req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.521884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] The token cache is being invalidate because project 7283f04bcbb04e179915e4b52786ee15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:54.522175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.523135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.527590 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2844/5629] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:54 2022] DELETE /identity/v3/projects/7283f04bcbb04e179915e4b52786ee15 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:54.528498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.530940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.567425 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2786/5630] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:54.567863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaaecd-8c43-4585-bfa6-b152a6eba81b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.569195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-babaaecd-8c43-4585-bfa6-b152a6eba81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.583109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babaaecd-8c43-4585-bfa6-b152a6eba81b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.587835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.588733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.589452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.589452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] PATH_INFO: `/v3/users/1543460762424c789b88f146cd22df17` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.590495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1543460762424c789b88f146cd22df17)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.593211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.616303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec01b4f-69d4-4814-a3a0-2c2ef86569a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.622336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.623302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.623585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.623859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/users/da6bd54a4cc449a585c2b0bdd05e1bf0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.643235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:delete_user(user_id=da6bd54a4cc449a585c2b0bdd05e1bf0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.645585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.651628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1543460762424c789b88f146cd22df17'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.672035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1543460762424c789b88f146cd22df17'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.672788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1543460762424c789b88f146cd22df17'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.674492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1543460762424c789b88f146cd22df17'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.694863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1543460762424c789b88f146cd22df17'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.714163 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2787/5631] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:54 2022] DELETE /identity/v3/users/1543460762424c789b88f146cd22df17 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:54.714163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.714446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.720727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6bd54a4cc449a585c2b0bdd05e1bf0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.728744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6bd54a4cc449a585c2b0bdd05e1bf0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.729471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6bd54a4cc449a585c2b0bdd05e1bf0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.732553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6bd54a4cc449a585c2b0bdd05e1bf0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.743536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6bd54a4cc449a585c2b0bdd05e1bf0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:54.805261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be410b1-85e9-451a-b881-12e85f202f50 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.812510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2845/5632] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:54 2022] DELETE /identity/v3/users/da6bd54a4cc449a585c2b0bdd05e1bf0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:54.813606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.815724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.816720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.817703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.818085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.819610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:54.820531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.823115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.825372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.854305 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2788/5633] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:54.859640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:54.870897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:54.890989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06f79b-208d-4a3c-ad53-477fe6e32771 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.967614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a9fc5-70c7-4951-a31d-19c5856e4edc tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:54.973793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.974984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.975284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.975583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/users/bc848fed9ef44682bab5b26dd740ff70` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.977204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:delete_user(user_id=bc848fed9ef44682bab5b26dd740ff70)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.979421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:54.983850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d25c1-2bf1-46a7-b0b8-4bf5c8f84b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:54.985108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d25c1-2bf1-46a7-b0b8-4bf5c8f84b9d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:54.985779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d25c1-2bf1-46a7-b0b8-4bf5c8f84b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:54.987723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d25c1-2bf1-46a7-b0b8-4bf5c8f84b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:54.988831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d25c1-2bf1-46a7-b0b8-4bf5c8f84b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:54.991212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d25c1-2bf1-46a7-b0b8-4bf5c8f84b9d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.051651 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2789/5634] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:54 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:55.052308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc848fed9ef44682bab5b26dd740ff70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.053840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d25c1-2bf1-46a7-b0b8-4bf5c8f84b9d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.071777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc848fed9ef44682bab5b26dd740ff70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.072644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc848fed9ef44682bab5b26dd740ff70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.073305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc848fed9ef44682bab5b26dd740ff70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.100689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc848fed9ef44682bab5b26dd740ff70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.131168 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2846/5635] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:54 2022] DELETE /identity/v3/users/bc848fed9ef44682bab5b26dd740ff70 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:55.132234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.136253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.162949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d25c1-2bf1-46a7-b0b8-4bf5c8f84b9d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.214543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87fdf9-27fa-455e-9bb5-b38915fd02d1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.220320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.222157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.222371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.222652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/domains/ef78b6d7a89d4838926ecf066a384b99` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.229211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ef78b6d7a89d4838926ecf066a384b99)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:55.231818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.247115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b873-57bc-400c-9fda-7eab6ac0e9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.247997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b873-57bc-400c-9fda-7eab6ac0e9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.248384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b873-57bc-400c-9fda-7eab6ac0e9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.248810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16b873-57bc-400c-9fda-7eab6ac0e9d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.249634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16b873-57bc-400c-9fda-7eab6ac0e9d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:55.251826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16b873-57bc-400c-9fda-7eab6ac0e9d8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.257428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.258464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.273772 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2790/5636] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:55 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:55.274830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b873-57bc-400c-9fda-7eab6ac0e9d8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.276506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3f16b873-57bc-400c-9fda-7eab6ac0e9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.291482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16b873-57bc-400c-9fda-7eab6ac0e9d8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.295381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.296134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.299550 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2847/5637] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:08:55 2022] PATCH /identity/v3/domains/ef78b6d7a89d4838926ecf066a384b99 => generated 277 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:08:55.301242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.303388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.378726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.379722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.380052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.380407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] PATH_INFO: `/v3/projects/db79be3c900c49909c969c1d96fb747c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.381620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db79be3c900c49909c969c1d96fb747c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:55.383650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.390340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df54f4-ede7-401d-b39f-67e6e43c4142 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.396497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d846c-45c2-445d-bca3-25936d12bfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.397061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d846c-45c2-445d-bca3-25936d12bfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.397344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d846c-45c2-445d-bca3-25936d12bfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.397615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d846c-45c2-445d-bca3-25936d12bfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.398332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d846c-45c2-445d-bca3-25936d12bfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:55.400013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d846c-45c2-445d-bca3-25936d12bfd2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.412282 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2848/5638] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:55.413228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d846c-45c2-445d-bca3-25936d12bfd2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.418848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-861d846c-45c2-445d-bca3-25936d12bfd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.442601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db79be3c900c49909c969c1d96fb747c', 'request_id': 'req-42d36bee-ffa4-4c21-98a6-9c28b4628701'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.453761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db79be3c900c49909c969c1d96fb747c', 'request_id': 'req-42d36bee-ffa4-4c21-98a6-9c28b4628701'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.463547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db79be3c900c49909c969c1d96fb747c', 'request_id': 'req-42d36bee-ffa4-4c21-98a6-9c28b4628701'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.482777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] The token cache is being invalidate because project db79be3c900c49909c969c1d96fb747c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:55.483210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.483998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.485912 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2791/5639] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:55 2022] DELETE /identity/v3/projects/db79be3c900c49909c969c1d96fb747c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:55.486629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.488043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.493450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d846c-45c2-445d-bca3-25936d12bfd2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.549297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26df018b31fd434799e69fbd5ce238bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.550159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.550445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.550730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] PATH_INFO: `/v3/domains/ef78b6d7a89d4838926ecf066a384b99` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.552444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36bee-ffa4-4c21-98a6-9c28b4628701 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.557312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fdaf4-f227-4a0b-b9be-09f9e74593a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.557964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fdaf4-f227-4a0b-b9be-09f9e74593a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.558253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fdaf4-f227-4a0b-b9be-09f9e74593a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.558528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fdaf4-f227-4a0b-b9be-09f9e74593a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.559241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fdaf4-f227-4a0b-b9be-09f9e74593a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:55.560904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93fdaf4-f227-4a0b-b9be-09f9e74593a8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.561246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ef78b6d7a89d4838926ecf066a384b99)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:55.562848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.571759 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2792/5640] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:55.572806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fdaf4-f227-4a0b-b9be-09f9e74593a8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.574505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b93fdaf4-f227-4a0b-b9be-09f9e74593a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.586331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.587701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fdaf4-f227-4a0b-b9be-09f9e74593a8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.589576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.592614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.593447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.593733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.594006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] PATH_INFO: `/v3/users/800a379a2a9a40a4b66109740909874f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.595281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800a379a2a9a40a4b66109740909874f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:55.597285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.635460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99', 'request_id': 'req-ed04fc40-687a-4d2a-965b-ca924678f0a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.643150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800a379a2a9a40a4b66109740909874f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.643288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99', 'request_id': 'req-ed04fc40-687a-4d2a-965b-ca924678f0a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.649232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99', 'request_id': 'req-ed04fc40-687a-4d2a-965b-ca924678f0a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.650043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800a379a2a9a40a4b66109740909874f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.650641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800a379a2a9a40a4b66109740909874f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.651259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800a379a2a9a40a4b66109740909874f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.660917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] The token cache is being invalidate because project ef78b6d7a89d4838926ecf066a384b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:55.661219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.661860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.663217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ec150d09-c13d-4555-b702-5a1c86da5755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800a379a2a9a40a4b66109740909874f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.669248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99', 'request_id': 'req-ed04fc40-687a-4d2a-965b-ca924678f0a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.669918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99', 'request_id': 'req-ed04fc40-687a-4d2a-965b-ca924678f0a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.670681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ef78b6d7a89d4838926ecf066a384b99', 'request_id': 'req-ed04fc40-687a-4d2a-965b-ca924678f0a1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.675498 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2793/5641] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:55 2022] DELETE /identity/v3/users/800a379a2a9a40a4b66109740909874f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:55.676793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44936eb-456b-4097-8292-461ba5f07ee2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.677070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44936eb-456b-4097-8292-461ba5f07ee2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.677359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44936eb-456b-4097-8292-461ba5f07ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.678783 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2849/5642] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:08:55 2022] DELETE /identity/v3/domains/ef78b6d7a89d4838926ecf066a384b99 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:55.681717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.681717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.696584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e44936eb-456b-4097-8292-461ba5f07ee2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:55.697585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e44936eb-456b-4097-8292-461ba5f07ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.746378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04fc40-687a-4d2a-965b-ca924678f0a1 tempest-UsersV3TestJSON-886671558 tempest-UsersV3TestJSON-886671558-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.755976 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2794/5643] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:55.757368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303cdad-d439-4d38-8718-a4a9360c6e18 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.757659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303cdad-d439-4d38-8718-a4a9360c6e18 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.758212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303cdad-d439-4d38-8718-a4a9360c6e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.776874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b303cdad-d439-4d38-8718-a4a9360c6e18 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:55.778117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b303cdad-d439-4d38-8718-a4a9360c6e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.786152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2795/5644] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:55.786947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303cdad-d439-4d38-8718-a4a9360c6e18 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.793133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b303cdad-d439-4d38-8718-a4a9360c6e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.801802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b687d4-f999-436a-a281-d3bca1192c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.802681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b687d4-f999-436a-a281-d3bca1192c17 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.802964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b687d4-f999-436a-a281-d3bca1192c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.803236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b687d4-f999-436a-a281-d3bca1192c17 admin admin] PATH_INFO: `/v3/projects/a821ba46f3f5408ab82098a1d2d8a926/users/dd05073d7e52411c92d7b9def363dd50/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.805183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303cdad-d439-4d38-8718-a4a9360c6e18 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.809814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.810663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.810947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.811227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] PATH_INFO: `/v3/users/851e42c6e6534107a18315523604c4c9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.812453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851e42c6e6534107a18315523604c4c9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:55.815184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.819301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b687d4-f999-436a-a281-d3bca1192c17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a821ba46f3f5408ab82098a1d2d8a926, user_id=dd05073d7e52411c92d7b9def363dd50, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:55.822009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b687d4-f999-436a-a281-d3bca1192c17 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:55.835969 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2850/5645] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:55 2022] PUT /identity/v3/projects/a821ba46f3f5408ab82098a1d2d8a926/users/dd05073d7e52411c92d7b9def363dd50/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:55.837048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758057f-81de-45f5-bd69-00557ad301ac None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.837339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758057f-81de-45f5-bd69-00557ad301ac None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.837622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758057f-81de-45f5-bd69-00557ad301ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.855972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7758057f-81de-45f5-bd69-00557ad301ac None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:55.857187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7758057f-81de-45f5-bd69-00557ad301ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.862018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851e42c6e6534107a18315523604c4c9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.869458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851e42c6e6534107a18315523604c4c9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.870140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851e42c6e6534107a18315523604c4c9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.870760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851e42c6e6534107a18315523604c4c9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.885115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851e42c6e6534107a18315523604c4c9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:55.898236 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2796/5646] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:55 2022] DELETE /identity/v3/users/851e42c6e6534107a18315523604c4c9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:55.901306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:55.901306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.918436 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2851/5647] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:55.919545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be8d03-fcb3-400d-831c-625fc037aa0d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.919833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be8d03-fcb3-400d-831c-625fc037aa0d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.920146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be8d03-fcb3-400d-831c-625fc037aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.938257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-34be8d03-fcb3-400d-831c-625fc037aa0d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:55.940334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-34be8d03-fcb3-400d-831c-625fc037aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:55.963284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382150f-4a25-4c83-9ecf-caf8423677c6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:55.967178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec328bd-9731-47b8-9bde-4a614056d08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:55.967864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec328bd-9731-47b8-9bde-4a614056d08d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:55.968167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec328bd-9731-47b8-9bde-4a614056d08d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:55.968438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec328bd-9731-47b8-9bde-4a614056d08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:55.970351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fec328bd-9731-47b8-9bde-4a614056d08d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:56.008115 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2852/5648] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:56.011237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10cfb2-bf41-44f3-a1ee-2a4db8073007 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.011237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10cfb2-bf41-44f3-a1ee-2a4db8073007 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.011237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10cfb2-bf41-44f3-a1ee-2a4db8073007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.032407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7d10cfb2-bf41-44f3-a1ee-2a4db8073007 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:56.033757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7d10cfb2-bf41-44f3-a1ee-2a4db8073007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:56.042599 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2853/5649] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:56.044887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10cfb2-bf41-44f3-a1ee-2a4db8073007 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.055512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec328bd-9731-47b8-9bde-4a614056d08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.057222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec328bd-9731-47b8-9bde-4a614056d08d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.059055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10cfb2-bf41-44f3-a1ee-2a4db8073007 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.065633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.066538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.066893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.067240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.068086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:56.068640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.070855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.080344 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2797/5650] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:56.081732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec328bd-9731-47b8-9bde-4a614056d08d service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.086143 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2854/5651] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:56.087437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.089433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:56.093932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec328bd-9731-47b8-9bde-4a614056d08d service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.099084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d923ea8-c25c-45db-b976-dd9c8fcdf064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.099756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d923ea8-c25c-45db-b976-dd9c8fcdf064 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.100108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d923ea8-c25c-45db-b976-dd9c8fcdf064 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.100397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d923ea8-c25c-45db-b976-dd9c8fcdf064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.106034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2182fa3f-00db-489b-bc0f-95330ad021d7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.110685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31a02-de68-4a80-a696-0d4f9dec583d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.112419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31a02-de68-4a80-a696-0d4f9dec583d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.112560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d923ea8-c25c-45db-b976-dd9c8fcdf064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.112833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31a02-de68-4a80-a696-0d4f9dec583d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.113175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c31a02-de68-4a80-a696-0d4f9dec583d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.114113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d923ea8-c25c-45db-b976-dd9c8fcdf064 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.126438 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2798/5652] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:56.128230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d923ea8-c25c-45db-b976-dd9c8fcdf064 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.128647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31a02-de68-4a80-a696-0d4f9dec583d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.130404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c31a02-de68-4a80-a696-0d4f9dec583d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.141834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d923ea8-c25c-45db-b976-dd9c8fcdf064 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.142096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2855/5653] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:56.150302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32802f-dc59-4279-b6ab-a2e15e808536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.151000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32802f-dc59-4279-b6ab-a2e15e808536 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.151409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32802f-dc59-4279-b6ab-a2e15e808536 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.152052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32802f-dc59-4279-b6ab-a2e15e808536 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.153073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32802f-dc59-4279-b6ab-a2e15e808536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.155369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32802f-dc59-4279-b6ab-a2e15e808536 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.196706 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2799/5654] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:56 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:56.201117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31a02-de68-4a80-a696-0d4f9dec583d service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.218802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c31a02-de68-4a80-a696-0d4f9dec583d service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.289843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896756f1-d904-4edb-85c6-0c03caab3134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.290607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896756f1-d904-4edb-85c6-0c03caab3134 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.291353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896756f1-d904-4edb-85c6-0c03caab3134 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.291353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896756f1-d904-4edb-85c6-0c03caab3134 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.292179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896756f1-d904-4edb-85c6-0c03caab3134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.294265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896756f1-d904-4edb-85c6-0c03caab3134 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.327862 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2856/5655] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:56 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:56.330458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32802f-dc59-4279-b6ab-a2e15e808536 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.342286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32802f-dc59-4279-b6ab-a2e15e808536 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.347573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1eac6-e778-4a7d-993c-2b8ed7d0b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.348328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1eac6-e778-4a7d-993c-2b8ed7d0b43e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.348618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1eac6-e778-4a7d-993c-2b8ed7d0b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.349024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1eac6-e778-4a7d-993c-2b8ed7d0b43e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.349902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1eac6-e778-4a7d-993c-2b8ed7d0b43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.351637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1eac6-e778-4a7d-993c-2b8ed7d0b43e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.366864 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2800/5656] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:08:56.368553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896756f1-d904-4edb-85c6-0c03caab3134 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.380967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896756f1-d904-4edb-85c6-0c03caab3134 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.385959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873ca5-39ab-496a-bf64-54ba2f3aa7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.386848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873ca5-39ab-496a-bf64-54ba2f3aa7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.388022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873ca5-39ab-496a-bf64-54ba2f3aa7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.388022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873ca5-39ab-496a-bf64-54ba2f3aa7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.388219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6873ca5-39ab-496a-bf64-54ba2f3aa7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.389755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6873ca5-39ab-496a-bf64-54ba2f3aa7e7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.404079 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2857/5657] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:56.406069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1eac6-e778-4a7d-993c-2b8ed7d0b43e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.421823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1eac6-e778-4a7d-993c-2b8ed7d0b43e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.428046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e8ae3d-d812-4eb0-94f0-54cafb7dfa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.429177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8ae3d-d812-4eb0-94f0-54cafb7dfa23 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.429568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8ae3d-d812-4eb0-94f0-54cafb7dfa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.429948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8ae3d-d812-4eb0-94f0-54cafb7dfa23 admin admin] PATH_INFO: `/v3/projects/de8e9fac6cd148c5a144cbe642648a31/users/e99d6eb023bd45aea7f232e3a2946cad/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.447618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8ae3d-d812-4eb0-94f0-54cafb7dfa23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de8e9fac6cd148c5a144cbe642648a31, user_id=e99d6eb023bd45aea7f232e3a2946cad, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.450604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e8ae3d-d812-4eb0-94f0-54cafb7dfa23 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.468916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873ca5-39ab-496a-bf64-54ba2f3aa7e7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.474898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e6873ca5-39ab-496a-bf64-54ba2f3aa7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:56.503014 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2801/5658] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:56 2022] PUT /identity/v3/projects/de8e9fac6cd148c5a144cbe642648a31/users/e99d6eb023bd45aea7f232e3a2946cad/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:56.506724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ee84e-3a15-4bbf-be55-a4a83060cea4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.508348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ee84e-3a15-4bbf-be55-a4a83060cea4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.509350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ee84e-3a15-4bbf-be55-a4a83060cea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.509855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873ca5-39ab-496a-bf64-54ba2f3aa7e7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.575617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-743ee84e-3a15-4bbf-be55-a4a83060cea4 None None] MFA Rules not processed for user `e99d6eb023bd45aea7f232e3a2946cad`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:56.577105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-743ee84e-3a15-4bbf-be55-a4a83060cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:56.624607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.625582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.628029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.629359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] PATH_INFO: `/v3/projects/c9b9541fa06942a284369334e1068d48` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.632418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b9541fa06942a284369334e1068d48)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.638429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:56.744144 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2802/5659] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:56.757152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ee84e-3a15-4bbf-be55-a4a83060cea4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.758322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b9541fa06942a284369334e1068d48', 'request_id': 'req-75cbd31f-a229-4213-9418-737c95f46023'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:56.758889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-743ee84e-3a15-4bbf-be55-a4a83060cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:56.786414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b9541fa06942a284369334e1068d48', 'request_id': 'req-75cbd31f-a229-4213-9418-737c95f46023'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:56.798824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b9541fa06942a284369334e1068d48', 'request_id': 'req-75cbd31f-a229-4213-9418-737c95f46023'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:56.815419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] The token cache is being invalidate because project c9b9541fa06942a284369334e1068d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:56.815985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:56.817366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:56.819511 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2858/5660] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:56 2022] DELETE /identity/v3/projects/c9b9541fa06942a284369334e1068d48 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:56.820608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:56.823909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:56.903630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ee84e-3a15-4bbf-be55-a4a83060cea4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.961868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbd31f-a229-4213-9418-737c95f46023 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:56.968621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:56.969534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:56.970089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:56.970374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] PATH_INFO: `/v3/projects/3b9c6849aa874b98b765ddbee781dadb` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:56.972593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9c6849aa874b98b765ddbee781dadb)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:56.974754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:57.006154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b408c45-0c1d-4de6-9b22-4990a2df545e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:57.006856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b408c45-0c1d-4de6-9b22-4990a2df545e service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:57.007696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b408c45-0c1d-4de6-9b22-4990a2df545e service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:57.007696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b408c45-0c1d-4de6-9b22-4990a2df545e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:57.009680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9b408c45-0c1d-4de6-9b22-4990a2df545e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:57.049422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9c6849aa874b98b765ddbee781dadb', 'request_id': 'req-cdc35439-2d62-4538-89d8-fab8dc00fe71'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.061158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9c6849aa874b98b765ddbee781dadb', 'request_id': 'req-cdc35439-2d62-4538-89d8-fab8dc00fe71'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.077037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9c6849aa874b98b765ddbee781dadb', 'request_id': 'req-cdc35439-2d62-4538-89d8-fab8dc00fe71'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.092804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] The token cache is being invalidate because project 3b9c6849aa874b98b765ddbee781dadb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:57.093098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.093783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.098254 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2859/5661] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:56 2022] DELETE /identity/v3/projects/3b9c6849aa874b98b765ddbee781dadb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:57.098254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:57.098858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:57.112648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b408c45-0c1d-4de6-9b22-4990a2df545e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:57.114762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b408c45-0c1d-4de6-9b22-4990a2df545e service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:57.127979 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2803/5662] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:08:57.130470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b408c45-0c1d-4de6-9b22-4990a2df545e service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:57.143537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b408c45-0c1d-4de6-9b22-4990a2df545e service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:57.192559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc35439-2d62-4538-89d8-fab8dc00fe71 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:57.198668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:57.199557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:57.199842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:57.200145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] PATH_INFO: `/v3/users/26df018b31fd434799e69fbd5ce238bd` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:57.202297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26df018b31fd434799e69fbd5ce238bd)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:57.204165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:57.220407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:57.222202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:57.222735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:57.223165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] PATH_INFO: `/v3/users/56dca9e8a3f54fe2bb45a01720065792` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:57.225118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dca9e8a3f54fe2bb45a01720065792)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:57.227318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:57.270465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26df018b31fd434799e69fbd5ce238bd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.278676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26df018b31fd434799e69fbd5ce238bd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.279429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26df018b31fd434799e69fbd5ce238bd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.280270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26df018b31fd434799e69fbd5ce238bd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.289250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26df018b31fd434799e69fbd5ce238bd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.300068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dca9e8a3f54fe2bb45a01720065792'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.311011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dca9e8a3f54fe2bb45a01720065792'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.312330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dca9e8a3f54fe2bb45a01720065792'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.313282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dca9e8a3f54fe2bb45a01720065792'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.316239 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2860/5663] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:57 2022] DELETE /identity/v3/users/26df018b31fd434799e69fbd5ce238bd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:57.332079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e25a131-4546-45b1-b267-9e2566d530ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dca9e8a3f54fe2bb45a01720065792'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.353732 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2804/5664] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:57 2022] DELETE /identity/v3/users/56dca9e8a3f54fe2bb45a01720065792 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:57.690520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:57.692313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:57.793309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac66f8b-e7a8-4c2f-b24b-17e44ae54b2a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:57.877230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:57.878689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:57.879165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:57.879799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] PATH_INFO: `/v3/projects/f05bb10c7c1d4ee8b0d0007ba7f98f27` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:57.881366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f05bb10c7c1d4ee8b0d0007ba7f98f27)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:57.884090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:57.950107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'request_id': 'req-7c88b1bd-7329-4235-811b-578d5af4cd3d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.964290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'request_id': 'req-7c88b1bd-7329-4235-811b-578d5af4cd3d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.974793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f05bb10c7c1d4ee8b0d0007ba7f98f27', 'request_id': 'req-7c88b1bd-7329-4235-811b-578d5af4cd3d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.990012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] The token cache is being invalidate because project f05bb10c7c1d4ee8b0d0007ba7f98f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:57.990311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.990968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:57.994115 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2861/5665] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:57 2022] DELETE /identity/v3/projects/f05bb10c7c1d4ee8b0d0007ba7f98f27 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:57.998606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80c4eb-f0a3-4eab-b305-c68a571a167a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:57.999141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80c4eb-f0a3-4eab-b305-c68a571a167a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:57.999452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80c4eb-f0a3-4eab-b305-c68a571a167a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.019464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:58.020830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:58.037072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7a80c4eb-f0a3-4eab-b305-c68a571a167a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:58.038298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7a80c4eb-f0a3-4eab-b305-c68a571a167a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:58.116243 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2805/5666] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:58.124993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88b1bd-7329-4235-811b-578d5af4cd3d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:58.125716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ae6f-e976-43d3-ab6e-b1e70658c16b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.126028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ae6f-e976-43d3-ab6e-b1e70658c16b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.126340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2ae6f-e976-43d3-ab6e-b1e70658c16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.131474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:58.132641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.133266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.133759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] PATH_INFO: `/v3/projects/b20ee0dab0fe4d64b485757b15278abe` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.135947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20ee0dab0fe4d64b485757b15278abe)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:58.138327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:58.148604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e4a2ae6f-e976-43d3-ab6e-b1e70658c16b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:58.149830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e4a2ae6f-e976-43d3-ab6e-b1e70658c16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:58.162292 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2806/5667] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:58.168116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2ae6f-e976-43d3-ab6e-b1e70658c16b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:58.178559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2ae6f-e976-43d3-ab6e-b1e70658c16b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:58.183683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c3cd2-2241-459d-8c8f-22e1502ae652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:58.184389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c3cd2-2241-459d-8c8f-22e1502ae652 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.184676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c3cd2-2241-459d-8c8f-22e1502ae652 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.185013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c3cd2-2241-459d-8c8f-22e1502ae652 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.185676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c3cd2-2241-459d-8c8f-22e1502ae652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:58.185988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c3cd2-2241-459d-8c8f-22e1502ae652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:58.187646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c3cd2-2241-459d-8c8f-22e1502ae652 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:58.202341 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2807/5668] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:58.206897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c3cd2-2241-459d-8c8f-22e1502ae652 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:58.221542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20ee0dab0fe4d64b485757b15278abe', 'request_id': 'req-2c8dcae6-5238-4c50-ad9a-950208a356f7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.231261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c3cd2-2241-459d-8c8f-22e1502ae652 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:58.232171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20ee0dab0fe4d64b485757b15278abe', 'request_id': 'req-2c8dcae6-5238-4c50-ad9a-950208a356f7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.240665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20ee0dab0fe4d64b485757b15278abe', 'request_id': 'req-2c8dcae6-5238-4c50-ad9a-950208a356f7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.263610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] The token cache is being invalidate because project b20ee0dab0fe4d64b485757b15278abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:58.263751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.264995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.270394 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2862/5669] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:58 2022] DELETE /identity/v3/projects/b20ee0dab0fe4d64b485757b15278abe => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:58.271491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:58.272885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:58.330545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32bce1-6538-4661-8065-7a58e1e11ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:58.331501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32bce1-6538-4661-8065-7a58e1e11ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.332039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32bce1-6538-4661-8065-7a58e1e11ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.332511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32bce1-6538-4661-8065-7a58e1e11ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.333396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32bce1-6538-4661-8065-7a58e1e11ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:58.335542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32bce1-6538-4661-8065-7a58e1e11ec9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:58.354639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8dcae6-5238-4c50-ad9a-950208a356f7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:58.362878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:58.364012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.364354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.365310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] PATH_INFO: `/v3/users/c898c7ab7d4a4d99b2ec11a5d04adc9c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.366913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c898c7ab7d4a4d99b2ec11a5d04adc9c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:58.369708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:58.374317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2808/5670] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:58 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:58.378498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32bce1-6538-4661-8065-7a58e1e11ec9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:58.380955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cd32bce1-6538-4661-8065-7a58e1e11ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:58.462343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c898c7ab7d4a4d99b2ec11a5d04adc9c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.484926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c898c7ab7d4a4d99b2ec11a5d04adc9c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.485893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32bce1-6538-4661-8065-7a58e1e11ec9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:58.487880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c898c7ab7d4a4d99b2ec11a5d04adc9c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.489731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c898c7ab7d4a4d99b2ec11a5d04adc9c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.502081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56d1ed-0d39-41b7-95d2-6c363a8687fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:58.503302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56d1ed-0d39-41b7-95d2-6c363a8687fb admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.505414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56d1ed-0d39-41b7-95d2-6c363a8687fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.505414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56d1ed-0d39-41b7-95d2-6c363a8687fb admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.506683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56d1ed-0d39-41b7-95d2-6c363a8687fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:58.507437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c898c7ab7d4a4d99b2ec11a5d04adc9c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:58.509425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56d1ed-0d39-41b7-95d2-6c363a8687fb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:58.544067 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2863/5671] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:08:58 2022] DELETE /identity/v3/users/c898c7ab7d4a4d99b2ec11a5d04adc9c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:58.557644 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2809/5672] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:58 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:58.560865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:58.562891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:58.659739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de7703-00f8-431a-a066-95c2ca3fa719 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:58.665124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66dc3-d0ec-4f4b-87da-03c1e2f25aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:58.665805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66dc3-d0ec-4f4b-87da-03c1e2f25aed admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.666095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66dc3-d0ec-4f4b-87da-03c1e2f25aed admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.666378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e66dc3-d0ec-4f4b-87da-03c1e2f25aed admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.667108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e66dc3-d0ec-4f4b-87da-03c1e2f25aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:58.670294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e66dc3-d0ec-4f4b-87da-03c1e2f25aed admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:58.696141 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2864/5673] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:58.700158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56d1ed-0d39-41b7-95d2-6c363a8687fb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:58.714536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56d1ed-0d39-41b7-95d2-6c363a8687fb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:58.728950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee338584-0b9f-4aa9-bb81-cc36ab5b55cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:58.729682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee338584-0b9f-4aa9-bb81-cc36ab5b55cb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.729931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee338584-0b9f-4aa9-bb81-cc36ab5b55cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.730262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee338584-0b9f-4aa9-bb81-cc36ab5b55cb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.730997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee338584-0b9f-4aa9-bb81-cc36ab5b55cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:58.734035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee338584-0b9f-4aa9-bb81-cc36ab5b55cb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:58.756660 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2810/5674] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:58.761361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66dc3-d0ec-4f4b-87da-03c1e2f25aed admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:58.776154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e66dc3-d0ec-4f4b-87da-03c1e2f25aed admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:58.787827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bbe31-ed0c-4c2e-9b0f-cd07769a5b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:58.803135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bbe31-ed0c-4c2e-9b0f-cd07769a5b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.803437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bbe31-ed0c-4c2e-9b0f-cd07769a5b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.803727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bbe31-ed0c-4c2e-9b0f-cd07769a5b24 admin admin] PATH_INFO: `/v3/projects/ce5238e1a02e4dc5be49582d3592e83e/users/9326cb35e3d14d79aa44ceb732ce2399/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.831234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bbe31-ed0c-4c2e-9b0f-cd07769a5b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5238e1a02e4dc5be49582d3592e83e, user_id=9326cb35e3d14d79aa44ceb732ce2399, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:58.834831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bbe31-ed0c-4c2e-9b0f-cd07769a5b24 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:58.879841 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2865/5675] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:58 2022] PUT /identity/v3/projects/ce5238e1a02e4dc5be49582d3592e83e/users/9326cb35e3d14d79aa44ceb732ce2399/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:58.884668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd07d-b051-4985-b2eb-a545924e6730 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:58.884967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd07d-b051-4985-b2eb-a545924e6730 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:58.885247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbd07d-b051-4985-b2eb-a545924e6730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:58.951627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9ccbd07d-b051-4985-b2eb-a545924e6730 None None] MFA Rules not processed for user `9326cb35e3d14d79aa44ceb732ce2399`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:58.966069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9ccbd07d-b051-4985-b2eb-a545924e6730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:59.102628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bbe31-ed0c-4c2e-9b0f-cd07769a5b24 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:59.105013 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2811/5676] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:59.114084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbd07d-b051-4985-b2eb-a545924e6730 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:59.119787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9ccbd07d-b051-4985-b2eb-a545924e6730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:59.228215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bbe31-ed0c-4c2e-9b0f-cd07769a5b24 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:59.234187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920316-e7e5-489e-9cf6-aa30ae1696e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:59.234994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920316-e7e5-489e-9cf6-aa30ae1696e5 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.235344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920316-e7e5-489e-9cf6-aa30ae1696e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.235831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0920316-e7e5-489e-9cf6-aa30ae1696e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.237309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0920316-e7e5-489e-9cf6-aa30ae1696e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:59.239390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0920316-e7e5-489e-9cf6-aa30ae1696e5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:59.264772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbd07d-b051-4985-b2eb-a545924e6730 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:59.271645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:59.272949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.273406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.273826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] PATH_INFO: `/v3/projects/05ad6707f15045a6a5b2497a5f62371d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.275214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05ad6707f15045a6a5b2497a5f62371d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:59.277923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:59.278753 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2866/5677] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:59 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:59.282694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920316-e7e5-489e-9cf6-aa30ae1696e5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:59.390244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0920316-e7e5-489e-9cf6-aa30ae1696e5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:59.391823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05ad6707f15045a6a5b2497a5f62371d', 'request_id': 'req-a405af66-04e4-4b4b-9bde-0708e9d58525'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:59.417673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05ad6707f15045a6a5b2497a5f62371d', 'request_id': 'req-a405af66-04e4-4b4b-9bde-0708e9d58525'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:59.433361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05ad6707f15045a6a5b2497a5f62371d', 'request_id': 'req-a405af66-04e4-4b4b-9bde-0708e9d58525'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:59.447642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] The token cache is being invalidate because project 05ad6707f15045a6a5b2497a5f62371d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:08:59.448740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:59.449518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a405af66-04e4-4b4b-9bde-0708e9d58525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:08:59.456275 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2812/5678] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:08:59 2022] DELETE /identity/v3/projects/05ad6707f15045a6a5b2497a5f62371d => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:08:59.456275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b842-bf2b-434e-a455-daa2a0f103bf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.456275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b842-bf2b-434e-a455-daa2a0f103bf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.456275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6b842-bf2b-434e-a455-daa2a0f103bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.476754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-84a6b842-bf2b-434e-a455-daa2a0f103bf None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:59.478339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-84a6b842-bf2b-434e-a455-daa2a0f103bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:59.506905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3021e-cde0-40f5-93db-d909bedf184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:59.508193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3021e-cde0-40f5-93db-d909bedf184b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.508843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3021e-cde0-40f5-93db-d909bedf184b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.509396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3021e-cde0-40f5-93db-d909bedf184b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.510659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3021e-cde0-40f5-93db-d909bedf184b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:59.514481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3021e-cde0-40f5-93db-d909bedf184b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:59.549580 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2867/5679] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:59 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:08:59.549580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124350d9-72a1-44ed-84d4-c460bc6eafb8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.549580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124350d9-72a1-44ed-84d4-c460bc6eafb8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.549983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124350d9-72a1-44ed-84d4-c460bc6eafb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.582862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-124350d9-72a1-44ed-84d4-c460bc6eafb8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:59.584435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-124350d9-72a1-44ed-84d4-c460bc6eafb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:59.604050 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2868/5680] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:59.605216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124350d9-72a1-44ed-84d4-c460bc6eafb8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:59.607027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-124350d9-72a1-44ed-84d4-c460bc6eafb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:59.613270 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2813/5681] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:59.619671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675ae31-627d-404c-9f37-64d026d681b5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.620121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675ae31-627d-404c-9f37-64d026d681b5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.620680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675ae31-627d-404c-9f37-64d026d681b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.651978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124350d9-72a1-44ed-84d4-c460bc6eafb8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:59.658816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da91512-b785-4755-9fd3-b52158ff8b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:59.659522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da91512-b785-4755-9fd3-b52158ff8b1f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.659808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da91512-b785-4755-9fd3-b52158ff8b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.660116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da91512-b785-4755-9fd3-b52158ff8b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.660838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da91512-b785-4755-9fd3-b52158ff8b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:59.662484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da91512-b785-4755-9fd3-b52158ff8b1f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:59.675396 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2869/5682] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:08:59.679189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da91512-b785-4755-9fd3-b52158ff8b1f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:59.703052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da91512-b785-4755-9fd3-b52158ff8b1f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:59.703515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c675ae31-627d-404c-9f37-64d026d681b5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:08:59.708547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c675ae31-627d-404c-9f37-64d026d681b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:08:59.719304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a490f-9f5e-4d43-91a5-b59df00a9b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:59.720434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a490f-9f5e-4d43-91a5-b59df00a9b26 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.725508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a490f-9f5e-4d43-91a5-b59df00a9b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.726285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a490f-9f5e-4d43-91a5-b59df00a9b26 admin admin] PATH_INFO: `/v3/projects/4329f63ab8924c3db1f14a85602b874b/users/ac36092aa4a2433ca02075af35c24766/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.731045 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2814/5683] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:08:59.734956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675ae31-627d-404c-9f37-64d026d681b5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:59.759323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675ae31-627d-404c-9f37-64d026d681b5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:59.775564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4403483-bc83-475e-88d3-07bb7009959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:59.777413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4403483-bc83-475e-88d3-07bb7009959b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.778846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4403483-bc83-475e-88d3-07bb7009959b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.779362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4403483-bc83-475e-88d3-07bb7009959b admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.780767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4403483-bc83-475e-88d3-07bb7009959b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:08:59.782484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4403483-bc83-475e-88d3-07bb7009959b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:59.785286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4403483-bc83-475e-88d3-07bb7009959b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:59.818803 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2815/5684] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:08:59.822808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4403483-bc83-475e-88d3-07bb7009959b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:59.835511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4403483-bc83-475e-88d3-07bb7009959b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:08:59.841395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aea9a-d7cf-4bb7-aee5-868b9b09c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:08:59.842137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aea9a-d7cf-4bb7-aee5-868b9b09c7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:08:59.846169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aea9a-d7cf-4bb7-aee5-868b9b09c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:08:59.846759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aea9a-d7cf-4bb7-aee5-868b9b09c7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:08:59.848330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aea9a-d7cf-4bb7-aee5-868b9b09c7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:59.851641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aea9a-d7cf-4bb7-aee5-868b9b09c7b3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:59.852676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a490f-9f5e-4d43-91a5-b59df00a9b26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4329f63ab8924c3db1f14a85602b874b, user_id=ac36092aa4a2433ca02075af35c24766, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:08:59.864200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a490f-9f5e-4d43-91a5-b59df00a9b26 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:08:59.892926 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2870/5685] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:08:59 2022] PUT /identity/v3/projects/4329f63ab8924c3db1f14a85602b874b/users/ac36092aa4a2433ca02075af35c24766/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:08:59.897958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a490f-9f5e-4d43-91a5-b59df00a9b26 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:08:59.899770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2816/5686] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:08:59 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:08:59.904025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aea9a-d7cf-4bb7-aee5-868b9b09c7b3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:00.013393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aea9a-d7cf-4bb7-aee5-868b9b09c7b3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.022068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410037d-b2d9-4d82-95d0-b745f73c3191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.023307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410037d-b2d9-4d82-95d0-b745f73c3191 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.023825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410037d-b2d9-4d82-95d0-b745f73c3191 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.024933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410037d-b2d9-4d82-95d0-b745f73c3191 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.026398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410037d-b2d9-4d82-95d0-b745f73c3191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.028854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410037d-b2d9-4d82-95d0-b745f73c3191 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:00.054582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a490f-9f5e-4d43-91a5-b59df00a9b26 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.061182 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2817/5687] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:08:59 2022] POST /identity/v3/users => generated 290 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:00.066341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20becec-ca69-4ce4-8f88-39c883ccab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.067032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20becec-ca69-4ce4-8f88-39c883ccab93 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.068015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20becec-ca69-4ce4-8f88-39c883ccab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.068302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20becec-ca69-4ce4-8f88-39c883ccab93 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.069286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20becec-ca69-4ce4-8f88-39c883ccab93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.070956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20becec-ca69-4ce4-8f88-39c883ccab93 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:00.072988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410037d-b2d9-4d82-95d0-b745f73c3191 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:00.091998 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2871/5688] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:00.093016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20becec-ca69-4ce4-8f88-39c883ccab93 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:00.112540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410037d-b2d9-4d82-95d0-b745f73c3191 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.115094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20becec-ca69-4ce4-8f88-39c883ccab93 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.127139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66705d8-9799-4719-9242-6125f92c4d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.128070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66705d8-9799-4719-9242-6125f92c4d16 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.128414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66705d8-9799-4719-9242-6125f92c4d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.128750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66705d8-9799-4719-9242-6125f92c4d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.129873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66705d8-9799-4719-9242-6125f92c4d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.133610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66705d8-9799-4719-9242-6125f92c4d16 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:00.138609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbcd26-b3ff-4016-abeb-6ebf01c5f248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.139697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbcd26-b3ff-4016-abeb-6ebf01c5f248 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.140156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbcd26-b3ff-4016-abeb-6ebf01c5f248 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.140582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbcd26-b3ff-4016-abeb-6ebf01c5f248 admin admin] PATH_INFO: `/v3/projects/4329f63ab8924c3db1f14a85602b874b/users/ac36092aa4a2433ca02075af35c24766/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.143596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbcd26-b3ff-4016-abeb-6ebf01c5f248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4329f63ab8924c3db1f14a85602b874b, user_id=ac36092aa4a2433ca02075af35c24766, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.146506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbcd26-b3ff-4016-abeb-6ebf01c5f248 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:00.150135 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2818/5689] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:00.154922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66705d8-9799-4719-9242-6125f92c4d16 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:00.166989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66705d8-9799-4719-9242-6125f92c4d16 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.170142 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2872/5690] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:00 2022] PUT /identity/v3/projects/4329f63ab8924c3db1f14a85602b874b/users/ac36092aa4a2433ca02075af35c24766/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:00.182847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12a0e8-bcac-4e8d-bb6c-8278cafe55a6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.185342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12a0e8-bcac-4e8d-bb6c-8278cafe55a6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.187700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12a0e8-bcac-4e8d-bb6c-8278cafe55a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.247814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dd12a0e8-bcac-4e8d-bb6c-8278cafe55a6 None None] MFA Rules not processed for user `ac36092aa4a2433ca02075af35c24766`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:00.249453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dd12a0e8-bcac-4e8d-bb6c-8278cafe55a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:00.252479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749ec45-bb21-4b61-bf75-8ff72f4ce6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.253475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749ec45-bb21-4b61-bf75-8ff72f4ce6de admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.254219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749ec45-bb21-4b61-bf75-8ff72f4ce6de admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.254507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749ec45-bb21-4b61-bf75-8ff72f4ce6de admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.255250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749ec45-bb21-4b61-bf75-8ff72f4ce6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.257291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749ec45-bb21-4b61-bf75-8ff72f4ce6de admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:00.284357 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2819/5691] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:00.290013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749ec45-bb21-4b61-bf75-8ff72f4ce6de admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:00.313531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749ec45-bb21-4b61-bf75-8ff72f4ce6de admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.331859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5db44-80b7-477c-87dd-b351ffb24a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.333066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5db44-80b7-477c-87dd-b351ffb24a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.333341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5db44-80b7-477c-87dd-b351ffb24a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.333619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5db44-80b7-477c-87dd-b351ffb24a85 admin admin] PATH_INFO: `/v3/projects/e3d333dbb48e416e88ee38a517995266/users/9c70dec99d4d462197189af39cdc6c07/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.363366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5db44-80b7-477c-87dd-b351ffb24a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d333dbb48e416e88ee38a517995266, user_id=9c70dec99d4d462197189af39cdc6c07, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.368560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5db44-80b7-477c-87dd-b351ffb24a85 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:00.413053 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2820/5692] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:00 2022] PUT /identity/v3/projects/e3d333dbb48e416e88ee38a517995266/users/9c70dec99d4d462197189af39cdc6c07/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:00.413686 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2873/5693] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:00.414097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540f76-1de6-4148-8beb-c8dc58a8df31 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.414097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540f76-1de6-4148-8beb-c8dc58a8df31 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.414097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1540f76-1de6-4148-8beb-c8dc58a8df31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.417479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12a0e8-bcac-4e8d-bb6c-8278cafe55a6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:00.441259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12a0e8-bcac-4e8d-bb6c-8278cafe55a6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.464157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c1540f76-1de6-4148-8beb-c8dc58a8df31 None None] MFA Rules not processed for user `9c70dec99d4d462197189af39cdc6c07`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:00.465669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c1540f76-1de6-4148-8beb-c8dc58a8df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:00.576462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb954-f912-426d-8216-aacb439f19bb tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.577145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb954-f912-426d-8216-aacb439f19bb tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.577485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb954-f912-426d-8216-aacb439f19bb tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.577772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb954-f912-426d-8216-aacb439f19bb tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.578694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb954-f912-426d-8216-aacb439f19bb tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.580666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb954-f912-426d-8216-aacb439f19bb tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:00.615022 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2821/5694] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:00.616038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1540f76-1de6-4148-8beb-c8dc58a8df31 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:00.640433 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2874/5695] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:00 2022] POST /identity/v3/projects => generated 359 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:00.649800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb954-f912-426d-8216-aacb439f19bb tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:00.750886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1540f76-1de6-4148-8beb-c8dc58a8df31 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.782358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb954-f912-426d-8216-aacb439f19bb tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.797284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cbba6-7d9a-4fde-9a6c-fc1006aa81f4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.798028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cbba6-7d9a-4fde-9a6c-fc1006aa81f4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.799082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cbba6-7d9a-4fde-9a6c-fc1006aa81f4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.799375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cbba6-7d9a-4fde-9a6c-fc1006aa81f4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.800554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cbba6-7d9a-4fde-9a6c-fc1006aa81f4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.803140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cbba6-7d9a-4fde-9a6c-fc1006aa81f4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:00.840766 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2875/5696] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:00 2022] POST /identity/v3/users => generated 413 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:00.841945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cbba6-7d9a-4fde-9a6c-fc1006aa81f4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:00.844373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-965cbba6-7d9a-4fde-9a6c-fc1006aa81f4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:00.943893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0081-c40e-4441-a040-21f9c8f4417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.945119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0081-c40e-4441-a040-21f9c8f4417a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.945488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0081-c40e-4441-a040-21f9c8f4417a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.945890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac0081-c40e-4441-a040-21f9c8f4417a admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.948909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac0081-c40e-4441-a040-21f9c8f4417a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.951697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fac0081-c40e-4441-a040-21f9c8f4417a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:00.956567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cbba6-7d9a-4fde-9a6c-fc1006aa81f4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:00.972919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:00.973923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:00.974206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:00.974953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] PATH_INFO: `/v3/users/e99d6eb023bd45aea7f232e3a2946cad` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:00.976936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99d6eb023bd45aea7f232e3a2946cad)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:00.979857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:01.016596 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2822/5697] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:00 2022] POST /identity/v3/projects => generated 379 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:01.019263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0081-c40e-4441-a040-21f9c8f4417a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:01.077863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99d6eb023bd45aea7f232e3a2946cad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.093561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99d6eb023bd45aea7f232e3a2946cad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.096289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99d6eb023bd45aea7f232e3a2946cad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.097579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99d6eb023bd45aea7f232e3a2946cad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.123480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99d6eb023bd45aea7f232e3a2946cad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.156271 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2876/5698] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:00 2022] DELETE /identity/v3/users/e99d6eb023bd45aea7f232e3a2946cad => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:01.157356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:01.159630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:01.217689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac0081-c40e-4441-a040-21f9c8f4417a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:01.279645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de64c3-80c6-4fda-b25f-36f5a3d11d47 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:01.285726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcecdf0-ac17-495d-b115-bed2fc9246ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:01.286404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcecdf0-ac17-495d-b115-bed2fc9246ba admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:01.286826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcecdf0-ac17-495d-b115-bed2fc9246ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:01.287155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcecdf0-ac17-495d-b115-bed2fc9246ba admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:01.287853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcecdf0-ac17-495d-b115-bed2fc9246ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:01.289940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcecdf0-ac17-495d-b115-bed2fc9246ba admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:01.315341 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2877/5699] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:01 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:01.316874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744263-0bf6-4bf6-befe-a0a598d61910 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:01.317387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744263-0bf6-4bf6-befe-a0a598d61910 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:01.317847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76744263-0bf6-4bf6-befe-a0a598d61910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:01.326619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669025ef-1f96-4070-8710-915f9cf22276 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:01.327618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669025ef-1f96-4070-8710-915f9cf22276 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:01.328026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669025ef-1f96-4070-8710-915f9cf22276 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:01.328382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669025ef-1f96-4070-8710-915f9cf22276 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/users/39d3a44b93f74287bb5fd0fcf782333a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:01.353808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669025ef-1f96-4070-8710-915f9cf22276 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:get_user(user_id=39d3a44b93f74287bb5fd0fcf782333a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:01.356165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669025ef-1f96-4070-8710-915f9cf22276 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:01.358460 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2823/5700] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:09:01 2022] GET /identity/v3/users/39d3a44b93f74287bb5fd0fcf782333a => generated 413 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:01.359461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669025ef-1f96-4070-8710-915f9cf22276 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:01.365626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-76744263-0bf6-4bf6-befe-a0a598d61910 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:01.367082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-76744263-0bf6-4bf6-befe-a0a598d61910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:01.375125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669025ef-1f96-4070-8710-915f9cf22276 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:01.381025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66f362-3c1b-4667-b107-013975ef1f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:01.381705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66f362-3c1b-4667-b107-013975ef1f88 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:01.381995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66f362-3c1b-4667-b107-013975ef1f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:01.382274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66f362-3c1b-4667-b107-013975ef1f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:01.383005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66f362-3c1b-4667-b107-013975ef1f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:01.383407 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2878/5701] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:01.384858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744263-0bf6-4bf6-befe-a0a598d61910 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:01.386793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-76744263-0bf6-4bf6-befe-a0a598d61910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:01.394198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66f362-3c1b-4667-b107-013975ef1f88 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:01.409437 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2824/5702] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:01.410424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66f362-3c1b-4667-b107-013975ef1f88 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:01.412444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aa66f362-3c1b-4667-b107-013975ef1f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:01.444421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76744263-0bf6-4bf6-befe-a0a598d61910 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:01.456995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:01.459563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:01.461065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:01.461590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/users/39d3a44b93f74287bb5fd0fcf782333a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:01.464801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_user(user_id=39d3a44b93f74287bb5fd0fcf782333a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:01.473230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:01.493181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66f362-3c1b-4667-b107-013975ef1f88 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:01.506820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258986-0f98-44a1-b21f-4e11f0a71bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:01.507447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258986-0f98-44a1-b21f-4e11f0a71bab service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:01.507733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258986-0f98-44a1-b21f-4e11f0a71bab service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:01.508081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258986-0f98-44a1-b21f-4e11f0a71bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:01.550630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258986-0f98-44a1-b21f-4e11f0a71bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:01.552336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32258986-0f98-44a1-b21f-4e11f0a71bab service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:01.574053 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2825/5703] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:01.575273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258986-0f98-44a1-b21f-4e11f0a71bab service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:01.605859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d3a44b93f74287bb5fd0fcf782333a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.632918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d3a44b93f74287bb5fd0fcf782333a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.634855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d3a44b93f74287bb5fd0fcf782333a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.637556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d3a44b93f74287bb5fd0fcf782333a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.644939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258986-0f98-44a1-b21f-4e11f0a71bab service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:01.677935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e7d6c-999a-4c5b-94ed-b9166d293360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:01.679050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e7d6c-999a-4c5b-94ed-b9166d293360 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:01.680235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e7d6c-999a-4c5b-94ed-b9166d293360 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:01.681397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e7d6c-999a-4c5b-94ed-b9166d293360 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:01.684914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e7d6c-999a-4c5b-94ed-b9166d293360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:01.686167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d3a44b93f74287bb5fd0fcf782333a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.693647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e7d6c-999a-4c5b-94ed-b9166d293360 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:01.717430 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2826/5704] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:01.724180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e7d6c-999a-4c5b-94ed-b9166d293360 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:01.724709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b97e7d6c-999a-4c5b-94ed-b9166d293360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:01.724897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2879/5705] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:01 2022] DELETE /identity/v3/users/39d3a44b93f74287bb5fd0fcf782333a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:01.725997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:01.728366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:01.754585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e7d6c-999a-4c5b-94ed-b9166d293360 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:01.835313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee622044-ab8d-4887-81a7-81bba34f4ace tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:01.841846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:01.842874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:01.843252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:01.843631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/aaee2a54ad6f4e1baad477159f02b67f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:01.845056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aaee2a54ad6f4e1baad477159f02b67f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:01.847293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:01.920620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaee2a54ad6f4e1baad477159f02b67f', 'request_id': 'req-48661c11-368c-4dbe-b722-a2a10ebbbef7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.941405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaee2a54ad6f4e1baad477159f02b67f', 'request_id': 'req-48661c11-368c-4dbe-b722-a2a10ebbbef7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.955176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaee2a54ad6f4e1baad477159f02b67f', 'request_id': 'req-48661c11-368c-4dbe-b722-a2a10ebbbef7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.987540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project aaee2a54ad6f4e1baad477159f02b67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:01.988126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:01.988996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.003812 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2880/5706] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:01 2022] DELETE /identity/v3/projects/aaee2a54ad6f4e1baad477159f02b67f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:02.013395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:02.015559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:02.119082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661c11-368c-4dbe-b722-a2a10ebbbef7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:02.130137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b59a2b-6384-420b-a201-1ba00c740874 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:02.137687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b59a2b-6384-420b-a201-1ba00c740874 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.138081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b59a2b-6384-420b-a201-1ba00c740874 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.138375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b59a2b-6384-420b-a201-1ba00c740874 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.139125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b59a2b-6384-420b-a201-1ba00c740874 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:02.141494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b59a2b-6384-420b-a201-1ba00c740874 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:02.178998 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2881/5707] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:02 2022] POST /identity/v3/projects => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:02.184314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b59a2b-6384-420b-a201-1ba00c740874 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:02.256992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eb6d3-65e1-400b-8190-50fe75f998a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:02.258160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eb6d3-65e1-400b-8190-50fe75f998a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.258496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eb6d3-65e1-400b-8190-50fe75f998a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.258989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08eb6d3-65e1-400b-8190-50fe75f998a1 admin admin] PATH_INFO: `/v3/projects/1b6e856c71ca4187bae8ea450adc9fac/users/2aed4ad5a5f048cab67022f2730cf19c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.276031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eb6d3-65e1-400b-8190-50fe75f998a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6e856c71ca4187bae8ea450adc9fac, user_id=2aed4ad5a5f048cab67022f2730cf19c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:02.279307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08eb6d3-65e1-400b-8190-50fe75f998a1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:02.281048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b59a2b-6384-420b-a201-1ba00c740874 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:02.288135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583ee5d-ac65-4ece-b9a9-fed6f5c9226c tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:02.288831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583ee5d-ac65-4ece-b9a9-fed6f5c9226c tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.289171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583ee5d-ac65-4ece-b9a9-fed6f5c9226c tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.289477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583ee5d-ac65-4ece-b9a9-fed6f5c9226c tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.290510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583ee5d-ac65-4ece-b9a9-fed6f5c9226c tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:02.291105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583ee5d-ac65-4ece-b9a9-fed6f5c9226c tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:02.293452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583ee5d-ac65-4ece-b9a9-fed6f5c9226c tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:02.300993 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2827/5708] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:01 2022] PUT /identity/v3/projects/1b6e856c71ca4187bae8ea450adc9fac/users/2aed4ad5a5f048cab67022f2730cf19c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:02.312142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eb6d3-65e1-400b-8190-50fe75f998a1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:02.314284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f08eb6d3-65e1-400b-8190-50fe75f998a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:02.315786 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2882/5709] 10.222.0.16 () {58 vars in 1159 bytes} [Sat Mar 26 21:09:02 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:02.317559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41481f2-1b12-4d5d-9008-2c657dde4d8b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.318063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41481f2-1b12-4d5d-9008-2c657dde4d8b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.318516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41481f2-1b12-4d5d-9008-2c657dde4d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.357357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d41481f2-1b12-4d5d-9008-2c657dde4d8b None None] MFA Rules not processed for user `2aed4ad5a5f048cab67022f2730cf19c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:02.368785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d41481f2-1b12-4d5d-9008-2c657dde4d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:02.399401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08eb6d3-65e1-400b-8190-50fe75f998a1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:02.406021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:02.407592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.408497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.408880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] PATH_INFO: `/v3/projects/de8e9fac6cd148c5a144cbe642648a31` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.410202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de8e9fac6cd148c5a144cbe642648a31)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:02.412249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:02.442801 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2883/5710] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:02.443977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41481f2-1b12-4d5d-9008-2c657dde4d8b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:02.478025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de8e9fac6cd148c5a144cbe642648a31', 'request_id': 'req-fc3440f8-73db-4dd8-bcda-e09880e599e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.492413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de8e9fac6cd148c5a144cbe642648a31', 'request_id': 'req-fc3440f8-73db-4dd8-bcda-e09880e599e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.504375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de8e9fac6cd148c5a144cbe642648a31', 'request_id': 'req-fc3440f8-73db-4dd8-bcda-e09880e599e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.516914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41481f2-1b12-4d5d-9008-2c657dde4d8b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:02.523211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] The token cache is being invalidate because project de8e9fac6cd148c5a144cbe642648a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:02.523507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.525499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.527339 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2828/5711] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:02 2022] DELETE /identity/v3/projects/de8e9fac6cd148c5a144cbe642648a31 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:02.528110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:02.529683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:02.591518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed873b2-8130-4500-89c8-e81064b484ef tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:02.592874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed873b2-8130-4500-89c8-e81064b484ef tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.593170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed873b2-8130-4500-89c8-e81064b484ef tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.593454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed873b2-8130-4500-89c8-e81064b484ef tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.594865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed873b2-8130-4500-89c8-e81064b484ef tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:02.597252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed873b2-8130-4500-89c8-e81064b484ef tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:02.614117 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2884/5712] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 21:09:02 2022] GET /identity/v3/domains => generated 830 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:02.616155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c218f92-872c-45ed-b614-fdc903fa3ba4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.616506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c218f92-872c-45ed-b614-fdc903fa3ba4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.616805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c218f92-872c-45ed-b614-fdc903fa3ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.639476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3c218f92-872c-45ed-b614-fdc903fa3ba4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:02.640813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c218f92-872c-45ed-b614-fdc903fa3ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:02.678287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3440f8-73db-4dd8-bcda-e09880e599e5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:02.683415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec9f7-166b-4fd8-b13c-08f6c04affa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:02.684165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec9f7-166b-4fd8-b13c-08f6c04affa4 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.684580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec9f7-166b-4fd8-b13c-08f6c04affa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.684709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ec9f7-166b-4fd8-b13c-08f6c04affa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.686110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ec9f7-166b-4fd8-b13c-08f6c04affa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:02.688942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ec9f7-166b-4fd8-b13c-08f6c04affa4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:02.724944 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2829/5713] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:02 2022] POST /identity/v3/projects => generated 377 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:02.725909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec9f7-166b-4fd8-b13c-08f6c04affa4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:02.727984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-340ec9f7-166b-4fd8-b13c-08f6c04affa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:02.819558 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2885/5714] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:02.820552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c218f92-872c-45ed-b614-fdc903fa3ba4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:02.822852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ec9f7-166b-4fd8-b13c-08f6c04affa4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:02.830903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:02.832480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.832771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.833041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/523fe07f0d0d4b13bca91d192551408e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.835161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:update_project(project_id=523fe07f0d0d4b13bca91d192551408e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:02.836501 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:02.836501 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:02.836501 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:02.837915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:02.851327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '523fe07f0d0d4b13bca91d192551408e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.852240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '523fe07f0d0d4b13bca91d192551408e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.858679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c218f92-872c-45ed-b614-fdc903fa3ba4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:02.886271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '523fe07f0d0d4b13bca91d192551408e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.887297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2ae9afe2-8dfb-47c3-b8d1-40ad4160f4e1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '523fe07f0d0d4b13bca91d192551408e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:02.892702 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2830/5715] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Mar 26 21:09:02 2022] PATCH /identity/v3/projects/523fe07f0d0d4b13bca91d192551408e => generated 363 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:02.894684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d854-0f93-470e-9bbe-f0e4dd7e21bc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.896692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d854-0f93-470e-9bbe-f0e4dd7e21bc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.899871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4d854-0f93-470e-9bbe-f0e4dd7e21bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.934952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-09c4d854-0f93-470e-9bbe-f0e4dd7e21bc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:02.936671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-09c4d854-0f93-470e-9bbe-f0e4dd7e21bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:02.960910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd601-08ad-4c9a-944d-d38e22737caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:02.962006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd601-08ad-4c9a-944d-d38e22737caf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:02.962496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd601-08ad-4c9a-944d-d38e22737caf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:02.962967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dd601-08ad-4c9a-944d-d38e22737caf admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:02.963862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dd601-08ad-4c9a-944d-d38e22737caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:02.965910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dd601-08ad-4c9a-944d-d38e22737caf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.001237 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2886/5716] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:02 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:03.005689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd601-08ad-4c9a-944d-d38e22737caf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.014164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-580dd601-08ad-4c9a-944d-d38e22737caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:03.041799 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2831/5717] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:03.047320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4d854-0f93-470e-9bbe-f0e4dd7e21bc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.050307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-09c4d854-0f93-470e-9bbe-f0e4dd7e21bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:03.082414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4d854-0f93-470e-9bbe-f0e4dd7e21bc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.096058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713628cc-bbb4-4b69-9cf1-93581fb14417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.099037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713628cc-bbb4-4b69-9cf1-93581fb14417 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.099357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713628cc-bbb4-4b69-9cf1-93581fb14417 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.100450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713628cc-bbb4-4b69-9cf1-93581fb14417 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.101333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dd601-08ad-4c9a-944d-d38e22737caf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.102863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713628cc-bbb4-4b69-9cf1-93581fb14417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.106166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713628cc-bbb4-4b69-9cf1-93581fb14417 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.108091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.109075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.109558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.109951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/523fe07f0d0d4b13bca91d192551408e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.122681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=523fe07f0d0d4b13bca91d192551408e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.124829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.137858 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2832/5718] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:03.137858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713628cc-bbb4-4b69-9cf1-93581fb14417 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.152923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713628cc-bbb4-4b69-9cf1-93581fb14417 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.164026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '523fe07f0d0d4b13bca91d192551408e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.167410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '523fe07f0d0d4b13bca91d192551408e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.171210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975bf57-26bb-492f-a191-f203f3f39e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.171451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975bf57-26bb-492f-a191-f203f3f39e4d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.171738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975bf57-26bb-492f-a191-f203f3f39e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.172066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975bf57-26bb-492f-a191-f203f3f39e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.172805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975bf57-26bb-492f-a191-f203f3f39e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:03.173117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975bf57-26bb-492f-a191-f203f3f39e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.174805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975bf57-26bb-492f-a191-f203f3f39e4d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.193641 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2833/5719] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:03.193641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975bf57-26bb-492f-a191-f203f3f39e4d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.209708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975bf57-26bb-492f-a191-f203f3f39e4d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.218297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb68f-1bb3-4bb5-b394-a5e92102b9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.219770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb68f-1bb3-4bb5-b394-a5e92102b9ba admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.220102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb68f-1bb3-4bb5-b394-a5e92102b9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.220458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb68f-1bb3-4bb5-b394-a5e92102b9ba admin admin] PATH_INFO: `/v3/projects/736f13cfe98648af881b354a452c715e/users/289527031a964db2ae745e571a514602/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.228327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523fe07f0d0d4b13bca91d192551408e', 'request_id': 'req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.239698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523fe07f0d0d4b13bca91d192551408e', 'request_id': 'req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.247085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb68f-1bb3-4bb5-b394-a5e92102b9ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=736f13cfe98648af881b354a452c715e, user_id=289527031a964db2ae745e571a514602, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.247289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523fe07f0d0d4b13bca91d192551408e', 'request_id': 'req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.251242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb68f-1bb3-4bb5-b394-a5e92102b9ba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.261941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project 523fe07f0d0d4b13bca91d192551408e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:03.262278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.263057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.272129 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2834/5720] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:03 2022] PUT /identity/v3/projects/736f13cfe98648af881b354a452c715e/users/289527031a964db2ae745e571a514602/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:03.272874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb68f-1bb3-4bb5-b394-a5e92102b9ba admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.274871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f5ceb68f-1bb3-4bb5-b394-a5e92102b9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:03.277643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '523fe07f0d0d4b13bca91d192551408e', 'request_id': 'req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.278553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '523fe07f0d0d4b13bca91d192551408e', 'request_id': 'req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.279196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '523fe07f0d0d4b13bca91d192551408e', 'request_id': 'req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:03.292470 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2887/5721] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:03 2022] DELETE /identity/v3/projects/523fe07f0d0d4b13bca91d192551408e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:03.293360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.294794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:03.373429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e8e6-63d6-47cb-a60d-e552c3c10813 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.400638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb68f-1bb3-4bb5-b394-a5e92102b9ba admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.417346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565fc23-e485-41e8-b721-71694cbca88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.418046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565fc23-e485-41e8-b721-71694cbca88c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.418331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565fc23-e485-41e8-b721-71694cbca88c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.418960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565fc23-e485-41e8-b721-71694cbca88c admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.419305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565fc23-e485-41e8-b721-71694cbca88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.426555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565fc23-e485-41e8-b721-71694cbca88c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.437895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c88faf-45b4-4dd3-acb8-d043b19747c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.438571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c88faf-45b4-4dd3-acb8-d043b19747c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.439751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c88faf-45b4-4dd3-acb8-d043b19747c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.440927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c88faf-45b4-4dd3-acb8-d043b19747c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.443127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c88faf-45b4-4dd3-acb8-d043b19747c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.445752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c88faf-45b4-4dd3-acb8-d043b19747c5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.459814 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2888/5722] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:03.461243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c88faf-45b4-4dd3-acb8-d043b19747c5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.462998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-05c88faf-45b4-4dd3-acb8-d043b19747c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:03.481018 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2835/5723] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:03 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:03.481896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565fc23-e485-41e8-b721-71694cbca88c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.558603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c88faf-45b4-4dd3-acb8-d043b19747c5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.579857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565fc23-e485-41e8-b721-71694cbca88c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.585501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb5c77-e167-4f5a-98e1-159b1c1b01e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.586892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb5c77-e167-4f5a-98e1-159b1c1b01e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.587525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb5c77-e167-4f5a-98e1-159b1c1b01e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.588168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb5c77-e167-4f5a-98e1-159b1c1b01e7 admin admin] PATH_INFO: `/v3/projects/736f13cfe98648af881b354a452c715e/users/289527031a964db2ae745e571a514602/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.590810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb5c77-e167-4f5a-98e1-159b1c1b01e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736f13cfe98648af881b354a452c715e, user_id=289527031a964db2ae745e571a514602, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.596098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb5c77-e167-4f5a-98e1-159b1c1b01e7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.615537 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2836/5724] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:03 2022] PUT /identity/v3/projects/736f13cfe98648af881b354a452c715e/users/289527031a964db2ae745e571a514602/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:03.616730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb5c77-e167-4f5a-98e1-159b1c1b01e7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.621220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e0eb5c77-e167-4f5a-98e1-159b1c1b01e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:03.647795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74006771-9e61-4b4b-a556-2425087ebdde tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.649338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74006771-9e61-4b4b-a556-2425087ebdde tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.649338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74006771-9e61-4b4b-a556-2425087ebdde tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.649525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74006771-9e61-4b4b-a556-2425087ebdde tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.650178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74006771-9e61-4b4b-a556-2425087ebdde tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.654014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74006771-9e61-4b4b-a556-2425087ebdde tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.705364 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2889/5725] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:03 2022] POST /identity/v3/projects => generated 358 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:03.712192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a83cd-171e-44e5-8ad6-f3255b2c84ce None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.712552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a83cd-171e-44e5-8ad6-f3255b2c84ce None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.712842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a83cd-171e-44e5-8ad6-f3255b2c84ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.717486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb5c77-e167-4f5a-98e1-159b1c1b01e7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.757216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-768a83cd-171e-44e5-8ad6-f3255b2c84ce None None] MFA Rules not processed for user `289527031a964db2ae745e571a514602`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:03.759423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-768a83cd-171e-44e5-8ad6-f3255b2c84ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:03.800761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4130-83d0-49e9-abe6-b694ef327e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.801971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4130-83d0-49e9-abe6-b694ef327e4d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.802519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4130-83d0-49e9-abe6-b694ef327e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.803003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef4130-83d0-49e9-abe6-b694ef327e4d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.804882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef4130-83d0-49e9-abe6-b694ef327e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.807185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef4130-83d0-49e9-abe6-b694ef327e4d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.836218 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2837/5726] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:03 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:03.840742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4130-83d0-49e9-abe6-b694ef327e4d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.875824 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2890/5727] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:03.877498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a83cd-171e-44e5-8ad6-f3255b2c84ce None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.895530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a83cd-171e-44e5-8ad6-f3255b2c84ce None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.902472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e63f19-6883-44f9-a6b7-deec220f45a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.903295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63f19-6883-44f9-a6b7-deec220f45a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.903808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63f19-6883-44f9-a6b7-deec220f45a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.904271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e63f19-6883-44f9-a6b7-deec220f45a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.905392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e63f19-6883-44f9-a6b7-deec220f45a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.907408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e63f19-6883-44f9-a6b7-deec220f45a7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.926068 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2891/5728] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:03.926068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e63f19-6883-44f9-a6b7-deec220f45a7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.926478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-55e63f19-6883-44f9-a6b7-deec220f45a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:03.952786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef4130-83d0-49e9-abe6-b694ef327e4d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.958475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01cd88-6e73-483d-aacc-c44613b7c881 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.960301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01cd88-6e73-483d-aacc-c44613b7c881 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.961306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01cd88-6e73-483d-aacc-c44613b7c881 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.961780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01cd88-6e73-483d-aacc-c44613b7c881 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/a817d79b643a48da81d4102891c7214f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.963522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01cd88-6e73-483d-aacc-c44613b7c881 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:get_project(project_id=a817d79b643a48da81d4102891c7214f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:03.966471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01cd88-6e73-483d-aacc-c44613b7c881 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:03.974389 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2838/5729] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:03 2022] GET /identity/v3/projects/a817d79b643a48da81d4102891c7214f => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:03.974989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01cd88-6e73-483d-aacc-c44613b7c881 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:03.988643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01cd88-6e73-483d-aacc-c44613b7c881 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:03.994955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb919cfa-5054-4cd2-8a39-546778b59bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:03.995998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb919cfa-5054-4cd2-8a39-546778b59bef admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:03.996992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb919cfa-5054-4cd2-8a39-546778b59bef admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:03.998347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb919cfa-5054-4cd2-8a39-546778b59bef admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:03.999310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb919cfa-5054-4cd2-8a39-546778b59bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:04.002353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb919cfa-5054-4cd2-8a39-546778b59bef admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:04.004383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e63f19-6883-44f9-a6b7-deec220f45a7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:04.010678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552fd25-d218-4bc8-b43b-fd0a460299ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:04.011342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552fd25-d218-4bc8-b43b-fd0a460299ba service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:04.012168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552fd25-d218-4bc8-b43b-fd0a460299ba service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:04.012168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552fd25-d218-4bc8-b43b-fd0a460299ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:04.024299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552fd25-d218-4bc8-b43b-fd0a460299ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:04.025759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552fd25-d218-4bc8-b43b-fd0a460299ba service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:04.029440 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2839/5730] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:04.029658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb919cfa-5054-4cd2-8a39-546778b59bef admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:04.038405 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2892/5731] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:04.039759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552fd25-d218-4bc8-b43b-fd0a460299ba service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:04.049170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb919cfa-5054-4cd2-8a39-546778b59bef admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:04.061649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:04.062907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:04.062907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:04.063169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/a817d79b643a48da81d4102891c7214f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:04.066090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552fd25-d218-4bc8-b43b-fd0a460299ba service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:04.068497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a817d79b643a48da81d4102891c7214f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:04.072359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:04.085364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae21f8-242b-4af7-a79d-7e6b3686aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:04.085364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae21f8-242b-4af7-a79d-7e6b3686aee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:04.086295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae21f8-242b-4af7-a79d-7e6b3686aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:04.086544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae21f8-242b-4af7-a79d-7e6b3686aee5 admin admin] PATH_INFO: `/v3/projects/8657daeb436044378b8b124a0f9d5c15/users/9d7e99c126f3435ea890fa21c1614041/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:04.108722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae21f8-242b-4af7-a79d-7e6b3686aee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8657daeb436044378b8b124a0f9d5c15, user_id=9d7e99c126f3435ea890fa21c1614041, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:04.112744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae21f8-242b-4af7-a79d-7e6b3686aee5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:04.148869 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2893/5732] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:04 2022] PUT /identity/v3/projects/8657daeb436044378b8b124a0f9d5c15/users/9d7e99c126f3435ea890fa21c1614041/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:04.149897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae21f8-242b-4af7-a79d-7e6b3686aee5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:04.152423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dcae21f8-242b-4af7-a79d-7e6b3686aee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:04.159616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a817d79b643a48da81d4102891c7214f', 'request_id': 'req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.169380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a817d79b643a48da81d4102891c7214f', 'request_id': 'req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.176775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a817d79b643a48da81d4102891c7214f', 'request_id': 'req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.195973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project a817d79b643a48da81d4102891c7214f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:04.196221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.196854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b89efc54-80e7-4c6c-8c63-4377f69dd9d4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.198667 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2840/5733] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:04 2022] DELETE /identity/v3/projects/a817d79b643a48da81d4102891c7214f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:04.199736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4096-9602-4429-8e6d-37917d2601da None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:04.200502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4096-9602-4429-8e6d-37917d2601da None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:04.200502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d4096-9602-4429-8e6d-37917d2601da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:04.234091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b06d4096-9602-4429-8e6d-37917d2601da None None] MFA Rules not processed for user `9d7e99c126f3435ea890fa21c1614041`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:04.235587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b06d4096-9602-4429-8e6d-37917d2601da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:04.259199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae21f8-242b-4af7-a79d-7e6b3686aee5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:04.310626 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2841/5734] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:04.316636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4096-9602-4429-8e6d-37917d2601da None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:04.318102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b06d4096-9602-4429-8e6d-37917d2601da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:04.322391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:04.323156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:04.323510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:04.323855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:04.326047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:04.392803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:04.394273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:04.405458 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2894/5735] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:04.406503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:04.408590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:04.414973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d4096-9602-4429-8e6d-37917d2601da None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:04.420441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7f5d5-333e-4e7f-b0da-45702e1c9cc7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:04.421494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7f5d5-333e-4e7f-b0da-45702e1c9cc7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:04.422424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7f5d5-333e-4e7f-b0da-45702e1c9cc7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:04.423214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7f5d5-333e-4e7f-b0da-45702e1c9cc7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:04.424537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7f5d5-333e-4e7f-b0da-45702e1c9cc7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:04.426946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7f5d5-333e-4e7f-b0da-45702e1c9cc7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:04.503538 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2842/5736] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:04 2022] POST /identity/v3/projects => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:04.503824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7f5d5-333e-4e7f-b0da-45702e1c9cc7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:04.506194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6ab7f5d5-333e-4e7f-b0da-45702e1c9cc7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:04.524168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa94d71-b36b-42a2-97ad-387b0eb956a8 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:04.605779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:04.606734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:04.607051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:04.607329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] PATH_INFO: `/v3/users/d5cbc0bf9ae44ad08d706bb23f7c979a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:04.608756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5cbc0bf9ae44ad08d706bb23f7c979a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:04.611277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:04.634198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7f5d5-333e-4e7f-b0da-45702e1c9cc7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:04.638467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1025ce1-e240-4321-99c5-a6833952e404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:04.639238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1025ce1-e240-4321-99c5-a6833952e404 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:04.639619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1025ce1-e240-4321-99c5-a6833952e404 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:04.640250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1025ce1-e240-4321-99c5-a6833952e404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:04.682553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5cbc0bf9ae44ad08d706bb23f7c979a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.724373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5cbc0bf9ae44ad08d706bb23f7c979a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.726922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5cbc0bf9ae44ad08d706bb23f7c979a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.729176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5cbc0bf9ae44ad08d706bb23f7c979a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.747011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5cbc0bf9ae44ad08d706bb23f7c979a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:04.761930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1025ce1-e240-4321-99c5-a6833952e404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:04.768752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1025ce1-e240-4321-99c5-a6833952e404 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:04.783694 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2843/5737] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:04.784597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1025ce1-e240-4321-99c5-a6833952e404 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:04.789328 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2895/5738] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:04 2022] DELETE /identity/v3/users/d5cbc0bf9ae44ad08d706bb23f7c979a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:04.938172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1025ce1-e240-4321-99c5-a6833952e404 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:05.083129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dffa9-177d-4fa9-b86e-23c474f0c076 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:05.083129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dffa9-177d-4fa9-b86e-23c474f0c076 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:05.083129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dffa9-177d-4fa9-b86e-23c474f0c076 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:05.083586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dffa9-177d-4fa9-b86e-23c474f0c076 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/f8d5c0a851494259ad66088f2f228222` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:05.121028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dffa9-177d-4fa9-b86e-23c474f0c076 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:get_project(project_id=f8d5c0a851494259ad66088f2f228222)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:05.125855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838dffa9-177d-4fa9-b86e-23c474f0c076 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:05.129812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2844/5739] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:04 2022] GET /identity/v3/projects/f8d5c0a851494259ad66088f2f228222 => generated 361 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:05.135605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:05.137499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:05.161211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56aa55-f773-451d-a6f1-7d79104754fb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:05.176260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:05.177842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:05.180531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:05.180868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/f8d5c0a851494259ad66088f2f228222` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:05.182601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8d5c0a851494259ad66088f2f228222)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:05.203897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:05.350952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dffa9-177d-4fa9-b86e-23c474f0c076 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:05.352913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-838dffa9-177d-4fa9-b86e-23c474f0c076 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:05.388592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d5c0a851494259ad66088f2f228222', 'request_id': 'req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.406349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d5c0a851494259ad66088f2f228222', 'request_id': 'req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.413815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d5c0a851494259ad66088f2f228222', 'request_id': 'req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.468978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dffa9-177d-4fa9-b86e-23c474f0c076 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:05.476303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project f8d5c0a851494259ad66088f2f228222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:05.476493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.477150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.479247 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2896/5740] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:05 2022] DELETE /identity/v3/projects/f8d5c0a851494259ad66088f2f228222 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:05.493817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:05.496709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:05.629145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:05.630024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:05.630307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:05.630582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] PATH_INFO: `/v3/projects/cc51d0de03ed49c08738d431ef274427` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:05.631694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63f09f-204c-4f05-b00b-1d7cdfeccb12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:05.634722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc51d0de03ed49c08738d431ef274427)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:05.639877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:05.651389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d77b9-c5c2-42fd-b724-91cb16510060 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:05.652174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d77b9-c5c2-42fd-b724-91cb16510060 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:05.652531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d77b9-c5c2-42fd-b724-91cb16510060 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:05.653551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d77b9-c5c2-42fd-b724-91cb16510060 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:05.654688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d77b9-c5c2-42fd-b724-91cb16510060 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:05.657546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d77b9-c5c2-42fd-b724-91cb16510060 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:05.725565 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2897/5741] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:09:05 2022] POST /identity/v3/projects => generated 348 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:05.727144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d77b9-c5c2-42fd-b724-91cb16510060 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:05.768308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc51d0de03ed49c08738d431ef274427', 'request_id': 'req-55f31760-03fd-40e8-acf8-5ef9e571e434'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.786108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc51d0de03ed49c08738d431ef274427', 'request_id': 'req-55f31760-03fd-40e8-acf8-5ef9e571e434'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.793871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc51d0de03ed49c08738d431ef274427', 'request_id': 'req-55f31760-03fd-40e8-acf8-5ef9e571e434'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.812974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] The token cache is being invalidate because project cc51d0de03ed49c08738d431ef274427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:05.813260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.816313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-55f31760-03fd-40e8-acf8-5ef9e571e434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:05.822817 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2845/5742] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:05 2022] DELETE /identity/v3/projects/cc51d0de03ed49c08738d431ef274427 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:05.824581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5d911-b45b-4b03-a762-a7fe932043d1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:05.824876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5d911-b45b-4b03-a762-a7fe932043d1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:05.825164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5d911-b45b-4b03-a762-a7fe932043d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:05.864384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2fc5d911-b45b-4b03-a762-a7fe932043d1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:05.865825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2fc5d911-b45b-4b03-a762-a7fe932043d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:05.889436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d77b9-c5c2-42fd-b724-91cb16510060 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.015665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b79de0-0fcf-4c34-a88d-e1c7a019bf3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.016761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b79de0-0fcf-4c34-a88d-e1c7a019bf3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.018064 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2846/5743] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:06.026714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913221c-c3bb-4ff4-8922-0b9aea06ea60 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.027015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913221c-c3bb-4ff4-8922-0b9aea06ea60 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.027356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913221c-c3bb-4ff4-8922-0b9aea06ea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.029876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b79de0-0fcf-4c34-a88d-e1c7a019bf3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.031805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b79de0-0fcf-4c34-a88d-e1c7a019bf3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/5869b000be374fe1839ae00122dd8544` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.038518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b79de0-0fcf-4c34-a88d-e1c7a019bf3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:get_project(project_id=5869b000be374fe1839ae00122dd8544)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.046530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b79de0-0fcf-4c34-a88d-e1c7a019bf3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.051108 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2898/5744] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:05 2022] GET /identity/v3/projects/5869b000be374fe1839ae00122dd8544 => generated 348 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:06.055986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b79de0-0fcf-4c34-a88d-e1c7a019bf3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.059559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-73b79de0-0fcf-4c34-a88d-e1c7a019bf3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:06.066179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7913221c-c3bb-4ff4-8922-0b9aea06ea60 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:06.067399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7913221c-c3bb-4ff4-8922-0b9aea06ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:06.098055 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2847/5745] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:06.104445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913221c-c3bb-4ff4-8922-0b9aea06ea60 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.119464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b79de0-0fcf-4c34-a88d-e1c7a019bf3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.121037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913221c-c3bb-4ff4-8922-0b9aea06ea60 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.128384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.129254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.129545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.129824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/5869b000be374fe1839ae00122dd8544` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.130626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740de84-c1f3-4844-a8f8-7a4cdf90ce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.132004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740de84-c1f3-4844-a8f8-7a4cdf90ce11 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.132504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740de84-c1f3-4844-a8f8-7a4cdf90ce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.132978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740de84-c1f3-4844-a8f8-7a4cdf90ce11 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.134179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740de84-c1f3-4844-a8f8-7a4cdf90ce11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:06.134910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740de84-c1f3-4844-a8f8-7a4cdf90ce11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.136474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5869b000be374fe1839ae00122dd8544)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.137468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740de84-c1f3-4844-a8f8-7a4cdf90ce11 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.138521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.158485 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2848/5746] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:06.159512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740de84-c1f3-4844-a8f8-7a4cdf90ce11 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.170888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740de84-c1f3-4844-a8f8-7a4cdf90ce11 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.176684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b82127-59c5-4b94-afca-218bfd4f8aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.178038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b82127-59c5-4b94-afca-218bfd4f8aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.178316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b82127-59c5-4b94-afca-218bfd4f8aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.178593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b82127-59c5-4b94-afca-218bfd4f8aa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.179571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b82127-59c5-4b94-afca-218bfd4f8aa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.181562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b82127-59c5-4b94-afca-218bfd4f8aa5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.215312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5869b000be374fe1839ae00122dd8544', 'request_id': 'req-bb3800e1-e056-4e5f-b561-43633b6b6337'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.223536 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2849/5747] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:06 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:06.227118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5869b000be374fe1839ae00122dd8544', 'request_id': 'req-bb3800e1-e056-4e5f-b561-43633b6b6337'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.228560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b82127-59c5-4b94-afca-218bfd4f8aa5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.235895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5869b000be374fe1839ae00122dd8544', 'request_id': 'req-bb3800e1-e056-4e5f-b561-43633b6b6337'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.254753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project 5869b000be374fe1839ae00122dd8544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:06.255047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.256337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.258293 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2899/5748] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:06 2022] DELETE /identity/v3/projects/5869b000be374fe1839ae00122dd8544 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:06.262937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.264573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:06.307167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b82127-59c5-4b94-afca-218bfd4f8aa5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.312856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf6a63-bfec-46e2-9836-9c98373760f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.314369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf6a63-bfec-46e2-9836-9c98373760f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.314892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf6a63-bfec-46e2-9836-9c98373760f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.315317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf6a63-bfec-46e2-9836-9c98373760f6 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.316121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf6a63-bfec-46e2-9836-9c98373760f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.318500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf6a63-bfec-46e2-9836-9c98373760f6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.349802 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2850/5749] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:06 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:06.351124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf6a63-bfec-46e2-9836-9c98373760f6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.354376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eabf6a63-bfec-46e2-9836-9c98373760f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:06.369663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf6a63-bfec-46e2-9836-9c98373760f6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.375252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a85e11-4783-4b1d-88cc-cab6e05c8eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.376061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a85e11-4783-4b1d-88cc-cab6e05c8eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.377136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a85e11-4783-4b1d-88cc-cab6e05c8eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.377543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a85e11-4783-4b1d-88cc-cab6e05c8eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.378688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a85e11-4783-4b1d-88cc-cab6e05c8eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.380439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a85e11-4783-4b1d-88cc-cab6e05c8eb5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.384794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3800e1-e056-4e5f-b561-43633b6b6337 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.408881 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2851/5750] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:06.410050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a85e11-4783-4b1d-88cc-cab6e05c8eb5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.437066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a85e11-4783-4b1d-88cc-cab6e05c8eb5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.444548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7dbf-b4d7-46b5-b67a-bb06f478a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.446072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7dbf-b4d7-46b5-b67a-bb06f478a60c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.446786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7dbf-b4d7-46b5-b67a-bb06f478a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.447081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f7dbf-b4d7-46b5-b67a-bb06f478a60c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.447813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7dbf-b4d7-46b5-b67a-bb06f478a60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.449922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f7dbf-b4d7-46b5-b67a-bb06f478a60c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.455255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221079-95ed-47ea-bbfa-0f728c28f335 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.456126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221079-95ed-47ea-bbfa-0f728c28f335 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.456427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221079-95ed-47ea-bbfa-0f728c28f335 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.456785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4221079-95ed-47ea-bbfa-0f728c28f335 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.457641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4221079-95ed-47ea-bbfa-0f728c28f335 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.464001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4221079-95ed-47ea-bbfa-0f728c28f335 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.470638 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2852/5751] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:06.471886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7dbf-b4d7-46b5-b67a-bb06f478a60c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.482874 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2900/5752] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:09:06 2022] POST /identity/v3/domains => generated 276 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:06.483420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f7dbf-b4d7-46b5-b67a-bb06f478a60c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.487697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221079-95ed-47ea-bbfa-0f728c28f335 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.563401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92e584-ea6d-4a27-8f7d-46a9f7dea98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.566019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92e584-ea6d-4a27-8f7d-46a9f7dea98c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.566525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92e584-ea6d-4a27-8f7d-46a9f7dea98c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.567019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92e584-ea6d-4a27-8f7d-46a9f7dea98c admin admin] PATH_INFO: `/v3/projects/0aee9d7189834141b6881cd81ddb821c/users/b402a590241e48759a2d0db329b0359e/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.573042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4221079-95ed-47ea-bbfa-0f728c28f335 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.577832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa627b-aec9-4edf-b4bf-40bddccef842 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.578807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa627b-aec9-4edf-b4bf-40bddccef842 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.579099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa627b-aec9-4edf-b4bf-40bddccef842 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.579378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa627b-aec9-4edf-b4bf-40bddccef842 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.580842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa627b-aec9-4edf-b4bf-40bddccef842 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.584769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa627b-aec9-4edf-b4bf-40bddccef842 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.590402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92e584-ea6d-4a27-8f7d-46a9f7dea98c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aee9d7189834141b6881cd81ddb821c, user_id=b402a590241e48759a2d0db329b0359e, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.595319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92e584-ea6d-4a27-8f7d-46a9f7dea98c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.621193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2853/5753] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:06 2022] PUT /identity/v3/projects/0aee9d7189834141b6881cd81ddb821c/users/b402a590241e48759a2d0db329b0359e/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:06.623057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0a915-7c08-4b56-89f5-7ae0d117fb05 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.623554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0a915-7c08-4b56-89f5-7ae0d117fb05 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.623932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0a915-7c08-4b56-89f5-7ae0d117fb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.650063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-97b0a915-7c08-4b56-89f5-7ae0d117fb05 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:06.650829 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2901/5754] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:06 2022] POST /identity/v3/projects => generated 404 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:06.651735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa627b-aec9-4edf-b4bf-40bddccef842 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.651869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-97b0a915-7c08-4b56-89f5-7ae0d117fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:06.761288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa627b-aec9-4edf-b4bf-40bddccef842 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.776501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc9b43-8fd0-4c00-8ee6-5e7af57ab02b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.779904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc9b43-8fd0-4c00-8ee6-5e7af57ab02b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.780665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc9b43-8fd0-4c00-8ee6-5e7af57ab02b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.780978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc9b43-8fd0-4c00-8ee6-5e7af57ab02b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/8e1495483be4471a8e0d1010f7246f1a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.786460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc9b43-8fd0-4c00-8ee6-5e7af57ab02b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:get_project(project_id=8e1495483be4471a8e0d1010f7246f1a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.794212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc9b43-8fd0-4c00-8ee6-5e7af57ab02b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.800060 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2902/5755] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:06 2022] GET /identity/v3/projects/8e1495483be4471a8e0d1010f7246f1a => generated 404 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:06.801197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc9b43-8fd0-4c00-8ee6-5e7af57ab02b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.813317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc9b43-8fd0-4c00-8ee6-5e7af57ab02b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:06.826026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:06.826967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:06.827274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:06.827555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/8e1495483be4471a8e0d1010f7246f1a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:06.829630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8e1495483be4471a8e0d1010f7246f1a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:06.831294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:06.840488 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2854/5756] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:06.850491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0a915-7c08-4b56-89f5-7ae0d117fb05 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:06.853676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-97b0a915-7c08-4b56-89f5-7ae0d117fb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:06.947079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1495483be4471a8e0d1010f7246f1a', 'request_id': 'req-a114b596-4d83-4437-8cbc-7a35a1bd5aad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.961572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1495483be4471a8e0d1010f7246f1a', 'request_id': 'req-a114b596-4d83-4437-8cbc-7a35a1bd5aad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.972795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1495483be4471a8e0d1010f7246f1a', 'request_id': 'req-a114b596-4d83-4437-8cbc-7a35a1bd5aad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.991135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project 8e1495483be4471a8e0d1010f7246f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:06.991511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.993462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:06.995983 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2903/5757] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:06 2022] DELETE /identity/v3/projects/8e1495483be4471a8e0d1010f7246f1a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:07.003636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0a915-7c08-4b56-89f5-7ae0d117fb05 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:07.015063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:07.018916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:07.119599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94662ff4-e51b-427f-92cf-14177ab9c6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:07.120876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94662ff4-e51b-427f-92cf-14177ab9c6dd service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:07.121826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94662ff4-e51b-427f-92cf-14177ab9c6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:07.122425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94662ff4-e51b-427f-92cf-14177ab9c6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:07.125565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-94662ff4-e51b-427f-92cf-14177ab9c6dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:07.167041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114b596-4d83-4437-8cbc-7a35a1bd5aad tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:07.178632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:07.181264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:07.182557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:07.184772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/domains/255ce960954548bfab8d91f976a70c9b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:07.186804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=255ce960954548bfab8d91f976a70c9b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:07.190838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:07.249167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '255ce960954548bfab8d91f976a70c9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.251145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '255ce960954548bfab8d91f976a70c9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.320107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94662ff4-e51b-427f-92cf-14177ab9c6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:07.321705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94662ff4-e51b-427f-92cf-14177ab9c6dd service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:07.328659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '255ce960954548bfab8d91f976a70c9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.329916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '255ce960954548bfab8d91f976a70c9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.334016 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2904/5758] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:09:06 2022] PATCH /identity/v3/domains/255ce960954548bfab8d91f976a70c9b => generated 277 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:07.339678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:07.342500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:07.347151 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2855/5759] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:07.463347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c73a7-ae6b-4bd8-8973-6834a6008104 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:07.472512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:07.473942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:07.473942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:07.474176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/domains/255ce960954548bfab8d91f976a70c9b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:07.494474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=255ce960954548bfab8d91f976a70c9b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:07.496721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:07.545764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '255ce960954548bfab8d91f976a70c9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.550922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '255ce960954548bfab8d91f976a70c9b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.677985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255ce960954548bfab8d91f976a70c9b', 'request_id': 'req-df2b9144-69ac-4490-895f-b3c80ca51b12'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.696572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255ce960954548bfab8d91f976a70c9b', 'request_id': 'req-df2b9144-69ac-4490-895f-b3c80ca51b12'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.706438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255ce960954548bfab8d91f976a70c9b', 'request_id': 'req-df2b9144-69ac-4490-895f-b3c80ca51b12'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.739050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project 255ce960954548bfab8d91f976a70c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:07.739405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.740232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.749771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '255ce960954548bfab8d91f976a70c9b', 'request_id': 'req-df2b9144-69ac-4490-895f-b3c80ca51b12'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.750853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '255ce960954548bfab8d91f976a70c9b', 'request_id': 'req-df2b9144-69ac-4490-895f-b3c80ca51b12'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.752154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '255ce960954548bfab8d91f976a70c9b', 'request_id': 'req-df2b9144-69ac-4490-895f-b3c80ca51b12'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:07.771669 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2905/5760] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:07 2022] DELETE /identity/v3/domains/255ce960954548bfab8d91f976a70c9b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:07.780881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94662ff4-e51b-427f-92cf-14177ab9c6dd service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:07.794128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94662ff4-e51b-427f-92cf-14177ab9c6dd service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:07.948222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:07.950344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:07.963063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d392e0-b6ea-4601-8313-f72c5d22ccb5 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:07.963733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d392e0-b6ea-4601-8313-f72c5d22ccb5 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:07.964044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d392e0-b6ea-4601-8313-f72c5d22ccb5 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:07.964325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d392e0-b6ea-4601-8313-f72c5d22ccb5 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:07.965056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d392e0-b6ea-4601-8313-f72c5d22ccb5 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:07.969047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d392e0-b6ea-4601-8313-f72c5d22ccb5 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:08.010975 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2856/5761] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:09:07 2022] POST /identity/v3/domains => generated 276 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:08.012666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205685-54d3-43e8-853f-2cca90a42d27 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:08.013171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205685-54d3-43e8-853f-2cca90a42d27 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:08.013710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77205685-54d3-43e8-853f-2cca90a42d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:08.067179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-77205685-54d3-43e8-853f-2cca90a42d27 None None] MFA Rules not processed for user `dd05073d7e52411c92d7b9def363dd50`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:08.072666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-77205685-54d3-43e8-853f-2cca90a42d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:08.097521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b9144-69ac-4490-895f-b3c80ca51b12 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:08.171091 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2857/5762] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:08.172489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205685-54d3-43e8-853f-2cca90a42d27 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:08.175244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-77205685-54d3-43e8-853f-2cca90a42d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:08.208012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:08.210064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:08.212242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:08.212851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] PATH_INFO: `/v3/users/9c70dec99d4d462197189af39cdc6c07` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:08.216155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c70dec99d4d462197189af39cdc6c07)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:08.221341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:08.290240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77205685-54d3-43e8-853f-2cca90a42d27 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:08.296193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b3f03-d083-48c9-8801-6c0c93a5370a tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:08.297246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b3f03-d083-48c9-8801-6c0c93a5370a tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:08.297915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b3f03-d083-48c9-8801-6c0c93a5370a tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:08.299154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b3f03-d083-48c9-8801-6c0c93a5370a tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:08.300132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b3f03-d083-48c9-8801-6c0c93a5370a tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:08.302453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b3f03-d083-48c9-8801-6c0c93a5370a tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:08.315335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c70dec99d4d462197189af39cdc6c07'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.328409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c70dec99d4d462197189af39cdc6c07'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.330039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c70dec99d4d462197189af39cdc6c07'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.332460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c70dec99d4d462197189af39cdc6c07'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.351272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c70dec99d4d462197189af39cdc6c07'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.377767 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2858/5763] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:08 2022] POST /identity/v3/projects => generated 409 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:08.380206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b3f03-d083-48c9-8801-6c0c93a5370a tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:08.386013 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2906/5764] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:07 2022] DELETE /identity/v3/users/9c70dec99d4d462197189af39cdc6c07 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:08.386946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:08.387795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9b5b3f03-d083-48c9-8801-6c0c93a5370a tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:08.388958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:08.461080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7817c-ab33-459a-a1df-f546163f3493 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:08.466590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ae4f0-9204-407c-b677-337775b1477b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:08.467344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ae4f0-9204-407c-b677-337775b1477b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:08.467635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ae4f0-9204-407c-b677-337775b1477b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:08.467936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ae4f0-9204-407c-b677-337775b1477b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:08.468782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ae4f0-9204-407c-b677-337775b1477b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:08.471338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86ae4f0-9204-407c-b677-337775b1477b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:08.513367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b3f03-d083-48c9-8801-6c0c93a5370a tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:08.515205 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2907/5765] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:08 2022] POST /identity/v3/projects => generated 404 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:08.517021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8efce6-388e-4f03-b424-9a9648851c7d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:08.517347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8efce6-388e-4f03-b424-9a9648851c7d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:08.517637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8efce6-388e-4f03-b424-9a9648851c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:08.539375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5b8efce6-388e-4f03-b424-9a9648851c7d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:08.541194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b8efce6-388e-4f03-b424-9a9648851c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:08.635744 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2908/5766] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:08.637237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8efce6-388e-4f03-b424-9a9648851c7d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:08.662909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23398193-8015-486f-8551-abd2139dc9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:08.663842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398193-8015-486f-8551-abd2139dc9ba admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:08.664417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398193-8015-486f-8551-abd2139dc9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:08.664889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398193-8015-486f-8551-abd2139dc9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:08.665739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23398193-8015-486f-8551-abd2139dc9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:08.676175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23398193-8015-486f-8551-abd2139dc9ba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:08.716947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8efce6-388e-4f03-b424-9a9648851c7d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:08.725827 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2859/5767] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:08 2022] POST /identity/v3/projects => generated 387 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:08.727124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decef653-4c4e-45b2-b3bf-0352e568e425 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:08.727526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decef653-4c4e-45b2-b3bf-0352e568e425 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:08.727879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decef653-4c4e-45b2-b3bf-0352e568e425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:08.732891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:08.734149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:08.734479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:08.735767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/78b0d5e1c551432783bb5ac814828d4a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:08.736871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=78b0d5e1c551432783bb5ac814828d4a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:08.739341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:08.761833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-decef653-4c4e-45b2-b3bf-0352e568e425 None None] MFA Rules not processed for user `b402a590241e48759a2d0db329b0359e`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:08.764118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-decef653-4c4e-45b2-b3bf-0352e568e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:08.810509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b0d5e1c551432783bb5ac814828d4a', 'request_id': 'req-8368e564-7819-495c-b377-db6f8bbc2713'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.822804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b0d5e1c551432783bb5ac814828d4a', 'request_id': 'req-8368e564-7819-495c-b377-db6f8bbc2713'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.834069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b0d5e1c551432783bb5ac814828d4a', 'request_id': 'req-8368e564-7819-495c-b377-db6f8bbc2713'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.850828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project 78b0d5e1c551432783bb5ac814828d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:08.851173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.852943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:08.856873 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2909/5768] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:08 2022] DELETE /identity/v3/projects/78b0d5e1c551432783bb5ac814828d4a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:08.857714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:08.860143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:08.865014 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2860/5769] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:08.868947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decef653-4c4e-45b2-b3bf-0352e568e425 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:08.976919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368e564-7819-495c-b377-db6f8bbc2713 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:08.988585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:08.989257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:08.989882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:08.989882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:08.994230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:09.015965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decef653-4c4e-45b2-b3bf-0352e568e425 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:09.092819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:09.094439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:09.108906 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2910/5770] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:09.109934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:09.113398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:09.164452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71101fa-7087-4547-9b97-edcd644117c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:09.172775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71101fa-7087-4547-9b97-edcd644117c4 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:09.173269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71101fa-7087-4547-9b97-edcd644117c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:09.173710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71101fa-7087-4547-9b97-edcd644117c4 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:09.174536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71101fa-7087-4547-9b97-edcd644117c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:09.178087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71101fa-7087-4547-9b97-edcd644117c4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:09.217293 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2861/5771] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:08 2022] POST /identity/v3/users => generated 300 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:09.218299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71101fa-7087-4547-9b97-edcd644117c4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:09.229836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b71101fa-7087-4547-9b97-edcd644117c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:09.253153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331df99f-7908-439b-bceb-de94bf74ea9c service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:09.263669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:09.264774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:09.265060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:09.265410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/f159861eada04e989bb2f438b4292d68` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:09.266684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f159861eada04e989bb2f438b4292d68)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:09.273311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:09.348012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71101fa-7087-4547-9b97-edcd644117c4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:09.360262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f159861eada04e989bb2f438b4292d68', 'request_id': 'req-2c743c44-0d85-41a1-8154-5d01d00e2de1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.379463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f159861eada04e989bb2f438b4292d68', 'request_id': 'req-2c743c44-0d85-41a1-8154-5d01d00e2de1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.388257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f159861eada04e989bb2f438b4292d68', 'request_id': 'req-2c743c44-0d85-41a1-8154-5d01d00e2de1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.401675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project f159861eada04e989bb2f438b4292d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:09.402055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.402700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.404723 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2911/5772] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:09 2022] DELETE /identity/v3/projects/f159861eada04e989bb2f438b4292d68 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:09.405682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:09.407664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:09.474057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297922-3e86-4977-9f3c-146a6c7205ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:09.474726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297922-3e86-4977-9f3c-146a6c7205ad service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:09.475012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297922-3e86-4977-9f3c-146a6c7205ad service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:09.475363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61297922-3e86-4977-9f3c-146a6c7205ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:09.480654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-61297922-3e86-4977-9f3c-146a6c7205ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:09.510983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c743c44-0d85-41a1-8154-5d01d00e2de1 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:09.516091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54914ef-3055-4a7c-a94b-5151dccbe08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:09.516952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54914ef-3055-4a7c-a94b-5151dccbe08d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:09.517301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54914ef-3055-4a7c-a94b-5151dccbe08d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:09.517640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54914ef-3055-4a7c-a94b-5151dccbe08d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:09.518482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54914ef-3055-4a7c-a94b-5151dccbe08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:09.520470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54914ef-3055-4a7c-a94b-5151dccbe08d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:09.540466 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2912/5773] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:09.541493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54914ef-3055-4a7c-a94b-5151dccbe08d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:09.544652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c54914ef-3055-4a7c-a94b-5151dccbe08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:09.612306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297922-3e86-4977-9f3c-146a6c7205ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:09.614091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61297922-3e86-4977-9f3c-146a6c7205ad service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:09.636240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54914ef-3055-4a7c-a94b-5151dccbe08d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:09.645292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:09.645486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2862/5774] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:09.646325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297922-3e86-4977-9f3c-146a6c7205ad service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:09.646462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:09.651094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:09.651538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/domains/c5062d1ecebd46c2bc01d2a03b4dea43` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:09.653503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c5062d1ecebd46c2bc01d2a03b4dea43)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:09.655695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:09.675979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61297922-3e86-4977-9f3c-146a6c7205ad service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:09.683952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.684504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.687518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7737d8-d853-4455-b43d-094b4c7b3415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:09.688456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7737d8-d853-4455-b43d-094b4c7b3415 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:09.689559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7737d8-d853-4455-b43d-094b4c7b3415 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:09.689842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7737d8-d853-4455-b43d-094b4c7b3415 admin admin] PATH_INFO: `/v3/projects/77943410921f4996909908ab6806a2a1/users/0ba639b89f7c49a18b63829c6223a058/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:09.716575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.717326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.720433 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2913/5775] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:09:09 2022] PATCH /identity/v3/domains/c5062d1ecebd46c2bc01d2a03b4dea43 => generated 277 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:09.721876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:09.727748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:09.732322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7737d8-d853-4455-b43d-094b4c7b3415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77943410921f4996909908ab6806a2a1, user_id=0ba639b89f7c49a18b63829c6223a058, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:09.735018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7737d8-d853-4455-b43d-094b4c7b3415 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:09.765411 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2863/5776] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:09 2022] PUT /identity/v3/projects/77943410921f4996909908ab6806a2a1/users/0ba639b89f7c49a18b63829c6223a058/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:09.766347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7737d8-d853-4455-b43d-094b4c7b3415 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:09.769723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ea7737d8-d853-4455-b43d-094b4c7b3415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:09.918987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7737d8-d853-4455-b43d-094b4c7b3415 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:09.928251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411af16b-8c90-42e5-b978-6821caf0918e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:09.928397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:09.929456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:09.929903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:09.930287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/domains/c5062d1ecebd46c2bc01d2a03b4dea43` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:09.946477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c5062d1ecebd46c2bc01d2a03b4dea43)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:09.948359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:09.992576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:09.997024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.181786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43', 'request_id': 'req-71b76a87-81bd-48fc-9d4d-1b205dc92164'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.203942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:10.205803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:10.206287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:10.206788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] PATH_INFO: `/v3/projects/e3d333dbb48e416e88ee38a517995266` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:10.210170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d333dbb48e416e88ee38a517995266)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:10.212449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:10.233015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43', 'request_id': 'req-71b76a87-81bd-48fc-9d4d-1b205dc92164'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.249023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43', 'request_id': 'req-71b76a87-81bd-48fc-9d4d-1b205dc92164'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.279350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project c5062d1ecebd46c2bc01d2a03b4dea43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:10.280689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.281078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.309903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43', 'request_id': 'req-71b76a87-81bd-48fc-9d4d-1b205dc92164'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.310841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43', 'request_id': 'req-71b76a87-81bd-48fc-9d4d-1b205dc92164'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.311526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c5062d1ecebd46c2bc01d2a03b4dea43', 'request_id': 'req-71b76a87-81bd-48fc-9d4d-1b205dc92164'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.325090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d333dbb48e416e88ee38a517995266', 'request_id': 'req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.338275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d333dbb48e416e88ee38a517995266', 'request_id': 'req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.346223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d333dbb48e416e88ee38a517995266', 'request_id': 'req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.349133 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2864/5777] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:09 2022] DELETE /identity/v3/domains/c5062d1ecebd46c2bc01d2a03b4dea43 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:10.351188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:10.358749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:10.360244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] The token cache is being invalidate because project e3d333dbb48e416e88ee38a517995266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:10.360677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.361466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.366184 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2914/5778] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:09 2022] DELETE /identity/v3/projects/e3d333dbb48e416e88ee38a517995266 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:10.366184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:10.366552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:10.488555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b6816-d8d8-4235-9e7e-b91d76dc25a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:10.492280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b76a87-81bd-48fc-9d4d-1b205dc92164 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:10.502181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:10.504352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:10.504658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:10.504908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:10.510202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:10.622459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47305c6-e06a-4a82-8c1c-f7fcfde781cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:10.623249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47305c6-e06a-4a82-8c1c-f7fcfde781cf admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:10.624205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47305c6-e06a-4a82-8c1c-f7fcfde781cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:10.624497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47305c6-e06a-4a82-8c1c-f7fcfde781cf admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:10.625572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47305c6-e06a-4a82-8c1c-f7fcfde781cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:10.628342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47305c6-e06a-4a82-8c1c-f7fcfde781cf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:10.644593 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2865/5779] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:10.646605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47305c6-e06a-4a82-8c1c-f7fcfde781cf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:10.649918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c47305c6-e06a-4a82-8c1c-f7fcfde781cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:10.671241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:10.675873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:10.735315 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2915/5780] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:10.735315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:10.740520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:10.802456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3eab7-3085-4f57-906c-fd75942fa7a0 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:10.816666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:10.818102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47305c6-e06a-4a82-8c1c-f7fcfde781cf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:10.828487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:10.832208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:10.832936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] PATH_INFO: `/v3/users/2aed4ad5a5f048cab67022f2730cf19c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:10.836090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ae2b0-8f8d-46f7-b497-c66721c79fc4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:10.836824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aed4ad5a5f048cab67022f2730cf19c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:10.840421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ae2b0-8f8d-46f7-b497-c66721c79fc4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:10.840684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ae2b0-8f8d-46f7-b497-c66721c79fc4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:10.840872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ae2b0-8f8d-46f7-b497-c66721c79fc4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:10.841595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ae2b0-8f8d-46f7-b497-c66721c79fc4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:10.842456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:10.845685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ae2b0-8f8d-46f7-b497-c66721c79fc4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:10.929550 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2866/5781] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:10 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:10.929550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ae2b0-8f8d-46f7-b497-c66721c79fc4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:10.934619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-874ae2b0-8f8d-46f7-b497-c66721c79fc4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:10.938435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aed4ad5a5f048cab67022f2730cf19c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.950091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aed4ad5a5f048cab67022f2730cf19c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.950927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aed4ad5a5f048cab67022f2730cf19c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.951846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aed4ad5a5f048cab67022f2730cf19c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:10.969937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aed4ad5a5f048cab67022f2730cf19c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.012672 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2916/5782] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:10 2022] DELETE /identity/v3/users/2aed4ad5a5f048cab67022f2730cf19c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:11.015069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:11.019589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:11.119398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ae2b0-8f8d-46f7-b497-c66721c79fc4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:11.159627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d9466-2a37-4cca-8b4f-ca501108ec83 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:11.165343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac44787-7168-4c9a-9779-68af85053c8b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:11.166376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac44787-7168-4c9a-9779-68af85053c8b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:11.166729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac44787-7168-4c9a-9779-68af85053c8b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:11.167118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac44787-7168-4c9a-9779-68af85053c8b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/ca66e7d2319e4db7ac1b072c2208f88c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:11.168510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac44787-7168-4c9a-9779-68af85053c8b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:get_project(project_id=ca66e7d2319e4db7ac1b072c2208f88c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:11.170789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac44787-7168-4c9a-9779-68af85053c8b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:11.180118 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2917/5783] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:11 2022] GET /identity/v3/projects/ca66e7d2319e4db7ac1b072c2208f88c => generated 377 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:11.181279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac44787-7168-4c9a-9779-68af85053c8b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:11.200360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac44787-7168-4c9a-9779-68af85053c8b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:11.209563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2983f6-1d45-4bd6-986d-3eddbe0b4f0e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:11.210463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2983f6-1d45-4bd6-986d-3eddbe0b4f0e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:11.212243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2983f6-1d45-4bd6-986d-3eddbe0b4f0e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:11.212685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2983f6-1d45-4bd6-986d-3eddbe0b4f0e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:11.215182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2983f6-1d45-4bd6-986d-3eddbe0b4f0e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:11.219820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2983f6-1d45-4bd6-986d-3eddbe0b4f0e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:11.277797 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2918/5784] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Mar 26 21:09:11 2022] GET /identity/v3/projects => generated 6594 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:11.279477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2983f6-1d45-4bd6-986d-3eddbe0b4f0e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:11.298068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2983f6-1d45-4bd6-986d-3eddbe0b4f0e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:11.308491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:11.309645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:11.309929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:11.310284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/ca66e7d2319e4db7ac1b072c2208f88c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:11.311696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ca66e7d2319e4db7ac1b072c2208f88c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:11.316351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:11.331090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b5aaa-a084-4bed-b414-b127787b5350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:11.332731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b5aaa-a084-4bed-b414-b127787b5350 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:11.333158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b5aaa-a084-4bed-b414-b127787b5350 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:11.333502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b5aaa-a084-4bed-b414-b127787b5350 admin admin] PATH_INFO: `/v3/projects/77943410921f4996909908ab6806a2a1/users/0ba639b89f7c49a18b63829c6223a058/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:11.339270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b5aaa-a084-4bed-b414-b127787b5350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77943410921f4996909908ab6806a2a1, user_id=0ba639b89f7c49a18b63829c6223a058, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:11.341101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b5aaa-a084-4bed-b414-b127787b5350 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:11.354882 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2867/5785] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:10 2022] PUT /identity/v3/projects/77943410921f4996909908ab6806a2a1/users/0ba639b89f7c49a18b63829c6223a058/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:11.476260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca66e7d2319e4db7ac1b072c2208f88c', 'request_id': 'req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.502411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca66e7d2319e4db7ac1b072c2208f88c', 'request_id': 'req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.507271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b5aaa-a084-4bed-b414-b127787b5350 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:11.509989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-982b5aaa-a084-4bed-b414-b127787b5350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:11.510135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca66e7d2319e4db7ac1b072c2208f88c', 'request_id': 'req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.526517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project ca66e7d2319e4db7ac1b072c2208f88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:11.527041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.528157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.530538 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2919/5786] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:11 2022] DELETE /identity/v3/projects/ca66e7d2319e4db7ac1b072c2208f88c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:11.535996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:11.538170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:11.618346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b5aaa-a084-4bed-b414-b127787b5350 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:11.663249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5eb42a-2651-4bf9-90d8-3c163ce59ac9 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:11.670254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dda85-33e1-417f-a18a-121d06cc5329 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:11.670949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dda85-33e1-417f-a18a-121d06cc5329 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:11.671490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dda85-33e1-417f-a18a-121d06cc5329 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:11.671812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dda85-33e1-417f-a18a-121d06cc5329 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:11.672520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dda85-33e1-417f-a18a-121d06cc5329 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:11.675191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dda85-33e1-417f-a18a-121d06cc5329 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:11.707523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:11.708487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:11.708838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:11.709049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] PATH_INFO: `/v3/users/b402a590241e48759a2d0db329b0359e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:11.721386 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2920/5787] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:09:11 2022] POST /identity/v3/projects => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:11.723398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b402a590241e48759a2d0db329b0359e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:11.725265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dda85-33e1-417f-a18a-121d06cc5329 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:11.725509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:11.812621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b402a590241e48759a2d0db329b0359e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.833834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b402a590241e48759a2d0db329b0359e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.834907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b402a590241e48759a2d0db329b0359e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.835828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b402a590241e48759a2d0db329b0359e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.863470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dda85-33e1-417f-a18a-121d06cc5329 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:11.868677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b402a590241e48759a2d0db329b0359e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:11.882280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:11.884471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:11.885005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:11.885619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/c3ed5cc45cf44639834a8991022613b4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:11.888802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:update_project(project_id=c3ed5cc45cf44639834a8991022613b4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:11.893249 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:11.893249 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:11.893249 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:11.895258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:11.901056 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2868/5788] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:11 2022] DELETE /identity/v3/users/b402a590241e48759a2d0db329b0359e => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:11.903270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:11.906900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:11.965767 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2921/5789] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Mar 26 21:09:11 2022] PATCH /identity/v3/projects/c3ed5cc45cf44639834a8991022613b4 => generated 361 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:09:11.968740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:11.973120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:12.005317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2376c9-f08c-4fe5-8c8b-2c188b2cdfb4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:12.055530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec60bb-528b-44ed-9ae8-5b4e3c3a7d6a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:12.066724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:12.067609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:12.067901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:12.068211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] PATH_INFO: `/v3/projects/1b6e856c71ca4187bae8ea450adc9fac` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:12.071198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6e856c71ca4187bae8ea450adc9fac)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:12.076966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:12.100749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ccc1-b86b-40e2-aa55-36f740d46de7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:12.102557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ccc1-b86b-40e2-aa55-36f740d46de7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:12.103239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ccc1-b86b-40e2-aa55-36f740d46de7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:12.103993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ccc1-b86b-40e2-aa55-36f740d46de7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/c3ed5cc45cf44639834a8991022613b4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:12.122197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854ccc1-b86b-40e2-aa55-36f740d46de7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:get_project(project_id=c3ed5cc45cf44639834a8991022613b4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:12.125116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854ccc1-b86b-40e2-aa55-36f740d46de7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:12.131139 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2922/5790] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:11 2022] GET /identity/v3/projects/c3ed5cc45cf44639834a8991022613b4 => generated 348 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:12.132471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ccc1-b86b-40e2-aa55-36f740d46de7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:12.144533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ccc1-b86b-40e2-aa55-36f740d46de7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:12.160241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6e856c71ca4187bae8ea450adc9fac', 'request_id': 'req-a494e761-d6ff-4b75-9555-c6e55dd81339'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.169703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6e856c71ca4187bae8ea450adc9fac', 'request_id': 'req-a494e761-d6ff-4b75-9555-c6e55dd81339'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.185190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6e856c71ca4187bae8ea450adc9fac', 'request_id': 'req-a494e761-d6ff-4b75-9555-c6e55dd81339'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.199995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] The token cache is being invalidate because project 1b6e856c71ca4187bae8ea450adc9fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:12.200606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.202127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.206687 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2869/5791] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:11 2022] DELETE /identity/v3/projects/1b6e856c71ca4187bae8ea450adc9fac => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:12.210854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:12.213429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:12.239295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:12.240704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:12.240704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:12.240917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/c3ed5cc45cf44639834a8991022613b4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:12.243522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c3ed5cc45cf44639834a8991022613b4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:12.263086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:12.367643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494e761-d6ff-4b75-9555-c6e55dd81339 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:12.384100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3ed5cc45cf44639834a8991022613b4', 'request_id': 'req-3fc2b578-5191-4084-ac1b-807348d3205b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.395936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3ed5cc45cf44639834a8991022613b4', 'request_id': 'req-3fc2b578-5191-4084-ac1b-807348d3205b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.405151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3ed5cc45cf44639834a8991022613b4', 'request_id': 'req-3fc2b578-5191-4084-ac1b-807348d3205b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.419542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project c3ed5cc45cf44639834a8991022613b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:12.419836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.420690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.422393 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2923/5792] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:12 2022] DELETE /identity/v3/projects/c3ed5cc45cf44639834a8991022613b4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:12.426276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:12.429674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:12.471279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:12.472267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:12.472620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:12.472964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] PATH_INFO: `/v3/users/289527031a964db2ae745e571a514602` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:12.475203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=289527031a964db2ae745e571a514602)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:12.477782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:12.513086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2b578-5191-4084-ac1b-807348d3205b tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:12.519788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:12.520987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:12.521281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:12.521966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] PATH_INFO: `/v3/projects/0aee9d7189834141b6881cd81ddb821c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:12.523947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aee9d7189834141b6881cd81ddb821c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:12.525797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:12.575350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289527031a964db2ae745e571a514602'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.586244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289527031a964db2ae745e571a514602'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.586996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289527031a964db2ae745e571a514602'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.587768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289527031a964db2ae745e571a514602'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.610236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289527031a964db2ae745e571a514602'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.620499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aee9d7189834141b6881cd81ddb821c', 'request_id': 'req-7d263617-37e7-4af3-96df-271be8da53cd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.631960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aee9d7189834141b6881cd81ddb821c', 'request_id': 'req-7d263617-37e7-4af3-96df-271be8da53cd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.632893 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2870/5793] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:12 2022] DELETE /identity/v3/users/289527031a964db2ae745e571a514602 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:12.634059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:12.636818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:12.638630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aee9d7189834141b6881cd81ddb821c', 'request_id': 'req-7d263617-37e7-4af3-96df-271be8da53cd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.659680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] The token cache is being invalidate because project 0aee9d7189834141b6881cd81ddb821c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:12.660079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.663104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:12.665575 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2924/5794] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:12 2022] DELETE /identity/v3/projects/0aee9d7189834141b6881cd81ddb821c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:12.667052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:12.668862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:12.768294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d263617-37e7-4af3-96df-271be8da53cd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:12.778796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207459a8-9c17-4540-8555-09aaefd7ff84 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:12.794762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730cbf-5641-456b-a1e9-2e942a07e419 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:12.795449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730cbf-5641-456b-a1e9-2e942a07e419 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:12.795794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730cbf-5641-456b-a1e9-2e942a07e419 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:12.796105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730cbf-5641-456b-a1e9-2e942a07e419 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:12.802691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09730cbf-5641-456b-a1e9-2e942a07e419 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:12.805642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09730cbf-5641-456b-a1e9-2e942a07e419 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:12.869374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac8723-f909-4c56-b64e-3c40cb3622d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:12.869953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac8723-f909-4c56-b64e-3c40cb3622d1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:12.870642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac8723-f909-4c56-b64e-3c40cb3622d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:12.871610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac8723-f909-4c56-b64e-3c40cb3622d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:12.874728 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2871/5795] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:12 2022] POST /identity/v3/projects => generated 359 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:12.875528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-44ac8723-f909-4c56-b64e-3c40cb3622d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:12.880258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1d284-1973-4c89-9e04-f40166daf9f8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:12.880557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1d284-1973-4c89-9e04-f40166daf9f8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:12.881586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1d284-1973-4c89-9e04-f40166daf9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:12.923762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5cc1d284-1973-4c89-9e04-f40166daf9f8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:12.925443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5cc1d284-1973-4c89-9e04-f40166daf9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.050273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac8723-f909-4c56-b64e-3c40cb3622d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.052658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac8723-f909-4c56-b64e-3c40cb3622d1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.066740 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2872/5796] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:13.068390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1d284-1973-4c89-9e04-f40166daf9f8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.070669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5cc1d284-1973-4c89-9e04-f40166daf9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.087864 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2925/5797] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:13.091068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f410ce1-bade-4661-adcd-b3069980a538 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.091364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f410ce1-bade-4661-adcd-b3069980a538 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.091642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f410ce1-bade-4661-adcd-b3069980a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.135185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2f410ce1-bade-4661-adcd-b3069980a538 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:13.136713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2f410ce1-bade-4661-adcd-b3069980a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.147214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2926/5798] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:13.153527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f410ce1-bade-4661-adcd-b3069980a538 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.171793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f410ce1-bade-4661-adcd-b3069980a538 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.190416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1d284-1973-4c89-9e04-f40166daf9f8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.198278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdcb6a-edb5-41ab-84f7-30f70fa6a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.198811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdcb6a-edb5-41ab-84f7-30f70fa6a18e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.199096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdcb6a-edb5-41ab-84f7-30f70fa6a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.199376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdcb6a-edb5-41ab-84f7-30f70fa6a18e admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.200335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdcb6a-edb5-41ab-84f7-30f70fa6a18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:13.200610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdcb6a-edb5-41ab-84f7-30f70fa6a18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.202751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdcb6a-edb5-41ab-84f7-30f70fa6a18e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.205927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e0ee-bbbc-4634-a784-45285d5e6c02 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.206803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e0ee-bbbc-4634-a784-45285d5e6c02 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.207081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e0ee-bbbc-4634-a784-45285d5e6c02 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.207353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e0ee-bbbc-4634-a784-45285d5e6c02 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/7fb57be6b5234818a93b64e57880810f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.208687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7e0ee-bbbc-4634-a784-45285d5e6c02 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:update_project(project_id=7fb57be6b5234818a93b64e57880810f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.212070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7e0ee-bbbc-4634-a784-45285d5e6c02 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.221540 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2927/5799] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:13.225900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdcb6a-edb5-41ab-84f7-30f70fa6a18e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.266653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdcb6a-edb5-41ab-84f7-30f70fa6a18e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.280390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6a36e-0d50-478d-9fdb-a36e3d4f13a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.281208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6a36e-0d50-478d-9fdb-a36e3d4f13a5 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.281601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6a36e-0d50-478d-9fdb-a36e3d4f13a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.282051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6a36e-0d50-478d-9fdb-a36e3d4f13a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.284100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6a36e-0d50-478d-9fdb-a36e3d4f13a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.287102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6a36e-0d50-478d-9fdb-a36e3d4f13a5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.319798 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2873/5800] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Mar 26 21:09:13 2022] PATCH /identity/v3/projects/7fb57be6b5234818a93b64e57880810f => generated 371 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:13.320779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e0ee-bbbc-4634-a784-45285d5e6c02 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.330513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-21c7e0ee-bbbc-4634-a784-45285d5e6c02 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.362982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e0ee-bbbc-4634-a784-45285d5e6c02 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.367054 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2928/5801] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:13 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:13.368486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6a36e-0d50-478d-9fdb-a36e3d4f13a5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.377781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.381183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.381653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.382033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] PATH_INFO: `/v3/projects/736f13cfe98648af881b354a452c715e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.383589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=736f13cfe98648af881b354a452c715e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.387330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.461888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736f13cfe98648af881b354a452c715e', 'request_id': 'req-cd475cbd-750b-4816-835d-b6dbce307617'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.469677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6a36e-0d50-478d-9fdb-a36e3d4f13a5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.472519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736f13cfe98648af881b354a452c715e', 'request_id': 'req-cd475cbd-750b-4816-835d-b6dbce307617'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.486226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736f13cfe98648af881b354a452c715e', 'request_id': 'req-cd475cbd-750b-4816-835d-b6dbce307617'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.504038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] The token cache is being invalidate because project 736f13cfe98648af881b354a452c715e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:13.504378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.505433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.512904 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2874/5802] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:13 2022] DELETE /identity/v3/projects/736f13cfe98648af881b354a452c715e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:13.513743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.516099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.604101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e923d5-71b2-4456-a6c3-da0b9ecabea4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.605793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e923d5-71b2-4456-a6c3-da0b9ecabea4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.606088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e923d5-71b2-4456-a6c3-da0b9ecabea4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.607481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e923d5-71b2-4456-a6c3-da0b9ecabea4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/7fb57be6b5234818a93b64e57880810f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.615106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd475cbd-750b-4816-835d-b6dbce307617 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.622500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330f92-5a8a-477d-ad11-581b0a25511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.623989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330f92-5a8a-477d-ad11-581b0a25511c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.624571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330f92-5a8a-477d-ad11-581b0a25511c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.625448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330f92-5a8a-477d-ad11-581b0a25511c admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.627150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff330f92-5a8a-477d-ad11-581b0a25511c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.630076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff330f92-5a8a-477d-ad11-581b0a25511c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.635561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e923d5-71b2-4456-a6c3-da0b9ecabea4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:get_project(project_id=7fb57be6b5234818a93b64e57880810f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.645682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e923d5-71b2-4456-a6c3-da0b9ecabea4 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.653793 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2929/5803] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:13 2022] GET /identity/v3/projects/7fb57be6b5234818a93b64e57880810f => generated 358 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:13.658479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2d64f-d332-412b-9b37-b509c572664f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.658774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2d64f-d332-412b-9b37-b509c572664f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.659049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2d64f-d332-412b-9b37-b509c572664f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.662928 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2875/5804] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:13 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:13.665634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330f92-5a8a-477d-ad11-581b0a25511c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.668265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ff330f92-5a8a-477d-ad11-581b0a25511c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.686866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330f92-5a8a-477d-ad11-581b0a25511c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.693204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.695719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.695719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.695719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/7fb57be6b5234818a93b64e57880810f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.696978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7fb57be6b5234818a93b64e57880810f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.699048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.717013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-20a2d64f-d332-412b-9b37-b509c572664f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:13.718478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-20a2d64f-d332-412b-9b37-b509c572664f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.740437 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2930/5805] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:13.742167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2d64f-d332-412b-9b37-b509c572664f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.758269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2d64f-d332-412b-9b37-b509c572664f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.784201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb57be6b5234818a93b64e57880810f', 'request_id': 'req-9feaa529-4905-49ea-a95e-4afad2a6bc34'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.800895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb57be6b5234818a93b64e57880810f', 'request_id': 'req-9feaa529-4905-49ea-a95e-4afad2a6bc34'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.816651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb57be6b5234818a93b64e57880810f', 'request_id': 'req-9feaa529-4905-49ea-a95e-4afad2a6bc34'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.834786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project 7fb57be6b5234818a93b64e57880810f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:13.835237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.836044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9feaa529-4905-49ea-a95e-4afad2a6bc34 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:13.836931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f566b3-cb53-4f27-aa06-5b42b7cad9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.837776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f566b3-cb53-4f27-aa06-5b42b7cad9c5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.838168 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2876/5806] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:13 2022] DELETE /identity/v3/projects/7fb57be6b5234818a93b64e57880810f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:13.838377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f566b3-cb53-4f27-aa06-5b42b7cad9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.839574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4b702-b89b-4424-9ded-2bf2cc1aa4d0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.839878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f566b3-cb53-4f27-aa06-5b42b7cad9c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.840061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4b702-b89b-4424-9ded-2bf2cc1aa4d0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.840449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4b702-b89b-4424-9ded-2bf2cc1aa4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.841166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f566b3-cb53-4f27-aa06-5b42b7cad9c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.844218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f566b3-cb53-4f27-aa06-5b42b7cad9c5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.862593 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2931/5807] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:13.865418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f566b3-cb53-4f27-aa06-5b42b7cad9c5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.869393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-17f566b3-cb53-4f27-aa06-5b42b7cad9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.870090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bfe4b702-b89b-4424-9ded-2bf2cc1aa4d0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:13.871511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bfe4b702-b89b-4424-9ded-2bf2cc1aa4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.887035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2877/5808] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:13.888295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4b702-b89b-4424-9ded-2bf2cc1aa4d0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.890222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bfe4b702-b89b-4424-9ded-2bf2cc1aa4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:13.910165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4b702-b89b-4424-9ded-2bf2cc1aa4d0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.921422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6124e9-1f6f-4b66-924f-659bb85e021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.922388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6124e9-1f6f-4b66-924f-659bb85e021f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.922867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6124e9-1f6f-4b66-924f-659bb85e021f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.923264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6124e9-1f6f-4b66-924f-659bb85e021f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.924110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6124e9-1f6f-4b66-924f-659bb85e021f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.926025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6124e9-1f6f-4b66-924f-659bb85e021f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.939790 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2878/5809] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:13.941126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6124e9-1f6f-4b66-924f-659bb85e021f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.953601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6124e9-1f6f-4b66-924f-659bb85e021f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.961033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32608529-87dd-4441-ab8a-025fa3e37de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:13.961971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32608529-87dd-4441-ab8a-025fa3e37de3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:13.962444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32608529-87dd-4441-ab8a-025fa3e37de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:13.962794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32608529-87dd-4441-ab8a-025fa3e37de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:13.963965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32608529-87dd-4441-ab8a-025fa3e37de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:13.964354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32608529-87dd-4441-ab8a-025fa3e37de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:13.966512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32608529-87dd-4441-ab8a-025fa3e37de3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:13.983165 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2879/5810] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:13.984358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32608529-87dd-4441-ab8a-025fa3e37de3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:13.988796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f566b3-cb53-4f27-aa06-5b42b7cad9c5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:13.997137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32608529-87dd-4441-ab8a-025fa3e37de3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.004075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1ee6e-3ffc-47c2-b150-3bd46cba69de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.005140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1ee6e-3ffc-47c2-b150-3bd46cba69de admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.005494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1ee6e-3ffc-47c2-b150-3bd46cba69de admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.006266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1ee6e-3ffc-47c2-b150-3bd46cba69de admin admin] PATH_INFO: `/v3/projects/97d8cf03facb404b81a31014cf74f93c/users/4e069c88bde243a39d59ee5a170f5094/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.008748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbadb1-1586-46d3-bf6f-5c112d16a748 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.009885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbadb1-1586-46d3-bf6f-5c112d16a748 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.010351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbadb1-1586-46d3-bf6f-5c112d16a748 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.010783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbadb1-1586-46d3-bf6f-5c112d16a748 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.011636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbadb1-1586-46d3-bf6f-5c112d16a748 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.016308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbadb1-1586-46d3-bf6f-5c112d16a748 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.048952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1ee6e-3ffc-47c2-b150-3bd46cba69de admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d8cf03facb404b81a31014cf74f93c, user_id=4e069c88bde243a39d59ee5a170f5094, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.052114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1ee6e-3ffc-47c2-b150-3bd46cba69de admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.073129 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2932/5811] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:13 2022] POST /identity/v3/projects => generated 355 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:14.074560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbadb1-1586-46d3-bf6f-5c112d16a748 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.101343 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2880/5812] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:13 2022] PUT /identity/v3/projects/97d8cf03facb404b81a31014cf74f93c/users/4e069c88bde243a39d59ee5a170f5094/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:14.102278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1ee6e-3ffc-47c2-b150-3bd46cba69de admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.187674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbadb1-1586-46d3-bf6f-5c112d16a748 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.285394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1ee6e-3ffc-47c2-b150-3bd46cba69de admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.290627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cb308-11e5-4b04-8a72-29bd81ee5359 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.291503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cb308-11e5-4b04-8a72-29bd81ee5359 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.291799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cb308-11e5-4b04-8a72-29bd81ee5359 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.292195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cb308-11e5-4b04-8a72-29bd81ee5359 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/aeae1fd80f6c415cb4ce4f737eac0c0f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.293410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cb308-11e5-4b04-8a72-29bd81ee5359 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:update_project(project_id=aeae1fd80f6c415cb4ce4f737eac0c0f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.295374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101cb308-11e5-4b04-8a72-29bd81ee5359 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.350043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145add61-8e0b-4e2f-a0ca-60f2502d4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.350801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145add61-8e0b-4e2f-a0ca-60f2502d4544 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.351085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145add61-8e0b-4e2f-a0ca-60f2502d4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.352146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145add61-8e0b-4e2f-a0ca-60f2502d4544 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.352978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145add61-8e0b-4e2f-a0ca-60f2502d4544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.366996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145add61-8e0b-4e2f-a0ca-60f2502d4544 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.420671 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2881/5813] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Mar 26 21:09:14 2022] PATCH /identity/v3/projects/aeae1fd80f6c415cb4ce4f737eac0c0f => generated 369 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:14.425481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34295d50-8ba6-470c-880c-02536b17772f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.426920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34295d50-8ba6-470c-880c-02536b17772f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.427468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34295d50-8ba6-470c-880c-02536b17772f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.442926 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2933/5814] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:14 2022] POST /identity/v3/projects => generated 361 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:14.447963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145add61-8e0b-4e2f-a0ca-60f2502d4544 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.454628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-34295d50-8ba6-470c-880c-02536b17772f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:14.456582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-34295d50-8ba6-470c-880c-02536b17772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:14.566445 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2882/5815] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:14.570597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34295d50-8ba6-470c-880c-02536b17772f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.591937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145add61-8e0b-4e2f-a0ca-60f2502d4544 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.593399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34295d50-8ba6-470c-880c-02536b17772f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.598047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d0260-49d8-4788-b7a7-fe042e468ea7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.599055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d0260-49d8-4788-b7a7-fe042e468ea7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.599205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d0260-49d8-4788-b7a7-fe042e468ea7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.599490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d0260-49d8-4788-b7a7-fe042e468ea7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/aeae1fd80f6c415cb4ce4f737eac0c0f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.603638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92016cb-ff15-428a-ad36-f895a158856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.609734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92016cb-ff15-428a-ad36-f895a158856c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.610296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92016cb-ff15-428a-ad36-f895a158856c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.611766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92016cb-ff15-428a-ad36-f895a158856c admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.612839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92016cb-ff15-428a-ad36-f895a158856c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.613407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d0260-49d8-4788-b7a7-fe042e468ea7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:get_project(project_id=aeae1fd80f6c415cb4ce4f737eac0c0f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.615534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d0260-49d8-4788-b7a7-fe042e468ea7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.617182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92016cb-ff15-428a-ad36-f895a158856c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.621130 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2934/5816] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:14 2022] GET /identity/v3/projects/aeae1fd80f6c415cb4ce4f737eac0c0f => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:14.622067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d0260-49d8-4788-b7a7-fe042e468ea7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.624634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-510d0260-49d8-4788-b7a7-fe042e468ea7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:14.655656 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2883/5817] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:14 2022] POST /identity/v3/users => generated 281 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:14.657003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92016cb-ff15-428a-ad36-f895a158856c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.676787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92016cb-ff15-428a-ad36-f895a158856c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.683990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.685343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.685799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.686244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/projects/aeae1fd80f6c415cb4ce4f737eac0c0f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.688032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aeae1fd80f6c415cb4ce4f737eac0c0f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.690474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.697727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d0260-49d8-4788-b7a7-fe042e468ea7 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.702141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995e187-a222-442b-b603-782985e949b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.702798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995e187-a222-442b-b603-782985e949b5 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.703077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995e187-a222-442b-b603-782985e949b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.703344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995e187-a222-442b-b603-782985e949b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.713799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995e187-a222-442b-b603-782985e949b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.715280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995e187-a222-442b-b603-782985e949b5 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.740666 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2935/5818] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:14.741628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995e187-a222-442b-b603-782985e949b5 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.765015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995e187-a222-442b-b603-782985e949b5 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.781564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeae1fd80f6c415cb4ce4f737eac0c0f', 'request_id': 'req-c2e961ac-4d41-4861-8ba8-710a3848a261'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:14.793978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeae1fd80f6c415cb4ce4f737eac0c0f', 'request_id': 'req-c2e961ac-4d41-4861-8ba8-710a3848a261'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:14.803088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeae1fd80f6c415cb4ce4f737eac0c0f', 'request_id': 'req-c2e961ac-4d41-4861-8ba8-710a3848a261'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:14.828877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] The token cache is being invalidate because project aeae1fd80f6c415cb4ce4f737eac0c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:14.830331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:14.832645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:14.835889 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2884/5819] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:14 2022] DELETE /identity/v3/projects/aeae1fd80f6c415cb4ce4f737eac0c0f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:14.842742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.844590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:14.899694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b37a4-d8bd-40c7-a252-f685cb43d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.902433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b37a4-d8bd-40c7-a252-f685cb43d96d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.903315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b37a4-d8bd-40c7-a252-f685cb43d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.903634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b37a4-d8bd-40c7-a252-f685cb43d96d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.905691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b37a4-d8bd-40c7-a252-f685cb43d96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.911316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b37a4-d8bd-40c7-a252-f685cb43d96d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.929629 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2936/5820] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:14.930633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b37a4-d8bd-40c7-a252-f685cb43d96d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.932827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0d8b37a4-d8bd-40c7-a252-f685cb43d96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:14.950721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b37a4-d8bd-40c7-a252-f685cb43d96d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.957253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879f345-2776-431c-9867-d76eb0734348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.957924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879f345-2776-431c-9867-d76eb0734348 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.958212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879f345-2776-431c-9867-d76eb0734348 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.958494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879f345-2776-431c-9867-d76eb0734348 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.959269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879f345-2776-431c-9867-d76eb0734348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:14.961628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879f345-2776-431c-9867-d76eb0734348 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:14.971420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e961ac-4d41-4861-8ba8-710a3848a261 tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:14.979014 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2937/5821] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:14.979182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e093c-6288-4e14-b973-7be0a3ca5d3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:14.979987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879f345-2776-431c-9867-d76eb0734348 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:14.980592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e093c-6288-4e14-b973-7be0a3ca5d3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:14.981067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e093c-6288-4e14-b973-7be0a3ca5d3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:14.981868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e093c-6288-4e14-b973-7be0a3ca5d3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/domains/c5062d1ecebd46c2bc01d2a03b4dea43` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:14.994945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715e093c-6288-4e14-b973-7be0a3ca5d3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:09:15.002140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879f345-2776-431c-9867-d76eb0734348 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:15.014200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc0ee78-b3c7-4203-911a-6192335584a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:15.017700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0ee78-b3c7-4203-911a-6192335584a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:15.018107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0ee78-b3c7-4203-911a-6192335584a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:15.018295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc0ee78-b3c7-4203-911a-6192335584a3 admin admin] PATH_INFO: `/v3/projects/9003db1828f94eaba2af1c25df3bcc58/users/9d0079b338aa487b9f9060ac177fddaa/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:15.021326 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-715e093c-6288-4e14-b973-7be0a3ca5d3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Could not find domain: c5062d1ecebd46c2bc01d2a03b4dea43.: keystone.exception.DomainNotFound: Could not find domain: c5062d1ecebd46c2bc01d2a03b4dea43. Mar 26 21:09:15.024061 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2885/5822] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:09:14 2022] PATCH /identity/v3/domains/c5062d1ecebd46c2bc01d2a03b4dea43 => generated 112 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:09:15.028563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e093c-6288-4e14-b973-7be0a3ca5d3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:15.043646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e093c-6288-4e14-b973-7be0a3ca5d3d tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:15.050471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e42a9-b809-43a5-abc8-a1d482a17b2e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac36092aa4a2433ca02075af35c24766', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4329f63ab8924c3db1f14a85602b874b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:15.052471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e42a9-b809-43a5-abc8-a1d482a17b2e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:15.052986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e42a9-b809-43a5-abc8-a1d482a17b2e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:15.053491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e42a9-b809-43a5-abc8-a1d482a17b2e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] PATH_INFO: `/v3/domains/255ce960954548bfab8d91f976a70c9b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:15.054847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0ee78-b3c7-4203-911a-6192335584a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9003db1828f94eaba2af1c25df3bcc58, user_id=9d0079b338aa487b9f9060ac177fddaa, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:15.057573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc0ee78-b3c7-4203-911a-6192335584a3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:15.087656 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2938/5823] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:14 2022] PUT /identity/v3/projects/9003db1828f94eaba2af1c25df3bcc58/users/9d0079b338aa487b9f9060ac177fddaa/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:15.101265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6f4de-7f40-45ea-85f5-095bf65925d9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:15.101565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6f4de-7f40-45ea-85f5-095bf65925d9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:15.101825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6f4de-7f40-45ea-85f5-095bf65925d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:15.119732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e42a9-b809-43a5-abc8-a1d482a17b2e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:09:15.133503 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-fe9e42a9-b809-43a5-abc8-a1d482a17b2e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Could not find domain: 255ce960954548bfab8d91f976a70c9b.: keystone.exception.DomainNotFound: Could not find domain: 255ce960954548bfab8d91f976a70c9b. Mar 26 21:09:15.135378 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2886/5824] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:09:15 2022] PATCH /identity/v3/domains/255ce960954548bfab8d91f976a70c9b => generated 112 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:09:15.138980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e42a9-b809-43a5-abc8-a1d482a17b2e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:15.143994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fe9e42a9-b809-43a5-abc8-a1d482a17b2e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:15.173338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-79e6f4de-7f40-45ea-85f5-095bf65925d9 None None] MFA Rules not processed for user `9d0079b338aa487b9f9060ac177fddaa`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:15.174997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e42a9-b809-43a5-abc8-a1d482a17b2e tempest-ProjectsTestJSON-1556496835 tempest-ProjectsTestJSON-1556496835-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:15.175363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-79e6f4de-7f40-45ea-85f5-095bf65925d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:15.268262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:15.269204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:15.269488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:15.269763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] PATH_INFO: `/v3/users/9326cb35e3d14d79aa44ceb732ce2399` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:15.271681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9326cb35e3d14d79aa44ceb732ce2399)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:15.276817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:15.291960 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2939/5825] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:15.330873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6f4de-7f40-45ea-85f5-095bf65925d9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:15.335064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-79e6f4de-7f40-45ea-85f5-095bf65925d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:15.371271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9326cb35e3d14d79aa44ceb732ce2399'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.387657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9326cb35e3d14d79aa44ceb732ce2399'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.388845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9326cb35e3d14d79aa44ceb732ce2399'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.389771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9326cb35e3d14d79aa44ceb732ce2399'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.415035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d8028c30-1e05-4c11-ab9f-100fa740cd97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9326cb35e3d14d79aa44ceb732ce2399'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.458787 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2887/5826] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:15 2022] DELETE /identity/v3/users/9326cb35e3d14d79aa44ceb732ce2399 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:15.463416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36365-882a-421c-aa7d-ac52ac18e002 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:15.463705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36365-882a-421c-aa7d-ac52ac18e002 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:15.464009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b36365-882a-421c-aa7d-ac52ac18e002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:15.473496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6f4de-7f40-45ea-85f5-095bf65925d9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:15.516214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c9b36365-882a-421c-aa7d-ac52ac18e002 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:15.519623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c9b36365-882a-421c-aa7d-ac52ac18e002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:15.632335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:15.635804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:15.636305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:15.636787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:15.642913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:15.741899 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2888/5827] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:15.750581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:15.753006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:15.774775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2940/5828] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:09:15.790442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36365-882a-421c-aa7d-ac52ac18e002 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:15.791895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c9b36365-882a-421c-aa7d-ac52ac18e002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:15.812626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:15.813000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b36365-882a-421c-aa7d-ac52ac18e002 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:15.814605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:15.827968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:15.829345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:15.829627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:15.829903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] PATH_INFO: `/v3/users/9d0079b338aa487b9f9060ac177fddaa` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:15.832876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0079b338aa487b9f9060ac177fddaa)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:15.836761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:15.936543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0079b338aa487b9f9060ac177fddaa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.947008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b51996-4255-47b5-9865-4a1dc64aa1ad service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:15.951471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca62102-921c-4f31-aa1f-0c82445e6b4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:15.952485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca62102-921c-4f31-aa1f-0c82445e6b4e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:15.952772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca62102-921c-4f31-aa1f-0c82445e6b4e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:15.953094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca62102-921c-4f31-aa1f-0c82445e6b4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:15.955946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0079b338aa487b9f9060ac177fddaa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.956739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0079b338aa487b9f9060ac177fddaa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.958319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0079b338aa487b9f9060ac177fddaa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.971721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca62102-921c-4f31-aa1f-0c82445e6b4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:15.975169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca62102-921c-4f31-aa1f-0c82445e6b4e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:15.992719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0079b338aa487b9f9060ac177fddaa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:15.995418 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2941/5829] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:16.020739 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2889/5830] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:15 2022] DELETE /identity/v3/users/9d0079b338aa487b9f9060ac177fddaa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:16.024971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2181cf5-054d-4c7f-b387-51482bcc3e6c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:16.025266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2181cf5-054d-4c7f-b387-51482bcc3e6c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:16.025523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2181cf5-054d-4c7f-b387-51482bcc3e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:16.060616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d2181cf5-054d-4c7f-b387-51482bcc3e6c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:16.063711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d2181cf5-054d-4c7f-b387-51482bcc3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:16.223256 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2942/5831] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:16.238732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:16.240187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:16.367392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc04e6-e02a-4047-8415-2d1df027c60c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:16.371884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1080f-22f7-44ed-ba7c-4789a5369cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:16.372497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1080f-22f7-44ed-ba7c-4789a5369cdd service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:16.372776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1080f-22f7-44ed-ba7c-4789a5369cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:16.373047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1080f-22f7-44ed-ba7c-4789a5369cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:16.397617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1080f-22f7-44ed-ba7c-4789a5369cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:16.399624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1080f-22f7-44ed-ba7c-4789a5369cdd service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:16.426382 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2890/5832] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:17.375415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2181cf5-054d-4c7f-b387-51482bcc3e6c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:17.377820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d2181cf5-054d-4c7f-b387-51482bcc3e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:17.399252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2181cf5-054d-4c7f-b387-51482bcc3e6c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:17.406133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:17.407251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:17.407679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:17.408130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] PATH_INFO: `/v3/projects/ce5238e1a02e4dc5be49582d3592e83e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:17.409557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5238e1a02e4dc5be49582d3592e83e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:17.411778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:17.474713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5238e1a02e4dc5be49582d3592e83e', 'request_id': 'req-4b520ad1-172b-4c87-8636-c4777d9433ee'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.488095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5238e1a02e4dc5be49582d3592e83e', 'request_id': 'req-4b520ad1-172b-4c87-8636-c4777d9433ee'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.498708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5238e1a02e4dc5be49582d3592e83e', 'request_id': 'req-4b520ad1-172b-4c87-8636-c4777d9433ee'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.513502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] The token cache is being invalidate because project ce5238e1a02e4dc5be49582d3592e83e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:17.514158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.515366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.520650 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2943/5833] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:17 2022] DELETE /identity/v3/projects/ce5238e1a02e4dc5be49582d3592e83e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:17.523729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1080f-22f7-44ed-ba7c-4789a5369cdd service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:17.537173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1080f-22f7-44ed-ba7c-4789a5369cdd service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:17.625254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:17.626737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:17.627076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:17.627352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] PATH_INFO: `/v3/users/ac36092aa4a2433ca02075af35c24766` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:17.629437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac36092aa4a2433ca02075af35c24766)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:17.631305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:17.729148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac36092aa4a2433ca02075af35c24766'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.734643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:17.739258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:17.751561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac36092aa4a2433ca02075af35c24766'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.752376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac36092aa4a2433ca02075af35c24766'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.753146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac36092aa4a2433ca02075af35c24766'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.769875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5ba7f3bf-130e-4dfa-90b6-7a5a5a95ea44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac36092aa4a2433ca02075af35c24766'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.779657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b520ad1-172b-4c87-8636-c4777d9433ee admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:17.787390 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2891/5834] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:17 2022] DELETE /identity/v3/users/ac36092aa4a2433ca02075af35c24766 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:17.790144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:17.791712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:17.792222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:17.793718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] PATH_INFO: `/v3/projects/9003db1828f94eaba2af1c25df3bcc58` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:17.795417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9003db1828f94eaba2af1c25df3bcc58)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:17.799410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:17.943076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9003db1828f94eaba2af1c25df3bcc58', 'request_id': 'req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.960215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9003db1828f94eaba2af1c25df3bcc58', 'request_id': 'req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.967173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9003db1828f94eaba2af1c25df3bcc58', 'request_id': 'req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.990644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] The token cache is being invalidate because project 9003db1828f94eaba2af1c25df3bcc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:17.991402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.992579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1113e117-8ae5-4fe8-8d9c-030c7bfefc95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:17.995571 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2944/5835] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:17 2022] DELETE /identity/v3/projects/9003db1828f94eaba2af1c25df3bcc58 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:18.000344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575111-2d14-4e2f-8195-dba93c5ae657 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:18.000836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575111-2d14-4e2f-8195-dba93c5ae657 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:18.001917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575111-2d14-4e2f-8195-dba93c5ae657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:18.030097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cc575111-2d14-4e2f-8195-dba93c5ae657 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:18.033043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cc575111-2d14-4e2f-8195-dba93c5ae657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:18.169580 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2892/5836] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:18.177585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a9f0-fdac-4a40-92f0-ec9339628997 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:18.178359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a9f0-fdac-4a40-92f0-ec9339628997 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:18.179018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336a9f0-fdac-4a40-92f0-ec9339628997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:18.214592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e336a9f0-fdac-4a40-92f0-ec9339628997 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:18.216966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e336a9f0-fdac-4a40-92f0-ec9339628997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:18.231573 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2945/5837] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:18.236298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc575111-2d14-4e2f-8195-dba93c5ae657 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:18.267386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc575111-2d14-4e2f-8195-dba93c5ae657 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:18.277707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c4b20-7cb8-40a1-845b-ac4106b00a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:18.279004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c4b20-7cb8-40a1-845b-ac4106b00a75 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:18.280301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c4b20-7cb8-40a1-845b-ac4106b00a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:18.281198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c4b20-7cb8-40a1-845b-ac4106b00a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:18.283001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c4b20-7cb8-40a1-845b-ac4106b00a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:18.283713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c4b20-7cb8-40a1-845b-ac4106b00a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:18.285909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c4b20-7cb8-40a1-845b-ac4106b00a75 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:18.309720 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2893/5838] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:18.314405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336a9f0-fdac-4a40-92f0-ec9339628997 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:18.326516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336a9f0-fdac-4a40-92f0-ec9339628997 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:18.346599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e4915-2897-4ed4-b0c3-436228413c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:18.349166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e4915-2897-4ed4-b0c3-436228413c98 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:18.350975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e4915-2897-4ed4-b0c3-436228413c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:18.352544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e4915-2897-4ed4-b0c3-436228413c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:18.354038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e4915-2897-4ed4-b0c3-436228413c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:18.359490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e4915-2897-4ed4-b0c3-436228413c98 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:18.403997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c4b20-7cb8-40a1-845b-ac4106b00a75 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:18.412099 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2946/5839] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:18 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:18.429746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c4b20-7cb8-40a1-845b-ac4106b00a75 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:18.521016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276427c3-39b6-4f44-a059-ee43c094c5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:18.521843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276427c3-39b6-4f44-a059-ee43c094c5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:18.522233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276427c3-39b6-4f44-a059-ee43c094c5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:18.522602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276427c3-39b6-4f44-a059-ee43c094c5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:18.523549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276427c3-39b6-4f44-a059-ee43c094c5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:18.526697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276427c3-39b6-4f44-a059-ee43c094c5b7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:18.564119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e4915-2897-4ed4-b0c3-436228413c98 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:18.569033 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2894/5840] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:18 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:18.584784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e4915-2897-4ed4-b0c3-436228413c98 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:18.590761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98af622-e1dc-4d34-b7e5-5ac3c592e1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:18.591451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98af622-e1dc-4d34-b7e5-5ac3c592e1be admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:18.592058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98af622-e1dc-4d34-b7e5-5ac3c592e1be admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:18.592058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98af622-e1dc-4d34-b7e5-5ac3c592e1be admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:18.592760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98af622-e1dc-4d34-b7e5-5ac3c592e1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:18.596519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98af622-e1dc-4d34-b7e5-5ac3c592e1be admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:18.613057 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2947/5841] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:18.614301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276427c3-39b6-4f44-a059-ee43c094c5b7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:18.625323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276427c3-39b6-4f44-a059-ee43c094c5b7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:18.630382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8c0e6-ad3a-4c58-b320-095b197c5598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:18.631071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8c0e6-ad3a-4c58-b320-095b197c5598 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:18.631814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8c0e6-ad3a-4c58-b320-095b197c5598 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:18.631814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8c0e6-ad3a-4c58-b320-095b197c5598 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:18.632439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8c0e6-ad3a-4c58-b320-095b197c5598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:18.634117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8c0e6-ad3a-4c58-b320-095b197c5598 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:18.649041 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2895/5842] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:18.650457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98af622-e1dc-4d34-b7e5-5ac3c592e1be admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:18.666112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98af622-e1dc-4d34-b7e5-5ac3c592e1be admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:18.672614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587cd50-7017-4221-a6b4-82ae432f8866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:18.674472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587cd50-7017-4221-a6b4-82ae432f8866 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:18.674986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587cd50-7017-4221-a6b4-82ae432f8866 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:18.675857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587cd50-7017-4221-a6b4-82ae432f8866 admin admin] PATH_INFO: `/v3/projects/7b6be6f8159f4491b83d9658d643464c/users/da090da7f121431abd13c9d9f0c71bb8/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:18.698024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587cd50-7017-4221-a6b4-82ae432f8866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6be6f8159f4491b83d9658d643464c, user_id=da090da7f121431abd13c9d9f0c71bb8, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:18.701683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587cd50-7017-4221-a6b4-82ae432f8866 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:18.741306 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2948/5843] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:18 2022] PUT /identity/v3/projects/7b6be6f8159f4491b83d9658d643464c/users/da090da7f121431abd13c9d9f0c71bb8/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:18.742899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99e8e5-f399-4a2f-a655-9ed0266020cd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:18.743191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99e8e5-f399-4a2f-a655-9ed0266020cd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:18.743469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99e8e5-f399-4a2f-a655-9ed0266020cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:18.763684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3f99e8e5-f399-4a2f-a655-9ed0266020cd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:18.765085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3f99e8e5-f399-4a2f-a655-9ed0266020cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:18.869729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2896/5844] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:18.883457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587cd50-7017-4221-a6b4-82ae432f8866 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:18.885735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7587cd50-7017-4221-a6b4-82ae432f8866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:18.980045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99e8e5-f399-4a2f-a655-9ed0266020cd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:18.981817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3f99e8e5-f399-4a2f-a655-9ed0266020cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:19.017731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99e8e5-f399-4a2f-a655-9ed0266020cd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:19.025671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587cd50-7017-4221-a6b4-82ae432f8866 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:19.036099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:19.036998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.037283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.037553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] PATH_INFO: `/v3/projects/4329f63ab8924c3db1f14a85602b874b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.039085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] RBAC: Authorizing `identity:delete_project(project_id=4329f63ab8924c3db1f14a85602b874b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:19.047147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:19.049029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd378ef-182d-43c2-9aa0-3f8c7219785c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:19.049700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd378ef-182d-43c2-9aa0-3f8c7219785c service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.049984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd378ef-182d-43c2-9aa0-3f8c7219785c service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.050259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd378ef-182d-43c2-9aa0-3f8c7219785c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.075881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd378ef-182d-43c2-9aa0-3f8c7219785c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:19.077379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd378ef-182d-43c2-9aa0-3f8c7219785c service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:19.120323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2949/5845] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:19.190700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4329f63ab8924c3db1f14a85602b874b', 'request_id': 'req-82e824d1-2094-4fc7-a269-7984d34ffada'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:19.205472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4329f63ab8924c3db1f14a85602b874b', 'request_id': 'req-82e824d1-2094-4fc7-a269-7984d34ffada'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:19.213665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4329f63ab8924c3db1f14a85602b874b', 'request_id': 'req-82e824d1-2094-4fc7-a269-7984d34ffada'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:19.232760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] The token cache is being invalidate because project 4329f63ab8924c3db1f14a85602b874b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:19.233373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:19.234179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-82e824d1-2094-4fc7-a269-7984d34ffada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:19.240437 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2897/5846] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:18 2022] DELETE /identity/v3/projects/4329f63ab8924c3db1f14a85602b874b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:19.242477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be582-ca8b-4a97-8809-bdbffb017042 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.243629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be582-ca8b-4a97-8809-bdbffb017042 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.244165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9be582-ca8b-4a97-8809-bdbffb017042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.269396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4f9be582-ca8b-4a97-8809-bdbffb017042 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:19.270261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4f9be582-ca8b-4a97-8809-bdbffb017042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:19.377601 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2950/5847] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:19.387690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697605c5-b76b-4fb2-8c3f-54f35c4153ef None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.388379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697605c5-b76b-4fb2-8c3f-54f35c4153ef None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.388829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697605c5-b76b-4fb2-8c3f-54f35c4153ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.430442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-697605c5-b76b-4fb2-8c3f-54f35c4153ef None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:19.431666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-697605c5-b76b-4fb2-8c3f-54f35c4153ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:19.458382 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2898/5848] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:19.462910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9be582-ca8b-4a97-8809-bdbffb017042 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:19.484361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9be582-ca8b-4a97-8809-bdbffb017042 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:19.498736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a692223-2593-4692-9bcb-f29ba6d7f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:19.499773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692223-2593-4692-9bcb-f29ba6d7f8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.500306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692223-2593-4692-9bcb-f29ba6d7f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.500787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a692223-2593-4692-9bcb-f29ba6d7f8b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.502479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a692223-2593-4692-9bcb-f29ba6d7f8b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:19.503032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a692223-2593-4692-9bcb-f29ba6d7f8b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:19.507341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a692223-2593-4692-9bcb-f29ba6d7f8b1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:19.522979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2951/5849] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:19.528896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697605c5-b76b-4fb2-8c3f-54f35c4153ef None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:19.543848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697605c5-b76b-4fb2-8c3f-54f35c4153ef None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:19.552055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484645d-5d2d-4aba-a49e-b0ab4e95a0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:19.557964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484645d-5d2d-4aba-a49e-b0ab4e95a0c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.558565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484645d-5d2d-4aba-a49e-b0ab4e95a0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.559097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484645d-5d2d-4aba-a49e-b0ab4e95a0c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.560072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484645d-5d2d-4aba-a49e-b0ab4e95a0c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:19.562367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484645d-5d2d-4aba-a49e-b0ab4e95a0c8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:19.627558 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2899/5850] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:19 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:19.631668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a692223-2593-4692-9bcb-f29ba6d7f8b1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:19.644123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a692223-2593-4692-9bcb-f29ba6d7f8b1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:19.726094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc462fb-dab8-46b6-b84c-0144d65f115d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.726352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc462fb-dab8-46b6-b84c-0144d65f115d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.726678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc462fb-dab8-46b6-b84c-0144d65f115d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.764185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a2bb2-eb8d-465a-8366-f7519ec100a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:19.764913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a2bb2-eb8d-465a-8366-f7519ec100a8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.765336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a2bb2-eb8d-465a-8366-f7519ec100a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.765908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a2bb2-eb8d-465a-8366-f7519ec100a8 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.767827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a2bb2-eb8d-465a-8366-f7519ec100a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:19.770004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a2bb2-eb8d-465a-8366-f7519ec100a8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:19.778808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2fc462fb-dab8-46b6-b84c-0144d65f115d None None] MFA Rules not processed for user `0ba639b89f7c49a18b63829c6223a058`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:19.780344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2fc462fb-dab8-46b6-b84c-0144d65f115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:19.826450 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2952/5851] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:19 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:19.827686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a2bb2-eb8d-465a-8366-f7519ec100a8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:19.878498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a2bb2-eb8d-465a-8366-f7519ec100a8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:19.900492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2459d75-b017-4d0a-8b15-76e25de01dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:19.901982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2459d75-b017-4d0a-8b15-76e25de01dfe admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.902336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2459d75-b017-4d0a-8b15-76e25de01dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.902958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2459d75-b017-4d0a-8b15-76e25de01dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.905011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2459d75-b017-4d0a-8b15-76e25de01dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:19.909925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2459d75-b017-4d0a-8b15-76e25de01dfe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:19.927516 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2953/5852] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:19.931152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2459d75-b017-4d0a-8b15-76e25de01dfe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:19.963411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2459d75-b017-4d0a-8b15-76e25de01dfe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:19.977145 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2900/5853] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:19.984931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c6f36-9605-46c6-84de-ff6811adb20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:19.985723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c6f36-9605-46c6-84de-ff6811adb20f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:19.986067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c6f36-9605-46c6-84de-ff6811adb20f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:19.986407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c6f36-9605-46c6-84de-ff6811adb20f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:19.987289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c6f36-9605-46c6-84de-ff6811adb20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:19.989685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc462fb-dab8-46b6-b84c-0144d65f115d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:19.991133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2fc462fb-dab8-46b6-b84c-0144d65f115d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:19.996246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c6f36-9605-46c6-84de-ff6811adb20f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:20.053797 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2954/5854] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:20.057706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c6f36-9605-46c6-84de-ff6811adb20f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:20.098700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c6f36-9605-46c6-84de-ff6811adb20f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:20.116723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0c1096-cbee-4007-b5db-be19a0a70880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:20.117778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1096-cbee-4007-b5db-be19a0a70880 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:20.117913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1096-cbee-4007-b5db-be19a0a70880 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:20.118948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0c1096-cbee-4007-b5db-be19a0a70880 admin admin] PATH_INFO: `/v3/projects/51193509c8b34b33b120cef258cb7549/users/3a139deb87c340d499c15312b7b91ede/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:20.191627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc462fb-dab8-46b6-b84c-0144d65f115d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:20.199414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147517b6-655d-4e1b-9a76-fb4de3a8e75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:20.200229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147517b6-655d-4e1b-9a76-fb4de3a8e75e service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:20.200809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147517b6-655d-4e1b-9a76-fb4de3a8e75e service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:20.201129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147517b6-655d-4e1b-9a76-fb4de3a8e75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:20.214562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-147517b6-655d-4e1b-9a76-fb4de3a8e75e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:20.232032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c1096-cbee-4007-b5db-be19a0a70880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51193509c8b34b33b120cef258cb7549, user_id=3a139deb87c340d499c15312b7b91ede, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:20.243566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0c1096-cbee-4007-b5db-be19a0a70880 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:20.301185 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2955/5855] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:20 2022] PUT /identity/v3/projects/51193509c8b34b33b120cef258cb7549/users/3a139deb87c340d499c15312b7b91ede/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:20.311578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c090f1a-ea33-4578-b58c-5b4d24845b98 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:20.311873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c090f1a-ea33-4578-b58c-5b4d24845b98 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:20.315060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c090f1a-ea33-4578-b58c-5b4d24845b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:20.357835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147517b6-655d-4e1b-9a76-fb4de3a8e75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:20.359433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147517b6-655d-4e1b-9a76-fb4de3a8e75e service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:20.394535 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2901/5856] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:20.479193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7c090f1a-ea33-4578-b58c-5b4d24845b98 None None] MFA Rules not processed for user `3a139deb87c340d499c15312b7b91ede`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:20.480431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7c090f1a-ea33-4578-b58c-5b4d24845b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:20.607178 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2956/5857] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:20.612236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147517b6-655d-4e1b-9a76-fb4de3a8e75e service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:20.635807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147517b6-655d-4e1b-9a76-fb4de3a8e75e service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:20.842518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85e3d8-0cb5-4638-ab18-1f9b5eca4e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:20.843199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85e3d8-0cb5-4638-ab18-1f9b5eca4e49 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:20.843479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85e3d8-0cb5-4638-ab18-1f9b5eca4e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:20.843752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85e3d8-0cb5-4638-ab18-1f9b5eca4e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:20.845256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85e3d8-0cb5-4638-ab18-1f9b5eca4e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:20.846804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85e3d8-0cb5-4638-ab18-1f9b5eca4e49 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:20.883763 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2902/5858] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:20 2022] POST /identity/v3/projects => generated 367 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:20.885481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c090f1a-ea33-4578-b58c-5b4d24845b98 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:20.909019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c090f1a-ea33-4578-b58c-5b4d24845b98 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:21.069495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7cb77-54ba-4cae-8038-27f88ca83484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:21.070190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7cb77-54ba-4cae-8038-27f88ca83484 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:21.070481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7cb77-54ba-4cae-8038-27f88ca83484 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:21.070761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7cb77-54ba-4cae-8038-27f88ca83484 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:21.071515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7cb77-54ba-4cae-8038-27f88ca83484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:21.073914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7cb77-54ba-4cae-8038-27f88ca83484 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:21.112842 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2957/5859] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:20 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:21.118821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85e3d8-0cb5-4638-ab18-1f9b5eca4e49 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:21.138023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85e3d8-0cb5-4638-ab18-1f9b5eca4e49 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:21.153991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bcfcd-042f-46e2-80f8-8511481f56f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:21.155016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bcfcd-042f-46e2-80f8-8511481f56f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:21.155545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bcfcd-042f-46e2-80f8-8511481f56f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:21.156091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bcfcd-042f-46e2-80f8-8511481f56f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:21.157539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bcfcd-042f-46e2-80f8-8511481f56f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:21.161159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bcfcd-042f-46e2-80f8-8511481f56f5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:21.174087 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2903/5860] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:21.178718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7cb77-54ba-4cae-8038-27f88ca83484 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:21.195190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7cb77-54ba-4cae-8038-27f88ca83484 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:21.202895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b6a46-20a6-44ff-99f0-a7c0d8003de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:21.204157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6a46-20a6-44ff-99f0-a7c0d8003de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:21.204669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6a46-20a6-44ff-99f0-a7c0d8003de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:21.205031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6a46-20a6-44ff-99f0-a7c0d8003de1 admin admin] PATH_INFO: `/v3/projects/66df28e3705246bbace8b1861533ab01/users/d48eea90c1d446b58f391bc81efe35ac/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:21.231375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b6a46-20a6-44ff-99f0-a7c0d8003de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66df28e3705246bbace8b1861533ab01, user_id=d48eea90c1d446b58f391bc81efe35ac, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:21.237463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b6a46-20a6-44ff-99f0-a7c0d8003de1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:21.283496 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2958/5861] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:21 2022] PUT /identity/v3/projects/66df28e3705246bbace8b1861533ab01/users/d48eea90c1d446b58f391bc81efe35ac/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:21.284942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bcfcd-042f-46e2-80f8-8511481f56f5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:21.311647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bcfcd-042f-46e2-80f8-8511481f56f5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:21.456991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1b349-e084-4f8f-93a3-bd9c241ca73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:21.459533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b349-e084-4f8f-93a3-bd9c241ca73d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:21.460062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b349-e084-4f8f-93a3-bd9c241ca73d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:21.460492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b349-e084-4f8f-93a3-bd9c241ca73d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:21.461563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1b349-e084-4f8f-93a3-bd9c241ca73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:21.463494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1b349-e084-4f8f-93a3-bd9c241ca73d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:21.485308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b6a46-20a6-44ff-99f0-a7c0d8003de1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:21.490230 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2904/5862] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:21.499798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b6a46-20a6-44ff-99f0-a7c0d8003de1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:21.510972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332b600-a051-46bd-949c-c181d7dd8c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:21.512536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332b600-a051-46bd-949c-c181d7dd8c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:21.513021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332b600-a051-46bd-949c-c181d7dd8c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:21.513455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332b600-a051-46bd-949c-c181d7dd8c8e admin admin] PATH_INFO: `/v3/projects/66df28e3705246bbace8b1861533ab01/users/d48eea90c1d446b58f391bc81efe35ac/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:21.536685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332b600-a051-46bd-949c-c181d7dd8c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66df28e3705246bbace8b1861533ab01, user_id=d48eea90c1d446b58f391bc81efe35ac, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:21.542905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d332b600-a051-46bd-949c-c181d7dd8c8e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:21.578612 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2959/5863] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:21 2022] PUT /identity/v3/projects/66df28e3705246bbace8b1861533ab01/users/d48eea90c1d446b58f391bc81efe35ac/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:21.594205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acb0e3-c0f6-49bf-9a5d-060220b12054 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:21.595349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acb0e3-c0f6-49bf-9a5d-060220b12054 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:21.596042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acb0e3-c0f6-49bf-9a5d-060220b12054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:21.667060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-37acb0e3-c0f6-49bf-9a5d-060220b12054 None None] MFA Rules not processed for user `d48eea90c1d446b58f391bc81efe35ac`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:21.671348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-37acb0e3-c0f6-49bf-9a5d-060220b12054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:21.721796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c3865-9f3b-440e-9d0e-e28c7d20f91f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:21.722312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c3865-9f3b-440e-9d0e-e28c7d20f91f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:21.722974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c3865-9f3b-440e-9d0e-e28c7d20f91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:21.781225 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2905/5864] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:21.787467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acb0e3-c0f6-49bf-9a5d-060220b12054 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:21.809027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-373c3865-9f3b-440e-9d0e-e28c7d20f91f None None] MFA Rules not processed for user `da090da7f121431abd13c9d9f0c71bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:21.810316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-373c3865-9f3b-440e-9d0e-e28c7d20f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:21.810590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37acb0e3-c0f6-49bf-9a5d-060220b12054 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:21.836740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c65390-7554-4c4e-bd9c-b3e61a51933e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:21.842930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c65390-7554-4c4e-bd9c-b3e61a51933e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:21.843243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c65390-7554-4c4e-bd9c-b3e61a51933e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:21.843705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c65390-7554-4c4e-bd9c-b3e61a51933e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:21.845036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c65390-7554-4c4e-bd9c-b3e61a51933e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:21.846765 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-54c65390-7554-4c4e-bd9c-b3e61a51933e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:21.846765 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:21.846765 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:21.849851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c65390-7554-4c4e-bd9c-b3e61a51933e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:21.880282 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2906/5865] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:09:21 2022] POST /identity/v3/roles => generated 234 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:21.881869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c65390-7554-4c4e-bd9c-b3e61a51933e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:21.905863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c65390-7554-4c4e-bd9c-b3e61a51933e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:21.943991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8caf3-4dd3-4742-85ee-7aeca577f9b8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:21.945411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8caf3-4dd3-4742-85ee-7aeca577f9b8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:21.947054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8caf3-4dd3-4742-85ee-7aeca577f9b8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:21.947611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8caf3-4dd3-4742-85ee-7aeca577f9b8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:21.952475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8caf3-4dd3-4742-85ee-7aeca577f9b8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:21.959172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8caf3-4dd3-4742-85ee-7aeca577f9b8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:21.984467 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2907/5866] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:09:21 2022] POST /identity/v3/roles => generated 234 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:21.988218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8caf3-4dd3-4742-85ee-7aeca577f9b8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:22.005302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8caf3-4dd3-4742-85ee-7aeca577f9b8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:22.012891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c02095-c056-46b0-aac0-c7fd9a354d9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:22.013815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c02095-c056-46b0-aac0-c7fd9a354d9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.014179 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2960/5867] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:22.014934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c02095-c056-46b0-aac0-c7fd9a354d9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.038607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c3865-9f3b-440e-9d0e-e28c7d20f91f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:22.039537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c02095-c056-46b0-aac0-c7fd9a354d9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.040306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-373c3865-9f3b-440e-9d0e-e28c7d20f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:22.041251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c02095-c056-46b0-aac0-c7fd9a354d9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:22.050543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c02095-c056-46b0-aac0-c7fd9a354d9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:22.084081 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2908/5868] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:09:21 2022] POST /identity/v3/roles => generated 235 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:22.087706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c02095-c056-46b0-aac0-c7fd9a354d9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:22.108130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c02095-c056-46b0-aac0-c7fd9a354d9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:22.122859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c5107-b141-4899-af66-0e4ae39c575b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:22.125156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5107-b141-4899-af66-0e4ae39c575b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.125468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5107-b141-4899-af66-0e4ae39c575b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.128100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c5107-b141-4899-af66-0e4ae39c575b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.129165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c5107-b141-4899-af66-0e4ae39c575b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:22.136166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c5107-b141-4899-af66-0e4ae39c575b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:22.174371 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2909/5869] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:09:22 2022] POST /identity/v3/domains => generated 276 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:22.175291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c5107-b141-4899-af66-0e4ae39c575b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:22.189509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c3865-9f3b-440e-9d0e-e28c7d20f91f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:22.282202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74fdbc-0b40-40b7-98c8-3fd5ebb81eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:22.282855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fdbc-0b40-40b7-98c8-3fd5ebb81eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.283140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fdbc-0b40-40b7-98c8-3fd5ebb81eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.283413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74fdbc-0b40-40b7-98c8-3fd5ebb81eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.323142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c5107-b141-4899-af66-0e4ae39c575b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:22.334927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf18072-65d6-4035-9429-61ac8ccd9749 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:22.335622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18072-65d6-4035-9429-61ac8ccd9749 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.336007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18072-65d6-4035-9429-61ac8ccd9749 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.336380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf18072-65d6-4035-9429-61ac8ccd9749 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.338683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf18072-65d6-4035-9429-61ac8ccd9749 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:22.342552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf18072-65d6-4035-9429-61ac8ccd9749 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:22.407254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74fdbc-0b40-40b7-98c8-3fd5ebb81eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:22.409188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74fdbc-0b40-40b7-98c8-3fd5ebb81eb1 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:22.424356 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2910/5870] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:22 2022] POST /identity/v3/projects => generated 401 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:22.425975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979be42-cee3-4854-9f09-9a29fedcb46c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.426372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979be42-cee3-4854-9f09-9a29fedcb46c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.426738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979be42-cee3-4854-9f09-9a29fedcb46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.444500 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2961/5871] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:09:22.449700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74fdbc-0b40-40b7-98c8-3fd5ebb81eb1 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:22.465825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c979be42-cee3-4854-9f09-9a29fedcb46c None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:22.469875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c979be42-cee3-4854-9f09-9a29fedcb46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:22.471516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74fdbc-0b40-40b7-98c8-3fd5ebb81eb1 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:22.559317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2911/5872] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:22.565656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677d043-7699-469f-bc35-6f0260be9fd1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:22.566434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677d043-7699-469f-bc35-6f0260be9fd1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.566786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677d043-7699-469f-bc35-6f0260be9fd1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.567270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677d043-7699-469f-bc35-6f0260be9fd1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.568187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677d043-7699-469f-bc35-6f0260be9fd1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:22.570838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677d043-7699-469f-bc35-6f0260be9fd1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:22.590510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2962/5873] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:09:22 2022] POST /identity/v3/groups => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:22.595279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979be42-cee3-4854-9f09-9a29fedcb46c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:22.611404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979be42-cee3-4854-9f09-9a29fedcb46c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:22.617107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08010d0-7d5d-43a1-a45b-15b7233692cf tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:22.617788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08010d0-7d5d-43a1-a45b-15b7233692cf tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.618076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08010d0-7d5d-43a1-a45b-15b7233692cf tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.618497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08010d0-7d5d-43a1-a45b-15b7233692cf tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.619125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08010d0-7d5d-43a1-a45b-15b7233692cf tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:22.620919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08010d0-7d5d-43a1-a45b-15b7233692cf tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:22.643660 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2912/5874] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:09:22 2022] POST /identity/v3/roles => generated 235 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:22.647797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677d043-7699-469f-bc35-6f0260be9fd1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:22.667762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677d043-7699-469f-bc35-6f0260be9fd1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:22.676420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4103a-138c-4c9e-b4a6-9cc62c87286a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:22.677596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4103a-138c-4c9e-b4a6-9cc62c87286a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.678385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4103a-138c-4c9e-b4a6-9cc62c87286a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.679501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4103a-138c-4c9e-b4a6-9cc62c87286a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.681186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4103a-138c-4c9e-b4a6-9cc62c87286a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:22.684012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4103a-138c-4c9e-b4a6-9cc62c87286a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:22.727352 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2963/5875] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:22 2022] POST /identity/v3/users => generated 442 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:22.728817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08010d0-7d5d-43a1-a45b-15b7233692cf tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:22.763352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08010d0-7d5d-43a1-a45b-15b7233692cf tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:22.776552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd9504-d598-4836-af6a-14311f387410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:22.778015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd9504-d598-4836-af6a-14311f387410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.778460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd9504-d598-4836-af6a-14311f387410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.778913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd9504-d598-4836-af6a-14311f387410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.780010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd9504-d598-4836-af6a-14311f387410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:22.781209 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-37dd9504-d598-4836-af6a-14311f387410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:22.781209 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:22.781209 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:22.782954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd9504-d598-4836-af6a-14311f387410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:22.828939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4103a-138c-4c9e-b4a6-9cc62c87286a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:22.829829 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2913/5876] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:09:22 2022] POST /identity/v3/roles => generated 269 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:22.849433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4103a-138c-4c9e-b4a6-9cc62c87286a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:22.865153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8d2a5-6cb0-4596-acfb-aca4fac3b3a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:22.867570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8d2a5-6cb0-4596-acfb-aca4fac3b3a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:22.868318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8d2a5-6cb0-4596-acfb-aca4fac3b3a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:22.870063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8d2a5-6cb0-4596-acfb-aca4fac3b3a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/93720f9ef4264cdcaaa20f20deec7202` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:22.920399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8d2a5-6cb0-4596-acfb-aca4fac3b3a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=93720f9ef4264cdcaaa20f20deec7202)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:22.929526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8d2a5-6cb0-4596-acfb-aca4fac3b3a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:22.987686 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2964/5877] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:22 2022] PUT /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/93720f9ef4264cdcaaa20f20deec7202 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:22.992783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd9504-d598-4836-af6a-14311f387410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:23.010274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd9504-d598-4836-af6a-14311f387410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:23.183878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:23.184617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:23.184915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:23.186205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:23.186802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Adding query filter params (scope.project.id=d1f1f6ffc8b24ae19e49621106b20fec, user.id=5f4cdb1b8b404a2880534f25cf70c14c) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:23.187151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:23.189090 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:23.189090 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:23.189090 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:23.190108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:23.298204 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2914/5878] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Mar 26 21:09:22 2022] GET /identity/v3/role_assignments?scope.project.id=d1f1f6ffc8b24ae19e49621106b20fec&user.id=5f4cdb1b8b404a2880534f25cf70c14c&effective => generated 228 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:23.302331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8d2a5-6cb0-4596-acfb-aca4fac3b3a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:23.322920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8d2a5-6cb0-4596-acfb-aca4fac3b3a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:23.333036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:23.334819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:23.335392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:23.335869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/93720f9ef4264cdcaaa20f20deec7202` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:23.340820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=93720f9ef4264cdcaaa20f20deec7202)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:23.342056 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:23.342056 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:23.342056 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:23.345838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:23.356455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 93720f9ef4264cdcaaa20f20deec7202 was removed from user 5f4cdb1b8b404a2880534f25cf70c14c on project d1f1f6ffc8b24ae19e49621106b20fec. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:23.356808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:23.357698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6780d21d-33ec-4fea-a88a-28bf32e37ce4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:23.388624 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2965/5879] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Mar 26 21:09:23 2022] DELETE /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/93720f9ef4264cdcaaa20f20deec7202 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:23.393779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:23.398191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:23.444911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6a825-7b06-421a-add9-12203eccd58f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:23.621305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:23.622367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:23.623723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:23.624141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/93720f9ef4264cdcaaa20f20deec7202` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:23.630093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=93720f9ef4264cdcaaa20f20deec7202)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:23.631326 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:23.631326 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:23.631326 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:23.632844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:23.731070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6020a6-60c8-4850-b081-c967c1abedc3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:23.731566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6020a6-60c8-4850-b081-c967c1abedc3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:23.731676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6020a6-60c8-4850-b081-c967c1abedc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:23.736150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 93720f9ef4264cdcaaa20f20deec7202 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:23.736642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:23.737335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:23.739900 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2915/5880] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:23 2022] DELETE /identity/v3/roles/93720f9ef4264cdcaaa20f20deec7202 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:23.747299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:23.754708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:23.773371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-eb6020a6-60c8-4850-b081-c967c1abedc3 None None] MFA Rules not processed for user `4e069c88bde243a39d59ee5a170f5094`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:23.775716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-eb6020a6-60c8-4850-b081-c967c1abedc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:23.843825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d39e-4db3-4edd-9d2d-e423bbedee85 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:23.849306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7fb5e-9869-45a7-a52a-dedc85f6f937 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:23.850424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7fb5e-9869-45a7-a52a-dedc85f6f937 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:23.850809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7fb5e-9869-45a7-a52a-dedc85f6f937 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:23.851221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d7fb5e-9869-45a7-a52a-dedc85f6f937 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/6203062d4e634a97bb749c228595b2ef` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:23.854559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7fb5e-9869-45a7-a52a-dedc85f6f937 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=6203062d4e634a97bb749c228595b2ef)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:23.861837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d7fb5e-9869-45a7-a52a-dedc85f6f937 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:23.898170 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2916/5881] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:23 2022] PUT /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/6203062d4e634a97bb749c228595b2ef => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:23.901441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7fb5e-9869-45a7-a52a-dedc85f6f937 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:23.945795 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2966/5882] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:23.956192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c94e-41ca-41a8-8be1-fd53ab91b030 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:23.956695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c94e-41ca-41a8-8be1-fd53ab91b030 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:23.956956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51c94e-41ca-41a8-8be1-fd53ab91b030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:23.994552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5e51c94e-41ca-41a8-8be1-fd53ab91b030 None None] MFA Rules not processed for user `4e069c88bde243a39d59ee5a170f5094`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:23.995793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5e51c94e-41ca-41a8-8be1-fd53ab91b030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:24.081625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d7fb5e-9869-45a7-a52a-dedc85f6f937 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:24.091525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:24.092678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:24.093063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:24.093740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:24.101872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:24.105189 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:24.105189 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:24.105189 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:24.113983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:24.155974 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2917/5883] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:23 2022] PUT /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 519 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:24.160128 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2967/5884] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:24.160621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:24.161771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c94e-41ca-41a8-8be1-fd53ab91b030 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:24.162738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:24.186025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51c94e-41ca-41a8-8be1-fd53ab91b030 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:24.317850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642065a-e8cc-486c-99a7-913ff18891a5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:24.327717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca1187-c0c4-419c-9640-70ec76285aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:24.328860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca1187-c0c4-419c-9640-70ec76285aa3 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:24.329223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca1187-c0c4-419c-9640-70ec76285aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:24.329512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca1187-c0c4-419c-9640-70ec76285aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:24.330758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09e927-6e63-4d97-86e9-be4cb4b7a687 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:24.331970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09e927-6e63-4d97-86e9-be4cb4b7a687 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:24.333108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09e927-6e63-4d97-86e9-be4cb4b7a687 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:24.333894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09e927-6e63-4d97-86e9-be4cb4b7a687 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:24.335029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09e927-6e63-4d97-86e9-be4cb4b7a687 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Adding query filter params (scope.project.id=d1f1f6ffc8b24ae19e49621106b20fec, user.id=5f4cdb1b8b404a2880534f25cf70c14c) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:24.335578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09e927-6e63-4d97-86e9-be4cb4b7a687 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:24.337290 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-1a09e927-6e63-4d97-86e9-be4cb4b7a687 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:24.337290 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:24.337290 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:24.339184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09e927-6e63-4d97-86e9-be4cb4b7a687 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:24.413636 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2968/5885] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Mar 26 21:09:24 2022] GET /identity/v3/role_assignments?scope.project.id=d1f1f6ffc8b24ae19e49621106b20fec&user.id=5f4cdb1b8b404a2880534f25cf70c14c&effective => generated 1061 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:24.413636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9a1d8-df16-4219-978f-609016ccdfc1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:24.413636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9a1d8-df16-4219-978f-609016ccdfc1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:24.413636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9a1d8-df16-4219-978f-609016ccdfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:24.417256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca1187-c0c4-419c-9640-70ec76285aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:24.419826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca1187-c0c4-419c-9640-70ec76285aa3 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:24.436144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-34e9a1d8-df16-4219-978f-609016ccdfc1 None None] MFA Rules not processed for user `da090da7f121431abd13c9d9f0c71bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:24.437456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-34e9a1d8-df16-4219-978f-609016ccdfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:24.440597 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2918/5886] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:24.441539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca1187-c0c4-419c-9640-70ec76285aa3 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:24.456744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca1187-c0c4-419c-9640-70ec76285aa3 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:24.466621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b86a6-1a65-42af-905f-4cc317984776 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:24.467640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b86a6-1a65-42af-905f-4cc317984776 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:24.467953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b86a6-1a65-42af-905f-4cc317984776 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:24.468233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b86a6-1a65-42af-905f-4cc317984776 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:24.476132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b86a6-1a65-42af-905f-4cc317984776 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:24.479037 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-ce4b86a6-1a65-42af-905f-4cc317984776 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:24.479037 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:24.479037 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:24.481801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b86a6-1a65-42af-905f-4cc317984776 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:24.513727 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2919/5887] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:24 2022] DELETE /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:24.514878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b86a6-1a65-42af-905f-4cc317984776 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:24.568471 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2969/5888] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:24.646954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b86a6-1a65-42af-905f-4cc317984776 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:24.661064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b1267-738e-4593-b254-cfad3a29c9e4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:24.664521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1267-738e-4593-b254-cfad3a29c9e4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:24.664850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1267-738e-4593-b254-cfad3a29c9e4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:24.665209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1267-738e-4593-b254-cfad3a29c9e4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:24.666296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b1267-738e-4593-b254-cfad3a29c9e4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Adding query filter params (scope.project.id=d1f1f6ffc8b24ae19e49621106b20fec, user.id=5f4cdb1b8b404a2880534f25cf70c14c) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:24.666606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b1267-738e-4593-b254-cfad3a29c9e4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:24.670241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b1267-738e-4593-b254-cfad3a29c9e4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:24.854997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9a1d8-df16-4219-978f-609016ccdfc1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:24.857965 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2920/5889] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Mar 26 21:09:24 2022] GET /identity/v3/role_assignments?scope.project.id=d1f1f6ffc8b24ae19e49621106b20fec&user.id=5f4cdb1b8b404a2880534f25cf70c14c&effective => generated 577 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:09:24.878850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9a1d8-df16-4219-978f-609016ccdfc1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:24.883963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:24.885061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:24.885347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:24.885763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:24.892038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:24.893148 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:24.893148 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:24.893148 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:24.894436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:24.948460 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] 6203062d4e634a97bb749c228595b2ef does not imply 6b53b07ba0484933af454aec4b7d1e34.: keystone.exception.ImpliedRoleNotFound: 6203062d4e634a97bb749c228595b2ef does not imply 6b53b07ba0484933af454aec4b7d1e34. Mar 26 21:09:24.953124 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2970/5890] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:24 2022] DELETE /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 137 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Mar 26 21:09:24.954598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b1267-738e-4593-b254-cfad3a29c9e4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:24.975881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b1267-738e-4593-b254-cfad3a29c9e4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:24.984430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:24.986200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:24.986846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:24.987836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/6203062d4e634a97bb749c228595b2ef` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:24.991191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=6203062d4e634a97bb749c228595b2ef)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:24.992588 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:24.992588 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:24.992588 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:24.994891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:25.004524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 6203062d4e634a97bb749c228595b2ef was removed from user 5f4cdb1b8b404a2880534f25cf70c14c on project d1f1f6ffc8b24ae19e49621106b20fec. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:25.005093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:25.006253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:25.054666 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2921/5891] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Mar 26 21:09:24 2022] DELETE /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/6203062d4e634a97bb749c228595b2ef => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:25.055750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:25.057850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:25.079329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773970e-bc5f-4c0e-ae07-54bccdc5ec33 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:25.238756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42072520-0f2a-48a1-b994-2249253766cb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:25.239819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072520-0f2a-48a1-b994-2249253766cb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:25.240341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072520-0f2a-48a1-b994-2249253766cb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:25.240949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42072520-0f2a-48a1-b994-2249253766cb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:25.241867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42072520-0f2a-48a1-b994-2249253766cb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:25.243072 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-42072520-0f2a-48a1-b994-2249253766cb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:25.243072 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:25.243072 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:25.244061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42072520-0f2a-48a1-b994-2249253766cb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:25.274306 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2971/5892] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:25 2022] POST /identity/v3/roles => generated 272 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:25.278301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:25.294082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6042ff-e015-4a7e-a7b6-666c2334c59c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:25.308824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:25.309507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:25.309793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:25.310427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:25.316721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Adding query filter params (domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:25.317082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:25.318480 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:25.318480 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:25.318480 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:25.319391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:25.340454 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2922/5893] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Mar 26 21:09:25 2022] GET /identity/v3/roles?domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81 => generated 409 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:25.345403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42072520-0f2a-48a1-b994-2249253766cb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:25.371214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42072520-0f2a-48a1-b994-2249253766cb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:25.378239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:25.379364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:25.379655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:25.379973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/eb2df94b3b68430e8a0b1f5b4aa39c50` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:25.381222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=eb2df94b3b68430e8a0b1f5b4aa39c50)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:25.382398 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:25.382398 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:25.382398 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:25.383414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:25.445778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role eb2df94b3b68430e8a0b1f5b4aa39c50 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:25.446193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:25.448864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e9e37c2d-3ecf-4e3a-9a18-75a70c814e49 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:25.458461 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2972/5894] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:25 2022] DELETE /identity/v3/roles/eb2df94b3b68430e8a0b1f5b4aa39c50 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:25.462692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:25.465428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:25.498761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a19507-ebf0-4ab8-a08e-26f5b03f6147 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:25.585369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93764214-d007-4250-a2db-f60c7172e4dc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:25.585652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93764214-d007-4250-a2db-f60c7172e4dc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:25.586105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93764214-d007-4250-a2db-f60c7172e4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:25.606239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-93764214-d007-4250-a2db-f60c7172e4dc None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:25.608043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-93764214-d007-4250-a2db-f60c7172e4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:25.626766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dff08-cd7f-4048-a38a-437b9b1f4e79 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:25.628410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dff08-cd7f-4048-a38a-437b9b1f4e79 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:25.629405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dff08-cd7f-4048-a38a-437b9b1f4e79 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:25.629405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7dff08-cd7f-4048-a38a-437b9b1f4e79 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:25.631565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dff08-cd7f-4048-a38a-437b9b1f4e79 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Adding query filter params (domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:25.632418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dff08-cd7f-4048-a38a-437b9b1f4e79 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:25.657379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7dff08-cd7f-4048-a38a-437b9b1f4e79 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:25.696200 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2923/5895] 10.222.0.16 () {58 vars in 1206 bytes} [Sat Mar 26 21:09:25 2022] GET /identity/v3/roles?domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81 => generated 148 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:25.698330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dff08-cd7f-4048-a38a-437b9b1f4e79 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:25.729543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7dff08-cd7f-4048-a38a-437b9b1f4e79 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:25.767065 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2973/5896] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:25.781451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753770b-064f-4a8c-8cd9-f1f9b2680315 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:25.785301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753770b-064f-4a8c-8cd9-f1f9b2680315 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:25.787427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753770b-064f-4a8c-8cd9-f1f9b2680315 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:25.787866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753770b-064f-4a8c-8cd9-f1f9b2680315 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/eb2df94b3b68430e8a0b1f5b4aa39c50` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:25.837284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753770b-064f-4a8c-8cd9-f1f9b2680315 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:09:25.868409 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-b753770b-064f-4a8c-8cd9-f1f9b2680315 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Could not find role: eb2df94b3b68430e8a0b1f5b4aa39c50.: keystone.exception.RoleNotFound: Could not find role: eb2df94b3b68430e8a0b1f5b4aa39c50. Mar 26 21:09:25.872395 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2924/5897] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:25 2022] DELETE /identity/v3/roles/eb2df94b3b68430e8a0b1f5b4aa39c50 => generated 110 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:09:25.874789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93764214-d007-4250-a2db-f60c7172e4dc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:25.908875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93764214-d007-4250-a2db-f60c7172e4dc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:25.924237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab1db1-3c81-42a9-b6b7-002bd195c2d5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:25.930288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab1db1-3c81-42a9-b6b7-002bd195c2d5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:25.931536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab1db1-3c81-42a9-b6b7-002bd195c2d5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:25.932137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab1db1-3c81-42a9-b6b7-002bd195c2d5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:25.942582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab1db1-3c81-42a9-b6b7-002bd195c2d5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81, group_id=7a6cd2d8b42c4a4cac3626f273435ddd, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:25.947151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab1db1-3c81-42a9-b6b7-002bd195c2d5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:25.982689 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2974/5898] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:25 2022] PUT /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:25.987181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753770b-064f-4a8c-8cd9-f1f9b2680315 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:26.010230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753770b-064f-4a8c-8cd9-f1f9b2680315 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:26.173096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083581-78cf-464d-8fa4-08e9575a589c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:26.201657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083581-78cf-464d-8fa4-08e9575a589c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:26.202072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083581-78cf-464d-8fa4-08e9575a589c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:26.202381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98083581-78cf-464d-8fa4-08e9575a589c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:26.209997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98083581-78cf-464d-8fa4-08e9575a589c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81, group_id=7a6cd2d8b42c4a4cac3626f273435ddd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:26.218350 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-98083581-78cf-464d-8fa4-08e9575a589c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:26.218350 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:26.218350 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:26.226229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98083581-78cf-464d-8fa4-08e9575a589c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:26.289639 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2925/5899] 10.222.0.16 () {58 vars in 1364 bytes} [Sat Mar 26 21:09:25 2022] GET /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles => generated 410 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:26.294185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab1db1-3c81-42a9-b6b7-002bd195c2d5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:26.311763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab1db1-3c81-42a9-b6b7-002bd195c2d5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:26.340366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:26.341271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:26.348156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:26.349254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:26.355676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81, group_id=7a6cd2d8b42c4a4cac3626f273435ddd, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:26.361754 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:26.361754 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:26.361754 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:26.367897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:26.389256 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2975/5900] 10.222.0.16 () {58 vars in 1464 bytes} [Sat Mar 26 21:09:26 2022] HEAD /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:26.393427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083581-78cf-464d-8fa4-08e9575a589c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:26.409162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98083581-78cf-464d-8fa4-08e9575a589c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:26.430480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:26.433955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:26.434254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:26.434542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:26.440533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81, group_id=7a6cd2d8b42c4a4cac3626f273435ddd, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:26.448377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:26.476807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role e79bfe60a28640988d99e64ab7826768 was removed from group 7a6cd2d8b42c4a4cac3626f273435ddd on domain dc8dd98fcf3743a0a8e7adc3d2b76d81. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:26.477113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:26.483350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:26.527949 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2926/5901] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Mar 26 21:09:26 2022] DELETE /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:26.533566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:26.535538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:26.575876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd814f2-eb4a-440a-9c32-981b80a1f3fb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:26.826550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec4fee-cbeb-4d00-8c60-d05df884ad9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:26.827132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec4fee-cbeb-4d00-8c60-d05df884ad9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:26.827421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec4fee-cbeb-4d00-8c60-d05df884ad9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:26.827856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec4fee-cbeb-4d00-8c60-d05df884ad9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:26.836203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec4fee-cbeb-4d00-8c60-d05df884ad9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, group_id=7a6cd2d8b42c4a4cac3626f273435ddd, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:26.846204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec4fee-cbeb-4d00-8c60-d05df884ad9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:26.888413 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2976/5902] 10.222.0.16 () {60 vars in 1485 bytes} [Sat Mar 26 21:09:26 2022] PUT /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:26.892614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:26.916476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05dd862-735d-4428-b43c-ef5b4e0c4f9d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:27.206679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe820f-dcaf-4182-b414-bd6763156425 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:27.210139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe820f-dcaf-4182-b414-bd6763156425 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:27.213805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe820f-dcaf-4182-b414-bd6763156425 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:27.214328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe820f-dcaf-4182-b414-bd6763156425 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:27.224300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe820f-dcaf-4182-b414-bd6763156425 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d1f1f6ffc8b24ae19e49621106b20fec, group_id=7a6cd2d8b42c4a4cac3626f273435ddd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:27.233839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe820f-dcaf-4182-b414-bd6763156425 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:27.264929 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2927/5903] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Mar 26 21:09:26 2022] GET /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles => generated 411 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:27.269929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec4fee-cbeb-4d00-8c60-d05df884ad9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:27.303578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec4fee-cbeb-4d00-8c60-d05df884ad9f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:27.318230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a582-dd10-41d9-9285-322872ae2060 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:27.319449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a582-dd10-41d9-9285-322872ae2060 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:27.319943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a582-dd10-41d9-9285-322872ae2060 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:27.320372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a582-dd10-41d9-9285-322872ae2060 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/groups/7a6cd2d8b42c4a4cac3626f273435ddd/users/5f4cdb1b8b404a2880534f25cf70c14c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:27.322378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a582-dd10-41d9-9285-322872ae2060 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7a6cd2d8b42c4a4cac3626f273435ddd, user_id=5f4cdb1b8b404a2880534f25cf70c14c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:27.324853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a582-dd10-41d9-9285-322872ae2060 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:27.418661 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2977/5904] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Mar 26 21:09:27 2022] PUT /identity/v3/groups/7a6cd2d8b42c4a4cac3626f273435ddd/users/5f4cdb1b8b404a2880534f25cf70c14c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:27.423797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0f82-56be-47e7-8d07-cec6d05347d0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:27.424703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0f82-56be-47e7-8d07-cec6d05347d0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:27.424703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b0f82-56be-47e7-8d07-cec6d05347d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:27.549961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-df4b0f82-56be-47e7-8d07-cec6d05347d0 None None] MFA Rules not processed for user `5f4cdb1b8b404a2880534f25cf70c14c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:27.551476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-df4b0f82-56be-47e7-8d07-cec6d05347d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:27.818092 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2928/5905] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:27.822134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a582-dd10-41d9-9285-322872ae2060 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:28.066269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a582-dd10-41d9-9285-322872ae2060 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:28.096679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e057142-08be-4ca5-8bfd-bf7c4474c695 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:28.100906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e057142-08be-4ca5-8bfd-bf7c4474c695 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:28.102334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e057142-08be-4ca5-8bfd-bf7c4474c695 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:28.102965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e057142-08be-4ca5-8bfd-bf7c4474c695 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:28.116991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e057142-08be-4ca5-8bfd-bf7c4474c695 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, group_id=7a6cd2d8b42c4a4cac3626f273435ddd, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:28.119816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e057142-08be-4ca5-8bfd-bf7c4474c695 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:28.144948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2978/5906] 10.222.0.16 () {58 vars in 1467 bytes} [Sat Mar 26 21:09:27 2022] HEAD /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:28.149122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b0f82-56be-47e7-8d07-cec6d05347d0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:28.175030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b0f82-56be-47e7-8d07-cec6d05347d0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:28.198706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:28.199621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:28.199902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:28.200227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:28.210349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, group_id=7a6cd2d8b42c4a4cac3626f273435ddd, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:28.213330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:28.236584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role e79bfe60a28640988d99e64ab7826768 was removed from group 7a6cd2d8b42c4a4cac3626f273435ddd on project d1f1f6ffc8b24ae19e49621106b20fec. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:28.238549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:28.241470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:28.285410 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2929/5907] 10.222.0.16 () {58 vars in 1469 bytes} [Sat Mar 26 21:09:28 2022] DELETE /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:28.289705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e057142-08be-4ca5-8bfd-bf7c4474c695 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:28.291893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1e057142-08be-4ca5-8bfd-bf7c4474c695 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:28.326741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e057142-08be-4ca5-8bfd-bf7c4474c695 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:28.465434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7328a31-b1de-4d7b-a228-b133df2ab65f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:28.466638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7328a31-b1de-4d7b-a228-b133df2ab65f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:28.467073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7328a31-b1de-4d7b-a228-b133df2ab65f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:28.467593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7328a31-b1de-4d7b-a228-b133df2ab65f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/groups/7a6cd2d8b42c4a4cac3626f273435ddd/users/5f4cdb1b8b404a2880534f25cf70c14c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:28.472957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7328a31-b1de-4d7b-a228-b133df2ab65f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7a6cd2d8b42c4a4cac3626f273435ddd, user_id=5f4cdb1b8b404a2880534f25cf70c14c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:28.476378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7328a31-b1de-4d7b-a228-b133df2ab65f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:28.502606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d7328a31-b1de-4d7b-a228-b133df2ab65f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5f4cdb1b8b404a2880534f25cf70c14c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:28.532603 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2979/5908] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Mar 26 21:09:28 2022] DELETE /identity/v3/groups/7a6cd2d8b42c4a4cac3626f273435ddd/users/5f4cdb1b8b404a2880534f25cf70c14c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:28.537961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:28.555554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09abba05-2ead-4bfc-9193-d7c5c41c2527 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:28.707507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36fea0-f36f-4388-9df4-aa981da3e5e3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:28.708848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36fea0-f36f-4388-9df4-aa981da3e5e3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:28.709320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36fea0-f36f-4388-9df4-aa981da3e5e3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:28.709748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36fea0-f36f-4388-9df4-aa981da3e5e3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/system/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:28.711907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36fea0-f36f-4388-9df4-aa981da3e5e3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=7a6cd2d8b42c4a4cac3626f273435ddd, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:28.713152 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-0f36fea0-f36f-4388-9df4-aa981da3e5e3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:28.713152 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:28.713152 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:28.714562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36fea0-f36f-4388-9df4-aa981da3e5e3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:28.728496 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2930/5909] 10.222.0.16 () {60 vars in 1380 bytes} [Sat Mar 26 21:09:28 2022] PUT /identity/v3/system/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:28.734611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7328a31-b1de-4d7b-a228-b133df2ab65f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:28.776667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7328a31-b1de-4d7b-a228-b133df2ab65f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:28.787211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:28.788214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:28.788504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:28.788840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/system/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:28.790160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=7a6cd2d8b42c4a4cac3626f273435ddd)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:28.791265 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:28.791265 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:28.791265 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:28.792215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:28.839015 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2980/5910] 10.222.0.16 () {58 vars in 1262 bytes} [Sat Mar 26 21:09:28 2022] GET /identity/v3/system/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles => generated 376 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:28.842392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36fea0-f36f-4388-9df4-aa981da3e5e3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:28.869416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36fea0-f36f-4388-9df4-aa981da3e5e3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:28.906539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849380a5-8139-439b-88cb-9068db6f08cc tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:28.910533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849380a5-8139-439b-88cb-9068db6f08cc tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:28.910831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849380a5-8139-439b-88cb-9068db6f08cc tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:28.913011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849380a5-8139-439b-88cb-9068db6f08cc tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/system/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:28.919304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849380a5-8139-439b-88cb-9068db6f08cc tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=7a6cd2d8b42c4a4cac3626f273435ddd, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:28.920193 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-849380a5-8139-439b-88cb-9068db6f08cc tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:28.920193 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:28.920193 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:28.921010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:28.921163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849380a5-8139-439b-88cb-9068db6f08cc tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:28.924724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:28.955742 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2931/5911] 10.222.0.16 () {58 vars in 1362 bytes} [Sat Mar 26 21:09:28 2022] HEAD /identity/v3/system/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:28.962586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849380a5-8139-439b-88cb-9068db6f08cc tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:28.991808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849380a5-8139-439b-88cb-9068db6f08cc tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:29.013880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4eef7-9401-4373-80e8-ce1bb6da02b5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:29.013880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4eef7-9401-4373-80e8-ce1bb6da02b5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:29.013880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4eef7-9401-4373-80e8-ce1bb6da02b5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:29.014309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4eef7-9401-4373-80e8-ce1bb6da02b5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/system/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:29.019781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4eef7-9401-4373-80e8-ce1bb6da02b5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=7a6cd2d8b42c4a4cac3626f273435ddd, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:29.026718 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-58f4eef7-9401-4373-80e8-ce1bb6da02b5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:29.026718 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:29.026718 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:29.031198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f4eef7-9401-4373-80e8-ce1bb6da02b5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:29.046668 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2932/5912] 10.222.0.16 () {58 vars in 1364 bytes} [Sat Mar 26 21:09:28 2022] DELETE /identity/v3/system/groups/7a6cd2d8b42c4a4cac3626f273435ddd/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:29.051963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4eef7-9401-4373-80e8-ce1bb6da02b5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:29.064629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4eef7-9401-4373-80e8-ce1bb6da02b5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:29.071306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04f3e-da13-4dd2-8a42-e4ffb4a00dfb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:29.072357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04f3e-da13-4dd2-8a42-e4ffb4a00dfb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:29.072683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04f3e-da13-4dd2-8a42-e4ffb4a00dfb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:29.072965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b04f3e-da13-4dd2-8a42-e4ffb4a00dfb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:29.075734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b04f3e-da13-4dd2-8a42-e4ffb4a00dfb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:29.079050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b04f3e-da13-4dd2-8a42-e4ffb4a00dfb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:29.100520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c2a24-1c34-4614-bd75-b8091b5a9ae5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:29.102834 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2933/5913] 10.222.0.16 () {60 vars in 1479 bytes} [Sat Mar 26 21:09:29 2022] PUT /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:29.108452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04f3e-da13-4dd2-8a42-e4ffb4a00dfb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:29.186660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b04f3e-da13-4dd2-8a42-e4ffb4a00dfb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:29.189332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:29.190411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:29.190868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:29.191290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] PATH_INFO: `/v3/users/9d7e99c126f3435ea890fa21c1614041` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:29.192749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7e99c126f3435ea890fa21c1614041)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:29.193171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5b45-6a2c-4a1c-8270-c015a770a0a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:29.194861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5b45-6a2c-4a1c-8270-c015a770a0a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:29.195138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5b45-6a2c-4a1c-8270-c015a770a0a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:29.195607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a5b45-6a2c-4a1c-8270-c015a770a0a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/users/5f4cdb1b8b404a2880534f25cf70c14c/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:29.196523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:29.197797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a5b45-6a2c-4a1c-8270-c015a770a0a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81, user_id=5f4cdb1b8b404a2880534f25cf70c14c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:29.200875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a5b45-6a2c-4a1c-8270-c015a770a0a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:29.219883 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2934/5914] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Mar 26 21:09:29 2022] GET /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/users/5f4cdb1b8b404a2880534f25cf70c14c/roles => generated 409 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:29.221325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5b45-6a2c-4a1c-8270-c015a770a0a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:29.243814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a5b45-6a2c-4a1c-8270-c015a770a0a8 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:29.250402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1c93a-9222-436c-be5a-2a6090a3fb56 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:29.251979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c93a-9222-436c-be5a-2a6090a3fb56 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:29.252551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c93a-9222-436c-be5a-2a6090a3fb56 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:29.253070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1c93a-9222-436c-be5a-2a6090a3fb56 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:29.257269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c93a-9222-436c-be5a-2a6090a3fb56 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:29.258700 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-d1b1c93a-9222-436c-be5a-2a6090a3fb56 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:29.258700 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:29.258700 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:29.262459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1c93a-9222-436c-be5a-2a6090a3fb56 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:29.262713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7e99c126f3435ea890fa21c1614041'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:29.272653 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2935/5915] 10.222.0.16 () {58 vars in 1461 bytes} [Sat Mar 26 21:09:29 2022] HEAD /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:29.278588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07597780-bdc2-47ac-be5b-66e529649b73 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:29.279215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07597780-bdc2-47ac-be5b-66e529649b73 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:29.279694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07597780-bdc2-47ac-be5b-66e529649b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:29.287423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7e99c126f3435ea890fa21c1614041'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:29.289600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7e99c126f3435ea890fa21c1614041'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:29.290380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7e99c126f3435ea890fa21c1614041'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:29.307682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7e99c126f3435ea890fa21c1614041'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:29.321065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-07597780-bdc2-47ac-be5b-66e529649b73 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:29.323999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-07597780-bdc2-47ac-be5b-66e529649b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:29.341358 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2981/5916] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:28 2022] DELETE /identity/v3/users/9d7e99c126f3435ea890fa21c1614041 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:29.344639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:29.346201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:29.433395 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2936/5917] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:29.435610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa7db4-4f32-4346-bf3b-abbe5a5685bd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:29.436346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa7db4-4f32-4346-bf3b-abbe5a5685bd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:29.436801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa7db4-4f32-4346-bf3b-abbe5a5685bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:29.470952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a1aa7db4-4f32-4346-bf3b-abbe5a5685bd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:29.472851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a1aa7db4-4f32-4346-bf3b-abbe5a5685bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:29.558759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994e508-2fce-41ab-aa38-4e2d1bca7a0b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:29.571792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:29.574654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:29.577160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:29.577561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:29.581928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:29.589721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:29.611606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role e79bfe60a28640988d99e64ab7826768 was removed from user 5f4cdb1b8b404a2880534f25cf70c14c on domain dc8dd98fcf3743a0a8e7adc3d2b76d81. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:29.611966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:29.613522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:29.645613 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2982/5918] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Mar 26 21:09:29 2022] DELETE /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:29.650785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:29.654378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:29.661385 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2937/5919] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:29.738512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa7db4-4f32-4346-bf3b-abbe5a5685bd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:29.740084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a1aa7db4-4f32-4346-bf3b-abbe5a5685bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:29.805759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49767d8-acc7-4dd2-9f3d-56e98e1a8e1e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:29.813008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd30283-54dd-425c-aa3c-1c2c3ee60518 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:29.816367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd30283-54dd-425c-aa3c-1c2c3ee60518 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:29.817198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd30283-54dd-425c-aa3c-1c2c3ee60518 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:29.817735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd30283-54dd-425c-aa3c-1c2c3ee60518 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:29.829745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd30283-54dd-425c-aa3c-1c2c3ee60518 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:29.834341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd30283-54dd-425c-aa3c-1c2c3ee60518 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:29.861960 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2983/5920] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:29 2022] PUT /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:29.867585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd30283-54dd-425c-aa3c-1c2c3ee60518 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:29.881139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa7db4-4f32-4346-bf3b-abbe5a5685bd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.027392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177216ac-c13e-4185-b9b6-38b8677fe10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.028353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177216ac-c13e-4185-b9b6-38b8677fe10d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.028783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177216ac-c13e-4185-b9b6-38b8677fe10d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.029169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177216ac-c13e-4185-b9b6-38b8677fe10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.036974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd30283-54dd-425c-aa3c-1c2c3ee60518 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.051486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd059-df92-46c8-92d2-8a58a598e1d1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.052377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd059-df92-46c8-92d2-8a58a598e1d1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.052674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd059-df92-46c8-92d2-8a58a598e1d1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.052937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd059-df92-46c8-92d2-8a58a598e1d1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.073594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd059-df92-46c8-92d2-8a58a598e1d1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_grants(project_id=d1f1f6ffc8b24ae19e49621106b20fec, user_id=5f4cdb1b8b404a2880534f25cf70c14c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.074502 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-7d9bd059-df92-46c8-92d2-8a58a598e1d1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:30.074502 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:30.074502 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:30.083099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd059-df92-46c8-92d2-8a58a598e1d1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.140222 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2984/5921] 10.222.0.16 () {58 vars in 1364 bytes} [Sat Mar 26 21:09:29 2022] GET /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles => generated 410 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:30.144413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd059-df92-46c8-92d2-8a58a598e1d1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.161269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177216ac-c13e-4185-b9b6-38b8677fe10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.165470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177216ac-c13e-4185-b9b6-38b8677fe10d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.173209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd059-df92-46c8-92d2-8a58a598e1d1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.180635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c04693-98af-43c0-93bf-25454c08c4ec tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.184748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c04693-98af-43c0-93bf-25454c08c4ec tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.188433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c04693-98af-43c0-93bf-25454c08c4ec tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.189121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c04693-98af-43c0-93bf-25454c08c4ec tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.195140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c04693-98af-43c0-93bf-25454c08c4ec tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:check_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.202215 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2938/5922] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:30.204454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c04693-98af-43c0-93bf-25454c08c4ec tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.217275 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2985/5923] 10.222.0.16 () {58 vars in 1464 bytes} [Sat Mar 26 21:09:30 2022] HEAD /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:30.221732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177216ac-c13e-4185-b9b6-38b8677fe10d service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.237597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177216ac-c13e-4185-b9b6-38b8677fe10d service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.244756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.249844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.250089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.250595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.254659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=d1f1f6ffc8b24ae19e49621106b20fec, user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.258392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.269385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role e79bfe60a28640988d99e64ab7826768 was removed from user 5f4cdb1b8b404a2880534f25cf70c14c on project d1f1f6ffc8b24ae19e49621106b20fec. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:30.269740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:30.271161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:30.302877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c04693-98af-43c0-93bf-25454c08c4ec tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.305143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-01c04693-98af-43c0-93bf-25454c08c4ec tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:30.312037 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2939/5924] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Mar 26 21:09:30 2022] DELETE /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:30.327167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c04693-98af-43c0-93bf-25454c08c4ec tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.461960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abeecc-6b14-4cb6-a181-8e28b0fe4f5e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.463065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abeecc-6b14-4cb6-a181-8e28b0fe4f5e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.463243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abeecc-6b14-4cb6-a181-8e28b0fe4f5e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.463520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abeecc-6b14-4cb6-a181-8e28b0fe4f5e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/system/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.465974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abeecc-6b14-4cb6-a181-8e28b0fe4f5e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.467287 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-b3abeecc-6b14-4cb6-a181-8e28b0fe4f5e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:30.467287 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:30.467287 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:30.468357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abeecc-6b14-4cb6-a181-8e28b0fe4f5e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.486255 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2986/5925] 10.222.0.16 () {60 vars in 1377 bytes} [Sat Mar 26 21:09:30 2022] PUT /identity/v3/system/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:30.487053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.501620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba09e5a-d7a8-4098-a31f-dd2184f8a410 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.514813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b55c53-f829-4d3a-be35-7b72d84508db tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.516610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b55c53-f829-4d3a-be35-7b72d84508db tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.516979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b55c53-f829-4d3a-be35-7b72d84508db tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.517330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b55c53-f829-4d3a-be35-7b72d84508db tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/system/users/5f4cdb1b8b404a2880534f25cf70c14c/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.520743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b55c53-f829-4d3a-be35-7b72d84508db tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=5f4cdb1b8b404a2880534f25cf70c14c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.522327 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-08b55c53-f829-4d3a-be35-7b72d84508db tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:30.522327 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:30.522327 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:30.523339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b55c53-f829-4d3a-be35-7b72d84508db tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.538108 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2940/5926] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 21:09:30 2022] GET /identity/v3/system/users/5f4cdb1b8b404a2880534f25cf70c14c/roles => generated 375 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:09:30.542612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abeecc-6b14-4cb6-a181-8e28b0fe4f5e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.556928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abeecc-6b14-4cb6-a181-8e28b0fe4f5e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.568981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f87b-2f7b-44ba-93b4-13a0a5c46f84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.569864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f87b-2f7b-44ba-93b4-13a0a5c46f84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.570231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f87b-2f7b-44ba-93b4-13a0a5c46f84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.570656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7f87b-2f7b-44ba-93b4-13a0a5c46f84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/system/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.604115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f87b-2f7b-44ba-93b4-13a0a5c46f84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.604115 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-95b7f87b-2f7b-44ba-93b4-13a0a5c46f84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:30.604115 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:30.604115 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:30.604115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7f87b-2f7b-44ba-93b4-13a0a5c46f84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.617735 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2987/5927] 10.222.0.16 () {58 vars in 1359 bytes} [Sat Mar 26 21:09:30 2022] HEAD /identity/v3/system/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:30.619409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b55c53-f829-4d3a-be35-7b72d84508db tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.637823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b55c53-f829-4d3a-be35-7b72d84508db tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.651684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d3377-0d58-4c33-8dbf-c748abd94026 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.652788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d3377-0d58-4c33-8dbf-c748abd94026 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.652996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d3377-0d58-4c33-8dbf-c748abd94026 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.653296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d3377-0d58-4c33-8dbf-c748abd94026 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/system/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.665927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d3377-0d58-4c33-8dbf-c748abd94026 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=5f4cdb1b8b404a2880534f25cf70c14c, role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.666507 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-e72d3377-0d58-4c33-8dbf-c748abd94026 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:30.666507 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:30.666507 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:30.667407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d3377-0d58-4c33-8dbf-c748abd94026 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.685327 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2941/5928] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Mar 26 21:09:30 2022] DELETE /identity/v3/system/users/5f4cdb1b8b404a2880534f25cf70c14c/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:30.690907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f87b-2f7b-44ba-93b4-13a0a5c46f84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.704344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7f87b-2f7b-44ba-93b4-13a0a5c46f84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.718979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777fe3-4200-47d2-9017-0c592f178683 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.721654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777fe3-4200-47d2-9017-0c592f178683 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.722257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777fe3-4200-47d2-9017-0c592f178683 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.722883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66777fe3-4200-47d2-9017-0c592f178683 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.725022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66777fe3-4200-47d2-9017-0c592f178683 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.731480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66777fe3-4200-47d2-9017-0c592f178683 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.756559 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2988/5929] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:09:30 2022] POST /identity/v3/roles => generated 270 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:30.760645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d3377-0d58-4c33-8dbf-c748abd94026 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.777654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d3377-0d58-4c33-8dbf-c748abd94026 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.791743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9625b26-a109-4611-a7f1-6a23407ef11f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.792454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9625b26-a109-4611-a7f1-6a23407ef11f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.792792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9625b26-a109-4611-a7f1-6a23407ef11f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.793010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9625b26-a109-4611-a7f1-6a23407ef11f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.793774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9625b26-a109-4611-a7f1-6a23407ef11f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.795963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9625b26-a109-4611-a7f1-6a23407ef11f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.826779 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2942/5930] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:09:30 2022] POST /identity/v3/roles => generated 270 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:30.831280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777fe3-4200-47d2-9017-0c592f178683 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.843862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66777fe3-4200-47d2-9017-0c592f178683 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:30.854869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3be7d-5be4-4a4e-a237-6703026ded46 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:30.856419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3be7d-5be4-4a4e-a237-6703026ded46 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:30.857855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3be7d-5be4-4a4e-a237-6703026ded46 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:30.858722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3be7d-5be4-4a4e-a237-6703026ded46 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/30a229c55d2049b584f755f6167505f1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:30.865194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3be7d-5be4-4a4e-a237-6703026ded46 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9fc355d9454341d5bd5f3722ca35353b, implied_role_id=30a229c55d2049b584f755f6167505f1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:30.866912 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-05e3be7d-5be4-4a4e-a237-6703026ded46 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:30.866912 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:30.866912 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:30.871808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3be7d-5be4-4a4e-a237-6703026ded46 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:30.939219 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2989/5931] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:30 2022] PUT /identity/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/30a229c55d2049b584f755f6167505f1 => generated 531 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:30.940487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9625b26-a109-4611-a7f1-6a23407ef11f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:30.957727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9625b26-a109-4611-a7f1-6a23407ef11f tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:31.106647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de325e1c-85e1-44b5-ba2b-4f2c37ed5eb5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:31.108872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de325e1c-85e1-44b5-ba2b-4f2c37ed5eb5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:31.109464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de325e1c-85e1-44b5-ba2b-4f2c37ed5eb5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:31.109808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de325e1c-85e1-44b5-ba2b-4f2c37ed5eb5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:31.111040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de325e1c-85e1-44b5-ba2b-4f2c37ed5eb5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:31.112876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de325e1c-85e1-44b5-ba2b-4f2c37ed5eb5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:31.142677 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2943/5932] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:09:30 2022] POST /identity/v3/domains => generated 277 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:31.146611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3be7d-5be4-4a4e-a237-6703026ded46 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:31.162961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3be7d-5be4-4a4e-a237-6703026ded46 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:31.257191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e2602-58f7-4a05-9e3d-7ee97553144b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:31.257832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2602-58f7-4a05-9e3d-7ee97553144b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:31.258215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2602-58f7-4a05-9e3d-7ee97553144b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:31.258579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2602-58f7-4a05-9e3d-7ee97553144b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:31.259386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e2602-58f7-4a05-9e3d-7ee97553144b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:31.261157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e2602-58f7-4a05-9e3d-7ee97553144b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:31.282224 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2990/5933] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:09:31 2022] POST /identity/v3/roles => generated 270 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:31.285187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de325e1c-85e1-44b5-ba2b-4f2c37ed5eb5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:31.304808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de325e1c-85e1-44b5-ba2b-4f2c37ed5eb5 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:31.310209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caeffd-33bf-4a29-978f-ec36b4c6d628 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:31.311320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caeffd-33bf-4a29-978f-ec36b4c6d628 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:31.311839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caeffd-33bf-4a29-978f-ec36b4c6d628 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:31.312364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11caeffd-33bf-4a29-978f-ec36b4c6d628 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/9e55b63b5c054b84a6007307ed2dacdc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:31.315021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caeffd-33bf-4a29-978f-ec36b4c6d628 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9fc355d9454341d5bd5f3722ca35353b, implied_role_id=9e55b63b5c054b84a6007307ed2dacdc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:31.317317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11caeffd-33bf-4a29-978f-ec36b4c6d628 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:31.372220 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2944/5934] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:31 2022] PUT /identity/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/9e55b63b5c054b84a6007307ed2dacdc => generated 531 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:31.376780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e2602-58f7-4a05-9e3d-7ee97553144b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:31.391037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e2602-58f7-4a05-9e3d-7ee97553144b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:31.490582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841564fe-4453-4202-9294-1f47da2b57a4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:31.491518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841564fe-4453-4202-9294-1f47da2b57a4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:31.491798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841564fe-4453-4202-9294-1f47da2b57a4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:31.495338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841564fe-4453-4202-9294-1f47da2b57a4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:31.498516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841564fe-4453-4202-9294-1f47da2b57a4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9fc355d9454341d5bd5f3722ca35353b, implied_role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:31.501626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841564fe-4453-4202-9294-1f47da2b57a4 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:31.543627 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2991/5935] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:31 2022] PUT /identity/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/e79bfe60a28640988d99e64ab7826768 => generated 526 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:31.543793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caeffd-33bf-4a29-978f-ec36b4c6d628 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:31.546864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec838b4-cd3b-498a-adeb-fd665307868f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:31.547165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec838b4-cd3b-498a-adeb-fd665307868f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:31.548276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec838b4-cd3b-498a-adeb-fd665307868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:31.557801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11caeffd-33bf-4a29-978f-ec36b4c6d628 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:31.568258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3ec838b4-cd3b-498a-adeb-fd665307868f None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:31.569697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3ec838b4-cd3b-498a-adeb-fd665307868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:31.663391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058ef5-886e-46c2-aa49-48e82f415407 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:31.664301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058ef5-886e-46c2-aa49-48e82f415407 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:31.664789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058ef5-886e-46c2-aa49-48e82f415407 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:31.665069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058ef5-886e-46c2-aa49-48e82f415407 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/e79bfe60a28640988d99e64ab7826768/implies/9fc355d9454341d5bd5f3722ca35353b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:31.666832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f058ef5-886e-46c2-aa49-48e82f415407 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e79bfe60a28640988d99e64ab7826768, implied_role_id=9fc355d9454341d5bd5f3722ca35353b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:31.668628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f058ef5-886e-46c2-aa49-48e82f415407 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:31.687575 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2992/5936] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:31.695891 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-7f058ef5-886e-46c2-aa49-48e82f415407 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] 9fc355d9454341d5bd5f3722ca35353b cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 9fc355d9454341d5bd5f3722ca35353b cannot be an implied roles. Mar 26 21:09:31.697686 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2945/5937] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:31 2022] PUT /identity/v3/roles/e79bfe60a28640988d99e64ab7826768/implies/9fc355d9454341d5bd5f3722ca35353b => generated 116 bytes in 155 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Mar 26 21:09:31.702478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec838b4-cd3b-498a-adeb-fd665307868f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:31.727149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec838b4-cd3b-498a-adeb-fd665307868f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:31.746425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19591ef7-c3ae-4b92-9b3b-6c3093416edb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:31.747600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591ef7-c3ae-4b92-9b3b-6c3093416edb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:31.748073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591ef7-c3ae-4b92-9b3b-6c3093416edb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:31.748650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19591ef7-c3ae-4b92-9b3b-6c3093416edb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:31.756934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19591ef7-c3ae-4b92-9b3b-6c3093416edb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9fc355d9454341d5bd5f3722ca35353b, implied_role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:31.758924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19591ef7-c3ae-4b92-9b3b-6c3093416edb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:31.783714 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2993/5938] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:31 2022] DELETE /identity/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:31.787695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058ef5-886e-46c2-aa49-48e82f415407 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:31.805644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058ef5-886e-46c2-aa49-48e82f415407 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:31.948669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b14b3d-8c85-435a-83de-4948b4c5cc9e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:31.949728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b14b3d-8c85-435a-83de-4948b4c5cc9e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:31.949918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b14b3d-8c85-435a-83de-4948b4c5cc9e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:31.950183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b14b3d-8c85-435a-83de-4948b4c5cc9e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/9e55b63b5c054b84a6007307ed2dacdc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:31.959444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b14b3d-8c85-435a-83de-4948b4c5cc9e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9fc355d9454341d5bd5f3722ca35353b, implied_role_id=9e55b63b5c054b84a6007307ed2dacdc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:31.961140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b14b3d-8c85-435a-83de-4948b4c5cc9e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:31.987409 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2946/5939] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:31 2022] DELETE /identity/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/9e55b63b5c054b84a6007307ed2dacdc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:31.991850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19591ef7-c3ae-4b92-9b3b-6c3093416edb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:32.003488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19591ef7-c3ae-4b92-9b3b-6c3093416edb tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:32.134705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:32.135743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:32.136064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:32.136346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/9e55b63b5c054b84a6007307ed2dacdc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:32.137815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=9e55b63b5c054b84a6007307ed2dacdc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:32.139447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:32.204921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 9e55b63b5c054b84a6007307ed2dacdc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:32.206110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.207038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.209828 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2994/5940] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:31 2022] DELETE /identity/v3/roles/9e55b63b5c054b84a6007307ed2dacdc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:32.214457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b14b3d-8c85-435a-83de-4948b4c5cc9e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:32.217106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e9b14b3d-8c85-435a-83de-4948b4c5cc9e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:32.255767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b14b3d-8c85-435a-83de-4948b4c5cc9e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:32.342610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:32.343560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:32.344211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:32.344572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/0e5961143eaa4484a323438220ca383c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:32.362458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0e5961143eaa4484a323438220ca383c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:32.365357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:32.399332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0e5961143eaa4484a323438220ca383c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.400399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0e5961143eaa4484a323438220ca383c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.432412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0e5961143eaa4484a323438220ca383c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.433108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-141d5920-71de-4aa5-a65e-3194dc40dab2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0e5961143eaa4484a323438220ca383c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.435776 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2947/5941] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:09:32 2022] PATCH /identity/v3/domains/0e5961143eaa4484a323438220ca383c => generated 278 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:32.440161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:32.450642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdfeb5-f856-4f1a-8254-ccd504cd2446 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:32.524972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:32.525978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:32.526168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:32.526397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/0e5961143eaa4484a323438220ca383c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:32.539961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0e5961143eaa4484a323438220ca383c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:32.542189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:32.574995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e5961143eaa4484a323438220ca383c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.579577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e5961143eaa4484a323438220ca383c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.633160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5961143eaa4484a323438220ca383c', 'request_id': 'req-3f8ba537-63c6-4b78-b37e-109fda4bf19e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.645714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5961143eaa4484a323438220ca383c', 'request_id': 'req-3f8ba537-63c6-4b78-b37e-109fda4bf19e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.653508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5961143eaa4484a323438220ca383c', 'request_id': 'req-3f8ba537-63c6-4b78-b37e-109fda4bf19e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.674770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf183727-51a5-4927-a84b-d06ba4548d71 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:32.675284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf183727-51a5-4927-a84b-d06ba4548d71 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:32.675828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf183727-51a5-4927-a84b-d06ba4548d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:32.681121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] The token cache is being invalidate because project 0e5961143eaa4484a323438220ca383c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:32.681554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.682344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.691860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e5961143eaa4484a323438220ca383c', 'request_id': 'req-3f8ba537-63c6-4b78-b37e-109fda4bf19e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.692726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e5961143eaa4484a323438220ca383c', 'request_id': 'req-3f8ba537-63c6-4b78-b37e-109fda4bf19e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.693761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e5961143eaa4484a323438220ca383c', 'request_id': 'req-3f8ba537-63c6-4b78-b37e-109fda4bf19e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:32.704528 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2995/5942] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:32 2022] DELETE /identity/v3/domains/0e5961143eaa4484a323438220ca383c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:32.708402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:32.710004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:32.719959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cf183727-51a5-4927-a84b-d06ba4548d71 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:32.722585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf183727-51a5-4927-a84b-d06ba4548d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:32.818323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ba537-63c6-4b78-b37e-109fda4bf19e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:32.823897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18ff3-e029-4ed1-929f-dcb9a9cfa34e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:32.825142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18ff3-e029-4ed1-929f-dcb9a9cfa34e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:32.825462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18ff3-e029-4ed1-929f-dcb9a9cfa34e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:32.826471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18ff3-e029-4ed1-929f-dcb9a9cfa34e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/30a229c55d2049b584f755f6167505f1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:32.829726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a18ff3-e029-4ed1-929f-dcb9a9cfa34e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9fc355d9454341d5bd5f3722ca35353b, implied_role_id=30a229c55d2049b584f755f6167505f1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:32.831709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a18ff3-e029-4ed1-929f-dcb9a9cfa34e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:32.852100 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2996/5943] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:32 2022] DELETE /identity/v3/roles/9fc355d9454341d5bd5f3722ca35353b/implies/30a229c55d2049b584f755f6167505f1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:32.855554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18ff3-e029-4ed1-929f-dcb9a9cfa34e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:32.857232 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2948/5944] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:32.962096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18ff3-e029-4ed1-929f-dcb9a9cfa34e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:32.967968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:32.968844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:32.969161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:32.969444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/30a229c55d2049b584f755f6167505f1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:32.970707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=30a229c55d2049b584f755f6167505f1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:32.972566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.025256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 30a229c55d2049b584f755f6167505f1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:33.025800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:33.027243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf183727-51a5-4927-a84b-d06ba4548d71 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.029170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf183727-51a5-4927-a84b-d06ba4548d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:33.030587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:33.033891 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2997/5945] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:32 2022] DELETE /identity/v3/roles/30a229c55d2049b584f755f6167505f1 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:33.037666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.039214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:33.116884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65559af5-fe8a-4b65-a7d8-ca188a5d0d40 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:33.124265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:33.125234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.125613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.125961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/9fc355d9454341d5bd5f3722ca35353b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.127395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=9fc355d9454341d5bd5f3722ca35353b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.129448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.129649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf183727-51a5-4927-a84b-d06ba4548d71 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:33.169515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 9fc355d9454341d5bd5f3722ca35353b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:33.169908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:33.170800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:33.173798 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2998/5946] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:33 2022] DELETE /identity/v3/roles/9fc355d9454341d5bd5f3722ca35353b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:33.180059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.181628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:33.208553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:33.210954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.211472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.211991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] PATH_INFO: `/v3/projects/8657daeb436044378b8b124a0f9d5c15` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.214700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8657daeb436044378b8b124a0f9d5c15)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.217755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.270473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22013394-82ae-4bed-b5b2-12240d9cd8d0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:33.278469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158eb3c6-4bd8-4724-85ee-86d70dba6936 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:33.279539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eb3c6-4bd8-4724-85ee-86d70dba6936 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.280012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eb3c6-4bd8-4724-85ee-86d70dba6936 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.280375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158eb3c6-4bd8-4724-85ee-86d70dba6936 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.294870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158eb3c6-4bd8-4724-85ee-86d70dba6936 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.298341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158eb3c6-4bd8-4724-85ee-86d70dba6936 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.345258 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 2999/5947] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:33 2022] PUT /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 519 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:33.351468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158eb3c6-4bd8-4724-85ee-86d70dba6936 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.353801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8657daeb436044378b8b124a0f9d5c15', 'request_id': 'req-0697ce23-19cf-4639-a1f2-4b512c59bcab'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:33.374915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8657daeb436044378b8b124a0f9d5c15', 'request_id': 'req-0697ce23-19cf-4639-a1f2-4b512c59bcab'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:33.406395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8657daeb436044378b8b124a0f9d5c15', 'request_id': 'req-0697ce23-19cf-4639-a1f2-4b512c59bcab'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:33.429653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] The token cache is being invalidate because project 8657daeb436044378b8b124a0f9d5c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:33.429955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:33.431583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0697ce23-19cf-4639-a1f2-4b512c59bcab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:33.434857 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2949/5948] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:33 2022] DELETE /identity/v3/projects/8657daeb436044378b8b124a0f9d5c15 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:33.441064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb249d-45f7-40e8-80bc-a0c5271c7e56 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.441546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb249d-45f7-40e8-80bc-a0c5271c7e56 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.441831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb249d-45f7-40e8-80bc-a0c5271c7e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.501754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-70eb249d-45f7-40e8-80bc-a0c5271c7e56 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:33.504307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158eb3c6-4bd8-4724-85ee-86d70dba6936 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:33.505785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-70eb249d-45f7-40e8-80bc-a0c5271c7e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:33.519941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:33.521210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.521691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.522155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.527207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.528671 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:33.528671 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:33.528671 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:33.529905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.532106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.533426 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:33.533426 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:33.533426 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:33.536291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.551572 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3000/5949] 10.222.0.16 () {58 vars in 1344 bytes} [Sat Mar 26 21:09:33 2022] HEAD /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:33.555507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.560483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:33.621193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ed85f2-b254-46d7-a725-97e9ae94e411 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:33.632726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7addc-81a3-45fe-ad0f-f3404dd8f813 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:33.633962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7addc-81a3-45fe-ad0f-f3404dd8f813 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.635095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7addc-81a3-45fe-ad0f-f3404dd8f813 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.636623 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2950/5950] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:33.637087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7addc-81a3-45fe-ad0f-f3404dd8f813 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.639276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7addc-81a3-45fe-ad0f-f3404dd8f813 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.641684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7addc-81a3-45fe-ad0f-f3404dd8f813 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.644547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf241e-a0d0-4405-a6fb-43b75f915a54 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.645026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf241e-a0d0-4405-a6fb-43b75f915a54 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.645459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf241e-a0d0-4405-a6fb-43b75f915a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.658534 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3001/5951] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Mar 26 21:09:33 2022] GET /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 519 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:33.660567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7addc-81a3-45fe-ad0f-f3404dd8f813 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.673532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-31bf241e-a0d0-4405-a6fb-43b75f915a54 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:33.674754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-31bf241e-a0d0-4405-a6fb-43b75f915a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:33.687612 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2951/5952] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:33.688597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7addc-81a3-45fe-ad0f-f3404dd8f813 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:33.692230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf241e-a0d0-4405-a6fb-43b75f915a54 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.700340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8e5ee-4e40-4a63-ba32-e38ee66de57b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:33.701392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8e5ee-4e40-4a63-ba32-e38ee66de57b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.701749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8e5ee-4e40-4a63-ba32-e38ee66de57b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.702093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8e5ee-4e40-4a63-ba32-e38ee66de57b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.704294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf241e-a0d0-4405-a6fb-43b75f915a54 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:33.708485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8e5ee-4e40-4a63-ba32-e38ee66de57b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.710217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789d1e0-05bf-45cf-a700-9ece02319e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:33.710438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8e5ee-4e40-4a63-ba32-e38ee66de57b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.711163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789d1e0-05bf-45cf-a700-9ece02319e7e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.711785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789d1e0-05bf-45cf-a700-9ece02319e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.712256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789d1e0-05bf-45cf-a700-9ece02319e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.713065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789d1e0-05bf-45cf-a700-9ece02319e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:33.713444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789d1e0-05bf-45cf-a700-9ece02319e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.715849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789d1e0-05bf-45cf-a700-9ece02319e7e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.731989 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2952/5953] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:09:33.737629 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3002/5954] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:33 2022] DELETE /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:33.738691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789d1e0-05bf-45cf-a700-9ece02319e7e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.738813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8e5ee-4e40-4a63-ba32-e38ee66de57b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.762056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789d1e0-05bf-45cf-a700-9ece02319e7e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:33.884825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7315fa2-846c-40d3-80e5-434e8257a5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:33.885558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7315fa2-846c-40d3-80e5-434e8257a5bc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.885850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7315fa2-846c-40d3-80e5-434e8257a5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.886130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7315fa2-846c-40d3-80e5-434e8257a5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.887003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7315fa2-846c-40d3-80e5-434e8257a5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.889382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7315fa2-846c-40d3-80e5-434e8257a5bc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.899639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8e5ee-4e40-4a63-ba32-e38ee66de57b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:33.911254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b89e-99bc-49fe-ad4e-98d427a02718 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:33.912791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b89e-99bc-49fe-ad4e-98d427a02718 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:33.914730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b89e-99bc-49fe-ad4e-98d427a02718 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:33.915556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5b89e-99bc-49fe-ad4e-98d427a02718 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:33.919481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b89e-99bc-49fe-ad4e-98d427a02718 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:33.923155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5b89e-99bc-49fe-ad4e-98d427a02718 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:33.945773 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-7cc5b89e-99bc-49fe-ad4e-98d427a02718 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] 6203062d4e634a97bb749c228595b2ef does not imply 6b53b07ba0484933af454aec4b7d1e34.: keystone.exception.ImpliedRoleNotFound: 6203062d4e634a97bb749c228595b2ef does not imply 6b53b07ba0484933af454aec4b7d1e34. Mar 26 21:09:33.946427 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2953/5955] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:33 2022] POST /identity/v3/projects => generated 373 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:33.947408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7315fa2-846c-40d3-80e5-434e8257a5bc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.951278 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3003/5956] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Mar 26 21:09:33 2022] GET /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 137 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:09:33.953563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b89e-99bc-49fe-ad4e-98d427a02718 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:33.977017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5b89e-99bc-49fe-ad4e-98d427a02718 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:34.094776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7315fa2-846c-40d3-80e5-434e8257a5bc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:34.119641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29fd45-1287-4ac7-922f-ed17a77afc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:34.120371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fd45-1287-4ac7-922f-ed17a77afc39 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.120658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fd45-1287-4ac7-922f-ed17a77afc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.120933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29fd45-1287-4ac7-922f-ed17a77afc39 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.121628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29fd45-1287-4ac7-922f-ed17a77afc39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:34.123729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29fd45-1287-4ac7-922f-ed17a77afc39 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:34.159183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54c021-ba04-4ecf-8908-d2cfcae8c597 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:34.164090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54c021-ba04-4ecf-8908-d2cfcae8c597 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.164396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54c021-ba04-4ecf-8908-d2cfcae8c597 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.164688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54c021-ba04-4ecf-8908-d2cfcae8c597 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.164919 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2954/5957] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:33 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:34.166738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ebbf-5c09-4e4f-a828-430cd082b043 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.167029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ebbf-5c09-4e4f-a828-430cd082b043 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.167308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94ebbf-5c09-4e4f-a828-430cd082b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.172067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54c021-ba04-4ecf-8908-d2cfcae8c597 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:34.175658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54c021-ba04-4ecf-8908-d2cfcae8c597 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:34.213678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6f94ebbf-5c09-4e4f-a828-430cd082b043 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:34.214898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f94ebbf-5c09-4e4f-a828-430cd082b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:34.221105 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-6b54c021-ba04-4ecf-8908-d2cfcae8c597 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] 6203062d4e634a97bb749c228595b2ef does not imply 6b53b07ba0484933af454aec4b7d1e34.: keystone.exception.ImpliedRoleNotFound: 6203062d4e634a97bb749c228595b2ef does not imply 6b53b07ba0484933af454aec4b7d1e34. Mar 26 21:09:34.227711 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3004/5958] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:33 2022] DELETE /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 137 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:09:34.228915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54c021-ba04-4ecf-8908-d2cfcae8c597 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:34.246564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54c021-ba04-4ecf-8908-d2cfcae8c597 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:34.254319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c30f-1ab0-4023-815c-74e7b1fff218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:34.255474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c30f-1ab0-4023-815c-74e7b1fff218 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.256992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c30f-1ab0-4023-815c-74e7b1fff218 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.259439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933c30f-1ab0-4023-815c-74e7b1fff218 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.261193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933c30f-1ab0-4023-815c-74e7b1fff218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:34.267049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933c30f-1ab0-4023-815c-74e7b1fff218 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:34.287946 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3005/5959] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:34 2022] GET /identity/v3/roles => generated 2322 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:34.290194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c30f-1ab0-4023-815c-74e7b1fff218 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:34.304056 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2955/5960] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:34.304056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ebbf-5c09-4e4f-a828-430cd082b043 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:34.323052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94ebbf-5c09-4e4f-a828-430cd082b043 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:34.329033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933c30f-1ab0-4023-815c-74e7b1fff218 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:34.330819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997bd75-57dd-4299-8344-28b55673b135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:34.331980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997bd75-57dd-4299-8344-28b55673b135 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.332399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997bd75-57dd-4299-8344-28b55673b135 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.332691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997bd75-57dd-4299-8344-28b55673b135 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.334142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997bd75-57dd-4299-8344-28b55673b135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:34.336915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997bd75-57dd-4299-8344-28b55673b135 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:34.343364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49edd4-b914-44c9-b4de-c06b2cf0a526 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:34.346634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49edd4-b914-44c9-b4de-c06b2cf0a526 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.348304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49edd4-b914-44c9-b4de-c06b2cf0a526 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.348793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49edd4-b914-44c9-b4de-c06b2cf0a526 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.353262 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2956/5961] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:34 2022] GET /identity/v3/roles => generated 2322 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:34.354928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49edd4-b914-44c9-b4de-c06b2cf0a526 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:34.357078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997bd75-57dd-4299-8344-28b55673b135 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:34.358872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49edd4-b914-44c9-b4de-c06b2cf0a526 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:34.373128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997bd75-57dd-4299-8344-28b55673b135 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:34.378389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a8fd6-3572-4c78-ab9d-03714ec39ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:34.379977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8fd6-3572-4c78-ab9d-03714ec39ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.380425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8fd6-3572-4c78-ab9d-03714ec39ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.380860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8fd6-3572-4c78-ab9d-03714ec39ae4 admin admin] PATH_INFO: `/v3/projects/765e5efb645146e58c075fc2de2a13dd/users/513a378e40574ca39833b2f1f80270e7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.423319 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3006/5962] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:34 2022] PUT /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 519 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:34.424958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49edd4-b914-44c9-b4de-c06b2cf0a526 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:34.440388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8fd6-3572-4c78-ab9d-03714ec39ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=765e5efb645146e58c075fc2de2a13dd, user_id=513a378e40574ca39833b2f1f80270e7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:34.448666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8fd6-3572-4c78-ab9d-03714ec39ae4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:34.481633 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2957/5963] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:34 2022] PUT /identity/v3/projects/765e5efb645146e58c075fc2de2a13dd/users/513a378e40574ca39833b2f1f80270e7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:34.491983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e89e-d085-44b9-9377-5a496e48fd6c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.492501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e89e-d085-44b9-9377-5a496e48fd6c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.492934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0e89e-d085-44b9-9377-5a496e48fd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.545029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-51b0e89e-d085-44b9-9377-5a496e48fd6c None None] MFA Rules not processed for user `513a378e40574ca39833b2f1f80270e7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:34.547648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-51b0e89e-d085-44b9-9377-5a496e48fd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:34.582829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49edd4-b914-44c9-b4de-c06b2cf0a526 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:34.649355 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2958/5964] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:34.665322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0e89e-d085-44b9-9377-5a496e48fd6c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:34.667319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-51b0e89e-d085-44b9-9377-5a496e48fd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:34.726287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8eaa-7830-4bba-9d13-05dbdf0c3a17 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:34.727560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8eaa-7830-4bba-9d13-05dbdf0c3a17 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.727961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8eaa-7830-4bba-9d13-05dbdf0c3a17 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.728340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b8eaa-7830-4bba-9d13-05dbdf0c3a17 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/8156db4ce62f4326b73470a63e93be10` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.734085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b8eaa-7830-4bba-9d13-05dbdf0c3a17 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=8156db4ce62f4326b73470a63e93be10)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:34.736395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b8eaa-7830-4bba-9d13-05dbdf0c3a17 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:34.794613 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3007/5965] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:34 2022] PUT /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/8156db4ce62f4326b73470a63e93be10 => generated 520 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:34.795887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8eaa-7830-4bba-9d13-05dbdf0c3a17 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:34.832206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0e89e-d085-44b9-9377-5a496e48fd6c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:34.922906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b8eaa-7830-4bba-9d13-05dbdf0c3a17 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:34.935295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4830b6-ee89-47a6-9dc0-267be86fe44a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:34.935629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4830b6-ee89-47a6-9dc0-267be86fe44a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.936110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4830b6-ee89-47a6-9dc0-267be86fe44a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.936460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4830b6-ee89-47a6-9dc0-267be86fe44a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/8156db4ce62f4326b73470a63e93be10/implies/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.939279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4830b6-ee89-47a6-9dc0-267be86fe44a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8156db4ce62f4326b73470a63e93be10, implied_role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:34.941054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4830b6-ee89-47a6-9dc0-267be86fe44a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:34.945382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8973af2-6b8c-4e0c-973a-5cddc6a722ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:34.946058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8973af2-6b8c-4e0c-973a-5cddc6a722ad service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:34.946348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8973af2-6b8c-4e0c-973a-5cddc6a722ad service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:34.946625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8973af2-6b8c-4e0c-973a-5cddc6a722ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:34.981500 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3008/5966] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:34 2022] PUT /identity/v3/roles/8156db4ce62f4326b73470a63e93be10/implies/e79bfe60a28640988d99e64ab7826768 => generated 521 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:34.988303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4830b6-ee89-47a6-9dc0-267be86fe44a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:35.093246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8973af2-6b8c-4e0c-973a-5cddc6a722ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:35.096571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8973af2-6b8c-4e0c-973a-5cddc6a722ad service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:35.117583 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2959/5967] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:09:35.131873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4830b6-ee89-47a6-9dc0-267be86fe44a tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:35.138859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc8843-e2dd-43b4-abf3-ccf3f0228e23 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:35.139682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc8843-e2dd-43b4-abf3-ccf3f0228e23 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:35.140083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc8843-e2dd-43b4-abf3-ccf3f0228e23 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:35.140456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc8843-e2dd-43b4-abf3-ccf3f0228e23 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:35.142788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc8843-e2dd-43b4-abf3-ccf3f0228e23 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:35.143871 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-a5fc8843-e2dd-43b4-abf3-ccf3f0228e23 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:35.143871 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:35.143871 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:35.144949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc8843-e2dd-43b4-abf3-ccf3f0228e23 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:35.182758 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3009/5968] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 21:09:34 2022] GET /identity/v3/role_inferences => generated 1606 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:35.187507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8973af2-6b8c-4e0c-973a-5cddc6a722ad service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:35.209725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8973af2-6b8c-4e0c-973a-5cddc6a722ad service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:35.216364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df90087-e909-4115-b830-33cfe2204ea3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:35.217437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90087-e909-4115-b830-33cfe2204ea3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:35.217788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90087-e909-4115-b830-33cfe2204ea3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:35.218244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df90087-e909-4115-b830-33cfe2204ea3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/8156db4ce62f4326b73470a63e93be10/implies/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:35.221592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df90087-e909-4115-b830-33cfe2204ea3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8156db4ce62f4326b73470a63e93be10, implied_role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:35.223951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df90087-e909-4115-b830-33cfe2204ea3 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:35.237916 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2960/5969] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:35 2022] DELETE /identity/v3/roles/8156db4ce62f4326b73470a63e93be10/implies/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:35.241915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc8843-e2dd-43b4-abf3-ccf3f0228e23 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:35.258113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc8843-e2dd-43b4-abf3-ccf3f0228e23 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:35.433887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a583e78-2977-402f-aa17-c90ddc480b58 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:35.434417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a583e78-2977-402f-aa17-c90ddc480b58 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:35.434417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a583e78-2977-402f-aa17-c90ddc480b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:35.451241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b2d00-6cd7-48e6-b2e9-dd3326ad2829 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:35.452147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b2d00-6cd7-48e6-b2e9-dd3326ad2829 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:35.452432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b2d00-6cd7-48e6-b2e9-dd3326ad2829 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:35.452710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b2d00-6cd7-48e6-b2e9-dd3326ad2829 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/8156db4ce62f4326b73470a63e93be10` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:35.461646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b2d00-6cd7-48e6-b2e9-dd3326ad2829 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=8156db4ce62f4326b73470a63e93be10)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:35.463298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b2d00-6cd7-48e6-b2e9-dd3326ad2829 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:35.473268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4a583e78-2977-402f-aa17-c90ddc480b58 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:35.475704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4a583e78-2977-402f-aa17-c90ddc480b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:35.491853 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3010/5970] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:35 2022] DELETE /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/8156db4ce62f4326b73470a63e93be10 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:35.496164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b2d00-6cd7-48e6-b2e9-dd3326ad2829 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:35.630925 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2961/5971] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:35.638750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b2d00-6cd7-48e6-b2e9-dd3326ad2829 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:35.653914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc210d-a4a3-423c-a7d0-90293f57eda2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:35.655939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc210d-a4a3-423c-a7d0-90293f57eda2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:35.657522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc210d-a4a3-423c-a7d0-90293f57eda2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:35.657808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc210d-a4a3-423c-a7d0-90293f57eda2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:35.672923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc210d-a4a3-423c-a7d0-90293f57eda2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:35.674756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc210d-a4a3-423c-a7d0-90293f57eda2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:35.710407 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3011/5972] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:35 2022] DELETE /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:35.715369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a583e78-2977-402f-aa17-c90ddc480b58 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:35.737749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a583e78-2977-402f-aa17-c90ddc480b58 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:35.928622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17a184-4518-47c8-b615-b7b131410624 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:35.929368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17a184-4518-47c8-b615-b7b131410624 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:35.929657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17a184-4518-47c8-b615-b7b131410624 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:35.929941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17a184-4518-47c8-b615-b7b131410624 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:35.935947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17a184-4518-47c8-b615-b7b131410624 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:35.942807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17a184-4518-47c8-b615-b7b131410624 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:35.975986 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2962/5973] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:35 2022] GET /identity/v3/roles => generated 2322 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:35.978678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc210d-a4a3-423c-a7d0-90293f57eda2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:35.992984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc210d-a4a3-423c-a7d0-90293f57eda2 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:36.028089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b2683-a173-4c79-ab09-c1109ea5ac86 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:36.029007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b2683-a173-4c79-ab09-c1109ea5ac86 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:36.029452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b2683-a173-4c79-ab09-c1109ea5ac86 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:36.030574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b2683-a173-4c79-ab09-c1109ea5ac86 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:36.033205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b2683-a173-4c79-ab09-c1109ea5ac86 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:36.035676 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-310b2683-a173-4c79-ab09-c1109ea5ac86 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:36.035676 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:36.035676 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:36.036642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b2683-a173-4c79-ab09-c1109ea5ac86 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:36.084112 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3012/5974] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:09:35 2022] POST /identity/v3/roles => generated 234 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:36.088579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17a184-4518-47c8-b615-b7b131410624 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:36.105603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17a184-4518-47c8-b615-b7b131410624 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:36.112567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35ad79-e452-4db9-baf6-78aaba5915ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:36.113590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35ad79-e452-4db9-baf6-78aaba5915ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:36.114099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35ad79-e452-4db9-baf6-78aaba5915ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:36.114527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35ad79-e452-4db9-baf6-78aaba5915ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/4c38d9e86a674167a26b7993e9c7c765` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:36.117635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35ad79-e452-4db9-baf6-78aaba5915ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:update_role(role_id=4c38d9e86a674167a26b7993e9c7c765)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:36.118846 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-1d35ad79-e452-4db9-baf6-78aaba5915ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:36.118846 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:36.118846 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:36.120028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35ad79-e452-4db9-baf6-78aaba5915ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:36.174263 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2963/5975] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Mar 26 21:09:36 2022] PATCH /identity/v3/roles/4c38d9e86a674167a26b7993e9c7c765 => generated 238 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:36.177925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b2683-a173-4c79-ab09-c1109ea5ac86 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:36.208002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b2683-a173-4c79-ab09-c1109ea5ac86 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:36.229172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbae8c-f5ee-4e66-9093-163dfd777a3b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:36.230331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbae8c-f5ee-4e66-9093-163dfd777a3b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:36.232693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbae8c-f5ee-4e66-9093-163dfd777a3b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:36.233182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebbae8c-f5ee-4e66-9093-163dfd777a3b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/4c38d9e86a674167a26b7993e9c7c765` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:36.267713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbae8c-f5ee-4e66-9093-163dfd777a3b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:get_role(role_id=4c38d9e86a674167a26b7993e9c7c765)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:36.270652 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-1ebbae8c-f5ee-4e66-9093-163dfd777a3b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:36.270652 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:36.270652 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:36.273673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebbae8c-f5ee-4e66-9093-163dfd777a3b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:36.282709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35ad79-e452-4db9-baf6-78aaba5915ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:36.306639 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3013/5976] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:09:36 2022] GET /identity/v3/roles/4c38d9e86a674167a26b7993e9c7c765 => generated 238 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:36.317008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35ad79-e452-4db9-baf6-78aaba5915ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:36.325307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c2c7c-4d28-4ca0-81e2-fb5343c5813b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:36.325922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c2c7c-4d28-4ca0-81e2-fb5343c5813b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:36.326321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c2c7c-4d28-4ca0-81e2-fb5343c5813b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:36.326703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c2c7c-4d28-4ca0-81e2-fb5343c5813b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:36.328599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c2c7c-4d28-4ca0-81e2-fb5343c5813b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:36.334088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c2c7c-4d28-4ca0-81e2-fb5343c5813b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:36.361361 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2964/5977] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:36 2022] GET /identity/v3/roles => generated 2551 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:36.363338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbae8c-f5ee-4e66-9093-163dfd777a3b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:36.379237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebbae8c-f5ee-4e66-9093-163dfd777a3b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:36.396128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:36.397012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:36.397298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:36.397583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/4c38d9e86a674167a26b7993e9c7c765` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:36.399332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4c38d9e86a674167a26b7993e9c7c765)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:36.408256 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:36.408256 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:36.408256 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:36.409225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:36.477337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 4c38d9e86a674167a26b7993e9c7c765 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:36.480389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:36.481495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ed6115c-a9e8-4e7d-a764-9d03f2d176c7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:36.483630 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3014/5978] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:36 2022] DELETE /identity/v3/roles/4c38d9e86a674167a26b7993e9c7c765 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:36.489454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c2c7c-4d28-4ca0-81e2-fb5343c5813b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:36.495258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f10c2c7c-4d28-4ca0-81e2-fb5343c5813b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:36.529668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c2c7c-4d28-4ca0-81e2-fb5343c5813b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:36.568889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45472e-ec1c-4303-bdb9-00036c597101 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:36.569147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45472e-ec1c-4303-bdb9-00036c597101 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:36.569743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45472e-ec1c-4303-bdb9-00036c597101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:36.630210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3c45472e-ec1c-4303-bdb9-00036c597101 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:36.632094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c45472e-ec1c-4303-bdb9-00036c597101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:36.708334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0656b-ddb0-42f8-91c3-4d7cb6e52159 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:36.709592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0656b-ddb0-42f8-91c3-4d7cb6e52159 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:36.709945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0656b-ddb0-42f8-91c3-4d7cb6e52159 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:36.710232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0656b-ddb0-42f8-91c3-4d7cb6e52159 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:36.712309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0656b-ddb0-42f8-91c3-4d7cb6e52159 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:36.714331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0656b-ddb0-42f8-91c3-4d7cb6e52159 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:36.761356 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3015/5979] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:36.772569 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2965/5980] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:36 2022] PUT /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 519 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:36.792643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45472e-ec1c-4303-bdb9-00036c597101 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:36.839093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45472e-ec1c-4303-bdb9-00036c597101 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:37.000999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211ae7f-e5a5-4bdb-b0d1-f79d7fd309f0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:37.002618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211ae7f-e5a5-4bdb-b0d1-f79d7fd309f0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:37.002927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211ae7f-e5a5-4bdb-b0d1-f79d7fd309f0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:37.003369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211ae7f-e5a5-4bdb-b0d1-f79d7fd309f0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/8156db4ce62f4326b73470a63e93be10` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:37.012052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211ae7f-e5a5-4bdb-b0d1-f79d7fd309f0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=8156db4ce62f4326b73470a63e93be10)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:37.013748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211ae7f-e5a5-4bdb-b0d1-f79d7fd309f0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:37.094791 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3016/5981] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:36 2022] PUT /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/8156db4ce62f4326b73470a63e93be10 => generated 520 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:37.097534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0656b-ddb0-42f8-91c3-4d7cb6e52159 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:37.124883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0656b-ddb0-42f8-91c3-4d7cb6e52159 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:37.307151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb2a88-147f-4a11-a153-ca1f5792333e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:37.310194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb2a88-147f-4a11-a153-ca1f5792333e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:37.310496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb2a88-147f-4a11-a153-ca1f5792333e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:37.310783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bb2a88-147f-4a11-a153-ca1f5792333e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/8156db4ce62f4326b73470a63e93be10/implies/e79bfe60a28640988d99e64ab7826768` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:37.314935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb2a88-147f-4a11-a153-ca1f5792333e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8156db4ce62f4326b73470a63e93be10, implied_role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:37.316638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bb2a88-147f-4a11-a153-ca1f5792333e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:37.387584 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2966/5982] 10.222.0.16 () {60 vars in 1362 bytes} [Sat Mar 26 21:09:37 2022] PUT /identity/v3/roles/8156db4ce62f4326b73470a63e93be10/implies/e79bfe60a28640988d99e64ab7826768 => generated 521 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:37.391685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211ae7f-e5a5-4bdb-b0d1-f79d7fd309f0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:37.411623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211ae7f-e5a5-4bdb-b0d1-f79d7fd309f0 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:37.568874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a99890-f731-4f92-8605-9e27a1ed9f05 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:37.570749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a99890-f731-4f92-8605-9e27a1ed9f05 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:37.571144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a99890-f731-4f92-8605-9e27a1ed9f05 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:37.571598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a99890-f731-4f92-8605-9e27a1ed9f05 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/8156db4ce62f4326b73470a63e93be10/implies` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:37.574286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a99890-f731-4f92-8605-9e27a1ed9f05 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=8156db4ce62f4326b73470a63e93be10)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:37.575632 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-86a99890-f731-4f92-8605-9e27a1ed9f05 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:37.575632 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:37.575632 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:37.576983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a99890-f731-4f92-8605-9e27a1ed9f05 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:37.594553 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3017/5983] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:09:37 2022] GET /identity/v3/roles/8156db4ce62f4326b73470a63e93be10/implies => generated 490 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:09:37.598204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb2a88-147f-4a11-a153-ca1f5792333e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:37.632028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bb2a88-147f-4a11-a153-ca1f5792333e tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:37.647769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8373b61-d016-4d0d-a03f-e3c49e652d74 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:37.649038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8373b61-d016-4d0d-a03f-e3c49e652d74 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:37.649511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8373b61-d016-4d0d-a03f-e3c49e652d74 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:37.649989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8373b61-d016-4d0d-a03f-e3c49e652d74 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:37.651972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8373b61-d016-4d0d-a03f-e3c49e652d74 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=6203062d4e634a97bb749c228595b2ef)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:37.655108 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-e8373b61-d016-4d0d-a03f-e3c49e652d74 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:37.655108 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:37.655108 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:37.658984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8373b61-d016-4d0d-a03f-e3c49e652d74 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:37.679711 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2967/5984] 10.222.0.16 () {58 vars in 1244 bytes} [Sat Mar 26 21:09:37 2022] GET /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies => generated 659 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:37.683653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a99890-f731-4f92-8605-9e27a1ed9f05 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:37.701240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a99890-f731-4f92-8605-9e27a1ed9f05 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:37.709909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188da3c2-c65d-4c19-a40b-7ca7026cb10d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:37.710621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188da3c2-c65d-4c19-a40b-7ca7026cb10d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:37.711000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188da3c2-c65d-4c19-a40b-7ca7026cb10d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:37.711372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188da3c2-c65d-4c19-a40b-7ca7026cb10d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/8156db4ce62f4326b73470a63e93be10/implies/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:37.713341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188da3c2-c65d-4c19-a40b-7ca7026cb10d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8156db4ce62f4326b73470a63e93be10, implied_role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:37.716133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188da3c2-c65d-4c19-a40b-7ca7026cb10d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:37.727969 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3018/5985] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:37 2022] DELETE /identity/v3/roles/8156db4ce62f4326b73470a63e93be10/implies/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:37.734505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8373b61-d016-4d0d-a03f-e3c49e652d74 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:37.750813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8373b61-d016-4d0d-a03f-e3c49e652d74 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:37.892750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64a801-5c43-46c0-b689-5f2ffaae9170 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:37.893525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64a801-5c43-46c0-b689-5f2ffaae9170 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:37.893813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64a801-5c43-46c0-b689-5f2ffaae9170 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:37.894096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a64a801-5c43-46c0-b689-5f2ffaae9170 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/8156db4ce62f4326b73470a63e93be10` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:37.900550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64a801-5c43-46c0-b689-5f2ffaae9170 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=8156db4ce62f4326b73470a63e93be10)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:37.902143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a64a801-5c43-46c0-b689-5f2ffaae9170 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:37.936753 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2968/5986] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:37 2022] DELETE /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/8156db4ce62f4326b73470a63e93be10 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:37.939182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188da3c2-c65d-4c19-a40b-7ca7026cb10d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:37.955686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188da3c2-c65d-4c19-a40b-7ca7026cb10d tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:38.113378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33379a-4844-4bda-8b1f-871058543036 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:38.114319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33379a-4844-4bda-8b1f-871058543036 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:38.114600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33379a-4844-4bda-8b1f-871058543036 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:38.115054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33379a-4844-4bda-8b1f-871058543036 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:38.119204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33379a-4844-4bda-8b1f-871058543036 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=6203062d4e634a97bb749c228595b2ef, implied_role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:38.122077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33379a-4844-4bda-8b1f-871058543036 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:38.147859 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3019/5987] 10.222.0.16 () {58 vars in 1346 bytes} [Sat Mar 26 21:09:37 2022] DELETE /identity/v3/roles/6203062d4e634a97bb749c228595b2ef/implies/6b53b07ba0484933af454aec4b7d1e34 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:38.153001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64a801-5c43-46c0-b689-5f2ffaae9170 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:38.168820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a64a801-5c43-46c0-b689-5f2ffaae9170 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:38.295706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc09a2-2cd9-4186-aaed-425c6aba50ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:38.296833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc09a2-2cd9-4186-aaed-425c6aba50ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:38.298176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc09a2-2cd9-4186-aaed-425c6aba50ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:38.298977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc09a2-2cd9-4186-aaed-425c6aba50ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/0e5961143eaa4484a323438220ca383c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:38.310608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc09a2-2cd9-4186-aaed-425c6aba50ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:09:38.322220 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-fddc09a2-2cd9-4186-aaed-425c6aba50ca tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Could not find domain: 0e5961143eaa4484a323438220ca383c.: keystone.exception.DomainNotFound: Could not find domain: 0e5961143eaa4484a323438220ca383c. Mar 26 21:09:38.323992 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2969/5988] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:09:38 2022] PATCH /identity/v3/domains/0e5961143eaa4484a323438220ca383c => generated 112 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:09:38.327636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33379a-4844-4bda-8b1f-871058543036 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:38.349354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33379a-4844-4bda-8b1f-871058543036 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:38.364493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:38.366987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:38.367279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:38.368539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/users/5f4cdb1b8b404a2880534f25cf70c14c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:38.371283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5f4cdb1b8b404a2880534f25cf70c14c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:38.373427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:38.478673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f4cdb1b8b404a2880534f25cf70c14c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:38.494534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f4cdb1b8b404a2880534f25cf70c14c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:38.496653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f4cdb1b8b404a2880534f25cf70c14c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:38.499303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f4cdb1b8b404a2880534f25cf70c14c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:38.510200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d99ff-9369-4915-aa82-d106325caca2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:38.511284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d99ff-9369-4915-aa82-d106325caca2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:38.512515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d99ff-9369-4915-aa82-d106325caca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:38.520530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f4cdb1b8b404a2880534f25cf70c14c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:38.568158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cf7d99ff-9369-4915-aa82-d106325caca2 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:38.569872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf7d99ff-9369-4915-aa82-d106325caca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:38.585833 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3020/5989] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:38 2022] DELETE /identity/v3/users/5f4cdb1b8b404a2880534f25cf70c14c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:38.589807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:38.593220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:38.758671 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2970/5990] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:38.801876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078db1ac-4277-40a3-b7d9-f5160a2a1c11 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:38.818339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:38.829948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:38.834091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:38.834598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/e79bfe60a28640988d99e64ab7826768` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:38.839475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e79bfe60a28640988d99e64ab7826768)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:38.843141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:38.920601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role e79bfe60a28640988d99e64ab7826768 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:38.921017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:38.925807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:38.934743 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3021/5991] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:38 2022] DELETE /identity/v3/roles/e79bfe60a28640988d99e64ab7826768 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:38.936161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d99ff-9369-4915-aa82-d106325caca2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:38.954080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d99ff-9369-4915-aa82-d106325caca2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:39.122258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032197d-40b6-44f7-9772-40748fe4f569 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:39.123458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032197d-40b6-44f7-9772-40748fe4f569 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:39.124063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032197d-40b6-44f7-9772-40748fe4f569 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:39.124527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032197d-40b6-44f7-9772-40748fe4f569 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/groups/7a6cd2d8b42c4a4cac3626f273435ddd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:39.127606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032197d-40b6-44f7-9772-40748fe4f569 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7a6cd2d8b42c4a4cac3626f273435ddd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:39.129844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032197d-40b6-44f7-9772-40748fe4f569 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:39.262312 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2971/5992] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:09:38 2022] DELETE /identity/v3/groups/7a6cd2d8b42c4a4cac3626f273435ddd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:39.266215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:39.268910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:39.296966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183132-9a72-4be2-b9f1-9c22b6d92976 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:39.512558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:39.513823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:39.514320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:39.514807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:39.517562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d1f1f6ffc8b24ae19e49621106b20fec)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:39.520185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:39.617625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1f1f6ffc8b24ae19e49621106b20fec', 'request_id': 'req-0f5070a0-7d37-49f4-a553-db5b3f63991c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:39.632599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1f1f6ffc8b24ae19e49621106b20fec', 'request_id': 'req-0f5070a0-7d37-49f4-a553-db5b3f63991c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:39.643897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1f1f6ffc8b24ae19e49621106b20fec', 'request_id': 'req-0f5070a0-7d37-49f4-a553-db5b3f63991c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:39.674407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] The token cache is being invalidate because project d1f1f6ffc8b24ae19e49621106b20fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:39.675819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:39.677744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:39.681062 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3022/5993] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:39 2022] DELETE /identity/v3/projects/d1f1f6ffc8b24ae19e49621106b20fec => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:39.685498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032197d-40b6-44f7-9772-40748fe4f569 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:39.688742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3032197d-40b6-44f7-9772-40748fe4f569 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:39.713036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032197d-40b6-44f7-9772-40748fe4f569 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:39.879203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:39.881285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:39.882063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:39.882748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:39.887382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:39.890045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:39.952494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:39.953597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:39.975868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:39.978316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:40.015973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.028911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.037389 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2972/5994] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:09:39 2022] PATCH /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81 => generated 277 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:40.042266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:40.046956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:40.117803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5070a0-7d37-49f4-a553-db5b3f63991c tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:40.209028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6d7ce-8171-4c21-8861-4b12b2eb6a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:40.209872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d7ce-8171-4c21-8861-4b12b2eb6a52 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:40.210387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d7ce-8171-4c21-8861-4b12b2eb6a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:40.210671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d7ce-8171-4c21-8861-4b12b2eb6a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:40.212948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4be6d7ce-8171-4c21-8861-4b12b2eb6a52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:40.276798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf45896-cf6e-48ef-a50f-90553b94fb84 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:40.288859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:40.290755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:40.291051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:40.291826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:40.312311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dc8dd98fcf3743a0a8e7adc3d2b76d81)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:40.314901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:40.327520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6d7ce-8171-4c21-8861-4b12b2eb6a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:40.329838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6d7ce-8171-4c21-8861-4b12b2eb6a52 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:40.344889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.348991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.353883 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3023/5995] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:09:40.355622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256496c-1e76-4740-887a-d5831e7047f4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:40.360347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256496c-1e76-4740-887a-d5831e7047f4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:40.362095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256496c-1e76-4740-887a-d5831e7047f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:40.409790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c256496c-1e76-4740-887a-d5831e7047f4 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:40.413898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c256496c-1e76-4740-887a-d5831e7047f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:40.430783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81', 'request_id': 'req-0f03712e-2b28-4e50-b7e1-f5234df470b1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.441465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81', 'request_id': 'req-0f03712e-2b28-4e50-b7e1-f5234df470b1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.450385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81', 'request_id': 'req-0f03712e-2b28-4e50-b7e1-f5234df470b1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.465928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] The token cache is being invalidate because project dc8dd98fcf3743a0a8e7adc3d2b76d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:40.466197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.467019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.477146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81', 'request_id': 'req-0f03712e-2b28-4e50-b7e1-f5234df470b1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.480929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81', 'request_id': 'req-0f03712e-2b28-4e50-b7e1-f5234df470b1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.481498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dc8dd98fcf3743a0a8e7adc3d2b76d81', 'request_id': 'req-0f03712e-2b28-4e50-b7e1-f5234df470b1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.495726 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2973/5996] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:40 2022] DELETE /identity/v3/domains/dc8dd98fcf3743a0a8e7adc3d2b76d81 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:40.496770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:40.498447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:40.574375 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3024/5997] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:40.597063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03712e-2b28-4e50-b7e1-f5234df470b1 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:40.604496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:40.605364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:40.605653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:40.605935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/8156db4ce62f4326b73470a63e93be10` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:40.614412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8156db4ce62f4326b73470a63e93be10)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:40.615513 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:40.615513 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:09:40.615513 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:09:40.618536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:40.702316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 8156db4ce62f4326b73470a63e93be10 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:40.702984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.705273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.708595 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2974/5998] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:40 2022] DELETE /identity/v3/roles/8156db4ce62f4326b73470a63e93be10 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:40.735129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256496c-1e76-4740-887a-d5831e7047f4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:40.761874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256496c-1e76-4740-887a-d5831e7047f4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:40.895232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:40.897921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:40.898034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:40.898311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6b53b07ba0484933af454aec4b7d1e34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:40.902066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6b53b07ba0484933af454aec4b7d1e34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:40.903598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:40.995982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 6b53b07ba0484933af454aec4b7d1e34 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:40.996888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:40.999414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:41.005602 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3025/5999] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:40 2022] DELETE /identity/v3/roles/6b53b07ba0484933af454aec4b7d1e34 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:41.009815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:41.011341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:41.036090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b5c98-d7ac-4f4a-a559-92bb1aca92f7 tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:41.105448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e73f8d-8090-4cc5-abc6-cc6858895a5b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48eea90c1d446b58f391bc81efe35ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66df28e3705246bbace8b1861533ab01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:41.106329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e73f8d-8090-4cc5-abc6-cc6858895a5b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:41.106619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e73f8d-8090-4cc5-abc6-cc6858895a5b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:41.106901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e73f8d-8090-4cc5-abc6-cc6858895a5b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] PATH_INFO: `/v3/roles/6203062d4e634a97bb749c228595b2ef` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:41.108461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e73f8d-8090-4cc5-abc6-cc6858895a5b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6203062d4e634a97bb749c228595b2ef)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:41.110172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e73f8d-8090-4cc5-abc6-cc6858895a5b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:41.153140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51e73f8d-8090-4cc5-abc6-cc6858895a5b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invalidating the token cache because role 6203062d4e634a97bb749c228595b2ef has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:41.153548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51e73f8d-8090-4cc5-abc6-cc6858895a5b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:41.154135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-51e73f8d-8090-4cc5-abc6-cc6858895a5b tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:41.158308 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2975/6000] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:41 2022] DELETE /identity/v3/roles/6203062d4e634a97bb749c228595b2ef => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:41.162706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:41.165512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:41.383625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370ff5-5bc3-46d2-8172-5fbd300751ee tempest-RolesV3TestJSON-1450235434 tempest-RolesV3TestJSON-1450235434-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:41.482895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:41.485979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:41.486281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:41.486763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] PATH_INFO: `/v3/users/3a139deb87c340d499c15312b7b91ede` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:41.488624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a139deb87c340d499c15312b7b91ede)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:41.498419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:41.647616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a139deb87c340d499c15312b7b91ede'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:41.661662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a139deb87c340d499c15312b7b91ede'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:41.662672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a139deb87c340d499c15312b7b91ede'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:41.663869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a139deb87c340d499c15312b7b91ede'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:41.680596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a139deb87c340d499c15312b7b91ede'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:41.713342 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3026/6001] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:41 2022] DELETE /identity/v3/users/3a139deb87c340d499c15312b7b91ede => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:41.714908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc35ef-7c49-4382-8328-263c53d97e16 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:41.715203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc35ef-7c49-4382-8328-263c53d97e16 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:41.715490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc35ef-7c49-4382-8328-263c53d97e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:41.785129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-eddc35ef-7c49-4382-8328-263c53d97e16 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:41.786366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eddc35ef-7c49-4382-8328-263c53d97e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:41.933353 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2976/6002] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:41.943441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:41.944901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:42.042899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016852a-64dd-4655-bd1b-7911a81a928b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:42.048472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e640562-1b22-4088-9979-d9367cc57da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:42.049139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e640562-1b22-4088-9979-d9367cc57da2 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:42.049424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e640562-1b22-4088-9979-d9367cc57da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:42.049699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e640562-1b22-4088-9979-d9367cc57da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:42.063243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e640562-1b22-4088-9979-d9367cc57da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:42.064851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e640562-1b22-4088-9979-d9367cc57da2 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:42.079660 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3027/6003] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:42.936203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc35ef-7c49-4382-8328-263c53d97e16 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:42.938843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eddc35ef-7c49-4382-8328-263c53d97e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:42.972464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc35ef-7c49-4382-8328-263c53d97e16 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:42.984605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:42.987132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:42.990743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:42.991202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] PATH_INFO: `/v3/projects/51193509c8b34b33b120cef258cb7549` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:42.995549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] RBAC: Authorizing `identity:delete_project(project_id=51193509c8b34b33b120cef258cb7549)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:42.997000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:43.103427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51193509c8b34b33b120cef258cb7549', 'request_id': 'req-7996b94c-3a6c-4063-be75-07b2386b42be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.124641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51193509c8b34b33b120cef258cb7549', 'request_id': 'req-7996b94c-3a6c-4063-be75-07b2386b42be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.133160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51193509c8b34b33b120cef258cb7549', 'request_id': 'req-7996b94c-3a6c-4063-be75-07b2386b42be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.145475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] The token cache is being invalidate because project 51193509c8b34b33b120cef258cb7549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:43.145827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.146414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.150742 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2977/6004] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:42 2022] DELETE /identity/v3/projects/51193509c8b34b33b120cef258cb7549 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:43.154765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e640562-1b22-4088-9979-d9367cc57da2 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:43.169576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e640562-1b22-4088-9979-d9367cc57da2 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:43.269575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:43.270955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:43.271594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:43.272105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] PATH_INFO: `/v3/users/d48eea90c1d446b58f391bc81efe35ac` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:43.273636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48eea90c1d446b58f391bc81efe35ac)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:43.275801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:43.360966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48eea90c1d446b58f391bc81efe35ac'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.371095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48eea90c1d446b58f391bc81efe35ac'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.372171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48eea90c1d446b58f391bc81efe35ac'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.373141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48eea90c1d446b58f391bc81efe35ac'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.387911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-54f0acac-ac8d-4e05-9b07-5c9d2b61d1c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48eea90c1d446b58f391bc81efe35ac'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:43.446641 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3028/6005] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:43 2022] DELETE /identity/v3/users/d48eea90c1d446b58f391bc81efe35ac => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:44.429543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:44.433443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:44.487480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996b94c-3a6c-4063-be75-07b2386b42be admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:44.675315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:44.676506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:44.677002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:44.677446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] PATH_INFO: `/v3/projects/66df28e3705246bbace8b1861533ab01` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:44.681442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66df28e3705246bbace8b1861533ab01)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:44.683782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:44.764846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66df28e3705246bbace8b1861533ab01', 'request_id': 'req-fd48a2ef-7682-41f8-8e55-852365ff290c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:44.782857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66df28e3705246bbace8b1861533ab01', 'request_id': 'req-fd48a2ef-7682-41f8-8e55-852365ff290c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:44.791742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66df28e3705246bbace8b1861533ab01', 'request_id': 'req-fd48a2ef-7682-41f8-8e55-852365ff290c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:44.815512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] The token cache is being invalidate because project 66df28e3705246bbace8b1861533ab01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:44.815641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:44.816337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fd48a2ef-7682-41f8-8e55-852365ff290c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:44.819879 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2978/6006] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:44 2022] DELETE /identity/v3/projects/66df28e3705246bbace8b1861533ab01 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:44.826145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a1da-981b-4a15-9d4a-2d8b249cc2be None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:44.827055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a1da-981b-4a15-9d4a-2d8b249cc2be None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:44.827599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2a1da-981b-4a15-9d4a-2d8b249cc2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:44.869033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-37b2a1da-981b-4a15-9d4a-2d8b249cc2be None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:44.871265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-37b2a1da-981b-4a15-9d4a-2d8b249cc2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:45.010162 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3029/6007] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:45.024898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51d86-038b-45e8-8087-890511c9ca51 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.028010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51d86-038b-45e8-8087-890511c9ca51 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.028510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb51d86-038b-45e8-8087-890511c9ca51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.064077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5cb51d86-038b-45e8-8087-890511c9ca51 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:45.065514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5cb51d86-038b-45e8-8087-890511c9ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:45.080064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a1da-981b-4a15-9d4a-2d8b249cc2be None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:45.091789 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2979/6008] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:45.092839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2a1da-981b-4a15-9d4a-2d8b249cc2be None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:45.118006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04377e57-4026-4f3a-b45d-748b4877be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:45.126134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377e57-4026-4f3a-b45d-748b4877be3a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.127560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377e57-4026-4f3a-b45d-748b4877be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.127860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04377e57-4026-4f3a-b45d-748b4877be3a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.131838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04377e57-4026-4f3a-b45d-748b4877be3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:45.132230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04377e57-4026-4f3a-b45d-748b4877be3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:45.138299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04377e57-4026-4f3a-b45d-748b4877be3a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:45.171768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3030/6009] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:45.177959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51d86-038b-45e8-8087-890511c9ca51 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:45.191301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb51d86-038b-45e8-8087-890511c9ca51 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:45.206121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e48f-c548-46ad-bded-10ff1cfbac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:45.207258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e48f-c548-46ad-bded-10ff1cfbac9d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.207713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e48f-c548-46ad-bded-10ff1cfbac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.208200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924e48f-c548-46ad-bded-10ff1cfbac9d admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.209730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924e48f-c548-46ad-bded-10ff1cfbac9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:45.212030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924e48f-c548-46ad-bded-10ff1cfbac9d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:45.235482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb10c9-bea7-4e94-b719-2800693aeb7d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.236087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb10c9-bea7-4e94-b719-2800693aeb7d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.236544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb10c9-bea7-4e94-b719-2800693aeb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.286488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fdeb10c9-bea7-4e94-b719-2800693aeb7d None None] MFA Rules not processed for user `dd05073d7e52411c92d7b9def363dd50`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:45.289796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fdeb10c9-bea7-4e94-b719-2800693aeb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:45.293071 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2980/6010] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:45 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:45.300520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e48f-c548-46ad-bded-10ff1cfbac9d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:45.414815 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3031/6011] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:45.426737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b6703-d31a-4135-8ec2-b620f31c2ca4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.427038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b6703-d31a-4135-8ec2-b620f31c2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.427328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b6703-d31a-4135-8ec2-b620f31c2ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.434334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924e48f-c548-46ad-bded-10ff1cfbac9d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:45.440844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146028-5465-424b-8e77-911b4edeaa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:45.441979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146028-5465-424b-8e77-911b4edeaa1d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.442481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146028-5465-424b-8e77-911b4edeaa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.442969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b146028-5465-424b-8e77-911b4edeaa1d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.443659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b146028-5465-424b-8e77-911b4edeaa1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:45.446147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b146028-5465-424b-8e77-911b4edeaa1d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:45.446780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9a2b6703-d31a-4135-8ec2-b620f31c2ca4 None None] MFA Rules not processed for user `dd05073d7e52411c92d7b9def363dd50`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:45.448065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9a2b6703-d31a-4135-8ec2-b620f31c2ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:45.460235 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3032/6012] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:45.480016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b6703-d31a-4135-8ec2-b620f31c2ca4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:45.480244 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2981/6013] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:45 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:45.504959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b6703-d31a-4135-8ec2-b620f31c2ca4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:45.526557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0c315-6ff6-4797-9f30-0c5058d18bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:45.527946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0c315-6ff6-4797-9f30-0c5058d18bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.528488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0c315-6ff6-4797-9f30-0c5058d18bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.529666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0c315-6ff6-4797-9f30-0c5058d18bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.530683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0c315-6ff6-4797-9f30-0c5058d18bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:45.532814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0c315-6ff6-4797-9f30-0c5058d18bf1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:45.554094 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3033/6014] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:45.557602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146028-5465-424b-8e77-911b4edeaa1d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:45.574835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b146028-5465-424b-8e77-911b4edeaa1d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:45.580443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f10221-b7ab-4f05-a59e-4f207277b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:45.581426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f10221-b7ab-4f05-a59e-4f207277b96a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.581948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f10221-b7ab-4f05-a59e-4f207277b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.582446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f10221-b7ab-4f05-a59e-4f207277b96a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.583518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f10221-b7ab-4f05-a59e-4f207277b96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:45.585548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f10221-b7ab-4f05-a59e-4f207277b96a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:45.602774 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2982/6015] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:45.603817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0c315-6ff6-4797-9f30-0c5058d18bf1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:45.617513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0c315-6ff6-4797-9f30-0c5058d18bf1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:45.624064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4b700-8549-40a6-9fe2-80178ca80bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:45.625964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4b700-8549-40a6-9fe2-80178ca80bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.626456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4b700-8549-40a6-9fe2-80178ca80bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.626951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4b700-8549-40a6-9fe2-80178ca80bcf admin admin] PATH_INFO: `/v3/projects/53cefab95b6e4e79bde32b120ad7cb5c/users/27f667b87eae45e183745f3cf5bed03c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.646649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4b700-8549-40a6-9fe2-80178ca80bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cefab95b6e4e79bde32b120ad7cb5c, user_id=27f667b87eae45e183745f3cf5bed03c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:45.655373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4b700-8549-40a6-9fe2-80178ca80bcf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:45.673871 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3034/6016] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:45 2022] PUT /identity/v3/projects/53cefab95b6e4e79bde32b120ad7cb5c/users/27f667b87eae45e183745f3cf5bed03c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:45.685242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6a1c4-3015-4076-868d-b88130d25ec2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.686741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6a1c4-3015-4076-868d-b88130d25ec2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.687403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6a1c4-3015-4076-868d-b88130d25ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.718295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c4d6a1c4-3015-4076-868d-b88130d25ec2 None None] MFA Rules not processed for user `27f667b87eae45e183745f3cf5bed03c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:45.719758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c4d6a1c4-3015-4076-868d-b88130d25ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:45.826519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4b700-8549-40a6-9fe2-80178ca80bcf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:45.839218 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2983/6017] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:45.925016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4b700-8549-40a6-9fe2-80178ca80bcf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:45.929945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376b635-3163-4575-8180-60cc52a32a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:45.930791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376b635-3163-4575-8180-60cc52a32a39 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:45.931084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376b635-3163-4575-8180-60cc52a32a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:45.931493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376b635-3163-4575-8180-60cc52a32a39 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:45.932238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376b635-3163-4575-8180-60cc52a32a39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:45.934424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376b635-3163-4575-8180-60cc52a32a39 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:45.996962 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3035/6018] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:45 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:46.000257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6a1c4-3015-4076-868d-b88130d25ec2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:46.022133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6a1c4-3015-4076-868d-b88130d25ec2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:46.166801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6451050-b400-4724-aa66-23e65b9cdee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:46.172640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6451050-b400-4724-aa66-23e65b9cdee8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:46.172953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6451050-b400-4724-aa66-23e65b9cdee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:46.173241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6451050-b400-4724-aa66-23e65b9cdee8 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:46.174286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6451050-b400-4724-aa66-23e65b9cdee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:46.176331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6451050-b400-4724-aa66-23e65b9cdee8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:46.212862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376b635-3163-4575-8180-60cc52a32a39 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:46.216400 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2984/6019] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:45 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:46.232642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376b635-3163-4575-8180-60cc52a32a39 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:46.241225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09920ea9-49f2-44bd-8575-7b0d69c35cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:46.242072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09920ea9-49f2-44bd-8575-7b0d69c35cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:46.242694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09920ea9-49f2-44bd-8575-7b0d69c35cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:46.243017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09920ea9-49f2-44bd-8575-7b0d69c35cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:46.243828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09920ea9-49f2-44bd-8575-7b0d69c35cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:46.245687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09920ea9-49f2-44bd-8575-7b0d69c35cf4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:46.269420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6451050-b400-4724-aa66-23e65b9cdee8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:46.270330 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3036/6020] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:46.280823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6451050-b400-4724-aa66-23e65b9cdee8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:46.291530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93518b-8137-416d-84b8-333b7ee7b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:46.292771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93518b-8137-416d-84b8-333b7ee7b3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:46.293061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93518b-8137-416d-84b8-333b7ee7b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:46.293416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93518b-8137-416d-84b8-333b7ee7b3d6 admin admin] PATH_INFO: `/v3/projects/eb5890f4f7d9469dbc91ee08342b01c6/users/5a021da41c434a95a85cfc4a6236aef5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:46.312536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93518b-8137-416d-84b8-333b7ee7b3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5890f4f7d9469dbc91ee08342b01c6, user_id=5a021da41c434a95a85cfc4a6236aef5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:46.315542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93518b-8137-416d-84b8-333b7ee7b3d6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:46.332513 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2985/6021] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:46 2022] PUT /identity/v3/projects/eb5890f4f7d9469dbc91ee08342b01c6/users/5a021da41c434a95a85cfc4a6236aef5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:46.336435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09920ea9-49f2-44bd-8575-7b0d69c35cf4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:46.347966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09920ea9-49f2-44bd-8575-7b0d69c35cf4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:46.460209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeba78c-3938-422c-a32e-9f7384e8c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:46.460917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeba78c-3938-422c-a32e-9f7384e8c841 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:46.461181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeba78c-3938-422c-a32e-9f7384e8c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:46.461451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeba78c-3938-422c-a32e-9f7384e8c841 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:46.462176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeba78c-3938-422c-a32e-9f7384e8c841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:46.464276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeba78c-3938-422c-a32e-9f7384e8c841 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:46.489890 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3037/6022] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:46.493692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93518b-8137-416d-84b8-333b7ee7b3d6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:46.506543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93518b-8137-416d-84b8-333b7ee7b3d6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:46.516347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835caaad-6c50-4c14-baa8-8f611a1efe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:46.517538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835caaad-6c50-4c14-baa8-8f611a1efe80 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:46.520026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835caaad-6c50-4c14-baa8-8f611a1efe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:46.520532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835caaad-6c50-4c14-baa8-8f611a1efe80 admin admin] PATH_INFO: `/v3/projects/eb5890f4f7d9469dbc91ee08342b01c6/users/5a021da41c434a95a85cfc4a6236aef5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:46.523642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835caaad-6c50-4c14-baa8-8f611a1efe80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5890f4f7d9469dbc91ee08342b01c6, user_id=5a021da41c434a95a85cfc4a6236aef5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:46.526766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835caaad-6c50-4c14-baa8-8f611a1efe80 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:46.543886 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2986/6023] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:46 2022] PUT /identity/v3/projects/eb5890f4f7d9469dbc91ee08342b01c6/users/5a021da41c434a95a85cfc4a6236aef5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:46.555554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89952d9-e425-492e-91ab-ee8d16bd9c8a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:46.555863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89952d9-e425-492e-91ab-ee8d16bd9c8a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:46.556311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89952d9-e425-492e-91ab-ee8d16bd9c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:46.620360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d89952d9-e425-492e-91ab-ee8d16bd9c8a None None] MFA Rules not processed for user `5a021da41c434a95a85cfc4a6236aef5`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:46.621871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d89952d9-e425-492e-91ab-ee8d16bd9c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:46.717598 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3038/6024] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:46.717779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835caaad-6c50-4c14-baa8-8f611a1efe80 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:46.728671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835caaad-6c50-4c14-baa8-8f611a1efe80 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:46.733354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1469ba-5b8b-47e6-b067-93781b7c1ae1 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a021da41c434a95a85cfc4a6236aef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5890f4f7d9469dbc91ee08342b01c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:46.734057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1469ba-5b8b-47e6-b067-93781b7c1ae1 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:46.734387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1469ba-5b8b-47e6-b067-93781b7c1ae1 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:46.734670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1469ba-5b8b-47e6-b067-93781b7c1ae1 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:46.735357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1469ba-5b8b-47e6-b067-93781b7c1ae1 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:46.737276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1469ba-5b8b-47e6-b067-93781b7c1ae1 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:46.775512 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2987/6025] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:46 2022] POST /identity/v3/projects => generated 360 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:46.776857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89952d9-e425-492e-91ab-ee8d16bd9c8a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:46.787680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89952d9-e425-492e-91ab-ee8d16bd9c8a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:46.850284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d45d4-0b79-4773-8e12-3f247a226257 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a021da41c434a95a85cfc4a6236aef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5890f4f7d9469dbc91ee08342b01c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:46.851069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d45d4-0b79-4773-8e12-3f247a226257 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:46.851408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d45d4-0b79-4773-8e12-3f247a226257 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:46.851757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d45d4-0b79-4773-8e12-3f247a226257 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:46.852662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d45d4-0b79-4773-8e12-3f247a226257 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:46.863287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d45d4-0b79-4773-8e12-3f247a226257 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:46.889881 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3039/6026] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:46 2022] POST /identity/v3/users => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:46.892201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1469ba-5b8b-47e6-b067-93781b7c1ae1 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:46.923568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1469ba-5b8b-47e6-b067-93781b7c1ae1 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:46.929275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc90c71-f8ba-4f40-b934-169618194d65 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a021da41c434a95a85cfc4a6236aef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5890f4f7d9469dbc91ee08342b01c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:46.929953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90c71-f8ba-4f40-b934-169618194d65 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:46.931153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90c71-f8ba-4f40-b934-169618194d65 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:46.931153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90c71-f8ba-4f40-b934-169618194d65 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:46.932094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc90c71-f8ba-4f40-b934-169618194d65 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:46.932410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc90c71-f8ba-4f40-b934-169618194d65 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:46.935606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc90c71-f8ba-4f40-b934-169618194d65 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:46.986249 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2988/6027] 10.222.0.16 () {58 vars in 1156 bytes} [Sat Mar 26 21:09:46 2022] GET /identity/v3/users?domain_id=default => generated 7742 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:46.991091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d45d4-0b79-4773-8e12-3f247a226257 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:47.011983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d45d4-0b79-4773-8e12-3f247a226257 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:47.030547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a021da41c434a95a85cfc4a6236aef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5890f4f7d9469dbc91ee08342b01c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:47.031559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:47.032215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:47.032496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] PATH_INFO: `/v3/users/b2b88ea2684b4bc19421baf36c8ab9f9` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:47.060616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorizing `identity:update_user(user_id=b2b88ea2684b4bc19421baf36c8ab9f9)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:47.061844 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:09:47.061844 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:09:47.061844 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:09:47.063985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:47.118436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'b2b88ea2684b4bc19421baf36c8ab9f9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.133067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invalidating the token cache because user b2b88ea2684b4bc19421baf36c8ab9f9 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:47.133067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.133844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.138735 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3040/6028] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Mar 26 21:09:46 2022] PATCH /identity/v3/users/b2b88ea2684b4bc19421baf36c8ab9f9 => generated 485 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:47.141213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b1747-b8be-4c8f-a70b-3c82a9725d41 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:47.141559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b1747-b8be-4c8f-a70b-3c82a9725d41 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:47.141850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b1747-b8be-4c8f-a70b-3c82a9725d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:47.157686 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.auth.plugins.core [None req-bc6b1747-b8be-4c8f-a70b-3c82a9725d41 None None] User is disabled: b2b88ea2684b4bc19421baf36c8ab9f9: AssertionError: User is disabled: b2b88ea2684b4bc19421baf36c8ab9f9 Mar 26 21:09:47.164753 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-bc6b1747-b8be-4c8f-a70b-3c82a9725d41 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.16: keystone.exception.Unauthorized: The request you have made requires authentication. Mar 26 21:09:47.167979 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2989/6029] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:47 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 27 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Mar 26 21:09:47.170297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:47.172689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:47.197598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20d0f1-f85e-43b3-b145-017dbb7c1886 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:47.215703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a021da41c434a95a85cfc4a6236aef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5890f4f7d9469dbc91ee08342b01c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:47.225130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:47.226032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:47.226404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] PATH_INFO: `/v3/users/b2b88ea2684b4bc19421baf36c8ab9f9` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:47.262174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b2b88ea2684b4bc19421baf36c8ab9f9)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:47.264978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:47.339364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2b88ea2684b4bc19421baf36c8ab9f9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.355526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2b88ea2684b4bc19421baf36c8ab9f9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.356786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2b88ea2684b4bc19421baf36c8ab9f9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.358656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2b88ea2684b4bc19421baf36c8ab9f9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.383666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2b88ea2684b4bc19421baf36c8ab9f9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.416740 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3041/6030] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:47 2022] DELETE /identity/v3/users/b2b88ea2684b4bc19421baf36c8ab9f9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:47.421484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b1747-b8be-4c8f-a70b-3c82a9725d41 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:47.426973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bc6b1747-b8be-4c8f-a70b-3c82a9725d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:47.542164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b1747-b8be-4c8f-a70b-3c82a9725d41 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:47.549568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a021da41c434a95a85cfc4a6236aef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5890f4f7d9469dbc91ee08342b01c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:47.550450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:47.550731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:47.550988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] PATH_INFO: `/v3/projects/f07723ebb6934ab2ac41c5b2bc71b92f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:47.552274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f07723ebb6934ab2ac41c5b2bc71b92f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:47.554220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:47.648738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07723ebb6934ab2ac41c5b2bc71b92f', 'request_id': 'req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.677792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07723ebb6934ab2ac41c5b2bc71b92f', 'request_id': 'req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.690046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07723ebb6934ab2ac41c5b2bc71b92f', 'request_id': 'req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.737504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] The token cache is being invalidate because project f07723ebb6934ab2ac41c5b2bc71b92f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:47.737800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.739588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:47.746660 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2990/6031] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:47 2022] DELETE /identity/v3/projects/f07723ebb6934ab2ac41c5b2bc71b92f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:47.747020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:47.773517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01492453-c9fe-42aa-9cf6-314d068c28bd tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:47.917144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a021da41c434a95a85cfc4a6236aef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb5890f4f7d9469dbc91ee08342b01c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:47.918002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:47.918294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:47.918573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:47.919293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:47.921332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:47.935647 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Could not find domain: 9eb17e81ce9a463ba32baa7bf1040e27.: keystone.exception.DomainNotFound: Could not find domain: 9eb17e81ce9a463ba32baa7bf1040e27. Mar 26 21:09:47.942357 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3042/6032] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:47 2022] POST /identity/v3/users => generated 112 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Mar 26 21:09:47.944237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:47.947078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:48.131878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2df0e0-02a1-4f55-ab01-0abfa5ed52ce tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:48.136796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:48.138175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:48.138456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:48.138911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] PATH_INFO: `/v3/users/27f667b87eae45e183745f3cf5bed03c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:48.140171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f667b87eae45e183745f3cf5bed03c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:48.142707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:48.165024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:48.166884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:48.199021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5348b85-315c-45c0-8eb7-98f3e83ac645 tempest-UsersNegativeTest-1312458181 tempest-UsersNegativeTest-1312458181-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:48.224785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:48.225000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f667b87eae45e183745f3cf5bed03c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.226034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:48.226474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:48.226970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] PATH_INFO: `/v3/users/513a378e40574ca39833b2f1f80270e7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:48.228538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513a378e40574ca39833b2f1f80270e7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:48.230668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:48.239840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f667b87eae45e183745f3cf5bed03c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.240704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f667b87eae45e183745f3cf5bed03c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.242401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f667b87eae45e183745f3cf5bed03c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.270820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b53bf9d3-b7fe-4ba7-bb1b-f887246a25f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f667b87eae45e183745f3cf5bed03c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.303052 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2991/6033] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:47 2022] DELETE /identity/v3/users/27f667b87eae45e183745f3cf5bed03c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:48.307889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c89c6-7716-4ba7-88f9-5f9dea854db8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:48.308539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c89c6-7716-4ba7-88f9-5f9dea854db8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:48.308832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c89c6-7716-4ba7-88f9-5f9dea854db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:48.313542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513a378e40574ca39833b2f1f80270e7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.324493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513a378e40574ca39833b2f1f80270e7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.325911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513a378e40574ca39833b2f1f80270e7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.327091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513a378e40574ca39833b2f1f80270e7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.347123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cf210a43-7a02-405f-bebd-f57e0dc13590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513a378e40574ca39833b2f1f80270e7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.351273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-023c89c6-7716-4ba7-88f9-5f9dea854db8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:48.353232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-023c89c6-7716-4ba7-88f9-5f9dea854db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:48.386056 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3043/6034] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:48 2022] DELETE /identity/v3/users/513a378e40574ca39833b2f1f80270e7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:48.391177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57dec1-1dbd-4df5-9da4-9ff37d7ef3f5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:48.391664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57dec1-1dbd-4df5-9da4-9ff37d7ef3f5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:48.392130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57dec1-1dbd-4df5-9da4-9ff37d7ef3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:48.426613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cd57dec1-1dbd-4df5-9da4-9ff37d7ef3f5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:48.428323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cd57dec1-1dbd-4df5-9da4-9ff37d7ef3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:48.489444 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2992/6035] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:48.508213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c89c6-7716-4ba7-88f9-5f9dea854db8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:48.510808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-023c89c6-7716-4ba7-88f9-5f9dea854db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:48.547214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3044/6036] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:48.566889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57dec1-1dbd-4df5-9da4-9ff37d7ef3f5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:48.568750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cd57dec1-1dbd-4df5-9da4-9ff37d7ef3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:48.589477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c89c6-7716-4ba7-88f9-5f9dea854db8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:48.658195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df51f-0fe1-4afe-adff-2e9e7f855a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:48.658848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df51f-0fe1-4afe-adff-2e9e7f855a05 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:48.659135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df51f-0fe1-4afe-adff-2e9e7f855a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:48.659405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46df51f-0fe1-4afe-adff-2e9e7f855a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:48.671260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46df51f-0fe1-4afe-adff-2e9e7f855a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:48.671956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd57dec1-1dbd-4df5-9da4-9ff37d7ef3f5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:48.672915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46df51f-0fe1-4afe-adff-2e9e7f855a05 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:48.676858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f71f6-8222-43a7-b657-9f20132fe478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:48.677770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f71f6-8222-43a7-b657-9f20132fe478 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:48.678392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f71f6-8222-43a7-b657-9f20132fe478 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:48.679291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5f71f6-8222-43a7-b657-9f20132fe478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:48.683977 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2993/6037] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:09:48.694619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f71f6-8222-43a7-b657-9f20132fe478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:48.696597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5f71f6-8222-43a7-b657-9f20132fe478 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:48.718138 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3045/6038] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:48.827517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df51f-0fe1-4afe-adff-2e9e7f855a05 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:48.829660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b46df51f-0fe1-4afe-adff-2e9e7f855a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:48.843895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46df51f-0fe1-4afe-adff-2e9e7f855a05 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:48.849010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:48.849982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:48.850340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:48.850696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] PATH_INFO: `/v3/users/321431f1b82447d28c58e7d03fd20515` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:48.852057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=321431f1b82447d28c58e7d03fd20515)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:48.854136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:48.923597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321431f1b82447d28c58e7d03fd20515'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.935381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321431f1b82447d28c58e7d03fd20515'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.936152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321431f1b82447d28c58e7d03fd20515'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.938212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321431f1b82447d28c58e7d03fd20515'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.955694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321431f1b82447d28c58e7d03fd20515'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:48.975137 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2994/6039] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:48 2022] DELETE /identity/v3/users/321431f1b82447d28c58e7d03fd20515 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:49.379003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f71f6-8222-43a7-b657-9f20132fe478 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:49.381193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:49.381484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5e5f71f6-8222-43a7-b657-9f20132fe478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:49.382853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:49.422463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5f71f6-8222-43a7-b657-9f20132fe478 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:49.471246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5542b1-8609-48e7-82a1-5c2ff0bb7e8f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:49.477248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:49.478384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:49.478712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:49.478939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] PATH_INFO: `/v3/projects/765e5efb645146e58c075fc2de2a13dd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:49.480429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=765e5efb645146e58c075fc2de2a13dd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:49.492884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:49.535033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:49.535890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:49.536201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:49.536473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] PATH_INFO: `/v3/projects/53cefab95b6e4e79bde32b120ad7cb5c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:49.537676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cefab95b6e4e79bde32b120ad7cb5c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:49.539843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:49.561315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '765e5efb645146e58c075fc2de2a13dd', 'request_id': 'req-de68884e-dbd3-44f6-8c22-54f28e4a3347'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.571714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '765e5efb645146e58c075fc2de2a13dd', 'request_id': 'req-de68884e-dbd3-44f6-8c22-54f28e4a3347'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.579860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '765e5efb645146e58c075fc2de2a13dd', 'request_id': 'req-de68884e-dbd3-44f6-8c22-54f28e4a3347'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.594204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] The token cache is being invalidate because project 765e5efb645146e58c075fc2de2a13dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:49.594935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.595974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.598051 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2995/6040] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:49 2022] DELETE /identity/v3/projects/765e5efb645146e58c075fc2de2a13dd => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:49.598650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:49.600004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:49.619900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cefab95b6e4e79bde32b120ad7cb5c', 'request_id': 'req-00f35cc9-10e9-4d0e-b233-7c3f45db829f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.632392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cefab95b6e4e79bde32b120ad7cb5c', 'request_id': 'req-00f35cc9-10e9-4d0e-b233-7c3f45db829f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.640117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cefab95b6e4e79bde32b120ad7cb5c', 'request_id': 'req-00f35cc9-10e9-4d0e-b233-7c3f45db829f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.659083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] The token cache is being invalidate because project 53cefab95b6e4e79bde32b120ad7cb5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:49.659382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.660219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00f35cc9-10e9-4d0e-b233-7c3f45db829f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.662261 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3046/6041] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:49 2022] DELETE /identity/v3/projects/53cefab95b6e4e79bde32b120ad7cb5c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:49.668861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2894c0-1d94-4b04-aae8-7ae005b9246e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:49.669153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2894c0-1d94-4b04-aae8-7ae005b9246e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:49.669434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2894c0-1d94-4b04-aae8-7ae005b9246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:49.679609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68884e-dbd3-44f6-8c22-54f28e4a3347 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:49.728183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9c2894c0-1d94-4b04-aae8-7ae005b9246e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:49.729990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9c2894c0-1d94-4b04-aae8-7ae005b9246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:49.748508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:49.750116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:49.750556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:49.751086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] PATH_INFO: `/v3/projects/5a748aa42d5c4f55bd7d2d86838ff112` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:49.753620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a748aa42d5c4f55bd7d2d86838ff112)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:49.755800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:49.813232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a748aa42d5c4f55bd7d2d86838ff112', 'request_id': 'req-f1b64a8e-cc19-413c-9643-7a8599cff904'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.815955 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3047/6042] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:49.823872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e981-82be-4167-9c7b-d77a82ee2968 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:49.824218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e981-82be-4167-9c7b-d77a82ee2968 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:49.824466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578e981-82be-4167-9c7b-d77a82ee2968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:49.827411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a748aa42d5c4f55bd7d2d86838ff112', 'request_id': 'req-f1b64a8e-cc19-413c-9643-7a8599cff904'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.834268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a748aa42d5c4f55bd7d2d86838ff112', 'request_id': 'req-f1b64a8e-cc19-413c-9643-7a8599cff904'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.845600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0578e981-82be-4167-9c7b-d77a82ee2968 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:49.845840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] The token cache is being invalidate because project 5a748aa42d5c4f55bd7d2d86838ff112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:49.846200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.846899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:49.848582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0578e981-82be-4167-9c7b-d77a82ee2968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:49.851982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2996/6043] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:49 2022] DELETE /identity/v3/projects/5a748aa42d5c4f55bd7d2d86838ff112 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:49.853027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:49.854363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:49.932451 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3048/6044] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:49.934254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b445cf8-abbd-4518-85cd-80f26cc4ce0c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:49.934733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b445cf8-abbd-4518-85cd-80f26cc4ce0c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:49.935008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b445cf8-abbd-4518-85cd-80f26cc4ce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:49.951291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b64a8e-cc19-413c-9643-7a8599cff904 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:49.964644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0b445cf8-abbd-4518-85cd-80f26cc4ce0c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:49.964644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0b445cf8-abbd-4518-85cd-80f26cc4ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:49.966818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:49.970856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:49.971178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:49.971467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] PATH_INFO: `/v3/users/5a021da41c434a95a85cfc4a6236aef5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:49.973338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a021da41c434a95a85cfc4a6236aef5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:49.975315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:49.980416 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3049/6045] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:49.982130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231861-8749-4ea6-a7ed-a7ecadc31a30 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:49.982593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231861-8749-4ea6-a7ed-a7ecadc31a30 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:49.982875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231861-8749-4ea6-a7ed-a7ecadc31a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.019233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5f231861-8749-4ea6-a7ed-a7ecadc31a30 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:50.020623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5f231861-8749-4ea6-a7ed-a7ecadc31a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:50.042143 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3050/6046] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:50.042143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f231861-8749-4ea6-a7ed-a7ecadc31a30 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.042143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5f231861-8749-4ea6-a7ed-a7ecadc31a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:50.053806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a021da41c434a95a85cfc4a6236aef5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:50.066586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a021da41c434a95a85cfc4a6236aef5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:50.067519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a021da41c434a95a85cfc4a6236aef5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:50.068880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a021da41c434a95a85cfc4a6236aef5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:50.082982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a021da41c434a95a85cfc4a6236aef5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:50.103835 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2997/6047] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:49 2022] DELETE /identity/v3/users/5a021da41c434a95a85cfc4a6236aef5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:50.105088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.106624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:50.115897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f231861-8749-4ea6-a7ed-a7ecadc31a30 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.182434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad8ed6-f5fc-45da-a9a7-f961628295fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.183079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8ed6-f5fc-45da-a9a7-f961628295fd service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.183362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8ed6-f5fc-45da-a9a7-f961628295fd service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.183637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad8ed6-f5fc-45da-a9a7-f961628295fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.185564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-29ad8ed6-f5fc-45da-a9a7-f961628295fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:50.231028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75e205-0113-475a-8a3a-8cd1bf22fdc1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.236502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90a0c2-6556-4c04-aef5-4d5011ef3ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.237224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a0c2-6556-4c04-aef5-4d5011ef3ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.237524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a0c2-6556-4c04-aef5-4d5011ef3ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.237998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90a0c2-6556-4c04-aef5-4d5011ef3ec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.238518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a0c2-6556-4c04-aef5-4d5011ef3ec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:50.238830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a0c2-6556-4c04-aef5-4d5011ef3ec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.240572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90a0c2-6556-4c04-aef5-4d5011ef3ec1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.254114 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2998/6048] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:50.255259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632010e-de53-447f-af41-1d465dd94b8a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.255550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632010e-de53-447f-af41-1d465dd94b8a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.255834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b632010e-de53-447f-af41-1d465dd94b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.273545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad8ed6-f5fc-45da-a9a7-f961628295fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.275603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad8ed6-f5fc-45da-a9a7-f961628295fd service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.275863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b632010e-de53-447f-af41-1d465dd94b8a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:50.277114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b632010e-de53-447f-af41-1d465dd94b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:50.288202 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 2999/6049] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:50.289456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632010e-de53-447f-af41-1d465dd94b8a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.292193 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3051/6050] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:50.293245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad8ed6-f5fc-45da-a9a7-f961628295fd service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.303712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b632010e-de53-447f-af41-1d465dd94b8a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.304804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad8ed6-f5fc-45da-a9a7-f961628295fd service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.309088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e08d23-5741-4a21-9331-5b0010077e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.309797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e08d23-5741-4a21-9331-5b0010077e7f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.310081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e08d23-5741-4a21-9331-5b0010077e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.310407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e08d23-5741-4a21-9331-5b0010077e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.310604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218423-5d2d-40c7-bfe6-748d7194d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.311090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e08d23-5741-4a21-9331-5b0010077e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.311288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218423-5d2d-40c7-bfe6-748d7194d179 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.311573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218423-5d2d-40c7-bfe6-748d7194d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.312012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2218423-5d2d-40c7-bfe6-748d7194d179 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.313131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2218423-5d2d-40c7-bfe6-748d7194d179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:50.313436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2218423-5d2d-40c7-bfe6-748d7194d179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.313555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e08d23-5741-4a21-9331-5b0010077e7f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.315023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2218423-5d2d-40c7-bfe6-748d7194d179 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.338304 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3052/6051] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:50.342251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218423-5d2d-40c7-bfe6-748d7194d179 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.356961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2218423-5d2d-40c7-bfe6-748d7194d179 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.363553 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3000/6052] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:50 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:50.363749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d55eec-a5ee-4105-8dcd-20de0e81db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.364318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d55eec-a5ee-4105-8dcd-20de0e81db6b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.364600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d55eec-a5ee-4105-8dcd-20de0e81db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.364881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d55eec-a5ee-4105-8dcd-20de0e81db6b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.365617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d55eec-a5ee-4105-8dcd-20de0e81db6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.367710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e08d23-5741-4a21-9331-5b0010077e7f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.367847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d55eec-a5ee-4105-8dcd-20de0e81db6b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.410087 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3053/6053] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:50 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:50.410917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d55eec-a5ee-4105-8dcd-20de0e81db6b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.472954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e08d23-5741-4a21-9331-5b0010077e7f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.514675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d55eec-a5ee-4105-8dcd-20de0e81db6b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.519862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c81f-d50d-4a70-8292-b7d0fdce97fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.520580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c81f-d50d-4a70-8292-b7d0fdce97fb admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.520865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c81f-d50d-4a70-8292-b7d0fdce97fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.521144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0c81f-d50d-4a70-8292-b7d0fdce97fb admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.521886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0c81f-d50d-4a70-8292-b7d0fdce97fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.523833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0c81f-d50d-4a70-8292-b7d0fdce97fb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.544201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c32eb-a20f-4ff0-8335-11e552e6c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.544468 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3054/6054] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:50 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:50.544890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c32eb-a20f-4ff0-8335-11e552e6c5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.545182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c32eb-a20f-4ff0-8335-11e552e6c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.545464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c32eb-a20f-4ff0-8335-11e552e6c5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.546155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c32eb-a20f-4ff0-8335-11e552e6c5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.548769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c32eb-a20f-4ff0-8335-11e552e6c5c1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.548882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c81f-d50d-4a70-8292-b7d0fdce97fb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.558634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0c81f-d50d-4a70-8292-b7d0fdce97fb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.564487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3558a6e-c727-4f29-8dd1-9ae5b7ac36ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.565134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3558a6e-c727-4f29-8dd1-9ae5b7ac36ce admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.565511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3558a6e-c727-4f29-8dd1-9ae5b7ac36ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.565675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3558a6e-c727-4f29-8dd1-9ae5b7ac36ce admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.566402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3558a6e-c727-4f29-8dd1-9ae5b7ac36ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.568058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3558a6e-c727-4f29-8dd1-9ae5b7ac36ce admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.581345 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3001/6055] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:50 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:50.581501 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3055/6056] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:50.583198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3558a6e-c727-4f29-8dd1-9ae5b7ac36ce admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.583331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c32eb-a20f-4ff0-8335-11e552e6c5c1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.594063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c32eb-a20f-4ff0-8335-11e552e6c5c1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.594246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3558a6e-c727-4f29-8dd1-9ae5b7ac36ce admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.598761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72563d-109f-4c2b-84ca-f9a5410df5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.599142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969001-c64a-4726-8a2d-34ad12ab300d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.599609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72563d-109f-4c2b-84ca-f9a5410df5fe admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.599695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72563d-109f-4c2b-84ca-f9a5410df5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.599975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969001-c64a-4726-8a2d-34ad12ab300d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.600080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72563d-109f-4c2b-84ca-f9a5410df5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.600345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969001-c64a-4726-8a2d-34ad12ab300d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.600693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969001-c64a-4726-8a2d-34ad12ab300d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.600795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72563d-109f-4c2b-84ca-f9a5410df5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.601601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4969001-c64a-4726-8a2d-34ad12ab300d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.603306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4969001-c64a-4726-8a2d-34ad12ab300d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.610636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72563d-109f-4c2b-84ca-f9a5410df5fe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.618600 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3002/6057] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:50.630529 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3056/6058] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:50.632200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb4aed-5724-43ca-acc6-8321f29616d0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.632496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb4aed-5724-43ca-acc6-8321f29616d0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.632776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb4aed-5724-43ca-acc6-8321f29616d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.636461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969001-c64a-4726-8a2d-34ad12ab300d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.647603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969001-c64a-4726-8a2d-34ad12ab300d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.655383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306741-6b49-4e2e-bc6e-972d0efe4d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.655383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306741-6b49-4e2e-bc6e-972d0efe4d89 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.655383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306741-6b49-4e2e-bc6e-972d0efe4d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.655383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35306741-6b49-4e2e-bc6e-972d0efe4d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.656633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35306741-6b49-4e2e-bc6e-972d0efe4d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.657368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35306741-6b49-4e2e-bc6e-972d0efe4d89 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.670892 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3003/6059] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:50.672187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306741-6b49-4e2e-bc6e-972d0efe4d89 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.678152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1ecb4aed-5724-43ca-acc6-8321f29616d0 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:50.681079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1ecb4aed-5724-43ca-acc6-8321f29616d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:50.683837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35306741-6b49-4e2e-bc6e-972d0efe4d89 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.692582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f41503-9fd6-4743-b42a-cd58d858d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.693625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f41503-9fd6-4743-b42a-cd58d858d421 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.693918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f41503-9fd6-4743-b42a-cd58d858d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.694197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f41503-9fd6-4743-b42a-cd58d858d421 admin admin] PATH_INFO: `/v3/projects/07cc114d541b4309ac532e6490907780/users/545dd68b6a0e4097bc4d6270cd1baad2/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.720871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f41503-9fd6-4743-b42a-cd58d858d421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07cc114d541b4309ac532e6490907780, user_id=545dd68b6a0e4097bc4d6270cd1baad2, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.724417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f41503-9fd6-4743-b42a-cd58d858d421 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.750946 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3004/6060] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:50 2022] PUT /identity/v3/projects/07cc114d541b4309ac532e6490907780/users/545dd68b6a0e4097bc4d6270cd1baad2/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:50.752385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f41503-9fd6-4743-b42a-cd58d858d421 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.762437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c1f41503-9fd6-4743-b42a-cd58d858d421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:50.783685 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3057/6061] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:50.793134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb4aed-5724-43ca-acc6-8321f29616d0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:50.812167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb4aed-5724-43ca-acc6-8321f29616d0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.869527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f41503-9fd6-4743-b42a-cd58d858d421 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:50.889128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b1da2-d32a-442c-a092-c7b24647a9ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.889886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b1da2-d32a-442c-a092-c7b24647a9ec service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.891471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b1da2-d32a-442c-a092-c7b24647a9ec service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.891756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b1da2-d32a-442c-a092-c7b24647a9ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.899053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5c2b1da2-d32a-442c-a092-c7b24647a9ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:50.939681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e4c3f-8693-4bcd-84f8-cd97509cd9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:50.940781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e4c3f-8693-4bcd-84f8-cd97509cd9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.940900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b1da2-d32a-442c-a092-c7b24647a9ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.941066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e4c3f-8693-4bcd-84f8-cd97509cd9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.941453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e4c3f-8693-4bcd-84f8-cd97509cd9e3 admin admin] PATH_INFO: `/v3/projects/52b4455ec1a2447ebb1f737c0d97fc83/users/54a09bedd0ad4328b1e687fc5f7e3967/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.943429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b1da2-d32a-442c-a092-c7b24647a9ec service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:50.958924 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3005/6062] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:50.961365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f096-97fb-4fc2-8b44-d53c982974ed None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:50.961877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f096-97fb-4fc2-8b44-d53c982974ed None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:50.962425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217f096-97fb-4fc2-8b44-d53c982974ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:50.979490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e4c3f-8693-4bcd-84f8-cd97509cd9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b4455ec1a2447ebb1f737c0d97fc83, user_id=54a09bedd0ad4328b1e687fc5f7e3967, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:50.987645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e4c3f-8693-4bcd-84f8-cd97509cd9e3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.025415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8217f096-97fb-4fc2-8b44-d53c982974ed None None] MFA Rules not processed for user `545dd68b6a0e4097bc4d6270cd1baad2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:51.027119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8217f096-97fb-4fc2-8b44-d53c982974ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.030739 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3058/6063] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:50 2022] PUT /identity/v3/projects/52b4455ec1a2447ebb1f737c0d97fc83/users/54a09bedd0ad4328b1e687fc5f7e3967/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:51.032313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e4c3f-8693-4bcd-84f8-cd97509cd9e3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.034621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-192e4c3f-8693-4bcd-84f8-cd97509cd9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.175442 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3006/6064] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:51.175649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e4c3f-8693-4bcd-84f8-cd97509cd9e3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.175794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1ea1b-6551-4dd9-bb90-0b525b0a710d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.175794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1ea1b-6551-4dd9-bb90-0b525b0a710d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.175794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1ea1b-6551-4dd9-bb90-0b525b0a710d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.184517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.185399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.185710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.185992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] PATH_INFO: `/v3/projects/eb5890f4f7d9469dbc91ee08342b01c6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.188146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5890f4f7d9469dbc91ee08342b01c6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.191008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.197188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0cd1ea1b-6551-4dd9-bb90-0b525b0a710d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:51.198759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0cd1ea1b-6551-4dd9-bb90-0b525b0a710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.219835 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3007/6065] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:51.221074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1ea1b-6551-4dd9-bb90-0b525b0a710d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.222477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0cd1ea1b-6551-4dd9-bb90-0b525b0a710d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.254552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5890f4f7d9469dbc91ee08342b01c6', 'request_id': 'req-61cc2708-03c2-46b8-a8b2-b18724d8fc09'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:51.266380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5890f4f7d9469dbc91ee08342b01c6', 'request_id': 'req-61cc2708-03c2-46b8-a8b2-b18724d8fc09'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:51.278020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5890f4f7d9469dbc91ee08342b01c6', 'request_id': 'req-61cc2708-03c2-46b8-a8b2-b18724d8fc09'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:51.293000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] The token cache is being invalidate because project eb5890f4f7d9469dbc91ee08342b01c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:51.293854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:51.294209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:51.296035 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3059/6066] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:51 2022] DELETE /identity/v3/projects/eb5890f4f7d9469dbc91ee08342b01c6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:51.302688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.304172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.334610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1ea1b-6551-4dd9-bb90-0b525b0a710d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.387783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc2708-03c2-46b8-a8b2-b18724d8fc09 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.394284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602771c-788a-4a94-b4ec-7161abe25492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.395251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602771c-788a-4a94-b4ec-7161abe25492 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.395700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602771c-788a-4a94-b4ec-7161abe25492 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.396179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602771c-788a-4a94-b4ec-7161abe25492 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.397105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602771c-788a-4a94-b4ec-7161abe25492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.399324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602771c-788a-4a94-b4ec-7161abe25492 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.426610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fdf37-3833-46b9-8489-58c248a6f8dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.427521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdf37-3833-46b9-8489-58c248a6f8dc service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.427877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdf37-3833-46b9-8489-58c248a6f8dc service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.428694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdf37-3833-46b9-8489-58c248a6f8dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.430754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-219fdf37-3833-46b9-8489-58c248a6f8dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.449001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fdf37-3833-46b9-8489-58c248a6f8dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.451754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fdf37-3833-46b9-8489-58c248a6f8dc service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.454428 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3060/6067] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:51 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:51.455236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602771c-788a-4a94-b4ec-7161abe25492 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.460432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9602771c-788a-4a94-b4ec-7161abe25492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.478103 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3008/6068] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:51.479666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545de264-52d4-4656-8fa8-cae62654abd5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.479979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545de264-52d4-4656-8fa8-cae62654abd5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.481540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545de264-52d4-4656-8fa8-cae62654abd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.510214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-545de264-52d4-4656-8fa8-cae62654abd5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:51.515099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-545de264-52d4-4656-8fa8-cae62654abd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.610531 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3009/6069] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:51.611582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602771c-788a-4a94-b4ec-7161abe25492 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.617952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537c627-65ff-43e9-983b-48fbe2a8e079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.618839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c627-65ff-43e9-983b-48fbe2a8e079 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.619219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c627-65ff-43e9-983b-48fbe2a8e079 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.620040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c627-65ff-43e9-983b-48fbe2a8e079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.622189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7537c627-65ff-43e9-983b-48fbe2a8e079 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.626233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545de264-52d4-4656-8fa8-cae62654abd5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.641643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537c627-65ff-43e9-983b-48fbe2a8e079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.642200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545de264-52d4-4656-8fa8-cae62654abd5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.643412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537c627-65ff-43e9-983b-48fbe2a8e079 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.648591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd39570-8282-4b72-ac71-eea129869099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.649480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd39570-8282-4b72-ac71-eea129869099 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.650199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd39570-8282-4b72-ac71-eea129869099 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.650665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd39570-8282-4b72-ac71-eea129869099 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.651793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd39570-8282-4b72-ac71-eea129869099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.665128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd39570-8282-4b72-ac71-eea129869099 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.668558 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3061/6070] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:51.669998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b317-8898-430c-b6c5-b208600acac7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.670356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b317-8898-430c-b6c5-b208600acac7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.670709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b317-8898-430c-b6c5-b208600acac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.694444 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3010/6071] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:51 2022] POST /identity/v3/users => generated 293 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:51.696598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4b10b317-8898-430c-b6c5-b208600acac7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:51.697902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4b10b317-8898-430c-b6c5-b208600acac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:51.699302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd39570-8282-4b72-ac71-eea129869099 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.711899 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3062/6072] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:51.713397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10b317-8898-430c-b6c5-b208600acac7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.716235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd39570-8282-4b72-ac71-eea129869099 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.722449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71340c46-59e6-460b-8440-f3cc651b05d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.724129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71340c46-59e6-460b-8440-f3cc651b05d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.724528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71340c46-59e6-460b-8440-f3cc651b05d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.724990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71340c46-59e6-460b-8440-f3cc651b05d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.726046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71340c46-59e6-460b-8440-f3cc651b05d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.728324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71340c46-59e6-460b-8440-f3cc651b05d3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.728454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10b317-8898-430c-b6c5-b208600acac7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.736086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caadc7-7b32-4787-bb09-07d29b78e0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.736833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caadc7-7b32-4787-bb09-07d29b78e0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.737122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caadc7-7b32-4787-bb09-07d29b78e0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.737398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caadc7-7b32-4787-bb09-07d29b78e0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.738168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caadc7-7b32-4787-bb09-07d29b78e0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:51.738472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caadc7-7b32-4787-bb09-07d29b78e0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.740408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caadc7-7b32-4787-bb09-07d29b78e0b6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.743986 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3011/6073] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:51.747151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71340c46-59e6-460b-8440-f3cc651b05d3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.762312 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3063/6074] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:51.766202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caadc7-7b32-4787-bb09-07d29b78e0b6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.775580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71340c46-59e6-460b-8440-f3cc651b05d3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.777949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caadc7-7b32-4787-bb09-07d29b78e0b6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.781740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e60daf-6ba6-4114-a546-f2baaba9c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.782371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60daf-6ba6-4114-a546-f2baaba9c5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.782686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60daf-6ba6-4114-a546-f2baaba9c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.782967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e60daf-6ba6-4114-a546-f2baaba9c5dc admin admin] PATH_INFO: `/v3/projects/06d340c85d3f4ef6bc5d273f0759cc11/users/a6765baed04e4b52b4b19aa3c399e1bd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.785866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86808e-35cb-4a15-958d-54d6e9cd04a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.786687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86808e-35cb-4a15-958d-54d6e9cd04a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.786990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86808e-35cb-4a15-958d-54d6e9cd04a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.787267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec86808e-35cb-4a15-958d-54d6e9cd04a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.787984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86808e-35cb-4a15-958d-54d6e9cd04a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.790009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec86808e-35cb-4a15-958d-54d6e9cd04a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.801352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e60daf-6ba6-4114-a546-f2baaba9c5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d340c85d3f4ef6bc5d273f0759cc11, user_id=a6765baed04e4b52b4b19aa3c399e1bd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.804746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e60daf-6ba6-4114-a546-f2baaba9c5dc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.829777 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3012/6075] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:51 2022] PUT /identity/v3/projects/06d340c85d3f4ef6bc5d273f0759cc11/users/a6765baed04e4b52b4b19aa3c399e1bd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:51.834891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e60daf-6ba6-4114-a546-f2baaba9c5dc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.836230 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3064/6076] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:51 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:51.840055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86808e-35cb-4a15-958d-54d6e9cd04a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.949350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec86808e-35cb-4a15-958d-54d6e9cd04a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.958928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4b019-2df0-4718-9b5c-0e6d51f30e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.960244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4b019-2df0-4718-9b5c-0e6d51f30e7d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.960572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4b019-2df0-4718-9b5c-0e6d51f30e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.960857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4b019-2df0-4718-9b5c-0e6d51f30e7d admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.961701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4b019-2df0-4718-9b5c-0e6d51f30e7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.964262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4b019-2df0-4718-9b5c-0e6d51f30e7d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.971836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e60daf-6ba6-4114-a546-f2baaba9c5dc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:51.978103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0246f51-4fdc-425f-b932-2478828b64c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:51.979250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0246f51-4fdc-425f-b932-2478828b64c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:51.979855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0246f51-4fdc-425f-b932-2478828b64c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:51.980407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0246f51-4fdc-425f-b932-2478828b64c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:51.981702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0246f51-4fdc-425f-b932-2478828b64c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:51.983784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0246f51-4fdc-425f-b932-2478828b64c6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:51.995409 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3065/6077] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:51 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:51.996582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4b019-2df0-4718-9b5c-0e6d51f30e7d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:51.999373 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3013/6078] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:52.004287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0246f51-4fdc-425f-b932-2478828b64c6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:52.010397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4b019-2df0-4718-9b5c-0e6d51f30e7d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:52.019347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49170edd-04c4-47b9-8b45-67f667ca7138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:52.020063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49170edd-04c4-47b9-8b45-67f667ca7138 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.020352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49170edd-04c4-47b9-8b45-67f667ca7138 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.020631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49170edd-04c4-47b9-8b45-67f667ca7138 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.021358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49170edd-04c4-47b9-8b45-67f667ca7138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:52.027818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0246f51-4fdc-425f-b932-2478828b64c6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:52.030735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49170edd-04c4-47b9-8b45-67f667ca7138 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:52.037590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee9fab-5389-492f-897e-9f59c36457d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:52.038965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee9fab-5389-492f-897e-9f59c36457d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.039248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee9fab-5389-492f-897e-9f59c36457d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.039524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee9fab-5389-492f-897e-9f59c36457d5 admin admin] PATH_INFO: `/v3/projects/06d340c85d3f4ef6bc5d273f0759cc11/users/a6765baed04e4b52b4b19aa3c399e1bd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.044403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee9fab-5389-492f-897e-9f59c36457d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d340c85d3f4ef6bc5d273f0759cc11, user_id=a6765baed04e4b52b4b19aa3c399e1bd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:52.048775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee9fab-5389-492f-897e-9f59c36457d5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:52.048943 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3066/6079] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:52.052166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49170edd-04c4-47b9-8b45-67f667ca7138 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:52.061367 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3014/6080] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:52 2022] PUT /identity/v3/projects/06d340c85d3f4ef6bc5d273f0759cc11/users/a6765baed04e4b52b4b19aa3c399e1bd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:52.067588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49170edd-04c4-47b9-8b45-67f667ca7138 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:52.071656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c4b19-521e-4085-9a18-e1638c2fc270 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.071967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c4b19-521e-4085-9a18-e1638c2fc270 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.072884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c4b19-521e-4085-9a18-e1638c2fc270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.129221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ff7c4b19-521e-4085-9a18-e1638c2fc270 None None] MFA Rules not processed for user `a6765baed04e4b52b4b19aa3c399e1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:52.130894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ff7c4b19-521e-4085-9a18-e1638c2fc270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:52.149795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1b39-9ed3-455d-8522-bf66d6d247a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:52.150474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1b39-9ed3-455d-8522-bf66d6d247a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.150752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1b39-9ed3-455d-8522-bf66d6d247a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.152740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c1b39-9ed3-455d-8522-bf66d6d247a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.153405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c1b39-9ed3-455d-8522-bf66d6d247a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:52.155043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c1b39-9ed3-455d-8522-bf66d6d247a8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:52.175352 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3067/6081] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:52.179803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1b39-9ed3-455d-8522-bf66d6d247a8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:52.199031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c1b39-9ed3-455d-8522-bf66d6d247a8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:52.212617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034abfaa-8935-4a4c-a438-bdbdcc332c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:52.213281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034abfaa-8935-4a4c-a438-bdbdcc332c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.213621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034abfaa-8935-4a4c-a438-bdbdcc332c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.215163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034abfaa-8935-4a4c-a438-bdbdcc332c62 admin admin] PATH_INFO: `/v3/projects/dfe26a7857f84d2b89f3ed7ed194cec4/users/c359d29efa1b4884a3f6d624a23ffaa6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.244609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034abfaa-8935-4a4c-a438-bdbdcc332c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe26a7857f84d2b89f3ed7ed194cec4, user_id=c359d29efa1b4884a3f6d624a23ffaa6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:52.247834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034abfaa-8935-4a4c-a438-bdbdcc332c62 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:52.274452 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3015/6082] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:52.277223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c4b19-521e-4085-9a18-e1638c2fc270 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:52.283061 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3068/6083] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:52 2022] PUT /identity/v3/projects/dfe26a7857f84d2b89f3ed7ed194cec4/users/c359d29efa1b4884a3f6d624a23ffaa6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:52.294140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5bedc-961b-4e84-82f2-79230af2ffe7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.294567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5bedc-961b-4e84-82f2-79230af2ffe7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.294947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5bedc-961b-4e84-82f2-79230af2ffe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.313174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c4b19-521e-4085-9a18-e1638c2fc270 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:52.392992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a1a5bedc-961b-4e84-82f2-79230af2ffe7 None None] MFA Rules not processed for user `c359d29efa1b4884a3f6d624a23ffaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:52.394211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a1a5bedc-961b-4e84-82f2-79230af2ffe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:52.495839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ef23d-b037-4af0-9883-73ea62184e59 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:52.496534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ef23d-b037-4af0-9883-73ea62184e59 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.496901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ef23d-b037-4af0-9883-73ea62184e59 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.497468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ef23d-b037-4af0-9883-73ea62184e59 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.502577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ef23d-b037-4af0-9883-73ea62184e59 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:52.506954 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3069/6084] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:09:52.508607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5bedc-961b-4e84-82f2-79230af2ffe7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:52.511559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a1a5bedc-961b-4e84-82f2-79230af2ffe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:52.523156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ef23d-b037-4af0-9883-73ea62184e59 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:52.607615 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3016/6085] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:52 2022] POST /identity/v3/projects => generated 351 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:52.608793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ef23d-b037-4af0-9883-73ea62184e59 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:52.670296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5bedc-961b-4e84-82f2-79230af2ffe7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:52.704172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ef23d-b037-4af0-9883-73ea62184e59 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:52.723283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf721b7-fd71-4456-bcfc-e6fa35fa2a54 tempest-IdentityCatalogTest-51107373 tempest-IdentityCatalogTest-51107373-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c359d29efa1b4884a3f6d624a23ffaa6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfe26a7857f84d2b89f3ed7ed194cec4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:52.724046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf721b7-fd71-4456-bcfc-e6fa35fa2a54 tempest-IdentityCatalogTest-51107373 tempest-IdentityCatalogTest-51107373-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.724336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf721b7-fd71-4456-bcfc-e6fa35fa2a54 tempest-IdentityCatalogTest-51107373 tempest-IdentityCatalogTest-51107373-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.724615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf721b7-fd71-4456-bcfc-e6fa35fa2a54 tempest-IdentityCatalogTest-51107373 tempest-IdentityCatalogTest-51107373-project] PATH_INFO: `/v3/auth/catalog` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.725274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf721b7-fd71-4456-bcfc-e6fa35fa2a54 tempest-IdentityCatalogTest-51107373 tempest-IdentityCatalogTest-51107373-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:52.726527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf721b7-fd71-4456-bcfc-e6fa35fa2a54 tempest-IdentityCatalogTest-51107373 tempest-IdentityCatalogTest-51107373-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:52.733471 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3017/6086] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 21:09:52 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:52.734325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf721b7-fd71-4456-bcfc-e6fa35fa2a54 tempest-IdentityCatalogTest-51107373 tempest-IdentityCatalogTest-51107373-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:52.766806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6ead-31d7-4f1f-8dd0-56406c0af948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:52.767722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6ead-31d7-4f1f-8dd0-56406c0af948 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.768223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6ead-31d7-4f1f-8dd0-56406c0af948 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.768813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6ead-31d7-4f1f-8dd0-56406c0af948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.777207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-deff6ead-31d7-4f1f-8dd0-56406c0af948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:52.789970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff6ead-31d7-4f1f-8dd0-56406c0af948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:52.791877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff6ead-31d7-4f1f-8dd0-56406c0af948 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:52.805930 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3070/6087] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:52.807684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5ac90-a3bb-4135-8a1a-cfc2f5da9478 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.808201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5ac90-a3bb-4135-8a1a-cfc2f5da9478 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.808633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5ac90-a3bb-4135-8a1a-cfc2f5da9478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.817786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf721b7-fd71-4456-bcfc-e6fa35fa2a54 tempest-IdentityCatalogTest-51107373 tempest-IdentityCatalogTest-51107373-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:52.823218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf464be8-fe05-4a8c-834a-963cf08b2c9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:52.823877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf464be8-fe05-4a8c-834a-963cf08b2c9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.824209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf464be8-fe05-4a8c-834a-963cf08b2c9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.824490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf464be8-fe05-4a8c-834a-963cf08b2c9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.825179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf464be8-fe05-4a8c-834a-963cf08b2c9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:52.827222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf464be8-fe05-4a8c-834a-963cf08b2c9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:52.845659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3ed5ac90-a3bb-4135-8a1a-cfc2f5da9478 None None] MFA Rules not processed for user `da090da7f121431abd13c9d9f0c71bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:52.846964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3ed5ac90-a3bb-4135-8a1a-cfc2f5da9478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:52.879756 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3018/6088] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:52 2022] POST /identity/v3/projects => generated 351 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:52.882440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf464be8-fe05-4a8c-834a-963cf08b2c9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:52.927929 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3071/6089] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:52.929680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d911c-53be-4ee5-9fb0-4f203302b283 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:52.931850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d911c-53be-4ee5-9fb0-4f203302b283 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:52.932375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d911c-53be-4ee5-9fb0-4f203302b283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:52.971289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-314d911c-53be-4ee5-9fb0-4f203302b283 None None] MFA Rules not processed for user `54a09bedd0ad4328b1e687fc5f7e3967`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:52.973141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-314d911c-53be-4ee5-9fb0-4f203302b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:53.020235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf464be8-fe05-4a8c-834a-963cf08b2c9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.025885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.026863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.027373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.027746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] PATH_INFO: `/v3/users/c359d29efa1b4884a3f6d624a23ffaa6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.029283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c359d29efa1b4884a3f6d624a23ffaa6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.032307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.064375 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3072/6090] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:53.065501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d911c-53be-4ee5-9fb0-4f203302b283 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.102430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c359d29efa1b4884a3f6d624a23ffaa6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:53.114296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c359d29efa1b4884a3f6d624a23ffaa6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:53.115293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c359d29efa1b4884a3f6d624a23ffaa6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:53.116576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c359d29efa1b4884a3f6d624a23ffaa6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:53.136222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d911c-53be-4ee5-9fb0-4f203302b283 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.138915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c359d29efa1b4884a3f6d624a23ffaa6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:53.142515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bae31e-104e-4169-8f70-09d38de6b99e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.144019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bae31e-104e-4169-8f70-09d38de6b99e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.144465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bae31e-104e-4169-8f70-09d38de6b99e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.144896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bae31e-104e-4169-8f70-09d38de6b99e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/users/545dd68b6a0e4097bc4d6270cd1baad2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.146982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bae31e-104e-4169-8f70-09d38de6b99e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:get_user(user_id=545dd68b6a0e4097bc4d6270cd1baad2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.152021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bae31e-104e-4169-8f70-09d38de6b99e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.152021 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3073/6091] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:09:53 2022] GET /identity/v3/users/545dd68b6a0e4097bc4d6270cd1baad2 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:53.156589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bae31e-104e-4169-8f70-09d38de6b99e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.158508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65bae31e-104e-4169-8f70-09d38de6b99e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:53.161308 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3019/6092] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:52 2022] DELETE /identity/v3/users/c359d29efa1b4884a3f6d624a23ffaa6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:53.162686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.165202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:53.248485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2750d-2340-4f13-ba9a-c89a3a0e8f5d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.255354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e849c-b7ba-4fe7-ad6c-8a4cb9b52bbc tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.256582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e849c-b7ba-4fe7-ad6c-8a4cb9b52bbc tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.257031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e849c-b7ba-4fe7-ad6c-8a4cb9b52bbc tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.257175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bae31e-104e-4169-8f70-09d38de6b99e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.257598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e849c-b7ba-4fe7-ad6c-8a4cb9b52bbc tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.258555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e849c-b7ba-4fe7-ad6c-8a4cb9b52bbc tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.261096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e849c-b7ba-4fe7-ad6c-8a4cb9b52bbc tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.311898 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3020/6093] 10.222.0.16 () {60 vars in 1161 bytes} [Sat Mar 26 21:09:53 2022] POST /identity/v3/credentials => generated 431 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:53.313729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7cd8b-326c-4bb5-87fe-ea98f6ec7e19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.314307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eadff-ad19-4aac-aca5-b657856260f5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.314656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eadff-ad19-4aac-aca5-b657856260f5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.314889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71eadff-ad19-4aac-aca5-b657856260f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.315221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7cd8b-326c-4bb5-87fe-ea98f6ec7e19 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.316487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7cd8b-326c-4bb5-87fe-ea98f6ec7e19 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.316975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7cd8b-326c-4bb5-87fe-ea98f6ec7e19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.319063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-85a7cd8b-326c-4bb5-87fe-ea98f6ec7e19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:53.338324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d71eadff-ad19-4aac-aca5-b657856260f5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:53.340252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d71eadff-ad19-4aac-aca5-b657856260f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:53.390810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7cd8b-326c-4bb5-87fe-ea98f6ec7e19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.392658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7cd8b-326c-4bb5-87fe-ea98f6ec7e19 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.407285 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3074/6094] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:53.408616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7cd8b-326c-4bb5-87fe-ea98f6ec7e19 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.418816 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3021/6095] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:53.421497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7cd8b-326c-4bb5-87fe-ea98f6ec7e19 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.426115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eadff-ad19-4aac-aca5-b657856260f5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.427522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d71eadff-ad19-4aac-aca5-b657856260f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:53.428525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.429499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.429789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.430066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/credentials/7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.433243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.435140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.438861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.440507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.463909 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3075/6096] 10.222.0.16 () {60 vars in 1357 bytes} [Sat Mar 26 21:09:53 2022] PATCH /identity/v3/credentials/7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e => generated 437 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:53.468399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.489137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc961ee-6669-4531-b3c0-4509cc421e6f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.502800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0866e01-965f-470c-ab7f-1b0dbf94afe0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.505800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866e01-965f-470c-ab7f-1b0dbf94afe0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.509076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866e01-965f-470c-ab7f-1b0dbf94afe0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.509654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0866e01-965f-470c-ab7f-1b0dbf94afe0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/credentials/7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.514981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0866e01-965f-470c-ab7f-1b0dbf94afe0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.521953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0866e01-965f-470c-ab7f-1b0dbf94afe0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.531195 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3076/6097] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Mar 26 21:09:53 2022] GET /identity/v3/credentials/7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e => generated 437 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:09:53.533580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0866e01-965f-470c-ab7f-1b0dbf94afe0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.559976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0866e01-965f-470c-ab7f-1b0dbf94afe0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.575671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198d515-5402-470a-b024-8102185755a0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.576774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71eadff-ad19-4aac-aca5-b657856260f5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.577384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198d515-5402-470a-b024-8102185755a0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.579374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198d515-5402-470a-b024-8102185755a0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.580238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198d515-5402-470a-b024-8102185755a0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/credentials/7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.583631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198d515-5402-470a-b024-8102185755a0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.586450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198d515-5402-470a-b024-8102185755a0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.588139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff4c18-31c5-4202-abb3-38008035d88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.589049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff4c18-31c5-4202-abb3-38008035d88d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.589294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff4c18-31c5-4202-abb3-38008035d88d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.589581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff4c18-31c5-4202-abb3-38008035d88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.610790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff4c18-31c5-4202-abb3-38008035d88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.617618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff4c18-31c5-4202-abb3-38008035d88d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.631412 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3077/6098] 10.222.0.16 () {58 vars in 1337 bytes} [Sat Mar 26 21:09:53 2022] DELETE /identity/v3/credentials/7e0fc11b72059a4fbf9bc687550f75c56b16ab9910448eca3c6251d27126821e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:53.637754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198d515-5402-470a-b024-8102185755a0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.650057 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3022/6099] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:09:53.654529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198d515-5402-470a-b024-8102185755a0 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.662615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02373f0-119f-4602-a795-bbcd8e78341b tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.663412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02373f0-119f-4602-a795-bbcd8e78341b tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.663826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02373f0-119f-4602-a795-bbcd8e78341b tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.664180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02373f0-119f-4602-a795-bbcd8e78341b tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.665542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02373f0-119f-4602-a795-bbcd8e78341b tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.667796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02373f0-119f-4602-a795-bbcd8e78341b tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.701193 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3078/6100] 10.222.0.16 () {60 vars in 1161 bytes} [Sat Mar 26 21:09:53 2022] POST /identity/v3/credentials => generated 431 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:53.701388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff4c18-31c5-4202-abb3-38008035d88d service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.722694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff4c18-31c5-4202-abb3-38008035d88d service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.735089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9521c5b-38af-4da0-831a-e079aa9e7fcd tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.736226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521c5b-38af-4da0-831a-e079aa9e7fcd tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.740417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521c5b-38af-4da0-831a-e079aa9e7fcd tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.740794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9521c5b-38af-4da0-831a-e079aa9e7fcd tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.741608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9521c5b-38af-4da0-831a-e079aa9e7fcd tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.743629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9521c5b-38af-4da0-831a-e079aa9e7fcd tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.789100 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3023/6101] 10.222.0.16 () {60 vars in 1161 bytes} [Sat Mar 26 21:09:53 2022] POST /identity/v3/credentials => generated 431 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:09:53.791135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02373f0-119f-4602-a795-bbcd8e78341b tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.814761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02373f0-119f-4602-a795-bbcd8e78341b tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.837458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.838324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.838613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.838891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/credentials` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.839577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.841204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.860961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.863339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.867277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.869374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.874513 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3079/6102] 10.222.0.16 () {58 vars in 1139 bytes} [Sat Mar 26 21:09:53 2022] GET /identity/v3/credentials => generated 947 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:53.876512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9521c5b-38af-4da0-831a-e079aa9e7fcd tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.895531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9521c5b-38af-4da0-831a-e079aa9e7fcd tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.911326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea14021-e2b9-4565-a14d-8320ab9d8656 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.913287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea14021-e2b9-4565-a14d-8320ab9d8656 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.914157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea14021-e2b9-4565-a14d-8320ab9d8656 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.914737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea14021-e2b9-4565-a14d-8320ab9d8656 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/credentials/df8e09babb7cfc25bcc1b9a35887c94370199df64cd1db4a1a761fa1fbfbbf54` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.920443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea14021-e2b9-4565-a14d-8320ab9d8656 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=df8e09babb7cfc25bcc1b9a35887c94370199df64cd1db4a1a761fa1fbfbbf54)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.924794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea14021-e2b9-4565-a14d-8320ab9d8656 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:53.963548 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3024/6103] 10.222.0.16 () {58 vars in 1337 bytes} [Sat Mar 26 21:09:53 2022] DELETE /identity/v3/credentials/df8e09babb7cfc25bcc1b9a35887c94370199df64cd1db4a1a761fa1fbfbbf54 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:53.964363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:53.977692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d152a3-0b35-4c60-890d-bfa904c08daf tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:53.992720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fd0f-a65a-480a-92b1-8f7259b47e37 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:53.993653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fd0f-a65a-480a-92b1-8f7259b47e37 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:53.994168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fd0f-a65a-480a-92b1-8f7259b47e37 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:53.994464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81fd0f-a65a-480a-92b1-8f7259b47e37 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/credentials/f137188d52e3f22795ee817cb5e4fbf6f1273bf069b8fc04ff2bee9c1fa8c074` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:53.997193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81fd0f-a65a-480a-92b1-8f7259b47e37 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=f137188d52e3f22795ee817cb5e4fbf6f1273bf069b8fc04ff2bee9c1fa8c074)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:53.998973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81fd0f-a65a-480a-92b1-8f7259b47e37 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:54.039092 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3080/6104] 10.222.0.16 () {58 vars in 1337 bytes} [Sat Mar 26 21:09:53 2022] DELETE /identity/v3/credentials/f137188d52e3f22795ee817cb5e4fbf6f1273bf069b8fc04ff2bee9c1fa8c074 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:54.044679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea14021-e2b9-4565-a14d-8320ab9d8656 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:54.061389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea14021-e2b9-4565-a14d-8320ab9d8656 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:54.070401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:54.081537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:54.081899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:54.083038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/projects/9b7213fbfca44492ac6144b846f4ff87` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:54.088103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b7213fbfca44492ac6144b846f4ff87)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:54.095686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:54.227792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7213fbfca44492ac6144b846f4ff87', 'request_id': 'req-14297b27-57eb-4974-b1be-dfd3ab284c1f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.251290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7213fbfca44492ac6144b846f4ff87', 'request_id': 'req-14297b27-57eb-4974-b1be-dfd3ab284c1f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.266997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7213fbfca44492ac6144b846f4ff87', 'request_id': 'req-14297b27-57eb-4974-b1be-dfd3ab284c1f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.301573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] The token cache is being invalidate because project 9b7213fbfca44492ac6144b846f4ff87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:54.301913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.302612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.304768 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3025/6105] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:54 2022] DELETE /identity/v3/projects/9b7213fbfca44492ac6144b846f4ff87 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:54.308769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fd0f-a65a-480a-92b1-8f7259b47e37 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:54.315816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4f81fd0f-a65a-480a-92b1-8f7259b47e37 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:54.344378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81fd0f-a65a-480a-92b1-8f7259b47e37 tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:54.443972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:54.445689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:54.526038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6765baed04e4b52b4b19aa3c399e1bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06d340c85d3f4ef6bc5d273f0759cc11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:54.527160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:54.527655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:54.528930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] PATH_INFO: `/v3/projects/55c65e77ae334ffcbdc4a07a49a9e8c5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:54.534318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorizing `identity:delete_project(project_id=55c65e77ae334ffcbdc4a07a49a9e8c5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:54.537871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:54.582680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14297b27-57eb-4974-b1be-dfd3ab284c1f tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:54.598907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:54.603127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:54.604482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:54.604917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] PATH_INFO: `/v3/projects/dfe26a7857f84d2b89f3ed7ed194cec4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:54.607455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe26a7857f84d2b89f3ed7ed194cec4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:54.618021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:54.706540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c65e77ae334ffcbdc4a07a49a9e8c5', 'request_id': 'req-8140c672-de25-4a4f-9ad1-94767d86af9e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.731579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c65e77ae334ffcbdc4a07a49a9e8c5', 'request_id': 'req-8140c672-de25-4a4f-9ad1-94767d86af9e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.740023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c65e77ae334ffcbdc4a07a49a9e8c5', 'request_id': 'req-8140c672-de25-4a4f-9ad1-94767d86af9e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.758396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] The token cache is being invalidate because project 55c65e77ae334ffcbdc4a07a49a9e8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:54.758726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.759794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.762549 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3081/6106] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:54 2022] DELETE /identity/v3/projects/55c65e77ae334ffcbdc4a07a49a9e8c5 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:54.767473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:54.769910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:54.774691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe26a7857f84d2b89f3ed7ed194cec4', 'request_id': 'req-240750b9-cfa4-4b48-985a-ad92fd14e8fc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.796158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe26a7857f84d2b89f3ed7ed194cec4', 'request_id': 'req-240750b9-cfa4-4b48-985a-ad92fd14e8fc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.823952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe26a7857f84d2b89f3ed7ed194cec4', 'request_id': 'req-240750b9-cfa4-4b48-985a-ad92fd14e8fc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.883663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] The token cache is being invalidate because project dfe26a7857f84d2b89f3ed7ed194cec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:54.883663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.883663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-240750b9-cfa4-4b48-985a-ad92fd14e8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:54.888244 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3026/6107] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:54 2022] DELETE /identity/v3/projects/dfe26a7857f84d2b89f3ed7ed194cec4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:54.891167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9580-c122-4d61-8924-a60c295743bf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:54.891463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9580-c122-4d61-8924-a60c295743bf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:54.891747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9580-c122-4d61-8924-a60c295743bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:54.958033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ec0a9580-c122-4d61-8924-a60c295743bf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:54.975619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ec0a9580-c122-4d61-8924-a60c295743bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:55.038531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140c672-de25-4a4f-9ad1-94767d86af9e tempest-CredentialsTestJSON-780923311 tempest-CredentialsTestJSON-780923311-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:55.129090 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3027/6108] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:55.137112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e60cd-e243-4c08-9748-b318b679d0c8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.137408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e60cd-e243-4c08-9748-b318b679d0c8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.137837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e60cd-e243-4c08-9748-b318b679d0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.197873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f26e60cd-e243-4c08-9748-b318b679d0c8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:55.199528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f26e60cd-e243-4c08-9748-b318b679d0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:55.259580 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3028/6109] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:55.269013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e60cd-e243-4c08-9748-b318b679d0c8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:55.283447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:55.286172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.286464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.291143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] PATH_INFO: `/v3/users/545dd68b6a0e4097bc4d6270cd1baad2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.292876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545dd68b6a0e4097bc4d6270cd1baad2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:55.295829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e60cd-e243-4c08-9748-b318b679d0c8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:55.297718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:55.309450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189051-a156-4b89-8f93-f76076b8e800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:55.309450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189051-a156-4b89-8f93-f76076b8e800 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.309450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189051-a156-4b89-8f93-f76076b8e800 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.309890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25189051-a156-4b89-8f93-f76076b8e800 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.310436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25189051-a156-4b89-8f93-f76076b8e800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:55.310748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25189051-a156-4b89-8f93-f76076b8e800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:55.314585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25189051-a156-4b89-8f93-f76076b8e800 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:55.360672 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3029/6110] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:55.362203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189051-a156-4b89-8f93-f76076b8e800 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:55.393916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25189051-a156-4b89-8f93-f76076b8e800 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:55.407798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a54a48-fc22-4b2a-9c2a-46dd3a515dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:55.408510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a54a48-fc22-4b2a-9c2a-46dd3a515dee admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.408933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a54a48-fc22-4b2a-9c2a-46dd3a515dee admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.409226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a54a48-fc22-4b2a-9c2a-46dd3a515dee admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.409929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a54a48-fc22-4b2a-9c2a-46dd3a515dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:55.415664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a54a48-fc22-4b2a-9c2a-46dd3a515dee admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:55.451502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545dd68b6a0e4097bc4d6270cd1baad2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:55.475695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545dd68b6a0e4097bc4d6270cd1baad2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:55.478979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545dd68b6a0e4097bc4d6270cd1baad2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:55.479822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545dd68b6a0e4097bc4d6270cd1baad2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:55.498313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a5cb63b1-b9ca-443c-b065-ea5b33414e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545dd68b6a0e4097bc4d6270cd1baad2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:55.522521 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3030/6111] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:55 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:55.524616 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3082/6112] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:54 2022] DELETE /identity/v3/users/545dd68b6a0e4097bc4d6270cd1baad2 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:55.525034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a54a48-fc22-4b2a-9c2a-46dd3a515dee admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:55.529306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9a3f-f6f7-487e-a15f-f934ec87e653 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.529865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9a3f-f6f7-487e-a15f-f934ec87e653 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.529973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-53a54a48-fc22-4b2a-9c2a-46dd3a515dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:55.530066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff9a3f-f6f7-487e-a15f-f934ec87e653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.593622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1fff9a3f-f6f7-487e-a15f-f934ec87e653 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:55.599321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1fff9a3f-f6f7-487e-a15f-f934ec87e653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:55.701418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a54a48-fc22-4b2a-9c2a-46dd3a515dee admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:55.740467 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3083/6113] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:55.748077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9a3f-f6f7-487e-a15f-f934ec87e653 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:55.749949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1fff9a3f-f6f7-487e-a15f-f934ec87e653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:55.780195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15338-245a-41b0-bbfa-ab975bb7854c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:55.781991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15338-245a-41b0-bbfa-ab975bb7854c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.781991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15338-245a-41b0-bbfa-ab975bb7854c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.781991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15338-245a-41b0-bbfa-ab975bb7854c admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.782881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a15338-245a-41b0-bbfa-ab975bb7854c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:55.785003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a15338-245a-41b0-bbfa-ab975bb7854c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:55.813230 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3031/6114] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:55 2022] POST /identity/v3/users => generated 285 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:55.814226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15338-245a-41b0-bbfa-ab975bb7854c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:55.824652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15338-245a-41b0-bbfa-ab975bb7854c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:55.830353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a6c9-12a8-42bb-b0d7-4e232834a687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:55.831233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a6c9-12a8-42bb-b0d7-4e232834a687 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.831613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a6c9-12a8-42bb-b0d7-4e232834a687 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.832115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a6c9-12a8-42bb-b0d7-4e232834a687 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.832948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2a6c9-12a8-42bb-b0d7-4e232834a687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:55.835908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2a6c9-12a8-42bb-b0d7-4e232834a687 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:55.847197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff9a3f-f6f7-487e-a15f-f934ec87e653 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:55.852810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16d7d0-f08e-4944-9a13-5ca5efb29c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:55.857389 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3032/6115] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:55.857616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16d7d0-f08e-4944-9a13-5ca5efb29c15 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.857616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16d7d0-f08e-4944-9a13-5ca5efb29c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.857616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16d7d0-f08e-4944-9a13-5ca5efb29c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.860252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a6c9-12a8-42bb-b0d7-4e232834a687 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:55.873613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16d7d0-f08e-4944-9a13-5ca5efb29c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:55.875857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16d7d0-f08e-4944-9a13-5ca5efb29c15 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:55.882311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a6c9-12a8-42bb-b0d7-4e232834a687 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:55.887802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711af1b-f72e-46bd-9101-78edd8d449b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:55.888737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711af1b-f72e-46bd-9101-78edd8d449b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.889246 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3084/6116] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:09:55.889687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711af1b-f72e-46bd-9101-78edd8d449b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.890682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711af1b-f72e-46bd-9101-78edd8d449b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.891952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711af1b-f72e-46bd-9101-78edd8d449b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:55.893805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711af1b-f72e-46bd-9101-78edd8d449b8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:55.909213 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3033/6117] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:55.913480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16d7d0-f08e-4944-9a13-5ca5efb29c15 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:55.928181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16d7d0-f08e-4944-9a13-5ca5efb29c15 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:55.938885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef61e83-8cde-4cd0-bf90-5c2e0ab578f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:55.940615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef61e83-8cde-4cd0-bf90-5c2e0ab578f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:55.941052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef61e83-8cde-4cd0-bf90-5c2e0ab578f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:55.941624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef61e83-8cde-4cd0-bf90-5c2e0ab578f9 admin admin] PATH_INFO: `/v3/projects/29129873213241ffb4a419c139b5d326/users/89b6da3b73af4fc392caab00e76fc855/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:55.974791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef61e83-8cde-4cd0-bf90-5c2e0ab578f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29129873213241ffb4a419c139b5d326, user_id=89b6da3b73af4fc392caab00e76fc855, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:55.979504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef61e83-8cde-4cd0-bf90-5c2e0ab578f9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.005576 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3085/6118] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:55 2022] PUT /identity/v3/projects/29129873213241ffb4a419c139b5d326/users/89b6da3b73af4fc392caab00e76fc855/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:56.016500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1fb40-b052-4113-83d1-0b3fac2fd322 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.016871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1fb40-b052-4113-83d1-0b3fac2fd322 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.017150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1fb40-b052-4113-83d1-0b3fac2fd322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.077133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-90b1fb40-b052-4113-83d1-0b3fac2fd322 None None] MFA Rules not processed for user `89b6da3b73af4fc392caab00e76fc855`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:56.093987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-90b1fb40-b052-4113-83d1-0b3fac2fd322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:56.204202 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3034/6119] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:56.205784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef61e83-8cde-4cd0-bf90-5c2e0ab578f9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.231895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef61e83-8cde-4cd0-bf90-5c2e0ab578f9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.244068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76e7ac-f313-4257-9a9a-afb6c3388fbd tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.245432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76e7ac-f313-4257-9a9a-afb6c3388fbd tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.247395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76e7ac-f313-4257-9a9a-afb6c3388fbd tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.248034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76e7ac-f313-4257-9a9a-afb6c3388fbd tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.249771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76e7ac-f313-4257-9a9a-afb6c3388fbd tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=89b6da3b73af4fc392caab00e76fc855)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:56.253693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76e7ac-f313-4257-9a9a-afb6c3388fbd tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.285106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1fb40-b052-4113-83d1-0b3fac2fd322 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.286553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-90b1fb40-b052-4113-83d1-0b3fac2fd322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:56.302619 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3086/6120] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Mar 26 21:09:56 2022] POST /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2 => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:56.305669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76e7ac-f313-4257-9a9a-afb6c3388fbd tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.318059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76e7ac-f313-4257-9a9a-afb6c3388fbd tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.337762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7ba60-84c7-4a75-a02c-c7fc0e4641e0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.338592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7ba60-84c7-4a75-a02c-c7fc0e4641e0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.338877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7ba60-84c7-4a75-a02c-c7fc0e4641e0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.339161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7ba60-84c7-4a75-a02c-c7fc0e4641e0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/9ba120d24c9b413dbfee5736d1e958d3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.341282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7ba60-84c7-4a75-a02c-c7fc0e4641e0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=89b6da3b73af4fc392caab00e76fc855, credential_id=9ba120d24c9b413dbfee5736d1e958d3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:56.342747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf7ba60-84c7-4a75-a02c-c7fc0e4641e0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.378551 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3087/6121] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Mar 26 21:09:56 2022] DELETE /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/9ba120d24c9b413dbfee5736d1e958d3 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:56.380534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7ba60-84c7-4a75-a02c-c7fc0e4641e0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.401522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7ba60-84c7-4a75-a02c-c7fc0e4641e0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.412935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e775f5b-1145-475d-be34-b2491643992d tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.415740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e775f5b-1145-475d-be34-b2491643992d tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.418685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e775f5b-1145-475d-be34-b2491643992d tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.420196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e775f5b-1145-475d-be34-b2491643992d tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.421307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e775f5b-1145-475d-be34-b2491643992d tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=89b6da3b73af4fc392caab00e76fc855)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:56.425659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e775f5b-1145-475d-be34-b2491643992d tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.452059 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3088/6122] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Mar 26 21:09:56 2022] POST /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2 => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:56.456783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e775f5b-1145-475d-be34-b2491643992d tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.478453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e775f5b-1145-475d-be34-b2491643992d tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.489366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1fb40-b052-4113-83d1-0b3fac2fd322 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.490218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778e25-e8ce-43b2-a68d-ba8d78ddb80e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.494479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778e25-e8ce-43b2-a68d-ba8d78ddb80e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.495640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778e25-e8ce-43b2-a68d-ba8d78ddb80e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.508623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778e25-e8ce-43b2-a68d-ba8d78ddb80e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/45ee5aeb5be942458dec98048ece09e4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.517886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57778e25-e8ce-43b2-a68d-ba8d78ddb80e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=89b6da3b73af4fc392caab00e76fc855, credential_id=45ee5aeb5be942458dec98048ece09e4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:56.519380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57778e25-e8ce-43b2-a68d-ba8d78ddb80e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.520599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.526658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.528342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.529546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] PATH_INFO: `/v3/projects/07cc114d541b4309ac532e6490907780` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.534595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=07cc114d541b4309ac532e6490907780)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:56.539857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.552089 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3089/6123] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Mar 26 21:09:56 2022] DELETE /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/45ee5aeb5be942458dec98048ece09e4 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:56.553562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778e25-e8ce-43b2-a68d-ba8d78ddb80e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.568644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778e25-e8ce-43b2-a68d-ba8d78ddb80e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.590472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6e683-35bb-47a7-8cf6-4dcd4b6c98b3 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.591348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e683-35bb-47a7-8cf6-4dcd4b6c98b3 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.591832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e683-35bb-47a7-8cf6-4dcd4b6c98b3 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.592289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e683-35bb-47a7-8cf6-4dcd4b6c98b3 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/45ee5aeb5be942458dec98048ece09e4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.613175 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-96b6e683-35bb-47a7-8cf6-4dcd4b6c98b3 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Could not find credential: 1e619221d4c98c10e345e10e5a01253dc913448345cbeefc002a832997635b56.: keystone.exception.CredentialNotFound: Could not find credential: 1e619221d4c98c10e345e10e5a01253dc913448345cbeefc002a832997635b56. Mar 26 21:09:56.614492 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3090/6124] 10.222.0.16 () {58 vars in 1376 bytes} [Sat Mar 26 21:09:56 2022] GET /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/45ee5aeb5be942458dec98048ece09e4 => generated 148 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:09:56.635101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07cc114d541b4309ac532e6490907780', 'request_id': 'req-3922f568-4785-4696-8a46-869281ac0deb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:56.636014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6e683-35bb-47a7-8cf6-4dcd4b6c98b3 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.648478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6e683-35bb-47a7-8cf6-4dcd4b6c98b3 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.649561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07cc114d541b4309ac532e6490907780', 'request_id': 'req-3922f568-4785-4696-8a46-869281ac0deb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:56.659212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07cc114d541b4309ac532e6490907780', 'request_id': 'req-3922f568-4785-4696-8a46-869281ac0deb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:56.716217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] The token cache is being invalidate because project 07cc114d541b4309ac532e6490907780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:56.716799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:56.718574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:56.721669 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3035/6125] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:56 2022] DELETE /identity/v3/projects/07cc114d541b4309ac532e6490907780 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:56.727250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.731668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:56.768152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b122-2aa1-431e-9cb5-a8fc773fe838 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.769197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b122-2aa1-431e-9cb5-a8fc773fe838 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.769578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b122-2aa1-431e-9cb5-a8fc773fe838 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.770650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b122-2aa1-431e-9cb5-a8fc773fe838 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.771452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9b122-2aa1-431e-9cb5-a8fc773fe838 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=89b6da3b73af4fc392caab00e76fc855)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:56.773479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9b122-2aa1-431e-9cb5-a8fc773fe838 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.825368 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3091/6126] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Mar 26 21:09:56 2022] POST /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2 => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:56.833928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b122-2aa1-431e-9cb5-a8fc773fe838 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.838436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9cb9b122-2aa1-431e-9cb5-a8fc773fe838 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:56.861840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b122-2aa1-431e-9cb5-a8fc773fe838 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.868565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34087846-a6c6-450e-8400-85f5152aab89 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.869687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087846-a6c6-450e-8400-85f5152aab89 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.870272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087846-a6c6-450e-8400-85f5152aab89 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.870661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34087846-a6c6-450e-8400-85f5152aab89 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.870915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922f568-4785-4696-8a46-869281ac0deb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.871609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34087846-a6c6-450e-8400-85f5152aab89 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=89b6da3b73af4fc392caab00e76fc855)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:56.874210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34087846-a6c6-450e-8400-85f5152aab89 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.883302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.884775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.885020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.887330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] PATH_INFO: `/v3/users/a6765baed04e4b52b4b19aa3c399e1bd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.889667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6765baed04e4b52b4b19aa3c399e1bd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:56.896246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.904539 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3092/6127] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Mar 26 21:09:56 2022] POST /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2 => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:56.907191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34087846-a6c6-450e-8400-85f5152aab89 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:56.928552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34087846-a6c6-450e-8400-85f5152aab89 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:56.936628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127f32f-2be3-491d-859d-2fb4c1bfee7e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:56.939199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127f32f-2be3-491d-859d-2fb4c1bfee7e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:56.939708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127f32f-2be3-491d-859d-2fb4c1bfee7e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:56.940545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127f32f-2be3-491d-859d-2fb4c1bfee7e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:56.941648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127f32f-2be3-491d-859d-2fb4c1bfee7e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=89b6da3b73af4fc392caab00e76fc855)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:56.944160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127f32f-2be3-491d-859d-2fb4c1bfee7e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:56.985090 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3093/6128] 10.222.0.16 () {58 vars in 1277 bytes} [Sat Mar 26 21:09:56 2022] GET /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2 => generated 865 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:56.990191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127f32f-2be3-491d-859d-2fb4c1bfee7e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:57.015130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6765baed04e4b52b4b19aa3c399e1bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.025186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127f32f-2be3-491d-859d-2fb4c1bfee7e tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:57.033804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6765baed04e4b52b4b19aa3c399e1bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.034436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6765baed04e4b52b4b19aa3c399e1bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.035058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6765baed04e4b52b4b19aa3c399e1bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.038444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fd102-79c9-49c5-913e-650444a0e4d6 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:57.039327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fd102-79c9-49c5-913e-650444a0e4d6 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:57.039612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fd102-79c9-49c5-913e-650444a0e4d6 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:57.040115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510fd102-79c9-49c5-913e-650444a0e4d6 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/8a8d67bc9d994a25b507fd25522ec98a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:57.048708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fd102-79c9-49c5-913e-650444a0e4d6 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=89b6da3b73af4fc392caab00e76fc855, credential_id=8a8d67bc9d994a25b507fd25522ec98a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:57.050424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510fd102-79c9-49c5-913e-650444a0e4d6 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:57.055630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6765baed04e4b52b4b19aa3c399e1bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.082433 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3036/6129] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:56 2022] DELETE /identity/v3/users/a6765baed04e4b52b4b19aa3c399e1bd => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:57.084695 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3094/6130] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Mar 26 21:09:56 2022] DELETE /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/8a8d67bc9d994a25b507fd25522ec98a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:57.097021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:57.100260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:57.186498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e152c7-28a3-47ac-ad04-37597d996c86 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:57.191332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f1636-ef01-44fb-8427-090f6cc83031 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:57.192302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f1636-ef01-44fb-8427-090f6cc83031 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:57.192590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f1636-ef01-44fb-8427-090f6cc83031 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:57.192872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f1636-ef01-44fb-8427-090f6cc83031 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/7c0c6d8075cc460ea70d1bffd131b83c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:57.195053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f1636-ef01-44fb-8427-090f6cc83031 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=89b6da3b73af4fc392caab00e76fc855, credential_id=7c0c6d8075cc460ea70d1bffd131b83c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:57.196719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f1636-ef01-44fb-8427-090f6cc83031 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:57.220589 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3037/6131] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Mar 26 21:09:57 2022] DELETE /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/7c0c6d8075cc460ea70d1bffd131b83c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:57.225330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fd102-79c9-49c5-913e-650444a0e4d6 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:57.236142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510fd102-79c9-49c5-913e-650444a0e4d6 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:57.243079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a15b-17ac-44db-907a-71d9ae3d1ea0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:57.244004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a15b-17ac-44db-907a-71d9ae3d1ea0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:57.244297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a15b-17ac-44db-907a-71d9ae3d1ea0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:57.244577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7a15b-17ac-44db-907a-71d9ae3d1ea0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:57.245312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a15b-17ac-44db-907a-71d9ae3d1ea0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=89b6da3b73af4fc392caab00e76fc855)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:57.247376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b7a15b-17ac-44db-907a-71d9ae3d1ea0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:57.280372 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3095/6132] 10.222.0.16 () {60 vars in 1298 bytes} [Sat Mar 26 21:09:57 2022] POST /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2 => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:57.281582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f1636-ef01-44fb-8427-090f6cc83031 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:57.291266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f1636-ef01-44fb-8427-090f6cc83031 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:57.295975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836c57-50bf-491e-b70b-2dd4d8faa017 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:57.297416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836c57-50bf-491e-b70b-2dd4d8faa017 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:57.297704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836c57-50bf-491e-b70b-2dd4d8faa017 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:57.297982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1836c57-50bf-491e-b70b-2dd4d8faa017 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/ba549214f6c44d0e829ee96538770c08` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:57.300258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1836c57-50bf-491e-b70b-2dd4d8faa017 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=89b6da3b73af4fc392caab00e76fc855, credential_id=ba549214f6c44d0e829ee96538770c08)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:57.301828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1836c57-50bf-491e-b70b-2dd4d8faa017 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:57.305198 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3038/6133] 10.222.0.16 () {58 vars in 1376 bytes} [Sat Mar 26 21:09:57 2022] GET /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/ba549214f6c44d0e829ee96538770c08 => generated 367 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:57.310246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a15b-17ac-44db-907a-71d9ae3d1ea0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:57.321801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7a15b-17ac-44db-907a-71d9ae3d1ea0 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:57.327257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de58d5a-3bf5-458f-9b04-cb3b7d947476 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89b6da3b73af4fc392caab00e76fc855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29129873213241ffb4a419c139b5d326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:57.328716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de58d5a-3bf5-458f-9b04-cb3b7d947476 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:57.329076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de58d5a-3bf5-458f-9b04-cb3b7d947476 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:57.329470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de58d5a-3bf5-458f-9b04-cb3b7d947476 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/ba549214f6c44d0e829ee96538770c08` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:57.332497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de58d5a-3bf5-458f-9b04-cb3b7d947476 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=89b6da3b73af4fc392caab00e76fc855, credential_id=ba549214f6c44d0e829ee96538770c08)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:57.334411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de58d5a-3bf5-458f-9b04-cb3b7d947476 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:57.360870 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3096/6134] 10.222.0.16 () {58 vars in 1379 bytes} [Sat Mar 26 21:09:57 2022] DELETE /identity/v3/users/89b6da3b73af4fc392caab00e76fc855/credentials/OS-EC2/ba549214f6c44d0e829ee96538770c08 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:57.365670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836c57-50bf-491e-b70b-2dd4d8faa017 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:57.367638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e1836c57-50bf-491e-b70b-2dd4d8faa017 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:57.515469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1836c57-50bf-491e-b70b-2dd4d8faa017 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:57.523072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:57.524083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:57.524433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:57.524787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] PATH_INFO: `/v3/users/89b6da3b73af4fc392caab00e76fc855` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:57.526157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b6da3b73af4fc392caab00e76fc855)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:57.530636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:57.619654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b6da3b73af4fc392caab00e76fc855'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.635594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de58d5a-3bf5-458f-9b04-cb3b7d947476 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:57.638527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8de58d5a-3bf5-458f-9b04-cb3b7d947476 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:57.649291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b6da3b73af4fc392caab00e76fc855'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.650167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b6da3b73af4fc392caab00e76fc855'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.651112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b6da3b73af4fc392caab00e76fc855'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.674677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de58d5a-3bf5-458f-9b04-cb3b7d947476 tempest-EC2CredentialsTest-50524302 tempest-EC2CredentialsTest-50524302-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:57.679348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e2b1d37-d56e-4023-b1d9-9153a7d212d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b6da3b73af4fc392caab00e76fc855'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.690186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:57.694454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:57.695398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:57.697484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] PATH_INFO: `/v3/projects/06d340c85d3f4ef6bc5d273f0759cc11` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:57.704712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3039/6135] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:09:57 2022] DELETE /identity/v3/users/89b6da3b73af4fc392caab00e76fc855 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:57.712849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8e6c6-5428-447e-954f-2d5e837f9978 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:57.713336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8e6c6-5428-447e-954f-2d5e837f9978 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:57.713336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8e6c6-5428-447e-954f-2d5e837f9978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:57.716013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d340c85d3f4ef6bc5d273f0759cc11)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:57.721634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:57.756094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-98e8e6c6-5428-447e-954f-2d5e837f9978 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:57.757604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-98e8e6c6-5428-447e-954f-2d5e837f9978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:57.846341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d340c85d3f4ef6bc5d273f0759cc11', 'request_id': 'req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.869441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d340c85d3f4ef6bc5d273f0759cc11', 'request_id': 'req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.883984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d340c85d3f4ef6bc5d273f0759cc11', 'request_id': 'req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.917545 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3040/6136] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:57.931634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8e6c6-5428-447e-954f-2d5e837f9978 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:57.933653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-98e8e6c6-5428-447e-954f-2d5e837f9978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:57.935083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] The token cache is being invalidate because project 06d340c85d3f4ef6bc5d273f0759cc11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:57.936752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.939577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4e873dff-d07f-4d45-8f56-cc7b3a223ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:57.944890 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3097/6137] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:57 2022] DELETE /identity/v3/projects/06d340c85d3f4ef6bc5d273f0759cc11 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:57.949344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616aae3-0e68-4be5-9273-40dc1e0aa7c0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:57.949872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616aae3-0e68-4be5-9273-40dc1e0aa7c0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:57.950585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616aae3-0e68-4be5-9273-40dc1e0aa7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:57.995858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4616aae3-0e68-4be5-9273-40dc1e0aa7c0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:57.997750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4616aae3-0e68-4be5-9273-40dc1e0aa7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:58.050416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8e6c6-5428-447e-954f-2d5e837f9978 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:58.083888 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3098/6138] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:58.092075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc12042-3585-44bf-a910-22608c031bd8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.092679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc12042-3585-44bf-a910-22608c031bd8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.093679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc12042-3585-44bf-a910-22608c031bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.126297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcb45e-442e-4df3-b0bb-a4c3b0f34866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:58.126906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2dc12042-3585-44bf-a910-22608c031bd8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:58.127070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb45e-442e-4df3-b0bb-a4c3b0f34866 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.127244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb45e-442e-4df3-b0bb-a4c3b0f34866 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.127520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcb45e-442e-4df3-b0bb-a4c3b0f34866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.129558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2dc12042-3585-44bf-a910-22608c031bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:58.131273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5ebcb45e-442e-4df3-b0bb-a4c3b0f34866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:58.142954 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3099/6139] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:58.146720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc12042-3585-44bf-a910-22608c031bd8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:58.169409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcb45e-442e-4df3-b0bb-a4c3b0f34866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:58.174206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcb45e-442e-4df3-b0bb-a4c3b0f34866 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:58.180944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc12042-3585-44bf-a910-22608c031bd8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:58.189214 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3041/6140] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:09:58.198149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af162-fd53-49c8-87e5-73b2a66e0ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:58.198831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af162-fd53-49c8-87e5-73b2a66e0ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.199302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af162-fd53-49c8-87e5-73b2a66e0ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.201795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3af162-fd53-49c8-87e5-73b2a66e0ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.202951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3af162-fd53-49c8-87e5-73b2a66e0ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:58.203285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3af162-fd53-49c8-87e5-73b2a66e0ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:58.204965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3af162-fd53-49c8-87e5-73b2a66e0ba2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:58.224180 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3100/6141] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:58.228914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcb45e-442e-4df3-b0bb-a4c3b0f34866 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:58.240440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcb45e-442e-4df3-b0bb-a4c3b0f34866 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:58.255258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e732718-2a1b-4a0c-920a-a3ca7c976673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:58.256780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e732718-2a1b-4a0c-920a-a3ca7c976673 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.257440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e732718-2a1b-4a0c-920a-a3ca7c976673 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.258008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e732718-2a1b-4a0c-920a-a3ca7c976673 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.258744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e732718-2a1b-4a0c-920a-a3ca7c976673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:58.261288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e732718-2a1b-4a0c-920a-a3ca7c976673 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:58.314769 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3042/6142] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:58 2022] POST /identity/v3/projects => generated 387 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:58.320182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af162-fd53-49c8-87e5-73b2a66e0ba2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:58.335207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3af162-fd53-49c8-87e5-73b2a66e0ba2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:58.442752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0459b3a-3f9f-4846-bd3a-ebad37d13686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:58.443708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0459b3a-3f9f-4846-bd3a-ebad37d13686 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.444085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0459b3a-3f9f-4846-bd3a-ebad37d13686 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.444507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0459b3a-3f9f-4846-bd3a-ebad37d13686 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.445272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0459b3a-3f9f-4846-bd3a-ebad37d13686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:58.447572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0459b3a-3f9f-4846-bd3a-ebad37d13686 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:58.484686 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3101/6143] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:58 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:58.488174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e732718-2a1b-4a0c-920a-a3ca7c976673 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:58.501454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e732718-2a1b-4a0c-920a-a3ca7c976673 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:58.510286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3f3be-3d5b-4534-af8f-e93e11f853fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:58.511319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3f3be-3d5b-4534-af8f-e93e11f853fe admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.511855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3f3be-3d5b-4534-af8f-e93e11f853fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.512200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3f3be-3d5b-4534-af8f-e93e11f853fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.513451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3f3be-3d5b-4534-af8f-e93e11f853fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:58.515382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3f3be-3d5b-4534-af8f-e93e11f853fe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:58.534591 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3043/6144] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:58.536019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0459b3a-3f9f-4846-bd3a-ebad37d13686 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:58.548872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0459b3a-3f9f-4846-bd3a-ebad37d13686 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:58.554676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02968002-8ecd-4f57-81af-517103dbf18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:58.555488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02968002-8ecd-4f57-81af-517103dbf18e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.556102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02968002-8ecd-4f57-81af-517103dbf18e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.556549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02968002-8ecd-4f57-81af-517103dbf18e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.557774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02968002-8ecd-4f57-81af-517103dbf18e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:58.560445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02968002-8ecd-4f57-81af-517103dbf18e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:58.580079 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3102/6145] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:58.582560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3f3be-3d5b-4534-af8f-e93e11f853fe admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:58.618866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3f3be-3d5b-4534-af8f-e93e11f853fe admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:58.633817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80211dcb-6078-43af-a9f7-87c818ccba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:58.640846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80211dcb-6078-43af-a9f7-87c818ccba9d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.640846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80211dcb-6078-43af-a9f7-87c818ccba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.641132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80211dcb-6078-43af-a9f7-87c818ccba9d admin admin] PATH_INFO: `/v3/projects/d57ea8a7a01147a3827203b262830079/users/37e573732990400abc2a460aa628db16/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.668999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80211dcb-6078-43af-a9f7-87c818ccba9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57ea8a7a01147a3827203b262830079, user_id=37e573732990400abc2a460aa628db16, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:58.689335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80211dcb-6078-43af-a9f7-87c818ccba9d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:58.714010 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3044/6146] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:58 2022] PUT /identity/v3/projects/d57ea8a7a01147a3827203b262830079/users/37e573732990400abc2a460aa628db16/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:58.716219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e3335-36e7-41ee-9f7f-ee6d42edc4a1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.716672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e3335-36e7-41ee-9f7f-ee6d42edc4a1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.716875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e3335-36e7-41ee-9f7f-ee6d42edc4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.787623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bc4e3335-36e7-41ee-9f7f-ee6d42edc4a1 None None] MFA Rules not processed for user `37e573732990400abc2a460aa628db16`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:58.788931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bc4e3335-36e7-41ee-9f7f-ee6d42edc4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:58.846562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80211dcb-6078-43af-a9f7-87c818ccba9d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:58.848386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-80211dcb-6078-43af-a9f7-87c818ccba9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:58.954677 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3103/6147] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:58.958702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e3335-36e7-41ee-9f7f-ee6d42edc4a1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:58.969458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80211dcb-6078-43af-a9f7-87c818ccba9d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:58.976381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:58.977560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.977792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:58.978078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] PATH_INFO: `/v3/projects/29129873213241ffb4a419c139b5d326` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:58.979317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29129873213241ffb4a419c139b5d326)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:58.980593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e3335-36e7-41ee-9f7f-ee6d42edc4a1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:58.981960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:58.992800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c1a0-7f29-4fde-9b7f-279d39a79603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:58.995938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c1a0-7f29-4fde-9b7f-279d39a79603 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:58.996385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c1a0-7f29-4fde-9b7f-279d39a79603 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.001357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0c1a0-7f29-4fde-9b7f-279d39a79603 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.002305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0c1a0-7f29-4fde-9b7f-279d39a79603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.005131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0c1a0-7f29-4fde-9b7f-279d39a79603 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.057652 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3104/6148] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:58 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:59.058012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29129873213241ffb4a419c139b5d326', 'request_id': 'req-df70674e-2a03-4247-9a5b-205d28b894e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:59.061107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c1a0-7f29-4fde-9b7f-279d39a79603 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.068670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29129873213241ffb4a419c139b5d326', 'request_id': 'req-df70674e-2a03-4247-9a5b-205d28b894e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:59.080775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29129873213241ffb4a419c139b5d326', 'request_id': 'req-df70674e-2a03-4247-9a5b-205d28b894e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:59.102088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] The token cache is being invalidate because project 29129873213241ffb4a419c139b5d326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:09:59.102568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:59.106379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-df70674e-2a03-4247-9a5b-205d28b894e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:09:59.115219 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3045/6149] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:09:58 2022] DELETE /identity/v3/projects/29129873213241ffb4a419c139b5d326 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:59.118089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a381c-5f86-4358-8843-799ab0845275 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.118540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a381c-5f86-4358-8843-799ab0845275 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.118839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a381c-5f86-4358-8843-799ab0845275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.146527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-574a381c-5f86-4358-8843-799ab0845275 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:59.148039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-574a381c-5f86-4358-8843-799ab0845275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:59.159988 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3046/6150] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:59.168046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0c1a0-7f29-4fde-9b7f-279d39a79603 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.175593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7262b-6bba-4d8e-81a2-ecfdbf610bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.176349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7262b-6bba-4d8e-81a2-ecfdbf610bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.176641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7262b-6bba-4d8e-81a2-ecfdbf610bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.177168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7262b-6bba-4d8e-81a2-ecfdbf610bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.178317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7262b-6bba-4d8e-81a2-ecfdbf610bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.179739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9542352-7da2-4fc9-a1b4-533add4676ce None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.180887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7262b-6bba-4d8e-81a2-ecfdbf610bc7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.181561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9542352-7da2-4fc9-a1b4-533add4676ce None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.182025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9542352-7da2-4fc9-a1b4-533add4676ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.211560 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3105/6151] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:59 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:59.216213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7262b-6bba-4d8e-81a2-ecfdbf610bc7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.219516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cef7262b-6bba-4d8e-81a2-ecfdbf610bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:59.220174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a9542352-7da2-4fc9-a1b4-533add4676ce None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:59.221485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a9542352-7da2-4fc9-a1b4-533add4676ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:59.239503 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3047/6152] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:59.239817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7262b-6bba-4d8e-81a2-ecfdbf610bc7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.240923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9542352-7da2-4fc9-a1b4-533add4676ce None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.247455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a146c-3bc4-47c4-94c5-bda4957b74e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.248283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a146c-3bc4-47c4-94c5-bda4957b74e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.248662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a146c-3bc4-47c4-94c5-bda4957b74e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.249019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a146c-3bc4-47c4-94c5-bda4957b74e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.250208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a146c-3bc4-47c4-94c5-bda4957b74e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.252076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a146c-3bc4-47c4-94c5-bda4957b74e4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.263835 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3106/6153] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:59.268254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a146c-3bc4-47c4-94c5-bda4957b74e4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.275540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9542352-7da2-4fc9-a1b4-533add4676ce None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.283152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f6595-fff8-40cc-a09f-675bc3a4bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.284160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f6595-fff8-40cc-a09f-675bc3a4bb98 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.285295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f6595-fff8-40cc-a09f-675bc3a4bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.285817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f6595-fff8-40cc-a09f-675bc3a4bb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.287362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f6595-fff8-40cc-a09f-675bc3a4bb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:09:59.287749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a146c-3bc4-47c4-94c5-bda4957b74e4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.288154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f6595-fff8-40cc-a09f-675bc3a4bb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.291002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f6595-fff8-40cc-a09f-675bc3a4bb98 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.302186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacec014-b0f3-462d-9c04-a10ecfb3f831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.302956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacec014-b0f3-462d-9c04-a10ecfb3f831 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.303242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacec014-b0f3-462d-9c04-a10ecfb3f831 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.303559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacec014-b0f3-462d-9c04-a10ecfb3f831 admin admin] PATH_INFO: `/v3/projects/c7bbd041a2eb4adaa6f317985ee2babd/users/c967b87c6c8148468cfc5ccf9c44888e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.308876 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3048/6154] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:59.314345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f6595-fff8-40cc-a09f-675bc3a4bb98 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.346496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f6595-fff8-40cc-a09f-675bc3a4bb98 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.349661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacec014-b0f3-462d-9c04-a10ecfb3f831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7bbd041a2eb4adaa6f317985ee2babd, user_id=c967b87c6c8148468cfc5ccf9c44888e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.352403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacec014-b0f3-462d-9c04-a10ecfb3f831 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.363228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335864c-e8b6-424a-a92d-bb6142a018c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.364589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335864c-e8b6-424a-a92d-bb6142a018c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.365591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335864c-e8b6-424a-a92d-bb6142a018c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.365873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335864c-e8b6-424a-a92d-bb6142a018c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.366573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335864c-e8b6-424a-a92d-bb6142a018c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.368764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335864c-e8b6-424a-a92d-bb6142a018c7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.385280 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3107/6155] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:59 2022] PUT /identity/v3/projects/c7bbd041a2eb4adaa6f317985ee2babd/users/c967b87c6c8148468cfc5ccf9c44888e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:09:59.386474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacec014-b0f3-462d-9c04-a10ecfb3f831 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.439499 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3049/6156] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:09:59 2022] POST /identity/v3/projects => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:59.445063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335864c-e8b6-424a-a92d-bb6142a018c7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.472105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacec014-b0f3-462d-9c04-a10ecfb3f831 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.546894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add1df8-ba44-43d0-954e-a87a160ab0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.547689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1df8-ba44-43d0-954e-a87a160ab0de admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.548007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1df8-ba44-43d0-954e-a87a160ab0de admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.548289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add1df8-ba44-43d0-954e-a87a160ab0de admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.549035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335864c-e8b6-424a-a92d-bb6142a018c7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.549154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add1df8-ba44-43d0-954e-a87a160ab0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.551131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add1df8-ba44-43d0-954e-a87a160ab0de admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.556841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9c8ef-5d56-4a66-b8a3-ad20cb46d87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.558212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9c8ef-5d56-4a66-b8a3-ad20cb46d87b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.558825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9c8ef-5d56-4a66-b8a3-ad20cb46d87b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.559310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9c8ef-5d56-4a66-b8a3-ad20cb46d87b admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.560856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9c8ef-5d56-4a66-b8a3-ad20cb46d87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.564031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9c8ef-5d56-4a66-b8a3-ad20cb46d87b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.567339 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3108/6157] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:09:59.568863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add1df8-ba44-43d0-954e-a87a160ab0de admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.581017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add1df8-ba44-43d0-954e-a87a160ab0de admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.586873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73df3e2-6e9a-40c8-a926-5c8590a1fb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.588588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73df3e2-6e9a-40c8-a926-5c8590a1fb47 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.588877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73df3e2-6e9a-40c8-a926-5c8590a1fb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.589158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73df3e2-6e9a-40c8-a926-5c8590a1fb47 admin admin] PATH_INFO: `/v3/projects/c7bbd041a2eb4adaa6f317985ee2babd/users/c967b87c6c8148468cfc5ccf9c44888e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.593214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73df3e2-6e9a-40c8-a926-5c8590a1fb47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7bbd041a2eb4adaa6f317985ee2babd, user_id=c967b87c6c8148468cfc5ccf9c44888e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.595729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3050/6158] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:09:59 2022] POST /identity/v3/users => generated 280 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:09:59.596254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73df3e2-6e9a-40c8-a926-5c8590a1fb47 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.599861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9c8ef-5d56-4a66-b8a3-ad20cb46d87b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.618116 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3109/6159] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:59 2022] PUT /identity/v3/projects/c7bbd041a2eb4adaa6f317985ee2babd/users/c967b87c6c8148468cfc5ccf9c44888e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:59.624881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9c8ef-5d56-4a66-b8a3-ad20cb46d87b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.627726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e8e14-603e-45b2-85c0-cb9bf1020083 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.628065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e8e14-603e-45b2-85c0-cb9bf1020083 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.628349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e8e14-603e-45b2-85c0-cb9bf1020083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.670996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-347e8e14-603e-45b2-85c0-cb9bf1020083 None None] MFA Rules not processed for user `c967b87c6c8148468cfc5ccf9c44888e`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:59.673075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-347e8e14-603e-45b2-85c0-cb9bf1020083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:09:59.715156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92308f80-97e7-4a9f-b738-65adda21f609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.715999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92308f80-97e7-4a9f-b738-65adda21f609 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.716381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92308f80-97e7-4a9f-b738-65adda21f609 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.724139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92308f80-97e7-4a9f-b738-65adda21f609 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.724980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92308f80-97e7-4a9f-b738-65adda21f609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.726753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92308f80-97e7-4a9f-b738-65adda21f609 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.740868 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3051/6160] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:59.744630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92308f80-97e7-4a9f-b738-65adda21f609 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.759593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92308f80-97e7-4a9f-b738-65adda21f609 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.779718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0f52-e56d-47a0-ac80-5ad201b772e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.780560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0f52-e56d-47a0-ac80-5ad201b772e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.780917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0f52-e56d-47a0-ac80-5ad201b772e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.781266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0f52-e56d-47a0-ac80-5ad201b772e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.782064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0f52-e56d-47a0-ac80-5ad201b772e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.783969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0f52-e56d-47a0-ac80-5ad201b772e7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.800060 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3052/6161] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:09:59.807335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0f52-e56d-47a0-ac80-5ad201b772e7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.817755 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3110/6162] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:09:59.822834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e8e14-603e-45b2-85c0-cb9bf1020083 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.826984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0f52-e56d-47a0-ac80-5ad201b772e7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.833126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9778f6a-d779-4a45-8913-5df5dcb3bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.835170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778f6a-d779-4a45-8913-5df5dcb3bdc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.835651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778f6a-d779-4a45-8913-5df5dcb3bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.836143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9778f6a-d779-4a45-8913-5df5dcb3bdc8 admin admin] PATH_INFO: `/v3/projects/fb6caf03fc3743d792180c2ecd007b77/users/c18f7bcfb7d8467a9934f1f1690955dd/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.843306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e8e14-603e-45b2-85c0-cb9bf1020083 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.863070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d14fe-ca2e-4d51-af9f-ffdea14c6298 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:09:59.863509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d14fe-ca2e-4d51-af9f-ffdea14c6298 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.863838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d14fe-ca2e-4d51-af9f-ffdea14c6298 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.864489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d14fe-ca2e-4d51-af9f-ffdea14c6298 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects/d57ea8a7a01147a3827203b262830079` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.865734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d14fe-ca2e-4d51-af9f-ffdea14c6298 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:get_project(project_id=d57ea8a7a01147a3827203b262830079)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.869348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d14fe-ca2e-4d51-af9f-ffdea14c6298 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.872418 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3111/6163] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:09:59 2022] GET /identity/v3/projects/d57ea8a7a01147a3827203b262830079 => generated 387 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:09:59.875283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d14fe-ca2e-4d51-af9f-ffdea14c6298 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:09:59.877358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9778f6a-d779-4a45-8913-5df5dcb3bdc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb6caf03fc3743d792180c2ecd007b77, user_id=c18f7bcfb7d8467a9934f1f1690955dd, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:09:59.881754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9778f6a-d779-4a45-8913-5df5dcb3bdc8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:09:59.900903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d14fe-ca2e-4d51-af9f-ffdea14c6298 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:09:59.926848 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3053/6164] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:09:59 2022] PUT /identity/v3/projects/fb6caf03fc3743d792180c2ecd007b77/users/c18f7bcfb7d8467a9934f1f1690955dd/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:09:59.948366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac77e4-b471-4078-81a5-e6d99a957615 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:09:59.948787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac77e4-b471-4078-81a5-e6d99a957615 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:09:59.949159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac77e4-b471-4078-81a5-e6d99a957615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:09:59.992544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-19ac77e4-b471-4078-81a5-e6d99a957615 None None] MFA Rules not processed for user `c18f7bcfb7d8467a9934f1f1690955dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:09:59.993877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-19ac77e4-b471-4078-81a5-e6d99a957615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:00.093992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd60a8-0c7c-4f35-814a-8168b4f174ca tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.096167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd60a8-0c7c-4f35-814a-8168b4f174ca tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.096489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd60a8-0c7c-4f35-814a-8168b4f174ca tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.096771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd60a8-0c7c-4f35-814a-8168b4f174ca tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.097496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd60a8-0c7c-4f35-814a-8168b4f174ca tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.102078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd60a8-0c7c-4f35-814a-8168b4f174ca tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.192222 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3054/6165] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:09:59 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:00.194017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d44678-374d-4bf6-afe4-e5718b6bd8c8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.194017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d44678-374d-4bf6-afe4-e5718b6bd8c8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.194273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d44678-374d-4bf6-afe4-e5718b6bd8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.224262 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3112/6166] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:09:59 2022] POST /identity/v3/projects => generated 338 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:00.228960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd60a8-0c7c-4f35-814a-8168b4f174ca tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.257472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-21d44678-374d-4bf6-afe4-e5718b6bd8c8 None None] MFA Rules not processed for user `c18f7bcfb7d8467a9934f1f1690955dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:00.258709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-21d44678-374d-4bf6-afe4-e5718b6bd8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:00.267990 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3055/6167] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:00 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:10:00.270593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5a8f-42c4-48aa-9c7f-caedd06f729d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.270896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5a8f-42c4-48aa-9c7f-caedd06f729d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.271183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fd5a8f-42c4-48aa-9c7f-caedd06f729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.309857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-76fd5a8f-42c4-48aa-9c7f-caedd06f729d None None] MFA Rules not processed for user `c18f7bcfb7d8467a9934f1f1690955dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:00.311115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-76fd5a8f-42c4-48aa-9c7f-caedd06f729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:00.324103 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3056/6168] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:00 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:10:00.325046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5a8f-42c4-48aa-9c7f-caedd06f729d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.340847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd60a8-0c7c-4f35-814a-8168b4f174ca tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.347832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361a44-8fdf-4ec4-bea3-586ce47c5e05 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.348920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361a44-8fdf-4ec4-bea3-586ce47c5e05 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.349482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361a44-8fdf-4ec4-bea3-586ce47c5e05 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.349979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361a44-8fdf-4ec4-bea3-586ce47c5e05 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.350983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd361a44-8fdf-4ec4-bea3-586ce47c5e05 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.353500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd361a44-8fdf-4ec4-bea3-586ce47c5e05 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.411972 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3113/6169] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/projects => generated 6206 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:00.417109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361a44-8fdf-4ec4-bea3-586ce47c5e05 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.445991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361a44-8fdf-4ec4-bea3-586ce47c5e05 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.464058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fd5a8f-42c4-48aa-9c7f-caedd06f729d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.466284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eddb34-f3e6-46d8-ac03-5190e9d08b30 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.467174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eddb34-f3e6-46d8-ac03-5190e9d08b30 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.467662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eddb34-f3e6-46d8-ac03-5190e9d08b30 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.468056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eddb34-f3e6-46d8-ac03-5190e9d08b30 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects/d57ea8a7a01147a3827203b262830079` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.470296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eddb34-f3e6-46d8-ac03-5190e9d08b30 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:get_project(project_id=d57ea8a7a01147a3827203b262830079)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.473470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eddb34-f3e6-46d8-ac03-5190e9d08b30 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.478074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c8dc8-14ed-40e1-91ac-1fa626a186eb tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18f7bcfb7d8467a9934f1f1690955dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb6caf03fc3743d792180c2ecd007b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.478931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c8dc8-14ed-40e1-91ac-1fa626a186eb tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] REQUEST_METHOD: `HEAD` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.479194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c8dc8-14ed-40e1-91ac-1fa626a186eb tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.479484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c8dc8-14ed-40e1-91ac-1fa626a186eb tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.480769 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3114/6170] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/projects/d57ea8a7a01147a3827203b262830079 => generated 387 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:00.481736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eddb34-f3e6-46d8-ac03-5190e9d08b30 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.493344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c8dc8-14ed-40e1-91ac-1fa626a186eb tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorizing `identity:check_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.494895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c8dc8-14ed-40e1-91ac-1fa626a186eb tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.502471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eddb34-f3e6-46d8-ac03-5190e9d08b30 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.506887 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3057/6171] 10.222.0.16 () {56 vars in 1263 bytes} [Sat Mar 26 21:10:00 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Mar 26 21:10:00.511397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c8dc8-14ed-40e1-91ac-1fa626a186eb tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.520064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47dc0a-ad7a-48d6-9222-cf88eb4facf7 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.521216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47dc0a-ad7a-48d6-9222-cf88eb4facf7 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.521397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47dc0a-ad7a-48d6-9222-cf88eb4facf7 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.521645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47dc0a-ad7a-48d6-9222-cf88eb4facf7 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects/6b34f1a38c514400bf36733921129619` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.523555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47dc0a-ad7a-48d6-9222-cf88eb4facf7 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:get_project(project_id=6b34f1a38c514400bf36733921129619)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.525684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47dc0a-ad7a-48d6-9222-cf88eb4facf7 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.529716 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3115/6172] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/projects/6b34f1a38c514400bf36733921129619 => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:00.538052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c8dc8-14ed-40e1-91ac-1fa626a186eb tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.539261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47dc0a-ad7a-48d6-9222-cf88eb4facf7 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.554174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd6102-cba5-4502-8680-3ac412952546 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18f7bcfb7d8467a9934f1f1690955dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb6caf03fc3743d792180c2ecd007b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.555237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6102-cba5-4502-8680-3ac412952546 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.555453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6102-cba5-4502-8680-3ac412952546 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.555746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd6102-cba5-4502-8680-3ac412952546 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.559163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47dc0a-ad7a-48d6-9222-cf88eb4facf7 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.567903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd6102-cba5-4502-8680-3ac412952546 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.568363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b3411-2e7b-4c80-b89b-e8d34fcdb999 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.569083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b3411-2e7b-4c80-b89b-e8d34fcdb999 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.571016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd6102-cba5-4502-8680-3ac412952546 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.572232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b3411-2e7b-4c80-b89b-e8d34fcdb999 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.572625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b3411-2e7b-4c80-b89b-e8d34fcdb999 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.573512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b3411-2e7b-4c80-b89b-e8d34fcdb999 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.575393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b3411-2e7b-4c80-b89b-e8d34fcdb999 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.596112 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3058/6173] 10.222.0.16 () {56 vars in 1262 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 21:10:00.597099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd6102-cba5-4502-8680-3ac412952546 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.621681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd6102-cba5-4502-8680-3ac412952546 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.629281 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3116/6174] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/projects => generated 6206 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:00.633906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b3411-2e7b-4c80-b89b-e8d34fcdb999 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.639551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a0af8-74fe-4e3d-a91f-5a0f9e358f82 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18f7bcfb7d8467a9934f1f1690955dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb6caf03fc3743d792180c2ecd007b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.641039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a0af8-74fe-4e3d-a91f-5a0f9e358f82 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.641513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a0af8-74fe-4e3d-a91f-5a0f9e358f82 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.641954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a0af8-74fe-4e3d-a91f-5a0f9e358f82 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.655151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b3411-2e7b-4c80-b89b-e8d34fcdb999 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.657779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a0af8-74fe-4e3d-a91f-5a0f9e358f82 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.659519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a0af8-74fe-4e3d-a91f-5a0f9e358f82 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.671810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e067c2-e767-4dc5-a5aa-21f376523df4 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.672891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e067c2-e767-4dc5-a5aa-21f376523df4 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.673460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e067c2-e767-4dc5-a5aa-21f376523df4 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.673903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e067c2-e767-4dc5-a5aa-21f376523df4 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.674833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e067c2-e767-4dc5-a5aa-21f376523df4 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:00.676283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e067c2-e767-4dc5-a5aa-21f376523df4 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.678487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e067c2-e767-4dc5-a5aa-21f376523df4 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.698188 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3059/6175] 10.222.0.16 () {56 vars in 1265 bytes} [Sat Mar 26 21:10:00 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:00.702620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a0af8-74fe-4e3d-a91f-5a0f9e358f82 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.716224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a0af8-74fe-4e3d-a91f-5a0f9e358f82 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.729241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b8f4a-ea94-4e4e-9b49-202be6cc2b80 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18f7bcfb7d8467a9934f1f1690955dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb6caf03fc3743d792180c2ecd007b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.729893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b8f4a-ea94-4e4e-9b49-202be6cc2b80 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] REQUEST_METHOD: `HEAD` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.730179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b8f4a-ea94-4e4e-9b49-202be6cc2b80 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.730459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b8f4a-ea94-4e4e-9b49-202be6cc2b80 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.736170 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3117/6176] 10.222.0.16 () {58 vars in 1165 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/projects?domain_id=default => generated 5875 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:00.746663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-440b8f4a-ea94-4e4e-9b49-202be6cc2b80 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:00.750792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e067c2-e767-4dc5-a5aa-21f376523df4 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.770358 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-440b8f4a-ea94-4e4e-9b49-202be6cc2b80 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Mar 26 21:10:00.771577 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3060/6177] 10.222.0.16 () {56 vars in 1263 bytes} [Sat Mar 26 21:10:00 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Mar 26 21:10:00.778567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e067c2-e767-4dc5-a5aa-21f376523df4 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.781739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc42db-91b7-41d3-8a04-cea4d15e733a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.782199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc42db-91b7-41d3-8a04-cea4d15e733a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.782914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc42db-91b7-41d3-8a04-cea4d15e733a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.805055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6199c-d653-4d62-8f2d-cdddfca796e5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.805775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6199c-d653-4d62-8f2d-cdddfca796e5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.806063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6199c-d653-4d62-8f2d-cdddfca796e5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.806345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be6199c-d653-4d62-8f2d-cdddfca796e5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.807130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6199c-d653-4d62-8f2d-cdddfca796e5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.809103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be6199c-d653-4d62-8f2d-cdddfca796e5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.831792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4fdc42db-91b7-41d3-8a04-cea4d15e733a None None] MFA Rules not processed for user `c18f7bcfb7d8467a9934f1f1690955dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:00.833311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4fdc42db-91b7-41d3-8a04-cea4d15e733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:00.842369 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3061/6178] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:00 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:10:00.849802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc42db-91b7-41d3-8a04-cea4d15e733a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.854153 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3118/6179] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/projects => generated 6206 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:00.861728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6199c-d653-4d62-8f2d-cdddfca796e5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.874536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be6199c-d653-4d62-8f2d-cdddfca796e5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.886111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d166a-1c2a-450c-8b34-93781b33c399 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.887093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d166a-1c2a-450c-8b34-93781b33c399 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.887535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d166a-1c2a-450c-8b34-93781b33c399 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.888014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d166a-1c2a-450c-8b34-93781b33c399 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.888990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d166a-1c2a-450c-8b34-93781b33c399 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:00.889495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d166a-1c2a-450c-8b34-93781b33c399 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.891620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d166a-1c2a-450c-8b34-93781b33c399 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.893793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc42db-91b7-41d3-8a04-cea4d15e733a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:00.899208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7945ec1-e1ac-48a2-97b1-6e002c9ffa12 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18f7bcfb7d8467a9934f1f1690955dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb6caf03fc3743d792180c2ecd007b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:00.900070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7945ec1-e1ac-48a2-97b1-6e002c9ffa12 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:00.900355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7945ec1-e1ac-48a2-97b1-6e002c9ffa12 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:00.900631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7945ec1-e1ac-48a2-97b1-6e002c9ffa12 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:00.914903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7945ec1-e1ac-48a2-97b1-6e002c9ffa12 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:00.922253 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3119/6180] 10.222.0.16 () {58 vars in 1165 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/projects?domain_id=default => generated 5875 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:00.927223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d166a-1c2a-450c-8b34-93781b33c399 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.930338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7945ec1-e1ac-48a2-97b1-6e002c9ffa12 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:00.947590 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3062/6181] 10.222.0.16 () {56 vars in 1262 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 26 21:10:00.970642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7945ec1-e1ac-48a2-97b1-6e002c9ffa12 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:00.992547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d166a-1c2a-450c-8b34-93781b33c399 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:01.004199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7654f0-4d5f-4077-a4fb-72c0336dd0c5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:01.004199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7654f0-4d5f-4077-a4fb-72c0336dd0c5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.004430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7654f0-4d5f-4077-a4fb-72c0336dd0c5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.004670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7654f0-4d5f-4077-a4fb-72c0336dd0c5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.005633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7654f0-4d5f-4077-a4fb-72c0336dd0c5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:01.007691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7654f0-4d5f-4077-a4fb-72c0336dd0c5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:01.033819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7945ec1-e1ac-48a2-97b1-6e002c9ffa12 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:01.039282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6a5f-1b5e-47ba-a2fe-1d04ba263cc0 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18f7bcfb7d8467a9934f1f1690955dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb6caf03fc3743d792180c2ecd007b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:01.040788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6a5f-1b5e-47ba-a2fe-1d04ba263cc0 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.040788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6a5f-1b5e-47ba-a2fe-1d04ba263cc0 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.040788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e6a5f-1b5e-47ba-a2fe-1d04ba263cc0 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.048412 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3120/6182] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Mar 26 21:10:00 2022] GET /identity/v3/projects => generated 6206 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:01.053727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7654f0-4d5f-4077-a4fb-72c0336dd0c5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:01.069767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e6a5f-1b5e-47ba-a2fe-1d04ba263cc0 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:01.069767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e6a5f-1b5e-47ba-a2fe-1d04ba263cc0 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:01.082250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7654f0-4d5f-4077-a4fb-72c0336dd0c5 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:01.088749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107c8c5-ab7b-426e-82cb-d4aee6289d12 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:01.090504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107c8c5-ab7b-426e-82cb-d4aee6289d12 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.091082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107c8c5-ab7b-426e-82cb-d4aee6289d12 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.091488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107c8c5-ab7b-426e-82cb-d4aee6289d12 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.092492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107c8c5-ab7b-426e-82cb-d4aee6289d12 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-207143838) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:01.093504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107c8c5-ab7b-426e-82cb-d4aee6289d12 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:01.095985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107c8c5-ab7b-426e-82cb-d4aee6289d12 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:01.111039 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3063/6183] 10.222.0.16 () {56 vars in 1265 bytes} [Sat Mar 26 21:10:00 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:01.115269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6a5f-1b5e-47ba-a2fe-1d04ba263cc0 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:01.122412 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3121/6184] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:10:01 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-207143838 => generated 534 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:01.127945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107c8c5-ab7b-426e-82cb-d4aee6289d12 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:01.129554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e6a5f-1b5e-47ba-a2fe-1d04ba263cc0 tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:01.134608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f3f9d-59ed-4956-b8df-ca8ca043056e tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c18f7bcfb7d8467a9934f1f1690955dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb6caf03fc3743d792180c2ecd007b77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:01.135512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3f9d-59ed-4956-b8df-ca8ca043056e tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.136069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3f9d-59ed-4956-b8df-ca8ca043056e tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.136552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f3f9d-59ed-4956-b8df-ca8ca043056e tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.139352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-748f3f9d-59ed-4956-b8df-ca8ca043056e tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:01.141181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107c8c5-ab7b-426e-82cb-d4aee6289d12 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:01.149231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c967b87c6c8148468cfc5ccf9c44888e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c7bbd041a2eb4adaa6f317985ee2babd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:01.150278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.150723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.151274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] PATH_INFO: `/v3/projects/6b34f1a38c514400bf36733921129619` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.153970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6b34f1a38c514400bf36733921129619)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:01.156935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:01.158090 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-748f3f9d-59ed-4956-b8df-ca8ca043056e tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Mar 26 21:10:01.160484 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3064/6185] 10.222.0.16 () {56 vars in 1262 bytes} [Sat Mar 26 21:10:01 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 21:10:01.165304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f3f9d-59ed-4956-b8df-ca8ca043056e tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:01.221210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b34f1a38c514400bf36733921129619', 'request_id': 'req-b6c8875a-3426-4cc5-9358-98e07466f182'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.234021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b34f1a38c514400bf36733921129619', 'request_id': 'req-b6c8875a-3426-4cc5-9358-98e07466f182'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.243197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b34f1a38c514400bf36733921129619', 'request_id': 'req-b6c8875a-3426-4cc5-9358-98e07466f182'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.261719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] The token cache is being invalidate because project 6b34f1a38c514400bf36733921129619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:01.262319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.265520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.266040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f3f9d-59ed-4956-b8df-ca8ca043056e tempest-TokensV3Test-694023307 tempest-TokensV3Test-694023307-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:01.271076 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3122/6186] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:01 2022] DELETE /identity/v3/projects/6b34f1a38c514400bf36733921129619 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:01.273051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:01.276321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:01.373751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:01.375634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.376173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.376979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] PATH_INFO: `/v3/users/c18f7bcfb7d8467a9934f1f1690955dd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.378307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18f7bcfb7d8467a9934f1f1690955dd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:01.379881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8875a-3426-4cc5-9358-98e07466f182 tempest-ListProjectsStaticTestJSON-963964577 tempest-ListProjectsStaticTestJSON-963964577-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:01.380928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:01.387434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:01.389044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.389705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.390740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] PATH_INFO: `/v3/users/37e573732990400abc2a460aa628db16` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.393153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e573732990400abc2a460aa628db16)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:01.395782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:01.486122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18f7bcfb7d8467a9934f1f1690955dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.491555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e573732990400abc2a460aa628db16'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.503780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18f7bcfb7d8467a9934f1f1690955dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.504806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18f7bcfb7d8467a9934f1f1690955dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.504956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e573732990400abc2a460aa628db16'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.505570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e573732990400abc2a460aa628db16'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.505823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18f7bcfb7d8467a9934f1f1690955dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.508263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e573732990400abc2a460aa628db16'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.519571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd6315b5-c7a1-46f2-8356-4d9b955a3e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e573732990400abc2a460aa628db16'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.536551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-18642186-d04c-4747-b855-6cf9e2214de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18f7bcfb7d8467a9934f1f1690955dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:01.552230 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3123/6187] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:01 2022] DELETE /identity/v3/users/37e573732990400abc2a460aa628db16 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:01.554662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39a2d2-881d-43ab-8f61-d4e4f263e328 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.555416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39a2d2-881d-43ab-8f61-d4e4f263e328 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.555416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39a2d2-881d-43ab-8f61-d4e4f263e328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.556141 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3065/6188] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:01 2022] DELETE /identity/v3/users/c18f7bcfb7d8467a9934f1f1690955dd => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:01.562652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b473c-7181-412d-96c8-1e4c6d5e4172 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.562875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b473c-7181-412d-96c8-1e4c6d5e4172 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.563476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b473c-7181-412d-96c8-1e4c6d5e4172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.596800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6f39a2d2-881d-43ab-8f61-d4e4f263e328 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:01.598257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6f39a2d2-881d-43ab-8f61-d4e4f263e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:01.610296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-410b473c-7181-412d-96c8-1e4c6d5e4172 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:01.611825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-410b473c-7181-412d-96c8-1e4c6d5e4172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:01.721417 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3124/6189] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:01.734086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39a2d2-881d-43ab-8f61-d4e4f263e328 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:01.734670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6f39a2d2-881d-43ab-8f61-d4e4f263e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:01.741863 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3066/6190] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:01.749998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b473c-7181-412d-96c8-1e4c6d5e4172 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:01.751637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-410b473c-7181-412d-96c8-1e4c6d5e4172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:01.865624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39a2d2-881d-43ab-8f61-d4e4f263e328 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:01.871520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028b3b4-52f7-4e73-b33f-285c8e3dc36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:01.873706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028b3b4-52f7-4e73-b33f-285c8e3dc36c service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.873931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028b3b4-52f7-4e73-b33f-285c8e3dc36c service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.874728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028b3b4-52f7-4e73-b33f-285c8e3dc36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.889181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028b3b4-52f7-4e73-b33f-285c8e3dc36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:01.889633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b473c-7181-412d-96c8-1e4c6d5e4172 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:01.891979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028b3b4-52f7-4e73-b33f-285c8e3dc36c service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:01.901699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7f80e-d855-4e3c-8fb4-309dbab6f589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:01.903015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7f80e-d855-4e3c-8fb4-309dbab6f589 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:01.903480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7f80e-d855-4e3c-8fb4-309dbab6f589 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:01.903869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7f80e-d855-4e3c-8fb4-309dbab6f589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:01.909735 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3125/6191] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:01.919949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7f80e-d855-4e3c-8fb4-309dbab6f589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:01.921491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7f80e-d855-4e3c-8fb4-309dbab6f589 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:01.939946 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3067/6192] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:02.690029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028b3b4-52f7-4e73-b33f-285c8e3dc36c service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:02.694389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5028b3b4-52f7-4e73-b33f-285c8e3dc36c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:02.716156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7f80e-d855-4e3c-8fb4-309dbab6f589 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:02.716156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-27e7f80e-d855-4e3c-8fb4-309dbab6f589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:02.724827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028b3b4-52f7-4e73-b33f-285c8e3dc36c service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:02.742966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7f80e-d855-4e3c-8fb4-309dbab6f589 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:02.755285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:02.756587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:02.756779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:02.757066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] PATH_INFO: `/v3/projects/d57ea8a7a01147a3827203b262830079` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:02.758648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57ea8a7a01147a3827203b262830079)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:02.759521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:02.760835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:02.762114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:02.762751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:02.763195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] PATH_INFO: `/v3/projects/fb6caf03fc3743d792180c2ecd007b77` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:02.770678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb6caf03fc3743d792180c2ecd007b77)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:02.779008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:02.887885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57ea8a7a01147a3827203b262830079', 'request_id': 'req-2bcb71de-0288-4ad6-8568-a1a56375aae2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.898459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb6caf03fc3743d792180c2ecd007b77', 'request_id': 'req-92610cf1-097a-4b21-abeb-b0d912b58b02'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.911488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57ea8a7a01147a3827203b262830079', 'request_id': 'req-2bcb71de-0288-4ad6-8568-a1a56375aae2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.915295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb6caf03fc3743d792180c2ecd007b77', 'request_id': 'req-92610cf1-097a-4b21-abeb-b0d912b58b02'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.924868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb6caf03fc3743d792180c2ecd007b77', 'request_id': 'req-92610cf1-097a-4b21-abeb-b0d912b58b02'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.933242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57ea8a7a01147a3827203b262830079', 'request_id': 'req-2bcb71de-0288-4ad6-8568-a1a56375aae2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.950161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] The token cache is being invalidate because project fb6caf03fc3743d792180c2ecd007b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:02.956137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.957723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.959683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] The token cache is being invalidate because project d57ea8a7a01147a3827203b262830079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:02.960220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.961141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcb71de-0288-4ad6-8568-a1a56375aae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:02.975598 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3126/6193] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:02 2022] DELETE /identity/v3/projects/fb6caf03fc3743d792180c2ecd007b77 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:02.975808 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3068/6194] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:02 2022] DELETE /identity/v3/projects/d57ea8a7a01147a3827203b262830079 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:02.975908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:02.976051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ce897-abe7-49e8-afc0-667ea6a4eb9f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:02.976051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ce897-abe7-49e8-afc0-667ea6a4eb9f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:02.976051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ce897-abe7-49e8-afc0-667ea6a4eb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:02.980233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:02.997148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a02ce897-abe7-49e8-afc0-667ea6a4eb9f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:02.998845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a02ce897-abe7-49e8-afc0-667ea6a4eb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:03.088917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92610cf1-097a-4b21-abeb-b0d912b58b02 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:03.094296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:03.095256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:03.105236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:03.105751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] PATH_INFO: `/v3/users/c967b87c6c8148468cfc5ccf9c44888e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:03.107387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c967b87c6c8148468cfc5ccf9c44888e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:03.109712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:03.196784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c967b87c6c8148468cfc5ccf9c44888e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:03.206717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c967b87c6c8148468cfc5ccf9c44888e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:03.208679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c967b87c6c8148468cfc5ccf9c44888e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:03.214340 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3069/6195] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:03.225165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214de43-6bff-47d4-a682-53d257c78715 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:03.225466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214de43-6bff-47d4-a682-53d257c78715 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:03.229524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0214de43-6bff-47d4-a682-53d257c78715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:03.230418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c967b87c6c8148468cfc5ccf9c44888e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:03.244606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c967b87c6c8148468cfc5ccf9c44888e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:03.254628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0214de43-6bff-47d4-a682-53d257c78715 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:03.255899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0214de43-6bff-47d4-a682-53d257c78715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:03.277949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3127/6196] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:02 2022] DELETE /identity/v3/users/c967b87c6c8148468cfc5ccf9c44888e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:03.283825 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3070/6197] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:10:03.285919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:03.390935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642bc41-b270-45fc-bcd2-3e3b204d0e9c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:03.401579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4dfb1-0521-4917-bcf1-0c23917df13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:03.402463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4dfb1-0521-4917-bcf1-0c23917df13a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:03.402757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4dfb1-0521-4917-bcf1-0c23917df13a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:03.403409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4dfb1-0521-4917-bcf1-0c23917df13a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:03.404537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4dfb1-0521-4917-bcf1-0c23917df13a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:03.405405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4dfb1-0521-4917-bcf1-0c23917df13a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:03.407777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4dfb1-0521-4917-bcf1-0c23917df13a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:03.429429 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3128/6198] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:03.435705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214de43-6bff-47d4-a682-53d257c78715 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:03.457593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0214de43-6bff-47d4-a682-53d257c78715 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:03.470951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd7022-91e4-4dfd-9087-241d39241045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:03.472136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd7022-91e4-4dfd-9087-241d39241045 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:03.472136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd7022-91e4-4dfd-9087-241d39241045 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:03.473519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd7022-91e4-4dfd-9087-241d39241045 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:03.475050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd7022-91e4-4dfd-9087-241d39241045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:03.478495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd7022-91e4-4dfd-9087-241d39241045 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:03.626124 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3071/6199] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:03 2022] POST /identity/v3/projects => generated 397 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:03.630283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4dfb1-0521-4917-bcf1-0c23917df13a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:03.646391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4dfb1-0521-4917-bcf1-0c23917df13a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:03.779207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db0559-093b-4603-97e7-e35794f8b69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:03.780995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db0559-093b-4603-97e7-e35794f8b69f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:03.781607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db0559-093b-4603-97e7-e35794f8b69f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:03.782370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db0559-093b-4603-97e7-e35794f8b69f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:03.784013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db0559-093b-4603-97e7-e35794f8b69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:03.786850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db0559-093b-4603-97e7-e35794f8b69f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:03.824850 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3129/6200] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:03 2022] POST /identity/v3/users => generated 305 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:03.827761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd7022-91e4-4dfd-9087-241d39241045 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:03.838979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd7022-91e4-4dfd-9087-241d39241045 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:03.844630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4294b-db70-4d4a-be3f-fc7113f6e742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:03.845319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4294b-db70-4d4a-be3f-fc7113f6e742 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:03.845613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4294b-db70-4d4a-be3f-fc7113f6e742 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:03.845900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4294b-db70-4d4a-be3f-fc7113f6e742 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:03.846641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4294b-db70-4d4a-be3f-fc7113f6e742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:03.848397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4294b-db70-4d4a-be3f-fc7113f6e742 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:03.866341 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3072/6201] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:03.867796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db0559-093b-4603-97e7-e35794f8b69f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:03.880761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db0559-093b-4603-97e7-e35794f8b69f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:03.889504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda23b5f-7774-462a-be2e-e6f545f71073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:03.890876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda23b5f-7774-462a-be2e-e6f545f71073 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:03.891380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda23b5f-7774-462a-be2e-e6f545f71073 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:03.891889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda23b5f-7774-462a-be2e-e6f545f71073 admin admin] PATH_INFO: `/v3/projects/395fee6a7d044c32ab96865a7ad75193/users/098369120c914b88a53cdce2e7e8fe08/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:03.916346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda23b5f-7774-462a-be2e-e6f545f71073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395fee6a7d044c32ab96865a7ad75193, user_id=098369120c914b88a53cdce2e7e8fe08, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:03.921622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda23b5f-7774-462a-be2e-e6f545f71073 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:03.946793 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3130/6202] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:03 2022] PUT /identity/v3/projects/395fee6a7d044c32ab96865a7ad75193/users/098369120c914b88a53cdce2e7e8fe08/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:03.950471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4294b-db70-4d4a-be3f-fc7113f6e742 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:03.972581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4294b-db70-4d4a-be3f-fc7113f6e742 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:04.091300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71f726-cadd-42b1-9b75-bf412d23d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:04.091870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f726-cadd-42b1-9b75-bf412d23d8dd admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:04.092136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f726-cadd-42b1-9b75-bf412d23d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:04.092420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71f726-cadd-42b1-9b75-bf412d23d8dd admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:04.093749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f726-cadd-42b1-9b75-bf412d23d8dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:04.095395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71f726-cadd-42b1-9b75-bf412d23d8dd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:04.111339 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3073/6203] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:04.112240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda23b5f-7774-462a-be2e-e6f545f71073 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:04.132889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda23b5f-7774-462a-be2e-e6f545f71073 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:04.147893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985929-6a7e-4008-af78-669a39898808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:04.149250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985929-6a7e-4008-af78-669a39898808 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:04.149790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985929-6a7e-4008-af78-669a39898808 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:04.150617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985929-6a7e-4008-af78-669a39898808 admin admin] PATH_INFO: `/v3/projects/395fee6a7d044c32ab96865a7ad75193/users/098369120c914b88a53cdce2e7e8fe08/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:04.162469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d985929-6a7e-4008-af78-669a39898808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395fee6a7d044c32ab96865a7ad75193, user_id=098369120c914b88a53cdce2e7e8fe08, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:04.167070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d985929-6a7e-4008-af78-669a39898808 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:04.202795 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3131/6204] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:04 2022] PUT /identity/v3/projects/395fee6a7d044c32ab96865a7ad75193/users/098369120c914b88a53cdce2e7e8fe08/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:04.213971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d8ea3-f882-4c55-b985-ada65489a32c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:04.214311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d8ea3-f882-4c55-b985-ada65489a32c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:04.214564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d8ea3-f882-4c55-b985-ada65489a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:04.258776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f86d8ea3-f882-4c55-b985-ada65489a32c None None] MFA Rules not processed for user `098369120c914b88a53cdce2e7e8fe08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:04.263015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f86d8ea3-f882-4c55-b985-ada65489a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:04.346142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985929-6a7e-4008-af78-669a39898808 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:04.357216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7d985929-6a7e-4008-af78-669a39898808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:04.453933 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3074/6205] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:04.454918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d8ea3-f882-4c55-b985-ada65489a32c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:04.543568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985929-6a7e-4008-af78-669a39898808 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:04.551010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:04.552067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:04.552406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:04.552698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] PATH_INFO: `/v3/projects/c7bbd041a2eb4adaa6f317985ee2babd` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:04.554260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7bbd041a2eb4adaa6f317985ee2babd)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:04.557660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:04.607113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86d8ea3-f882-4c55-b985-ada65489a32c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:04.620455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccc0b7-5c63-49fc-9208-d84f42cdd0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:04.620455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccc0b7-5c63-49fc-9208-d84f42cdd0d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:04.620455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccc0b7-5c63-49fc-9208-d84f42cdd0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:04.620455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccc0b7-5c63-49fc-9208-d84f42cdd0d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:04.620965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccc0b7-5c63-49fc-9208-d84f42cdd0d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:04.623323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccc0b7-5c63-49fc-9208-d84f42cdd0d8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:04.685837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7bbd041a2eb4adaa6f317985ee2babd', 'request_id': 'req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:04.695393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3075/6206] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:04 2022] POST /identity/v3/projects => generated 399 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:04.704699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccc0b7-5c63-49fc-9208-d84f42cdd0d8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:04.729224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7bbd041a2eb4adaa6f317985ee2babd', 'request_id': 'req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:04.741791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7bbd041a2eb4adaa6f317985ee2babd', 'request_id': 'req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:04.789033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] The token cache is being invalidate because project c7bbd041a2eb4adaa6f317985ee2babd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:04.789442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:04.791562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74aa43ae-aab3-4dbe-adfe-c6fbd6cdea47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:04.794687 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3132/6207] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:04 2022] DELETE /identity/v3/projects/c7bbd041a2eb4adaa6f317985ee2babd => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:04.800467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54293c-3705-4a34-9881-6f35b99c0e96 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:04.800758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54293c-3705-4a34-9881-6f35b99c0e96 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:04.801364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c54293c-3705-4a34-9881-6f35b99c0e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:04.857683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5c54293c-3705-4a34-9881-6f35b99c0e96 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:04.860416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5c54293c-3705-4a34-9881-6f35b99c0e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:04.911053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccc0b7-5c63-49fc-9208-d84f42cdd0d8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:04.933662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bde6e-4689-436c-a4cc-04254a397b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:04.934444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bde6e-4689-436c-a4cc-04254a397b7a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:04.934730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bde6e-4689-436c-a4cc-04254a397b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:04.938724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bde6e-4689-436c-a4cc-04254a397b7a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:04.941837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bde6e-4689-436c-a4cc-04254a397b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:04.956073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bde6e-4689-436c-a4cc-04254a397b7a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.036147 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3076/6208] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:04 2022] POST /identity/v3/users => generated 300 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:05.038648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bde6e-4689-436c-a4cc-04254a397b7a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.046564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fd7bde6e-4689-436c-a4cc-04254a397b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:05.100893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bde6e-4689-436c-a4cc-04254a397b7a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.122603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb281-c6a8-4860-ab64-b3585292f2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.123389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb281-c6a8-4860-ab64-b3585292f2af admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.123699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb281-c6a8-4860-ab64-b3585292f2af admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.129239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb281-c6a8-4860-ab64-b3585292f2af admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.130273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddb281-c6a8-4860-ab64-b3585292f2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.132051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ddb281-c6a8-4860-ab64-b3585292f2af admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.150202 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3133/6209] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:05.156183 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3077/6210] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:05.164243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d6d9-3aac-4889-92db-ee5863da14bf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.165957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d6d9-3aac-4889-92db-ee5863da14bf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.167704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb281-c6a8-4860-ab64-b3585292f2af admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.168125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056d6d9-3aac-4889-92db-ee5863da14bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.200884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d056d6d9-3aac-4889-92db-ee5863da14bf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:05.205175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d056d6d9-3aac-4889-92db-ee5863da14bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:05.205305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb281-c6a8-4860-ab64-b3585292f2af admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.211715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdfa92-1f97-4fe6-b3f5-f9b6a6157484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.212395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfa92-1f97-4fe6-b3f5-f9b6a6157484 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.215515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfa92-1f97-4fe6-b3f5-f9b6a6157484 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.215515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bdfa92-1f97-4fe6-b3f5-f9b6a6157484 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.215515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdfa92-1f97-4fe6-b3f5-f9b6a6157484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.216489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bdfa92-1f97-4fe6-b3f5-f9b6a6157484 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.236891 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3078/6211] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:05.238887 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3134/6212] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:05.240644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdfa92-1f97-4fe6-b3f5-f9b6a6157484 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.244538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d6d9-3aac-4889-92db-ee5863da14bf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.260301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056d6d9-3aac-4889-92db-ee5863da14bf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.278082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532691f-3e66-42af-845a-a1b68fd6f39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.278820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532691f-3e66-42af-845a-a1b68fd6f39a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.279108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532691f-3e66-42af-845a-a1b68fd6f39a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.279222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bdfa92-1f97-4fe6-b3f5-f9b6a6157484 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.279375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532691f-3e66-42af-845a-a1b68fd6f39a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.280160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532691f-3e66-42af-845a-a1b68fd6f39a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:05.280989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532691f-3e66-42af-845a-a1b68fd6f39a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.284013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532691f-3e66-42af-845a-a1b68fd6f39a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.291556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac121-0bf5-4c87-8128-f1c034b86512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.292591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac121-0bf5-4c87-8128-f1c034b86512 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.292909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac121-0bf5-4c87-8128-f1c034b86512 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.301311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ac121-0bf5-4c87-8128-f1c034b86512 admin admin] PATH_INFO: `/v3/projects/a5310eea8ece42b69d7ed6f1e477a0ef/users/29c7c195a16743149f1cd1603fcf1cb4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.315993 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3135/6213] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:05.321065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532691f-3e66-42af-845a-a1b68fd6f39a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.333398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ac121-0bf5-4c87-8128-f1c034b86512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5310eea8ece42b69d7ed6f1e477a0ef, user_id=29c7c195a16743149f1cd1603fcf1cb4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.336663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ac121-0bf5-4c87-8128-f1c034b86512 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.349088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532691f-3e66-42af-845a-a1b68fd6f39a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.359380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0007bd-983b-4195-a6dc-bef12fb7e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.366283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0007bd-983b-4195-a6dc-bef12fb7e8fc admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.366283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0007bd-983b-4195-a6dc-bef12fb7e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.366283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0007bd-983b-4195-a6dc-bef12fb7e8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.366283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0007bd-983b-4195-a6dc-bef12fb7e8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.366283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0007bd-983b-4195-a6dc-bef12fb7e8fc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.390557 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3079/6214] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:05 2022] PUT /identity/v3/projects/a5310eea8ece42b69d7ed6f1e477a0ef/users/29c7c195a16743149f1cd1603fcf1cb4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:05.445958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3136/6215] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:05 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:05.446471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac121-0bf5-4c87-8128-f1c034b86512 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.492608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bd960-dd16-4d46-b9aa-fe516b5d431d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.492869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bd960-dd16-4d46-b9aa-fe516b5d431d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.493364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5bd960-dd16-4d46-b9aa-fe516b5d431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.540521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bc5bd960-dd16-4d46-b9aa-fe516b5d431d None None] MFA Rules not processed for user `29c7c195a16743149f1cd1603fcf1cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:05.541882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bc5bd960-dd16-4d46-b9aa-fe516b5d431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:05.578726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ac121-0bf5-4c87-8128-f1c034b86512 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.691630 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3137/6216] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:10:05.705921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8b60c-43b3-42dc-9acf-38d8db02b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.706868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bd960-dd16-4d46-b9aa-fe516b5d431d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.707028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8b60c-43b3-42dc-9acf-38d8db02b8de admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.707363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8b60c-43b3-42dc-9acf-38d8db02b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.707744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8b60c-43b3-42dc-9acf-38d8db02b8de admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.708304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bc5bd960-dd16-4d46-b9aa-fe516b5d431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:05.708683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8b60c-43b3-42dc-9acf-38d8db02b8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.711295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8b60c-43b3-42dc-9acf-38d8db02b8de admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.776415 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3080/6217] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:05 2022] POST /identity/v3/users => generated 289 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:05.780134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8b60c-43b3-42dc-9acf-38d8db02b8de admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.796294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8b60c-43b3-42dc-9acf-38d8db02b8de admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.804677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac87560-dbc9-4684-b3b6-fbb92eaae942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.805448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac87560-dbc9-4684-b3b6-fbb92eaae942 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.806845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac87560-dbc9-4684-b3b6-fbb92eaae942 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.807347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac87560-dbc9-4684-b3b6-fbb92eaae942 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.808571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac87560-dbc9-4684-b3b6-fbb92eaae942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.813779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5bd960-dd16-4d46-b9aa-fe516b5d431d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.814442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac87560-dbc9-4684-b3b6-fbb92eaae942 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.817494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45facc31-6514-4d59-b852-2a59c05a5c81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.818358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facc31-6514-4d59-b852-2a59c05a5c81 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.819095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facc31-6514-4d59-b852-2a59c05a5c81 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.819428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facc31-6514-4d59-b852-2a59c05a5c81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.821453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-45facc31-6514-4d59-b852-2a59c05a5c81 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:05.838005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3081/6218] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:05.841979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac87560-dbc9-4684-b3b6-fbb92eaae942 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.855753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac87560-dbc9-4684-b3b6-fbb92eaae942 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.861508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823085-1f36-42f5-a0a4-377242668ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.862473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823085-1f36-42f5-a0a4-377242668ddc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.862951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823085-1f36-42f5-a0a4-377242668ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.864100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61823085-1f36-42f5-a0a4-377242668ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.865659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61823085-1f36-42f5-a0a4-377242668ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.868749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61823085-1f36-42f5-a0a4-377242668ddc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.882551 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3082/6219] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:10:05.887858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823085-1f36-42f5-a0a4-377242668ddc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:05.900907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61823085-1f36-42f5-a0a4-377242668ddc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:05.904030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45facc31-6514-4d59-b852-2a59c05a5c81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.906674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45facc31-6514-4d59-b852-2a59c05a5c81 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.908329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166277ab-bd40-4426-8c25-ad419056ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:05.909499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166277ab-bd40-4426-8c25-ad419056ccb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.910730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166277ab-bd40-4426-8c25-ad419056ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.911282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166277ab-bd40-4426-8c25-ad419056ccb3 admin admin] PATH_INFO: `/v3/projects/4d9c59e0a5334f35a4b6c759ba40a4f0/users/b67c94ca763e4d1bb01fa4c3e546b5d6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:05.930247 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3138/6220] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:10:05.934415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166277ab-bd40-4426-8c25-ad419056ccb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9c59e0a5334f35a4b6c759ba40a4f0, user_id=b67c94ca763e4d1bb01fa4c3e546b5d6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:05.938875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166277ab-bd40-4426-8c25-ad419056ccb3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:05.958283 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3083/6221] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:05 2022] PUT /identity/v3/projects/4d9c59e0a5334f35a4b6c759ba40a4f0/users/b67c94ca763e4d1bb01fa4c3e546b5d6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:05.970175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2ebda-b7cc-490e-b0e9-9233e10f042b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:05.970499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2ebda-b7cc-490e-b0e9-9233e10f042b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:05.970783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa2ebda-b7cc-490e-b0e9-9233e10f042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:06.045027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bfa2ebda-b7cc-490e-b0e9-9233e10f042b None None] MFA Rules not processed for user `b67c94ca763e4d1bb01fa4c3e546b5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:06.046475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bfa2ebda-b7cc-490e-b0e9-9233e10f042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:06.208232 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3139/6222] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:06.212485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166277ab-bd40-4426-8c25-ad419056ccb3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:06.350149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166277ab-bd40-4426-8c25-ad419056ccb3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:06.365777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c44935-6ec8-420d-a7fa-9314053b147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:06.366709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c44935-6ec8-420d-a7fa-9314053b147b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:06.367093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c44935-6ec8-420d-a7fa-9314053b147b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:06.367494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c44935-6ec8-420d-a7fa-9314053b147b admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:06.368385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c44935-6ec8-420d-a7fa-9314053b147b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:06.372567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c44935-6ec8-420d-a7fa-9314053b147b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:06.447779 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3084/6223] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:06 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:06.452555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2ebda-b7cc-490e-b0e9-9233e10f042b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:06.471145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa2ebda-b7cc-490e-b0e9-9233e10f042b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:06.590335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1956a36-1834-49b9-924b-870fe156829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:06.591163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1956a36-1834-49b9-924b-870fe156829e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:06.591908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1956a36-1834-49b9-924b-870fe156829e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:06.600189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1956a36-1834-49b9-924b-870fe156829e admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:06.601989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1956a36-1834-49b9-924b-870fe156829e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:06.614532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1956a36-1834-49b9-924b-870fe156829e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:06.643757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c44935-6ec8-420d-a7fa-9314053b147b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:06.665402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c44935-6ec8-420d-a7fa-9314053b147b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:06.679577 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3140/6224] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:06 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:06.688869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1956a36-1834-49b9-924b-870fe156829e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:06.693084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:06.693084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:06.693084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:06.693483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] PATH_INFO: `/v3/users/098369120c914b88a53cdce2e7e8fe08` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:06.699292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] RBAC: Authorizing `identity:delete_user(user_id=098369120c914b88a53cdce2e7e8fe08)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:06.706622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:06.721146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1956a36-1834-49b9-924b-870fe156829e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:06.727044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b421622-9fb9-4638-b781-7e60e3de4023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:06.727714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421622-9fb9-4638-b781-7e60e3de4023 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:06.728014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421622-9fb9-4638-b781-7e60e3de4023 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:06.728910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b421622-9fb9-4638-b781-7e60e3de4023 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:06.730348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421622-9fb9-4638-b781-7e60e3de4023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:06.733883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b421622-9fb9-4638-b781-7e60e3de4023 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:06.751158 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3141/6225] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:06.751158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b421622-9fb9-4638-b781-7e60e3de4023 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:06.753994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8b421622-9fb9-4638-b781-7e60e3de4023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:06.815790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098369120c914b88a53cdce2e7e8fe08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:06.827431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098369120c914b88a53cdce2e7e8fe08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:06.828755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098369120c914b88a53cdce2e7e8fe08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:06.829887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098369120c914b88a53cdce2e7e8fe08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:06.845438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098369120c914b88a53cdce2e7e8fe08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:06.874050 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3085/6226] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:06 2022] DELETE /identity/v3/users/098369120c914b88a53cdce2e7e8fe08 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:06.875133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:06.875247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b421622-9fb9-4638-b781-7e60e3de4023 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:06.877479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:06.970061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181ca42-4057-41b0-92e1-e8344633ca49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:06.970814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ca42-4057-41b0-92e1-e8344633ca49 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:06.971189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ca42-4057-41b0-92e1-e8344633ca49 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:06.971549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181ca42-4057-41b0-92e1-e8344633ca49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:06.978257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c181ca42-4057-41b0-92e1-e8344633ca49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:06.979531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875e9e3-1188-4a0e-9ca0-25b2a9e7184f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:06.987458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b694b-5b1e-4c06-8dea-01161c79eaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:06.992118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b694b-5b1e-4c06-8dea-01161c79eaf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:06.992118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b694b-5b1e-4c06-8dea-01161c79eaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:06.992118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b694b-5b1e-4c06-8dea-01161c79eaf0 admin admin] PATH_INFO: `/v3/projects/dd5280dceeb549a8a8a6872bcd8e1124/users/a068539bb5cb4f299ddb86665b2d2953/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:06.998640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181ca42-4057-41b0-92e1-e8344633ca49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:07.001219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c181ca42-4057-41b0-92e1-e8344633ca49 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:07.022057 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3142/6227] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:07.024262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b694b-5b1e-4c06-8dea-01161c79eaf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5280dceeb549a8a8a6872bcd8e1124, user_id=a068539bb5cb4f299ddb86665b2d2953, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:07.032916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b694b-5b1e-4c06-8dea-01161c79eaf0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:07.039096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb8d69-150f-44db-9906-fa6da0e06661 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:07.039465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb8d69-150f-44db-9906-fa6da0e06661 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:07.039969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb8d69-150f-44db-9906-fa6da0e06661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:07.072951 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3086/6228] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:06 2022] PUT /identity/v3/projects/dd5280dceeb549a8a8a6872bcd8e1124/users/a068539bb5cb4f299ddb86665b2d2953/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:07.078261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b694b-5b1e-4c06-8dea-01161c79eaf0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:07.102911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3feb8d69-150f-44db-9906-fa6da0e06661 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:07.104231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3feb8d69-150f-44db-9906-fa6da0e06661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:07.195399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b694b-5b1e-4c06-8dea-01161c79eaf0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:07.205722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e3e85-eb5d-4f4c-8a7d-bb1a8bb7e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:07.206508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e3e85-eb5d-4f4c-8a7d-bb1a8bb7e695 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:07.206859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e3e85-eb5d-4f4c-8a7d-bb1a8bb7e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:07.207167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e3e85-eb5d-4f4c-8a7d-bb1a8bb7e695 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:07.208454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e3e85-eb5d-4f4c-8a7d-bb1a8bb7e695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:07.209431 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3143/6229] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:07.213575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e3e85-eb5d-4f4c-8a7d-bb1a8bb7e695 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:07.230202 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3087/6230] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:07.232974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb8d69-150f-44db-9906-fa6da0e06661 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:07.254985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb8d69-150f-44db-9906-fa6da0e06661 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:07.260571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6529d8-4a4d-4585-9d24-d0958c26245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:07.261960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6529d8-4a4d-4585-9d24-d0958c26245b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:07.262243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6529d8-4a4d-4585-9d24-d0958c26245b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:07.262953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6529d8-4a4d-4585-9d24-d0958c26245b admin admin] PATH_INFO: `/v3/projects/dd5280dceeb549a8a8a6872bcd8e1124/users/a068539bb5cb4f299ddb86665b2d2953/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:07.265993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6529d8-4a4d-4585-9d24-d0958c26245b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5280dceeb549a8a8a6872bcd8e1124, user_id=a068539bb5cb4f299ddb86665b2d2953, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:07.269753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6529d8-4a4d-4585-9d24-d0958c26245b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:07.294101 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3144/6231] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:07 2022] PUT /identity/v3/projects/dd5280dceeb549a8a8a6872bcd8e1124/users/a068539bb5cb4f299ddb86665b2d2953/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:07.296073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5d7c-a387-4c04-a997-111b197c9cf6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:07.296318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5d7c-a387-4c04-a997-111b197c9cf6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:07.296608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb5d7c-a387-4c04-a997-111b197c9cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:07.300182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6529d8-4a4d-4585-9d24-d0958c26245b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:07.305037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5a6529d8-4a4d-4585-9d24-d0958c26245b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:07.362885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8ebb5d7c-a387-4c04-a997-111b197c9cf6 None None] MFA Rules not processed for user `a068539bb5cb4f299ddb86665b2d2953`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:07.364127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8ebb5d7c-a387-4c04-a997-111b197c9cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:07.451275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6529d8-4a4d-4585-9d24-d0958c26245b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:07.460527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a3197-47f0-4da2-a71c-3ada20db78e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:07.461203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a3197-47f0-4da2-a71c-3ada20db78e4 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:07.461493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a3197-47f0-4da2-a71c-3ada20db78e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:07.461774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659a3197-47f0-4da2-a71c-3ada20db78e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:07.478367 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3088/6232] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:07.483365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5d7c-a387-4c04-a997-111b197c9cf6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:07.508182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb5d7c-a387-4c04-a997-111b197c9cf6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:07.523899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8f465-8bbb-43b7-9575-64e42995a06f tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a068539bb5cb4f299ddb86665b2d2953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5280dceeb549a8a8a6872bcd8e1124', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:07.524772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8f465-8bbb-43b7-9575-64e42995a06f tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:07.525151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8f465-8bbb-43b7-9575-64e42995a06f tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:07.525528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8f465-8bbb-43b7-9575-64e42995a06f tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:07.528416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8f465-8bbb-43b7-9575-64e42995a06f tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:07.535634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8f465-8bbb-43b7-9575-64e42995a06f tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:07.585397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a3197-47f0-4da2-a71c-3ada20db78e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:07.587529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659a3197-47f0-4da2-a71c-3ada20db78e4 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:07.602829 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3089/6233] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:07 2022] POST /identity/v3/projects => generated 334 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:07.604600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e4b6f-e036-4cb2-b972-35e49e039496 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:07.605223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e4b6f-e036-4cb2-b972-35e49e039496 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:07.605734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e4b6f-e036-4cb2-b972-35e49e039496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:07.614293 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3145/6234] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:07.615372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a3197-47f0-4da2-a71c-3ada20db78e4 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:07.627739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659a3197-47f0-4da2-a71c-3ada20db78e4 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:07.672732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c78e4b6f-e036-4cb2-b972-35e49e039496 None None] MFA Rules not processed for user `102a4f93d75c4f219861f8e3e119fd82`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:07.674162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c78e4b6f-e036-4cb2-b972-35e49e039496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:07.744497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446eb82-d619-4737-a076-a0cdd1828b44 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a068539bb5cb4f299ddb86665b2d2953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5280dceeb549a8a8a6872bcd8e1124', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:07.757949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446eb82-d619-4737-a076-a0cdd1828b44 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:07.764480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446eb82-d619-4737-a076-a0cdd1828b44 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:07.765615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446eb82-d619-4737-a076-a0cdd1828b44 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:07.768237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446eb82-d619-4737-a076-a0cdd1828b44 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:07.770645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a446eb82-d619-4737-a076-a0cdd1828b44 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:07.850113 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3090/6235] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:07.866788 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3146/6236] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:10:07 2022] POST /identity/v3/projects => generated 333 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:07.886064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e4b6f-e036-4cb2-b972-35e49e039496 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:07.917272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e4b6f-e036-4cb2-b972-35e49e039496 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:08.055758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e7cbe-675b-4633-ae4e-4d31c1f7fa2a tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a068539bb5cb4f299ddb86665b2d2953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5280dceeb549a8a8a6872bcd8e1124', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:08.057069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e7cbe-675b-4633-ae4e-4d31c1f7fa2a tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:08.057069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e7cbe-675b-4633-ae4e-4d31c1f7fa2a tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:08.057826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e7cbe-675b-4633-ae4e-4d31c1f7fa2a tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:08.058289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e7cbe-675b-4633-ae4e-4d31c1f7fa2a tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:08.062176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e7cbe-675b-4633-ae4e-4d31c1f7fa2a tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:08.135679 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3091/6237] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:07 2022] POST /identity/v3/projects => generated 358 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:08.140414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446eb82-d619-4737-a076-a0cdd1828b44 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:08.189631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446eb82-d619-4737-a076-a0cdd1828b44 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:08.284102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e7cbe-675b-4633-ae4e-4d31c1f7fa2a tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:08.286847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-439e7cbe-675b-4633-ae4e-4d31c1f7fa2a tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:08.386856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1016-c7df-4b25-ac4f-8dc6aebf6af8 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a068539bb5cb4f299ddb86665b2d2953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5280dceeb549a8a8a6872bcd8e1124', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:08.388553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1016-c7df-4b25-ac4f-8dc6aebf6af8 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:08.388553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1016-c7df-4b25-ac4f-8dc6aebf6af8 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:08.388553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce1016-c7df-4b25-ac4f-8dc6aebf6af8 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:08.390147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce1016-c7df-4b25-ac4f-8dc6aebf6af8 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:08.390952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce1016-c7df-4b25-ac4f-8dc6aebf6af8 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:08.464335 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3147/6238] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Mar 26 21:10:08 2022] GET /identity/v3/projects => generated 7272 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:08.470333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1016-c7df-4b25-ac4f-8dc6aebf6af8 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:08.497638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce1016-c7df-4b25-ac4f-8dc6aebf6af8 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:08.509303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ec96-a5b4-45bb-89ff-7699639a6d75 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a068539bb5cb4f299ddb86665b2d2953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5280dceeb549a8a8a6872bcd8e1124', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:08.510118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ec96-a5b4-45bb-89ff-7699639a6d75 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:08.510837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ec96-a5b4-45bb-89ff-7699639a6d75 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:08.510837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8ec96-a5b4-45bb-89ff-7699639a6d75 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:08.511573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8ec96-a5b4-45bb-89ff-7699639a6d75 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:08.511999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8ec96-a5b4-45bb-89ff-7699639a6d75 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:08.513817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce8ec96-a5b4-45bb-89ff-7699639a6d75 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:08.538014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e7cbe-675b-4633-ae4e-4d31c1f7fa2a tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:08.569605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:08.577455 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3148/6239] 10.222.0.16 () {58 vars in 1157 bytes} [Sat Mar 26 21:10:08 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:08.578577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:08.578768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ec96-a5b4-45bb-89ff-7699639a6d75 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:08.580061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:08.581512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] PATH_INFO: `/v3/projects/395fee6a7d044c32ab96865a7ad75193` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:08.586688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=395fee6a7d044c32ab96865a7ad75193)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:08.597371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8ec96-a5b4-45bb-89ff-7699639a6d75 tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:08.599027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:08.614164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f62d7-1fb8-4d28-af7d-c1e90f2a960c tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a068539bb5cb4f299ddb86665b2d2953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5280dceeb549a8a8a6872bcd8e1124', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:08.615571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f62d7-1fb8-4d28-af7d-c1e90f2a960c tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:08.615571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f62d7-1fb8-4d28-af7d-c1e90f2a960c tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:08.615571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951f62d7-1fb8-4d28-af7d-c1e90f2a960c tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:08.616003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f62d7-1fb8-4d28-af7d-c1e90f2a960c tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Adding query filter params (parent_id=f68709f0656b4b22b612766b357092b5) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:08.616102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f62d7-1fb8-4d28-af7d-c1e90f2a960c tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:08.620323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951f62d7-1fb8-4d28-af7d-c1e90f2a960c tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:08.661897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3149/6240] 10.222.0.16 () {58 vars in 1215 bytes} [Sat Mar 26 21:10:08 2022] GET /identity/v3/projects?parent_id=f68709f0656b4b22b612766b357092b5 => generated 498 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:10:08.667761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f62d7-1fb8-4d28-af7d-c1e90f2a960c tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:08.698180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951f62d7-1fb8-4d28-af7d-c1e90f2a960c tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:08.707370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a068539bb5cb4f299ddb86665b2d2953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5280dceeb549a8a8a6872bcd8e1124', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:08.707978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:08.708268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:08.708544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] PATH_INFO: `/v3/projects/1b2f05512380447a8cf998cccd92f032` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:08.709927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1b2f05512380447a8cf998cccd92f032)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:08.712494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:08.773160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395fee6a7d044c32ab96865a7ad75193', 'request_id': 'req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.788244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395fee6a7d044c32ab96865a7ad75193', 'request_id': 'req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.806343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395fee6a7d044c32ab96865a7ad75193', 'request_id': 'req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.836580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b2f05512380447a8cf998cccd92f032', 'request_id': 'req-68434872-65c0-45bc-bef8-b134b417afbf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.845653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] The token cache is being invalidate because project 395fee6a7d044c32ab96865a7ad75193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:08.846181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.847994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.852539 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3092/6241] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:08 2022] DELETE /identity/v3/projects/395fee6a7d044c32ab96865a7ad75193 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:08.855861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:08.857825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:08.888414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b2f05512380447a8cf998cccd92f032', 'request_id': 'req-68434872-65c0-45bc-bef8-b134b417afbf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.910346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b2f05512380447a8cf998cccd92f032', 'request_id': 'req-68434872-65c0-45bc-bef8-b134b417afbf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.938070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] The token cache is being invalidate because project 1b2f05512380447a8cf998cccd92f032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:08.938640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.939429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:08.943945 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3150/6242] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:08 2022] DELETE /identity/v3/projects/1b2f05512380447a8cf998cccd92f032 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:08.945082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:08.946889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:08.974976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148974-8170-49f1-bf6d-92a1cb2ac4bb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:09.063619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:09.066062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:09.067687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:09.069126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] PATH_INFO: `/v3/users/29c7c195a16743149f1cd1603fcf1cb4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:09.072033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c7c195a16743149f1cd1603fcf1cb4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:09.073058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:09.082369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68434872-65c0-45bc-bef8-b134b417afbf tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:09.089098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a068539bb5cb4f299ddb86665b2d2953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5280dceeb549a8a8a6872bcd8e1124', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:09.104976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:09.105511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:09.106010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] PATH_INFO: `/v3/projects/f68709f0656b4b22b612766b357092b5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:09.110479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f68709f0656b4b22b612766b357092b5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:09.113118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:09.178367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c7c195a16743149f1cd1603fcf1cb4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.203864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c7c195a16743149f1cd1603fcf1cb4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.203864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c7c195a16743149f1cd1603fcf1cb4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.203864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c7c195a16743149f1cd1603fcf1cb4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.227091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c7c195a16743149f1cd1603fcf1cb4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.250350 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3093/6243] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:08 2022] DELETE /identity/v3/users/29c7c195a16743149f1cd1603fcf1cb4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:09.251556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68709f0656b4b22b612766b357092b5', 'request_id': 'req-c913b31c-acfd-434c-a776-9947252d1f3e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.267736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68709f0656b4b22b612766b357092b5', 'request_id': 'req-c913b31c-acfd-434c-a776-9947252d1f3e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.281268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68709f0656b4b22b612766b357092b5', 'request_id': 'req-c913b31c-acfd-434c-a776-9947252d1f3e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.317284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] The token cache is being invalidate because project f68709f0656b4b22b612766b357092b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:09.317669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.318721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.320754 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3151/6244] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:08 2022] DELETE /identity/v3/projects/f68709f0656b4b22b612766b357092b5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:09.329615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:09.341148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:09.583680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53c936-836b-4818-9cb6-4726ce5a30ee admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:09.598551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a068539bb5cb4f299ddb86665b2d2953', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5280dceeb549a8a8a6872bcd8e1124', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:09.599827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:09.600535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:09.600930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] PATH_INFO: `/v3/projects/9f524655f0fb494c8a46f24ab13f72d7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:09.605257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9f524655f0fb494c8a46f24ab13f72d7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:09.607357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:09.738999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f524655f0fb494c8a46f24ab13f72d7', 'request_id': 'req-32a3a345-01ce-4847-812f-67eff7395adc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.770381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f524655f0fb494c8a46f24ab13f72d7', 'request_id': 'req-32a3a345-01ce-4847-812f-67eff7395adc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.806267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f524655f0fb494c8a46f24ab13f72d7', 'request_id': 'req-32a3a345-01ce-4847-812f-67eff7395adc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.846410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] The token cache is being invalidate because project 9f524655f0fb494c8a46f24ab13f72d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:09.846852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.847776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:09.851748 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3094/6245] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:09 2022] DELETE /identity/v3/projects/9f524655f0fb494c8a46f24ab13f72d7 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:09.854622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:09.856804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:10.006725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913b31c-acfd-434c-a776-9947252d1f3e tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:10.217010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:10.223475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:10.247632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:10.248181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] PATH_INFO: `/v3/users/b67c94ca763e4d1bb01fa4c3e546b5d6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:10.257772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b67c94ca763e4d1bb01fa4c3e546b5d6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:10.260291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:10.389073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b67c94ca763e4d1bb01fa4c3e546b5d6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.399651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b67c94ca763e4d1bb01fa4c3e546b5d6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.400998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b67c94ca763e4d1bb01fa4c3e546b5d6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.402107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b67c94ca763e4d1bb01fa4c3e546b5d6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.424813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bc4047b-af26-45b8-9226-c10b7e9283f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b67c94ca763e4d1bb01fa4c3e546b5d6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.495744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:10.497390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:10.533106 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3152/6246] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:09 2022] DELETE /identity/v3/users/b67c94ca763e4d1bb01fa4c3e546b5d6 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:10.535124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba08402-cacd-4303-a1dd-e895c4f17eb4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:10.535503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba08402-cacd-4303-a1dd-e895c4f17eb4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:10.536031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba08402-cacd-4303-a1dd-e895c4f17eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:10.543115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3a345-01ce-4847-812f-67eff7395adc tempest-ListProjectsTestJSON-771584996 tempest-ListProjectsTestJSON-771584996-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:10.589922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bba08402-cacd-4303-a1dd-e895c4f17eb4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:10.593713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bba08402-cacd-4303-a1dd-e895c4f17eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:10.718433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:10.719464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:10.719870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:10.720284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] PATH_INFO: `/v3/projects/a5310eea8ece42b69d7ed6f1e477a0ef` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:10.723023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5310eea8ece42b69d7ed6f1e477a0ef)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:10.726252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:10.750940 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3153/6247] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:10.762149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba08402-cacd-4303-a1dd-e895c4f17eb4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:10.767447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bba08402-cacd-4303-a1dd-e895c4f17eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:10.860670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5310eea8ece42b69d7ed6f1e477a0ef', 'request_id': 'req-43de132f-0a16-4516-9bf4-9d45b551a507'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.914438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5310eea8ece42b69d7ed6f1e477a0ef', 'request_id': 'req-43de132f-0a16-4516-9bf4-9d45b551a507'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.936348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5310eea8ece42b69d7ed6f1e477a0ef', 'request_id': 'req-43de132f-0a16-4516-9bf4-9d45b551a507'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.972850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba08402-cacd-4303-a1dd-e895c4f17eb4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:10.980182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] The token cache is being invalidate because project a5310eea8ece42b69d7ed6f1e477a0ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:10.986469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.990759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-43de132f-0a16-4516-9bf4-9d45b551a507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:10.997550 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3095/6248] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:10 2022] DELETE /identity/v3/projects/a5310eea8ece42b69d7ed6f1e477a0ef => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:11.012330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e971-f35c-4ee9-936a-de05d0fa6746 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:11.012330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e971-f35c-4ee9-936a-de05d0fa6746 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:11.012330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e971-f35c-4ee9-936a-de05d0fa6746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:11.049624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-89f1e971-f35c-4ee9-936a-de05d0fa6746 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:11.051443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-89f1e971-f35c-4ee9-936a-de05d0fa6746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:11.058814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8418b-7881-4a5a-acb6-8b8bb774fd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:11.059717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8418b-7881-4a5a-acb6-8b8bb774fd0e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:11.060519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8418b-7881-4a5a-acb6-8b8bb774fd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:11.062069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8418b-7881-4a5a-acb6-8b8bb774fd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:11.067883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cde8418b-7881-4a5a-acb6-8b8bb774fd0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:11.155846 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3096/6249] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:10:11.159117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e971-f35c-4ee9-936a-de05d0fa6746 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:11.164855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-89f1e971-f35c-4ee9-936a-de05d0fa6746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:11.192091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e971-f35c-4ee9-936a-de05d0fa6746 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:11.214924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20364ffd-f23e-4233-92b3-7fda3ceb887b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:11.215794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20364ffd-f23e-4233-92b3-7fda3ceb887b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:11.216120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20364ffd-f23e-4233-92b3-7fda3ceb887b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:11.216406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20364ffd-f23e-4233-92b3-7fda3ceb887b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:11.218402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8418b-7881-4a5a-acb6-8b8bb774fd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:11.223090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8418b-7881-4a5a-acb6-8b8bb774fd0e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:11.226127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-20364ffd-f23e-4233-92b3-7fda3ceb887b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:11.246575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20364ffd-f23e-4233-92b3-7fda3ceb887b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:11.248330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20364ffd-f23e-4233-92b3-7fda3ceb887b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:11.254869 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3154/6250] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:11.265204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f131b7-297f-4e50-91d8-5ba2ebbcbb92 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:11.265741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f131b7-297f-4e50-91d8-5ba2ebbcbb92 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:11.266031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f131b7-297f-4e50-91d8-5ba2ebbcbb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:11.284869 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3097/6251] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:11.335562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-70f131b7-297f-4e50-91d8-5ba2ebbcbb92 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:11.337655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-70f131b7-297f-4e50-91d8-5ba2ebbcbb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:11.360403 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3155/6252] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:11.368322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20364ffd-f23e-4233-92b3-7fda3ceb887b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:11.427425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20364ffd-f23e-4233-92b3-7fda3ceb887b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:11.450043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0a31-0657-4a66-8487-4d95ffeb2ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:11.451137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0a31-0657-4a66-8487-4d95ffeb2ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:11.451454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0a31-0657-4a66-8487-4d95ffeb2ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:11.457474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0a31-0657-4a66-8487-4d95ffeb2ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:11.457474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0a31-0657-4a66-8487-4d95ffeb2ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:11.457474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0a31-0657-4a66-8487-4d95ffeb2ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:11.457474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0a31-0657-4a66-8487-4d95ffeb2ae3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:11.491262 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3098/6253] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:11.493598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f131b7-297f-4e50-91d8-5ba2ebbcbb92 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:11.511979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f131b7-297f-4e50-91d8-5ba2ebbcbb92 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:11.535398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c5df3-1d0d-4562-89b3-068529d82e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:11.536213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c5df3-1d0d-4562-89b3-068529d82e6b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:11.536561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c5df3-1d0d-4562-89b3-068529d82e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:11.536899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c5df3-1d0d-4562-89b3-068529d82e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:11.537602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c5df3-1d0d-4562-89b3-068529d82e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:11.540760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c5df3-1d0d-4562-89b3-068529d82e6b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:11.590282 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3156/6254] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:11 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:11.597859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0a31-0657-4a66-8487-4d95ffeb2ae3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:11.615675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0a31-0657-4a66-8487-4d95ffeb2ae3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:11.745326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e324fe-1d59-45a3-b666-1eb78975999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:11.746026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e324fe-1d59-45a3-b666-1eb78975999f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:11.746355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e324fe-1d59-45a3-b666-1eb78975999f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:11.746646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e324fe-1d59-45a3-b666-1eb78975999f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:11.747488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e324fe-1d59-45a3-b666-1eb78975999f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:11.752765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e324fe-1d59-45a3-b666-1eb78975999f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:11.810538 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3099/6255] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:11 2022] POST /identity/v3/users => generated 303 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:11.818337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c5df3-1d0d-4562-89b3-068529d82e6b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:11.834702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c5df3-1d0d-4562-89b3-068529d82e6b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:11.847967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e751393-9903-45a2-9cfc-151dc46b09e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:11.849109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e751393-9903-45a2-9cfc-151dc46b09e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:11.849445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e751393-9903-45a2-9cfc-151dc46b09e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:11.849695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e751393-9903-45a2-9cfc-151dc46b09e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:11.850465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e751393-9903-45a2-9cfc-151dc46b09e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:11.852279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e751393-9903-45a2-9cfc-151dc46b09e9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:11.881852 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3157/6256] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:11.886233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e324fe-1d59-45a3-b666-1eb78975999f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:11.915476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e324fe-1d59-45a3-b666-1eb78975999f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:11.927245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1381ba-3e49-49e8-a3cf-1d84f4b40c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:11.927904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1381ba-3e49-49e8-a3cf-1d84f4b40c6b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:11.928253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1381ba-3e49-49e8-a3cf-1d84f4b40c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:11.928562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1381ba-3e49-49e8-a3cf-1d84f4b40c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:11.929738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1381ba-3e49-49e8-a3cf-1d84f4b40c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:11.940697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1381ba-3e49-49e8-a3cf-1d84f4b40c6b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:11.967430 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3100/6257] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:11.980495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e751393-9903-45a2-9cfc-151dc46b09e9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:12.007563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e751393-9903-45a2-9cfc-151dc46b09e9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:12.024334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f39fd-8de0-4878-8f54-5fd5447c745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:12.025887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f39fd-8de0-4878-8f54-5fd5447c745f admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:12.026254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f39fd-8de0-4878-8f54-5fd5447c745f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:12.026640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f39fd-8de0-4878-8f54-5fd5447c745f admin admin] PATH_INFO: `/v3/projects/7562193827df467bb40fa31857362ff5/users/f4cf1a4ac5a24a10ba2b07eacca36328/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:12.057652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f39fd-8de0-4878-8f54-5fd5447c745f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7562193827df467bb40fa31857362ff5, user_id=f4cf1a4ac5a24a10ba2b07eacca36328, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:12.063511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f39fd-8de0-4878-8f54-5fd5447c745f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:12.090997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3158/6258] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:11 2022] PUT /identity/v3/projects/7562193827df467bb40fa31857362ff5/users/f4cf1a4ac5a24a10ba2b07eacca36328/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:12.102649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a441c-7858-4771-804d-4c9194766e41 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:12.102938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a441c-7858-4771-804d-4c9194766e41 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:12.103223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a441c-7858-4771-804d-4c9194766e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:12.153310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9f8a441c-7858-4771-804d-4c9194766e41 None None] MFA Rules not processed for user `f4cf1a4ac5a24a10ba2b07eacca36328`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:12.154657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9f8a441c-7858-4771-804d-4c9194766e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:12.242663 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3101/6259] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:12.244296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f39fd-8de0-4878-8f54-5fd5447c745f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:12.333010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f39fd-8de0-4878-8f54-5fd5447c745f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:12.341863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac62cc-790a-4025-8aaf-451517c82074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:12.343015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac62cc-790a-4025-8aaf-451517c82074 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:12.343529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac62cc-790a-4025-8aaf-451517c82074 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:12.344039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac62cc-790a-4025-8aaf-451517c82074 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:12.345938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac62cc-790a-4025-8aaf-451517c82074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:12.349907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac62cc-790a-4025-8aaf-451517c82074 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:12.416741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a441c-7858-4771-804d-4c9194766e41 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:12.418369 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3159/6260] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:12 2022] POST /identity/v3/projects => generated 405 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:12.429336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a441c-7858-4771-804d-4c9194766e41 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:12.598112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f66ca7-9a83-4391-b37c-7b9e6ae073e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:12.599611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f66ca7-9a83-4391-b37c-7b9e6ae073e9 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:12.599895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f66ca7-9a83-4391-b37c-7b9e6ae073e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:12.600272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f66ca7-9a83-4391-b37c-7b9e6ae073e9 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:12.600993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f66ca7-9a83-4391-b37c-7b9e6ae073e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:12.602999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f66ca7-9a83-4391-b37c-7b9e6ae073e9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:12.694188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac62cc-790a-4025-8aaf-451517c82074 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:12.709326 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3102/6261] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:12 2022] POST /identity/v3/users => generated 309 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:12.711860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac62cc-790a-4025-8aaf-451517c82074 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:12.719586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70803fea-9ae9-4fff-b13a-a37c4d20e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:12.720054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70803fea-9ae9-4fff-b13a-a37c4d20e605 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:12.720684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70803fea-9ae9-4fff-b13a-a37c4d20e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:12.720684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70803fea-9ae9-4fff-b13a-a37c4d20e605 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:12.721318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70803fea-9ae9-4fff-b13a-a37c4d20e605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:12.723041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70803fea-9ae9-4fff-b13a-a37c4d20e605 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:12.756135 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3160/6262] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:12.760423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f66ca7-9a83-4391-b37c-7b9e6ae073e9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:12.775601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f66ca7-9a83-4391-b37c-7b9e6ae073e9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:12.789295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aceda-f6ee-4fff-817d-407b2d1d50b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:12.790797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aceda-f6ee-4fff-817d-407b2d1d50b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:12.790797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aceda-f6ee-4fff-817d-407b2d1d50b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:12.791879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1aceda-f6ee-4fff-817d-407b2d1d50b1 admin admin] PATH_INFO: `/v3/projects/596ee8810125431d954b80477f5e5ec2/users/bcff5001ffae4d9a8dd5e8e100330ab6/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:12.850431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aceda-f6ee-4fff-817d-407b2d1d50b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596ee8810125431d954b80477f5e5ec2, user_id=bcff5001ffae4d9a8dd5e8e100330ab6, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:12.852887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1aceda-f6ee-4fff-817d-407b2d1d50b1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:12.877648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70803fea-9ae9-4fff-b13a-a37c4d20e605 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:12.880154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-70803fea-9ae9-4fff-b13a-a37c4d20e605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:12.884022 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3103/6263] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:12 2022] PUT /identity/v3/projects/596ee8810125431d954b80477f5e5ec2/users/bcff5001ffae4d9a8dd5e8e100330ab6/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:12.896008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aceda-f6ee-4fff-817d-407b2d1d50b1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:12.915489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70803fea-9ae9-4fff-b13a-a37c4d20e605 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:13.058686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1aceda-f6ee-4fff-817d-407b2d1d50b1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:13.075320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27706589-0fe8-41be-8831-4bded4a5af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:13.076401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27706589-0fe8-41be-8831-4bded4a5af7a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:13.077503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27706589-0fe8-41be-8831-4bded4a5af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:13.077912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27706589-0fe8-41be-8831-4bded4a5af7a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:13.080213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27706589-0fe8-41be-8831-4bded4a5af7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:13.082325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27706589-0fe8-41be-8831-4bded4a5af7a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:13.096683 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3104/6264] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:13.100635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27706589-0fe8-41be-8831-4bded4a5af7a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:13.118408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27706589-0fe8-41be-8831-4bded4a5af7a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:13.125184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b23025-9839-4e76-a6ee-bbf902c9d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:13.126453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b23025-9839-4e76-a6ee-bbf902c9d8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:13.126999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b23025-9839-4e76-a6ee-bbf902c9d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:13.127537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b23025-9839-4e76-a6ee-bbf902c9d8b5 admin admin] PATH_INFO: `/v3/projects/596ee8810125431d954b80477f5e5ec2/users/bcff5001ffae4d9a8dd5e8e100330ab6/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:13.133139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b23025-9839-4e76-a6ee-bbf902c9d8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596ee8810125431d954b80477f5e5ec2, user_id=bcff5001ffae4d9a8dd5e8e100330ab6, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:13.136784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b23025-9839-4e76-a6ee-bbf902c9d8b5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:13.158406 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3105/6265] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:13 2022] PUT /identity/v3/projects/596ee8810125431d954b80477f5e5ec2/users/bcff5001ffae4d9a8dd5e8e100330ab6/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:13.173466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:13.174401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:13.174723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:13.175010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] PATH_INFO: `/v3/projects/4d9c59e0a5334f35a4b6c759ba40a4f0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:13.176715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de872b-d83d-4948-819a-5c1becd3effd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:13.176958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de872b-d83d-4948-819a-5c1becd3effd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:13.179500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de872b-d83d-4948-819a-5c1becd3effd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:13.182954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9c59e0a5334f35a4b6c759ba40a4f0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:13.185102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:13.238118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-51de872b-d83d-4948-819a-5c1becd3effd None None] MFA Rules not processed for user `bcff5001ffae4d9a8dd5e8e100330ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:13.239872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-51de872b-d83d-4948-819a-5c1becd3effd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:13.298601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9c59e0a5334f35a4b6c759ba40a4f0', 'request_id': 'req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.316801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9c59e0a5334f35a4b6c759ba40a4f0', 'request_id': 'req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.328265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9c59e0a5334f35a4b6c759ba40a4f0', 'request_id': 'req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.364314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] The token cache is being invalidate because project 4d9c59e0a5334f35a4b6c759ba40a4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:13.364764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.365583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.370827 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3161/6266] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:12 2022] DELETE /identity/v3/projects/4d9c59e0a5334f35a4b6c759ba40a4f0 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:13.372712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:13.374231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:13.421385 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3106/6267] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:13.457183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de872b-d83d-4948-819a-5c1becd3effd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:13.459855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-51de872b-d83d-4948-819a-5c1becd3effd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:13.499688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb69111-c5f2-40e5-8f7c-f568ca45aa8f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:13.510019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:13.516398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:13.516768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:13.517533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] PATH_INFO: `/v3/users/a068539bb5cb4f299ddb86665b2d2953` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:13.521837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a068539bb5cb4f299ddb86665b2d2953)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:13.526504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:13.613304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de872b-d83d-4948-819a-5c1becd3effd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:13.684403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a068539bb5cb4f299ddb86665b2d2953'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.710695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a068539bb5cb4f299ddb86665b2d2953'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.712123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a068539bb5cb4f299ddb86665b2d2953'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.713385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a068539bb5cb4f299ddb86665b2d2953'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.736322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a068539bb5cb4f299ddb86665b2d2953'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:13.753579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:13.755259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:13.755910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:13.756292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:13.758840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:13.784628 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3162/6268] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:13 2022] DELETE /identity/v3/users/a068539bb5cb4f299ddb86665b2d2953 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:13.880869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:13.882505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:13.926296 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3107/6269] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:13 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:14.496490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:14.498675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:14.632260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ad1d6-f6d3-4745-877b-bf772a2f4b12 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:14.640942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:14.641718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:14.642179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:14.642592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:14.646255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:14.670260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:14.671990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:14.690590 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3163/6270] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:15.012740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:15.016506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:15.050438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a43cd9-fe59-459e-b4ac-130bc6c55c79 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:15.150198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:15.151629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:15.152135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:15.153607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:15.155080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:15.164205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] PATH_INFO: `/v3/projects/dd5280dceeb549a8a8a6872bcd8e1124` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:15.166656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5280dceeb549a8a8a6872bcd8e1124)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:15.170184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:15.180439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e17b85-a127-478f-96bb-99c7f0e3c6ee service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:15.194846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06b029-bac6-4007-99b4-4bb86d9b5d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:15.196341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06b029-bac6-4007-99b4-4bb86d9b5d8c service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:15.196821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06b029-bac6-4007-99b4-4bb86d9b5d8c service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:15.197899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06b029-bac6-4007-99b4-4bb86d9b5d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:15.201536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8f06b029-bac6-4007-99b4-4bb86d9b5d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:15.254592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5280dceeb549a8a8a6872bcd8e1124', 'request_id': 'req-d69b8f57-4019-4cb3-841e-f4f216c50555'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:15.273639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5280dceeb549a8a8a6872bcd8e1124', 'request_id': 'req-d69b8f57-4019-4cb3-841e-f4f216c50555'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:15.292235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5280dceeb549a8a8a6872bcd8e1124', 'request_id': 'req-d69b8f57-4019-4cb3-841e-f4f216c50555'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:15.314302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] The token cache is being invalidate because project dd5280dceeb549a8a8a6872bcd8e1124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:15.314622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:15.315605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b8f57-4019-4cb3-841e-f4f216c50555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:15.321622 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3108/6271] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:15 2022] DELETE /identity/v3/projects/dd5280dceeb549a8a8a6872bcd8e1124 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:15.323156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d6c9c-03c2-4dcc-a481-db518bcf0673 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:15.323504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d6c9c-03c2-4dcc-a481-db518bcf0673 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:15.324393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d6c9c-03c2-4dcc-a481-db518bcf0673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:15.340709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06b029-bac6-4007-99b4-4bb86d9b5d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:15.348964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06b029-bac6-4007-99b4-4bb86d9b5d8c service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:15.353384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c40d6c9c-03c2-4dcc-a481-db518bcf0673 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:15.354680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c40d6c9c-03c2-4dcc-a481-db518bcf0673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:15.366219 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3164/6272] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:15 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:15.459199 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3109/6273] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:15.466400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc767750-e565-4169-b7fb-a9ad62a3d8bd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:15.466724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc767750-e565-4169-b7fb-a9ad62a3d8bd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:15.468160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc767750-e565-4169-b7fb-a9ad62a3d8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:15.512764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dc767750-e565-4169-b7fb-a9ad62a3d8bd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:15.519576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dc767750-e565-4169-b7fb-a9ad62a3d8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:15.544388 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3165/6274] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:15.546939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d6c9c-03c2-4dcc-a481-db518bcf0673 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:15.576189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d6c9c-03c2-4dcc-a481-db518bcf0673 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:15.592266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46232e-74de-43d7-8305-c3e4c3160262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:15.593729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46232e-74de-43d7-8305-c3e4c3160262 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:15.594172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46232e-74de-43d7-8305-c3e4c3160262 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:15.594460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46232e-74de-43d7-8305-c3e4c3160262 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:15.595382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46232e-74de-43d7-8305-c3e4c3160262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:15.596034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46232e-74de-43d7-8305-c3e4c3160262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:15.597836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46232e-74de-43d7-8305-c3e4c3160262 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:15.631064 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3110/6275] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:15.632538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc767750-e565-4169-b7fb-a9ad62a3d8bd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:15.644011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc767750-e565-4169-b7fb-a9ad62a3d8bd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:15.651689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7606f-ad5b-4a62-a27b-5699fb8cacd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:15.652948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7606f-ad5b-4a62-a27b-5699fb8cacd0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:15.654041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7606f-ad5b-4a62-a27b-5699fb8cacd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:15.654568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7606f-ad5b-4a62-a27b-5699fb8cacd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:15.656231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7606f-ad5b-4a62-a27b-5699fb8cacd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:15.658606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7606f-ad5b-4a62-a27b-5699fb8cacd0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:15.716909 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3166/6276] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:15 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:15.721610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46232e-74de-43d7-8305-c3e4c3160262 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:15.752585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46232e-74de-43d7-8305-c3e4c3160262 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:15.935411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa86e-e655-4b67-8017-d0e570f50c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:15.936844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa86e-e655-4b67-8017-d0e570f50c7f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:15.937599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa86e-e655-4b67-8017-d0e570f50c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:15.938052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fa86e-e655-4b67-8017-d0e570f50c7f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:15.939020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fa86e-e655-4b67-8017-d0e570f50c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:15.942016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fa86e-e655-4b67-8017-d0e570f50c7f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:15.974442 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3111/6277] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:15 2022] POST /identity/v3/users => generated 284 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:15.980524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7606f-ad5b-4a62-a27b-5699fb8cacd0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:16.019901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7606f-ad5b-4a62-a27b-5699fb8cacd0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:16.034153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508aa45d-2682-430c-9e51-3dbb757e73c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:16.036401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508aa45d-2682-430c-9e51-3dbb757e73c8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:16.037353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508aa45d-2682-430c-9e51-3dbb757e73c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:16.037901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508aa45d-2682-430c-9e51-3dbb757e73c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:16.040479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508aa45d-2682-430c-9e51-3dbb757e73c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:16.043510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508aa45d-2682-430c-9e51-3dbb757e73c8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:16.058350 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3167/6278] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:16.064565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa86e-e655-4b67-8017-d0e570f50c7f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:16.079630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fa86e-e655-4b67-8017-d0e570f50c7f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:16.089113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5aa83-41eb-465e-8ba6-47a9fa2c90e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:16.090082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5aa83-41eb-465e-8ba6-47a9fa2c90e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:16.090614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5aa83-41eb-465e-8ba6-47a9fa2c90e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:16.092722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5aa83-41eb-465e-8ba6-47a9fa2c90e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:16.093657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5aa83-41eb-465e-8ba6-47a9fa2c90e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:16.095906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5aa83-41eb-465e-8ba6-47a9fa2c90e9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:16.118155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508aa45d-2682-430c-9e51-3dbb757e73c8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:16.127894 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3112/6279] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:16.138394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508aa45d-2682-430c-9e51-3dbb757e73c8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:16.173029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ec222-bfcc-4eaa-aa74-9672eabd3591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:16.177886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ec222-bfcc-4eaa-aa74-9672eabd3591 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:16.193018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ec222-bfcc-4eaa-aa74-9672eabd3591 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:16.193400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ec222-bfcc-4eaa-aa74-9672eabd3591 admin admin] PATH_INFO: `/v3/projects/668f5214a74b47368c0f369a97b95332/users/ddf5c9049fd34e3c8393c1814d55555c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:16.259250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ec222-bfcc-4eaa-aa74-9672eabd3591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=668f5214a74b47368c0f369a97b95332, user_id=ddf5c9049fd34e3c8393c1814d55555c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:16.266282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ec222-bfcc-4eaa-aa74-9672eabd3591 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:16.283622 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3168/6280] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:16 2022] PUT /identity/v3/projects/668f5214a74b47368c0f369a97b95332/users/ddf5c9049fd34e3c8393c1814d55555c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:16.297039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0658f2-54b1-4080-a620-36e3095591d9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:16.297363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0658f2-54b1-4080-a620-36e3095591d9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:16.297696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0658f2-54b1-4080-a620-36e3095591d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:16.369777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-de0658f2-54b1-4080-a620-36e3095591d9 None None] MFA Rules not processed for user `ddf5c9049fd34e3c8393c1814d55555c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:16.371014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-de0658f2-54b1-4080-a620-36e3095591d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:16.532185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ec222-bfcc-4eaa-aa74-9672eabd3591 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:16.532764 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3113/6281] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:16.672492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ec222-bfcc-4eaa-aa74-9672eabd3591 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:16.680439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3b332-e506-4f6f-8082-35d676fe81cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:16.681182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3b332-e506-4f6f-8082-35d676fe81cb admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:16.681542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3b332-e506-4f6f-8082-35d676fe81cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:16.681894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3b332-e506-4f6f-8082-35d676fe81cb admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:16.683179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3b332-e506-4f6f-8082-35d676fe81cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:16.689256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a3b332-e506-4f6f-8082-35d676fe81cb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:16.728923 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3169/6282] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:16 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:16.733528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0658f2-54b1-4080-a620-36e3095591d9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:16.761608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0658f2-54b1-4080-a620-36e3095591d9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:16.837201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c681ac5-2f7c-435f-a623-bc4dde30a0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:16.838027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c681ac5-2f7c-435f-a623-bc4dde30a0da admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:16.838323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c681ac5-2f7c-435f-a623-bc4dde30a0da admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:16.838606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c681ac5-2f7c-435f-a623-bc4dde30a0da admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:16.839480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c681ac5-2f7c-435f-a623-bc4dde30a0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:16.843446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c681ac5-2f7c-435f-a623-bc4dde30a0da admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:16.883264 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3114/6283] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:16 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:16.888795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3b332-e506-4f6f-8082-35d676fe81cb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:16.925259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23b9f8-4a78-4374-a98c-1fd9384e967b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:16.925466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23b9f8-4a78-4374-a98c-1fd9384e967b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:16.925691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23b9f8-4a78-4374-a98c-1fd9384e967b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:16.935951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3b332-e506-4f6f-8082-35d676fe81cb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:16.948328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349560df-44eb-4622-baf8-647d00df1c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:16.950525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349560df-44eb-4622-baf8-647d00df1c25 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:16.950826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349560df-44eb-4622-baf8-647d00df1c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:16.952758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349560df-44eb-4622-baf8-647d00df1c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:16.953647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349560df-44eb-4622-baf8-647d00df1c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:16.956170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349560df-44eb-4622-baf8-647d00df1c25 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:16.962910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6f23b9f8-4a78-4374-a98c-1fd9384e967b None None] MFA Rules not processed for user `54a09bedd0ad4328b1e687fc5f7e3967`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:16.967169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f23b9f8-4a78-4374-a98c-1fd9384e967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:16.978814 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3170/6284] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:16.983428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349560df-44eb-4622-baf8-647d00df1c25 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:17.015237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349560df-44eb-4622-baf8-647d00df1c25 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:17.047292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f98a3-b8aa-4bdb-b415-4256129a0689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:17.049177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f98a3-b8aa-4bdb-b415-4256129a0689 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:17.049944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f98a3-b8aa-4bdb-b415-4256129a0689 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:17.050462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f98a3-b8aa-4bdb-b415-4256129a0689 admin admin] PATH_INFO: `/v3/projects/a25fc8cec09f4d8784c7e74a5b56f536/users/b66cb05a678c4f17b8e7baa7714bd61b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:17.090897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f98a3-b8aa-4bdb-b415-4256129a0689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25fc8cec09f4d8784c7e74a5b56f536, user_id=b66cb05a678c4f17b8e7baa7714bd61b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:17.097864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f98a3-b8aa-4bdb-b415-4256129a0689 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:17.105413 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3115/6285] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:17.148416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23b9f8-4a78-4374-a98c-1fd9384e967b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:17.163624 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3171/6286] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:16 2022] PUT /identity/v3/projects/a25fc8cec09f4d8784c7e74a5b56f536/users/b66cb05a678c4f17b8e7baa7714bd61b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:17.167327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23b9f8-4a78-4374-a98c-1fd9384e967b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:17.303515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d4850e-5134-4ce2-bd47-7f9e904465b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:17.304710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4850e-5134-4ce2-bd47-7f9e904465b5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:17.305160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4850e-5134-4ce2-bd47-7f9e904465b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:17.305598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d4850e-5134-4ce2-bd47-7f9e904465b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:17.307067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4850e-5134-4ce2-bd47-7f9e904465b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:17.309174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d4850e-5134-4ce2-bd47-7f9e904465b5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:17.341885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f98a3-b8aa-4bdb-b415-4256129a0689 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:17.348317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3116/6287] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:17.359542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f98a3-b8aa-4bdb-b415-4256129a0689 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:17.364963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e3cc4-6332-44ee-be0d-ea9e770e881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:17.367438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e3cc4-6332-44ee-be0d-ea9e770e881f admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:17.367640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e3cc4-6332-44ee-be0d-ea9e770e881f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:17.367965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e3cc4-6332-44ee-be0d-ea9e770e881f admin admin] PATH_INFO: `/v3/projects/a25fc8cec09f4d8784c7e74a5b56f536/users/b66cb05a678c4f17b8e7baa7714bd61b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:17.378492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e3cc4-6332-44ee-be0d-ea9e770e881f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25fc8cec09f4d8784c7e74a5b56f536, user_id=b66cb05a678c4f17b8e7baa7714bd61b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:17.381916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e3cc4-6332-44ee-be0d-ea9e770e881f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:17.415382 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3172/6288] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:17 2022] PUT /identity/v3/projects/a25fc8cec09f4d8784c7e74a5b56f536/users/b66cb05a678c4f17b8e7baa7714bd61b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:17.417355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d77e80-7bdd-4b0c-872f-dbd21631f259 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:17.417355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d77e80-7bdd-4b0c-872f-dbd21631f259 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:17.417665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d77e80-7bdd-4b0c-872f-dbd21631f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:17.497011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-40d77e80-7bdd-4b0c-872f-dbd21631f259 None None] MFA Rules not processed for user `b66cb05a678c4f17b8e7baa7714bd61b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:17.499530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-40d77e80-7bdd-4b0c-872f-dbd21631f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:17.669941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e3cc4-6332-44ee-be0d-ea9e770e881f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:17.673237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-728e3cc4-6332-44ee-be0d-ea9e770e881f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:17.693915 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3117/6289] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:17 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:10:17.699638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d77e80-7bdd-4b0c-872f-dbd21631f259 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:17.878789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e3cc4-6332-44ee-be0d-ea9e770e881f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:17.884148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124276ae-889c-42c8-b720-b7add30b2537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:17.885178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124276ae-889c-42c8-b720-b7add30b2537 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:17.889493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124276ae-889c-42c8-b720-b7add30b2537 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:17.897045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124276ae-889c-42c8-b720-b7add30b2537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:17.900916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-124276ae-889c-42c8-b720-b7add30b2537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:17.947855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124276ae-889c-42c8-b720-b7add30b2537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:17.952195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124276ae-889c-42c8-b720-b7add30b2537 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:17.958290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d77e80-7bdd-4b0c-872f-dbd21631f259 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:17.975088 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3173/6290] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:10:17.983744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b245d-7c01-4693-abbd-a0327b6e33e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:17.984713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b245d-7c01-4693-abbd-a0327b6e33e0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:17.985196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b245d-7c01-4693-abbd-a0327b6e33e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:17.985851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b245d-7c01-4693-abbd-a0327b6e33e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:17.987571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b245d-7c01-4693-abbd-a0327b6e33e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:17.989772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b245d-7c01-4693-abbd-a0327b6e33e0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:18.023090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500c696-6455-453f-adec-5d986a4741e4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:18.023700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500c696-6455-453f-adec-5d986a4741e4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:18.024282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500c696-6455-453f-adec-5d986a4741e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:18.085214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d500c696-6455-453f-adec-5d986a4741e4 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:18.086897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d500c696-6455-453f-adec-5d986a4741e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:18.090703 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3118/6291] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:17 2022] POST /identity/v3/projects => generated 365 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:18.098894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b245d-7c01-4693-abbd-a0327b6e33e0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:18.178441 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3174/6292] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:10:18.189224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b245d-7c01-4693-abbd-a0327b6e33e0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:18.196664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e69c-2721-4b5e-a70e-fa4c7be6f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:18.197950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e69c-2721-4b5e-a70e-fa4c7be6f883 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:18.198687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e69c-2721-4b5e-a70e-fa4c7be6f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:18.199136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e69c-2721-4b5e-a70e-fa4c7be6f883 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:18.200037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702e69c-2721-4b5e-a70e-fa4c7be6f883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:18.203700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702e69c-2721-4b5e-a70e-fa4c7be6f883 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:18.239412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500c696-6455-453f-adec-5d986a4741e4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:18.241877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d500c696-6455-453f-adec-5d986a4741e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:18.242378 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3119/6293] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:18 2022] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:18.248556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e69c-2721-4b5e-a70e-fa4c7be6f883 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:18.264438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e69c-2721-4b5e-a70e-fa4c7be6f883 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:18.271857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a592d-5927-48a2-9a4e-1141e6c25b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:18.273186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a592d-5927-48a2-9a4e-1141e6c25b17 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:18.273793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a592d-5927-48a2-9a4e-1141e6c25b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:18.274257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a592d-5927-48a2-9a4e-1141e6c25b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:18.275966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a592d-5927-48a2-9a4e-1141e6c25b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:18.278404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a592d-5927-48a2-9a4e-1141e6c25b17 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:18.296168 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3120/6294] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:18.309324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a592d-5927-48a2-9a4e-1141e6c25b17 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:18.322577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a592d-5927-48a2-9a4e-1141e6c25b17 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:18.328399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92652cd-b314-4f27-8cbe-b45830056284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:18.329213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92652cd-b314-4f27-8cbe-b45830056284 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:18.329505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92652cd-b314-4f27-8cbe-b45830056284 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:18.329786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92652cd-b314-4f27-8cbe-b45830056284 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:18.330656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92652cd-b314-4f27-8cbe-b45830056284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:18.332401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92652cd-b314-4f27-8cbe-b45830056284 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:18.341792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500c696-6455-453f-adec-5d986a4741e4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:18.350606 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3121/6295] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:10:18.351692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537c4b8-f774-45d2-bc93-76ee18f2ea98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:18.351881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92652cd-b314-4f27-8cbe-b45830056284 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:18.353815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c4b8-f774-45d2-bc93-76ee18f2ea98 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:18.354272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c4b8-f774-45d2-bc93-76ee18f2ea98 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:18.354710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537c4b8-f774-45d2-bc93-76ee18f2ea98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:18.363829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92652cd-b314-4f27-8cbe-b45830056284 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:18.368303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537c4b8-f774-45d2-bc93-76ee18f2ea98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:18.369351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3e903-8a29-4501-bff1-bcffa4762995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:18.370244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3e903-8a29-4501-bff1-bcffa4762995 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:18.370676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3e903-8a29-4501-bff1-bcffa4762995 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:18.370962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3e903-8a29-4501-bff1-bcffa4762995 admin admin] PATH_INFO: `/v3/projects/2bff193c9e7548b381c4d5701471b65a/users/5a41400f6c9f40538f3006f9aea18d85/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:18.371748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537c4b8-f774-45d2-bc93-76ee18f2ea98 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:18.388948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3175/6296] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:10:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 21:10:18.392507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3e903-8a29-4501-bff1-bcffa4762995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bff193c9e7548b381c4d5701471b65a, user_id=5a41400f6c9f40538f3006f9aea18d85, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:18.395439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d3e903-8a29-4501-bff1-bcffa4762995 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:18.427175 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3122/6297] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:18 2022] PUT /identity/v3/projects/2bff193c9e7548b381c4d5701471b65a/users/5a41400f6c9f40538f3006f9aea18d85/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:18.431781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706acad-8fbe-4121-a236-f6173f44f038 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:18.432110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706acad-8fbe-4121-a236-f6173f44f038 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:18.432387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706acad-8fbe-4121-a236-f6173f44f038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:18.493303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3706acad-8fbe-4121-a236-f6173f44f038 None None] MFA Rules not processed for user `5a41400f6c9f40538f3006f9aea18d85`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:18.495069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3706acad-8fbe-4121-a236-f6173f44f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:18.633979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3176/6298] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:18.638897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3e903-8a29-4501-bff1-bcffa4762995 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:18.842205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3e903-8a29-4501-bff1-bcffa4762995 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:18.848286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549e66-53f3-4acd-8d52-a9d959ea5881 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:18.848959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549e66-53f3-4acd-8d52-a9d959ea5881 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:18.849253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549e66-53f3-4acd-8d52-a9d959ea5881 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:18.849530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25549e66-53f3-4acd-8d52-a9d959ea5881 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:18.850337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25549e66-53f3-4acd-8d52-a9d959ea5881 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:18.853451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25549e66-53f3-4acd-8d52-a9d959ea5881 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:18.895697 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3123/6299] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:10:18 2022] POST /identity/v3/domains => generated 276 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:18.896355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706acad-8fbe-4121-a236-f6173f44f038 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:18.913063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706acad-8fbe-4121-a236-f6173f44f038 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:19.044544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51cc9b-d91c-4de9-b7e2-1b4c29e482cf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:19.046112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51cc9b-d91c-4de9-b7e2-1b4c29e482cf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:19.046787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51cc9b-d91c-4de9-b7e2-1b4c29e482cf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:19.047232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d51cc9b-d91c-4de9-b7e2-1b4c29e482cf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:19.048555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51cc9b-d91c-4de9-b7e2-1b4c29e482cf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:19.052277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d51cc9b-d91c-4de9-b7e2-1b4c29e482cf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:19.078220 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3177/6300] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:18 2022] POST /identity/v3/roles => generated 239 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:19.082774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549e66-53f3-4acd-8d52-a9d959ea5881 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:19.108469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25549e66-53f3-4acd-8d52-a9d959ea5881 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:19.135460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120e24-54fa-4d82-9895-da7b12f494a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:19.136708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120e24-54fa-4d82-9895-da7b12f494a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:19.145982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120e24-54fa-4d82-9895-da7b12f494a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:19.148558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77120e24-54fa-4d82-9895-da7b12f494a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/ccc68b774ce34de5bc6a639271a2f242/users/5a41400f6c9f40538f3006f9aea18d85/roles/e8d38f36cce84dbdb8284ee0ed9eabc7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:19.170221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120e24-54fa-4d82-9895-da7b12f494a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=ccc68b774ce34de5bc6a639271a2f242, user_id=5a41400f6c9f40538f3006f9aea18d85, role_id=e8d38f36cce84dbdb8284ee0ed9eabc7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:19.173474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77120e24-54fa-4d82-9895-da7b12f494a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:19.206911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3124/6301] 10.222.0.16 () {60 vars in 1479 bytes} [Sat Mar 26 21:10:19 2022] PUT /identity/v3/domains/ccc68b774ce34de5bc6a639271a2f242/users/5a41400f6c9f40538f3006f9aea18d85/roles/e8d38f36cce84dbdb8284ee0ed9eabc7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:19.211554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51cc9b-d91c-4de9-b7e2-1b4c29e482cf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:19.231692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d51cc9b-d91c-4de9-b7e2-1b4c29e482cf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:19.412345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf5f7e-7509-4aa1-a2bf-cab524f73bb0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:19.413772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf5f7e-7509-4aa1-a2bf-cab524f73bb0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:19.414062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf5f7e-7509-4aa1-a2bf-cab524f73bb0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:19.415735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf5f7e-7509-4aa1-a2bf-cab524f73bb0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:19.419217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf5f7e-7509-4aa1-a2bf-cab524f73bb0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:19.425110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf5f7e-7509-4aa1-a2bf-cab524f73bb0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:19.463845 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3178/6302] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:10:19 2022] POST /identity/v3/domains => generated 277 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:19.469052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120e24-54fa-4d82-9895-da7b12f494a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:19.489868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77120e24-54fa-4d82-9895-da7b12f494a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:19.749177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5ed33-2865-47e0-8cb3-7541dbea190b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:19.749815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ed33-2865-47e0-8cb3-7541dbea190b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:19.751244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ed33-2865-47e0-8cb3-7541dbea190b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:19.751573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5ed33-2865-47e0-8cb3-7541dbea190b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:19.756354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5ed33-2865-47e0-8cb3-7541dbea190b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:19.759087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5ed33-2865-47e0-8cb3-7541dbea190b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:19.820577 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3125/6303] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:19 2022] POST /identity/v3/roles => generated 240 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:19.823184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf5f7e-7509-4aa1-a2bf-cab524f73bb0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:19.842570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf5f7e-7509-4aa1-a2bf-cab524f73bb0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:19.861031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1544d-42be-4869-80a1-2eaf3a0eb48f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:19.861031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1544d-42be-4869-80a1-2eaf3a0eb48f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:19.861031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1544d-42be-4869-80a1-2eaf3a0eb48f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:19.861450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1544d-42be-4869-80a1-2eaf3a0eb48f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:19.861450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1544d-42be-4869-80a1-2eaf3a0eb48f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:19.863175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1544d-42be-4869-80a1-2eaf3a0eb48f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:19.949949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3179/6304] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:10:19 2022] POST /identity/v3/groups => generated 325 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:19.950593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5ed33-2865-47e0-8cb3-7541dbea190b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:19.968161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5ed33-2865-47e0-8cb3-7541dbea190b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:19.976753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354ba5c-c839-4cd1-9259-1c9e8a16d185 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:19.977694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ba5c-c839-4cd1-9259-1c9e8a16d185 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:19.978006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ba5c-c839-4cd1-9259-1c9e8a16d185 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:19.978267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ba5c-c839-4cd1-9259-1c9e8a16d185 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/groups/e2d277eda82d45458745d729cf389c1c/users/5a41400f6c9f40538f3006f9aea18d85` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:19.998297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354ba5c-c839-4cd1-9259-1c9e8a16d185 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e2d277eda82d45458745d729cf389c1c, user_id=5a41400f6c9f40538f3006f9aea18d85)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:20.002490 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-3354ba5c-c839-4cd1-9259-1c9e8a16d185 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:10:20.002490 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:10:20.002490 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:10:20.004684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354ba5c-c839-4cd1-9259-1c9e8a16d185 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:20.106867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1544d-42be-4869-80a1-2eaf3a0eb48f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:20.108380 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3126/6305] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Mar 26 21:10:19 2022] PUT /identity/v3/groups/e2d277eda82d45458745d729cf389c1c/users/5a41400f6c9f40538f3006f9aea18d85 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:20.135031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1544d-42be-4869-80a1-2eaf3a0eb48f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:20.289539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb58dc5-980d-4cdc-a2c6-769244d51c16 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:20.290766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb58dc5-980d-4cdc-a2c6-769244d51c16 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:20.291448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb58dc5-980d-4cdc-a2c6-769244d51c16 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:20.291830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb58dc5-980d-4cdc-a2c6-769244d51c16 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831/groups/e2d277eda82d45458745d729cf389c1c/roles/5c40c26731e84ba59d6a3f8ffbef42aa` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:20.307561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb58dc5-980d-4cdc-a2c6-769244d51c16 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=5f6e2e7778914d5c9b71789ebf2aa831, group_id=e2d277eda82d45458745d729cf389c1c, role_id=5c40c26731e84ba59d6a3f8ffbef42aa)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:20.317722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb58dc5-980d-4cdc-a2c6-769244d51c16 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:20.362119 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3180/6306] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:20 2022] PUT /identity/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831/groups/e2d277eda82d45458745d729cf389c1c/roles/5c40c26731e84ba59d6a3f8ffbef42aa => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:20.363645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354ba5c-c839-4cd1-9259-1c9e8a16d185 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:20.377712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354ba5c-c839-4cd1-9259-1c9e8a16d185 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:20.537007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7193ae-fe70-4d9e-ac42-f1972fc295f2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:20.537945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7193ae-fe70-4d9e-ac42-f1972fc295f2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:20.538411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7193ae-fe70-4d9e-ac42-f1972fc295f2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:20.538847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7193ae-fe70-4d9e-ac42-f1972fc295f2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:20.539737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7193ae-fe70-4d9e-ac42-f1972fc295f2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:20.543073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7193ae-fe70-4d9e-ac42-f1972fc295f2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:20.583106 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3127/6307] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:10:20 2022] POST /identity/v3/domains => generated 276 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:20.584395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb58dc5-980d-4cdc-a2c6-769244d51c16 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:20.601687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb58dc5-980d-4cdc-a2c6-769244d51c16 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:20.734969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc19a38-a2b0-46a0-a300-745a66a06096 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:20.738866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19a38-a2b0-46a0-a300-745a66a06096 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:20.739170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19a38-a2b0-46a0-a300-745a66a06096 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:20.739611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc19a38-a2b0-46a0-a300-745a66a06096 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:20.740436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc19a38-a2b0-46a0-a300-745a66a06096 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:20.745946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc19a38-a2b0-46a0-a300-745a66a06096 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:20.782609 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3181/6308] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:20 2022] POST /identity/v3/roles => generated 239 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:20.784038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7193ae-fe70-4d9e-ac42-f1972fc295f2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:20.798000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7193ae-fe70-4d9e-ac42-f1972fc295f2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:20.814611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783411f5-a4db-4719-900b-e266980df018 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:20.820444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783411f5-a4db-4719-900b-e266980df018 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:20.820883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783411f5-a4db-4719-900b-e266980df018 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:20.821243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783411f5-a4db-4719-900b-e266980df018 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/2861231b2e624ef391f9a489400a0b5b/users/5a41400f6c9f40538f3006f9aea18d85/roles/f68c4f27e73e42128e803c1139ed10f9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:20.836869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783411f5-a4db-4719-900b-e266980df018 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=2861231b2e624ef391f9a489400a0b5b, user_id=5a41400f6c9f40538f3006f9aea18d85, role_id=f68c4f27e73e42128e803c1139ed10f9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:20.841230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783411f5-a4db-4719-900b-e266980df018 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:20.910639 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3128/6309] 10.222.0.16 () {60 vars in 1479 bytes} [Sat Mar 26 21:10:20 2022] PUT /identity/v3/domains/2861231b2e624ef391f9a489400a0b5b/users/5a41400f6c9f40538f3006f9aea18d85/roles/f68c4f27e73e42128e803c1139ed10f9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:20.913371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc19a38-a2b0-46a0-a300-745a66a06096 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:20.938202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc19a38-a2b0-46a0-a300-745a66a06096 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:21.072592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e2061-9b88-4f39-b003-12e0f5ad3587 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:21.073318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e2061-9b88-4f39-b003-12e0f5ad3587 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:21.073601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e2061-9b88-4f39-b003-12e0f5ad3587 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:21.073879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e2061-9b88-4f39-b003-12e0f5ad3587 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:21.074778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e2061-9b88-4f39-b003-12e0f5ad3587 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:21.076312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e2061-9b88-4f39-b003-12e0f5ad3587 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:21.128956 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3182/6310] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:10:20 2022] POST /identity/v3/domains => generated 276 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:21.130081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783411f5-a4db-4719-900b-e266980df018 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:21.146889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783411f5-a4db-4719-900b-e266980df018 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:21.235379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090f0a5-8a88-4e13-b879-8db7e07c5f53 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:21.236487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090f0a5-8a88-4e13-b879-8db7e07c5f53 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:21.236888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090f0a5-8a88-4e13-b879-8db7e07c5f53 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:21.237371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090f0a5-8a88-4e13-b879-8db7e07c5f53 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:21.238194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090f0a5-8a88-4e13-b879-8db7e07c5f53 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:21.241192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7090f0a5-8a88-4e13-b879-8db7e07c5f53 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:21.263075 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3129/6311] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:21 2022] POST /identity/v3/roles => generated 240 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:21.268376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e2061-9b88-4f39-b003-12e0f5ad3587 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:21.310549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e2061-9b88-4f39-b003-12e0f5ad3587 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:21.331873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db4d0-19f7-4331-adf3-8cac5b90190e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:21.343097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db4d0-19f7-4331-adf3-8cac5b90190e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:21.354151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db4d0-19f7-4331-adf3-8cac5b90190e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:21.354448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db4d0-19f7-4331-adf3-8cac5b90190e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:21.357801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db4d0-19f7-4331-adf3-8cac5b90190e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:21.364624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db4d0-19f7-4331-adf3-8cac5b90190e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:21.428796 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3183/6312] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:10:21 2022] POST /identity/v3/groups => generated 326 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:21.433064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090f0a5-8a88-4e13-b879-8db7e07c5f53 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:21.446966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090f0a5-8a88-4e13-b879-8db7e07c5f53 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:21.463648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec416f-ffe4-4684-934c-27787d62942a tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:21.465031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec416f-ffe4-4684-934c-27787d62942a tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:21.467282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec416f-ffe4-4684-934c-27787d62942a tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:21.467622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec416f-ffe4-4684-934c-27787d62942a tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/groups/7b074aef39d04509a25e116999eee75e/users/5a41400f6c9f40538f3006f9aea18d85` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:21.481346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec416f-ffe4-4684-934c-27787d62942a tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7b074aef39d04509a25e116999eee75e, user_id=5a41400f6c9f40538f3006f9aea18d85)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:21.487572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec416f-ffe4-4684-934c-27787d62942a tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:21.543971 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3130/6313] 10.222.0.16 () {60 vars in 1359 bytes} [Sat Mar 26 21:10:21 2022] PUT /identity/v3/groups/7b074aef39d04509a25e116999eee75e/users/5a41400f6c9f40538f3006f9aea18d85 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:21.549094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db4d0-19f7-4331-adf3-8cac5b90190e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:21.564515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db4d0-19f7-4331-adf3-8cac5b90190e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:21.686854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801bba6-5434-43f9-9b99-f6d186900e9c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:21.689583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801bba6-5434-43f9-9b99-f6d186900e9c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:21.692433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801bba6-5434-43f9-9b99-f6d186900e9c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:21.693405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6801bba6-5434-43f9-9b99-f6d186900e9c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/12380b7a18b64d42b8f7d867d13da83d/groups/7b074aef39d04509a25e116999eee75e/roles/ccb3d0f470534c89aa6645ade43de7f6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:21.702466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801bba6-5434-43f9-9b99-f6d186900e9c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=12380b7a18b64d42b8f7d867d13da83d, group_id=7b074aef39d04509a25e116999eee75e, role_id=ccb3d0f470534c89aa6645ade43de7f6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:21.707034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6801bba6-5434-43f9-9b99-f6d186900e9c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:21.736869 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3184/6314] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:21 2022] PUT /identity/v3/domains/12380b7a18b64d42b8f7d867d13da83d/groups/7b074aef39d04509a25e116999eee75e/roles/ccb3d0f470534c89aa6645ade43de7f6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:21.740816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec416f-ffe4-4684-934c-27787d62942a tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:21.892774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec416f-ffe4-4684-934c-27787d62942a tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:22.112615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7f469-1215-4038-9033-691e1a516050 tempest-TokensV3TestJSON-82094115 tempest-TokensV3TestJSON-82094115-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a41400f6c9f40538f3006f9aea18d85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bff193c9e7548b381c4d5701471b65a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:22.113348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7f469-1215-4038-9033-691e1a516050 tempest-TokensV3TestJSON-82094115 tempest-TokensV3TestJSON-82094115-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:22.113644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7f469-1215-4038-9033-691e1a516050 tempest-TokensV3TestJSON-82094115 tempest-TokensV3TestJSON-82094115-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:22.113929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7f469-1215-4038-9033-691e1a516050 tempest-TokensV3TestJSON-82094115 tempest-TokensV3TestJSON-82094115-project] PATH_INFO: `/v3/auth/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:22.114582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7f469-1215-4038-9033-691e1a516050 tempest-TokensV3TestJSON-82094115 tempest-TokensV3TestJSON-82094115-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:22.115877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7f469-1215-4038-9033-691e1a516050 tempest-TokensV3TestJSON-82094115 tempest-TokensV3TestJSON-82094115-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:22.259979 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3131/6315] 10.222.0.16 () {58 vars in 1142 bytes} [Sat Mar 26 21:10:21 2022] GET /identity/v3/auth/domains => generated 1173 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:22.263212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801bba6-5434-43f9-9b99-f6d186900e9c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:22.363973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6801bba6-5434-43f9-9b99-f6d186900e9c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:22.373577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:22.375299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:22.375588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:22.375868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/12380b7a18b64d42b8f7d867d13da83d/groups/7b074aef39d04509a25e116999eee75e/roles/ccb3d0f470534c89aa6645ade43de7f6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:22.385368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=12380b7a18b64d42b8f7d867d13da83d, group_id=7b074aef39d04509a25e116999eee75e, role_id=ccb3d0f470534c89aa6645ade43de7f6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:22.388282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:22.409585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role ccb3d0f470534c89aa6645ade43de7f6 was removed from group 7b074aef39d04509a25e116999eee75e on domain 12380b7a18b64d42b8f7d867d13da83d. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:22.409585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:22.410388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:22.440672 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3185/6316] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Mar 26 21:10:22 2022] DELETE /identity/v3/domains/12380b7a18b64d42b8f7d867d13da83d/groups/7b074aef39d04509a25e116999eee75e/roles/ccb3d0f470534c89aa6645ade43de7f6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:22.446924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7f469-1215-4038-9033-691e1a516050 tempest-TokensV3TestJSON-82094115 tempest-TokensV3TestJSON-82094115-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:22.450542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9da7f469-1215-4038-9033-691e1a516050 tempest-TokensV3TestJSON-82094115 tempest-TokensV3TestJSON-82094115-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:22.498413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7f469-1215-4038-9033-691e1a516050 tempest-TokensV3TestJSON-82094115 tempest-TokensV3TestJSON-82094115-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:22.629432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:22.630910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:22.631301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:22.631694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/groups/7b074aef39d04509a25e116999eee75e/users/5a41400f6c9f40538f3006f9aea18d85` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:22.633780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7b074aef39d04509a25e116999eee75e, user_id=5a41400f6c9f40538f3006f9aea18d85)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:22.634970 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:10:22.634970 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:10:22.634970 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:10:22.636477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:22.659202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5a41400f6c9f40538f3006f9aea18d85'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:22.680159 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3132/6317] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Mar 26 21:10:22 2022] DELETE /identity/v3/groups/7b074aef39d04509a25e116999eee75e/users/5a41400f6c9f40538f3006f9aea18d85 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:22.684645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:22.695950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5ae53-e12a-4662-85f7-cf09ed7dbae2 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:22.860554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58102cde-e441-47a6-b146-a74c731f4ec4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:22.861855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58102cde-e441-47a6-b146-a74c731f4ec4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:22.862355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58102cde-e441-47a6-b146-a74c731f4ec4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:22.862844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58102cde-e441-47a6-b146-a74c731f4ec4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/groups/7b074aef39d04509a25e116999eee75e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:22.867605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58102cde-e441-47a6-b146-a74c731f4ec4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7b074aef39d04509a25e116999eee75e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:22.869903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58102cde-e441-47a6-b146-a74c731f4ec4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:22.944367 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3186/6318] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:10:22 2022] DELETE /identity/v3/groups/7b074aef39d04509a25e116999eee75e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:22.945735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:22.963707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93062380-66d1-45ea-a4ad-b506a7160ac4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:23.150866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:23.152335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:23.152824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:23.153124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles/ccb3d0f470534c89aa6645ade43de7f6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:23.155476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ccb3d0f470534c89aa6645ade43de7f6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:23.161353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:23.236842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role ccb3d0f470534c89aa6645ade43de7f6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:23.244174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.246312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.251423 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3133/6319] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:22 2022] DELETE /identity/v3/roles/ccb3d0f470534c89aa6645ade43de7f6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:23.253012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58102cde-e441-47a6-b146-a74c731f4ec4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:23.255112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-58102cde-e441-47a6-b146-a74c731f4ec4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:23.269087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58102cde-e441-47a6-b146-a74c731f4ec4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:23.347293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:23.348460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:23.349154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:23.349702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/12380b7a18b64d42b8f7d867d13da83d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:23.351547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=12380b7a18b64d42b8f7d867d13da83d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:23.353630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:23.379190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.407946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.467848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.468476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.473818 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3187/6320] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:10:23 2022] PATCH /identity/v3/domains/12380b7a18b64d42b8f7d867d13da83d => generated 277 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:23.475624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:23.500036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10915e4-a62a-45ab-b04f-c1a4ac4fd19f tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:23.568512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:23.569480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:23.569842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:23.570195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/12380b7a18b64d42b8f7d867d13da83d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:23.585281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=12380b7a18b64d42b8f7d867d13da83d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:23.587427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:23.637967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.643843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.743235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d', 'request_id': 'req-33193a3b-365a-49e8-b5a0-38db24c19e63'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.768445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d', 'request_id': 'req-33193a3b-365a-49e8-b5a0-38db24c19e63'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.777754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d', 'request_id': 'req-33193a3b-365a-49e8-b5a0-38db24c19e63'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.809596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] The token cache is being invalidate because project 12380b7a18b64d42b8f7d867d13da83d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:23.810004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.810692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.821887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d', 'request_id': 'req-33193a3b-365a-49e8-b5a0-38db24c19e63'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.823322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d', 'request_id': 'req-33193a3b-365a-49e8-b5a0-38db24c19e63'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.825337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '12380b7a18b64d42b8f7d867d13da83d', 'request_id': 'req-33193a3b-365a-49e8-b5a0-38db24c19e63'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:23.839960 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3134/6321] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:10:23 2022] DELETE /identity/v3/domains/12380b7a18b64d42b8f7d867d13da83d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:23.840907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:23.842808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:23.874675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c418da7-6827-47c3-a89b-e62de28e9f8b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:24.000605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:24.002082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:24.004158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:24.009943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/2861231b2e624ef391f9a489400a0b5b/users/5a41400f6c9f40538f3006f9aea18d85/roles/f68c4f27e73e42128e803c1139ed10f9` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:24.019252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=2861231b2e624ef391f9a489400a0b5b, user_id=5a41400f6c9f40538f3006f9aea18d85, role_id=f68c4f27e73e42128e803c1139ed10f9)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:24.025654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:24.054054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role f68c4f27e73e42128e803c1139ed10f9 was removed from user 5a41400f6c9f40538f3006f9aea18d85 on domain 2861231b2e624ef391f9a489400a0b5b. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:24.056258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.058945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.090733 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3188/6322] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Mar 26 21:10:23 2022] DELETE /identity/v3/domains/2861231b2e624ef391f9a489400a0b5b/users/5a41400f6c9f40538f3006f9aea18d85/roles/f68c4f27e73e42128e803c1139ed10f9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:24.095104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:24.096625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:24.125914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33193a3b-365a-49e8-b5a0-38db24c19e63 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:24.204341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:24.205428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:24.205720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:24.205999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles/f68c4f27e73e42128e803c1139ed10f9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:24.207733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f68c4f27e73e42128e803c1139ed10f9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:24.209487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:24.256997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role f68c4f27e73e42128e803c1139ed10f9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:24.258151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.259190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.262232 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3135/6323] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:24 2022] DELETE /identity/v3/roles/f68c4f27e73e42128e803c1139ed10f9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:24.266184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:24.267826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:24.288456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a886e0ea-3e8f-4413-8d59-75007b7bbc90 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:24.417247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:24.418424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:24.418818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:24.419201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/2861231b2e624ef391f9a489400a0b5b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:24.420767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2861231b2e624ef391f9a489400a0b5b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:24.422714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:24.453522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2861231b2e624ef391f9a489400a0b5b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.454429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2861231b2e624ef391f9a489400a0b5b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.486666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2861231b2e624ef391f9a489400a0b5b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.487539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2861231b2e624ef391f9a489400a0b5b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.493809 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3189/6324] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:10:24 2022] PATCH /identity/v3/domains/2861231b2e624ef391f9a489400a0b5b => generated 277 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:24.500864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:24.502622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:24.527341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40578a80-a2a9-46bf-a969-ffe630616ec0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:24.640371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:24.648363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:24.650070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:24.650383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/2861231b2e624ef391f9a489400a0b5b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:24.673493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2861231b2e624ef391f9a489400a0b5b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:24.675789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:24.707680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2861231b2e624ef391f9a489400a0b5b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.711430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2861231b2e624ef391f9a489400a0b5b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.820644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2861231b2e624ef391f9a489400a0b5b', 'request_id': 'req-569cba69-4f08-4457-bbcc-31e02e474a35'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.844592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2861231b2e624ef391f9a489400a0b5b', 'request_id': 'req-569cba69-4f08-4457-bbcc-31e02e474a35'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.854517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2861231b2e624ef391f9a489400a0b5b', 'request_id': 'req-569cba69-4f08-4457-bbcc-31e02e474a35'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.871805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] The token cache is being invalidate because project 2861231b2e624ef391f9a489400a0b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:24.872871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.874309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.884996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2861231b2e624ef391f9a489400a0b5b', 'request_id': 'req-569cba69-4f08-4457-bbcc-31e02e474a35'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.886213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2861231b2e624ef391f9a489400a0b5b', 'request_id': 'req-569cba69-4f08-4457-bbcc-31e02e474a35'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.887075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2861231b2e624ef391f9a489400a0b5b', 'request_id': 'req-569cba69-4f08-4457-bbcc-31e02e474a35'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:24.901113 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3136/6325] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:10:24 2022] DELETE /identity/v3/domains/2861231b2e624ef391f9a489400a0b5b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:24.905430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:24.908743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:24.941247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da909f1-0a49-4348-bad1-9927e1da60ea tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:25.115876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:25.117462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:25.117765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:25.118040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831/groups/e2d277eda82d45458745d729cf389c1c/roles/5c40c26731e84ba59d6a3f8ffbef42aa` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:25.120455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=5f6e2e7778914d5c9b71789ebf2aa831, group_id=e2d277eda82d45458745d729cf389c1c, role_id=5c40c26731e84ba59d6a3f8ffbef42aa)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:25.123694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:25.129977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role 5c40c26731e84ba59d6a3f8ffbef42aa was removed from group e2d277eda82d45458745d729cf389c1c on domain 5f6e2e7778914d5c9b71789ebf2aa831. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:25.130285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:25.134750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:25.182177 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3190/6326] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Mar 26 21:10:24 2022] DELETE /identity/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831/groups/e2d277eda82d45458745d729cf389c1c/roles/5c40c26731e84ba59d6a3f8ffbef42aa => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:25.187195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:25.189271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:25.205375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cba69-4f08-4457-bbcc-31e02e474a35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:25.328808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a6787-b62b-4cd6-ba5b-abe0fd072a96 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:25.329657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a6787-b62b-4cd6-ba5b-abe0fd072a96 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:25.329941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a6787-b62b-4cd6-ba5b-abe0fd072a96 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:25.330394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a6787-b62b-4cd6-ba5b-abe0fd072a96 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/groups/e2d277eda82d45458745d729cf389c1c/users/5a41400f6c9f40538f3006f9aea18d85` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:25.334517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a6787-b62b-4cd6-ba5b-abe0fd072a96 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=e2d277eda82d45458745d729cf389c1c, user_id=5a41400f6c9f40538f3006f9aea18d85)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:25.336984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a6787-b62b-4cd6-ba5b-abe0fd072a96 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:25.359273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3b2a6787-b62b-4cd6-ba5b-abe0fd072a96 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5a41400f6c9f40538f3006f9aea18d85'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:25.385132 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3137/6327] 10.222.0.16 () {58 vars in 1343 bytes} [Sat Mar 26 21:10:25 2022] DELETE /identity/v3/groups/e2d277eda82d45458745d729cf389c1c/users/5a41400f6c9f40538f3006f9aea18d85 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:25.389848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:25.392399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:25.412906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573afddb-921f-4e98-869b-49aadda886c6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:25.553677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41048-bcd2-4d01-9799-6888c0a693d8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:25.554957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41048-bcd2-4d01-9799-6888c0a693d8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:25.555468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41048-bcd2-4d01-9799-6888c0a693d8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:25.556102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc41048-bcd2-4d01-9799-6888c0a693d8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/groups/e2d277eda82d45458745d729cf389c1c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:25.561542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc41048-bcd2-4d01-9799-6888c0a693d8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e2d277eda82d45458745d729cf389c1c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:25.566954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc41048-bcd2-4d01-9799-6888c0a693d8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:25.671028 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3191/6328] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:10:25 2022] DELETE /identity/v3/groups/e2d277eda82d45458745d729cf389c1c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:25.673598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a6787-b62b-4cd6-ba5b-abe0fd072a96 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:25.713537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a6787-b62b-4cd6-ba5b-abe0fd072a96 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:25.848508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:25.849357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:25.849649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:25.849932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles/5c40c26731e84ba59d6a3f8ffbef42aa` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:25.851603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5c40c26731e84ba59d6a3f8ffbef42aa)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:25.853342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:25.926445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role 5c40c26731e84ba59d6a3f8ffbef42aa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:25.926445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:25.927818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:25.933664 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3138/6329] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:25 2022] DELETE /identity/v3/roles/5c40c26731e84ba59d6a3f8ffbef42aa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:25.934843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41048-bcd2-4d01-9799-6888c0a693d8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:25.937859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0bc41048-bcd2-4d01-9799-6888c0a693d8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:25.965197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc41048-bcd2-4d01-9799-6888c0a693d8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:26.060691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:26.062424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:26.062818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:26.063196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:26.064646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5f6e2e7778914d5c9b71789ebf2aa831)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:26.075024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:26.132428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.133516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.173120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.174006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.179860 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3192/6330] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:10:25 2022] PATCH /identity/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831 => generated 278 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:26.182082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:26.203494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63c8b5-cb5d-4618-a375-64d7d9395777 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:26.302879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:26.304695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:26.305254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:26.305768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:26.320405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5f6e2e7778914d5c9b71789ebf2aa831)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:26.322719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:26.367518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.372384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.472153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831', 'request_id': 'req-dbd38f5b-da10-4cb9-bca4-23616957fe73'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.504631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831', 'request_id': 'req-dbd38f5b-da10-4cb9-bca4-23616957fe73'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.515288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831', 'request_id': 'req-dbd38f5b-da10-4cb9-bca4-23616957fe73'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.531739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] The token cache is being invalidate because project 5f6e2e7778914d5c9b71789ebf2aa831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:26.532452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.533488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.555750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831', 'request_id': 'req-dbd38f5b-da10-4cb9-bca4-23616957fe73'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.558709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831', 'request_id': 'req-dbd38f5b-da10-4cb9-bca4-23616957fe73'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.562551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5f6e2e7778914d5c9b71789ebf2aa831', 'request_id': 'req-dbd38f5b-da10-4cb9-bca4-23616957fe73'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.584261 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3139/6331] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:10:26 2022] DELETE /identity/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:26.588348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:26.590826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:26.635767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68225aad-4fba-4983-b022-5808e9520d03 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:26.791576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:26.792581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:26.792873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:26.793150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/ccc68b774ce34de5bc6a639271a2f242/users/5a41400f6c9f40538f3006f9aea18d85/roles/e8d38f36cce84dbdb8284ee0ed9eabc7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:26.802090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=ccc68b774ce34de5bc6a639271a2f242, user_id=5a41400f6c9f40538f3006f9aea18d85, role_id=e8d38f36cce84dbdb8284ee0ed9eabc7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:26.805692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:26.820905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role e8d38f36cce84dbdb8284ee0ed9eabc7 was removed from user 5a41400f6c9f40538f3006f9aea18d85 on domain ccc68b774ce34de5bc6a639271a2f242. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:26.821213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.821978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:26.843512 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3193/6332] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Mar 26 21:10:26 2022] DELETE /identity/v3/domains/ccc68b774ce34de5bc6a639271a2f242/users/5a41400f6c9f40538f3006f9aea18d85/roles/e8d38f36cce84dbdb8284ee0ed9eabc7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:26.847644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:26.849941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:26.876315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd38f5b-da10-4cb9-bca4-23616957fe73 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:26.993699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:26.995142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:26.996071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:26.997031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles/e8d38f36cce84dbdb8284ee0ed9eabc7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:26.999072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e8d38f36cce84dbdb8284ee0ed9eabc7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:27.001359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:27.092799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role e8d38f36cce84dbdb8284ee0ed9eabc7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:27.093176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.093945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.096818 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3140/6333] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:26 2022] DELETE /identity/v3/roles/e8d38f36cce84dbdb8284ee0ed9eabc7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:27.100178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:27.101712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:27.119127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2669ba-0842-40b4-908d-4bed5a4970e5 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:27.211784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:27.216028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:27.221280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:27.222096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/ccc68b774ce34de5bc6a639271a2f242` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:27.224699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ccc68b774ce34de5bc6a639271a2f242)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:27.231277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:27.262631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.264963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.309893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.328621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.333804 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3194/6334] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:10:27 2022] PATCH /identity/v3/domains/ccc68b774ce34de5bc6a639271a2f242 => generated 277 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:27.338895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:27.340842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:27.382282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad806ed-7782-4cb4-864a-e87abb62fb8c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:27.520445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:27.523511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:27.524064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:27.524513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/ccc68b774ce34de5bc6a639271a2f242` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:27.542371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ccc68b774ce34de5bc6a639271a2f242)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:27.544285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:27.570998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.575300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.635474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242', 'request_id': 'req-e867b436-a4b5-4a54-9285-338ecdcabd9b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.667534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242', 'request_id': 'req-e867b436-a4b5-4a54-9285-338ecdcabd9b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.676680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242', 'request_id': 'req-e867b436-a4b5-4a54-9285-338ecdcabd9b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.730072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] The token cache is being invalidate because project ccc68b774ce34de5bc6a639271a2f242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:27.732383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.749335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.801954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242', 'request_id': 'req-e867b436-a4b5-4a54-9285-338ecdcabd9b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.803418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242', 'request_id': 'req-e867b436-a4b5-4a54-9285-338ecdcabd9b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.806202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ccc68b774ce34de5bc6a639271a2f242', 'request_id': 'req-e867b436-a4b5-4a54-9285-338ecdcabd9b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:27.836195 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3141/6335] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:10:27 2022] DELETE /identity/v3/domains/ccc68b774ce34de5bc6a639271a2f242 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:27.841072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:27.844057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:27.861262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ffc2-6621-45d2-aa34-8acd04bd15be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:27.992503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2335b9-5fa5-4ea1-8120-184b1e6b62a6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:27.993489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2335b9-5fa5-4ea1-8120-184b1e6b62a6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:27.993959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2335b9-5fa5-4ea1-8120-184b1e6b62a6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:27.994401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2335b9-5fa5-4ea1-8120-184b1e6b62a6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:27.995305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2335b9-5fa5-4ea1-8120-184b1e6b62a6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:27.998127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2335b9-5fa5-4ea1-8120-184b1e6b62a6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:28.013369 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3195/6336] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:28.014429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:28.017020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:28.059246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867b436-a4b5-4a54-9285-338ecdcabd9b tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:28.074422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989449c-b296-4ce2-8147-9038ef7a19bc tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:28.076034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989449c-b296-4ce2-8147-9038ef7a19bc tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:28.076671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989449c-b296-4ce2-8147-9038ef7a19bc tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:28.078553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989449c-b296-4ce2-8147-9038ef7a19bc tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/projects/668f5214a74b47368c0f369a97b95332/users/b66cb05a678c4f17b8e7baa7714bd61b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:28.083034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989449c-b296-4ce2-8147-9038ef7a19bc tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_grant(project_id=668f5214a74b47368c0f369a97b95332, user_id=b66cb05a678c4f17b8e7baa7714bd61b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:28.093253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989449c-b296-4ce2-8147-9038ef7a19bc tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:28.120328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2335b9-5fa5-4ea1-8120-184b1e6b62a6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:28.121066 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3142/6337] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:28 2022] PUT /identity/v3/projects/668f5214a74b47368c0f369a97b95332/users/b66cb05a678c4f17b8e7baa7714bd61b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:28.136249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2335b9-5fa5-4ea1-8120-184b1e6b62a6 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:28.243329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7360f7-6ab6-4237-9177-b2bc1cfd219c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:28.244372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7360f7-6ab6-4237-9177-b2bc1cfd219c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:28.244957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7360f7-6ab6-4237-9177-b2bc1cfd219c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:28.245399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7360f7-6ab6-4237-9177-b2bc1cfd219c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:28.246671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7360f7-6ab6-4237-9177-b2bc1cfd219c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:28.248612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7360f7-6ab6-4237-9177-b2bc1cfd219c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:28.362601 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3196/6338] 10.222.0.16 () {58 vars in 1145 bytes} [Sat Mar 26 21:10:28 2022] GET /identity/v3/auth/projects => generated 826 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:28.367422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989449c-b296-4ce2-8147-9038ef7a19bc tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:28.385133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989449c-b296-4ce2-8147-9038ef7a19bc tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:28.398189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:28.399508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:28.400000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:28.400579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/projects/668f5214a74b47368c0f369a97b95332/users/b66cb05a678c4f17b8e7baa7714bd61b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:28.408476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=668f5214a74b47368c0f369a97b95332, user_id=b66cb05a678c4f17b8e7baa7714bd61b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:28.411286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:28.420508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role 8160adb3a8504dd3b239b60abf8bde28 was removed from user b66cb05a678c4f17b8e7baa7714bd61b on project 668f5214a74b47368c0f369a97b95332. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:28.420833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:28.423601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:28.459705 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3143/6339] 10.222.0.16 () {58 vars in 1466 bytes} [Sat Mar 26 21:10:28 2022] DELETE /identity/v3/projects/668f5214a74b47368c0f369a97b95332/users/b66cb05a678c4f17b8e7baa7714bd61b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:28.460328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7360f7-6ab6-4237-9177-b2bc1cfd219c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:28.462158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1e7360f7-6ab6-4237-9177-b2bc1cfd219c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:28.483946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7360f7-6ab6-4237-9177-b2bc1cfd219c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:28.626548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9752a2-b17e-48e1-8f12-64af2298bd55 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:28.627231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9752a2-b17e-48e1-8f12-64af2298bd55 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:28.627514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9752a2-b17e-48e1-8f12-64af2298bd55 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:28.627795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9752a2-b17e-48e1-8f12-64af2298bd55 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:28.628971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9752a2-b17e-48e1-8f12-64af2298bd55 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:28.631517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9752a2-b17e-48e1-8f12-64af2298bd55 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:28.669176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:28.680202 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3197/6340] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:28 2022] POST /identity/v3/users => generated 323 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:28.682703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d33fc7-027d-4b65-b3b8-36f0d2ef0fc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:28.688907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d07ffc-fbf2-416e-abad-766fe11fcadf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:28.689703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d07ffc-fbf2-416e-abad-766fe11fcadf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:28.689998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d07ffc-fbf2-416e-abad-766fe11fcadf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:28.690632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d07ffc-fbf2-416e-abad-766fe11fcadf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:28.691332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d07ffc-fbf2-416e-abad-766fe11fcadf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:28.693379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d07ffc-fbf2-416e-abad-766fe11fcadf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:28.737035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9752a2-b17e-48e1-8f12-64af2298bd55 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:28.750307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9752a2-b17e-48e1-8f12-64af2298bd55 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:28.753322 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3144/6341] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:28 2022] POST /identity/v3/projects => generated 362 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:28.828593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e3c16-946c-4300-b2d2-7ff04ee44382 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:28.829268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3c16-946c-4300-b2d2-7ff04ee44382 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:28.829614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3c16-946c-4300-b2d2-7ff04ee44382 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:28.830005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3c16-946c-4300-b2d2-7ff04ee44382 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:28.830719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e3c16-946c-4300-b2d2-7ff04ee44382 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:28.833160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e3c16-946c-4300-b2d2-7ff04ee44382 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:28.901602 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3198/6342] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:28 2022] POST /identity/v3/projects => generated 364 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:28.905869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d07ffc-fbf2-416e-abad-766fe11fcadf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:28.919152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d07ffc-fbf2-416e-abad-766fe11fcadf tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:29.066054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9501-4ff7-4a94-907d-c7b1c14836be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:29.066818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9501-4ff7-4a94-907d-c7b1c14836be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:29.067180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9501-4ff7-4a94-907d-c7b1c14836be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:29.067454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9501-4ff7-4a94-907d-c7b1c14836be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:29.068228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c9501-4ff7-4a94-907d-c7b1c14836be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:29.069866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c9501-4ff7-4a94-907d-c7b1c14836be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:29.088311 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3145/6343] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:28 2022] POST /identity/v3/roles => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:29.092321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e3c16-946c-4300-b2d2-7ff04ee44382 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:29.135273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e3c16-946c-4300-b2d2-7ff04ee44382 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:29.149911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7399a4-a8b2-42c9-a900-e94412502313 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:29.153455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7399a4-a8b2-42c9-a900-e94412502313 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:29.160280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7399a4-a8b2-42c9-a900-e94412502313 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:29.163173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7399a4-a8b2-42c9-a900-e94412502313 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/projects/2653cb211d264a5a8d3df5da16e8facc/users/4ccf7982ac30441bb7b459ea32916597/roles/6db0caebb3844a77a2eb97aadf001dc8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:29.197710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7399a4-a8b2-42c9-a900-e94412502313 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2653cb211d264a5a8d3df5da16e8facc, user_id=4ccf7982ac30441bb7b459ea32916597, role_id=6db0caebb3844a77a2eb97aadf001dc8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:29.208394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7399a4-a8b2-42c9-a900-e94412502313 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:29.259063 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3199/6344] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:29 2022] PUT /identity/v3/projects/2653cb211d264a5a8d3df5da16e8facc/users/4ccf7982ac30441bb7b459ea32916597/roles/6db0caebb3844a77a2eb97aadf001dc8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:29.263209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9501-4ff7-4a94-907d-c7b1c14836be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:29.284878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9501-4ff7-4a94-907d-c7b1c14836be tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:29.397320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb13dd-d566-457f-9396-ea18f3d9809c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:29.398529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb13dd-d566-457f-9396-ea18f3d9809c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:29.398981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb13dd-d566-457f-9396-ea18f3d9809c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:29.399422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb13dd-d566-457f-9396-ea18f3d9809c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/projects/02e914987cb94575948dd1f6103f6b20/users/4ccf7982ac30441bb7b459ea32916597/roles/6db0caebb3844a77a2eb97aadf001dc8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:29.405089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb13dd-d566-457f-9396-ea18f3d9809c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:create_grant(project_id=02e914987cb94575948dd1f6103f6b20, user_id=4ccf7982ac30441bb7b459ea32916597, role_id=6db0caebb3844a77a2eb97aadf001dc8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:29.411845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb13dd-d566-457f-9396-ea18f3d9809c tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:29.446126 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3146/6345] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:29 2022] PUT /identity/v3/projects/02e914987cb94575948dd1f6103f6b20/users/4ccf7982ac30441bb7b459ea32916597/roles/6db0caebb3844a77a2eb97aadf001dc8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:29.450887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a785f6e-4a65-49ed-b992-e6dea9703395 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:29.451325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a785f6e-4a65-49ed-b992-e6dea9703395 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:29.451701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a785f6e-4a65-49ed-b992-e6dea9703395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:29.499984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6a785f6e-4a65-49ed-b992-e6dea9703395 None None] MFA Rules not processed for user `4ccf7982ac30441bb7b459ea32916597`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:29.502383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6a785f6e-4a65-49ed-b992-e6dea9703395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:29.509213 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3200/6346] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:29 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:10:29.511485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcc7b-912d-4fa3-a61c-89838647851d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:29.511701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcc7b-912d-4fa3-a61c-89838647851d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:29.512059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdcc7b-912d-4fa3-a61c-89838647851d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:29.533355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0dcdcc7b-912d-4fa3-a61c-89838647851d None None] MFA Rules not processed for user `4ccf7982ac30441bb7b459ea32916597`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:29.546686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0dcdcc7b-912d-4fa3-a61c-89838647851d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:29.858225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a785f6e-4a65-49ed-b992-e6dea9703395 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:29.863273 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3147/6347] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:29 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Mar 26 21:10:29.979887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a785f6e-4a65-49ed-b992-e6dea9703395 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:29.988049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d5adb-1b83-4779-8993-a816fe96f47e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:29.989728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d5adb-1b83-4779-8993-a816fe96f47e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:29.990454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d5adb-1b83-4779-8993-a816fe96f47e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:29.991175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d5adb-1b83-4779-8993-a816fe96f47e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:30.007765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d5adb-1b83-4779-8993-a816fe96f47e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:30.010016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534d5adb-1b83-4779-8993-a816fe96f47e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:30.031953 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3201/6348] 10.222.0.16 () {56 vars in 1307 bytes} [Sat Mar 26 21:10:29 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:30.036379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee99db6-6d04-4045-88c1-75ce35262d9a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:30.036379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee99db6-6d04-4045-88c1-75ce35262d9a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:30.036625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee99db6-6d04-4045-88c1-75ce35262d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:30.053503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2ee99db6-6d04-4045-88c1-75ce35262d9a None None] MFA Rules not processed for user `4ccf7982ac30441bb7b459ea32916597`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:30.055247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2ee99db6-6d04-4045-88c1-75ce35262d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:30.234918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d5adb-1b83-4779-8993-a816fe96f47e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:30.235770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3148/6349] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:30 2022] POST /identity/v3/auth/tokens => generated 3216 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Mar 26 21:10:30.247296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d5adb-1b83-4779-8993-a816fe96f47e tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:30.257933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:30.261366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:30.262164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:30.262612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/roles/6db0caebb3844a77a2eb97aadf001dc8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:30.272495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6db0caebb3844a77a2eb97aadf001dc8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:30.277467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:30.362677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invalidating the token cache because role 6db0caebb3844a77a2eb97aadf001dc8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:30.363070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:30.364995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:30.372166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee99db6-6d04-4045-88c1-75ce35262d9a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:30.372327 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3202/6350] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:30 2022] DELETE /identity/v3/roles/6db0caebb3844a77a2eb97aadf001dc8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:30.401273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee99db6-6d04-4045-88c1-75ce35262d9a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:30.542972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:30.544535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:30.545111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:30.545489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/projects/02e914987cb94575948dd1f6103f6b20` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:30.547405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_project(project_id=02e914987cb94575948dd1f6103f6b20)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:30.549721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:30.626936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e914987cb94575948dd1f6103f6b20', 'request_id': 'req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:30.650049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e914987cb94575948dd1f6103f6b20', 'request_id': 'req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:30.657172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e914987cb94575948dd1f6103f6b20', 'request_id': 'req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:30.678307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] The token cache is being invalidate because project 02e914987cb94575948dd1f6103f6b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:30.678606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:30.679780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:30.682410 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3149/6351] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:30 2022] DELETE /identity/v3/projects/02e914987cb94575948dd1f6103f6b20 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:30.687515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:30.689127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:30.706078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae0412-c406-4ace-91f3-0563c49113a0 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:30.793081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:30.794468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:30.794468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:30.795246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/projects/02e914987cb94575948dd1f6103f6b20` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:30.818072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_project(project_id=02e914987cb94575948dd1f6103f6b20)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:30.820690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:30.843976 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Could not find project: 02e914987cb94575948dd1f6103f6b20.: keystone.exception.ProjectNotFound: Could not find project: 02e914987cb94575948dd1f6103f6b20. Mar 26 21:10:30.846232 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3203/6352] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:30 2022] DELETE /identity/v3/projects/02e914987cb94575948dd1f6103f6b20 => generated 113 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Mar 26 21:10:30.849441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:30.852742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:30.871573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c2e9cf-2ceb-4bf2-9753-73f2a6dc324d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:30.880357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:30.881396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:30.881784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:30.882163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/projects/2653cb211d264a5a8d3df5da16e8facc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:30.884555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2653cb211d264a5a8d3df5da16e8facc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:30.885866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:31.023865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2653cb211d264a5a8d3df5da16e8facc', 'request_id': 'req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.047830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2653cb211d264a5a8d3df5da16e8facc', 'request_id': 'req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.054879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2653cb211d264a5a8d3df5da16e8facc', 'request_id': 'req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.087938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] The token cache is being invalidate because project 2653cb211d264a5a8d3df5da16e8facc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:31.087938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.089518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.092915 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3150/6353] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:30 2022] DELETE /identity/v3/projects/2653cb211d264a5a8d3df5da16e8facc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:31.097026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:31.098769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:31.135270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942d325-ea00-4a00-8a55-fb7d6353abd8 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:31.287801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:31.288733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:31.289201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:31.289490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/users/4ccf7982ac30441bb7b459ea32916597` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:31.291651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4ccf7982ac30441bb7b459ea32916597)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:31.298546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:31.390627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccf7982ac30441bb7b459ea32916597'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.398295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccf7982ac30441bb7b459ea32916597'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.399028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccf7982ac30441bb7b459ea32916597'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.399727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccf7982ac30441bb7b459ea32916597'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.416899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccf7982ac30441bb7b459ea32916597'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:31.446805 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3204/6354] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:31 2022] DELETE /identity/v3/users/4ccf7982ac30441bb7b459ea32916597 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:31.454436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:31.476307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f5df6-d319-4830-a10d-1dc8c3a6a0ee tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:31.580829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55c41-ee21-41cc-a143-7f7be4c2bcc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:31.581698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55c41-ee21-41cc-a143-7f7be4c2bcc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:31.581980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55c41-ee21-41cc-a143-7f7be4c2bcc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:31.582254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e55c41-ee21-41cc-a143-7f7be4c2bcc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/12380b7a18b64d42b8f7d867d13da83d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:31.590683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e55c41-ee21-41cc-a143-7f7be4c2bcc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:10:31.600876 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-e1e55c41-ee21-41cc-a143-7f7be4c2bcc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Could not find domain: 12380b7a18b64d42b8f7d867d13da83d.: keystone.exception.DomainNotFound: Could not find domain: 12380b7a18b64d42b8f7d867d13da83d. Mar 26 21:10:31.605665 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3151/6355] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:10:31 2022] PATCH /identity/v3/domains/12380b7a18b64d42b8f7d867d13da83d => generated 112 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:10:31.606700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:31.608321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:31.622812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97629b-4c6b-4e9e-987d-344375f87158 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:31.628833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19363-98f6-4641-a20f-bea675af328d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:31.629844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19363-98f6-4641-a20f-bea675af328d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:31.630330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19363-98f6-4641-a20f-bea675af328d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:31.630707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b19363-98f6-4641-a20f-bea675af328d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/2861231b2e624ef391f9a489400a0b5b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:31.639820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b19363-98f6-4641-a20f-bea675af328d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:10:31.650852 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-31b19363-98f6-4641-a20f-bea675af328d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Could not find domain: 2861231b2e624ef391f9a489400a0b5b.: keystone.exception.DomainNotFound: Could not find domain: 2861231b2e624ef391f9a489400a0b5b. Mar 26 21:10:31.655637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55c41-ee21-41cc-a143-7f7be4c2bcc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:31.661577 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3205/6356] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:10:31 2022] PATCH /identity/v3/domains/2861231b2e624ef391f9a489400a0b5b => generated 112 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:10:31.667501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e55c41-ee21-41cc-a143-7f7be4c2bcc4 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:31.677114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86179c-f967-4762-9abc-a49ec352bd35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:31.678003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86179c-f967-4762-9abc-a49ec352bd35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:31.678291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86179c-f967-4762-9abc-a49ec352bd35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:31.678568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d86179c-f967-4762-9abc-a49ec352bd35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:31.701928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d86179c-f967-4762-9abc-a49ec352bd35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:10:31.727903 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-7d86179c-f967-4762-9abc-a49ec352bd35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Could not find domain: 5f6e2e7778914d5c9b71789ebf2aa831.: keystone.exception.DomainNotFound: Could not find domain: 5f6e2e7778914d5c9b71789ebf2aa831. Mar 26 21:10:31.732999 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3152/6357] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:10:31 2022] PATCH /identity/v3/domains/5f6e2e7778914d5c9b71789ebf2aa831 => generated 112 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Mar 26 21:10:31.736759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19363-98f6-4641-a20f-bea675af328d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:31.755675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b19363-98f6-4641-a20f-bea675af328d tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:31.765080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e194e-6d48-4772-bd70-7dff5cac23b1 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b66cb05a678c4f17b8e7baa7714bd61b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a25fc8cec09f4d8784c7e74a5b56f536', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:31.766153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e194e-6d48-4772-bd70-7dff5cac23b1 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:31.766589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e194e-6d48-4772-bd70-7dff5cac23b1 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:31.767028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e194e-6d48-4772-bd70-7dff5cac23b1 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] PATH_INFO: `/v3/domains/ccc68b774ce34de5bc6a639271a2f242` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:31.776268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e194e-6d48-4772-bd70-7dff5cac23b1 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:10:31.788185 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-493e194e-6d48-4772-bd70-7dff5cac23b1 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Could not find domain: ccc68b774ce34de5bc6a639271a2f242.: keystone.exception.DomainNotFound: Could not find domain: ccc68b774ce34de5bc6a639271a2f242. Mar 26 21:10:31.793110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3206/6358] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:10:31 2022] PATCH /identity/v3/domains/ccc68b774ce34de5bc6a639271a2f242 => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:10:31.793722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86179c-f967-4762-9abc-a49ec352bd35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:31.795496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d86179c-f967-4762-9abc-a49ec352bd35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:31.934555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d86179c-f967-4762-9abc-a49ec352bd35 tempest-TokensV3TestJSON-1076761472 tempest-TokensV3TestJSON-1076761472-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:31.946776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:31.947565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:31.948014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:31.948313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] PATH_INFO: `/v3/users/ddf5c9049fd34e3c8393c1814d55555c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:31.952007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf5c9049fd34e3c8393c1814d55555c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:31.953969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:32.056698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf5c9049fd34e3c8393c1814d55555c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.069068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf5c9049fd34e3c8393c1814d55555c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.069731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf5c9049fd34e3c8393c1814d55555c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.070418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf5c9049fd34e3c8393c1814d55555c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.094032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf5c9049fd34e3c8393c1814d55555c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.116996 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3153/6359] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:31 2022] DELETE /identity/v3/users/ddf5c9049fd34e3c8393c1814d55555c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:32.121214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e57c8-bd75-48cc-8889-d4463b90743c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:32.121775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e57c8-bd75-48cc-8889-d4463b90743c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:32.121775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e57c8-bd75-48cc-8889-d4463b90743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:32.143261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0f6e57c8-bd75-48cc-8889-d4463b90743c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:32.144815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f6e57c8-bd75-48cc-8889-d4463b90743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:32.225439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:32.226882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:32.259382 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3207/6360] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:32.364941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e57c8-bd75-48cc-8889-d4463b90743c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:32.367004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f6e57c8-bd75-48cc-8889-d4463b90743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:32.417010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025397e-0a61-4ca7-8651-8713945cac61 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:32.425806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:32.426717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:32.427006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:32.427289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] PATH_INFO: `/v3/users/f4cf1a4ac5a24a10ba2b07eacca36328` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:32.429563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4cf1a4ac5a24a10ba2b07eacca36328)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:32.432828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:32.512707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4cf1a4ac5a24a10ba2b07eacca36328'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.533042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4cf1a4ac5a24a10ba2b07eacca36328'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.533832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4cf1a4ac5a24a10ba2b07eacca36328'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.536665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4cf1a4ac5a24a10ba2b07eacca36328'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.547707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e57c8-bd75-48cc-8889-d4463b90743c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:32.573092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:32.573758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:32.574233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:32.574969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:32.582411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a9ba83a6-2ea9-4b9a-880d-613bfd5cb72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4cf1a4ac5a24a10ba2b07eacca36328'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:32.582906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:32.618955 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3154/6361] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:32 2022] DELETE /identity/v3/users/f4cf1a4ac5a24a10ba2b07eacca36328 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:32.623131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:32.624290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428612-1ce1-4c30-a26d-78c288d6ab6f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:32.624771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428612-1ce1-4c30-a26d-78c288d6ab6f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:32.625378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46428612-1ce1-4c30-a26d-78c288d6ab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:32.625499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:32.649718 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3208/6362] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:10:32.679531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-46428612-1ce1-4c30-a26d-78c288d6ab6f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:32.680996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-46428612-1ce1-4c30-a26d-78c288d6ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:32.781869 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3155/6363] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:32.811336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:32.816653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:32.836536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc54250-d904-49f7-b11f-1a49606e802a service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:32.963311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecac8c-1c42-4ce7-9e81-f340218cd05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:32.964089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecac8c-1c42-4ce7-9e81-f340218cd05b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:32.964465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecac8c-1c42-4ce7-9e81-f340218cd05b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:32.964815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecac8c-1c42-4ce7-9e81-f340218cd05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:32.995160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecac8c-1c42-4ce7-9e81-f340218cd05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:32.996954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecac8c-1c42-4ce7-9e81-f340218cd05b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:33.016447 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3209/6364] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:33.410014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46428612-1ce1-4c30-a26d-78c288d6ab6f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:33.411276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-46428612-1ce1-4c30-a26d-78c288d6ab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:33.433207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46428612-1ce1-4c30-a26d-78c288d6ab6f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:33.452719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:33.453616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:33.453904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:33.454186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] PATH_INFO: `/v3/projects/668f5214a74b47368c0f369a97b95332` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:33.455492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=668f5214a74b47368c0f369a97b95332)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:33.458736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:33.529919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecac8c-1c42-4ce7-9e81-f340218cd05b service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:33.534026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c2ecac8c-1c42-4ce7-9e81-f340218cd05b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:33.559363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '668f5214a74b47368c0f369a97b95332', 'request_id': 'req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:33.577687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecac8c-1c42-4ce7-9e81-f340218cd05b service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:33.581092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '668f5214a74b47368c0f369a97b95332', 'request_id': 'req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:33.605051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '668f5214a74b47368c0f369a97b95332', 'request_id': 'req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:33.636536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] The token cache is being invalidate because project 668f5214a74b47368c0f369a97b95332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:33.637173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:33.639434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:33.646499 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3156/6365] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:33 2022] DELETE /identity/v3/projects/668f5214a74b47368c0f369a97b95332 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:33.650341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:33.654770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:33.803411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6ee5f-006d-43c8-b880-1a1f68ce8775 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:33.813394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:33.815145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:33.815585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:33.816759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] PATH_INFO: `/v3/users/b66cb05a678c4f17b8e7baa7714bd61b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:33.818448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b66cb05a678c4f17b8e7baa7714bd61b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:33.821597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:33.831115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:33.834803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:33.835096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:33.835374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] PATH_INFO: `/v3/projects/7562193827df467bb40fa31857362ff5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:33.837088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7562193827df467bb40fa31857362ff5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:33.843352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:33.928421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b66cb05a678c4f17b8e7baa7714bd61b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:33.956056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b66cb05a678c4f17b8e7baa7714bd61b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:33.958856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b66cb05a678c4f17b8e7baa7714bd61b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:33.961793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b66cb05a678c4f17b8e7baa7714bd61b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.015451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b66cb05a678c4f17b8e7baa7714bd61b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.038421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7562193827df467bb40fa31857362ff5', 'request_id': 'req-98a7565b-0d8b-4f5b-815d-939087829f9a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.057485 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3157/6366] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:33 2022] DELETE /identity/v3/users/b66cb05a678c4f17b8e7baa7714bd61b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:34.063441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7562193827df467bb40fa31857362ff5', 'request_id': 'req-98a7565b-0d8b-4f5b-815d-939087829f9a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.100203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7562193827df467bb40fa31857362ff5', 'request_id': 'req-98a7565b-0d8b-4f5b-815d-939087829f9a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.126676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] The token cache is being invalidate because project 7562193827df467bb40fa31857362ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:34.127117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.129451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.135168 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3210/6367] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:33 2022] DELETE /identity/v3/projects/7562193827df467bb40fa31857362ff5 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:34.136517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:34.138311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:34.282879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645c1f9-3b1b-437d-9d13-4307cf9877ff admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:34.293838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:34.295187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:34.295474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:34.295871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] PATH_INFO: `/v3/users/bcff5001ffae4d9a8dd5e8e100330ab6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:34.297528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcff5001ffae4d9a8dd5e8e100330ab6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:34.299863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:34.511790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcff5001ffae4d9a8dd5e8e100330ab6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.525279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcff5001ffae4d9a8dd5e8e100330ab6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.525990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcff5001ffae4d9a8dd5e8e100330ab6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.526740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcff5001ffae4d9a8dd5e8e100330ab6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.554371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-625bf988-da60-4f38-8d37-183f10444f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcff5001ffae4d9a8dd5e8e100330ab6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:34.584555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3158/6368] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:34 2022] DELETE /identity/v3/users/bcff5001ffae4d9a8dd5e8e100330ab6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:34.982682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:34.984196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:35.189376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7565b-0d8b-4f5b-815d-939087829f9a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:35.342165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:35.343353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:35.345193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:35.345600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] PATH_INFO: `/v3/projects/596ee8810125431d954b80477f5e5ec2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:35.347069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=596ee8810125431d954b80477f5e5ec2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:35.352458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:35.462698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596ee8810125431d954b80477f5e5ec2', 'request_id': 'req-76d91148-cf5f-4297-b30a-f208adfaba1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:35.481767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596ee8810125431d954b80477f5e5ec2', 'request_id': 'req-76d91148-cf5f-4297-b30a-f208adfaba1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:35.497211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596ee8810125431d954b80477f5e5ec2', 'request_id': 'req-76d91148-cf5f-4297-b30a-f208adfaba1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:35.531773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] The token cache is being invalidate because project 596ee8810125431d954b80477f5e5ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:35.532082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:35.532922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:35.536461 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3211/6369] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:34 2022] DELETE /identity/v3/projects/596ee8810125431d954b80477f5e5ec2 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:35.541575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763189d8-0a6e-43c8-a6c0-8327c16bedfd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:35.541881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763189d8-0a6e-43c8-a6c0-8327c16bedfd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:35.542151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763189d8-0a6e-43c8-a6c0-8327c16bedfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:35.595748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:35.597045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-763189d8-0a6e-43c8-a6c0-8327c16bedfd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:35.597531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:35.598269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-763189d8-0a6e-43c8-a6c0-8327c16bedfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:35.737160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d91148-cf5f-4297-b30a-f208adfaba1a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:35.747274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5ecdd-2b7d-477f-b2e0-3da0f64acf51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:35.748004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5ecdd-2b7d-477f-b2e0-3da0f64acf51 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:35.748291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5ecdd-2b7d-477f-b2e0-3da0f64acf51 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:35.748562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f5ecdd-2b7d-477f-b2e0-3da0f64acf51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:35.768627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-98f5ecdd-2b7d-477f-b2e0-3da0f64acf51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:35.801523 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3159/6370] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:35.810707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048476b-c566-45b0-ba92-e1f858e8e3fc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:35.811215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048476b-c566-45b0-ba92-e1f858e8e3fc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:35.811957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048476b-c566-45b0-ba92-e1f858e8e3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:35.815437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5ecdd-2b7d-477f-b2e0-3da0f64acf51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:35.822612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f5ecdd-2b7d-477f-b2e0-3da0f64acf51 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:35.840691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7048476b-c566-45b0-ba92-e1f858e8e3fc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:35.842874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7048476b-c566-45b0-ba92-e1f858e8e3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:35.847953 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3212/6371] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:10:35.854956 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3160/6372] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:35.859069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5ecdd-2b7d-477f-b2e0-3da0f64acf51 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:35.889173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f5ecdd-2b7d-477f-b2e0-3da0f64acf51 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:35.903745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:35.905426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:35.906151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:35.906629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:35.907630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:35.908162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:35.910937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:35.943029 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3213/6373] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:10:35.947331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048476b-c566-45b0-ba92-e1f858e8e3fc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:35.962276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048476b-c566-45b0-ba92-e1f858e8e3fc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:35.976970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279b6e6-923c-47c8-a88d-7eb47327b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:35.977753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279b6e6-923c-47c8-a88d-7eb47327b514 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:35.978108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279b6e6-923c-47c8-a88d-7eb47327b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:35.978457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279b6e6-923c-47c8-a88d-7eb47327b514 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:35.979834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279b6e6-923c-47c8-a88d-7eb47327b514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:35.981985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279b6e6-923c-47c8-a88d-7eb47327b514 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:36.086469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:36.088463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:36.099125 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3161/6374] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:35 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:36.103855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279b6e6-923c-47c8-a88d-7eb47327b514 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:36.108962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54196c-3958-4045-838e-c12d90467275 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:36.273383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279b6e6-923c-47c8-a88d-7eb47327b514 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:36.275073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:36.275982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:36.277892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:36.278168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] PATH_INFO: `/v3/projects/a25fc8cec09f4d8784c7e74a5b56f536` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:36.284972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd4559-bfd4-4d1f-87b4-c3322a95fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:36.288606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd4559-bfd4-4d1f-87b4-c3322a95fafe admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:36.288867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd4559-bfd4-4d1f-87b4-c3322a95fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:36.289066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd4559-bfd4-4d1f-87b4-c3322a95fafe admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:36.289729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd4559-bfd4-4d1f-87b4-c3322a95fafe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:36.291736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd4559-bfd4-4d1f-87b4-c3322a95fafe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:36.294278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25fc8cec09f4d8784c7e74a5b56f536)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:36.297042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:36.344141 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3162/6375] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:36 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:36.345099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd4559-bfd4-4d1f-87b4-c3322a95fafe admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:36.373383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd4559-bfd4-4d1f-87b4-c3322a95fafe admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:36.392068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bef1ff-ca3b-4593-bd56-5af630ab366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:36.392922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bef1ff-ca3b-4593-bd56-5af630ab366a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:36.393051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bef1ff-ca3b-4593-bd56-5af630ab366a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:36.393305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bef1ff-ca3b-4593-bd56-5af630ab366a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:36.394046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bef1ff-ca3b-4593-bd56-5af630ab366a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:36.395696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bef1ff-ca3b-4593-bd56-5af630ab366a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:36.422013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25fc8cec09f4d8784c7e74a5b56f536', 'request_id': 'req-80d94c2f-843c-4439-a304-ddf9a0b77983'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.423451 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3163/6376] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:36.429927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bef1ff-ca3b-4593-bd56-5af630ab366a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:36.438128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25fc8cec09f4d8784c7e74a5b56f536', 'request_id': 'req-80d94c2f-843c-4439-a304-ddf9a0b77983'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.449479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bef1ff-ca3b-4593-bd56-5af630ab366a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:36.450028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25fc8cec09f4d8784c7e74a5b56f536', 'request_id': 'req-80d94c2f-843c-4439-a304-ddf9a0b77983'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.470411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] The token cache is being invalidate because project a25fc8cec09f4d8784c7e74a5b56f536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:36.470699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.471379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.489864 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3214/6377] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:36 2022] DELETE /identity/v3/projects/a25fc8cec09f4d8784c7e74a5b56f536 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:36.494540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:36.496825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:36.587158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053063f-76aa-4fe7-a97f-10122969944a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:36.587857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053063f-76aa-4fe7-a97f-10122969944a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:36.588242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053063f-76aa-4fe7-a97f-10122969944a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:36.588452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053063f-76aa-4fe7-a97f-10122969944a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:36.589182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053063f-76aa-4fe7-a97f-10122969944a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:36.590828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053063f-76aa-4fe7-a97f-10122969944a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:36.629487 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3164/6378] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:36.633966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053063f-76aa-4fe7-a97f-10122969944a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:36.637663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4053063f-76aa-4fe7-a97f-10122969944a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:36.658483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053063f-76aa-4fe7-a97f-10122969944a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:36.660143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d94c2f-843c-4439-a304-ddf9a0b77983 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:36.664800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792e5c9-0d47-4676-b618-28ede1122532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:36.666582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792e5c9-0d47-4676-b618-28ede1122532 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:36.667181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792e5c9-0d47-4676-b618-28ede1122532 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:36.667662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792e5c9-0d47-4676-b618-28ede1122532 admin admin] PATH_INFO: `/v3/projects/ace57cacf3a9435eb4945655bd3a6c57/users/c310d2bcd40347e58581d3f154347203/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:36.668151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:36.669337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:36.670267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:36.670672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] PATH_INFO: `/v3/users/5a41400f6c9f40538f3006f9aea18d85` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:36.672489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a41400f6c9f40538f3006f9aea18d85)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:36.675459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:36.719738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792e5c9-0d47-4676-b618-28ede1122532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace57cacf3a9435eb4945655bd3a6c57, user_id=c310d2bcd40347e58581d3f154347203, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:36.723223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792e5c9-0d47-4676-b618-28ede1122532 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:36.753280 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3165/6379] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:36 2022] PUT /identity/v3/projects/ace57cacf3a9435eb4945655bd3a6c57/users/c310d2bcd40347e58581d3f154347203/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:36.765222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a41400f6c9f40538f3006f9aea18d85'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.765222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a41400f6c9f40538f3006f9aea18d85'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.765222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a41400f6c9f40538f3006f9aea18d85'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.765222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a41400f6c9f40538f3006f9aea18d85'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.766746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ad985-1ed6-4d4c-b899-2eeeedcfc3db None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:36.767221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ad985-1ed6-4d4c-b899-2eeeedcfc3db None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:36.767503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ad985-1ed6-4d4c-b899-2eeeedcfc3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:36.789224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a41400f6c9f40538f3006f9aea18d85'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:36.830981 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3215/6380] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:36 2022] DELETE /identity/v3/users/5a41400f6c9f40538f3006f9aea18d85 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:36.834523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f12ad985-1ed6-4d4c-b899-2eeeedcfc3db None None] MFA Rules not processed for user `c310d2bcd40347e58581d3f154347203`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:36.835758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f12ad985-1ed6-4d4c-b899-2eeeedcfc3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:36.938461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:36.940435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:36.942322 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3166/6381] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:37.104737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81bbf4-c470-47e9-b8c2-a19e24fbb8fe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:37.117208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a85ce-be41-439a-bc20-da9cf2c31f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:37.117816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a85ce-be41-439a-bc20-da9cf2c31f25 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:37.119621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a85ce-be41-439a-bc20-da9cf2c31f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:37.119837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a85ce-be41-439a-bc20-da9cf2c31f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:37.120741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a85ce-be41-439a-bc20-da9cf2c31f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:37.123497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a85ce-be41-439a-bc20-da9cf2c31f25 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:37.178610 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3216/6382] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:36 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:37.182415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ad985-1ed6-4d4c-b899-2eeeedcfc3db None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:37.196124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ad985-1ed6-4d4c-b899-2eeeedcfc3db None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:37.344076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a85ce-be41-439a-bc20-da9cf2c31f25 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:37.345913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-314a85ce-be41-439a-bc20-da9cf2c31f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:37.353686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be2f2a-1fe6-4751-b655-e7927519227c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:37.354894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be2f2a-1fe6-4751-b655-e7927519227c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:37.355369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be2f2a-1fe6-4751-b655-e7927519227c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:37.355834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be2f2a-1fe6-4751-b655-e7927519227c admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:37.356869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be2f2a-1fe6-4751-b655-e7927519227c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:37.363895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be2f2a-1fe6-4751-b655-e7927519227c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:37.392040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a85ce-be41-439a-bc20-da9cf2c31f25 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:37.412103 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3167/6383] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:37 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:37.415511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be2f2a-1fe6-4751-b655-e7927519227c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:37.416101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:37.421277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:37.421828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:37.424153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] PATH_INFO: `/v3/projects/2bff193c9e7548b381c4d5701471b65a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:37.427601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bff193c9e7548b381c4d5701471b65a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:37.429794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:37.442592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be2f2a-1fe6-4751-b655-e7927519227c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:37.456044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6352b-2c9d-4063-8442-4c2af2f475e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:37.461253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6352b-2c9d-4063-8442-4c2af2f475e7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:37.463303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6352b-2c9d-4063-8442-4c2af2f475e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:37.463959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6352b-2c9d-4063-8442-4c2af2f475e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:37.464748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6352b-2c9d-4063-8442-4c2af2f475e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:37.467109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6352b-2c9d-4063-8442-4c2af2f475e7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:37.479104 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3168/6384] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:37.483454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6352b-2c9d-4063-8442-4c2af2f475e7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:37.519361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6352b-2c9d-4063-8442-4c2af2f475e7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:37.549637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b405e-a9a8-403b-9b44-e44409099730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:37.551644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b405e-a9a8-403b-9b44-e44409099730 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:37.552729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b405e-a9a8-403b-9b44-e44409099730 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:37.554619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bff193c9e7548b381c4d5701471b65a', 'request_id': 'req-1ef9cb27-a730-409e-bdca-a9df4ccfce02'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:37.555093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b405e-a9a8-403b-9b44-e44409099730 admin admin] PATH_INFO: `/v3/projects/ec20d4256a9946e38d5f5ca4871295da/users/ae3287541dee46208134c2309a18293d/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:37.564380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bff193c9e7548b381c4d5701471b65a', 'request_id': 'req-1ef9cb27-a730-409e-bdca-a9df4ccfce02'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:37.573907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bff193c9e7548b381c4d5701471b65a', 'request_id': 'req-1ef9cb27-a730-409e-bdca-a9df4ccfce02'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:37.592880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] The token cache is being invalidate because project 2bff193c9e7548b381c4d5701471b65a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:37.593343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:37.594182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1ef9cb27-a730-409e-bdca-a9df4ccfce02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:37.599232 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3217/6385] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:37 2022] DELETE /identity/v3/projects/2bff193c9e7548b381c4d5701471b65a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:37.600958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f1dab-270f-4387-8a3b-ca5d454c0596 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:37.601385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f1dab-270f-4387-8a3b-ca5d454c0596 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:37.601769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f1dab-270f-4387-8a3b-ca5d454c0596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:37.631541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-929f1dab-270f-4387-8a3b-ca5d454c0596 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:37.633130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-929f1dab-270f-4387-8a3b-ca5d454c0596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:37.637973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b405e-a9a8-403b-9b44-e44409099730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec20d4256a9946e38d5f5ca4871295da, user_id=ae3287541dee46208134c2309a18293d, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:37.645220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1b405e-a9a8-403b-9b44-e44409099730 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:37.689054 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3169/6386] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:37 2022] PUT /identity/v3/projects/ec20d4256a9946e38d5f5ca4871295da/users/ae3287541dee46208134c2309a18293d/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:37.692799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b405e-a9a8-403b-9b44-e44409099730 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:37.697650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fb1b405e-a9a8-403b-9b44-e44409099730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:37.727974 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3218/6387] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:37.736479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c336433-e69e-4c03-ab71-1cc6be877b46 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:37.738005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c336433-e69e-4c03-ab71-1cc6be877b46 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:37.743505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c336433-e69e-4c03-ab71-1cc6be877b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:37.800315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8c336433-e69e-4c03-ab71-1cc6be877b46 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:37.801554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8c336433-e69e-4c03-ab71-1cc6be877b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:37.893079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b405e-a9a8-403b-9b44-e44409099730 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:37.920727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ac1f6-ddde-4326-9bb0-0dfaddf981ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:37.921459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ac1f6-ddde-4326-9bb0-0dfaddf981ce admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:37.921758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ac1f6-ddde-4326-9bb0-0dfaddf981ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:37.922027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ac1f6-ddde-4326-9bb0-0dfaddf981ce admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:37.923858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ac1f6-ddde-4326-9bb0-0dfaddf981ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:37.925828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ac1f6-ddde-4326-9bb0-0dfaddf981ce admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:37.966155 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3170/6388] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:37.967202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ac1f6-ddde-4326-9bb0-0dfaddf981ce admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:37.991425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ac1f6-ddde-4326-9bb0-0dfaddf981ce admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:37.997278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230cf7b5-8a74-44c4-9c76-6225f36f8dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:37.999904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cf7b5-8a74-44c4-9c76-6225f36f8dce admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:38.001064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cf7b5-8a74-44c4-9c76-6225f36f8dce admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:38.001536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230cf7b5-8a74-44c4-9c76-6225f36f8dce admin admin] PATH_INFO: `/v3/projects/ec20d4256a9946e38d5f5ca4871295da/users/ae3287541dee46208134c2309a18293d/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:38.004609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cf7b5-8a74-44c4-9c76-6225f36f8dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec20d4256a9946e38d5f5ca4871295da, user_id=ae3287541dee46208134c2309a18293d, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:38.008405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230cf7b5-8a74-44c4-9c76-6225f36f8dce admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:38.023496 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3171/6389] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:37 2022] PUT /identity/v3/projects/ec20d4256a9946e38d5f5ca4871295da/users/ae3287541dee46208134c2309a18293d/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:38.035013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c397214-a7cf-479c-b541-3da999cb5758 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:38.036209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c397214-a7cf-479c-b541-3da999cb5758 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:38.038425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c397214-a7cf-479c-b541-3da999cb5758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:38.050069 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3219/6390] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:38.054861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c336433-e69e-4c03-ab71-1cc6be877b46 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:38.078643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c336433-e69e-4c03-ab71-1cc6be877b46 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:38.135669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1c397214-a7cf-479c-b541-3da999cb5758 None None] MFA Rules not processed for user `ae3287541dee46208134c2309a18293d`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:38.141622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1c397214-a7cf-479c-b541-3da999cb5758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:38.308393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed64a6-1194-4f89-8bfe-f8a6cadbac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:38.308393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed64a6-1194-4f89-8bfe-f8a6cadbac4b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:38.308393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed64a6-1194-4f89-8bfe-f8a6cadbac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:38.308393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed64a6-1194-4f89-8bfe-f8a6cadbac4b admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:38.309567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed64a6-1194-4f89-8bfe-f8a6cadbac4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:38.309567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed64a6-1194-4f89-8bfe-f8a6cadbac4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:38.309567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed64a6-1194-4f89-8bfe-f8a6cadbac4b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:38.326246 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3220/6391] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:38.328516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed64a6-1194-4f89-8bfe-f8a6cadbac4b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:38.352458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed64a6-1194-4f89-8bfe-f8a6cadbac4b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:38.391459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d1650-14d1-4658-b407-4c46beebb114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:38.392595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d1650-14d1-4658-b407-4c46beebb114 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:38.393075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d1650-14d1-4658-b407-4c46beebb114 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:38.393538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d1650-14d1-4658-b407-4c46beebb114 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:38.412683 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3172/6392] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:38.413681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d1650-14d1-4658-b407-4c46beebb114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:38.420428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c397214-a7cf-479c-b541-3da999cb5758 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:38.424674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1c397214-a7cf-479c-b541-3da999cb5758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:38.429361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d1650-14d1-4658-b407-4c46beebb114 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:38.506669 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3221/6393] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:38 2022] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:38.512146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d1650-14d1-4658-b407-4c46beebb114 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:38.570628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c397214-a7cf-479c-b541-3da999cb5758 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:38.670352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d1650-14d1-4658-b407-4c46beebb114 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:38.683364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769fb3-9787-4be7-ac3c-74f68f760993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:38.684193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769fb3-9787-4be7-ac3c-74f68f760993 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:38.684528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769fb3-9787-4be7-ac3c-74f68f760993 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:38.684806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d769fb3-9787-4be7-ac3c-74f68f760993 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:38.685544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769fb3-9787-4be7-ac3c-74f68f760993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:38.690050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d769fb3-9787-4be7-ac3c-74f68f760993 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:38.710468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987364e1-8107-456a-8cc3-1b91da6ec976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:38.711157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987364e1-8107-456a-8cc3-1b91da6ec976 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:38.711420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987364e1-8107-456a-8cc3-1b91da6ec976 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:38.711687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987364e1-8107-456a-8cc3-1b91da6ec976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:38.740192 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3222/6394] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:38 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:38.741394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769fb3-9787-4be7-ac3c-74f68f760993 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:38.765060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d769fb3-9787-4be7-ac3c-74f68f760993 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:38.770598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f824a-1e99-46ee-b932-597aee344650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:38.772023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f824a-1e99-46ee-b932-597aee344650 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:38.773146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f824a-1e99-46ee-b932-597aee344650 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:38.773593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f824a-1e99-46ee-b932-597aee344650 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:38.774499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f824a-1e99-46ee-b932-597aee344650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:38.776354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f824a-1e99-46ee-b932-597aee344650 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:38.789030 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3223/6395] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:38.813003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f824a-1e99-46ee-b932-597aee344650 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:38.838942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f824a-1e99-46ee-b932-597aee344650 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:38.852747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2da2fc-b94a-4480-87c5-caaf5a67fa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:38.853668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2da2fc-b94a-4480-87c5-caaf5a67fa12 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:38.854655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2da2fc-b94a-4480-87c5-caaf5a67fa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:38.855121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2da2fc-b94a-4480-87c5-caaf5a67fa12 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:38.856896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2da2fc-b94a-4480-87c5-caaf5a67fa12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:38.862919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2da2fc-b94a-4480-87c5-caaf5a67fa12 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:38.876109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987364e1-8107-456a-8cc3-1b91da6ec976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:38.877594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987364e1-8107-456a-8cc3-1b91da6ec976 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:38.886553 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3224/6396] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:10:38.891618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2da2fc-b94a-4480-87c5-caaf5a67fa12 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:38.909323 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3173/6397] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:10:38.910897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2da2fc-b94a-4480-87c5-caaf5a67fa12 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:38.926505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbc567-c668-409d-9959-09f4b01ea80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:38.927632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbc567-c668-409d-9959-09f4b01ea80c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:38.928109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbc567-c668-409d-9959-09f4b01ea80c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:38.928577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbc567-c668-409d-9959-09f4b01ea80c admin admin] PATH_INFO: `/v3/projects/8ae99e7304ab40079a0aeaaa57c0d143/users/347b32b9beb84f658a5ab68dbec25372/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:38.975503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbc567-c668-409d-9959-09f4b01ea80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ae99e7304ab40079a0aeaaa57c0d143, user_id=347b32b9beb84f658a5ab68dbec25372, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:38.991052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbc567-c668-409d-9959-09f4b01ea80c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:39.036803 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3225/6398] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:38 2022] PUT /identity/v3/projects/8ae99e7304ab40079a0aeaaa57c0d143/users/347b32b9beb84f658a5ab68dbec25372/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:39.048554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319928-e4a6-4716-b737-f4f070c7c478 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:39.048842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319928-e4a6-4716-b737-f4f070c7c478 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:39.049125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319928-e4a6-4716-b737-f4f070c7c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:39.141657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5c319928-e4a6-4716-b737-f4f070c7c478 None None] MFA Rules not processed for user `347b32b9beb84f658a5ab68dbec25372`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:39.143166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5c319928-e4a6-4716-b737-f4f070c7c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:39.322450 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3174/6399] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:39.327318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbc567-c668-409d-9959-09f4b01ea80c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:39.479304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbc567-c668-409d-9959-09f4b01ea80c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:39.491941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc5338-bcd8-4ea5-aa08-42e5defce00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:39.492916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc5338-bcd8-4ea5-aa08-42e5defce00f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:39.494775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc5338-bcd8-4ea5-aa08-42e5defce00f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:39.495149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc5338-bcd8-4ea5-aa08-42e5defce00f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:39.497550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc5338-bcd8-4ea5-aa08-42e5defce00f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:39.499627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc5338-bcd8-4ea5-aa08-42e5defce00f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:39.561398 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3226/6400] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:39 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:39.566162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c319928-e4a6-4716-b737-f4f070c7c478 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:39.581702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c319928-e4a6-4716-b737-f4f070c7c478 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:39.707901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ba85-bdce-4172-8fc4-627df3664870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:39.708808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ba85-bdce-4172-8fc4-627df3664870 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:39.709206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ba85-bdce-4172-8fc4-627df3664870 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:39.709594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ba85-bdce-4172-8fc4-627df3664870 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:39.710556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4ba85-bdce-4172-8fc4-627df3664870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:39.713167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4ba85-bdce-4172-8fc4-627df3664870 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:39.752481 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3175/6401] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:39 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:39.756155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc5338-bcd8-4ea5-aa08-42e5defce00f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:39.776970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc5338-bcd8-4ea5-aa08-42e5defce00f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:39.794277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c04fa-0946-470e-abd3-9c24af3b75c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:39.795470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c04fa-0946-470e-abd3-9c24af3b75c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:39.795878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c04fa-0946-470e-abd3-9c24af3b75c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:39.796288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c04fa-0946-470e-abd3-9c24af3b75c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:39.798617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c04fa-0946-470e-abd3-9c24af3b75c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:39.803653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c04fa-0946-470e-abd3-9c24af3b75c6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:39.835517 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3227/6402] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:39.839544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ba85-bdce-4172-8fc4-627df3664870 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:39.855338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ba85-bdce-4172-8fc4-627df3664870 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:39.887171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2e2c4-16f4-405c-9800-de8aa4979ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:39.894548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e2c4-16f4-405c-9800-de8aa4979ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:39.896069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e2c4-16f4-405c-9800-de8aa4979ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:39.897698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2e2c4-16f4-405c-9800-de8aa4979ae3 admin admin] PATH_INFO: `/v3/projects/c5c3e48830974c83bd50a01110f0d3e4/users/e26bcb1d1ae64ed5bf6ab66b02c6ef0e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:39.979648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2e2c4-16f4-405c-9800-de8aa4979ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c3e48830974c83bd50a01110f0d3e4, user_id=e26bcb1d1ae64ed5bf6ab66b02c6ef0e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:39.991093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2e2c4-16f4-405c-9800-de8aa4979ae3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:40.057355 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3176/6403] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:39 2022] PUT /identity/v3/projects/c5c3e48830974c83bd50a01110f0d3e4/users/e26bcb1d1ae64ed5bf6ab66b02c6ef0e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:40.058099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c04fa-0946-470e-abd3-9c24af3b75c6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:40.070157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c04fa-0946-470e-abd3-9c24af3b75c6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:40.311042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aecc12-b900-4f7d-ad2c-c498ab88a126 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:40.313166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aecc12-b900-4f7d-ad2c-c498ab88a126 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:40.313695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aecc12-b900-4f7d-ad2c-c498ab88a126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:40.351032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd85b2-e4b0-4fc1-be26-e188d04dd4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:40.356262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd85b2-e4b0-4fc1-be26-e188d04dd4fe admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:40.357391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd85b2-e4b0-4fc1-be26-e188d04dd4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:40.357857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd85b2-e4b0-4fc1-be26-e188d04dd4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:40.359518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd85b2-e4b0-4fc1-be26-e188d04dd4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:40.361890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f4aecc12-b900-4f7d-ad2c-c498ab88a126 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:40.363985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd85b2-e4b0-4fc1-be26-e188d04dd4fe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:40.381900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f4aecc12-b900-4f7d-ad2c-c498ab88a126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:40.397671 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3228/6404] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:10:40.399675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd85b2-e4b0-4fc1-be26-e188d04dd4fe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:40.430060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd85b2-e4b0-4fc1-be26-e188d04dd4fe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:40.452610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec45522b-865c-43ef-a80c-2e2efd159121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:40.454966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45522b-865c-43ef-a80c-2e2efd159121 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:40.458139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45522b-865c-43ef-a80c-2e2efd159121 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:40.458669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec45522b-865c-43ef-a80c-2e2efd159121 admin admin] PATH_INFO: `/v3/projects/c5c3e48830974c83bd50a01110f0d3e4/users/e26bcb1d1ae64ed5bf6ab66b02c6ef0e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:40.465815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45522b-865c-43ef-a80c-2e2efd159121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c3e48830974c83bd50a01110f0d3e4, user_id=e26bcb1d1ae64ed5bf6ab66b02c6ef0e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:40.474081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec45522b-865c-43ef-a80c-2e2efd159121 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:40.509492 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3229/6405] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:40 2022] PUT /identity/v3/projects/c5c3e48830974c83bd50a01110f0d3e4/users/e26bcb1d1ae64ed5bf6ab66b02c6ef0e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:40.520613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc415-784f-40cb-a8c5-7d666686de10 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:40.521090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc415-784f-40cb-a8c5-7d666686de10 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:40.521792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bc415-784f-40cb-a8c5-7d666686de10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:40.599728 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3177/6406] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:10:40.616413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aecc12-b900-4f7d-ad2c-c498ab88a126 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:40.620138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dc5bc415-784f-40cb-a8c5-7d666686de10 None None] MFA Rules not processed for user `e26bcb1d1ae64ed5bf6ab66b02c6ef0e`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:40.621391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dc5bc415-784f-40cb-a8c5-7d666686de10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:40.625187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f4aecc12-b900-4f7d-ad2c-c498ab88a126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:40.841486 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3230/6407] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:40 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:10:40.846379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bc415-784f-40cb-a8c5-7d666686de10 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:40.864096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bc415-784f-40cb-a8c5-7d666686de10 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:40.874761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5deb38-a854-4753-83d0-2a60df96de27 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:40.876497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5deb38-a854-4753-83d0-2a60df96de27 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:40.879272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5deb38-a854-4753-83d0-2a60df96de27 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:40.880442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5deb38-a854-4753-83d0-2a60df96de27 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:40.881332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aecc12-b900-4f7d-ad2c-c498ab88a126 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:40.883508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5deb38-a854-4753-83d0-2a60df96de27 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:40.886094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5deb38-a854-4753-83d0-2a60df96de27 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:40.948151 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3231/6408] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:10:40 2022] POST /identity/v3/projects => generated 329 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:40.952480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5deb38-a854-4753-83d0-2a60df96de27 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:41.047567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da181-b63e-4772-b11c-ee25c8ea4fa9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:41.049198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da181-b63e-4772-b11c-ee25c8ea4fa9 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:41.049555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da181-b63e-4772-b11c-ee25c8ea4fa9 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:41.049899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9da181-b63e-4772-b11c-ee25c8ea4fa9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:41.137653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5deb38-a854-4753-83d0-2a60df96de27 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:41.148725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635a375-fdef-4048-8311-f70c2c701675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:41.149687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a375-fdef-4048-8311-f70c2c701675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:41.151662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a375-fdef-4048-8311-f70c2c701675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:41.153252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3635a375-fdef-4048-8311-f70c2c701675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:41.154120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635a375-fdef-4048-8311-f70c2c701675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:41.158786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3635a375-fdef-4048-8311-f70c2c701675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:41.176324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da181-b63e-4772-b11c-ee25c8ea4fa9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:41.178287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9da181-b63e-4772-b11c-ee25c8ea4fa9 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:41.196909 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3178/6409] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:10:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:10:41.220401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da181-b63e-4772-b11c-ee25c8ea4fa9 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:41.226053 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3232/6410] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:40 2022] POST /identity/v3/users => generated 413 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:41.241824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9da181-b63e-4772-b11c-ee25c8ea4fa9 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:41.249538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebafce9-2225-4e55-ac5d-929415086ccd tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:41.250644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebafce9-2225-4e55-ac5d-929415086ccd tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:41.251075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebafce9-2225-4e55-ac5d-929415086ccd tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:41.251449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebafce9-2225-4e55-ac5d-929415086ccd tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:41.252366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebafce9-2225-4e55-ac5d-929415086ccd tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:41.255153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebafce9-2225-4e55-ac5d-929415086ccd tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:41.284393 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3179/6411] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:41 2022] POST /identity/v3/roles => generated 244 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:41.285141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635a375-fdef-4048-8311-f70c2c701675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:41.301912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3635a375-fdef-4048-8311-f70c2c701675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:41.321306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53606e-fd1d-42fb-a982-c09a333b6dfc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:41.322386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53606e-fd1d-42fb-a982-c09a333b6dfc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:41.322927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53606e-fd1d-42fb-a982-c09a333b6dfc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:41.323433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53606e-fd1d-42fb-a982-c09a333b6dfc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:41.330451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53606e-fd1d-42fb-a982-c09a333b6dfc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:41.333042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53606e-fd1d-42fb-a982-c09a333b6dfc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:41.365458 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3233/6412] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:41 2022] POST /identity/v3/roles => generated 246 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:41.367181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebafce9-2225-4e55-ac5d-929415086ccd tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:41.385953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebafce9-2225-4e55-ac5d-929415086ccd tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:41.402722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6433a08-5795-488e-917a-a907f9f0a01d tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:41.410552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6433a08-5795-488e-917a-a907f9f0a01d tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:41.410925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6433a08-5795-488e-917a-a907f9f0a01d tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:41.411295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6433a08-5795-488e-917a-a907f9f0a01d tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/fc068a5c277243dfb46ce6a2cb4d76ed/users/b0cf2dc46e4e4cca977cd086fdecf7bc/roles/f94d1c66d05a4eaca8d1d0a6888342c8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:41.446539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6433a08-5795-488e-917a-a907f9f0a01d tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fc068a5c277243dfb46ce6a2cb4d76ed, user_id=b0cf2dc46e4e4cca977cd086fdecf7bc, role_id=f94d1c66d05a4eaca8d1d0a6888342c8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:41.454647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6433a08-5795-488e-917a-a907f9f0a01d tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:41.502786 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3180/6413] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:41 2022] PUT /identity/v3/projects/fc068a5c277243dfb46ce6a2cb4d76ed/users/b0cf2dc46e4e4cca977cd086fdecf7bc/roles/f94d1c66d05a4eaca8d1d0a6888342c8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:41.504509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53606e-fd1d-42fb-a982-c09a333b6dfc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:41.531765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53606e-fd1d-42fb-a982-c09a333b6dfc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:41.742504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2b6c42-08f8-48eb-a8fd-9a9ef36f2f05 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:41.746119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b6c42-08f8-48eb-a8fd-9a9ef36f2f05 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:41.746776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b6c42-08f8-48eb-a8fd-9a9ef36f2f05 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:41.747267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2b6c42-08f8-48eb-a8fd-9a9ef36f2f05 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/fc068a5c277243dfb46ce6a2cb4d76ed/users/b0cf2dc46e4e4cca977cd086fdecf7bc/roles/bb78d0d6412440afbe878ccac5a442af` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:41.756247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b6c42-08f8-48eb-a8fd-9a9ef36f2f05 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fc068a5c277243dfb46ce6a2cb4d76ed, user_id=b0cf2dc46e4e4cca977cd086fdecf7bc, role_id=bb78d0d6412440afbe878ccac5a442af)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:41.762178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2b6c42-08f8-48eb-a8fd-9a9ef36f2f05 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:41.794978 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3234/6414] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:41 2022] PUT /identity/v3/projects/fc068a5c277243dfb46ce6a2cb4d76ed/users/b0cf2dc46e4e4cca977cd086fdecf7bc/roles/bb78d0d6412440afbe878ccac5a442af => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:41.799383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6433a08-5795-488e-917a-a907f9f0a01d tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:41.818296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6433a08-5795-488e-917a-a907f9f0a01d tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:42.027798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1775d-0811-4cd0-934b-4993ac1fceb4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:42.028613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1775d-0811-4cd0-934b-4993ac1fceb4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:42.029484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1775d-0811-4cd0-934b-4993ac1fceb4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:42.029710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1775d-0811-4cd0-934b-4993ac1fceb4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:42.030489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1775d-0811-4cd0-934b-4993ac1fceb4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:42.034594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1775d-0811-4cd0-934b-4993ac1fceb4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:42.100285 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3181/6415] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:41 2022] GET /identity/v3/users => generated 8348 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:42.101607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa759-17ac-4590-8268-083fb7029cb9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:42.101901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa759-17ac-4590-8268-083fb7029cb9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:42.102205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aa759-17ac-4590-8268-083fb7029cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:42.306630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e76aa759-17ac-4590-8268-083fb7029cb9 None None] MFA Rules not processed for user `b0cf2dc46e4e4cca977cd086fdecf7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:42.307890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e76aa759-17ac-4590-8268-083fb7029cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:42.413505 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3235/6416] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:10:42.424839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb140011-ce2b-4615-a36b-a589843712a8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:42.425324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb140011-ce2b-4615-a36b-a589843712a8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:42.425966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb140011-ce2b-4615-a36b-a589843712a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:42.474284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-eb140011-ce2b-4615-a36b-a589843712a8 None None] MFA Rules not processed for user `b0cf2dc46e4e4cca977cd086fdecf7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:42.477663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eb140011-ce2b-4615-a36b-a589843712a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:42.502750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aa759-17ac-4590-8268-083fb7029cb9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:42.512590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aa759-17ac-4590-8268-083fb7029cb9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:42.513157 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3182/6417] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:42 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:42.522036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576f24-3347-4e70-ada3-fd21d44b72b8 tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0cf2dc46e4e4cca977cd086fdecf7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc068a5c277243dfb46ce6a2cb4d76ed', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-640172112', 'tempest-DelegatedRole-1529062724'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:42.533253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576f24-3347-4e70-ada3-fd21d44b72b8 tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:42.538781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576f24-3347-4e70-ada3-fd21d44b72b8 tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:42.539800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c576f24-3347-4e70-ada3-fd21d44b72b8 tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:42.540830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c576f24-3347-4e70-ada3-fd21d44b72b8 tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] RBAC: Authorizing `identity:create_trust()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:42.546806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c576f24-3347-4e70-ada3-fd21d44b72b8 tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:42.718834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb140011-ce2b-4615-a36b-a589843712a8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:42.722334 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3236/6418] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Mar 26 21:10:42 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:42.746778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb140011-ce2b-4615-a36b-a589843712a8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:42.765628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:42.766303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:42.766597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:42.766985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:42.772851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:42.773250 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:10:42.773250 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:10:42.773250 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:10:42.774581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:42.796418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576f24-3347-4e70-ada3-fd21d44b72b8 tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:42.806605 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3183/6419] 10.222.0.16 () {58 vars in 1154 bytes} [Sat Mar 26 21:10:42 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:42.811188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c576f24-3347-4e70-ada3-fd21d44b72b8 tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:42.821945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0cf2dc46e4e4cca977cd086fdecf7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc068a5c277243dfb46ce6a2cb4d76ed', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-640172112', 'tempest-DelegatedRole-1529062724'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:42.822853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:42.823138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:42.823536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] PATH_INFO: `/v3/OS-TRUST/trusts/d06ae49b56514b71aed90540334647b9` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:42.846462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] RBAC: Authorizing `identity:delete_trust(trust_id=d06ae49b56514b71aed90540334647b9)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:42.848042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:42.908001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd06ae49b56514b71aed90540334647b9', 'request_id': 'req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:42.908905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd06ae49b56514b71aed90540334647b9', 'request_id': 'req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:42.924716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd06ae49b56514b71aed90540334647b9', 'request_id': 'req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:42.943298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:42.944713 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3237/6420] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:10:42 2022] DELETE /identity/v3/OS-TRUST/trusts/d06ae49b56514b71aed90540334647b9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:42.945442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:42.969334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63e858-1f9c-4647-a19e-5f1ac61f1ff2 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:42.981179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38972-d891-4587-ab22-b8a3ae35277b tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0cf2dc46e4e4cca977cd086fdecf7bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc068a5c277243dfb46ce6a2cb4d76ed', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-640172112', 'tempest-DelegatedRole-1529062724'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:42.983028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38972-d891-4587-ab22-b8a3ae35277b tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:42.983320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38972-d891-4587-ab22-b8a3ae35277b tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:42.984807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff38972-d891-4587-ab22-b8a3ae35277b tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] PATH_INFO: `/v3/OS-TRUST/trusts/d06ae49b56514b71aed90540334647b9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:43.035911 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-dff38972-d891-4587-ab22-b8a3ae35277b tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Could not find trust: d06ae49b56514b71aed90540334647b9.: keystone.exception.TrustNotFound: Could not find trust: d06ae49b56514b71aed90540334647b9. Mar 26 21:10:43.043434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:43.045936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:43.054500 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3184/6421] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:10:42 2022] GET /identity/v3/OS-TRUST/trusts/d06ae49b56514b71aed90540334647b9 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:10:43.071038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5d3a9-c0d9-486b-8bf6-904f0e02956a tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:43.084258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:43.085528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:43.086368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:43.086368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/bb78d0d6412440afbe878ccac5a442af` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:43.087728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bb78d0d6412440afbe878ccac5a442af)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:43.089384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:43.181935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role bb78d0d6412440afbe878ccac5a442af has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:43.183200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:43.184816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:43.196383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38972-d891-4587-ab22-b8a3ae35277b tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:43.196582 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3238/6422] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:43 2022] DELETE /identity/v3/roles/bb78d0d6412440afbe878ccac5a442af => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:43.196827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dff38972-d891-4587-ab22-b8a3ae35277b tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:43.227378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff38972-d891-4587-ab22-b8a3ae35277b tempest-TrustsV3TestJSON-2062176984 tempest-user-174797239] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:43.416439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:43.417423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:43.417716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:43.417996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/f94d1c66d05a4eaca8d1d0a6888342c8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:43.430250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f94d1c66d05a4eaca8d1d0a6888342c8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:43.431908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:43.527615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role f94d1c66d05a4eaca8d1d0a6888342c8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:43.527909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:43.528603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:43.531673 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3185/6423] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:43 2022] DELETE /identity/v3/roles/f94d1c66d05a4eaca8d1d0a6888342c8 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:43.535461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:43.547665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507fd44-785f-4fb6-8ada-8b0f1e5344d4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:43.651222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:43.652066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:43.652351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:43.652780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users/b0cf2dc46e4e4cca977cd086fdecf7bc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:43.654059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b0cf2dc46e4e4cca977cd086fdecf7bc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:43.656056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:43.711171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0cf2dc46e4e4cca977cd086fdecf7bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:43.719891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0cf2dc46e4e4cca977cd086fdecf7bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:43.720987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0cf2dc46e4e4cca977cd086fdecf7bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:43.721387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0cf2dc46e4e4cca977cd086fdecf7bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:43.735656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0cf2dc46e4e4cca977cd086fdecf7bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:43.782389 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3239/6424] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:43 2022] DELETE /identity/v3/users/b0cf2dc46e4e4cca977cd086fdecf7bc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:43.786508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:43.788640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:43.810756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa982e9a-ff20-4545-a161-1cb5797e2f16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:44.057088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:44.058862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:44.060806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:44.061896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/fc068a5c277243dfb46ce6a2cb4d76ed` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:44.065949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fc068a5c277243dfb46ce6a2cb4d76ed)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:44.069474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:44.269458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc068a5c277243dfb46ce6a2cb4d76ed', 'request_id': 'req-d6665808-2fd8-4c5b-b9b1-13c5002a3325'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:44.288364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc068a5c277243dfb46ce6a2cb4d76ed', 'request_id': 'req-d6665808-2fd8-4c5b-b9b1-13c5002a3325'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:44.307812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc068a5c277243dfb46ce6a2cb4d76ed', 'request_id': 'req-d6665808-2fd8-4c5b-b9b1-13c5002a3325'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:44.346022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] The token cache is being invalidate because project fc068a5c277243dfb46ce6a2cb4d76ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:44.347091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:44.350536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:44.359814 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3186/6425] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:43 2022] DELETE /identity/v3/projects/fc068a5c277243dfb46ce6a2cb4d76ed => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:44.361047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:44.363281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:44.399403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399589a-8dee-482a-99ea-ef4b5cf86fee tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:44.550610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8107c8f-0cfb-4eda-a153-a2d07fcebe21 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:44.551332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8107c8f-0cfb-4eda-a153-a2d07fcebe21 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:44.551562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8107c8f-0cfb-4eda-a153-a2d07fcebe21 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:44.551851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8107c8f-0cfb-4eda-a153-a2d07fcebe21 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:44.558754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8107c8f-0cfb-4eda-a153-a2d07fcebe21 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:44.562876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8107c8f-0cfb-4eda-a153-a2d07fcebe21 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:44.645679 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3240/6426] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:10:44 2022] POST /identity/v3/projects => generated 328 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:44.650282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:44.652093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:44.674071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6665808-2fd8-4c5b-b9b1-13c5002a3325 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:44.932960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff19deb-1555-4b75-b50e-6db216929fba tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:44.934220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff19deb-1555-4b75-b50e-6db216929fba tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:44.941496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff19deb-1555-4b75-b50e-6db216929fba tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:44.942330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff19deb-1555-4b75-b50e-6db216929fba tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:44.943210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff19deb-1555-4b75-b50e-6db216929fba tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:44.947676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff19deb-1555-4b75-b50e-6db216929fba tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:45.032728 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3187/6427] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:44 2022] POST /identity/v3/users => generated 413 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:45.036695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8107c8f-0cfb-4eda-a153-a2d07fcebe21 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:45.067289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8107c8f-0cfb-4eda-a153-a2d07fcebe21 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:45.078845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5791141-231c-4cbe-8581-8be1196da1ea tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:45.079626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5791141-231c-4cbe-8581-8be1196da1ea tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:45.080170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5791141-231c-4cbe-8581-8be1196da1ea tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:45.080563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5791141-231c-4cbe-8581-8be1196da1ea tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:45.089154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5791141-231c-4cbe-8581-8be1196da1ea tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:45.096367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5791141-231c-4cbe-8581-8be1196da1ea tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:45.147476 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3241/6428] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:45 2022] POST /identity/v3/roles => generated 244 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:45.150495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff19deb-1555-4b75-b50e-6db216929fba tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:45.183729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff19deb-1555-4b75-b50e-6db216929fba tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:45.214199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b732-0a52-49e0-a375-888d6a038d18 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:45.217237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b732-0a52-49e0-a375-888d6a038d18 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:45.219092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b732-0a52-49e0-a375-888d6a038d18 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:45.221188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711b732-0a52-49e0-a375-888d6a038d18 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:45.225801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711b732-0a52-49e0-a375-888d6a038d18 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:45.231948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711b732-0a52-49e0-a375-888d6a038d18 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:45.289969 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3188/6429] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:45 2022] POST /identity/v3/roles => generated 246 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:45.305460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5791141-231c-4cbe-8581-8be1196da1ea tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:45.326913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5791141-231c-4cbe-8581-8be1196da1ea tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:45.340949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58394f18-c535-4116-9522-c84512004844 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:45.342850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58394f18-c535-4116-9522-c84512004844 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:45.343657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58394f18-c535-4116-9522-c84512004844 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:45.346200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58394f18-c535-4116-9522-c84512004844 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/32e7c234e58f48d2ac440cdbfbb95ba5/users/57ca185c46aa481b8524afe326716eb8/roles/63b097183a8a487dbedd998ad7f24416` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:45.425091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58394f18-c535-4116-9522-c84512004844 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32e7c234e58f48d2ac440cdbfbb95ba5, user_id=57ca185c46aa481b8524afe326716eb8, role_id=63b097183a8a487dbedd998ad7f24416)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:45.428968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58394f18-c535-4116-9522-c84512004844 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:45.475399 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3242/6430] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:45 2022] PUT /identity/v3/projects/32e7c234e58f48d2ac440cdbfbb95ba5/users/57ca185c46aa481b8524afe326716eb8/roles/63b097183a8a487dbedd998ad7f24416 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:45.479393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b732-0a52-49e0-a375-888d6a038d18 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:45.495200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711b732-0a52-49e0-a375-888d6a038d18 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:45.614020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05cf3bb-0dce-413c-9373-72a96f038675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:45.614020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cf3bb-0dce-413c-9373-72a96f038675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:45.614660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cf3bb-0dce-413c-9373-72a96f038675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:45.615033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05cf3bb-0dce-413c-9373-72a96f038675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/32e7c234e58f48d2ac440cdbfbb95ba5/users/57ca185c46aa481b8524afe326716eb8/roles/9373b403ad6b4051a86e9a4056a42aeb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:45.619734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cf3bb-0dce-413c-9373-72a96f038675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=32e7c234e58f48d2ac440cdbfbb95ba5, user_id=57ca185c46aa481b8524afe326716eb8, role_id=9373b403ad6b4051a86e9a4056a42aeb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:45.623755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05cf3bb-0dce-413c-9373-72a96f038675 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:45.672712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3189/6431] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:45 2022] PUT /identity/v3/projects/32e7c234e58f48d2ac440cdbfbb95ba5/users/57ca185c46aa481b8524afe326716eb8/roles/9373b403ad6b4051a86e9a4056a42aeb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:45.676731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58394f18-c535-4116-9522-c84512004844 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:45.703734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58394f18-c535-4116-9522-c84512004844 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:45.964544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc28b9-f5e1-44fe-8655-5476a5fb755a tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:45.965587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc28b9-f5e1-44fe-8655-5476a5fb755a tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:45.981167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc28b9-f5e1-44fe-8655-5476a5fb755a tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:45.981635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc28b9-f5e1-44fe-8655-5476a5fb755a tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:45.982620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc28b9-f5e1-44fe-8655-5476a5fb755a tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:45.992271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc28b9-f5e1-44fe-8655-5476a5fb755a tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:46.087404 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3243/6432] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:45 2022] GET /identity/v3/users => generated 8348 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:10:46.092470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb0e29-2106-481a-963c-d75981396a50 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:46.093074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb0e29-2106-481a-963c-d75981396a50 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:46.093522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb0e29-2106-481a-963c-d75981396a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:46.140516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-52eb0e29-2106-481a-963c-d75981396a50 None None] MFA Rules not processed for user `57ca185c46aa481b8524afe326716eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:46.141932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-52eb0e29-2106-481a-963c-d75981396a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:46.231112 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3190/6433] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:46.241784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4df0b-f533-41fe-9371-fae2460be539 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:46.242059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4df0b-f533-41fe-9371-fae2460be539 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:46.242482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4df0b-f533-41fe-9371-fae2460be539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:46.280528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-efd4df0b-f533-41fe-9371-fae2460be539 None None] MFA Rules not processed for user `57ca185c46aa481b8524afe326716eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:46.290203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-efd4df0b-f533-41fe-9371-fae2460be539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:46.308362 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3244/6434] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:46.313809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb0e29-2106-481a-963c-d75981396a50 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:46.327125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb0e29-2106-481a-963c-d75981396a50 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:46.336800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ce567-e1f2-4813-b44b-7fca125a61b9 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ca185c46aa481b8524afe326716eb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32e7c234e58f48d2ac440cdbfbb95ba5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-549666417', 'tempest-DelegatedRole-1085847589'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:46.337738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ce567-e1f2-4813-b44b-7fca125a61b9 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:46.338504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ce567-e1f2-4813-b44b-7fca125a61b9 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:46.338800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ce567-e1f2-4813-b44b-7fca125a61b9 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:46.339652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ce567-e1f2-4813-b44b-7fca125a61b9 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: Authorizing `identity:create_trust()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:46.345062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ce567-e1f2-4813-b44b-7fca125a61b9 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:46.563678 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3191/6435] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Mar 26 21:10:46 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:46.565088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4df0b-f533-41fe-9371-fae2460be539 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:46.595264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4df0b-f533-41fe-9371-fae2460be539 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:46.616749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4a3f-e2e8-4fe4-86fc-4d01bf5f7b75 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ca185c46aa481b8524afe326716eb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32e7c234e58f48d2ac440cdbfbb95ba5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-549666417', 'tempest-DelegatedRole-1085847589'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:46.618696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4a3f-e2e8-4fe4-86fc-4d01bf5f7b75 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:46.620285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4a3f-e2e8-4fe4-86fc-4d01bf5f7b75 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:46.621050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd4a3f-e2e8-4fe4-86fc-4d01bf5f7b75 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:46.624442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4a3f-e2e8-4fe4-86fc-4d01bf5f7b75 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:46.628448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd4a3f-e2e8-4fe4-86fc-4d01bf5f7b75 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:46.647323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3245/6436] 10.222.0.16 () {58 vars in 1251 bytes} [Sat Mar 26 21:10:46 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=57ca185c46aa481b8524afe326716eb8 => generated 611 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:46.651193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ce567-e1f2-4813-b44b-7fca125a61b9 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:46.663599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ce567-e1f2-4813-b44b-7fca125a61b9 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:46.682853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ca185c46aa481b8524afe326716eb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32e7c234e58f48d2ac440cdbfbb95ba5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-549666417', 'tempest-DelegatedRole-1085847589'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:46.684299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:46.684586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:46.685405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] PATH_INFO: `/v3/OS-TRUST/trusts/16cf21eaa4694fabb11fd116e9218d1f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:46.715006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: Authorizing `identity:delete_trust(trust_id=16cf21eaa4694fabb11fd116e9218d1f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:46.716610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:46.783611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '16cf21eaa4694fabb11fd116e9218d1f', 'request_id': 'req-d00888f0-c7b3-429d-8d75-8d397c4d43a3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:46.784897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '16cf21eaa4694fabb11fd116e9218d1f', 'request_id': 'req-d00888f0-c7b3-429d-8d75-8d397c4d43a3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:46.802814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '16cf21eaa4694fabb11fd116e9218d1f', 'request_id': 'req-d00888f0-c7b3-429d-8d75-8d397c4d43a3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:46.818709 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3192/6437] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:10:46 2022] DELETE /identity/v3/OS-TRUST/trusts/16cf21eaa4694fabb11fd116e9218d1f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:46.822675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4a3f-e2e8-4fe4-86fc-4d01bf5f7b75 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:46.824659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-87dd4a3f-e2e8-4fe4-86fc-4d01bf5f7b75 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:46.852908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd4a3f-e2e8-4fe4-86fc-4d01bf5f7b75 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:46.877722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b08595-b2fd-420d-9b38-7aa053bc0e51 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57ca185c46aa481b8524afe326716eb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '32e7c234e58f48d2ac440cdbfbb95ba5', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-549666417', 'tempest-DelegatedRole-1085847589'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:46.878575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b08595-b2fd-420d-9b38-7aa053bc0e51 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:46.878864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b08595-b2fd-420d-9b38-7aa053bc0e51 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:46.879145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b08595-b2fd-420d-9b38-7aa053bc0e51 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] PATH_INFO: `/v3/OS-TRUST/trusts/16cf21eaa4694fabb11fd116e9218d1f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:46.938780 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-46b08595-b2fd-420d-9b38-7aa053bc0e51 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Could not find trust: 16cf21eaa4694fabb11fd116e9218d1f.: keystone.exception.TrustNotFound: Could not find trust: 16cf21eaa4694fabb11fd116e9218d1f. Mar 26 21:10:46.957259 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3246/6438] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:10:46 2022] GET /identity/v3/OS-TRUST/trusts/16cf21eaa4694fabb11fd116e9218d1f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:10:46.958381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:46.960227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:46.993113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00888f0-c7b3-429d-8d75-8d397c4d43a3 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:47.012672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:47.017036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:47.017595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:47.018062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/9373b403ad6b4051a86e9a4056a42aeb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:47.021487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9373b403ad6b4051a86e9a4056a42aeb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:47.031494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:47.117484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role 9373b403ad6b4051a86e9a4056a42aeb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:47.119458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:47.124826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:47.136087 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3193/6439] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:46 2022] DELETE /identity/v3/roles/9373b403ad6b4051a86e9a4056a42aeb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:47.137630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b08595-b2fd-420d-9b38-7aa053bc0e51 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:47.140170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-46b08595-b2fd-420d-9b38-7aa053bc0e51 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:47.178978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b08595-b2fd-420d-9b38-7aa053bc0e51 tempest-TrustsV3TestJSON-753951331 tempest-user-496148598] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:47.304102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:47.305532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:47.306786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:47.306786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/63b097183a8a487dbedd998ad7f24416` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:47.307843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=63b097183a8a487dbedd998ad7f24416)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:47.310692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:47.397645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role 63b097183a8a487dbedd998ad7f24416 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:47.398097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:47.398866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:47.405231 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3247/6440] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:47 2022] DELETE /identity/v3/roles/63b097183a8a487dbedd998ad7f24416 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:47.406755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:47.417948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99209518-c55f-4a59-954c-81d673a48273 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:47.635766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:47.638523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:47.638869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:47.639199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users/57ca185c46aa481b8524afe326716eb8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:47.640548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_user(user_id=57ca185c46aa481b8524afe326716eb8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:47.642526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:47.786692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57ca185c46aa481b8524afe326716eb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:47.802061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57ca185c46aa481b8524afe326716eb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:47.803235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57ca185c46aa481b8524afe326716eb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:47.804069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57ca185c46aa481b8524afe326716eb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:47.828606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57ca185c46aa481b8524afe326716eb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:47.858754 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3194/6441] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:47 2022] DELETE /identity/v3/users/57ca185c46aa481b8524afe326716eb8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:47.863183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:47.865169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:47.929353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ca927-73ff-4c09-9f31-aac6e2345c16 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:48.122541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:48.130217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:48.130646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:48.131054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/32e7c234e58f48d2ac440cdbfbb95ba5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:48.133667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_project(project_id=32e7c234e58f48d2ac440cdbfbb95ba5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:48.135711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:48.271251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e7c234e58f48d2ac440cdbfbb95ba5', 'request_id': 'req-69a24ba1-b76f-4ee4-a996-726fb406bfff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:48.290484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e7c234e58f48d2ac440cdbfbb95ba5', 'request_id': 'req-69a24ba1-b76f-4ee4-a996-726fb406bfff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:48.304889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e7c234e58f48d2ac440cdbfbb95ba5', 'request_id': 'req-69a24ba1-b76f-4ee4-a996-726fb406bfff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:48.364137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] The token cache is being invalidate because project 32e7c234e58f48d2ac440cdbfbb95ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:48.364519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:48.366292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:48.371101 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3248/6442] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:47 2022] DELETE /identity/v3/projects/32e7c234e58f48d2ac440cdbfbb95ba5 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:48.381869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:48.383643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:48.425970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36611d8-0989-43af-b6e8-2e99d403f4e8 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:48.598888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a2a4-1918-43a6-8119-8a2d1d977256 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:48.600662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a2a4-1918-43a6-8119-8a2d1d977256 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:48.601987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a2a4-1918-43a6-8119-8a2d1d977256 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:48.602530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00a2a4-1918-43a6-8119-8a2d1d977256 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:48.606459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a2a4-1918-43a6-8119-8a2d1d977256 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:48.613141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00a2a4-1918-43a6-8119-8a2d1d977256 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:48.691898 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3195/6443] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:10:48 2022] POST /identity/v3/projects => generated 329 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:48.696273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:48.697749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:48.734803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a24ba1-b76f-4ee4-a996-726fb406bfff tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:48.858469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0cb80-27d6-403b-ad8f-57c08a21cd08 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:48.859575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0cb80-27d6-403b-ad8f-57c08a21cd08 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:48.859575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0cb80-27d6-403b-ad8f-57c08a21cd08 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:48.859789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0cb80-27d6-403b-ad8f-57c08a21cd08 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:48.861464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0cb80-27d6-403b-ad8f-57c08a21cd08 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:48.862497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0cb80-27d6-403b-ad8f-57c08a21cd08 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:48.926591 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3249/6444] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:48 2022] POST /identity/v3/users => generated 416 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:48.928098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a2a4-1918-43a6-8119-8a2d1d977256 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:48.946009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00a2a4-1918-43a6-8119-8a2d1d977256 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:48.968787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addc5dd-8dd9-41af-994c-27d39c79f579 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:48.973064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addc5dd-8dd9-41af-994c-27d39c79f579 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:48.975051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addc5dd-8dd9-41af-994c-27d39c79f579 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:48.975795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addc5dd-8dd9-41af-994c-27d39c79f579 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:48.980357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addc5dd-8dd9-41af-994c-27d39c79f579 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:48.990097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addc5dd-8dd9-41af-994c-27d39c79f579 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:49.052315 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3196/6445] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:48 2022] POST /identity/v3/roles => generated 244 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:49.052989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0cb80-27d6-403b-ad8f-57c08a21cd08 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:49.064894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0cb80-27d6-403b-ad8f-57c08a21cd08 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:49.110247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac16849-924b-497f-a414-d52b552cddbf tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:49.111298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac16849-924b-497f-a414-d52b552cddbf tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:49.111750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac16849-924b-497f-a414-d52b552cddbf tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:49.112240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac16849-924b-497f-a414-d52b552cddbf tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:49.113468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac16849-924b-497f-a414-d52b552cddbf tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:49.116529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac16849-924b-497f-a414-d52b552cddbf tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:49.181796 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3250/6446] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:49 2022] POST /identity/v3/roles => generated 247 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:49.194278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addc5dd-8dd9-41af-994c-27d39c79f579 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:49.241122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addc5dd-8dd9-41af-994c-27d39c79f579 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:49.255848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c12c50-2c52-41c3-a5f5-ba1c8f8c6559 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:49.257204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c12c50-2c52-41c3-a5f5-ba1c8f8c6559 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:49.257548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c12c50-2c52-41c3-a5f5-ba1c8f8c6559 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:49.257835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c12c50-2c52-41c3-a5f5-ba1c8f8c6559 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/c6cff2ada4a64866aaf55d097a5340b0/users/33fda7b39ca047049dd9dd1a0a6bef5d/roles/a40b85cd09974ec8a6166697587f7399` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:49.283542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c12c50-2c52-41c3-a5f5-ba1c8f8c6559 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c6cff2ada4a64866aaf55d097a5340b0, user_id=33fda7b39ca047049dd9dd1a0a6bef5d, role_id=a40b85cd09974ec8a6166697587f7399)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:49.286722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c12c50-2c52-41c3-a5f5-ba1c8f8c6559 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:49.373425 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3197/6447] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:49 2022] PUT /identity/v3/projects/c6cff2ada4a64866aaf55d097a5340b0/users/33fda7b39ca047049dd9dd1a0a6bef5d/roles/a40b85cd09974ec8a6166697587f7399 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:49.377232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac16849-924b-497f-a414-d52b552cddbf tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:49.389212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac16849-924b-497f-a414-d52b552cddbf tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:49.520206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4aecf-3b28-44d4-9aa3-5b67ab979810 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:49.521450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4aecf-3b28-44d4-9aa3-5b67ab979810 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:49.521979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4aecf-3b28-44d4-9aa3-5b67ab979810 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:49.522483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4aecf-3b28-44d4-9aa3-5b67ab979810 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/c6cff2ada4a64866aaf55d097a5340b0/users/33fda7b39ca047049dd9dd1a0a6bef5d/roles/e22da427dec84d03acd838badab79807` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:49.525402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4aecf-3b28-44d4-9aa3-5b67ab979810 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c6cff2ada4a64866aaf55d097a5340b0, user_id=33fda7b39ca047049dd9dd1a0a6bef5d, role_id=e22da427dec84d03acd838badab79807)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:49.530387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4aecf-3b28-44d4-9aa3-5b67ab979810 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:49.556896 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3251/6448] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:49 2022] PUT /identity/v3/projects/c6cff2ada4a64866aaf55d097a5340b0/users/33fda7b39ca047049dd9dd1a0a6bef5d/roles/e22da427dec84d03acd838badab79807 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:49.560700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c12c50-2c52-41c3-a5f5-ba1c8f8c6559 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:49.590287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c12c50-2c52-41c3-a5f5-ba1c8f8c6559 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:49.877889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e93c4-7c95-457c-aac8-2e46f6b282e4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:49.879210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e93c4-7c95-457c-aac8-2e46f6b282e4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:49.879674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e93c4-7c95-457c-aac8-2e46f6b282e4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:49.880168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e93c4-7c95-457c-aac8-2e46f6b282e4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:49.881117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e93c4-7c95-457c-aac8-2e46f6b282e4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:49.883191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e93c4-7c95-457c-aac8-2e46f6b282e4 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:49.965588 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3198/6449] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:49 2022] GET /identity/v3/users => generated 8351 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:49.970998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065654c-f3eb-4f18-9dfd-6ae294b0d060 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:49.971585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065654c-f3eb-4f18-9dfd-6ae294b0d060 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:49.971585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065654c-f3eb-4f18-9dfd-6ae294b0d060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:50.103400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e065654c-f3eb-4f18-9dfd-6ae294b0d060 None None] MFA Rules not processed for user `33fda7b39ca047049dd9dd1a0a6bef5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:50.110125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e065654c-f3eb-4f18-9dfd-6ae294b0d060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:50.330678 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3252/6450] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:49 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:50.332824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e33ab-813a-4a5c-849b-6584f0bf8131 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:50.333121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e33ab-813a-4a5c-849b-6584f0bf8131 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:50.333407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e33ab-813a-4a5c-849b-6584f0bf8131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:50.374135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-972e33ab-813a-4a5c-849b-6584f0bf8131 None None] MFA Rules not processed for user `33fda7b39ca047049dd9dd1a0a6bef5d`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:50.375409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-972e33ab-813a-4a5c-849b-6584f0bf8131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:50.410240 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3199/6451] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:50 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:50.411573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065654c-f3eb-4f18-9dfd-6ae294b0d060 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:50.427903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065654c-f3eb-4f18-9dfd-6ae294b0d060 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:50.447135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b089a2-ece9-4cce-ba0a-8453e6019e0b tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fda7b39ca047049dd9dd1a0a6bef5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6cff2ada4a64866aaf55d097a5340b0', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1479458349', 'tempest-NotDelegatedRole-2124733529'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:50.448929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b089a2-ece9-4cce-ba0a-8453e6019e0b tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:50.449255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b089a2-ece9-4cce-ba0a-8453e6019e0b tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:50.449526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b089a2-ece9-4cce-ba0a-8453e6019e0b tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:50.450367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b089a2-ece9-4cce-ba0a-8453e6019e0b tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorizing `identity:create_trust()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:50.451907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b089a2-ece9-4cce-ba0a-8453e6019e0b tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:50.670323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3253/6452] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Mar 26 21:10:50 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:50.671458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e33ab-813a-4a5c-849b-6584f0bf8131 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:50.682531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972e33ab-813a-4a5c-849b-6584f0bf8131 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:50.701714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4fb8-2552-4528-8950-ff6826362e13 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fda7b39ca047049dd9dd1a0a6bef5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6cff2ada4a64866aaf55d097a5340b0', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1479458349', 'tempest-NotDelegatedRole-2124733529'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:50.702343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4fb8-2552-4528-8950-ff6826362e13 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:50.702631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4fb8-2552-4528-8950-ff6826362e13 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:50.708670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e4fb8-2552-4528-8950-ff6826362e13 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] PATH_INFO: `/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:50.733813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e4fb8-2552-4528-8950-ff6826362e13 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorizing `identity:get_trust(trust_id=7a4621e270554560932a66bea23a5572)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:50.735771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e4fb8-2552-4528-8950-ff6826362e13 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:50.785086 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3200/6453] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:10:50 2022] GET /identity/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572 => generated 859 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:50.785910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b089a2-ece9-4cce-ba0a-8453e6019e0b tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:50.799550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b089a2-ece9-4cce-ba0a-8453e6019e0b tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:50.814264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c12396-e1c3-4e1a-965c-d207f951569c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fda7b39ca047049dd9dd1a0a6bef5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6cff2ada4a64866aaf55d097a5340b0', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1479458349', 'tempest-NotDelegatedRole-2124733529'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:50.815121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c12396-e1c3-4e1a-965c-d207f951569c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:50.815411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c12396-e1c3-4e1a-965c-d207f951569c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:50.815692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c12396-e1c3-4e1a-965c-d207f951569c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] PATH_INFO: `/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:50.837295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c12396-e1c3-4e1a-965c-d207f951569c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=7a4621e270554560932a66bea23a5572)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:50.838793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c12396-e1c3-4e1a-965c-d207f951569c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:50.857023 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3254/6454] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 21:10:50 2022] GET /identity/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles => generated 371 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:50.859763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4fb8-2552-4528-8950-ff6826362e13 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:50.871261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e4fb8-2552-4528-8950-ff6826362e13 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:50.886998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b73eba-46fd-46d5-8d15-18c1fac6ab15 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fda7b39ca047049dd9dd1a0a6bef5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6cff2ada4a64866aaf55d097a5340b0', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1479458349', 'tempest-NotDelegatedRole-2124733529'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:50.887889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b73eba-46fd-46d5-8d15-18c1fac6ab15 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:50.888202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b73eba-46fd-46d5-8d15-18c1fac6ab15 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:50.888481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b73eba-46fd-46d5-8d15-18c1fac6ab15 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] PATH_INFO: `/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles/a40b85cd09974ec8a6166697587f7399` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:50.901398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b73eba-46fd-46d5-8d15-18c1fac6ab15 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7a4621e270554560932a66bea23a5572, role_id=a40b85cd09974ec8a6166697587f7399)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:50.902901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b73eba-46fd-46d5-8d15-18c1fac6ab15 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:50.924857 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3201/6455] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Mar 26 21:10:50 2022] GET /identity/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles/a40b85cd09974ec8a6166697587f7399 => generated 244 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:50.926074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c12396-e1c3-4e1a-965c-d207f951569c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:50.942379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c12396-e1c3-4e1a-965c-d207f951569c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:50.956672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea7f6-85fd-45c2-b2a2-f7b07517efa0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fda7b39ca047049dd9dd1a0a6bef5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6cff2ada4a64866aaf55d097a5340b0', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1479458349', 'tempest-NotDelegatedRole-2124733529'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:50.957521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea7f6-85fd-45c2-b2a2-f7b07517efa0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:50.957809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea7f6-85fd-45c2-b2a2-f7b07517efa0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:50.958088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ea7f6-85fd-45c2-b2a2-f7b07517efa0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] PATH_INFO: `/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles/a40b85cd09974ec8a6166697587f7399` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:50.968821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ea7f6-85fd-45c2-b2a2-f7b07517efa0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7a4621e270554560932a66bea23a5572, role_id=a40b85cd09974ec8a6166697587f7399)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:50.976358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ea7f6-85fd-45c2-b2a2-f7b07517efa0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:51.000372 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3255/6456] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Mar 26 21:10:50 2022] HEAD /identity/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles/a40b85cd09974ec8a6166697587f7399 => generated 0 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Mar 26 21:10:51.002143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b73eba-46fd-46d5-8d15-18c1fac6ab15 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:51.016167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b73eba-46fd-46d5-8d15-18c1fac6ab15 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:51.032261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c4858-baf6-4f0a-9518-966dd23a8494 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fda7b39ca047049dd9dd1a0a6bef5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6cff2ada4a64866aaf55d097a5340b0', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1479458349', 'tempest-NotDelegatedRole-2124733529'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:51.033130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c4858-baf6-4f0a-9518-966dd23a8494 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:51.033393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c4858-baf6-4f0a-9518-966dd23a8494 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:51.033604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c4858-baf6-4f0a-9518-966dd23a8494 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] PATH_INFO: `/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles/e22da427dec84d03acd838badab79807` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:51.042536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c4858-baf6-4f0a-9518-966dd23a8494 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7a4621e270554560932a66bea23a5572, role_id=e22da427dec84d03acd838badab79807)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:51.047463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c4858-baf6-4f0a-9518-966dd23a8494 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:51.075514 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-c03c4858-baf6-4f0a-9518-966dd23a8494 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Could not find role: e22da427dec84d03acd838badab79807.: keystone.exception.RoleNotFound: Could not find role: e22da427dec84d03acd838badab79807. Mar 26 21:10:51.078844 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3202/6457] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Mar 26 21:10:51 2022] GET /identity/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles/e22da427dec84d03acd838badab79807 => generated 110 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:10:51.083338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea7f6-85fd-45c2-b2a2-f7b07517efa0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:51.100053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ea7f6-85fd-45c2-b2a2-f7b07517efa0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:51.114281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fda7b39ca047049dd9dd1a0a6bef5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6cff2ada4a64866aaf55d097a5340b0', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1479458349', 'tempest-NotDelegatedRole-2124733529'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:51.114281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:51.114281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:51.115393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] PATH_INFO: `/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles/e22da427dec84d03acd838badab79807` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:51.129898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7a4621e270554560932a66bea23a5572, role_id=e22da427dec84d03acd838badab79807)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:51.131357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:51.182088 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Could not find role: e22da427dec84d03acd838badab79807.: keystone.exception.RoleNotFound: Could not find role: e22da427dec84d03acd838badab79807. Mar 26 21:10:51.189667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c4858-baf6-4f0a-9518-966dd23a8494 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:51.202300 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3256/6458] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Mar 26 21:10:51 2022] HEAD /identity/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572/roles/e22da427dec84d03acd838badab79807 => generated 0 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Mar 26 21:10:51.212304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c4858-baf6-4f0a-9518-966dd23a8494 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:51.240779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fda7b39ca047049dd9dd1a0a6bef5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6cff2ada4a64866aaf55d097a5340b0', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1479458349', 'tempest-NotDelegatedRole-2124733529'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:51.249061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:51.254867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:51.256715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] PATH_INFO: `/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:51.331026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorizing `identity:delete_trust(trust_id=7a4621e270554560932a66bea23a5572)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:51.334343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:51.444798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7a4621e270554560932a66bea23a5572', 'request_id': 'req-2e56a82a-c31f-4eb2-b9e2-438f1059532f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:51.446865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7a4621e270554560932a66bea23a5572', 'request_id': 'req-2e56a82a-c31f-4eb2-b9e2-438f1059532f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:51.474033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7a4621e270554560932a66bea23a5572', 'request_id': 'req-2e56a82a-c31f-4eb2-b9e2-438f1059532f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:51.501613 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3203/6459] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:10:51 2022] DELETE /identity/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:51.507379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:51.509351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:51.552843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b575e-124b-4289-9d66-2714711664e0 tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:51.562001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f23d5-5237-44bc-ae13-536f5200f42c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fda7b39ca047049dd9dd1a0a6bef5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c6cff2ada4a64866aaf55d097a5340b0', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1479458349', 'tempest-NotDelegatedRole-2124733529'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:51.562923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f23d5-5237-44bc-ae13-536f5200f42c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:51.563206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f23d5-5237-44bc-ae13-536f5200f42c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:51.563483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f23d5-5237-44bc-ae13-536f5200f42c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] PATH_INFO: `/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:51.627480 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-5a6f23d5-5237-44bc-ae13-536f5200f42c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Could not find trust: 7a4621e270554560932a66bea23a5572.: keystone.exception.TrustNotFound: Could not find trust: 7a4621e270554560932a66bea23a5572. Mar 26 21:10:51.634701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:51.637208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:51.641660 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3257/6460] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:10:51 2022] GET /identity/v3/OS-TRUST/trusts/7a4621e270554560932a66bea23a5572 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:10:51.675081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56a82a-c31f-4eb2-b9e2-438f1059532f tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:51.694557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:51.695823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:51.696309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:51.696754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/e22da427dec84d03acd838badab79807` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:51.700929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e22da427dec84d03acd838badab79807)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:51.702784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:51.808725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role e22da427dec84d03acd838badab79807 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:51.810257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:51.813816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:51.818284 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3204/6461] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:51 2022] DELETE /identity/v3/roles/e22da427dec84d03acd838badab79807 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:51.822583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f23d5-5237-44bc-ae13-536f5200f42c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:51.824498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5a6f23d5-5237-44bc-ae13-536f5200f42c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:51.854590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6f23d5-5237-44bc-ae13-536f5200f42c tempest-TrustsV3TestJSON-1451543778 tempest-user-2005833585] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:51.976705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:51.977601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:51.977942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:51.978215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/a40b85cd09974ec8a6166697587f7399` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:51.984260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a40b85cd09974ec8a6166697587f7399)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:51.991548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:52.071050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role a40b85cd09974ec8a6166697587f7399 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:52.071424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.073192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.079692 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3258/6462] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:51 2022] DELETE /identity/v3/roles/a40b85cd09974ec8a6166697587f7399 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:52.082570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:52.095877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561027f-fc56-4296-8b18-f8dd7d486a2b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:52.238066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:52.239010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:52.239363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:52.239726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users/33fda7b39ca047049dd9dd1a0a6bef5d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:52.242650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_user(user_id=33fda7b39ca047049dd9dd1a0a6bef5d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:52.245746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:52.352545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fda7b39ca047049dd9dd1a0a6bef5d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.377590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fda7b39ca047049dd9dd1a0a6bef5d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.379443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fda7b39ca047049dd9dd1a0a6bef5d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.381070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fda7b39ca047049dd9dd1a0a6bef5d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.413351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fda7b39ca047049dd9dd1a0a6bef5d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.447238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:52.448070 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3205/6463] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:52 2022] DELETE /identity/v3/users/33fda7b39ca047049dd9dd1a0a6bef5d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:52.449028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:52.466975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c9fd0c-4950-485f-a645-81642e3c07df tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:52.681726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:52.688289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:52.688289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:52.688289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/c6cff2ada4a64866aaf55d097a5340b0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:52.691511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c6cff2ada4a64866aaf55d097a5340b0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:52.712382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:52.843628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6cff2ada4a64866aaf55d097a5340b0', 'request_id': 'req-5c2b5c36-208f-435b-9376-da888813d729'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.859864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6cff2ada4a64866aaf55d097a5340b0', 'request_id': 'req-5c2b5c36-208f-435b-9376-da888813d729'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.876823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6cff2ada4a64866aaf55d097a5340b0', 'request_id': 'req-5c2b5c36-208f-435b-9376-da888813d729'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.901014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] The token cache is being invalidate because project c6cff2ada4a64866aaf55d097a5340b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:52.901501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.902410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:52.911674 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3259/6464] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:52 2022] DELETE /identity/v3/projects/c6cff2ada4a64866aaf55d097a5340b0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:52.913402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:52.915609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:52.945159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876194e-1ce6-44f9-887b-6bfb7b20c2b6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:53.101712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bc858-8c15-4a6f-80a3-b2bf013ea70f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:53.102403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bc858-8c15-4a6f-80a3-b2bf013ea70f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:53.102690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bc858-8c15-4a6f-80a3-b2bf013ea70f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:53.102976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bc858-8c15-4a6f-80a3-b2bf013ea70f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:53.103726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bc858-8c15-4a6f-80a3-b2bf013ea70f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:53.110390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bc858-8c15-4a6f-80a3-b2bf013ea70f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:53.158371 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3206/6465] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:10:52 2022] POST /identity/v3/projects => generated 328 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:53.159356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:53.161348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:53.188739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b5c36-208f-435b-9376-da888813d729 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:53.363783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5e521-ce28-41fa-8536-be756f13f21e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:53.365717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5e521-ce28-41fa-8536-be756f13f21e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:53.366011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5e521-ce28-41fa-8536-be756f13f21e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:53.366303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c5e521-ce28-41fa-8536-be756f13f21e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:53.371086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5e521-ce28-41fa-8536-be756f13f21e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:53.374705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c5e521-ce28-41fa-8536-be756f13f21e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:53.470799 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3260/6466] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:53 2022] POST /identity/v3/users => generated 416 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:53.475152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bc858-8c15-4a6f-80a3-b2bf013ea70f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:53.490671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bc858-8c15-4a6f-80a3-b2bf013ea70f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:53.507078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59b100-1397-404e-befa-f5563afac277 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:53.507783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b100-1397-404e-befa-f5563afac277 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:53.508104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b100-1397-404e-befa-f5563afac277 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:53.508389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59b100-1397-404e-befa-f5563afac277 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:53.509311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59b100-1397-404e-befa-f5563afac277 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:53.510978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee59b100-1397-404e-befa-f5563afac277 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:53.537352 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3207/6467] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:53 2022] POST /identity/v3/roles => generated 243 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:10:53.541534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5e521-ce28-41fa-8536-be756f13f21e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:53.555077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c5e521-ce28-41fa-8536-be756f13f21e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:53.570785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc273ad-2595-4c4e-bc35-5aa5da11015e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:53.571609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc273ad-2595-4c4e-bc35-5aa5da11015e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:53.571902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc273ad-2595-4c4e-bc35-5aa5da11015e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:53.572209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc273ad-2595-4c4e-bc35-5aa5da11015e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:53.572964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc273ad-2595-4c4e-bc35-5aa5da11015e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:53.574679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc273ad-2595-4c4e-bc35-5aa5da11015e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:53.606730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59b100-1397-404e-befa-f5563afac277 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:53.612360 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3261/6468] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:53 2022] POST /identity/v3/roles => generated 246 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:53.624045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59b100-1397-404e-befa-f5563afac277 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:53.639116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a657a5-c2a3-4236-a156-832f1c255530 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:53.640070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a657a5-c2a3-4236-a156-832f1c255530 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:53.640361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a657a5-c2a3-4236-a156-832f1c255530 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:53.640651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a657a5-c2a3-4236-a156-832f1c255530 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/9b0a516386cb4704b7fb89499bc64318/users/9c0535691c5c4f75af519d4b903abb43/roles/1185e3bb5eb046cda7dd5898a89b5a19` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:53.677073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a657a5-c2a3-4236-a156-832f1c255530 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9b0a516386cb4704b7fb89499bc64318, user_id=9c0535691c5c4f75af519d4b903abb43, role_id=1185e3bb5eb046cda7dd5898a89b5a19)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:53.680013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a657a5-c2a3-4236-a156-832f1c255530 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:53.710559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc273ad-2595-4c4e-bc35-5aa5da11015e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:53.711455 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3208/6469] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:53 2022] PUT /identity/v3/projects/9b0a516386cb4704b7fb89499bc64318/users/9c0535691c5c4f75af519d4b903abb43/roles/1185e3bb5eb046cda7dd5898a89b5a19 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:53.726284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc273ad-2595-4c4e-bc35-5aa5da11015e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:53.820770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d7aac-a014-42b8-8ec1-30bd76ba81ef tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:53.822301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7aac-a014-42b8-8ec1-30bd76ba81ef tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:53.822655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7aac-a014-42b8-8ec1-30bd76ba81ef tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:53.822941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d7aac-a014-42b8-8ec1-30bd76ba81ef tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/9b0a516386cb4704b7fb89499bc64318/users/9c0535691c5c4f75af519d4b903abb43/roles/49815b04546a4bad9308f8c286188434` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:53.826405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7aac-a014-42b8-8ec1-30bd76ba81ef tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9b0a516386cb4704b7fb89499bc64318, user_id=9c0535691c5c4f75af519d4b903abb43, role_id=49815b04546a4bad9308f8c286188434)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:53.831013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d7aac-a014-42b8-8ec1-30bd76ba81ef tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:53.866662 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3262/6470] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:53 2022] PUT /identity/v3/projects/9b0a516386cb4704b7fb89499bc64318/users/9c0535691c5c4f75af519d4b903abb43/roles/49815b04546a4bad9308f8c286188434 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:53.868301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a657a5-c2a3-4236-a156-832f1c255530 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:53.890238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a657a5-c2a3-4236-a156-832f1c255530 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:54.039007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5eef0-7655-4233-ab1c-9e27687c5f47 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:54.042406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5eef0-7655-4233-ab1c-9e27687c5f47 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:54.042707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5eef0-7655-4233-ab1c-9e27687c5f47 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:54.042998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5eef0-7655-4233-ab1c-9e27687c5f47 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:54.044734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5eef0-7655-4233-ab1c-9e27687c5f47 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:54.047134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5eef0-7655-4233-ab1c-9e27687c5f47 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:54.097316 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3209/6471] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:53 2022] GET /identity/v3/users => generated 8351 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:54.102337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a1b3-4d8a-4c5f-8767-58d33696ba87 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:54.102629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a1b3-4d8a-4c5f-8767-58d33696ba87 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:54.104501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a1b3-4d8a-4c5f-8767-58d33696ba87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:54.276748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bc44a1b3-4d8a-4c5f-8767-58d33696ba87 None None] MFA Rules not processed for user `9c0535691c5c4f75af519d4b903abb43`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:54.279187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bc44a1b3-4d8a-4c5f-8767-58d33696ba87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:54.349595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48c6d-bf64-4ae3-a4aa-6ec617ad25e0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:54.349789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48c6d-bf64-4ae3-a4aa-6ec617ad25e0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:54.350226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c48c6d-bf64-4ae3-a4aa-6ec617ad25e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:54.387023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e6c48c6d-bf64-4ae3-a4aa-6ec617ad25e0 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:54.391677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e6c48c6d-bf64-4ae3-a4aa-6ec617ad25e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:54.426078 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3263/6472] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:54.439519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbeb23-1638-4fa9-b542-96d7576ed1c1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:54.440489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbeb23-1638-4fa9-b542-96d7576ed1c1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:54.440993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbeb23-1638-4fa9-b542-96d7576ed1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:54.468925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2dcbeb23-1638-4fa9-b542-96d7576ed1c1 None None] MFA Rules not processed for user `9c0535691c5c4f75af519d4b903abb43`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:54.471350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2dcbeb23-1638-4fa9-b542-96d7576ed1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:54.486662 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3264/6473] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:54.495007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbeb23-1638-4fa9-b542-96d7576ed1c1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:54.510009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbeb23-1638-4fa9-b542-96d7576ed1c1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:54.517797 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3210/6474] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:10:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Mar 26 21:10:54.535187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e380c62-e293-44c4-93c6-4ac9f094f628 tempest-TrustsV3TestJSON-966445456 tempest-user-1263194548] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c0535691c5c4f75af519d4b903abb43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b0a516386cb4704b7fb89499bc64318', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-852310276', 'tempest-NotDelegatedRole-806187377'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:54.536546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380c62-e293-44c4-93c6-4ac9f094f628 tempest-TrustsV3TestJSON-966445456 tempest-user-1263194548] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:54.536923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c48c6d-bf64-4ae3-a4aa-6ec617ad25e0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:54.538553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e6c48c6d-bf64-4ae3-a4aa-6ec617ad25e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:54.550810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380c62-e293-44c4-93c6-4ac9f094f628 tempest-TrustsV3TestJSON-966445456 tempest-user-1263194548] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:54.551286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e380c62-e293-44c4-93c6-4ac9f094f628 tempest-TrustsV3TestJSON-966445456 tempest-user-1263194548] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:54.552277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e380c62-e293-44c4-93c6-4ac9f094f628 tempest-TrustsV3TestJSON-966445456 tempest-user-1263194548] RBAC: Authorizing `identity:create_trust()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:54.554942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e380c62-e293-44c4-93c6-4ac9f094f628 tempest-TrustsV3TestJSON-966445456 tempest-user-1263194548] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:54.716597 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-4e380c62-e293-44c4-93c6-4ac9f094f628 tempest-TrustsV3TestJSON-966445456 tempest-user-1263194548] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Mar 26 21:10:54.718512 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3265/6475] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Mar 26 21:10:54 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 228 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Mar 26 21:10:54.723046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e380c62-e293-44c4-93c6-4ac9f094f628 tempest-TrustsV3TestJSON-966445456 tempest-user-1263194548] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:54.726826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c48c6d-bf64-4ae3-a4aa-6ec617ad25e0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:54.738561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e380c62-e293-44c4-93c6-4ac9f094f628 tempest-TrustsV3TestJSON-966445456 tempest-user-1263194548] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:54.747898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8f19a-1fcf-4b0e-bd26-659de508bd99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:54.750854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8f19a-1fcf-4b0e-bd26-659de508bd99 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:54.752951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8f19a-1fcf-4b0e-bd26-659de508bd99 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:54.753446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8f19a-1fcf-4b0e-bd26-659de508bd99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:54.755153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:54.756343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:54.757405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:54.757546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/49815b04546a4bad9308f8c286188434` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:54.761082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=49815b04546a4bad9308f8c286188434)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:54.766278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:54.777077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8f19a-1fcf-4b0e-bd26-659de508bd99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:54.781412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8f19a-1fcf-4b0e-bd26-659de508bd99 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:54.804630 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3211/6476] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:10:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:10:54.831377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role 49815b04546a4bad9308f8c286188434 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:54.832094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:54.832984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:54.836069 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3266/6477] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:54 2022] DELETE /identity/v3/roles/49815b04546a4bad9308f8c286188434 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:54.840083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8f19a-1fcf-4b0e-bd26-659de508bd99 service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:54.853774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8f19a-1fcf-4b0e-bd26-659de508bd99 service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:55.002988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:55.004896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:55.005857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:55.030513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/1185e3bb5eb046cda7dd5898a89b5a19` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:55.032312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1185e3bb5eb046cda7dd5898a89b5a19)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:55.037122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:55.135847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role 1185e3bb5eb046cda7dd5898a89b5a19 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:55.138336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.139264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.146069 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3212/6478] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:54 2022] DELETE /identity/v3/roles/1185e3bb5eb046cda7dd5898a89b5a19 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:55.146761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:55.148308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:55.177947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005d081-290b-4b12-9382-69284b2e38a9 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:55.327964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:55.328894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:55.329183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:55.329515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users/9c0535691c5c4f75af519d4b903abb43` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:55.332396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9c0535691c5c4f75af519d4b903abb43)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:55.334459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:55.501751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c0535691c5c4f75af519d4b903abb43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.522627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c0535691c5c4f75af519d4b903abb43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.524569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c0535691c5c4f75af519d4b903abb43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.525221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c0535691c5c4f75af519d4b903abb43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.539460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c0535691c5c4f75af519d4b903abb43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.587603 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3267/6479] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:55 2022] DELETE /identity/v3/users/9c0535691c5c4f75af519d4b903abb43 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:55.593566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:55.602023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:55.645347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a62f1b-6d6c-422d-ad01-c8bb6db77069 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:55.744527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:55.745703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:55.746144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:55.746594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/9b0a516386cb4704b7fb89499bc64318` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:55.748465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b0a516386cb4704b7fb89499bc64318)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:55.751579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:55.849302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b0a516386cb4704b7fb89499bc64318', 'request_id': 'req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.871416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b0a516386cb4704b7fb89499bc64318', 'request_id': 'req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.881458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b0a516386cb4704b7fb89499bc64318', 'request_id': 'req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.928052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] The token cache is being invalidate because project 9b0a516386cb4704b7fb89499bc64318 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:55.928626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.930162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:55.938585 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3213/6480] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:55 2022] DELETE /identity/v3/projects/9b0a516386cb4704b7fb89499bc64318 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:55.944921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:55.946918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:55.992480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e85794-1b16-458c-8b2d-931dd5e59a0c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:56.134210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a2e4d-07e6-48db-94b3-47037eb487cc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:56.134883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a2e4d-07e6-48db-94b3-47037eb487cc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:56.135167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a2e4d-07e6-48db-94b3-47037eb487cc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:56.135444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a2e4d-07e6-48db-94b3-47037eb487cc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:56.136313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a2e4d-07e6-48db-94b3-47037eb487cc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:56.140171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a2e4d-07e6-48db-94b3-47037eb487cc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:56.202868 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3268/6481] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:10:55 2022] POST /identity/v3/projects => generated 328 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:56.204316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:56.206034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:56.226227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ccd4c-67fe-4f7c-87f6-4438f21f2f25 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:56.300960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350225c-37bb-4bfb-910d-eab2d5cfbda5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:56.301650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350225c-37bb-4bfb-910d-eab2d5cfbda5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:56.301939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350225c-37bb-4bfb-910d-eab2d5cfbda5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:56.302226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350225c-37bb-4bfb-910d-eab2d5cfbda5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:56.303862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350225c-37bb-4bfb-910d-eab2d5cfbda5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:56.305871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350225c-37bb-4bfb-910d-eab2d5cfbda5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:56.341397 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3214/6482] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:56 2022] POST /identity/v3/users => generated 413 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:56.342010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a2e4d-07e6-48db-94b3-47037eb487cc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:56.355953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a2e4d-07e6-48db-94b3-47037eb487cc tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:56.362481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1898d0-acbd-43ea-b95f-5167153856c5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:56.363554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1898d0-acbd-43ea-b95f-5167153856c5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:56.364302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1898d0-acbd-43ea-b95f-5167153856c5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:56.364747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1898d0-acbd-43ea-b95f-5167153856c5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:56.365656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1898d0-acbd-43ea-b95f-5167153856c5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:56.367802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1898d0-acbd-43ea-b95f-5167153856c5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:56.387417 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3269/6483] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:56 2022] POST /identity/v3/roles => generated 244 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:56.395707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350225c-37bb-4bfb-910d-eab2d5cfbda5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:56.408417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350225c-37bb-4bfb-910d-eab2d5cfbda5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:56.414000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fba58-61d0-404c-89a0-23206766dbc6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:56.414680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fba58-61d0-404c-89a0-23206766dbc6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:56.414962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fba58-61d0-404c-89a0-23206766dbc6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:56.415248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fba58-61d0-404c-89a0-23206766dbc6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:56.416125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fba58-61d0-404c-89a0-23206766dbc6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:56.417922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fba58-61d0-404c-89a0-23206766dbc6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:56.439064 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3215/6484] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:10:56 2022] POST /identity/v3/roles => generated 247 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:56.443294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1898d0-acbd-43ea-b95f-5167153856c5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:56.454560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1898d0-acbd-43ea-b95f-5167153856c5 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:56.462444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee385d-6306-4d28-9acf-feb05681ccfb tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:56.463487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee385d-6306-4d28-9acf-feb05681ccfb tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:56.463874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee385d-6306-4d28-9acf-feb05681ccfb tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:56.464285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee385d-6306-4d28-9acf-feb05681ccfb tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/d94b1f0418b14c7c9603117f529ec7d8/users/27cfd70ee3b34633be86008127ff4cc7/roles/bdf6ca90984047e288fffd5d611a8ee2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:56.488889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee385d-6306-4d28-9acf-feb05681ccfb tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d94b1f0418b14c7c9603117f529ec7d8, user_id=27cfd70ee3b34633be86008127ff4cc7, role_id=bdf6ca90984047e288fffd5d611a8ee2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:56.492333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee385d-6306-4d28-9acf-feb05681ccfb tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:56.510673 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3270/6485] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:56 2022] PUT /identity/v3/projects/d94b1f0418b14c7c9603117f529ec7d8/users/27cfd70ee3b34633be86008127ff4cc7/roles/bdf6ca90984047e288fffd5d611a8ee2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:56.514932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fba58-61d0-404c-89a0-23206766dbc6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:56.532563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fba58-61d0-404c-89a0-23206766dbc6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:56.632551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee385d-6306-4d28-9acf-feb05681ccfb tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:56.634860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d0ee385d-6306-4d28-9acf-feb05681ccfb tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:56.659186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8bca9-5365-4e27-8e6b-c390f376314e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:56.660393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8bca9-5365-4e27-8e6b-c390f376314e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:56.664849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8bca9-5365-4e27-8e6b-c390f376314e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:56.665498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8bca9-5365-4e27-8e6b-c390f376314e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/d94b1f0418b14c7c9603117f529ec7d8/users/27cfd70ee3b34633be86008127ff4cc7/roles/a1160b10a15a4fed989a02fc8c194593` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:56.672716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8bca9-5365-4e27-8e6b-c390f376314e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d94b1f0418b14c7c9603117f529ec7d8, user_id=27cfd70ee3b34633be86008127ff4cc7, role_id=a1160b10a15a4fed989a02fc8c194593)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:56.677401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8bca9-5365-4e27-8e6b-c390f376314e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:56.719664 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3216/6486] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:10:56 2022] PUT /identity/v3/projects/d94b1f0418b14c7c9603117f529ec7d8/users/27cfd70ee3b34633be86008127ff4cc7/roles/a1160b10a15a4fed989a02fc8c194593 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:56.724109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8bca9-5365-4e27-8e6b-c390f376314e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:56.795005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee385d-6306-4d28-9acf-feb05681ccfb tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:56.947335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d5c47-eed9-4e01-9dc4-d8bb40fbf508 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae3287541dee46208134c2309a18293d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec20d4256a9946e38d5f5ca4871295da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:56.948122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d5c47-eed9-4e01-9dc4-d8bb40fbf508 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:56.948464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d5c47-eed9-4e01-9dc4-d8bb40fbf508 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:56.948689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d5c47-eed9-4e01-9dc4-d8bb40fbf508 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:56.952809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d5c47-eed9-4e01-9dc4-d8bb40fbf508 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:56.953140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d5c47-eed9-4e01-9dc4-d8bb40fbf508 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:56.957359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d5c47-eed9-4e01-9dc4-d8bb40fbf508 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:56.970373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8bca9-5365-4e27-8e6b-c390f376314e tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:56.985955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2ebd7-8e98-4f3a-8ea1-bd25548db59b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:56.987105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2ebd7-8e98-4f3a-8ea1-bd25548db59b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:56.987742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2ebd7-8e98-4f3a-8ea1-bd25548db59b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:56.988217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2ebd7-8e98-4f3a-8ea1-bd25548db59b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:56.990012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2ebd7-8e98-4f3a-8ea1-bd25548db59b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:56.993345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2ebd7-8e98-4f3a-8ea1-bd25548db59b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:56.997533 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3271/6487] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:10:56.998885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d5c47-eed9-4e01-9dc4-d8bb40fbf508 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:57.052850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d5c47-eed9-4e01-9dc4-d8bb40fbf508 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:57.061494 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3217/6488] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:10:56 2022] GET /identity/v3/users => generated 8348 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:10:57.064452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9dcf-39a9-4874-afd3-2d10061a88b3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.065850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9dcf-39a9-4874-afd3-2d10061a88b3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.066367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c9dcf-39a9-4874-afd3-2d10061a88b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.071976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfd9ee-c173-4408-924e-a72417b231ec tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae3287541dee46208134c2309a18293d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec20d4256a9946e38d5f5ca4871295da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:57.073331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfd9ee-c173-4408-924e-a72417b231ec tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.073630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfd9ee-c173-4408-924e-a72417b231ec tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.073917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfd9ee-c173-4408-924e-a72417b231ec tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.079716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfd9ee-c173-4408-924e-a72417b231ec tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:57.085383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfd9ee-c173-4408-924e-a72417b231ec tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:57.134168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f73c9dcf-39a9-4874-afd3-2d10061a88b3 None None] MFA Rules not processed for user `27cfd70ee3b34633be86008127ff4cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:57.136458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f73c9dcf-39a9-4874-afd3-2d10061a88b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:57.168082 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3272/6489] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:10:56 2022] POST /identity/v3/projects => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:57.173019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfd9ee-c173-4408-924e-a72417b231ec tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:57.235983 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3218/6490] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:57.240930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fde76-742b-4041-ac3a-3b712b916b4e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.241864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fde76-742b-4041-ac3a-3b712b916b4e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.242284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fde76-742b-4041-ac3a-3b712b916b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.293311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfd9ee-c173-4408-924e-a72417b231ec tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:57.304474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2f3fde76-742b-4041-ac3a-3b712b916b4e None None] MFA Rules not processed for user `27cfd70ee3b34633be86008127ff4cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:10:57.306922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115f21a-0044-4f14-b342-41c5dc63e604 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae3287541dee46208134c2309a18293d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec20d4256a9946e38d5f5ca4871295da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:57.308260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115f21a-0044-4f14-b342-41c5dc63e604 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.308732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115f21a-0044-4f14-b342-41c5dc63e604 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.309184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115f21a-0044-4f14-b342-41c5dc63e604 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.310682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115f21a-0044-4f14-b342-41c5dc63e604 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:10:57.311426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115f21a-0044-4f14-b342-41c5dc63e604 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:57.313234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f3fde76-742b-4041-ac3a-3b712b916b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:57.316808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115f21a-0044-4f14-b342-41c5dc63e604 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:57.352095 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3273/6491] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:57.487894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115f21a-0044-4f14-b342-41c5dc63e604 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:57.490027 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3219/6492] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:10:57 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:10:57.504766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115f21a-0044-4f14-b342-41c5dc63e604 tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:57.512261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650609cc-513e-457d-ada5-db48401879a8 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27cfd70ee3b34633be86008127ff4cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94b1f0418b14c7c9603117f529ec7d8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1224213322', 'tempest-NotDelegatedRole-1487055889'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:57.518842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650609cc-513e-457d-ada5-db48401879a8 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.518842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650609cc-513e-457d-ada5-db48401879a8 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.519815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650609cc-513e-457d-ada5-db48401879a8 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.522379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650609cc-513e-457d-ada5-db48401879a8 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorizing `identity:create_trust()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:57.527626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650609cc-513e-457d-ada5-db48401879a8 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:57.679803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fde76-742b-4041-ac3a-3b712b916b4e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:57.687161 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3274/6493] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Mar 26 21:10:57 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:57.693611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fde76-742b-4041-ac3a-3b712b916b4e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:57.700001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91c1d6-e7c0-4a8e-b8e8-d93e8c993a00 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27cfd70ee3b34633be86008127ff4cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94b1f0418b14c7c9603117f529ec7d8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1224213322', 'tempest-NotDelegatedRole-1487055889'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:57.701668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91c1d6-e7c0-4a8e-b8e8-d93e8c993a00 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.702179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91c1d6-e7c0-4a8e-b8e8-d93e8c993a00 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.702831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91c1d6-e7c0-4a8e-b8e8-d93e8c993a00 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] PATH_INFO: `/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.712649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91c1d6-e7c0-4a8e-b8e8-d93e8c993a00 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorizing `identity:get_trust(trust_id=f336f179b5ac4a21ae90a7289af81a89)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:57.715545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91c1d6-e7c0-4a8e-b8e8-d93e8c993a00 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:57.729299 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3220/6494] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:10:57 2022] GET /identity/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89 => generated 834 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:57.729817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650609cc-513e-457d-ada5-db48401879a8 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:57.749928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650609cc-513e-457d-ada5-db48401879a8 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:57.764954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44651f3-0ca4-454a-a7a9-7790841bbe51 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27cfd70ee3b34633be86008127ff4cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94b1f0418b14c7c9603117f529ec7d8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1224213322', 'tempest-NotDelegatedRole-1487055889'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:57.764954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44651f3-0ca4-454a-a7a9-7790841bbe51 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.764954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44651f3-0ca4-454a-a7a9-7790841bbe51 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.765411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44651f3-0ca4-454a-a7a9-7790841bbe51 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] PATH_INFO: `/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.779068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44651f3-0ca4-454a-a7a9-7790841bbe51 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=f336f179b5ac4a21ae90a7289af81a89)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:57.781970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44651f3-0ca4-454a-a7a9-7790841bbe51 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:57.812979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3275/6495] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 21:10:57 2022] GET /identity/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles => generated 371 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:57.816739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91c1d6-e7c0-4a8e-b8e8-d93e8c993a00 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:57.827530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91c1d6-e7c0-4a8e-b8e8-d93e8c993a00 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:57.842494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f889d-ba39-4be6-9732-3557ef67b834 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27cfd70ee3b34633be86008127ff4cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94b1f0418b14c7c9603117f529ec7d8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1224213322', 'tempest-NotDelegatedRole-1487055889'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:57.845052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f889d-ba39-4be6-9732-3557ef67b834 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.845531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f889d-ba39-4be6-9732-3557ef67b834 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.846194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f889d-ba39-4be6-9732-3557ef67b834 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] PATH_INFO: `/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles/bdf6ca90984047e288fffd5d611a8ee2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.858376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f889d-ba39-4be6-9732-3557ef67b834 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f336f179b5ac4a21ae90a7289af81a89, role_id=bdf6ca90984047e288fffd5d611a8ee2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:57.860106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f889d-ba39-4be6-9732-3557ef67b834 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:57.873202 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3221/6496] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Mar 26 21:10:57 2022] GET /identity/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles/bdf6ca90984047e288fffd5d611a8ee2 => generated 244 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:10:57.874330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44651f3-0ca4-454a-a7a9-7790841bbe51 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:57.892598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44651f3-0ca4-454a-a7a9-7790841bbe51 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:57.899260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cbd37-cc12-4bee-b5f8-49f58fce031a tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27cfd70ee3b34633be86008127ff4cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94b1f0418b14c7c9603117f529ec7d8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1224213322', 'tempest-NotDelegatedRole-1487055889'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:57.900219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cbd37-cc12-4bee-b5f8-49f58fce031a tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.900591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cbd37-cc12-4bee-b5f8-49f58fce031a tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.900881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049cbd37-cc12-4bee-b5f8-49f58fce031a tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] PATH_INFO: `/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles/bdf6ca90984047e288fffd5d611a8ee2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.917539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cbd37-cc12-4bee-b5f8-49f58fce031a tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f336f179b5ac4a21ae90a7289af81a89, role_id=bdf6ca90984047e288fffd5d611a8ee2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:57.919908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049cbd37-cc12-4bee-b5f8-49f58fce031a tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:57.936927 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3276/6497] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Mar 26 21:10:57 2022] HEAD /identity/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles/bdf6ca90984047e288fffd5d611a8ee2 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Mar 26 21:10:57.940977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f889d-ba39-4be6-9732-3557ef67b834 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:57.954880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f889d-ba39-4be6-9732-3557ef67b834 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:57.968355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c897-74db-4d95-b0f9-48f20f538c65 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27cfd70ee3b34633be86008127ff4cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94b1f0418b14c7c9603117f529ec7d8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1224213322', 'tempest-NotDelegatedRole-1487055889'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:57.969214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c897-74db-4d95-b0f9-48f20f538c65 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:57.969503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c897-74db-4d95-b0f9-48f20f538c65 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:57.969790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c897-74db-4d95-b0f9-48f20f538c65 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] PATH_INFO: `/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles/a1160b10a15a4fed989a02fc8c194593` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:57.977451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43c897-74db-4d95-b0f9-48f20f538c65 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f336f179b5ac4a21ae90a7289af81a89, role_id=a1160b10a15a4fed989a02fc8c194593)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:57.978921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43c897-74db-4d95-b0f9-48f20f538c65 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:57.999681 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-0f43c897-74db-4d95-b0f9-48f20f538c65 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Could not find role: a1160b10a15a4fed989a02fc8c194593.: keystone.exception.RoleNotFound: Could not find role: a1160b10a15a4fed989a02fc8c194593. Mar 26 21:10:58.005310 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3222/6498] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Mar 26 21:10:57 2022] GET /identity/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles/a1160b10a15a4fed989a02fc8c194593 => generated 110 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:10:58.006455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cbd37-cc12-4bee-b5f8-49f58fce031a tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:58.037162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049cbd37-cc12-4bee-b5f8-49f58fce031a tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:58.054351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c954e-0619-44b6-8177-043e1c897846 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27cfd70ee3b34633be86008127ff4cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94b1f0418b14c7c9603117f529ec7d8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1224213322', 'tempest-NotDelegatedRole-1487055889'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:58.055586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c954e-0619-44b6-8177-043e1c897846 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:58.056599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c954e-0619-44b6-8177-043e1c897846 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:58.057670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c954e-0619-44b6-8177-043e1c897846 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] PATH_INFO: `/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles/a1160b10a15a4fed989a02fc8c194593` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:58.071950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c954e-0619-44b6-8177-043e1c897846 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorizing `identity:get_role_for_trust(trust_id=f336f179b5ac4a21ae90a7289af81a89, role_id=a1160b10a15a4fed989a02fc8c194593)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:58.075834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c954e-0619-44b6-8177-043e1c897846 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:58.119877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c897-74db-4d95-b0f9-48f20f538c65 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:58.127944 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-c11c954e-0619-44b6-8177-043e1c897846 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Could not find role: a1160b10a15a4fed989a02fc8c194593.: keystone.exception.RoleNotFound: Could not find role: a1160b10a15a4fed989a02fc8c194593. Mar 26 21:10:58.129646 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3277/6499] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Mar 26 21:10:58 2022] HEAD /identity/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89/roles/a1160b10a15a4fed989a02fc8c194593 => generated 0 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Mar 26 21:10:58.136006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c954e-0619-44b6-8177-043e1c897846 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:58.140997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43c897-74db-4d95-b0f9-48f20f538c65 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:58.160618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c954e-0619-44b6-8177-043e1c897846 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:58.162918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae3287541dee46208134c2309a18293d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec20d4256a9946e38d5f5ca4871295da', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:58.163635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:58.165540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27cfd70ee3b34633be86008127ff4cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94b1f0418b14c7c9603117f529ec7d8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1224213322', 'tempest-NotDelegatedRole-1487055889'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:58.166447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:58.166680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:58.166795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:58.166983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] PATH_INFO: `/v3/projects/ab129618265e4c4786cd25f1df564888` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:58.167215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] PATH_INFO: `/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:58.172601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab129618265e4c4786cd25f1df564888)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:58.175039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorizing `identity:delete_trust(trust_id=f336f179b5ac4a21ae90a7289af81a89)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:58.176607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:58.177536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:58.211474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f336f179b5ac4a21ae90a7289af81a89', 'request_id': 'req-4d547208-2578-4453-9c60-7a57fc4e5493'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.212390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'f336f179b5ac4a21ae90a7289af81a89', 'request_id': 'req-4d547208-2578-4453-9c60-7a57fc4e5493'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.230285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f336f179b5ac4a21ae90a7289af81a89', 'request_id': 'req-4d547208-2578-4453-9c60-7a57fc4e5493'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.249927 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3278/6500] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:10:58 2022] DELETE /identity/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:58.251089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:58.252860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:58.273239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d547208-2578-4453-9c60-7a57fc4e5493 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:58.294351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab129618265e4c4786cd25f1df564888', 'request_id': 'req-a309de08-ab16-4382-ae00-fbd70efd486c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.311550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab129618265e4c4786cd25f1df564888', 'request_id': 'req-a309de08-ab16-4382-ae00-fbd70efd486c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.318520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab129618265e4c4786cd25f1df564888', 'request_id': 'req-a309de08-ab16-4382-ae00-fbd70efd486c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.344116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4779-61ed-4139-9d74-15c49efd7061 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '27cfd70ee3b34633be86008127ff4cc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94b1f0418b14c7c9603117f529ec7d8', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1224213322', 'tempest-NotDelegatedRole-1487055889'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:58.345275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4779-61ed-4139-9d74-15c49efd7061 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:58.345705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4779-61ed-4139-9d74-15c49efd7061 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:58.345831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a4779-61ed-4139-9d74-15c49efd7061 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] PATH_INFO: `/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:58.368645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] The token cache is being invalidate because project ab129618265e4c4786cd25f1df564888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:58.368949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.373927 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-004a4779-61ed-4139-9d74-15c49efd7061 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Could not find trust: f336f179b5ac4a21ae90a7289af81a89.: keystone.exception.TrustNotFound: Could not find trust: f336f179b5ac4a21ae90a7289af81a89. Mar 26 21:10:58.378160 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3279/6501] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:10:58 2022] GET /identity/v3/OS-TRUST/trusts/f336f179b5ac4a21ae90a7289af81a89 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:10:58.378290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.381343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4779-61ed-4139-9d74-15c49efd7061 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:58.382536 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3223/6502] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:58 2022] DELETE /identity/v3/projects/ab129618265e4c4786cd25f1df564888 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:58.383404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-004a4779-61ed-4139-9d74-15c49efd7061 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:58.419483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:58.421099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:58.507667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a4779-61ed-4139-9d74-15c49efd7061 tempest-TrustsV3TestJSON-175964119 tempest-user-480552468] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:58.514358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:58.515468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:58.515962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:58.516461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/a1160b10a15a4fed989a02fc8c194593` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:58.518190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a1160b10a15a4fed989a02fc8c194593)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:58.520076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:58.571515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309de08-ab16-4382-ae00-fbd70efd486c tempest-RoutersIpV6AdminTest-689482649 tempest-RoutersIpV6AdminTest-689482649-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:58.586054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674896e-4017-46ac-8801-4063f6ec980f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:58.587408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674896e-4017-46ac-8801-4063f6ec980f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:58.589019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role a1160b10a15a4fed989a02fc8c194593 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:58.589224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674896e-4017-46ac-8801-4063f6ec980f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:58.589624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0674896e-4017-46ac-8801-4063f6ec980f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:58.589892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.591937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.595064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0674896e-4017-46ac-8801-4063f6ec980f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:58.602673 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3280/6503] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:58 2022] DELETE /identity/v3/roles/a1160b10a15a4fed989a02fc8c194593 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:58.604339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:58.607722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:58.710750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2eac8d-c28f-4335-b1de-4dd1dacd9b38 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:58.735166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:58.736784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:58.736784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:58.736784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/bdf6ca90984047e288fffd5d611a8ee2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:58.741662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bdf6ca90984047e288fffd5d611a8ee2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:58.757077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674896e-4017-46ac-8801-4063f6ec980f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:58.758682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0674896e-4017-46ac-8801-4063f6ec980f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:58.760325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:58.783208 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3224/6504] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:10:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:10:58.854428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role bdf6ca90984047e288fffd5d611a8ee2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:58.854956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.855877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:58.863258 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3281/6505] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:58 2022] DELETE /identity/v3/roles/bdf6ca90984047e288fffd5d611a8ee2 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:58.863962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674896e-4017-46ac-8801-4063f6ec980f service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:58.890120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0674896e-4017-46ac-8801-4063f6ec980f service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:59.071816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:59.075910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:59.075910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:59.075910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users/27cfd70ee3b34633be86008127ff4cc7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:59.082677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_user(user_id=27cfd70ee3b34633be86008127ff4cc7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:59.088036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:59.111977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:59.114089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:59.206411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27cfd70ee3b34633be86008127ff4cc7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.217858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27cfd70ee3b34633be86008127ff4cc7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.218635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27cfd70ee3b34633be86008127ff4cc7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.219489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27cfd70ee3b34633be86008127ff4cc7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.220168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458e225-dd14-4f60-a289-2eb2d736470b tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:59.227469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:59.228892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:59.229177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:59.230121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] PATH_INFO: `/v3/users/da090da7f121431abd13c9d9f0c71bb8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:59.231186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da090da7f121431abd13c9d9f0c71bb8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:59.233599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:59.238106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27cfd70ee3b34633be86008127ff4cc7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.257879 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3225/6506] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:58 2022] DELETE /identity/v3/users/27cfd70ee3b34633be86008127ff4cc7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:10:59.261598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:59.263839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:59.340504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da090da7f121431abd13c9d9f0c71bb8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.352161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da090da7f121431abd13c9d9f0c71bb8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.360791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da090da7f121431abd13c9d9f0c71bb8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.361545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da090da7f121431abd13c9d9f0c71bb8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.376496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da090da7f121431abd13c9d9f0c71bb8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.396036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb44d1-b481-4952-b540-841c6b872620 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:59.403394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:59.404352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:59.404665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:59.404991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/d94b1f0418b14c7c9603117f529ec7d8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:59.407531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d94b1f0418b14c7c9603117f529ec7d8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:59.410960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:59.420184 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3282/6507] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:10:59 2022] DELETE /identity/v3/users/da090da7f121431abd13c9d9f0c71bb8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:59.534124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd94b1f0418b14c7c9603117f529ec7d8', 'request_id': 'req-f05802b7-f44e-4a15-8852-d48c32a17ff6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.555859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd94b1f0418b14c7c9603117f529ec7d8', 'request_id': 'req-f05802b7-f44e-4a15-8852-d48c32a17ff6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.567027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd94b1f0418b14c7c9603117f529ec7d8', 'request_id': 'req-f05802b7-f44e-4a15-8852-d48c32a17ff6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.595330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] The token cache is being invalidate because project d94b1f0418b14c7c9603117f529ec7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:10:59.595682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.597854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:10:59.616138 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3226/6508] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:59 2022] DELETE /identity/v3/projects/d94b1f0418b14c7c9603117f529ec7d8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:10:59.617848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:59.619703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:59.761529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b0182-5a72-4be3-9e0b-3bd10f1fc138 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:10:59.804038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:10:59.805629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:10:59.927613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1681e3-5e3a-40e5-a44a-b2c657633f15 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:10:59.928438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1681e3-5e3a-40e5-a44a-b2c657633f15 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:10:59.928850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1681e3-5e3a-40e5-a44a-b2c657633f15 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:10:59.929209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1681e3-5e3a-40e5-a44a-b2c657633f15 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:10:59.932694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1681e3-5e3a-40e5-a44a-b2c657633f15 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:10:59.941677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1681e3-5e3a-40e5-a44a-b2c657633f15 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:10:59.993590 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3283/6509] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:10:59 2022] POST /identity/v3/projects => generated 329 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:10:59.997759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1681e3-5e3a-40e5-a44a-b2c657633f15 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:00.000791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9c1681e3-5e3a-40e5-a44a-b2c657633f15 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:00.020142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05802b7-f44e-4a15-8852-d48c32a17ff6 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:00.139077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1681e3-5e3a-40e5-a44a-b2c657633f15 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:00.154105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e578b-d7b2-4e03-8516-4658adc46410 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:00.156009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:00.158134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:00.158429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:00.158710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] PATH_INFO: `/v3/projects/7b6be6f8159f4491b83d9658d643464c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:00.160239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6be6f8159f4491b83d9658d643464c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:00.164918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:00.169963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e578b-d7b2-4e03-8516-4658adc46410 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:00.170481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e578b-d7b2-4e03-8516-4658adc46410 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:00.170928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e578b-d7b2-4e03-8516-4658adc46410 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:00.171824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e578b-d7b2-4e03-8516-4658adc46410 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:00.174069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e578b-d7b2-4e03-8516-4658adc46410 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:00.206469 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3284/6510] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:10:59 2022] POST /identity/v3/users => generated 416 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:00.209387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e578b-d7b2-4e03-8516-4658adc46410 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:00.233513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e578b-d7b2-4e03-8516-4658adc46410 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:00.240119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb76aea-5b3d-417f-8829-29c798ecc57f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:00.241018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb76aea-5b3d-417f-8829-29c798ecc57f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:00.241360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb76aea-5b3d-417f-8829-29c798ecc57f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:00.241649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb76aea-5b3d-417f-8829-29c798ecc57f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:00.242526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb76aea-5b3d-417f-8829-29c798ecc57f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:00.245139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb76aea-5b3d-417f-8829-29c798ecc57f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:00.270561 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3285/6511] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:11:00 2022] POST /identity/v3/roles => generated 243 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:00.275129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6be6f8159f4491b83d9658d643464c', 'request_id': 'req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:00.275289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb76aea-5b3d-417f-8829-29c798ecc57f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:00.291275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6be6f8159f4491b83d9658d643464c', 'request_id': 'req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:00.295884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb76aea-5b3d-417f-8829-29c798ecc57f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:00.317661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6be6f8159f4491b83d9658d643464c', 'request_id': 'req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:00.339888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] The token cache is being invalidate because project 7b6be6f8159f4491b83d9658d643464c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:00.341563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:00.341894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53c4c8f7-82e5-4acd-850c-12fc8e9dbdc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:00.351168 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3227/6512] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:10:59 2022] DELETE /identity/v3/projects/7b6be6f8159f4491b83d9658d643464c => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:00.356253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8dc0c-acc1-4dfc-a7cb-ecf0dccbcf70 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:00.356681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8dc0c-acc1-4dfc-a7cb-ecf0dccbcf70 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:00.357202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8dc0c-acc1-4dfc-a7cb-ecf0dccbcf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:00.403842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d986-9369-4841-b31f-ef920f77897f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:00.404786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d986-9369-4841-b31f-ef920f77897f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:00.405801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d986-9369-4841-b31f-ef920f77897f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:00.406231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d1a8dc0c-acc1-4dfc-a7cb-ecf0dccbcf70 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:00.406644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8d986-9369-4841-b31f-ef920f77897f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:00.408600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d986-9369-4841-b31f-ef920f77897f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:00.409233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d1a8dc0c-acc1-4dfc-a7cb-ecf0dccbcf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:00.419367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8d986-9369-4841-b31f-ef920f77897f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:00.453297 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3286/6513] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:11:00 2022] POST /identity/v3/roles => generated 247 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:00.455088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d986-9369-4841-b31f-ef920f77897f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:00.463080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f0f8d986-9369-4841-b31f-ef920f77897f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:00.511547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8d986-9369-4841-b31f-ef920f77897f tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:00.541179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c704050-a4d2-4e33-8cd7-4e972ba326ad tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:00.542393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c704050-a4d2-4e33-8cd7-4e972ba326ad tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:00.546055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c704050-a4d2-4e33-8cd7-4e972ba326ad tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:00.548163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c704050-a4d2-4e33-8cd7-4e972ba326ad tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/954fba535724411180e5fc59c9cb6c6a/users/591a769c0b1d473887d3e90809295185/roles/9c546e3bf51c43e39b188834e59dbe01` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:00.587782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c704050-a4d2-4e33-8cd7-4e972ba326ad tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=954fba535724411180e5fc59c9cb6c6a, user_id=591a769c0b1d473887d3e90809295185, role_id=9c546e3bf51c43e39b188834e59dbe01)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:00.591006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c704050-a4d2-4e33-8cd7-4e972ba326ad tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:00.624595 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3228/6514] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:00.628732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe727-04e2-4db4-91b8-74b76be6e37d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:00.629022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe727-04e2-4db4-91b8-74b76be6e37d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:00.629398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fe727-04e2-4db4-91b8-74b76be6e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:00.631228 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3287/6515] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:00 2022] PUT /identity/v3/projects/954fba535724411180e5fc59c9cb6c6a/users/591a769c0b1d473887d3e90809295185/roles/9c546e3bf51c43e39b188834e59dbe01 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:11:00.638248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c704050-a4d2-4e33-8cd7-4e972ba326ad tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:00.750669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ba3fe727-04e2-4db4-91b8-74b76be6e37d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:00.752475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba3fe727-04e2-4db4-91b8-74b76be6e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:00.854445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c704050-a4d2-4e33-8cd7-4e972ba326ad tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:00.868069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc13569-d189-4e1c-8a78-c8f00f1634ca tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:00.870183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc13569-d189-4e1c-8a78-c8f00f1634ca tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:00.871254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc13569-d189-4e1c-8a78-c8f00f1634ca tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:00.873814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc13569-d189-4e1c-8a78-c8f00f1634ca tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/954fba535724411180e5fc59c9cb6c6a/users/591a769c0b1d473887d3e90809295185/roles/d64910d623b1490a887ca9c3c1c081f6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:00.880094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc13569-d189-4e1c-8a78-c8f00f1634ca tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:create_grant(project_id=954fba535724411180e5fc59c9cb6c6a, user_id=591a769c0b1d473887d3e90809295185, role_id=d64910d623b1490a887ca9c3c1c081f6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:00.884415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc13569-d189-4e1c-8a78-c8f00f1634ca tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:00.902789 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3229/6516] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:00.909850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fe727-04e2-4db4-91b8-74b76be6e37d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:00.923715 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3288/6517] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:00 2022] PUT /identity/v3/projects/954fba535724411180e5fc59c9cb6c6a/users/591a769c0b1d473887d3e90809295185/roles/d64910d623b1490a887ca9c3c1c081f6 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:00.942240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc13569-d189-4e1c-8a78-c8f00f1634ca tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:00.948211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fe727-04e2-4db4-91b8-74b76be6e37d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.106994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc13569-d189-4e1c-8a78-c8f00f1634ca tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.118519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2167b5dd-a610-4504-b209-501363859141 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.119417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167b5dd-a610-4504-b209-501363859141 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.119670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167b5dd-a610-4504-b209-501363859141 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.120098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167b5dd-a610-4504-b209-501363859141 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.120907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167b5dd-a610-4504-b209-501363859141 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.123512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2167b5dd-a610-4504-b209-501363859141 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.159723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117c0f1-c510-4494-aadf-f7bc86a6774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.165901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117c0f1-c510-4494-aadf-f7bc86a6774b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.166211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117c0f1-c510-4494-aadf-f7bc86a6774b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.166486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d117c0f1-c510-4494-aadf-f7bc86a6774b admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.167229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117c0f1-c510-4494-aadf-f7bc86a6774b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:11:01.167539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117c0f1-c510-4494-aadf-f7bc86a6774b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.175659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d117c0f1-c510-4494-aadf-f7bc86a6774b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.197947 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3289/6518] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:00 2022] GET /identity/v3/users => generated 8074 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:01.202450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac64a7-722e-4c46-96bb-73815c59466d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.204317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac64a7-722e-4c46-96bb-73815c59466d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.204317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac64a7-722e-4c46-96bb-73815c59466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.212372 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3230/6519] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:11:01.217173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117c0f1-c510-4494-aadf-f7bc86a6774b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:01.242735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d117c0f1-c510-4494-aadf-f7bc86a6774b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.251941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb06cc0-3b1c-494a-b920-a71fed131881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.252465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb06cc0-3b1c-494a-b920-a71fed131881 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.252857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb06cc0-3b1c-494a-b920-a71fed131881 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.253241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb06cc0-3b1c-494a-b920-a71fed131881 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.254048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb06cc0-3b1c-494a-b920-a71fed131881 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.256151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb06cc0-3b1c-494a-b920-a71fed131881 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.316087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0aac64a7-722e-4c46-96bb-73815c59466d None None] MFA Rules not processed for user `591a769c0b1d473887d3e90809295185`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:01.317328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0aac64a7-722e-4c46-96bb-73815c59466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:01.331358 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3231/6520] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:01 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:01.335610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb06cc0-3b1c-494a-b920-a71fed131881 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:01.470112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb06cc0-3b1c-494a-b920-a71fed131881 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.480861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7502-185c-490f-a142-8a62a58ac3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.482155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7502-185c-490f-a142-8a62a58ac3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.482675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7502-185c-490f-a142-8a62a58ac3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.483224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a7502-185c-490f-a142-8a62a58ac3c3 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.484336 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3290/6521] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:01.486195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a7502-185c-490f-a142-8a62a58ac3c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.488509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a7502-185c-490f-a142-8a62a58ac3c3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.495255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab50341-987f-472c-9490-1fd0cb08dc09 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.496385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab50341-987f-472c-9490-1fd0cb08dc09 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.496385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab50341-987f-472c-9490-1fd0cb08dc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.519724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0ab50341-987f-472c-9490-1fd0cb08dc09 None None] MFA Rules not processed for user `591a769c0b1d473887d3e90809295185`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:01.521075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0ab50341-987f-472c-9490-1fd0cb08dc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:01.544260 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3232/6522] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:01 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:01.548806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7502-185c-490f-a142-8a62a58ac3c3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:01.580337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a7502-185c-490f-a142-8a62a58ac3c3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.588402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01bd36-5eac-49e5-a09b-154515073eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.589372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01bd36-5eac-49e5-a09b-154515073eda admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.589894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01bd36-5eac-49e5-a09b-154515073eda admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.590254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01bd36-5eac-49e5-a09b-154515073eda admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.591255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01bd36-5eac-49e5-a09b-154515073eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.593071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d01bd36-5eac-49e5-a09b-154515073eda admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.606693 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3233/6523] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:01 2022] GET /identity/v3/roles => generated 1892 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:01.610274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01bd36-5eac-49e5-a09b-154515073eda admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:01.619579 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3291/6524] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:01.621444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d01bd36-5eac-49e5-a09b-154515073eda admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.623374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab50341-987f-472c-9490-1fd0cb08dc09 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:01.628624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4719a8-413d-4434-a159-459a408248eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.629488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4719a8-413d-4434-a159-459a408248eb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.629969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4719a8-413d-4434-a159-459a408248eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.630488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4719a8-413d-4434-a159-459a408248eb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.631383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4719a8-413d-4434-a159-459a408248eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.633377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4719a8-413d-4434-a159-459a408248eb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.634474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab50341-987f-472c-9490-1fd0cb08dc09 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.643008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930f813-4718-49b9-b083-1e691de503d2 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591a769c0b1d473887d3e90809295185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '954fba535724411180e5fc59c9cb6c6a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-771055215', 'tempest-NotDelegatedRole-1802322628'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.644331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930f813-4718-49b9-b083-1e691de503d2 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.644331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930f813-4718-49b9-b083-1e691de503d2 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.645422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930f813-4718-49b9-b083-1e691de503d2 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.645555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930f813-4718-49b9-b083-1e691de503d2 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorizing `identity:create_trust()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.652027 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3234/6525] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:01 2022] GET /identity/v3/roles => generated 1892 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:01.655451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4719a8-413d-4434-a159-459a408248eb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:01.657241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930f813-4718-49b9-b083-1e691de503d2 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.676541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4719a8-413d-4434-a159-459a408248eb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.689121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc984865-3cf0-4d38-812f-536517c3682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.690426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc984865-3cf0-4d38-812f-536517c3682f admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.690938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc984865-3cf0-4d38-812f-536517c3682f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.691879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc984865-3cf0-4d38-812f-536517c3682f admin admin] PATH_INFO: `/v3/projects/13edcc6f41ce42ff8b88edb21a3ae4ec/users/579df559018e45808c3886ac22ecc165/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.714595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc984865-3cf0-4d38-812f-536517c3682f admin admin] RBAC: Authorizing `identity:create_grant(project_id=13edcc6f41ce42ff8b88edb21a3ae4ec, user_id=579df559018e45808c3886ac22ecc165, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.719231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc984865-3cf0-4d38-812f-536517c3682f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.743665 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3235/6526] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:01 2022] PUT /identity/v3/projects/13edcc6f41ce42ff8b88edb21a3ae4ec/users/579df559018e45808c3886ac22ecc165/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:11:01.756145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3b5ac-0dfa-42f3-adf8-a5dd3caf3074 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.756885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3b5ac-0dfa-42f3-adf8-a5dd3caf3074 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.757175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3b5ac-0dfa-42f3-adf8-a5dd3caf3074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.768025 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3292/6527] 10.222.0.16 () {60 vars in 1173 bytes} [Sat Mar 26 21:11:01 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:11:01.772304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930f813-4718-49b9-b083-1e691de503d2 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:01.788196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930f813-4718-49b9-b083-1e691de503d2 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.801877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d7a3b5ac-0dfa-42f3-adf8-a5dd3caf3074 None None] MFA Rules not processed for user `579df559018e45808c3886ac22ecc165`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:01.803716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d7a3b5ac-0dfa-42f3-adf8-a5dd3caf3074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:01.888805 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3236/6528] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:01.898958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09d588-61db-4fcf-91aa-49758208a6f5 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591a769c0b1d473887d3e90809295185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '954fba535724411180e5fc59c9cb6c6a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-771055215', 'tempest-NotDelegatedRole-1802322628'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.899797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09d588-61db-4fcf-91aa-49758208a6f5 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.900123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09d588-61db-4fcf-91aa-49758208a6f5 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.900786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09d588-61db-4fcf-91aa-49758208a6f5 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] PATH_INFO: `/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.901973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3b5ac-0dfa-42f3-adf8-a5dd3caf3074 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:01.904136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d7a3b5ac-0dfa-42f3-adf8-a5dd3caf3074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:01.915349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09d588-61db-4fcf-91aa-49758208a6f5 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorizing `identity:get_trust(trust_id=d6d2db6e466145fdb2b4adeae65ffcdc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.917259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09d588-61db-4fcf-91aa-49758208a6f5 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.941275 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3293/6529] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:11:01 2022] GET /identity/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc => generated 834 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:11:01.945186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09d588-61db-4fcf-91aa-49758208a6f5 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:01.958430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09d588-61db-4fcf-91aa-49758208a6f5 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:01.963606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb48c-a1bb-4507-ac89-2e1497e3d477 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591a769c0b1d473887d3e90809295185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '954fba535724411180e5fc59c9cb6c6a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-771055215', 'tempest-NotDelegatedRole-1802322628'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:01.964924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb48c-a1bb-4507-ac89-2e1497e3d477 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:01.965214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb48c-a1bb-4507-ac89-2e1497e3d477 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:01.965548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeb48c-a1bb-4507-ac89-2e1497e3d477 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] PATH_INFO: `/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:01.975268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeb48c-a1bb-4507-ac89-2e1497e3d477 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=d6d2db6e466145fdb2b4adeae65ffcdc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:01.977306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeb48c-a1bb-4507-ac89-2e1497e3d477 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:01.989985 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3294/6530] 10.222.0.16 () {58 vars in 1268 bytes} [Sat Mar 26 21:11:01 2022] GET /identity/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:11:01.993612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb48c-a1bb-4507-ac89-2e1497e3d477 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:02.008825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeb48c-a1bb-4507-ac89-2e1497e3d477 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:02.013776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80045-5b99-456f-bb59-0ebe1f355945 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591a769c0b1d473887d3e90809295185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '954fba535724411180e5fc59c9cb6c6a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-771055215', 'tempest-NotDelegatedRole-1802322628'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:02.014741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80045-5b99-456f-bb59-0ebe1f355945 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:02.015177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80045-5b99-456f-bb59-0ebe1f355945 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:02.015468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b80045-5b99-456f-bb59-0ebe1f355945 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] PATH_INFO: `/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles/9c546e3bf51c43e39b188834e59dbe01` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:02.024070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80045-5b99-456f-bb59-0ebe1f355945 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d6d2db6e466145fdb2b4adeae65ffcdc, role_id=9c546e3bf51c43e39b188834e59dbe01)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:02.025974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b80045-5b99-456f-bb59-0ebe1f355945 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:02.029427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3b5ac-0dfa-42f3-adf8-a5dd3caf3074 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:02.037351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c57f3-8f5a-4fed-9cfe-94ef6cecbdbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:02.038434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c57f3-8f5a-4fed-9cfe-94ef6cecbdbe service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:02.039123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c57f3-8f5a-4fed-9cfe-94ef6cecbdbe service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:02.040001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c57f3-8f5a-4fed-9cfe-94ef6cecbdbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:02.042341 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3295/6531] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Mar 26 21:11:01 2022] GET /identity/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles/9c546e3bf51c43e39b188834e59dbe01 => generated 243 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:11:02.046202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80045-5b99-456f-bb59-0ebe1f355945 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:02.051614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c57f3-8f5a-4fed-9cfe-94ef6cecbdbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:02.054931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c57f3-8f5a-4fed-9cfe-94ef6cecbdbe service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:02.061567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b80045-5b99-456f-bb59-0ebe1f355945 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:02.066986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58ace-28e3-41ac-9725-a1004343ec6d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591a769c0b1d473887d3e90809295185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '954fba535724411180e5fc59c9cb6c6a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-771055215', 'tempest-NotDelegatedRole-1802322628'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:02.067958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58ace-28e3-41ac-9725-a1004343ec6d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:02.068349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58ace-28e3-41ac-9725-a1004343ec6d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:02.068725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa58ace-28e3-41ac-9725-a1004343ec6d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] PATH_INFO: `/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles/9c546e3bf51c43e39b188834e59dbe01` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:02.079049 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3237/6532] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:02.081887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa58ace-28e3-41ac-9725-a1004343ec6d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d6d2db6e466145fdb2b4adeae65ffcdc, role_id=9c546e3bf51c43e39b188834e59dbe01)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:02.084504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa58ace-28e3-41ac-9725-a1004343ec6d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:02.114247 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3296/6533] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Mar 26 21:11:02 2022] HEAD /identity/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles/9c546e3bf51c43e39b188834e59dbe01 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Mar 26 21:11:02.117723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c57f3-8f5a-4fed-9cfe-94ef6cecbdbe service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:02.142641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c57f3-8f5a-4fed-9cfe-94ef6cecbdbe service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:02.153184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8295d-77b2-4a60-8842-f8f25435cb17 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591a769c0b1d473887d3e90809295185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '954fba535724411180e5fc59c9cb6c6a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-771055215', 'tempest-NotDelegatedRole-1802322628'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:02.153997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8295d-77b2-4a60-8842-f8f25435cb17 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:02.154276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8295d-77b2-4a60-8842-f8f25435cb17 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:02.154554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8295d-77b2-4a60-8842-f8f25435cb17 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] PATH_INFO: `/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles/d64910d623b1490a887ca9c3c1c081f6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:02.166195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8295d-77b2-4a60-8842-f8f25435cb17 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d6d2db6e466145fdb2b4adeae65ffcdc, role_id=d64910d623b1490a887ca9c3c1c081f6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:02.170594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8295d-77b2-4a60-8842-f8f25435cb17 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:02.194939 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-8ed8295d-77b2-4a60-8842-f8f25435cb17 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Could not find role: d64910d623b1490a887ca9c3c1c081f6.: keystone.exception.RoleNotFound: Could not find role: d64910d623b1490a887ca9c3c1c081f6. Mar 26 21:11:02.197241 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3238/6534] 10.222.0.16 () {58 vars in 1367 bytes} [Sat Mar 26 21:11:02 2022] GET /identity/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles/d64910d623b1490a887ca9c3c1c081f6 => generated 110 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:11:02.201737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58ace-28e3-41ac-9725-a1004343ec6d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:02.222412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa58ace-28e3-41ac-9725-a1004343ec6d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:02.244809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591a769c0b1d473887d3e90809295185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '954fba535724411180e5fc59c9cb6c6a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-771055215', 'tempest-NotDelegatedRole-1802322628'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:02.245804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:02.245804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:02.249107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] PATH_INFO: `/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles/d64910d623b1490a887ca9c3c1c081f6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:02.263242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorizing `identity:get_role_for_trust(trust_id=d6d2db6e466145fdb2b4adeae65ffcdc, role_id=d64910d623b1490a887ca9c3c1c081f6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:02.267480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:02.299397 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Could not find role: d64910d623b1490a887ca9c3c1c081f6.: keystone.exception.RoleNotFound: Could not find role: d64910d623b1490a887ca9c3c1c081f6. Mar 26 21:11:02.306114 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3297/6535] 10.222.0.16 () {58 vars in 1368 bytes} [Sat Mar 26 21:11:02 2022] HEAD /identity/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc/roles/d64910d623b1490a887ca9c3c1c081f6 => generated 0 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:11:02.310825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8295d-77b2-4a60-8842-f8f25435cb17 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:02.331012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8295d-77b2-4a60-8842-f8f25435cb17 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:02.342454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591a769c0b1d473887d3e90809295185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '954fba535724411180e5fc59c9cb6c6a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-771055215', 'tempest-NotDelegatedRole-1802322628'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:02.343564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:02.344640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:02.346099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] PATH_INFO: `/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:02.362195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorizing `identity:delete_trust(trust_id=d6d2db6e466145fdb2b4adeae65ffcdc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:02.365313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:02.420244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd6d2db6e466145fdb2b4adeae65ffcdc', 'request_id': 'req-af72e427-7969-4b4b-be52-e91b5478e596'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:02.421206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'd6d2db6e466145fdb2b4adeae65ffcdc', 'request_id': 'req-af72e427-7969-4b4b-be52-e91b5478e596'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:02.442362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'd6d2db6e466145fdb2b4adeae65ffcdc', 'request_id': 'req-af72e427-7969-4b4b-be52-e91b5478e596'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:02.459706 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3239/6536] 10.222.0.16 () {58 vars in 1253 bytes} [Sat Mar 26 21:11:02 2022] DELETE /identity/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:02.462318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:02.464865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:02.499652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f720483-6d17-416c-879d-ede998335487 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:02.511452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff036d-2604-4d89-bfce-4532b242b68d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '591a769c0b1d473887d3e90809295185', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '954fba535724411180e5fc59c9cb6c6a', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-771055215', 'tempest-NotDelegatedRole-1802322628'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:02.513268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff036d-2604-4d89-bfce-4532b242b68d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:02.513734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff036d-2604-4d89-bfce-4532b242b68d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:02.514225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff036d-2604-4d89-bfce-4532b242b68d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] PATH_INFO: `/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:02.530874 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-31ff036d-2604-4d89-bfce-4532b242b68d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Could not find trust: d6d2db6e466145fdb2b4adeae65ffcdc.: keystone.exception.TrustNotFound: Could not find trust: d6d2db6e466145fdb2b4adeae65ffcdc. Mar 26 21:11:02.538041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:02.538598 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3298/6537] 10.222.0.16 () {58 vars in 1250 bytes} [Sat Mar 26 21:11:02 2022] GET /identity/v3/OS-TRUST/trusts/d6d2db6e466145fdb2b4adeae65ffcdc => generated 111 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:11:02.539531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:02.676217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af72e427-7969-4b4b-be52-e91b5478e596 tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:02.696167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:02.698907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:02.699360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:02.703338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/d64910d623b1490a887ca9c3c1c081f6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:02.707845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d64910d623b1490a887ca9c3c1c081f6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:02.709810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:02.851112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role d64910d623b1490a887ca9c3c1c081f6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:02.851500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:02.854065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:02.857641 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3240/6538] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:02 2022] DELETE /identity/v3/roles/d64910d623b1490a887ca9c3c1c081f6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:02.858876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff036d-2604-4d89-bfce-4532b242b68d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:02.863363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-31ff036d-2604-4d89-bfce-4532b242b68d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:02.907083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff036d-2604-4d89-bfce-4532b242b68d tempest-TrustsV3TestJSON-1902796739 tempest-user-1798183003] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:03.035376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:03.036682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:03.037278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:03.037655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/roles/9c546e3bf51c43e39b188834e59dbe01` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:03.039604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9c546e3bf51c43e39b188834e59dbe01)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:03.041550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:03.107325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invalidating the token cache because role 9c546e3bf51c43e39b188834e59dbe01 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:03.108266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.109100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.112227 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3299/6539] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:02 2022] DELETE /identity/v3/roles/9c546e3bf51c43e39b188834e59dbe01 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:03.116029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:03.130473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2b8c-54f2-4a40-81af-b63414cfee5c tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:03.212795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:03.214588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:03.215107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:03.216231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/users/591a769c0b1d473887d3e90809295185` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:03.218941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_user(user_id=591a769c0b1d473887d3e90809295185)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:03.221779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:03.281714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591a769c0b1d473887d3e90809295185'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.290120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591a769c0b1d473887d3e90809295185'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.290917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591a769c0b1d473887d3e90809295185'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.291583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591a769c0b1d473887d3e90809295185'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.306372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591a769c0b1d473887d3e90809295185'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.322864 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3241/6540] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:03 2022] DELETE /identity/v3/users/591a769c0b1d473887d3e90809295185 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:11:03.326626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:03.328056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:03.342945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f4985-a49b-4f0b-a47d-b545bb0f22a7 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:03.411247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:03.412266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c5c3e48830974c83bd50a01110f0d3e4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:03.412927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:03.413674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:03.414460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:03.415088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] PATH_INFO: `/v3/projects/954fba535724411180e5fc59c9cb6c6a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:03.416649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorizing `identity:delete_project(project_id=954fba535724411180e5fc59c9cb6c6a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:03.418833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:03.495639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954fba535724411180e5fc59c9cb6c6a', 'request_id': 'req-05c43dae-5bb6-4a9e-af39-603c111c3f88'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.508613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab9ff4-b096-44df-a080-8f345260fd57 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:03.510711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954fba535724411180e5fc59c9cb6c6a', 'request_id': 'req-05c43dae-5bb6-4a9e-af39-603c111c3f88'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.521507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954fba535724411180e5fc59c9cb6c6a', 'request_id': 'req-05c43dae-5bb6-4a9e-af39-603c111c3f88'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.540717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] The token cache is being invalidate because project 954fba535724411180e5fc59c9cb6c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:03.541005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.543850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.545997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3300/6541] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:03 2022] DELETE /identity/v3/projects/954fba535724411180e5fc59c9cb6c6a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:03.552389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:03.555472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:03.632393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:03.633359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:03.633709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:03.634108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] PATH_INFO: `/v3/users/4e069c88bde243a39d59ee5a170f5094` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:03.635369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e069c88bde243a39d59ee5a170f5094)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:03.638212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:03.646360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c43dae-5bb6-4a9e-af39-603c111c3f88 tempest-TrustsV3TestJSON-114205689 tempest-TrustsV3TestJSON-114205689-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:03.652166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:03.653952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:03.654237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:03.654512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] PATH_INFO: `/v3/users/347b32b9beb84f658a5ab68dbec25372` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:03.656065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] RBAC: Authorizing `identity:delete_user(user_id=347b32b9beb84f658a5ab68dbec25372)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:03.659117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:03.706597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e069c88bde243a39d59ee5a170f5094'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.717546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e069c88bde243a39d59ee5a170f5094'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.718557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e069c88bde243a39d59ee5a170f5094'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.719412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e069c88bde243a39d59ee5a170f5094'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.723751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '347b32b9beb84f658a5ab68dbec25372'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.734237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a0cd84dc-b0a9-483b-82bb-0e3412a673e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e069c88bde243a39d59ee5a170f5094'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.736847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '347b32b9beb84f658a5ab68dbec25372'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.738392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '347b32b9beb84f658a5ab68dbec25372'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.739033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '347b32b9beb84f658a5ab68dbec25372'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.751578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b78fc5da-c33c-4412-8fb6-f3b58e94611e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '347b32b9beb84f658a5ab68dbec25372'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:03.757261 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3242/6542] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:03 2022] DELETE /identity/v3/users/4e069c88bde243a39d59ee5a170f5094 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:11:03.784054 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3301/6543] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:03 2022] DELETE /identity/v3/users/347b32b9beb84f658a5ab68dbec25372 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:03.786960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725b495-dd79-42f7-9462-91ef9567e34c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:03.787250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725b495-dd79-42f7-9462-91ef9567e34c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:03.787536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725b495-dd79-42f7-9462-91ef9567e34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:03.821085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1725b495-dd79-42f7-9462-91ef9567e34c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:03.822326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1725b495-dd79-42f7-9462-91ef9567e34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:03.900768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c30b5-3004-4529-b475-36dfd1d8b7d1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:03.901079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c30b5-3004-4529-b475-36dfd1d8b7d1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:03.901365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c30b5-3004-4529-b475-36dfd1d8b7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:03.942841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c28c30b5-3004-4529-b475-36dfd1d8b7d1 None None] MFA Rules not processed for user `579df559018e45808c3886ac22ecc165`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:03.944863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c28c30b5-3004-4529-b475-36dfd1d8b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:03.954160 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3243/6544] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:03.966823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725b495-dd79-42f7-9462-91ef9567e34c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:03.968367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1725b495-dd79-42f7-9462-91ef9567e34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:04.064029 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3302/6545] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:04.066436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725b495-dd79-42f7-9462-91ef9567e34c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:04.071209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1357bee-d405-46d5-88c4-d6c00376ccda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:04.071985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357bee-d405-46d5-88c4-d6c00376ccda service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.072273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357bee-d405-46d5-88c4-d6c00376ccda service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.072548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357bee-d405-46d5-88c4-d6c00376ccda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.082966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c30b5-3004-4529-b475-36dfd1d8b7d1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:04.083574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357bee-d405-46d5-88c4-d6c00376ccda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:04.085079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357bee-d405-46d5-88c4-d6c00376ccda service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:04.088124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c28c30b5-3004-4529-b475-36dfd1d8b7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:04.098339 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3244/6546] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:04.114353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c30b5-3004-4529-b475-36dfd1d8b7d1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:04.122634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:04.123617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.124057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.124522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] PATH_INFO: `/v3/projects/97d8cf03facb404b81a31014cf74f93c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.125877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d8cf03facb404b81a31014cf74f93c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:04.128117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:04.196280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d8cf03facb404b81a31014cf74f93c', 'request_id': 'req-e356355f-8f69-442a-ad5c-d49c6e3cddb7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.204182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d8cf03facb404b81a31014cf74f93c', 'request_id': 'req-e356355f-8f69-442a-ad5c-d49c6e3cddb7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.212475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d8cf03facb404b81a31014cf74f93c', 'request_id': 'req-e356355f-8f69-442a-ad5c-d49c6e3cddb7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.224532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] The token cache is being invalidate because project 97d8cf03facb404b81a31014cf74f93c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:04.224948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.226126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e356355f-8f69-442a-ad5c-d49c6e3cddb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.227963 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3303/6547] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:04 2022] DELETE /identity/v3/projects/97d8cf03facb404b81a31014cf74f93c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:04.234875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6ee1b-8e43-4407-8fb1-9ef23d52576c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.235357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6ee1b-8e43-4407-8fb1-9ef23d52576c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.235780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6ee1b-8e43-4407-8fb1-9ef23d52576c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.255324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-aad6ee1b-8e43-4407-8fb1-9ef23d52576c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:04.256753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aad6ee1b-8e43-4407-8fb1-9ef23d52576c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:04.337726 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3245/6548] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:04.339892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658322-c653-4f3f-ac36-b144a12e5fc8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.340243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658322-c653-4f3f-ac36-b144a12e5fc8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.340725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658322-c653-4f3f-ac36-b144a12e5fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.366160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-33658322-c653-4f3f-ac36-b144a12e5fc8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:04.366940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-33658322-c653-4f3f-ac36-b144a12e5fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:04.377142 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3304/6549] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:04.382767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6ee1b-8e43-4407-8fb1-9ef23d52576c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:04.396105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6ee1b-8e43-4407-8fb1-9ef23d52576c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:04.408749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97414cf-753a-4917-b66c-b73721215f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:04.409982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97414cf-753a-4917-b66c-b73721215f77 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.411123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97414cf-753a-4917-b66c-b73721215f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.411886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97414cf-753a-4917-b66c-b73721215f77 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.413041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97414cf-753a-4917-b66c-b73721215f77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:11:04.413601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97414cf-753a-4917-b66c-b73721215f77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:04.417440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97414cf-753a-4917-b66c-b73721215f77 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:04.439205 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3246/6550] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:11:04.440767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658322-c653-4f3f-ac36-b144a12e5fc8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:04.451643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658322-c653-4f3f-ac36-b144a12e5fc8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:04.457090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b7d20-db3c-445c-b3a3-3dfa80bdbbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:04.457751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b7d20-db3c-445c-b3a3-3dfa80bdbbbd admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.458037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b7d20-db3c-445c-b3a3-3dfa80bdbbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.458316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b7d20-db3c-445c-b3a3-3dfa80bdbbbd admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.459062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b7d20-db3c-445c-b3a3-3dfa80bdbbbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:04.463054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b7d20-db3c-445c-b3a3-3dfa80bdbbbd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:04.509812 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3305/6551] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:04 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:04.510689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97414cf-753a-4917-b66c-b73721215f77 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:04.525143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97414cf-753a-4917-b66c-b73721215f77 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:04.599638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187d360-2a30-4a2f-88dd-2c109126c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:04.600337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187d360-2a30-4a2f-88dd-2c109126c327 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.600997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187d360-2a30-4a2f-88dd-2c109126c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.601828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187d360-2a30-4a2f-88dd-2c109126c327 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.602967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187d360-2a30-4a2f-88dd-2c109126c327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:04.605971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187d360-2a30-4a2f-88dd-2c109126c327 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:04.654569 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3247/6552] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:04 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:04.658218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b7d20-db3c-445c-b3a3-3dfa80bdbbbd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:04.674407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b7d20-db3c-445c-b3a3-3dfa80bdbbbd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:04.684318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f9ec3-4955-4533-8a2e-50b39a530aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:04.685647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f9ec3-4955-4533-8a2e-50b39a530aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.686232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f9ec3-4955-4533-8a2e-50b39a530aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.686867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f9ec3-4955-4533-8a2e-50b39a530aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.689269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f9ec3-4955-4533-8a2e-50b39a530aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:04.692109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f9ec3-4955-4533-8a2e-50b39a530aa4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:04.724703 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3306/6553] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:04.732234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187d360-2a30-4a2f-88dd-2c109126c327 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:04.733980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f9ec3-4955-4533-8a2e-50b39a530aa4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:04.735273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1187d360-2a30-4a2f-88dd-2c109126c327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:04.764790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f9ec3-4955-4533-8a2e-50b39a530aa4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:04.767756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187d360-2a30-4a2f-88dd-2c109126c327 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:04.780362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba11ea1-93fc-4da1-8e02-017d06f48086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:04.782826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba11ea1-93fc-4da1-8e02-017d06f48086 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.782980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:04.783329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba11ea1-93fc-4da1-8e02-017d06f48086 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.783707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba11ea1-93fc-4da1-8e02-017d06f48086 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.783825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.784151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.784440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] PATH_INFO: `/v3/projects/8ae99e7304ab40079a0aeaaa57c0d143` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.785475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba11ea1-93fc-4da1-8e02-017d06f48086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:04.785997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ae99e7304ab40079a0aeaaa57c0d143)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:04.790034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba11ea1-93fc-4da1-8e02-017d06f48086 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:04.793228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:04.815879 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3307/6554] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:04.821407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba11ea1-93fc-4da1-8e02-017d06f48086 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:04.833080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba11ea1-93fc-4da1-8e02-017d06f48086 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:04.838637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02ff56-785d-4aa7-aea1-07d1549218a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:04.839587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02ff56-785d-4aa7-aea1-07d1549218a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.839870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02ff56-785d-4aa7-aea1-07d1549218a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.840175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02ff56-785d-4aa7-aea1-07d1549218a4 admin admin] PATH_INFO: `/v3/projects/d4cfad6a8d7b42a9b8c3f6c1673e7f24/users/5080bfb361be4f2f80120378a8274f76/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.865475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02ff56-785d-4aa7-aea1-07d1549218a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4cfad6a8d7b42a9b8c3f6c1673e7f24, user_id=5080bfb361be4f2f80120378a8274f76, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:04.870089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02ff56-785d-4aa7-aea1-07d1549218a4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:04.872565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ae99e7304ab40079a0aeaaa57c0d143', 'request_id': 'req-e711c368-0756-4c41-8d86-68073926a263'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.883360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ae99e7304ab40079a0aeaaa57c0d143', 'request_id': 'req-e711c368-0756-4c41-8d86-68073926a263'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.894527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ae99e7304ab40079a0aeaaa57c0d143', 'request_id': 'req-e711c368-0756-4c41-8d86-68073926a263'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.909056 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3308/6555] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:04 2022] PUT /identity/v3/projects/d4cfad6a8d7b42a9b8c3f6c1673e7f24/users/5080bfb361be4f2f80120378a8274f76/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:11:04.912394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77b910-cef0-410d-a8f1-82808b93642d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:04.912722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77b910-cef0-410d-a8f1-82808b93642d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:04.912917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77b910-cef0-410d-a8f1-82808b93642d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:04.933667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] The token cache is being invalidate because project 8ae99e7304ab40079a0aeaaa57c0d143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:04.936182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.937935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:04.947109 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3248/6556] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:04 2022] DELETE /identity/v3/projects/8ae99e7304ab40079a0aeaaa57c0d143 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:04.950023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:04.953694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:04.983538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1b77b910-cef0-410d-a8f1-82808b93642d None None] MFA Rules not processed for user `5080bfb361be4f2f80120378a8274f76`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:04.987642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b77b910-cef0-410d-a8f1-82808b93642d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:05.050308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711c368-0756-4c41-8d86-68073926a263 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:05.120884 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3309/6557] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:05.131689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77b910-cef0-410d-a8f1-82808b93642d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:05.134636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b77b910-cef0-410d-a8f1-82808b93642d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:05.163499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:05.164818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:05.165420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:05.165847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] PATH_INFO: `/v3/users/e26bcb1d1ae64ed5bf6ab66b02c6ef0e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:05.167644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26bcb1d1ae64ed5bf6ab66b02c6ef0e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:05.170732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:05.253582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.267712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.268936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.270170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.316234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26bcb1d1ae64ed5bf6ab66b02c6ef0e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.318528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77b910-cef0-410d-a8f1-82808b93642d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:05.330322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd777ac-9480-4740-aee4-681394fcb592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:05.330899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd777ac-9480-4740-aee4-681394fcb592 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:05.331147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd777ac-9480-4740-aee4-681394fcb592 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:05.331376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd777ac-9480-4740-aee4-681394fcb592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:05.336991 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3249/6558] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:04 2022] DELETE /identity/v3/users/e26bcb1d1ae64ed5bf6ab66b02c6ef0e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:05.341297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7bd777ac-9480-4740-aee4-681394fcb592 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:05.357682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd777ac-9480-4740-aee4-681394fcb592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:05.359538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd777ac-9480-4740-aee4-681394fcb592 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:05.401289 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3310/6559] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:05.441852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:05.445217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:05.556520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b66308-b754-47f4-9a3e-4ead947e4daf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:05.574153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:05.575161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:05.575834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:05.576228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] PATH_INFO: `/v3/users/5080bfb361be4f2f80120378a8274f76` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:05.577662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5080bfb361be4f2f80120378a8274f76)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:05.580466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:05.664213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5080bfb361be4f2f80120378a8274f76'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.678613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5080bfb361be4f2f80120378a8274f76'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.679771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5080bfb361be4f2f80120378a8274f76'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.681367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5080bfb361be4f2f80120378a8274f76'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.708035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5080bfb361be4f2f80120378a8274f76'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:05.723234 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3250/6560] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:05 2022] DELETE /identity/v3/users/5080bfb361be4f2f80120378a8274f76 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:05.729082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b64de-a4c3-4cf8-986f-b64a4bd7dde0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:05.729587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b64de-a4c3-4cf8-986f-b64a4bd7dde0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:05.729674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b64de-a4c3-4cf8-986f-b64a4bd7dde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:05.750385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a10b64de-a4c3-4cf8-986f-b64a4bd7dde0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:05.751770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a10b64de-a4c3-4cf8-986f-b64a4bd7dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:05.816949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3311/6561] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:05.827361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:05.828824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:05.897705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefb42e-d23e-4d64-84fb-b640e0e33f12 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:05.901328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3bbce-74f7-485c-ad57-09a0c37331b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:05.901982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3bbce-74f7-485c-ad57-09a0c37331b7 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:05.902262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3bbce-74f7-485c-ad57-09a0c37331b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:05.902582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3bbce-74f7-485c-ad57-09a0c37331b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:05.912558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3bbce-74f7-485c-ad57-09a0c37331b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:05.914020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3bbce-74f7-485c-ad57-09a0c37331b7 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:05.929199 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3251/6562] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:11:05.976193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b64de-a4c3-4cf8-986f-b64a4bd7dde0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:05.977626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a10b64de-a4c3-4cf8-986f-b64a4bd7dde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:05.995504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b64de-a4c3-4cf8-986f-b64a4bd7dde0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.004278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.005220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.034234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.035375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] PATH_INFO: `/v3/projects/c5c3e48830974c83bd50a01110f0d3e4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.037704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c3e48830974c83bd50a01110f0d3e4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.044977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.139882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c3e48830974c83bd50a01110f0d3e4', 'request_id': 'req-c772e206-241a-46d5-ae92-0aa9228aac20'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.151066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c3e48830974c83bd50a01110f0d3e4', 'request_id': 'req-c772e206-241a-46d5-ae92-0aa9228aac20'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.160399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c3e48830974c83bd50a01110f0d3e4', 'request_id': 'req-c772e206-241a-46d5-ae92-0aa9228aac20'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.178394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] The token cache is being invalidate because project c5c3e48830974c83bd50a01110f0d3e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:06.182026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.182949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.186708 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3312/6563] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:05 2022] DELETE /identity/v3/projects/c5c3e48830974c83bd50a01110f0d3e4 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:06.193278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae934-a2ec-4fd4-9980-223a374911a0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.193572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae934-a2ec-4fd4-9980-223a374911a0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.193853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ae934-a2ec-4fd4-9980-223a374911a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.247616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-aa4ae934-a2ec-4fd4-9980-223a374911a0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:06.249883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aa4ae934-a2ec-4fd4-9980-223a374911a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:06.341760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.344097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:06.370985 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3252/6564] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:06.379418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252f19-f291-4d46-8829-2be6fe6d6cfb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.379753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252f19-f291-4d46-8829-2be6fe6d6cfb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.380278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93252f19-f291-4d46-8829-2be6fe6d6cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.425904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-93252f19-f291-4d46-8829-2be6fe6d6cfb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:06.427157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-93252f19-f291-4d46-8829-2be6fe6d6cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:06.453326 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3253/6565] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:06.458024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252f19-f291-4d46-8829-2be6fe6d6cfb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.470618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93252f19-f291-4d46-8829-2be6fe6d6cfb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.476777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5226669-6fad-454e-9936-69692c55bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.478104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226669-6fad-454e-9936-69692c55bbfd admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.480414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226669-6fad-454e-9936-69692c55bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.482024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5226669-6fad-454e-9936-69692c55bbfd admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.483144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5226669-6fad-454e-9936-69692c55bbfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:11:06.488207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5226669-6fad-454e-9936-69692c55bbfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.491400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5226669-6fad-454e-9936-69692c55bbfd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.495768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772e206-241a-46d5-ae92-0aa9228aac20 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.502661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.503794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.504298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.505119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] PATH_INFO: `/v3/projects/d4cfad6a8d7b42a9b8c3f6c1673e7f24` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.507020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4cfad6a8d7b42a9b8c3f6c1673e7f24)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.509218 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3254/6566] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:11:06.510199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.514543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5226669-6fad-454e-9936-69692c55bbfd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.527051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5226669-6fad-454e-9936-69692c55bbfd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.532247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07c41e-e713-4aa6-9b4c-5cebe0d8483e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.533053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07c41e-e713-4aa6-9b4c-5cebe0d8483e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.533643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07c41e-e713-4aa6-9b4c-5cebe0d8483e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.533989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07c41e-e713-4aa6-9b4c-5cebe0d8483e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.534791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07c41e-e713-4aa6-9b4c-5cebe0d8483e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.537247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07c41e-e713-4aa6-9b4c-5cebe0d8483e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.567427 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3255/6567] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:06 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:06.568013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4cfad6a8d7b42a9b8c3f6c1673e7f24', 'request_id': 'req-0e898302-468d-425a-a212-ba97d2253a2c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.572236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07c41e-e713-4aa6-9b4c-5cebe0d8483e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.577169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4cfad6a8d7b42a9b8c3f6c1673e7f24', 'request_id': 'req-0e898302-468d-425a-a212-ba97d2253a2c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.583509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4cfad6a8d7b42a9b8c3f6c1673e7f24', 'request_id': 'req-0e898302-468d-425a-a212-ba97d2253a2c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.596891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] The token cache is being invalidate because project d4cfad6a8d7b42a9b8c3f6c1673e7f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:06.597184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.598047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0e898302-468d-425a-a212-ba97d2253a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:06.599584 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3313/6568] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:06 2022] DELETE /identity/v3/projects/d4cfad6a8d7b42a9b8c3f6c1673e7f24 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:06.605646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52435a6e-0821-4ecb-85b6-f2073fea6262 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.606799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52435a6e-0821-4ecb-85b6-f2073fea6262 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.607086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52435a6e-0821-4ecb-85b6-f2073fea6262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.628809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-52435a6e-0821-4ecb-85b6-f2073fea6262 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:06.630049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-52435a6e-0821-4ecb-85b6-f2073fea6262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:06.643488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07c41e-e713-4aa6-9b4c-5cebe0d8483e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.648889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74040d49-4ddc-4930-9b30-75a953006300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.649600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74040d49-4ddc-4930-9b30-75a953006300 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.649884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74040d49-4ddc-4930-9b30-75a953006300 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.650158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74040d49-4ddc-4930-9b30-75a953006300 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.650879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74040d49-4ddc-4930-9b30-75a953006300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.652949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74040d49-4ddc-4930-9b30-75a953006300 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.675642 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3256/6569] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:06 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:06.679572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74040d49-4ddc-4930-9b30-75a953006300 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.681295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-74040d49-4ddc-4930-9b30-75a953006300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:06.695115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74040d49-4ddc-4930-9b30-75a953006300 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.700559 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3314/6570] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:06.701258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463936c-f57e-49f7-9e12-7ca7e3ac629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.701682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463936c-f57e-49f7-9e12-7ca7e3ac629a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.701958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463936c-f57e-49f7-9e12-7ca7e3ac629a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.702305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463936c-f57e-49f7-9e12-7ca7e3ac629a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.703165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463936c-f57e-49f7-9e12-7ca7e3ac629a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.704778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463936c-f57e-49f7-9e12-7ca7e3ac629a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.709168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d214a-aca3-49d7-8689-6e683ebd96f8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.709706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d214a-aca3-49d7-8689-6e683ebd96f8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.710193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d214a-aca3-49d7-8689-6e683ebd96f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.715953 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3257/6571] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:11:06.720035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463936c-f57e-49f7-9e12-7ca7e3ac629a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.730029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463936c-f57e-49f7-9e12-7ca7e3ac629a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.738878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa250b5-9d5b-4795-830e-a6f129c32250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.740253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa250b5-9d5b-4795-830e-a6f129c32250 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.740253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa250b5-9d5b-4795-830e-a6f129c32250 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.740253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa250b5-9d5b-4795-830e-a6f129c32250 admin admin] PATH_INFO: `/v3/projects/30a383e79d444c09a47b82a43e4a544e/users/18942d7dd62749deb66edd968770022b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.742019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f58d214a-aca3-49d7-8689-6e683ebd96f8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:06.743571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f58d214a-aca3-49d7-8689-6e683ebd96f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:06.756678 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3315/6572] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:06.760331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d214a-aca3-49d7-8689-6e683ebd96f8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.771468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d214a-aca3-49d7-8689-6e683ebd96f8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.775667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa250b5-9d5b-4795-830e-a6f129c32250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a383e79d444c09a47b82a43e4a544e, user_id=18942d7dd62749deb66edd968770022b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.776972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211547-4b74-4352-a141-a81f634fdb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.778259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211547-4b74-4352-a141-a81f634fdb28 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.778704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211547-4b74-4352-a141-a81f634fdb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.779076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211547-4b74-4352-a141-a81f634fdb28 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.779996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211547-4b74-4352-a141-a81f634fdb28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:11:06.780118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa250b5-9d5b-4795-830e-a6f129c32250 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.780503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211547-4b74-4352-a141-a81f634fdb28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.782374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211547-4b74-4352-a141-a81f634fdb28 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.800474 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3258/6573] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:06 2022] PUT /identity/v3/projects/30a383e79d444c09a47b82a43e4a544e/users/18942d7dd62749deb66edd968770022b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:11:06.806372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa250b5-9d5b-4795-830e-a6f129c32250 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.806541 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3316/6574] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:11:06.811216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211547-4b74-4352-a141-a81f634fdb28 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.824791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211547-4b74-4352-a141-a81f634fdb28 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.896970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa250b5-9d5b-4795-830e-a6f129c32250 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.900264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5be33-ab4d-46eb-bf7e-8cfbfb88ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.901388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5be33-ab4d-46eb-bf7e-8cfbfb88ed9a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.901974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5be33-ab4d-46eb-bf7e-8cfbfb88ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.902462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f5be33-ab4d-46eb-bf7e-8cfbfb88ed9a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.903041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38402063-d132-4499-b286-57b30692331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.903701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5be33-ab4d-46eb-bf7e-8cfbfb88ed9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.903840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38402063-d132-4499-b286-57b30692331c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.904057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38402063-d132-4499-b286-57b30692331c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.904334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38402063-d132-4499-b286-57b30692331c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.905499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38402063-d132-4499-b286-57b30692331c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.907215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38402063-d132-4499-b286-57b30692331c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.907803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f5be33-ab4d-46eb-bf7e-8cfbfb88ed9a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.920449 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3259/6575] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:11:06.925966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38402063-d132-4499-b286-57b30692331c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.942090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38402063-d132-4499-b286-57b30692331c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:06.950547 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3317/6576] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:06 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:11:06.954463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5be33-ab4d-46eb-bf7e-8cfbfb88ed9a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:06.969595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f970fe-a257-4d23-9885-2280c8bb6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:06.971129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f970fe-a257-4d23-9885-2280c8bb6cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:06.971411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f970fe-a257-4d23-9885-2280c8bb6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:06.972004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f970fe-a257-4d23-9885-2280c8bb6cb6 admin admin] PATH_INFO: `/v3/projects/30a383e79d444c09a47b82a43e4a544e/users/18942d7dd62749deb66edd968770022b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:06.975321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f970fe-a257-4d23-9885-2280c8bb6cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30a383e79d444c09a47b82a43e4a544e, user_id=18942d7dd62749deb66edd968770022b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:06.978027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f970fe-a257-4d23-9885-2280c8bb6cb6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:06.999581 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3260/6577] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:06 2022] PUT /identity/v3/projects/30a383e79d444c09a47b82a43e4a544e/users/18942d7dd62749deb66edd968770022b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:07.045951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f5be33-ab4d-46eb-bf7e-8cfbfb88ed9a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.087909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3d6ba-a18c-496c-a81c-b04605c9471d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.088232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3d6ba-a18c-496c-a81c-b04605c9471d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.088513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3d6ba-a18c-496c-a81c-b04605c9471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.124471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-01d3d6ba-a18c-496c-a81c-b04605c9471d None None] MFA Rules not processed for user `18942d7dd62749deb66edd968770022b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:07.125753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-01d3d6ba-a18c-496c-a81c-b04605c9471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:07.152003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74b0d1-88f2-4d10-ae75-f833c26678e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.152633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74b0d1-88f2-4d10-ae75-f833c26678e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.152935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74b0d1-88f2-4d10-ae75-f833c26678e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.153210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74b0d1-88f2-4d10-ae75-f833c26678e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.153899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74b0d1-88f2-4d10-ae75-f833c26678e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.155834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74b0d1-88f2-4d10-ae75-f833c26678e6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.193399 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3318/6578] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:06 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:07.197432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74b0d1-88f2-4d10-ae75-f833c26678e6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:07.220488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74b0d1-88f2-4d10-ae75-f833c26678e6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.237130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a9e5e-8ec7-4191-b7b3-4623586fcb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.237657 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3261/6579] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:07.238545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a9e5e-8ec7-4191-b7b3-4623586fcb8f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.238858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a9e5e-8ec7-4191-b7b3-4623586fcb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.239451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a9e5e-8ec7-4191-b7b3-4623586fcb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.241609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a9e5e-8ec7-4191-b7b3-4623586fcb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.242720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3d6ba-a18c-496c-a81c-b04605c9471d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:07.247694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a9e5e-8ec7-4191-b7b3-4623586fcb8f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.256162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3d6ba-a18c-496c-a81c-b04605c9471d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.264378 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3319/6580] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:07.266308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a9e5e-8ec7-4191-b7b3-4623586fcb8f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:07.277252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d67aa-a134-43b3-8dd8-e8a84230db70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.278776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d67aa-a134-43b3-8dd8-e8a84230db70 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.278906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a9e5e-8ec7-4191-b7b3-4623586fcb8f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.279336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d67aa-a134-43b3-8dd8-e8a84230db70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.279766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d67aa-a134-43b3-8dd8-e8a84230db70 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.282813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d67aa-a134-43b3-8dd8-e8a84230db70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.285080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8d67aa-a134-43b3-8dd8-e8a84230db70 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.285927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcfc1-d685-4a86-b97d-1b0b59684d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.286762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcfc1-d685-4a86-b97d-1b0b59684d52 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.287111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcfc1-d685-4a86-b97d-1b0b59684d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.287480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcfc1-d685-4a86-b97d-1b0b59684d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.288361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcfc1-d685-4a86-b97d-1b0b59684d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.290085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcfc1-d685-4a86-b97d-1b0b59684d52 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.305131 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3320/6581] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:11:07.318027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcfc1-d685-4a86-b97d-1b0b59684d52 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:07.331217 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3262/6582] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:07 2022] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:11:07.333200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d67aa-a134-43b3-8dd8-e8a84230db70 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:07.357659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcfc1-d685-4a86-b97d-1b0b59684d52 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.422658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d67aa-a134-43b3-8dd8-e8a84230db70 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.430386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98227d06-1daa-4729-8caa-f2535f5ca44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.431222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98227d06-1daa-4729-8caa-f2535f5ca44b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.431567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98227d06-1daa-4729-8caa-f2535f5ca44b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.431851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98227d06-1daa-4729-8caa-f2535f5ca44b admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.432578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98227d06-1daa-4729-8caa-f2535f5ca44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.438874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54953be9-f570-4282-b8fa-d3f428b4c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.440764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54953be9-f570-4282-b8fa-d3f428b4c595 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.441054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54953be9-f570-4282-b8fa-d3f428b4c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.441400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98227d06-1daa-4729-8caa-f2535f5ca44b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.441561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54953be9-f570-4282-b8fa-d3f428b4c595 admin admin] PATH_INFO: `/v3/projects/3a8e16658cc541b2976c9325d1558792/users/41ad4fbc224446efaf5ad85c8c87eeab/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.458641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54953be9-f570-4282-b8fa-d3f428b4c595 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8e16658cc541b2976c9325d1558792, user_id=41ad4fbc224446efaf5ad85c8c87eeab, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.463540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54953be9-f570-4282-b8fa-d3f428b4c595 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.476598 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3263/6583] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:07 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:07.480716 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3321/6584] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:07 2022] PUT /identity/v3/projects/3a8e16658cc541b2976c9325d1558792/users/41ad4fbc224446efaf5ad85c8c87eeab/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:07.482044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98227d06-1daa-4729-8caa-f2535f5ca44b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:07.487481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3731c-169e-4087-87b8-477d17005535 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.488161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3731c-169e-4087-87b8-477d17005535 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.488779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3731c-169e-4087-87b8-477d17005535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.499735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98227d06-1daa-4729-8caa-f2535f5ca44b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.529584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b8b3731c-169e-4087-87b8-477d17005535 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:07.533061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b8b3731c-169e-4087-87b8-477d17005535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:07.613517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec44bc9-dbf2-435f-adfe-2d598d034acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.615050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec44bc9-dbf2-435f-adfe-2d598d034acb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.615505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec44bc9-dbf2-435f-adfe-2d598d034acb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.615810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec44bc9-dbf2-435f-adfe-2d598d034acb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.617625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec44bc9-dbf2-435f-adfe-2d598d034acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.619694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec44bc9-dbf2-435f-adfe-2d598d034acb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.633247 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3264/6585] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:07.638306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec44bc9-dbf2-435f-adfe-2d598d034acb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:07.644483 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3322/6586] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:07.657762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3731c-169e-4087-87b8-477d17005535 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:07.660520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b8b3731c-169e-4087-87b8-477d17005535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:07.667543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec44bc9-dbf2-435f-adfe-2d598d034acb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.684199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748435af-8a8d-4418-938e-9d7d67cb2dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.685735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748435af-8a8d-4418-938e-9d7d67cb2dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.686561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748435af-8a8d-4418-938e-9d7d67cb2dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.687133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748435af-8a8d-4418-938e-9d7d67cb2dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.688137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748435af-8a8d-4418-938e-9d7d67cb2dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.690955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748435af-8a8d-4418-938e-9d7d67cb2dc7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.725561 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3265/6587] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:11:07.733376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748435af-8a8d-4418-938e-9d7d67cb2dc7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:07.749297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3731c-169e-4087-87b8-477d17005535 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.754386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e1400-be9a-4614-81c8-de7d6fd3ff2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.755481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e1400-be9a-4614-81c8-de7d6fd3ff2e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.755775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e1400-be9a-4614-81c8-de7d6fd3ff2e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.756474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e1400-be9a-4614-81c8-de7d6fd3ff2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.759347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748435af-8a8d-4418-938e-9d7d67cb2dc7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:07.767329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e1400-be9a-4614-81c8-de7d6fd3ff2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.769868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e1400-be9a-4614-81c8-de7d6fd3ff2e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.773558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26c15-3724-4f9d-899c-afd06e735ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:07.774717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26c15-3724-4f9d-899c-afd06e735ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.776441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26c15-3724-4f9d-899c-afd06e735ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.778957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26c15-3724-4f9d-899c-afd06e735ab0 admin admin] PATH_INFO: `/v3/projects/7eaef2dba8ea4b3c85f1fd06ee555ff4/users/cfec76a951ea442480906a66715cc56c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.781668 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3323/6588] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:07.836070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c26c15-3724-4f9d-899c-afd06e735ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eaef2dba8ea4b3c85f1fd06ee555ff4, user_id=cfec76a951ea442480906a66715cc56c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:07.839153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c26c15-3724-4f9d-899c-afd06e735ab0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:07.860772 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3266/6589] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:07 2022] PUT /identity/v3/projects/7eaef2dba8ea4b3c85f1fd06ee555ff4/users/cfec76a951ea442480906a66715cc56c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:07.870918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3111-53d3-49fd-b1b8-3a78040a481f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:07.871230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3111-53d3-49fd-b1b8-3a78040a481f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:07.871966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3111-53d3-49fd-b1b8-3a78040a481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:07.912236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d26c3111-53d3-49fd-b1b8-3a78040a481f None None] MFA Rules not processed for user `cfec76a951ea442480906a66715cc56c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:07.914550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d26c3111-53d3-49fd-b1b8-3a78040a481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:08.003213 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3324/6590] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:08.042104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26c15-3724-4f9d-899c-afd06e735ab0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:08.044432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a0c26c15-3724-4f9d-899c-afd06e735ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:08.121499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c26c15-3724-4f9d-899c-afd06e735ab0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:08.126478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b14f9-3bd3-49ad-8918-bac3321ea395 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:08.127190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b14f9-3bd3-49ad-8918-bac3321ea395 service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:08.127466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b14f9-3bd3-49ad-8918-bac3321ea395 service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:08.127744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b14f9-3bd3-49ad-8918-bac3321ea395 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:08.222405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b14f9-3bd3-49ad-8918-bac3321ea395 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:08.224470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091b14f9-3bd3-49ad-8918-bac3321ea395 service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:08.235523 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3267/6591] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:08.943498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c3111-53d3-49fd-b1b8-3a78040a481f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:08.970401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c3111-53d3-49fd-b1b8-3a78040a481f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:08.976131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:08.977169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:08.977775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:08.978314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:08.982819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:09.136185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:09.138448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:09.150326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b14f9-3bd3-49ad-8918-bac3321ea395 service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:09.185472 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3325/6592] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:09.249944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b14f9-3bd3-49ad-8918-bac3321ea395 service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:09.255544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:09.256522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:09.256797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:09.257213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] PATH_INFO: `/v3/users/18942d7dd62749deb66edd968770022b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:09.258554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18942d7dd62749deb66edd968770022b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:09.260841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:09.300764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:09.303641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:09.318120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18942d7dd62749deb66edd968770022b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:09.327601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18942d7dd62749deb66edd968770022b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:09.329300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18942d7dd62749deb66edd968770022b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:09.330349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18942d7dd62749deb66edd968770022b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:09.346522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49e29dc6-263c-4d05-8589-0e0fe2faf3f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18942d7dd62749deb66edd968770022b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:09.366154 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3268/6593] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:09 2022] DELETE /identity/v3/users/18942d7dd62749deb66edd968770022b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:09.372217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146e8c-f2ed-4929-865b-95abeae16edc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:09.372882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146e8c-f2ed-4929-865b-95abeae16edc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:09.372882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146e8c-f2ed-4929-865b-95abeae16edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:09.389831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af38dc-6ae3-4298-828c-04366dda09f8 service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:09.395081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7c146e8c-f2ed-4929-865b-95abeae16edc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:09.396575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7c146e8c-f2ed-4929-865b-95abeae16edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:09.454654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:09.455520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:09.456311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:09.456731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:09.459363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:09.477297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:09.479403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:09.482689 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3269/6594] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:09.493454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c146e8c-f2ed-4929-865b-95abeae16edc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:09.500108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7c146e8c-f2ed-4929-865b-95abeae16edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:09.505257 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3326/6595] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:11:09.517789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c146e8c-f2ed-4929-865b-95abeae16edc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:09.521469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6f5ab-c8be-4ba9-abad-f81c8b21eb3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:09.522118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6f5ab-c8be-4ba9-abad-f81c8b21eb3b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:09.522570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6f5ab-c8be-4ba9-abad-f81c8b21eb3b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:09.522882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6f5ab-c8be-4ba9-abad-f81c8b21eb3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:09.533490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6f5ab-c8be-4ba9-abad-f81c8b21eb3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:09.535127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6f5ab-c8be-4ba9-abad-f81c8b21eb3b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:09.568337 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3270/6596] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:09.904588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:09.906238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:09.932581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a19c7b6-def8-40c7-acbb-c0221778850f service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:09.938709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:09.939731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:09.940309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:09.940764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] PATH_INFO: `/v3/projects/30a383e79d444c09a47b82a43e4a544e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:09.942103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=30a383e79d444c09a47b82a43e4a544e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:09.944113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:09.994310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30a383e79d444c09a47b82a43e4a544e', 'request_id': 'req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.002113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30a383e79d444c09a47b82a43e4a544e', 'request_id': 'req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.008524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30a383e79d444c09a47b82a43e4a544e', 'request_id': 'req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.021854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] The token cache is being invalidate because project 30a383e79d444c09a47b82a43e4a544e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:10.022227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.023487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.025691 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3327/6597] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:09 2022] DELETE /identity/v3/projects/30a383e79d444c09a47b82a43e4a544e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:10.030339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6f5ab-c8be-4ba9-abad-f81c8b21eb3b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:10.040510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6f5ab-c8be-4ba9-abad-f81c8b21eb3b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:10.101041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:10.102229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:10.102517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:10.102794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] PATH_INFO: `/v3/users/cfec76a951ea442480906a66715cc56c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:10.104125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfec76a951ea442480906a66715cc56c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:10.107517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:10.156803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfec76a951ea442480906a66715cc56c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.166524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfec76a951ea442480906a66715cc56c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.167343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfec76a951ea442480906a66715cc56c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.168060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfec76a951ea442480906a66715cc56c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.185098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbd38906-2f3f-4dad-8396-d0dd3bac3185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfec76a951ea442480906a66715cc56c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:10.216154 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3271/6598] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:10 2022] DELETE /identity/v3/users/cfec76a951ea442480906a66715cc56c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:11.498091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:11.502220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:11.522842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925f10d-7b2f-4f21-b1ec-57f79a31f6ca admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:11.654885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:11.657060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:11.657871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:11.658707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] PATH_INFO: `/v3/projects/7eaef2dba8ea4b3c85f1fd06ee555ff4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:11.660634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eaef2dba8ea4b3c85f1fd06ee555ff4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:11.662912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:11.753826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eaef2dba8ea4b3c85f1fd06ee555ff4', 'request_id': 'req-79abe365-4efd-406b-b655-b47283b8eedb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:11.767878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eaef2dba8ea4b3c85f1fd06ee555ff4', 'request_id': 'req-79abe365-4efd-406b-b655-b47283b8eedb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:11.778842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eaef2dba8ea4b3c85f1fd06ee555ff4', 'request_id': 'req-79abe365-4efd-406b-b655-b47283b8eedb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:11.796966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] The token cache is being invalidate because project 7eaef2dba8ea4b3c85f1fd06ee555ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:11.797671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:11.800220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-79abe365-4efd-406b-b655-b47283b8eedb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:11.805808 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3328/6599] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:11 2022] DELETE /identity/v3/projects/7eaef2dba8ea4b3c85f1fd06ee555ff4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:11.811825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882debc9-5223-4700-a880-f504b7560eb4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:11.812540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882debc9-5223-4700-a880-f504b7560eb4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:11.812540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882debc9-5223-4700-a880-f504b7560eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:11.845301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-882debc9-5223-4700-a880-f504b7560eb4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:11.846505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-882debc9-5223-4700-a880-f504b7560eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:11.974815 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3272/6600] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:11.986681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c5ba4-bdcd-4270-bc4c-0b45b8c20228 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:11.988508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c5ba4-bdcd-4270-bc4c-0b45b8c20228 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:11.989551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c5ba4-bdcd-4270-bc4c-0b45b8c20228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:12.059221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-217c5ba4-bdcd-4270-bc4c-0b45b8c20228 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:12.060682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-217c5ba4-bdcd-4270-bc4c-0b45b8c20228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:12.085068 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3329/6601] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:12.094710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882debc9-5223-4700-a880-f504b7560eb4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:12.115836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882debc9-5223-4700-a880-f504b7560eb4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:12.126188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50618f-435d-4291-9d9d-82b0b22f12c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:12.126902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50618f-435d-4291-9d9d-82b0b22f12c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:12.127189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50618f-435d-4291-9d9d-82b0b22f12c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:12.127960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50618f-435d-4291-9d9d-82b0b22f12c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:12.128555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50618f-435d-4291-9d9d-82b0b22f12c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:11:12.129065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50618f-435d-4291-9d9d-82b0b22f12c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:12.131278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50618f-435d-4291-9d9d-82b0b22f12c1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:12.147899 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3273/6602] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:11:12.153304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c5ba4-bdcd-4270-bc4c-0b45b8c20228 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:12.168915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c5ba4-bdcd-4270-bc4c-0b45b8c20228 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:12.180848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784718-d6b5-454a-af12-ba7fa5635df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:12.182927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784718-d6b5-454a-af12-ba7fa5635df2 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:12.183384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784718-d6b5-454a-af12-ba7fa5635df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:12.184824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784718-d6b5-454a-af12-ba7fa5635df2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:12.185978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5784718-d6b5-454a-af12-ba7fa5635df2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:12.188754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5784718-d6b5-454a-af12-ba7fa5635df2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:12.241296 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3330/6603] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:12 2022] POST /identity/v3/projects => generated 359 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:11:12.245324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50618f-435d-4291-9d9d-82b0b22f12c1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:12.265339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50618f-435d-4291-9d9d-82b0b22f12c1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:12.373626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265f0de-9f51-44f2-94de-eb37f489e272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:12.374748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265f0de-9f51-44f2-94de-eb37f489e272 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:12.375229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265f0de-9f51-44f2-94de-eb37f489e272 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:12.375578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e265f0de-9f51-44f2-94de-eb37f489e272 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:12.376421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265f0de-9f51-44f2-94de-eb37f489e272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:12.378950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e265f0de-9f51-44f2-94de-eb37f489e272 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:12.402408 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3274/6604] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:12 2022] POST /identity/v3/users => generated 280 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:12.407028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784718-d6b5-454a-af12-ba7fa5635df2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:12.421025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784718-d6b5-454a-af12-ba7fa5635df2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:12.427111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e729a-7747-42a3-a0fe-9f471d3b0d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:12.428403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e729a-7747-42a3-a0fe-9f471d3b0d3c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:12.428931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e729a-7747-42a3-a0fe-9f471d3b0d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:12.429302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e729a-7747-42a3-a0fe-9f471d3b0d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:12.430097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e729a-7747-42a3-a0fe-9f471d3b0d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:12.432143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721e729a-7747-42a3-a0fe-9f471d3b0d3c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:12.444664 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3331/6605] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:12.452381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265f0de-9f51-44f2-94de-eb37f489e272 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:12.479571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e265f0de-9f51-44f2-94de-eb37f489e272 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:12.493366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a6444-1975-49cf-b876-a33f1a03aa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:12.494135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6444-1975-49cf-b876-a33f1a03aa73 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:12.495514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6444-1975-49cf-b876-a33f1a03aa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:12.495810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a6444-1975-49cf-b876-a33f1a03aa73 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:12.496622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a6444-1975-49cf-b876-a33f1a03aa73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:12.506858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a6444-1975-49cf-b876-a33f1a03aa73 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:12.513770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3275/6606] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:12.517905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e729a-7747-42a3-a0fe-9f471d3b0d3c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:12.532022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721e729a-7747-42a3-a0fe-9f471d3b0d3c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:12.540110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a232-1183-483d-83ca-d4ef2b6de5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:12.541855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a232-1183-483d-83ca-d4ef2b6de5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:12.542346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a232-1183-483d-83ca-d4ef2b6de5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:12.543063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54a232-1183-483d-83ca-d4ef2b6de5d9 admin admin] PATH_INFO: `/v3/projects/01784d0cb65f43b68ace58d0fccf3ebb/users/a1feefcca73f40fabff6c4c9b39d5dc3/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:12.575771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54a232-1183-483d-83ca-d4ef2b6de5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01784d0cb65f43b68ace58d0fccf3ebb, user_id=a1feefcca73f40fabff6c4c9b39d5dc3, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:12.579178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54a232-1183-483d-83ca-d4ef2b6de5d9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:12.601459 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3332/6607] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:12 2022] PUT /identity/v3/projects/01784d0cb65f43b68ace58d0fccf3ebb/users/a1feefcca73f40fabff6c4c9b39d5dc3/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:12.615964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b336a-464b-4f35-9474-fcec202da20f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:12.616628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b336a-464b-4f35-9474-fcec202da20f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:12.617510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b336a-464b-4f35-9474-fcec202da20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:12.667683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5d0b336a-464b-4f35-9474-fcec202da20f None None] MFA Rules not processed for user `a1feefcca73f40fabff6c4c9b39d5dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:12.669133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5d0b336a-464b-4f35-9474-fcec202da20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:12.871198 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3276/6608] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:12.885795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a232-1183-483d-83ca-d4ef2b6de5d9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:13.032363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54a232-1183-483d-83ca-d4ef2b6de5d9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:13.039994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:13.041404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:13.041962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:13.042666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] PATH_INFO: `/v3/users/a1feefcca73f40fabff6c4c9b39d5dc3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:13.046444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1feefcca73f40fabff6c4c9b39d5dc3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:13.050867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:13.189319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1feefcca73f40fabff6c4c9b39d5dc3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:13.207466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1feefcca73f40fabff6c4c9b39d5dc3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:13.208618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1feefcca73f40fabff6c4c9b39d5dc3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:13.209436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1feefcca73f40fabff6c4c9b39d5dc3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:13.225901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1feefcca73f40fabff6c4c9b39d5dc3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:13.267703 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3333/6609] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:12 2022] DELETE /identity/v3/users/a1feefcca73f40fabff6c4c9b39d5dc3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:13.269952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f46b-a2b0-4127-92cc-60d83fbe822a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:13.270685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f46b-a2b0-4127-92cc-60d83fbe822a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:13.270685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f46b-a2b0-4127-92cc-60d83fbe822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:13.297406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c5e3f46b-a2b0-4127-92cc-60d83fbe822a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:13.311496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c5e3f46b-a2b0-4127-92cc-60d83fbe822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:13.463445 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3277/6610] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:13.483140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:13.485487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:13.709654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad475be-2474-4593-8dec-6b4fead7e39a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:13.714115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540d66-372f-4ea2-9de5-28fc0d770e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:13.716149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540d66-372f-4ea2-9de5-28fc0d770e76 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:13.716666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540d66-372f-4ea2-9de5-28fc0d770e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:13.717159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47540d66-372f-4ea2-9de5-28fc0d770e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:13.730383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540d66-372f-4ea2-9de5-28fc0d770e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:13.733306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47540d66-372f-4ea2-9de5-28fc0d770e76 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:13.747291 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3334/6611] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:14.051744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98a9a7-da89-46cb-b484-0cc7457a3523 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:14.052335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98a9a7-da89-46cb-b484-0cc7457a3523 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:14.052335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98a9a7-da89-46cb-b484-0cc7457a3523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:14.092598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2e98a9a7-da89-46cb-b484-0cc7457a3523 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:14.100526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e98a9a7-da89-46cb-b484-0cc7457a3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:14.251311 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3278/6612] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:11:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:14.281314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540d66-372f-4ea2-9de5-28fc0d770e76 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:14.283092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-47540d66-372f-4ea2-9de5-28fc0d770e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:14.388509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47540d66-372f-4ea2-9de5-28fc0d770e76 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:14.395769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de49617-bb8d-4b7a-bdcb-bc8cae0b0568 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:14.396554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de49617-bb8d-4b7a-bdcb-bc8cae0b0568 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:14.396837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de49617-bb8d-4b7a-bdcb-bc8cae0b0568 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:14.397184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de49617-bb8d-4b7a-bdcb-bc8cae0b0568 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:14.409417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de49617-bb8d-4b7a-bdcb-bc8cae0b0568 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:14.411563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de49617-bb8d-4b7a-bdcb-bc8cae0b0568 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:14.424578 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3335/6613] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:11:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:14.803412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98a9a7-da89-46cb-b484-0cc7457a3523 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:14.806395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e98a9a7-da89-46cb-b484-0cc7457a3523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:14.836661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98a9a7-da89-46cb-b484-0cc7457a3523 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:14.850414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:14.853081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:14.853792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:14.856749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] PATH_INFO: `/v3/projects/01784d0cb65f43b68ace58d0fccf3ebb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:14.859849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01784d0cb65f43b68ace58d0fccf3ebb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:14.866911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:14.996268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01784d0cb65f43b68ace58d0fccf3ebb', 'request_id': 'req-0b942b73-c2d0-48b7-86f1-04930d3ac376'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:15.006015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01784d0cb65f43b68ace58d0fccf3ebb', 'request_id': 'req-0b942b73-c2d0-48b7-86f1-04930d3ac376'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:15.014291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01784d0cb65f43b68ace58d0fccf3ebb', 'request_id': 'req-0b942b73-c2d0-48b7-86f1-04930d3ac376'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:15.047239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] The token cache is being invalidate because project 01784d0cb65f43b68ace58d0fccf3ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:15.047799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:15.052691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0b942b73-c2d0-48b7-86f1-04930d3ac376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:15.052691 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3279/6614] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:14 2022] DELETE /identity/v3/projects/01784d0cb65f43b68ace58d0fccf3ebb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:15.056535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad162c1c-cbf6-4058-a379-32d619b70c79 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:15.057007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad162c1c-cbf6-4058-a379-32d619b70c79 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:15.057107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad162c1c-cbf6-4058-a379-32d619b70c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:15.130736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ad162c1c-cbf6-4058-a379-32d619b70c79 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:15.135709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ad162c1c-cbf6-4058-a379-32d619b70c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:15.319553 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3336/6615] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:15.327282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea70ea-d263-43df-95b9-6ad351388be0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:15.327572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea70ea-d263-43df-95b9-6ad351388be0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:15.328057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea70ea-d263-43df-95b9-6ad351388be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:15.398058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-39ea70ea-d263-43df-95b9-6ad351388be0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:15.416089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-39ea70ea-d263-43df-95b9-6ad351388be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:15.454197 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3280/6616] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:15.462476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad162c1c-cbf6-4058-a379-32d619b70c79 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:15.478334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad162c1c-cbf6-4058-a379-32d619b70c79 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:15.494550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a07213-e216-422a-9f33-498da97df94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:15.495422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a07213-e216-422a-9f33-498da97df94f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:15.496178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a07213-e216-422a-9f33-498da97df94f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:15.498353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a07213-e216-422a-9f33-498da97df94f admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:15.499103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a07213-e216-422a-9f33-498da97df94f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:11:15.499412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a07213-e216-422a-9f33-498da97df94f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:15.501318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a07213-e216-422a-9f33-498da97df94f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:15.567906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea70ea-d263-43df-95b9-6ad351388be0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:15.569165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3337/6617] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:11:15.591325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea70ea-d263-43df-95b9-6ad351388be0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:15.604827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799bda7-612b-4865-8b90-1edcb89fa9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:15.606665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799bda7-612b-4865-8b90-1edcb89fa9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:15.607340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799bda7-612b-4865-8b90-1edcb89fa9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:15.607881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799bda7-612b-4865-8b90-1edcb89fa9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:15.609165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799bda7-612b-4865-8b90-1edcb89fa9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:15.611515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799bda7-612b-4865-8b90-1edcb89fa9c8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:15.672862 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3281/6618] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:15 2022] POST /identity/v3/projects => generated 389 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:15.675318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a07213-e216-422a-9f33-498da97df94f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:15.689975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a07213-e216-422a-9f33-498da97df94f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:15.898554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50d3e7-b5c7-44bf-aa8e-6a5fc7a1096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:15.899352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50d3e7-b5c7-44bf-aa8e-6a5fc7a1096f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:15.899669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50d3e7-b5c7-44bf-aa8e-6a5fc7a1096f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:15.899979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50d3e7-b5c7-44bf-aa8e-6a5fc7a1096f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:15.901715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50d3e7-b5c7-44bf-aa8e-6a5fc7a1096f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:15.908362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50d3e7-b5c7-44bf-aa8e-6a5fc7a1096f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:15.954755 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3338/6619] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:15 2022] POST /identity/v3/users => generated 295 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:15.959748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799bda7-612b-4865-8b90-1edcb89fa9c8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:15.996027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799bda7-612b-4865-8b90-1edcb89fa9c8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:16.033063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f745be-d052-490a-8517-a0491fabc785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:16.038989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f745be-d052-490a-8517-a0491fabc785 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:16.039754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f745be-d052-490a-8517-a0491fabc785 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:16.042477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f745be-d052-490a-8517-a0491fabc785 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:16.044704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f745be-d052-490a-8517-a0491fabc785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:16.050578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f745be-d052-490a-8517-a0491fabc785 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:16.102288 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3282/6620] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:16.107162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50d3e7-b5c7-44bf-aa8e-6a5fc7a1096f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:16.124011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50d3e7-b5c7-44bf-aa8e-6a5fc7a1096f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:16.136559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47078388-e2a4-475f-bdfc-4277e8b141d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:16.138171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47078388-e2a4-475f-bdfc-4277e8b141d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:16.138686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47078388-e2a4-475f-bdfc-4277e8b141d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:16.139133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47078388-e2a4-475f-bdfc-4277e8b141d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:16.140231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47078388-e2a4-475f-bdfc-4277e8b141d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:16.146305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47078388-e2a4-475f-bdfc-4277e8b141d2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:16.176628 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3339/6621] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:16.182935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f745be-d052-490a-8517-a0491fabc785 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:16.222206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f745be-d052-490a-8517-a0491fabc785 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:16.238447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f2d1-e53b-470f-a734-cadd1465652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:16.241098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f2d1-e53b-470f-a734-cadd1465652e admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:16.241673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f2d1-e53b-470f-a734-cadd1465652e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:16.242041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511f2d1-e53b-470f-a734-cadd1465652e admin admin] PATH_INFO: `/v3/projects/4d829a26f8314d519804c5828067b178/users/0ef2cf69deab434f87e674834d89c3b4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:16.302039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511f2d1-e53b-470f-a734-cadd1465652e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d829a26f8314d519804c5828067b178, user_id=0ef2cf69deab434f87e674834d89c3b4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:16.306873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511f2d1-e53b-470f-a734-cadd1465652e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:16.344932 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3283/6622] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:16 2022] PUT /identity/v3/projects/4d829a26f8314d519804c5828067b178/users/0ef2cf69deab434f87e674834d89c3b4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:16.357301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db910d48-5963-40d9-9386-e9d88a8578c5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:16.357588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db910d48-5963-40d9-9386-e9d88a8578c5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:16.358374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db910d48-5963-40d9-9386-e9d88a8578c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:16.424340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-db910d48-5963-40d9-9386-e9d88a8578c5 None None] MFA Rules not processed for user `0ef2cf69deab434f87e674834d89c3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:16.428078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-db910d48-5963-40d9-9386-e9d88a8578c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:16.641573 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3340/6623] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:16.659354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f2d1-e53b-470f-a734-cadd1465652e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:16.953563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511f2d1-e53b-470f-a734-cadd1465652e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:16.969060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17527b3f-7156-445b-8c27-e5706fd0c70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:16.970433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17527b3f-7156-445b-8c27-e5706fd0c70e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:16.971307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17527b3f-7156-445b-8c27-e5706fd0c70e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:16.971307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17527b3f-7156-445b-8c27-e5706fd0c70e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:16.971616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17527b3f-7156-445b-8c27-e5706fd0c70e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:16.981004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17527b3f-7156-445b-8c27-e5706fd0c70e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:17.082392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db910d48-5963-40d9-9386-e9d88a8578c5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:17.083082 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3284/6624] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:16 2022] POST /identity/v3/projects => generated 389 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:17.104919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db910d48-5963-40d9-9386-e9d88a8578c5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:17.289788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722abab5-3a48-4d58-8a66-eff268e0bd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:17.291805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722abab5-3a48-4d58-8a66-eff268e0bd51 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:17.295122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722abab5-3a48-4d58-8a66-eff268e0bd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:17.296265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722abab5-3a48-4d58-8a66-eff268e0bd51 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:17.299189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722abab5-3a48-4d58-8a66-eff268e0bd51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:17.307633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722abab5-3a48-4d58-8a66-eff268e0bd51 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:17.404461 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3341/6625] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:17 2022] POST /identity/v3/users => generated 301 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:17.408170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17527b3f-7156-445b-8c27-e5706fd0c70e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:17.431053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17527b3f-7156-445b-8c27-e5706fd0c70e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:17.458097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63158cf0-13ac-4130-abc2-98b7f2e90adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:17.459680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63158cf0-13ac-4130-abc2-98b7f2e90adc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:17.460605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63158cf0-13ac-4130-abc2-98b7f2e90adc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:17.461562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63158cf0-13ac-4130-abc2-98b7f2e90adc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:17.463025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63158cf0-13ac-4130-abc2-98b7f2e90adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:17.466452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63158cf0-13ac-4130-abc2-98b7f2e90adc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:17.500035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3285/6626] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:17.510735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722abab5-3a48-4d58-8a66-eff268e0bd51 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:17.537089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722abab5-3a48-4d58-8a66-eff268e0bd51 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:17.571402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4b6b1-d06d-47cb-8539-ea7fbacc56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:17.575193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4b6b1-d06d-47cb-8539-ea7fbacc56f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:17.578758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4b6b1-d06d-47cb-8539-ea7fbacc56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:17.579136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4b6b1-d06d-47cb-8539-ea7fbacc56f9 admin admin] PATH_INFO: `/v3/projects/f7d1539c19974aeb8d165c736ec47025/users/f95c432c3c97447994986bf0625aa8e5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:17.657676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4b6b1-d06d-47cb-8539-ea7fbacc56f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d1539c19974aeb8d165c736ec47025, user_id=f95c432c3c97447994986bf0625aa8e5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:17.672164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4b6b1-d06d-47cb-8539-ea7fbacc56f9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:17.719877 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3342/6627] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:17 2022] PUT /identity/v3/projects/f7d1539c19974aeb8d165c736ec47025/users/f95c432c3c97447994986bf0625aa8e5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:17.725032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63158cf0-13ac-4130-abc2-98b7f2e90adc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:17.749635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63158cf0-13ac-4130-abc2-98b7f2e90adc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:17.972780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9c399-ca0f-41c9-a258-d349a1dff215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:17.975702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9c399-ca0f-41c9-a258-d349a1dff215 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:17.976340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9c399-ca0f-41c9-a258-d349a1dff215 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:17.976661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9c399-ca0f-41c9-a258-d349a1dff215 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:17.977899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9c399-ca0f-41c9-a258-d349a1dff215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:17.981089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9c399-ca0f-41c9-a258-d349a1dff215 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:18.041199 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3286/6628] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:18.046218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4b6b1-d06d-47cb-8539-ea7fbacc56f9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:18.072016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4b6b1-d06d-47cb-8539-ea7fbacc56f9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:18.082329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c362d53-3481-4b00-85af-c07a91ef122d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:18.083670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c362d53-3481-4b00-85af-c07a91ef122d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:18.084217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c362d53-3481-4b00-85af-c07a91ef122d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:18.084688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c362d53-3481-4b00-85af-c07a91ef122d admin admin] PATH_INFO: `/v3/projects/f7d1539c19974aeb8d165c736ec47025/users/f95c432c3c97447994986bf0625aa8e5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:18.087386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c362d53-3481-4b00-85af-c07a91ef122d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d1539c19974aeb8d165c736ec47025, user_id=f95c432c3c97447994986bf0625aa8e5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:18.110516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c362d53-3481-4b00-85af-c07a91ef122d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:18.142370 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3343/6629] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:18 2022] PUT /identity/v3/projects/f7d1539c19974aeb8d165c736ec47025/users/f95c432c3c97447994986bf0625aa8e5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:11:18.154335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c8de5-d4ba-491c-ab0a-eddf38bc1612 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:18.154878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c8de5-d4ba-491c-ab0a-eddf38bc1612 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:18.155364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c8de5-d4ba-491c-ab0a-eddf38bc1612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:18.243981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-416c8de5-d4ba-491c-ab0a-eddf38bc1612 None None] MFA Rules not processed for user `f95c432c3c97447994986bf0625aa8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:18.247778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-416c8de5-d4ba-491c-ab0a-eddf38bc1612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:18.470234 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3287/6630] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:18.521193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c362d53-3481-4b00-85af-c07a91ef122d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:18.524108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7c362d53-3481-4b00-85af-c07a91ef122d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:18.700333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c362d53-3481-4b00-85af-c07a91ef122d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:18.711424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83038f97-bdf5-4988-86f6-8e0e87224007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:18.712526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83038f97-bdf5-4988-86f6-8e0e87224007 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:18.713839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83038f97-bdf5-4988-86f6-8e0e87224007 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:18.713839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83038f97-bdf5-4988-86f6-8e0e87224007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:18.891271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83038f97-bdf5-4988-86f6-8e0e87224007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:18.894293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83038f97-bdf5-4988-86f6-8e0e87224007 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:18.926675 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3344/6631] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:22.020040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d7202-4362-49b7-97ea-df0f9bea9e34 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:22.022148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d7202-4362-49b7-97ea-df0f9bea9e34 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:22.022148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d7202-4362-49b7-97ea-df0f9bea9e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:22.123220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-899d7202-4362-49b7-97ea-df0f9bea9e34 None None] MFA Rules not processed for user `41ad4fbc224446efaf5ad85c8c87eeab`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:22.127648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-899d7202-4362-49b7-97ea-df0f9bea9e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:22.303741 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3288/6632] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:22.320861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83038f97-bdf5-4988-86f6-8e0e87224007 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:22.323782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-83038f97-bdf5-4988-86f6-8e0e87224007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:22.536546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83038f97-bdf5-4988-86f6-8e0e87224007 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:22.553014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd681a73-c7ac-4f0b-98cd-3e6779ef7ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:22.553910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd681a73-c7ac-4f0b-98cd-3e6779ef7ee6 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:22.554311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd681a73-c7ac-4f0b-98cd-3e6779ef7ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:22.554751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd681a73-c7ac-4f0b-98cd-3e6779ef7ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:22.578890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd681a73-c7ac-4f0b-98cd-3e6779ef7ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:22.580601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd681a73-c7ac-4f0b-98cd-3e6779ef7ee6 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:22.603754 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3345/6633] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:27.796156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d7202-4362-49b7-97ea-df0f9bea9e34 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:27.837414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d7202-4362-49b7-97ea-df0f9bea9e34 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:27.853526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614220-67db-4cd3-a6e8-aa627287076c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:27.856258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614220-67db-4cd3-a6e8-aa627287076c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:27.857959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614220-67db-4cd3-a6e8-aa627287076c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:27.858507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614220-67db-4cd3-a6e8-aa627287076c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:27.878795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e614220-67db-4cd3-a6e8-aa627287076c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:27.880744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e614220-67db-4cd3-a6e8-aa627287076c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:27.918839 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3289/6634] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:29.452402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec03a5-a4ea-4d65-a134-3db9073c4a0b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:29.453485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec03a5-a4ea-4d65-a134-3db9073c4a0b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:29.454004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec03a5-a4ea-4d65-a134-3db9073c4a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:29.727094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b4ec03a5-a4ea-4d65-a134-3db9073c4a0b None None] MFA Rules not processed for user `41ad4fbc224446efaf5ad85c8c87eeab`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:29.731464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b4ec03a5-a4ea-4d65-a134-3db9073c4a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:29.762284 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3346/6635] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:32.871531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614220-67db-4cd3-a6e8-aa627287076c service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:32.957065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614220-67db-4cd3-a6e8-aa627287076c service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:32.961980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:32.962978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:32.963273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:32.963550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] PATH_INFO: `/v3/users/0ef2cf69deab434f87e674834d89c3b4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:32.965792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ef2cf69deab434f87e674834d89c3b4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:32.968016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:33.025618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ef2cf69deab434f87e674834d89c3b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.035402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ef2cf69deab434f87e674834d89c3b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.036226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ef2cf69deab434f87e674834d89c3b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.036848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ef2cf69deab434f87e674834d89c3b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.052428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ef2cf69deab434f87e674834d89c3b4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.068622 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3290/6636] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:32 2022] DELETE /identity/v3/users/0ef2cf69deab434f87e674834d89c3b4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:11:33.072978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c124b41-12e9-4800-b841-e34d155adb01 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:33.073575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c124b41-12e9-4800-b841-e34d155adb01 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:33.074189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c124b41-12e9-4800-b841-e34d155adb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:33.096421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8c124b41-12e9-4800-b841-e34d155adb01 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:33.098056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8c124b41-12e9-4800-b841-e34d155adb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:33.184253 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3347/6637] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:33.196163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:33.197688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:33.271744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6c11b-f0d3-4a58-a428-ef7359eac910 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:33.276851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e5083-f807-40f0-ab36-a18924b3d243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:33.277931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e5083-f807-40f0-ab36-a18924b3d243 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:33.278215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e5083-f807-40f0-ab36-a18924b3d243 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:33.278679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e5083-f807-40f0-ab36-a18924b3d243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:33.291849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e5083-f807-40f0-ab36-a18924b3d243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:33.293762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372e5083-f807-40f0-ab36-a18924b3d243 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:33.305150 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3291/6638] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:33.506363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c124b41-12e9-4800-b841-e34d155adb01 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:33.509031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8c124b41-12e9-4800-b841-e34d155adb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:33.524405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c124b41-12e9-4800-b841-e34d155adb01 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:33.530335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:33.531313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:33.532000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:33.532513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] PATH_INFO: `/v3/projects/4d829a26f8314d519804c5828067b178` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:33.535176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d829a26f8314d519804c5828067b178)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:33.539906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:33.601426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d829a26f8314d519804c5828067b178', 'request_id': 'req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.617284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d829a26f8314d519804c5828067b178', 'request_id': 'req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.630492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d829a26f8314d519804c5828067b178', 'request_id': 'req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.644663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] The token cache is being invalidate because project 4d829a26f8314d519804c5828067b178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:33.645237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.646099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.647988 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3348/6639] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:33 2022] DELETE /identity/v3/projects/4d829a26f8314d519804c5828067b178 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:33.651784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e5083-f807-40f0-ab36-a18924b3d243 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:33.662506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e5083-f807-40f0-ab36-a18924b3d243 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:33.738159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:33.739108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:33.739875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:33.740220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] PATH_INFO: `/v3/users/f95c432c3c97447994986bf0625aa8e5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:33.741851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f95c432c3c97447994986bf0625aa8e5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:33.744531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:33.825352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f95c432c3c97447994986bf0625aa8e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.841717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f95c432c3c97447994986bf0625aa8e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.842827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f95c432c3c97447994986bf0625aa8e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.843881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f95c432c3c97447994986bf0625aa8e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.861977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-89213ef5-0e15-40d8-9a9a-85a0115419e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f95c432c3c97447994986bf0625aa8e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:33.879033 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3292/6640] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:33 2022] DELETE /identity/v3/users/f95c432c3c97447994986bf0625aa8e5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:34.947686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:34.949895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:35.001312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54b4c0-c09e-4914-8dde-0867d3ef9ba6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:35.135079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:35.135879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.136228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.136504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] PATH_INFO: `/v3/projects/f7d1539c19974aeb8d165c736ec47025` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.138372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d1539c19974aeb8d165c736ec47025)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:35.141700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:35.215856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d1539c19974aeb8d165c736ec47025', 'request_id': 'req-a25d7522-473d-40ff-8e63-0a3d4543dcd3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:35.230822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d1539c19974aeb8d165c736ec47025', 'request_id': 'req-a25d7522-473d-40ff-8e63-0a3d4543dcd3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:35.241899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d1539c19974aeb8d165c736ec47025', 'request_id': 'req-a25d7522-473d-40ff-8e63-0a3d4543dcd3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:35.257351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] The token cache is being invalidate because project f7d1539c19974aeb8d165c736ec47025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:35.258013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:35.258889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a25d7522-473d-40ff-8e63-0a3d4543dcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:35.260704 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3349/6641] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:34 2022] DELETE /identity/v3/projects/f7d1539c19974aeb8d165c736ec47025 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:35.265943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956cfa1-e095-4a95-af20-a3fbf1d775dc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.266991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956cfa1-e095-4a95-af20-a3fbf1d775dc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.267731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956cfa1-e095-4a95-af20-a3fbf1d775dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.300949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4956cfa1-e095-4a95-af20-a3fbf1d775dc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:35.302352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4956cfa1-e095-4a95-af20-a3fbf1d775dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:35.397249 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3293/6642] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:35.399441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bb54e-fd3b-4049-a257-3c11efc0933e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.400090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bb54e-fd3b-4049-a257-3c11efc0933e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.400576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bb54e-fd3b-4049-a257-3c11efc0933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.447476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-711bb54e-fd3b-4049-a257-3c11efc0933e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:35.452223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-711bb54e-fd3b-4049-a257-3c11efc0933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:35.490803 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3350/6643] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:35.494990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956cfa1-e095-4a95-af20-a3fbf1d775dc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:35.508331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956cfa1-e095-4a95-af20-a3fbf1d775dc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:35.520005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b518a-f7f3-4444-9077-c8a244c7f645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:35.520928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b518a-f7f3-4444-9077-c8a244c7f645 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.521246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b518a-f7f3-4444-9077-c8a244c7f645 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.521714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b518a-f7f3-4444-9077-c8a244c7f645 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.523300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b518a-f7f3-4444-9077-c8a244c7f645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:11:35.523631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b518a-f7f3-4444-9077-c8a244c7f645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:35.525360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b518a-f7f3-4444-9077-c8a244c7f645 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:35.544500 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3294/6644] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:11:35.546009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bb54e-fd3b-4049-a257-3c11efc0933e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:35.557999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bb54e-fd3b-4049-a257-3c11efc0933e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:35.565078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9374ab2-5a17-4d6c-8061-cea764a34be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:35.565877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374ab2-5a17-4d6c-8061-cea764a34be0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.566550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374ab2-5a17-4d6c-8061-cea764a34be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.566550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374ab2-5a17-4d6c-8061-cea764a34be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.567130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9374ab2-5a17-4d6c-8061-cea764a34be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:35.569137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9374ab2-5a17-4d6c-8061-cea764a34be0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:35.598304 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3351/6645] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:35 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:35.602467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b518a-f7f3-4444-9077-c8a244c7f645 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:35.613728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b518a-f7f3-4444-9077-c8a244c7f645 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:35.685961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4fdeb-a7f8-4b3b-b574-393c15f8e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:35.687082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4fdeb-a7f8-4b3b-b574-393c15f8e9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.687555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4fdeb-a7f8-4b3b-b574-393c15f8e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.688155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4fdeb-a7f8-4b3b-b574-393c15f8e9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.689184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4fdeb-a7f8-4b3b-b574-393c15f8e9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:35.692055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4fdeb-a7f8-4b3b-b574-393c15f8e9e5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:35.724284 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3295/6646] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:35 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:11:35.728967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9374ab2-5a17-4d6c-8061-cea764a34be0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:35.741518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9374ab2-5a17-4d6c-8061-cea764a34be0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:35.767810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555fe85-8045-4907-aba1-77a7a40f8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:35.768752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555fe85-8045-4907-aba1-77a7a40f8f8e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.768869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555fe85-8045-4907-aba1-77a7a40f8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.769142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555fe85-8045-4907-aba1-77a7a40f8f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.769885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555fe85-8045-4907-aba1-77a7a40f8f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:35.775022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555fe85-8045-4907-aba1-77a7a40f8f8e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:35.792472 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3352/6647] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:35.797394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4fdeb-a7f8-4b3b-b574-393c15f8e9e5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:35.812870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4fdeb-a7f8-4b3b-b574-393c15f8e9e5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:35.819898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325de12-eaef-426c-8efd-9259fd27f191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:35.822098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325de12-eaef-426c-8efd-9259fd27f191 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.822641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325de12-eaef-426c-8efd-9259fd27f191 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.824860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325de12-eaef-426c-8efd-9259fd27f191 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.826935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325de12-eaef-426c-8efd-9259fd27f191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:35.829496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325de12-eaef-426c-8efd-9259fd27f191 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:35.851078 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3296/6648] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:35.852425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555fe85-8045-4907-aba1-77a7a40f8f8e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:35.866200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555fe85-8045-4907-aba1-77a7a40f8f8e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:35.881415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2f47c-67c4-47e4-9db7-c62f2d0cab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:35.882579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f47c-67c4-47e4-9db7-c62f2d0cab93 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.882931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f47c-67c4-47e4-9db7-c62f2d0cab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.883701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2f47c-67c4-47e4-9db7-c62f2d0cab93 admin admin] PATH_INFO: `/v3/projects/97c44f9a2b954b4b9e94bc8c85a3ad8f/users/2c6cdf53037c480f9d00659c639cb59c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.906598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2f47c-67c4-47e4-9db7-c62f2d0cab93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c44f9a2b954b4b9e94bc8c85a3ad8f, user_id=2c6cdf53037c480f9d00659c639cb59c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:35.910815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2f47c-67c4-47e4-9db7-c62f2d0cab93 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:35.936971 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3353/6649] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:35 2022] PUT /identity/v3/projects/97c44f9a2b954b4b9e94bc8c85a3ad8f/users/2c6cdf53037c480f9d00659c639cb59c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:35.949163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84460-45fa-47fd-9562-bfd4ff061a76 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:35.949536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84460-45fa-47fd-9562-bfd4ff061a76 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:35.949831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d84460-45fa-47fd-9562-bfd4ff061a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:35.979301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-91d84460-45fa-47fd-9562-bfd4ff061a76 None None] MFA Rules not processed for user `2c6cdf53037c480f9d00659c639cb59c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:35.980609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-91d84460-45fa-47fd-9562-bfd4ff061a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:36.062161 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3297/6650] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:36.079498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2f47c-67c4-47e4-9db7-c62f2d0cab93 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:36.082770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-40e2f47c-67c4-47e4-9db7-c62f2d0cab93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:36.168004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2f47c-67c4-47e4-9db7-c62f2d0cab93 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:36.173427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9522f0-1c0c-4158-9b95-d60986168321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:36.175279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9522f0-1c0c-4158-9b95-d60986168321 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:36.175726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9522f0-1c0c-4158-9b95-d60986168321 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:36.176196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9522f0-1c0c-4158-9b95-d60986168321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:36.189302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9522f0-1c0c-4158-9b95-d60986168321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:36.191651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9522f0-1c0c-4158-9b95-d60986168321 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:36.204562 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3354/6651] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:36.264437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d84460-45fa-47fd-9562-bfd4ff061a76 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:36.342059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d84460-45fa-47fd-9562-bfd4ff061a76 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:36.347156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:36.348208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:36.348491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:36.348768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] PATH_INFO: `/v3/users/2c6cdf53037c480f9d00659c639cb59c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:36.350102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c6cdf53037c480f9d00659c639cb59c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:36.352139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:36.415243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c6cdf53037c480f9d00659c639cb59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:36.426263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c6cdf53037c480f9d00659c639cb59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:36.427311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c6cdf53037c480f9d00659c639cb59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:36.428281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c6cdf53037c480f9d00659c639cb59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:36.446314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c6cdf53037c480f9d00659c639cb59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:36.462056 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3298/6652] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:36 2022] DELETE /identity/v3/users/2c6cdf53037c480f9d00659c639cb59c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:36.466853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ba98a-2634-410d-9a35-d5d915712884 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:36.467166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ba98a-2634-410d-9a35-d5d915712884 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:36.467410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ba98a-2634-410d-9a35-d5d915712884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:36.493019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1a7ba98a-2634-410d-9a35-d5d915712884 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:36.496531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1a7ba98a-2634-410d-9a35-d5d915712884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:36.578997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3355/6653] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:36.591064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:36.592740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:36.657874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e0eb-5ead-45aa-b72b-087536305cea admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:36.661867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a6cb8-6f03-4d83-a382-d707e1c0f464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:36.662524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a6cb8-6f03-4d83-a382-d707e1c0f464 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:36.662880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a6cb8-6f03-4d83-a382-d707e1c0f464 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:36.663083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a6cb8-6f03-4d83-a382-d707e1c0f464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:36.673677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a6cb8-6f03-4d83-a382-d707e1c0f464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:36.675146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a6cb8-6f03-4d83-a382-d707e1c0f464 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:36.686895 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3299/6654] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:36.966236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2af05e-1594-4fd0-b8cf-d7c981c9cfb2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:36.966413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2af05e-1594-4fd0-b8cf-d7c981c9cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:36.966579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2af05e-1594-4fd0-b8cf-d7c981c9cfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:36.988999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9a2af05e-1594-4fd0-b8cf-d7c981c9cfb2 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:36.990385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9a2af05e-1594-4fd0-b8cf-d7c981c9cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:37.063344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a6cb8-6f03-4d83-a382-d707e1c0f464 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:37.064978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-420a6cb8-6f03-4d83-a382-d707e1c0f464 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:37.081396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a6cb8-6f03-4d83-a382-d707e1c0f464 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:37.082291 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3356/6655] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:11:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:37.089708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:37.090740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:37.091178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:37.091559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] PATH_INFO: `/v3/projects/97c44f9a2b954b4b9e94bc8c85a3ad8f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:37.096890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c44f9a2b954b4b9e94bc8c85a3ad8f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:37.099591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:37.114577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2af05e-1594-4fd0-b8cf-d7c981c9cfb2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:37.117020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9a2af05e-1594-4fd0-b8cf-d7c981c9cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:37.176527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c44f9a2b954b4b9e94bc8c85a3ad8f', 'request_id': 'req-5e172d63-9121-4e9d-9c84-c71c21fab210'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:37.186492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c44f9a2b954b4b9e94bc8c85a3ad8f', 'request_id': 'req-5e172d63-9121-4e9d-9c84-c71c21fab210'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:37.194674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c44f9a2b954b4b9e94bc8c85a3ad8f', 'request_id': 'req-5e172d63-9121-4e9d-9c84-c71c21fab210'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:37.207247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2af05e-1594-4fd0-b8cf-d7c981c9cfb2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:37.223050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] The token cache is being invalidate because project 97c44f9a2b954b4b9e94bc8c85a3ad8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:37.223435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:37.224652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5e172d63-9121-4e9d-9c84-c71c21fab210 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:37.227227 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3300/6656] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:37 2022] DELETE /identity/v3/projects/97c44f9a2b954b4b9e94bc8c85a3ad8f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:11:37.233911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a20a43-8301-4e33-a5c0-705283966b59 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:37.233911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a20a43-8301-4e33-a5c0-705283966b59 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:37.234213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a20a43-8301-4e33-a5c0-705283966b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:37.279632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-82a20a43-8301-4e33-a5c0-705283966b59 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:37.281736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-82a20a43-8301-4e33-a5c0-705283966b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:37.331042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e4175-bad6-4941-9655-5823850b179c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:37.331844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e4175-bad6-4941-9655-5823850b179c service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:37.332167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e4175-bad6-4941-9655-5823850b179c service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:37.332504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e4175-bad6-4941-9655-5823850b179c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:37.342422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-416e4175-bad6-4941-9655-5823850b179c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:37.414422 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3301/6657] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:37.419941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911577d-970d-4a44-adc6-21ebd6aa095c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:37.420562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911577d-970d-4a44-adc6-21ebd6aa095c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:37.421034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911577d-970d-4a44-adc6-21ebd6aa095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:37.429973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e4175-bad6-4941-9655-5823850b179c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:37.432371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e4175-bad6-4941-9655-5823850b179c service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:37.445337 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3357/6658] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:11:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:11:37.470487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f911577d-970d-4a44-adc6-21ebd6aa095c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:37.471730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f911577d-970d-4a44-adc6-21ebd6aa095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:37.487929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e4175-bad6-4941-9655-5823850b179c service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:37.490509 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3302/6659] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:37.509722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e4175-bad6-4941-9655-5823850b179c service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:37.520245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5b9cb-b4a5-4e3f-9b8e-7a7426ef6981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:37.521034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5b9cb-b4a5-4e3f-9b8e-7a7426ef6981 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:37.521460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5b9cb-b4a5-4e3f-9b8e-7a7426ef6981 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:37.522229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5b9cb-b4a5-4e3f-9b8e-7a7426ef6981 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:37.523370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5b9cb-b4a5-4e3f-9b8e-7a7426ef6981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:11:37.523832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5b9cb-b4a5-4e3f-9b8e-7a7426ef6981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:37.528472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5b9cb-b4a5-4e3f-9b8e-7a7426ef6981 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:37.551420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911577d-970d-4a44-adc6-21ebd6aa095c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:37.578006 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3358/6660] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:11:37.581263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911577d-970d-4a44-adc6-21ebd6aa095c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:37.589086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298b714-e125-45e3-b6f1-51767cf7676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:37.589970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298b714-e125-45e3-b6f1-51767cf7676e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:37.590331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298b714-e125-45e3-b6f1-51767cf7676e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:37.591014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298b714-e125-45e3-b6f1-51767cf7676e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:37.592077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298b714-e125-45e3-b6f1-51767cf7676e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:37.595591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298b714-e125-45e3-b6f1-51767cf7676e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:37.636989 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3303/6661] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:37 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:37.642798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5b9cb-b4a5-4e3f-9b8e-7a7426ef6981 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:37.663019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5b9cb-b4a5-4e3f-9b8e-7a7426ef6981 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:37.835836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0a7b-a9c9-40e4-a0db-88cd905a1c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:37.841030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0a7b-a9c9-40e4-a0db-88cd905a1c20 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:37.841963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0a7b-a9c9-40e4-a0db-88cd905a1c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:37.842335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b0a7b-a9c9-40e4-a0db-88cd905a1c20 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:37.843768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b0a7b-a9c9-40e4-a0db-88cd905a1c20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:37.846942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b0a7b-a9c9-40e4-a0db-88cd905a1c20 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:37.880830 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3359/6662] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:37 2022] POST /identity/v3/users => generated 287 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:37.885035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298b714-e125-45e3-b6f1-51767cf7676e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:37.905446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298b714-e125-45e3-b6f1-51767cf7676e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:37.918090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b98d0e-d151-4a94-ad3d-b2269b365c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:37.922804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98d0e-d151-4a94-ad3d-b2269b365c8e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:37.923836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98d0e-d151-4a94-ad3d-b2269b365c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:37.924159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b98d0e-d151-4a94-ad3d-b2269b365c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:37.926064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b98d0e-d151-4a94-ad3d-b2269b365c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:37.930847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b98d0e-d151-4a94-ad3d-b2269b365c8e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:37.966772 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3304/6663] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:37.970960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0a7b-a9c9-40e4-a0db-88cd905a1c20 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:38.000244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b0a7b-a9c9-40e4-a0db-88cd905a1c20 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:38.018723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da457bac-070f-4ba1-afc4-5189f4a0418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:38.019488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da457bac-070f-4ba1-afc4-5189f4a0418d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:38.019776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da457bac-070f-4ba1-afc4-5189f4a0418d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:38.020859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da457bac-070f-4ba1-afc4-5189f4a0418d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:38.021684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da457bac-070f-4ba1-afc4-5189f4a0418d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:38.023360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da457bac-070f-4ba1-afc4-5189f4a0418d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:38.068639 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3360/6664] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:38.075259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b98d0e-d151-4a94-ad3d-b2269b365c8e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:38.088952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b98d0e-d151-4a94-ad3d-b2269b365c8e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:38.105562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12aeb9f-a84a-4ae9-a011-35e7e72b527c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:38.107838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12aeb9f-a84a-4ae9-a011-35e7e72b527c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:38.109479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12aeb9f-a84a-4ae9-a011-35e7e72b527c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:38.109737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12aeb9f-a84a-4ae9-a011-35e7e72b527c admin admin] PATH_INFO: `/v3/projects/09d56daeb4b041c4af32eb9a7b9e7893/users/017d91a429e3419fbb12006b0dc2ae43/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:38.132164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12aeb9f-a84a-4ae9-a011-35e7e72b527c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d56daeb4b041c4af32eb9a7b9e7893, user_id=017d91a429e3419fbb12006b0dc2ae43, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:38.137379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12aeb9f-a84a-4ae9-a011-35e7e72b527c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:38.160445 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3305/6665] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:38 2022] PUT /identity/v3/projects/09d56daeb4b041c4af32eb9a7b9e7893/users/017d91a429e3419fbb12006b0dc2ae43/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:38.172252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f3ddf-9717-4a8d-af40-1dde4c492bec None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:38.172782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f3ddf-9717-4a8d-af40-1dde4c492bec None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:38.172976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f3ddf-9717-4a8d-af40-1dde4c492bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:38.228998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5f0f3ddf-9717-4a8d-af40-1dde4c492bec None None] MFA Rules not processed for user `017d91a429e3419fbb12006b0dc2ae43`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:38.232226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5f0f3ddf-9717-4a8d-af40-1dde4c492bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:38.400603 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3361/6666] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:38.414192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12aeb9f-a84a-4ae9-a011-35e7e72b527c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:38.416325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e12aeb9f-a84a-4ae9-a011-35e7e72b527c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:38.488947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12aeb9f-a84a-4ae9-a011-35e7e72b527c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:38.493026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89799924-c151-41c1-b782-cf4c7fc8422d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:38.493764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89799924-c151-41c1-b782-cf4c7fc8422d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:38.494114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89799924-c151-41c1-b782-cf4c7fc8422d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:38.494418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89799924-c151-41c1-b782-cf4c7fc8422d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:38.504354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89799924-c151-41c1-b782-cf4c7fc8422d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:38.505899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89799924-c151-41c1-b782-cf4c7fc8422d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:38.516134 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3306/6667] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:54.091735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f3ddf-9717-4a8d-af40-1dde4c492bec None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:54.255513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f3ddf-9717-4a8d-af40-1dde4c492bec None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:54.262231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:54.263200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:54.268075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:54.268075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] PATH_INFO: `/v3/users/017d91a429e3419fbb12006b0dc2ae43` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:54.268075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=017d91a429e3419fbb12006b0dc2ae43)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:54.268075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:54.368792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017d91a429e3419fbb12006b0dc2ae43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:54.376023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017d91a429e3419fbb12006b0dc2ae43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:54.376763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017d91a429e3419fbb12006b0dc2ae43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:54.377424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017d91a429e3419fbb12006b0dc2ae43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:54.385863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017d91a429e3419fbb12006b0dc2ae43'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:54.404920 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3362/6668] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:54 2022] DELETE /identity/v3/users/017d91a429e3419fbb12006b0dc2ae43 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:54.410235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31460227-3b21-4d88-833e-6d9ee5b2d43b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:54.410796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31460227-3b21-4d88-833e-6d9ee5b2d43b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:54.410893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31460227-3b21-4d88-833e-6d9ee5b2d43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:54.429807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-31460227-3b21-4d88-833e-6d9ee5b2d43b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:54.431247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-31460227-3b21-4d88-833e-6d9ee5b2d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:54.503516 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3307/6669] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:54.520256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:54.520256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:54.606067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455db4d4-02d6-42b3-ab07-310429691675 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:54.609844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9f64b-16a4-4312-9633-25498ff5271a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:54.610625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9f64b-16a4-4312-9633-25498ff5271a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:54.610912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9f64b-16a4-4312-9633-25498ff5271a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:54.611191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9f64b-16a4-4312-9633-25498ff5271a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:54.620584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9f64b-16a4-4312-9633-25498ff5271a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:54.622034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9f64b-16a4-4312-9633-25498ff5271a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:54.631659 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3363/6670] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:54.919781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31460227-3b21-4d88-833e-6d9ee5b2d43b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:54.921710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-31460227-3b21-4d88-833e-6d9ee5b2d43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:54.954885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31460227-3b21-4d88-833e-6d9ee5b2d43b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:54.973899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:54.974462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:54.974750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:54.976098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] PATH_INFO: `/v3/projects/09d56daeb4b041c4af32eb9a7b9e7893` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:54.977830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d56daeb4b041c4af32eb9a7b9e7893)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:54.981112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:55.069411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d56daeb4b041c4af32eb9a7b9e7893', 'request_id': 'req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:55.079789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d56daeb4b041c4af32eb9a7b9e7893', 'request_id': 'req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:55.098995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d56daeb4b041c4af32eb9a7b9e7893', 'request_id': 'req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:55.132503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] The token cache is being invalidate because project 09d56daeb4b041c4af32eb9a7b9e7893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:55.132811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:55.133468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26e0ff44-d71a-41bf-a7b2-4286cf9b836c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:55.135858 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3308/6671] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:54 2022] DELETE /identity/v3/projects/09d56daeb4b041c4af32eb9a7b9e7893 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:55.140666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201801-5874-4a8b-9a37-1a617441157e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:55.141197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201801-5874-4a8b-9a37-1a617441157e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:55.141197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33201801-5874-4a8b-9a37-1a617441157e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:55.168599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-33201801-5874-4a8b-9a37-1a617441157e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:55.170168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-33201801-5874-4a8b-9a37-1a617441157e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:55.338185 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3364/6672] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:11:55.347977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb925-83dc-4fa0-b996-76a0cce3ed43 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:55.348311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb925-83dc-4fa0-b996-76a0cce3ed43 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:55.348600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fb925-83dc-4fa0-b996-76a0cce3ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:55.393065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-620fb925-83dc-4fa0-b996-76a0cce3ed43 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:55.395105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-620fb925-83dc-4fa0-b996-76a0cce3ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:55.408014 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3309/6673] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:55.413593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33201801-5874-4a8b-9a37-1a617441157e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:55.426429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33201801-5874-4a8b-9a37-1a617441157e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:55.436469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442ad4-20cb-4d79-9166-e3d1f37c98e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:55.436469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442ad4-20cb-4d79-9166-e3d1f37c98e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:55.436469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442ad4-20cb-4d79-9166-e3d1f37c98e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:55.436469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2442ad4-20cb-4d79-9166-e3d1f37c98e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:55.437859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2442ad4-20cb-4d79-9166-e3d1f37c98e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:11:55.437859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2442ad4-20cb-4d79-9166-e3d1f37c98e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:55.438888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2442ad4-20cb-4d79-9166-e3d1f37c98e8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:55.470345 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3365/6674] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:11:55.471650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fb925-83dc-4fa0-b996-76a0cce3ed43 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:55.485613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fb925-83dc-4fa0-b996-76a0cce3ed43 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:55.493989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc377f6b-4496-4889-b572-41b420e8673c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:55.495303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc377f6b-4496-4889-b572-41b420e8673c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:55.495857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc377f6b-4496-4889-b572-41b420e8673c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:55.496907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc377f6b-4496-4889-b572-41b420e8673c admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:55.497682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc377f6b-4496-4889-b572-41b420e8673c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:55.499911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc377f6b-4496-4889-b572-41b420e8673c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:55.537560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442ad4-20cb-4d79-9166-e3d1f37c98e8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:55.546387 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3310/6675] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:11:55 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:55.559483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2442ad4-20cb-4d79-9166-e3d1f37c98e8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:55.665137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b672d9-53a9-476e-8ddf-c591cfc77b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:55.666442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b672d9-53a9-476e-8ddf-c591cfc77b2b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:55.668079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b672d9-53a9-476e-8ddf-c591cfc77b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:55.669765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b672d9-53a9-476e-8ddf-c591cfc77b2b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:55.670611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b672d9-53a9-476e-8ddf-c591cfc77b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:55.673624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b672d9-53a9-476e-8ddf-c591cfc77b2b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:55.714983 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3366/6676] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:11:55 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:11:55.719907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc377f6b-4496-4889-b572-41b420e8673c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:55.731734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc377f6b-4496-4889-b572-41b420e8673c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:55.738078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c8fbd-8e05-43d9-84fc-6a216aa79866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:55.740837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c8fbd-8e05-43d9-84fc-6a216aa79866 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:55.740837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c8fbd-8e05-43d9-84fc-6a216aa79866 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:55.740837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c8fbd-8e05-43d9-84fc-6a216aa79866 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:55.740837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c8fbd-8e05-43d9-84fc-6a216aa79866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:55.742721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58c8fbd-8e05-43d9-84fc-6a216aa79866 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:55.765982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3311/6677] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:55.767219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b672d9-53a9-476e-8ddf-c591cfc77b2b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:55.779307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b672d9-53a9-476e-8ddf-c591cfc77b2b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:55.784371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24f45f-77f5-409a-a790-c0c924d8a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:55.785165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f45f-77f5-409a-a790-c0c924d8a6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:55.785457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f45f-77f5-409a-a790-c0c924d8a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:55.785736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24f45f-77f5-409a-a790-c0c924d8a6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:55.786572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24f45f-77f5-409a-a790-c0c924d8a6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:55.789229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24f45f-77f5-409a-a790-c0c924d8a6b6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:55.807518 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3367/6678] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:11:55.812560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c8fbd-8e05-43d9-84fc-6a216aa79866 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:55.823899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c8fbd-8e05-43d9-84fc-6a216aa79866 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:55.829078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639588ef-2ade-4c77-b25e-752a9d2e335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:55.829970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639588ef-2ade-4c77-b25e-752a9d2e335d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:55.830369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639588ef-2ade-4c77-b25e-752a9d2e335d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:55.830800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639588ef-2ade-4c77-b25e-752a9d2e335d admin admin] PATH_INFO: `/v3/projects/0386f864b38b404f8fa94d7578c95c16/users/259d208f1dd1422a9bda8a7495c47f3a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:55.851703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639588ef-2ade-4c77-b25e-752a9d2e335d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0386f864b38b404f8fa94d7578c95c16, user_id=259d208f1dd1422a9bda8a7495c47f3a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:55.855028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639588ef-2ade-4c77-b25e-752a9d2e335d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:55.870184 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3312/6679] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:11:55 2022] PUT /identity/v3/projects/0386f864b38b404f8fa94d7578c95c16/users/259d208f1dd1422a9bda8a7495c47f3a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:55.880179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79524a5d-ecc5-46ad-a4e7-e846fcdc5359 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:55.880470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79524a5d-ecc5-46ad-a4e7-e846fcdc5359 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:55.880753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79524a5d-ecc5-46ad-a4e7-e846fcdc5359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:55.908881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-79524a5d-ecc5-46ad-a4e7-e846fcdc5359 None None] MFA Rules not processed for user `259d208f1dd1422a9bda8a7495c47f3a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:55.910222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-79524a5d-ecc5-46ad-a4e7-e846fcdc5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:55.985224 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3368/6680] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:55.999321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639588ef-2ade-4c77-b25e-752a9d2e335d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:56.001325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-639588ef-2ade-4c77-b25e-752a9d2e335d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:56.106828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639588ef-2ade-4c77-b25e-752a9d2e335d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:56.113632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a410-e32b-4ac2-822c-2870ad736e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:56.114626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a410-e32b-4ac2-822c-2870ad736e8a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:56.115311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a410-e32b-4ac2-822c-2870ad736e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:56.115797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a410-e32b-4ac2-822c-2870ad736e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:56.128712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a410-e32b-4ac2-822c-2870ad736e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:56.131255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a410-e32b-4ac2-822c-2870ad736e8a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:56.147195 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3313/6681] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:58.239429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79524a5d-ecc5-46ad-a4e7-e846fcdc5359 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:58.241012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-79524a5d-ecc5-46ad-a4e7-e846fcdc5359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:58.356188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79524a5d-ecc5-46ad-a4e7-e846fcdc5359 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:58.362763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:58.363909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:58.364462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:58.364989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] PATH_INFO: `/v3/users/c310d2bcd40347e58581d3f154347203` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:58.366310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c310d2bcd40347e58581d3f154347203)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:58.368694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:58.429092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c310d2bcd40347e58581d3f154347203'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:58.437570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c310d2bcd40347e58581d3f154347203'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:58.438545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c310d2bcd40347e58581d3f154347203'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:58.439333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c310d2bcd40347e58581d3f154347203'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:58.449512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c310d2bcd40347e58581d3f154347203'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:58.471161 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3369/6682] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:58 2022] DELETE /identity/v3/users/c310d2bcd40347e58581d3f154347203 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:58.475471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787f091-141e-482e-acc3-827af0805e7d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:58.476041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787f091-141e-482e-acc3-827af0805e7d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:58.476163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787f091-141e-482e-acc3-827af0805e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:58.497230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3787f091-141e-482e-acc3-827af0805e7d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:58.498414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3787f091-141e-482e-acc3-827af0805e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:58.578322 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3314/6683] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:58.589190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:58.591094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:58.678116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676f59f-a5f2-4d06-886e-d5626ddde33a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:58.682504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f21c5-0e4d-4110-ba4c-165966982183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:58.683193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f21c5-0e4d-4110-ba4c-165966982183 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:58.683461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f21c5-0e4d-4110-ba4c-165966982183 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:58.683743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f21c5-0e4d-4110-ba4c-165966982183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:58.697404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f21c5-0e4d-4110-ba4c-165966982183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:58.698612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f21c5-0e4d-4110-ba4c-165966982183 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:58.711143 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3370/6684] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:11:59.038337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787f091-141e-482e-acc3-827af0805e7d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:59.039890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3787f091-141e-482e-acc3-827af0805e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:59.055164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787f091-141e-482e-acc3-827af0805e7d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:59.061131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:59.062178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:59.062469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:59.062788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] PATH_INFO: `/v3/projects/ace57cacf3a9435eb4945655bd3a6c57` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:59.064133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace57cacf3a9435eb4945655bd3a6c57)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:59.066307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:59.129591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace57cacf3a9435eb4945655bd3a6c57', 'request_id': 'req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.139185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace57cacf3a9435eb4945655bd3a6c57', 'request_id': 'req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.146878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace57cacf3a9435eb4945655bd3a6c57', 'request_id': 'req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.160534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] The token cache is being invalidate because project ace57cacf3a9435eb4945655bd3a6c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:59.160829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.161502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.163337 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3315/6685] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:59 2022] DELETE /identity/v3/projects/ace57cacf3a9435eb4945655bd3a6c57 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:59.168439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f21c5-0e4d-4110-ba4c-165966982183 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:59.180461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f21c5-0e4d-4110-ba4c-165966982183 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:59.244129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:59.245269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:59.245589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:59.246105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] PATH_INFO: `/v3/users/ae3287541dee46208134c2309a18293d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:59.247418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae3287541dee46208134c2309a18293d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:59.250071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:59.337026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae3287541dee46208134c2309a18293d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.346073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae3287541dee46208134c2309a18293d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.346948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae3287541dee46208134c2309a18293d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.347722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae3287541dee46208134c2309a18293d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.357731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6cf01289-dee0-41e2-b5c6-3de7bb59efd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae3287541dee46208134c2309a18293d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.379270 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3371/6686] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:11:59 2022] DELETE /identity/v3/users/ae3287541dee46208134c2309a18293d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:59.586603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:59.589785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:59.609848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aff16f-d1b8-42d4-8288-88adf3d47ca4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:11:59.703326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:11:59.704676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:59.705599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:59.706415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] PATH_INFO: `/v3/projects/ec20d4256a9946e38d5f5ca4871295da` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:59.708063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec20d4256a9946e38d5f5ca4871295da)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:11:59.710814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:11:59.778995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec20d4256a9946e38d5f5ca4871295da', 'request_id': 'req-962e7956-ce5f-4593-b9d9-6bd6eed35f64'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.792075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec20d4256a9946e38d5f5ca4871295da', 'request_id': 'req-962e7956-ce5f-4593-b9d9-6bd6eed35f64'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.800822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec20d4256a9946e38d5f5ca4871295da', 'request_id': 'req-962e7956-ce5f-4593-b9d9-6bd6eed35f64'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.830890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] The token cache is being invalidate because project ec20d4256a9946e38d5f5ca4871295da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:11:59.831375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.832124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-962e7956-ce5f-4593-b9d9-6bd6eed35f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:11:59.836257 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3316/6687] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:11:59 2022] DELETE /identity/v3/projects/ec20d4256a9946e38d5f5ca4871295da => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:11:59.838908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8b7bd-589c-4e45-b4ac-8f5808c8c94e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:59.839607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8b7bd-589c-4e45-b4ac-8f5808c8c94e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:59.839607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8b7bd-589c-4e45-b4ac-8f5808c8c94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:59.861181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-14b8b7bd-589c-4e45-b4ac-8f5808c8c94e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:59.862575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-14b8b7bd-589c-4e45-b4ac-8f5808c8c94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:59.928705 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3372/6688] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:59.938831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150df7da-e358-4aa5-9fb0-402ad2d7345b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:11:59.939356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150df7da-e358-4aa5-9fb0-402ad2d7345b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:11:59.939554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150df7da-e358-4aa5-9fb0-402ad2d7345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:11:59.967142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-150df7da-e358-4aa5-9fb0-402ad2d7345b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:11:59.968718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-150df7da-e358-4aa5-9fb0-402ad2d7345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:11:59.983473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8b7bd-589c-4e45-b4ac-8f5808c8c94e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:11:59.984131 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3317/6689] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:11:59.995943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8b7bd-589c-4e45-b4ac-8f5808c8c94e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:00.001991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07c167-7724-4f53-9b43-d9456b3189dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:00.002699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c167-7724-4f53-9b43-d9456b3189dd admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:00.003008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c167-7724-4f53-9b43-d9456b3189dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:00.003301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb07c167-7724-4f53-9b43-d9456b3189dd admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:00.004175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07c167-7724-4f53-9b43-d9456b3189dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:00.004533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07c167-7724-4f53-9b43-d9456b3189dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:00.006908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb07c167-7724-4f53-9b43-d9456b3189dd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:00.031552 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3373/6690] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:00.036606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150df7da-e358-4aa5-9fb0-402ad2d7345b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:00.052877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150df7da-e358-4aa5-9fb0-402ad2d7345b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:00.058451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141e862-6cfe-456a-9b82-3d273096eae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:00.059307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141e862-6cfe-456a-9b82-3d273096eae3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:00.060067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141e862-6cfe-456a-9b82-3d273096eae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:00.060416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141e862-6cfe-456a-9b82-3d273096eae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:00.061174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141e862-6cfe-456a-9b82-3d273096eae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:00.063143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141e862-6cfe-456a-9b82-3d273096eae3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:00.102582 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3318/6691] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:00 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:00.104520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07c167-7724-4f53-9b43-d9456b3189dd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:00.116616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb07c167-7724-4f53-9b43-d9456b3189dd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:00.183965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5a5cb-16b4-45fa-9d4a-8a60ebdaf8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:00.185192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a5cb-16b4-45fa-9d4a-8a60ebdaf8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:00.185413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a5cb-16b4-45fa-9d4a-8a60ebdaf8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:00.185782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5a5cb-16b4-45fa-9d4a-8a60ebdaf8c4 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:00.186759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5a5cb-16b4-45fa-9d4a-8a60ebdaf8c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:00.188822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5a5cb-16b4-45fa-9d4a-8a60ebdaf8c4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:00.210500 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3374/6692] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:00 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:00.214894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141e862-6cfe-456a-9b82-3d273096eae3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:00.229564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141e862-6cfe-456a-9b82-3d273096eae3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:00.241644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364dd75-59ba-4fde-ae47-5b54060036db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:00.242377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364dd75-59ba-4fde-ae47-5b54060036db admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:00.242641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364dd75-59ba-4fde-ae47-5b54060036db admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:00.243148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364dd75-59ba-4fde-ae47-5b54060036db admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:00.244388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364dd75-59ba-4fde-ae47-5b54060036db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:00.246291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364dd75-59ba-4fde-ae47-5b54060036db admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:00.264844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5a5cb-16b4-45fa-9d4a-8a60ebdaf8c4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:00.270133 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3319/6693] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:00.276982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5a5cb-16b4-45fa-9d4a-8a60ebdaf8c4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:00.282287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe3495-2d63-46d3-b050-2b4fbcc014e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:00.282943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3495-2d63-46d3-b050-2b4fbcc014e5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:00.283298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3495-2d63-46d3-b050-2b4fbcc014e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:00.283644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe3495-2d63-46d3-b050-2b4fbcc014e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:00.284749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe3495-2d63-46d3-b050-2b4fbcc014e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:00.286278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe3495-2d63-46d3-b050-2b4fbcc014e5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:00.297675 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3375/6694] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:00.302331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364dd75-59ba-4fde-ae47-5b54060036db admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:00.319751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364dd75-59ba-4fde-ae47-5b54060036db admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:00.332412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99d190-dd47-48d4-94ad-6d8b75f51957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:00.333988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d190-dd47-48d4-94ad-6d8b75f51957 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:00.334275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d190-dd47-48d4-94ad-6d8b75f51957 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:00.334552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae99d190-dd47-48d4-94ad-6d8b75f51957 admin admin] PATH_INFO: `/v3/projects/e94e4cb4734c45cda0a7786af1e5a34e/users/97b0caf3705c4cdb83b4dbd7452aad81/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:00.367113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99d190-dd47-48d4-94ad-6d8b75f51957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94e4cb4734c45cda0a7786af1e5a34e, user_id=97b0caf3705c4cdb83b4dbd7452aad81, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:00.370857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae99d190-dd47-48d4-94ad-6d8b75f51957 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:00.418136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a7f9-7f5d-4b6d-98f1-8de4711e667b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:00.418433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a7f9-7f5d-4b6d-98f1-8de4711e667b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:00.418866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a7f9-7f5d-4b6d-98f1-8de4711e667b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:00.427727 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3320/6695] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:00 2022] PUT /identity/v3/projects/e94e4cb4734c45cda0a7786af1e5a34e/users/97b0caf3705c4cdb83b4dbd7452aad81/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:00.462429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5953a7f9-7f5d-4b6d-98f1-8de4711e667b None None] MFA Rules not processed for user `97b0caf3705c4cdb83b4dbd7452aad81`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:00.465491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5953a7f9-7f5d-4b6d-98f1-8de4711e667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:00.565000 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3376/6696] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:00.581468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99d190-dd47-48d4-94ad-6d8b75f51957 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:00.586069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ae99d190-dd47-48d4-94ad-6d8b75f51957 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:00.685760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae99d190-dd47-48d4-94ad-6d8b75f51957 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:00.696844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc5089-0b9e-4fae-8cc1-0d68b612a2a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:00.698626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5089-0b9e-4fae-8cc1-0d68b612a2a7 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:00.699082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5089-0b9e-4fae-8cc1-0d68b612a2a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:00.699512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc5089-0b9e-4fae-8cc1-0d68b612a2a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:00.717638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5089-0b9e-4fae-8cc1-0d68b612a2a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:00.729360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc5089-0b9e-4fae-8cc1-0d68b612a2a7 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:00.789017 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3321/6697] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:03.440216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953a7f9-7f5d-4b6d-98f1-8de4711e667b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:03.443580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5953a7f9-7f5d-4b6d-98f1-8de4711e667b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:03.578130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953a7f9-7f5d-4b6d-98f1-8de4711e667b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:03.587627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:03.590939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:03.590939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:03.590939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] PATH_INFO: `/v3/users/102a4f93d75c4f219861f8e3e119fd82` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:03.594847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102a4f93d75c4f219861f8e3e119fd82)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:03.597555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:03.732217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102a4f93d75c4f219861f8e3e119fd82'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:03.740670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102a4f93d75c4f219861f8e3e119fd82'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:03.741613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102a4f93d75c4f219861f8e3e119fd82'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:03.742392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102a4f93d75c4f219861f8e3e119fd82'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:03.766080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dc53320d-f2cb-4f69-a4f1-dddda44a7bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102a4f93d75c4f219861f8e3e119fd82'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:03.798413 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3377/6698] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:03 2022] DELETE /identity/v3/users/102a4f93d75c4f219861f8e3e119fd82 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:05.077539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc5089-0b9e-4fae-8cc1-0d68b612a2a7 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:05.101135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc5089-0b9e-4fae-8cc1-0d68b612a2a7 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:05.335034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:05.336740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:05.337263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:05.337817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] PATH_INFO: `/v3/projects/5b7d84d914bd48ddbd9e2801f8a9c616` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:05.340490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b7d84d914bd48ddbd9e2801f8a9c616)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:05.343306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:05.540571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b7d84d914bd48ddbd9e2801f8a9c616', 'request_id': 'req-f3d9795e-5825-4bac-a5b1-68ece4c165be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:05.557885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b7d84d914bd48ddbd9e2801f8a9c616', 'request_id': 'req-f3d9795e-5825-4bac-a5b1-68ece4c165be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:05.569300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b7d84d914bd48ddbd9e2801f8a9c616', 'request_id': 'req-f3d9795e-5825-4bac-a5b1-68ece4c165be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:05.595969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] The token cache is being invalidate because project 5b7d84d914bd48ddbd9e2801f8a9c616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:05.596428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:05.597357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3d9795e-5825-4bac-a5b1-68ece4c165be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:05.599319 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3322/6699] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:05 2022] DELETE /identity/v3/projects/5b7d84d914bd48ddbd9e2801f8a9c616 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:05.604616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d4e80-cc7d-4e6f-9b49-2971517bd75f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:05.605485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d4e80-cc7d-4e6f-9b49-2971517bd75f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:05.605937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d4e80-cc7d-4e6f-9b49-2971517bd75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:05.645997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-374d4e80-cc7d-4e6f-9b49-2971517bd75f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:05.648282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-374d4e80-cc7d-4e6f-9b49-2971517bd75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:05.765950 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3378/6700] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:05.773758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9997787-b41e-4f4b-95f4-e3255e3962ef None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:05.774214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9997787-b41e-4f4b-95f4-e3255e3962ef None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:05.774503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9997787-b41e-4f4b-95f4-e3255e3962ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:05.809113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c9997787-b41e-4f4b-95f4-e3255e3962ef None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:05.810613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c9997787-b41e-4f4b-95f4-e3255e3962ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:05.832765 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3323/6701] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:05.836984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d4e80-cc7d-4e6f-9b49-2971517bd75f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:05.848513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d4e80-cc7d-4e6f-9b49-2971517bd75f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:05.864938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f34fc-e4db-48c4-862b-45d7e1607c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:05.865741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f34fc-e4db-48c4-862b-45d7e1607c80 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:05.866044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f34fc-e4db-48c4-862b-45d7e1607c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:05.866328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f34fc-e4db-48c4-862b-45d7e1607c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:05.867063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f34fc-e4db-48c4-862b-45d7e1607c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:05.867729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f34fc-e4db-48c4-862b-45d7e1607c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:05.871841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f34fc-e4db-48c4-862b-45d7e1607c80 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:05.906309 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3379/6702] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:05.910738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9997787-b41e-4f4b-95f4-e3255e3962ef None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:05.922631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9997787-b41e-4f4b-95f4-e3255e3962ef None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:05.938970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333910bd-77d8-417b-9751-42269200dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:05.939744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333910bd-77d8-417b-9751-42269200dd5e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:05.940451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333910bd-77d8-417b-9751-42269200dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:05.940874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333910bd-77d8-417b-9751-42269200dd5e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:05.941693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333910bd-77d8-417b-9751-42269200dd5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:05.943884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333910bd-77d8-417b-9751-42269200dd5e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:06.006555 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3324/6703] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:05 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:06.011032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f34fc-e4db-48c4-862b-45d7e1607c80 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:06.026846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f34fc-e4db-48c4-862b-45d7e1607c80 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:06.128960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972b14-d03d-46b7-8db3-df70884d5d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:06.129649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972b14-d03d-46b7-8db3-df70884d5d7e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:06.130073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972b14-d03d-46b7-8db3-df70884d5d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:06.130347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972b14-d03d-46b7-8db3-df70884d5d7e admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:06.131291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82972b14-d03d-46b7-8db3-df70884d5d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:06.133284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82972b14-d03d-46b7-8db3-df70884d5d7e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:06.163693 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3380/6704] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:06 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:06.167759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333910bd-77d8-417b-9751-42269200dd5e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:06.180161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333910bd-77d8-417b-9751-42269200dd5e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:06.187127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02662672-3cc5-4525-b2be-fc73c8cfb379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:06.187765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02662672-3cc5-4525-b2be-fc73c8cfb379 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:06.188146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02662672-3cc5-4525-b2be-fc73c8cfb379 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:06.188526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02662672-3cc5-4525-b2be-fc73c8cfb379 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:06.189410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02662672-3cc5-4525-b2be-fc73c8cfb379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:06.191795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02662672-3cc5-4525-b2be-fc73c8cfb379 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:06.214415 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3325/6705] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:06.218188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972b14-d03d-46b7-8db3-df70884d5d7e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:06.230519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972b14-d03d-46b7-8db3-df70884d5d7e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:06.237097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db17e9-286e-4e68-955d-7adea5dc68bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:06.238437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db17e9-286e-4e68-955d-7adea5dc68bc admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:06.238702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db17e9-286e-4e68-955d-7adea5dc68bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:06.238988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db17e9-286e-4e68-955d-7adea5dc68bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:06.240694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db17e9-286e-4e68-955d-7adea5dc68bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:06.242981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db17e9-286e-4e68-955d-7adea5dc68bc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:06.257446 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3381/6706] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:06.261199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02662672-3cc5-4525-b2be-fc73c8cfb379 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:06.274022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02662672-3cc5-4525-b2be-fc73c8cfb379 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:06.280006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84905d9-4b86-43cc-96fc-689f3207db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:06.280882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84905d9-4b86-43cc-96fc-689f3207db6f admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:06.281283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84905d9-4b86-43cc-96fc-689f3207db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:06.281623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84905d9-4b86-43cc-96fc-689f3207db6f admin admin] PATH_INFO: `/v3/projects/8747c12da8b847a294543693794b28e0/users/a603c6c4220f41f8810f54cb2b55bab1/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:06.303338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84905d9-4b86-43cc-96fc-689f3207db6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8747c12da8b847a294543693794b28e0, user_id=a603c6c4220f41f8810f54cb2b55bab1, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:06.307229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84905d9-4b86-43cc-96fc-689f3207db6f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:06.327607 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3326/6707] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:06 2022] PUT /identity/v3/projects/8747c12da8b847a294543693794b28e0/users/a603c6c4220f41f8810f54cb2b55bab1/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:06.334197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541466aa-4170-44e0-9314-3bef1e452f90 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:06.334579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541466aa-4170-44e0-9314-3bef1e452f90 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:06.335136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541466aa-4170-44e0-9314-3bef1e452f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:06.360226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-541466aa-4170-44e0-9314-3bef1e452f90 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:06.362625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-541466aa-4170-44e0-9314-3bef1e452f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:06.476500 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3382/6708] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:06.490647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84905d9-4b86-43cc-96fc-689f3207db6f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:06.493622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f84905d9-4b86-43cc-96fc-689f3207db6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:06.648824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84905d9-4b86-43cc-96fc-689f3207db6f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:06.653213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b10728-8544-477b-b502-eea03a8dcdf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:06.654170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b10728-8544-477b-b502-eea03a8dcdf4 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:06.654453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b10728-8544-477b-b502-eea03a8dcdf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:06.654726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b10728-8544-477b-b502-eea03a8dcdf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:06.669476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b10728-8544-477b-b502-eea03a8dcdf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:06.671163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b10728-8544-477b-b502-eea03a8dcdf4 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:06.687984 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3327/6709] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:08.843788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837c950-39c1-444a-ae2d-dc852a8e424e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:08.844680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837c950-39c1-444a-ae2d-dc852a8e424e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:08.845118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837c950-39c1-444a-ae2d-dc852a8e424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:08.892657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6837c950-39c1-444a-ae2d-dc852a8e424e None None] MFA Rules not processed for user `a603c6c4220f41f8810f54cb2b55bab1`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:08.894322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6837c950-39c1-444a-ae2d-dc852a8e424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:09.063545 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3383/6710] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:09.862716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b10728-8544-477b-b502-eea03a8dcdf4 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:09.882260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b10728-8544-477b-b502-eea03a8dcdf4 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:09.898103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:09.899382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:09.899867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:09.900354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] PATH_INFO: `/v3/users/a603c6c4220f41f8810f54cb2b55bab1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:09.901997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a603c6c4220f41f8810f54cb2b55bab1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:09.905478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:10.016857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a603c6c4220f41f8810f54cb2b55bab1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.034013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a603c6c4220f41f8810f54cb2b55bab1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.035120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a603c6c4220f41f8810f54cb2b55bab1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.035723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a603c6c4220f41f8810f54cb2b55bab1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.065893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a6184e2-aa56-421b-b30b-d1ff879db76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a603c6c4220f41f8810f54cb2b55bab1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.088530 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3328/6711] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:09 2022] DELETE /identity/v3/users/a603c6c4220f41f8810f54cb2b55bab1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:10.409726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837c950-39c1-444a-ae2d-dc852a8e424e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:10.426668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837c950-39c1-444a-ae2d-dc852a8e424e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:10.499898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:10.500845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:10.501124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:10.501430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] PATH_INFO: `/v3/projects/8747c12da8b847a294543693794b28e0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:10.503255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8747c12da8b847a294543693794b28e0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:10.505746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:10.582697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8747c12da8b847a294543693794b28e0', 'request_id': 'req-407b33fc-0398-4c8f-89af-1592bfb63d4a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.593168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8747c12da8b847a294543693794b28e0', 'request_id': 'req-407b33fc-0398-4c8f-89af-1592bfb63d4a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.600256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8747c12da8b847a294543693794b28e0', 'request_id': 'req-407b33fc-0398-4c8f-89af-1592bfb63d4a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.613319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] The token cache is being invalidate because project 8747c12da8b847a294543693794b28e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:10.613640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.614429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-407b33fc-0398-4c8f-89af-1592bfb63d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:10.620795 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3384/6712] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:10 2022] DELETE /identity/v3/projects/8747c12da8b847a294543693794b28e0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:10.623579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c801d-1caa-4d97-b51a-2ab12cdd8038 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:10.624210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c801d-1caa-4d97-b51a-2ab12cdd8038 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:10.624524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c801d-1caa-4d97-b51a-2ab12cdd8038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:10.645956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7c2c801d-1caa-4d97-b51a-2ab12cdd8038 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:10.647172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7c2c801d-1caa-4d97-b51a-2ab12cdd8038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:10.754403 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3329/6713] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:10.762607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1825-3346-4bef-9ff5-c2e0b27b7e2e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:10.762956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1825-3346-4bef-9ff5-c2e0b27b7e2e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:10.763227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1825-3346-4bef-9ff5-c2e0b27b7e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:10.794990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ea1b1825-3346-4bef-9ff5-c2e0b27b7e2e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:10.796933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ea1b1825-3346-4bef-9ff5-c2e0b27b7e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:10.811354 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3385/6714] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:10.816105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c801d-1caa-4d97-b51a-2ab12cdd8038 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:10.826691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c801d-1caa-4d97-b51a-2ab12cdd8038 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:10.835600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d494a0d-7b0f-4e43-9c76-b8cbd8f5b167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:10.840686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494a0d-7b0f-4e43-9c76-b8cbd8f5b167 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:10.841010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494a0d-7b0f-4e43-9c76-b8cbd8f5b167 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:10.841246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d494a0d-7b0f-4e43-9c76-b8cbd8f5b167 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:10.842329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d494a0d-7b0f-4e43-9c76-b8cbd8f5b167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:10.842329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d494a0d-7b0f-4e43-9c76-b8cbd8f5b167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:10.844694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d494a0d-7b0f-4e43-9c76-b8cbd8f5b167 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:10.868868 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3330/6715] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:10.873908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b1825-3346-4bef-9ff5-c2e0b27b7e2e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:10.892841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b1825-3346-4bef-9ff5-c2e0b27b7e2e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:10.902545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a7906-f115-43a0-82ed-2405726ab9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:10.903471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a7906-f115-43a0-82ed-2405726ab9cb admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:10.904274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a7906-f115-43a0-82ed-2405726ab9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:10.905044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a7906-f115-43a0-82ed-2405726ab9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:10.906078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a7906-f115-43a0-82ed-2405726ab9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:10.927486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a7906-f115-43a0-82ed-2405726ab9cb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:10.970973 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3386/6716] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:10 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:10.975027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d494a0d-7b0f-4e43-9c76-b8cbd8f5b167 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:10.992448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d494a0d-7b0f-4e43-9c76-b8cbd8f5b167 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:11.093033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee5e7c-20bf-418d-862a-e27e7bb3e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:11.097145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee5e7c-20bf-418d-862a-e27e7bb3e47c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:11.097431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee5e7c-20bf-418d-862a-e27e7bb3e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:11.097706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee5e7c-20bf-418d-862a-e27e7bb3e47c admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:11.098417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee5e7c-20bf-418d-862a-e27e7bb3e47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:11.100419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee5e7c-20bf-418d-862a-e27e7bb3e47c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:11.139809 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3331/6717] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:10 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:11.145172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a7906-f115-43a0-82ed-2405726ab9cb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:11.165048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a7906-f115-43a0-82ed-2405726ab9cb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:11.185691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a259bff-0519-494d-a82d-e2846a04a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:11.187796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259bff-0519-494d-a82d-e2846a04a63f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:11.189164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259bff-0519-494d-a82d-e2846a04a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:11.189675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a259bff-0519-494d-a82d-e2846a04a63f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:11.202196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a259bff-0519-494d-a82d-e2846a04a63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:11.214743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a259bff-0519-494d-a82d-e2846a04a63f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:11.236831 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3387/6718] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:11.238476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee5e7c-20bf-418d-862a-e27e7bb3e47c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:11.254148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee5e7c-20bf-418d-862a-e27e7bb3e47c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:11.272688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842c796-4a56-44db-bea9-2f06995bcecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:11.273581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842c796-4a56-44db-bea9-2f06995bcecb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:11.274076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842c796-4a56-44db-bea9-2f06995bcecb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:11.281467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842c796-4a56-44db-bea9-2f06995bcecb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:11.282842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842c796-4a56-44db-bea9-2f06995bcecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:11.285744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842c796-4a56-44db-bea9-2f06995bcecb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:11.288996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a259bff-0519-494d-a82d-e2846a04a63f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:11.291003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7a259bff-0519-494d-a82d-e2846a04a63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:11.320326 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3332/6719] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:11.323857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842c796-4a56-44db-bea9-2f06995bcecb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:11.381206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842c796-4a56-44db-bea9-2f06995bcecb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:11.395222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b850ec3a-a326-484f-89c8-5bd65fd59f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:11.399366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850ec3a-a326-484f-89c8-5bd65fd59f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:11.400821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850ec3a-a326-484f-89c8-5bd65fd59f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:11.403190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b850ec3a-a326-484f-89c8-5bd65fd59f4c admin admin] PATH_INFO: `/v3/projects/b71f8376aef34204986c6b230e125754/users/3fff44909cbd465e9dff5129a08b0ce2/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:11.465663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850ec3a-a326-484f-89c8-5bd65fd59f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b71f8376aef34204986c6b230e125754, user_id=3fff44909cbd465e9dff5129a08b0ce2, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:11.473148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b850ec3a-a326-484f-89c8-5bd65fd59f4c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:11.480994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a259bff-0519-494d-a82d-e2846a04a63f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:11.490872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:11.491750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:11.492271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:11.492730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:11.496656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:11.508146 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3333/6720] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:11 2022] PUT /identity/v3/projects/b71f8376aef34204986c6b230e125754/users/3fff44909cbd465e9dff5129a08b0ce2/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:11.525734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:11.530543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df93cc-44d5-406f-b6dd-8ba56c39150a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:11.531118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df93cc-44d5-406f-b6dd-8ba56c39150a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:11.531602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df93cc-44d5-406f-b6dd-8ba56c39150a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:11.533633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:11.554819 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3388/6721] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:11.566645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-61df93cc-44d5-406f-b6dd-8ba56c39150a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:11.571200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-61df93cc-44d5-406f-b6dd-8ba56c39150a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:11.713386 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3334/6722] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:11.727526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:11.730776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:11.837734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577206c-57df-4597-b08b-300b3f71f5aa service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:11.924061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03539a0d-2f2a-4eaa-b39c-135801885430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:11.925155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03539a0d-2f2a-4eaa-b39c-135801885430 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:11.925614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03539a0d-2f2a-4eaa-b39c-135801885430 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:11.925896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03539a0d-2f2a-4eaa-b39c-135801885430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:11.942562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03539a0d-2f2a-4eaa-b39c-135801885430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:11.944987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03539a0d-2f2a-4eaa-b39c-135801885430 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:11.964096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3389/6723] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:12.871210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280d1a2-7a56-4479-8556-e7cc2d7fb8d2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:12.872575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280d1a2-7a56-4479-8556-e7cc2d7fb8d2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:12.872876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280d1a2-7a56-4479-8556-e7cc2d7fb8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:12.919653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c280d1a2-7a56-4479-8556-e7cc2d7fb8d2 None None] MFA Rules not processed for user `3fff44909cbd465e9dff5129a08b0ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:12.920997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c280d1a2-7a56-4479-8556-e7cc2d7fb8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:13.028037 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3335/6724] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:13.034251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8780b5-717e-416d-8e1a-457416b12d8e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:13.034774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8780b5-717e-416d-8e1a-457416b12d8e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:13.034774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8780b5-717e-416d-8e1a-457416b12d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:13.086851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6d8780b5-717e-416d-8e1a-457416b12d8e None None] MFA Rules not processed for user `3fff44909cbd465e9dff5129a08b0ce2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:13.089200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6d8780b5-717e-416d-8e1a-457416b12d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:13.102253 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3390/6725] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:13.115199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280d1a2-7a56-4479-8556-e7cc2d7fb8d2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:13.117391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c280d1a2-7a56-4479-8556-e7cc2d7fb8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:13.216753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c280d1a2-7a56-4479-8556-e7cc2d7fb8d2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:13.224889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a57fe-64c6-4248-83b9-43d9838473c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:13.230885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a57fe-64c6-4248-83b9-43d9838473c2 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:13.231657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a57fe-64c6-4248-83b9-43d9838473c2 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:13.232029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a57fe-64c6-4248-83b9-43d9838473c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:13.252804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a57fe-64c6-4248-83b9-43d9838473c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:13.256821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a57fe-64c6-4248-83b9-43d9838473c2 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:13.279378 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3336/6726] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:14.181398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8780b5-717e-416d-8e1a-457416b12d8e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:14.205220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8780b5-717e-416d-8e1a-457416b12d8e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:14.214981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:14.216315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:14.216790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:14.217238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] PATH_INFO: `/v3/users/3fff44909cbd465e9dff5129a08b0ce2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:14.220657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fff44909cbd465e9dff5129a08b0ce2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:14.223479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:14.304303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fff44909cbd465e9dff5129a08b0ce2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:14.318814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fff44909cbd465e9dff5129a08b0ce2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:14.319640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fff44909cbd465e9dff5129a08b0ce2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:14.325193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fff44909cbd465e9dff5129a08b0ce2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:14.338785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-117ce784-2fa6-427c-9441-69db2118bbad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fff44909cbd465e9dff5129a08b0ce2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:14.362414 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3391/6727] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:14 2022] DELETE /identity/v3/users/3fff44909cbd465e9dff5129a08b0ce2 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:14.774131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a57fe-64c6-4248-83b9-43d9838473c2 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:14.818643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a57fe-64c6-4248-83b9-43d9838473c2 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:14.915391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:14.917448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:14.918004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:14.919066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] PATH_INFO: `/v3/projects/b71f8376aef34204986c6b230e125754` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:14.920618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b71f8376aef34204986c6b230e125754)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:14.923793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:15.003584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b71f8376aef34204986c6b230e125754', 'request_id': 'req-15528c1e-c85e-4e92-9f6b-402494caa529'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:15.018633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b71f8376aef34204986c6b230e125754', 'request_id': 'req-15528c1e-c85e-4e92-9f6b-402494caa529'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:15.035174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b71f8376aef34204986c6b230e125754', 'request_id': 'req-15528c1e-c85e-4e92-9f6b-402494caa529'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:15.052608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] The token cache is being invalidate because project b71f8376aef34204986c6b230e125754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:15.052875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:15.053825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:15.057051 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3337/6728] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:14 2022] DELETE /identity/v3/projects/b71f8376aef34204986c6b230e125754 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:15.063027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c89e46-a8d2-4bb0-8471-deaf3a51b357 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.063710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c89e46-a8d2-4bb0-8471-deaf3a51b357 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.064311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c89e46-a8d2-4bb0-8471-deaf3a51b357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.092104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-32c89e46-a8d2-4bb0-8471-deaf3a51b357 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:15.094219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-32c89e46-a8d2-4bb0-8471-deaf3a51b357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:15.147818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:15.150667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:15.242487 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3392/6729] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:15.253431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c239cf4-c933-493d-9b9a-5d86c544b7c3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.254152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c239cf4-c933-493d-9b9a-5d86c544b7c3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.254685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c239cf4-c933-493d-9b9a-5d86c544b7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.281170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8c239cf4-c933-493d-9b9a-5d86c544b7c3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:15.282936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8c239cf4-c933-493d-9b9a-5d86c544b7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:15.285288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15528c1e-c85e-4e92-9f6b-402494caa529 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:15.294012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8731-33c1-4274-9c0f-86d11685a0b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:15.294889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8731-33c1-4274-9c0f-86d11685a0b1 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.295159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8731-33c1-4274-9c0f-86d11685a0b1 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.295435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc8731-33c1-4274-9c0f-86d11685a0b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.300110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7dfc8731-33c1-4274-9c0f-86d11685a0b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:15.301619 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3393/6730] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:15.308610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c239cf4-c933-493d-9b9a-5d86c544b7c3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:15.320162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc8731-33c1-4274-9c0f-86d11685a0b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:15.322272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c239cf4-c933-493d-9b9a-5d86c544b7c3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:15.322627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc8731-33c1-4274-9c0f-86d11685a0b1 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:15.330089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7ef5b-ec97-4508-8f89-c5544a6b28d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:15.331091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7ef5b-ec97-4508-8f89-c5544a6b28d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.331629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7ef5b-ec97-4508-8f89-c5544a6b28d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.332483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7ef5b-ec97-4508-8f89-c5544a6b28d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.334229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7ef5b-ec97-4508-8f89-c5544a6b28d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:15.334707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7ef5b-ec97-4508-8f89-c5544a6b28d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:15.336627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7ef5b-ec97-4508-8f89-c5544a6b28d8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:15.340031 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3338/6731] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:15.361535 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3394/6732] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:12:15.363016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8731-33c1-4274-9c0f-86d11685a0b1 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:15.398875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc8731-33c1-4274-9c0f-86d11685a0b1 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:15.408125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ffb0c-dba2-47ac-8cd2-7f3bd0ef4046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:15.414054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ffb0c-dba2-47ac-8cd2-7f3bd0ef4046 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.414445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ffb0c-dba2-47ac-8cd2-7f3bd0ef4046 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.414878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ffb0c-dba2-47ac-8cd2-7f3bd0ef4046 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.416085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ffb0c-dba2-47ac-8cd2-7f3bd0ef4046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:15.420265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ffb0c-dba2-47ac-8cd2-7f3bd0ef4046 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:15.463232 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3339/6733] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:15 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:15.467005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7ef5b-ec97-4508-8f89-c5544a6b28d8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:15.493420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7ef5b-ec97-4508-8f89-c5544a6b28d8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:15.605317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449b0c2-9f28-4897-8fc8-b5fc749106c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:15.607011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449b0c2-9f28-4897-8fc8-b5fc749106c0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.607392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449b0c2-9f28-4897-8fc8-b5fc749106c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.607703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449b0c2-9f28-4897-8fc8-b5fc749106c0 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.608716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449b0c2-9f28-4897-8fc8-b5fc749106c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:15.611074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449b0c2-9f28-4897-8fc8-b5fc749106c0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:15.646246 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3395/6734] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:15 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:15.650495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ffb0c-dba2-47ac-8cd2-7f3bd0ef4046 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:15.666485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ffb0c-dba2-47ac-8cd2-7f3bd0ef4046 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:15.676112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1ffff-706a-40cf-9f61-74b7a3edc2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:15.677509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ffff-706a-40cf-9f61-74b7a3edc2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.677828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ffff-706a-40cf-9f61-74b7a3edc2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.678114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1ffff-706a-40cf-9f61-74b7a3edc2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.679071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1ffff-706a-40cf-9f61-74b7a3edc2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:15.682120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1ffff-706a-40cf-9f61-74b7a3edc2b6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:15.700930 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3340/6735] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:15.705234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449b0c2-9f28-4897-8fc8-b5fc749106c0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:15.728975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449b0c2-9f28-4897-8fc8-b5fc749106c0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:15.740307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572baa0f-56b2-4f2e-ad09-f078a66c1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:15.744882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572baa0f-56b2-4f2e-ad09-f078a66c1107 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.745254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572baa0f-56b2-4f2e-ad09-f078a66c1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.745800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572baa0f-56b2-4f2e-ad09-f078a66c1107 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.747451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572baa0f-56b2-4f2e-ad09-f078a66c1107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:15.750233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572baa0f-56b2-4f2e-ad09-f078a66c1107 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:15.767388 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3396/6736] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:15.772736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1ffff-706a-40cf-9f61-74b7a3edc2b6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:15.785266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1ffff-706a-40cf-9f61-74b7a3edc2b6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:15.794904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adbe17-2e03-409b-802f-2566ab9634d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:15.796217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adbe17-2e03-409b-802f-2566ab9634d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.797283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adbe17-2e03-409b-802f-2566ab9634d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.797892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adbe17-2e03-409b-802f-2566ab9634d0 admin admin] PATH_INFO: `/v3/projects/bdf65634074841f3ba68b540f7706a34/users/30c538b3ad234ec89213e8676cedbedf/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.820341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572baa0f-56b2-4f2e-ad09-f078a66c1107 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:15.822761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-572baa0f-56b2-4f2e-ad09-f078a66c1107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:15.825936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adbe17-2e03-409b-802f-2566ab9634d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf65634074841f3ba68b540f7706a34, user_id=30c538b3ad234ec89213e8676cedbedf, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:15.828903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adbe17-2e03-409b-802f-2566ab9634d0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:15.843818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572baa0f-56b2-4f2e-ad09-f078a66c1107 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:15.857126 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3341/6737] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:15 2022] PUT /identity/v3/projects/bdf65634074841f3ba68b540f7706a34/users/30c538b3ad234ec89213e8676cedbedf/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:15.869130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a115a-5a3f-48ba-aa4c-6b6ae144b8a0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.869496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a115a-5a3f-48ba-aa4c-6b6ae144b8a0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.870038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a115a-5a3f-48ba-aa4c-6b6ae144b8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.914287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-515a115a-5a3f-48ba-aa4c-6b6ae144b8a0 None None] MFA Rules not processed for user `30c538b3ad234ec89213e8676cedbedf`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:15.917836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-515a115a-5a3f-48ba-aa4c-6b6ae144b8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:15.938485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:15.939893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:15.940301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:15.940715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] PATH_INFO: `/v3/users/579df559018e45808c3886ac22ecc165` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:15.942430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=579df559018e45808c3886ac22ecc165)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:15.945073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:16.004580 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3342/6738] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:16.016886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a115a-5a3f-48ba-aa4c-6b6ae144b8a0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:16.017514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '579df559018e45808c3886ac22ecc165'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.018474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-515a115a-5a3f-48ba-aa4c-6b6ae144b8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:16.034510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '579df559018e45808c3886ac22ecc165'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.035466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '579df559018e45808c3886ac22ecc165'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.036118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '579df559018e45808c3886ac22ecc165'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.047068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4c8496de-266d-4206-b07c-37d84200e3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '579df559018e45808c3886ac22ecc165'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.074045 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3397/6739] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:15 2022] DELETE /identity/v3/users/579df559018e45808c3886ac22ecc165 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:16.078985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35349d-9d95-4ffb-a640-f1d0b6d38510 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:16.079298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35349d-9d95-4ffb-a640-f1d0b6d38510 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:16.079621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35349d-9d95-4ffb-a640-f1d0b6d38510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:16.100702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-fb35349d-9d95-4ffb-a640-f1d0b6d38510 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:16.101932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fb35349d-9d95-4ffb-a640-f1d0b6d38510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:16.126439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a115a-5a3f-48ba-aa4c-6b6ae144b8a0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:16.172325 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3398/6740] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:16.182286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35349d-9d95-4ffb-a640-f1d0b6d38510 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:16.185016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fb35349d-9d95-4ffb-a640-f1d0b6d38510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:16.216489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a64b2-6406-4147-b15b-38c75ac04d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:16.217354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a64b2-6406-4147-b15b-38c75ac04d6d service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:16.217917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a64b2-6406-4147-b15b-38c75ac04d6d service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:16.217917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a64b2-6406-4147-b15b-38c75ac04d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:16.220158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-424a64b2-6406-4147-b15b-38c75ac04d6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:16.259851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35349d-9d95-4ffb-a640-f1d0b6d38510 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:16.265625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1ed89-1797-4bb5-9e3b-b6b808959778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:16.266273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1ed89-1797-4bb5-9e3b-b6b808959778 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:16.266556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1ed89-1797-4bb5-9e3b-b6b808959778 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:16.266844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1ed89-1797-4bb5-9e3b-b6b808959778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:16.278207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1ed89-1797-4bb5-9e3b-b6b808959778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:16.279905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e1ed89-1797-4bb5-9e3b-b6b808959778 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:16.292252 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3399/6741] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:12:16.314229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a64b2-6406-4147-b15b-38c75ac04d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:16.316216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a64b2-6406-4147-b15b-38c75ac04d6d service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:16.336562 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3343/6742] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:12:16.519876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1ed89-1797-4bb5-9e3b-b6b808959778 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:16.521811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-69e1ed89-1797-4bb5-9e3b-b6b808959778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:16.559488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e1ed89-1797-4bb5-9e3b-b6b808959778 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:16.573964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:16.575766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:16.576074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:16.576455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] PATH_INFO: `/v3/projects/13edcc6f41ce42ff8b88edb21a3ae4ec` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:16.577935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13edcc6f41ce42ff8b88edb21a3ae4ec)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:16.579791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:16.643910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'request_id': 'req-35c29e39-b1ca-43d1-b2c0-0920b43c4779'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.653604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'request_id': 'req-35c29e39-b1ca-43d1-b2c0-0920b43c4779'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.661003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13edcc6f41ce42ff8b88edb21a3ae4ec', 'request_id': 'req-35c29e39-b1ca-43d1-b2c0-0920b43c4779'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.675313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] The token cache is being invalidate because project 13edcc6f41ce42ff8b88edb21a3ae4ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:16.675938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.676766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35c29e39-b1ca-43d1-b2c0-0920b43c4779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:16.678547 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3400/6743] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:16 2022] DELETE /identity/v3/projects/13edcc6f41ce42ff8b88edb21a3ae4ec => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:16.684884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb4045-60bd-49d5-8d8b-13c277920f8c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:16.685362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb4045-60bd-49d5-8d8b-13c277920f8c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:16.685471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb4045-60bd-49d5-8d8b-13c277920f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:16.707821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fbfb4045-60bd-49d5-8d8b-13c277920f8c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:16.709443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fbfb4045-60bd-49d5-8d8b-13c277920f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:16.810050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f29527-62e7-4c5e-9e94-955742834552 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:16.810360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f29527-62e7-4c5e-9e94-955742834552 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:16.810616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f29527-62e7-4c5e-9e94-955742834552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:16.812317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3344/6744] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:16.839490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b1f29527-62e7-4c5e-9e94-955742834552 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:16.839490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b1f29527-62e7-4c5e-9e94-955742834552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:16.873672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb4045-60bd-49d5-8d8b-13c277920f8c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:16.885662 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3401/6745] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:16.889160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb4045-60bd-49d5-8d8b-13c277920f8c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:16.906140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7d2af-b6da-474f-b5aa-fad00ee1345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:16.906833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7d2af-b6da-474f-b5aa-fad00ee1345c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:16.907118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7d2af-b6da-474f-b5aa-fad00ee1345c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:16.908858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7d2af-b6da-474f-b5aa-fad00ee1345c admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:16.909617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7d2af-b6da-474f-b5aa-fad00ee1345c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:16.909934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7d2af-b6da-474f-b5aa-fad00ee1345c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:16.913286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7d2af-b6da-474f-b5aa-fad00ee1345c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:16.937431 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3345/6746] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:16.942641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f29527-62e7-4c5e-9e94-955742834552 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:16.959052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f29527-62e7-4c5e-9e94-955742834552 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:16.974387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f82c9-a840-4f14-9412-13ae8d1aea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:16.975114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f82c9-a840-4f14-9412-13ae8d1aea1b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:16.975401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f82c9-a840-4f14-9412-13ae8d1aea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:16.975677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f82c9-a840-4f14-9412-13ae8d1aea1b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:16.976871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f82c9-a840-4f14-9412-13ae8d1aea1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:16.982214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f82c9-a840-4f14-9412-13ae8d1aea1b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:17.043530 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3402/6747] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:16 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:17.047693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7d2af-b6da-474f-b5aa-fad00ee1345c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:17.062735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7d2af-b6da-474f-b5aa-fad00ee1345c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:17.185565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798faf2-dee1-4977-bef4-54a3d469a24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:17.186628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798faf2-dee1-4977-bef4-54a3d469a24e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:17.187715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798faf2-dee1-4977-bef4-54a3d469a24e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:17.188314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798faf2-dee1-4977-bef4-54a3d469a24e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:17.189288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798faf2-dee1-4977-bef4-54a3d469a24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:17.192421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798faf2-dee1-4977-bef4-54a3d469a24e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:17.223114 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3346/6748] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:17 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:17.224094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f82c9-a840-4f14-9412-13ae8d1aea1b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:17.242672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f82c9-a840-4f14-9412-13ae8d1aea1b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:17.255073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89d7f4-2e4a-4af1-8844-86a1590dd427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:17.255844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89d7f4-2e4a-4af1-8844-86a1590dd427 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:17.256285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89d7f4-2e4a-4af1-8844-86a1590dd427 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:17.256685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89d7f4-2e4a-4af1-8844-86a1590dd427 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:17.257504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89d7f4-2e4a-4af1-8844-86a1590dd427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:17.260416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89d7f4-2e4a-4af1-8844-86a1590dd427 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:17.277339 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3403/6749] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:17.281199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798faf2-dee1-4977-bef4-54a3d469a24e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:17.293918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798faf2-dee1-4977-bef4-54a3d469a24e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:17.300624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab9c9f-ebdc-43ad-af5c-5908cccca536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:17.301717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab9c9f-ebdc-43ad-af5c-5908cccca536 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:17.301977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab9c9f-ebdc-43ad-af5c-5908cccca536 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:17.302269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab9c9f-ebdc-43ad-af5c-5908cccca536 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:17.303202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab9c9f-ebdc-43ad-af5c-5908cccca536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:17.306577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab9c9f-ebdc-43ad-af5c-5908cccca536 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:17.321068 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3347/6750] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:17.326601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89d7f4-2e4a-4af1-8844-86a1590dd427 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:17.340364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89d7f4-2e4a-4af1-8844-86a1590dd427 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:17.346244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62543902-01ac-46dc-895a-2c61d6c362d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:17.347291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62543902-01ac-46dc-895a-2c61d6c362d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:17.347603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62543902-01ac-46dc-895a-2c61d6c362d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:17.347867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62543902-01ac-46dc-895a-2c61d6c362d6 admin admin] PATH_INFO: `/v3/projects/527d34e41144408c95c2b93cb797c5bc/users/70b9b99519bd4335ab090702734a345b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:17.367963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62543902-01ac-46dc-895a-2c61d6c362d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527d34e41144408c95c2b93cb797c5bc, user_id=70b9b99519bd4335ab090702734a345b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:17.372824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62543902-01ac-46dc-895a-2c61d6c362d6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:17.389459 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3404/6751] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:17 2022] PUT /identity/v3/projects/527d34e41144408c95c2b93cb797c5bc/users/70b9b99519bd4335ab090702734a345b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:17.400820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a91760-5b40-4ae9-8beb-e39059940f93 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:17.401262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a91760-5b40-4ae9-8beb-e39059940f93 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:17.401515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a91760-5b40-4ae9-8beb-e39059940f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:17.441289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-82a91760-5b40-4ae9-8beb-e39059940f93 None None] MFA Rules not processed for user `70b9b99519bd4335ab090702734a345b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:17.442708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-82a91760-5b40-4ae9-8beb-e39059940f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:17.527745 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3348/6752] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:17.541802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62543902-01ac-46dc-895a-2c61d6c362d6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:17.544243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-62543902-01ac-46dc-895a-2c61d6c362d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:17.647456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62543902-01ac-46dc-895a-2c61d6c362d6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:17.653856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae436851-7fb3-4047-807e-7579a629bbf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:17.654587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae436851-7fb3-4047-807e-7579a629bbf5 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:17.654829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae436851-7fb3-4047-807e-7579a629bbf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:17.655280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae436851-7fb3-4047-807e-7579a629bbf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:17.673800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae436851-7fb3-4047-807e-7579a629bbf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:17.675258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae436851-7fb3-4047-807e-7579a629bbf5 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:17.688397 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3405/6753] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:19.422516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a91760-5b40-4ae9-8beb-e39059940f93 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:19.424009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-82a91760-5b40-4ae9-8beb-e39059940f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:19.565183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a91760-5b40-4ae9-8beb-e39059940f93 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:19.571692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:19.573550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:19.574091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:19.574547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] PATH_INFO: `/v3/users/30c538b3ad234ec89213e8676cedbedf` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:19.576579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c538b3ad234ec89213e8676cedbedf)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:19.579125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:19.672719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c538b3ad234ec89213e8676cedbedf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:19.700436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c538b3ad234ec89213e8676cedbedf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:19.702639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c538b3ad234ec89213e8676cedbedf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:19.703584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c538b3ad234ec89213e8676cedbedf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:19.744680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c538b3ad234ec89213e8676cedbedf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:19.771138 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3349/6754] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:19 2022] DELETE /identity/v3/users/30c538b3ad234ec89213e8676cedbedf => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:19.776168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9750c-0be5-40ac-81e9-3532d3a1cf1f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:19.776658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9750c-0be5-40ac-81e9-3532d3a1cf1f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:19.776777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9750c-0be5-40ac-81e9-3532d3a1cf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:19.801683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-62f9750c-0be5-40ac-81e9-3532d3a1cf1f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:19.803328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-62f9750c-0be5-40ac-81e9-3532d3a1cf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:19.931829 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3406/6755] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:19.953963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:19.955763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:20.105192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589c578-f6cb-4e34-a694-39bb323b1fa2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:20.121689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c374ad3-d02d-4411-8d23-2b42923febea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:20.123116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c374ad3-d02d-4411-8d23-2b42923febea service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:20.125776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c374ad3-d02d-4411-8d23-2b42923febea service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:20.126389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c374ad3-d02d-4411-8d23-2b42923febea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:20.164028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c374ad3-d02d-4411-8d23-2b42923febea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:20.169176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c374ad3-d02d-4411-8d23-2b42923febea service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:20.210007 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3350/6756] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:20.819872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822edd9f-6efc-4b2e-867a-3c008d47ad70 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:20.820630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822edd9f-6efc-4b2e-867a-3c008d47ad70 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:20.820630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822edd9f-6efc-4b2e-867a-3c008d47ad70 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:20.822483 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3407/6757] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 21:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:12:20.829880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79946a4-0983-415e-b8e0-fe387bdbd138 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:20.830857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79946a4-0983-415e-b8e0-fe387bdbd138 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:20.831701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79946a4-0983-415e-b8e0-fe387bdbd138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:20.886383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a79946a4-0983-415e-b8e0-fe387bdbd138 None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:20.888611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a79946a4-0983-415e-b8e0-fe387bdbd138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:20.902835 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3351/6758] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:12:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:20.937774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822edd9f-6efc-4b2e-867a-3c008d47ad70 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:20.940688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-822edd9f-6efc-4b2e-867a-3c008d47ad70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:20.975728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822edd9f-6efc-4b2e-867a-3c008d47ad70 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:20.988632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9d19d-4b1c-4543-8d6c-ad808b7dff84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:20.990492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9d19d-4b1c-4543-8d6c-ad808b7dff84 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:20.991506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9d19d-4b1c-4543-8d6c-ad808b7dff84 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:20.991800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9d19d-4b1c-4543-8d6c-ad808b7dff84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:21.016765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9d19d-4b1c-4543-8d6c-ad808b7dff84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:21.019158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9d19d-4b1c-4543-8d6c-ad808b7dff84 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:21.043378 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3408/6759] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:21.383911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79946a4-0983-415e-b8e0-fe387bdbd138 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:21.387159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a79946a4-0983-415e-b8e0-fe387bdbd138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:21.437630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79946a4-0983-415e-b8e0-fe387bdbd138 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:21.457856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:21.458803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:21.459110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:21.459267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] PATH_INFO: `/v3/projects/bdf65634074841f3ba68b540f7706a34` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:21.466458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf65634074841f3ba68b540f7706a34)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:21.470302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:21.576769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf65634074841f3ba68b540f7706a34', 'request_id': 'req-e180d859-aa75-402e-9e30-ae648813d787'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:21.600055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf65634074841f3ba68b540f7706a34', 'request_id': 'req-e180d859-aa75-402e-9e30-ae648813d787'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:21.610515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf65634074841f3ba68b540f7706a34', 'request_id': 'req-e180d859-aa75-402e-9e30-ae648813d787'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:21.653921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] The token cache is being invalidate because project bdf65634074841f3ba68b540f7706a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:21.654269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:21.655941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e180d859-aa75-402e-9e30-ae648813d787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:21.667422 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3352/6760] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:21 2022] DELETE /identity/v3/projects/bdf65634074841f3ba68b540f7706a34 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:21.669537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789af20b-318f-4d87-b72d-fed0b033ca41 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:21.676413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789af20b-318f-4d87-b72d-fed0b033ca41 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:21.677917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789af20b-318f-4d87-b72d-fed0b033ca41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:21.720109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-789af20b-318f-4d87-b72d-fed0b033ca41 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:21.725486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-789af20b-318f-4d87-b72d-fed0b033ca41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:21.853014 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3409/6761] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:21.863472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd097328-066b-4685-ab14-b3aab29fb7f4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:21.864355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd097328-066b-4685-ab14-b3aab29fb7f4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:21.864817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd097328-066b-4685-ab14-b3aab29fb7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:21.912795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bd097328-066b-4685-ab14-b3aab29fb7f4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:21.914282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bd097328-066b-4685-ab14-b3aab29fb7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:21.934635 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3353/6762] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:21.940904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789af20b-318f-4d87-b72d-fed0b033ca41 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:21.965214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789af20b-318f-4d87-b72d-fed0b033ca41 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:21.979531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d72a9-bdf1-443f-a53f-f4579552ce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:21.980708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d72a9-bdf1-443f-a53f-f4579552ce8b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:21.981026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d72a9-bdf1-443f-a53f-f4579552ce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:21.981276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d72a9-bdf1-443f-a53f-f4579552ce8b admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:21.986232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d72a9-bdf1-443f-a53f-f4579552ce8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:21.986564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d72a9-bdf1-443f-a53f-f4579552ce8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:21.988445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d72a9-bdf1-443f-a53f-f4579552ce8b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:22.018491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd097328-066b-4685-ab14-b3aab29fb7f4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:22.020267 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3410/6763] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:22.034409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd097328-066b-4685-ab14-b3aab29fb7f4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:22.042855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a27a19-8c91-474a-b6f2-e7f2a9ef2415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:22.043890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a27a19-8c91-474a-b6f2-e7f2a9ef2415 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:22.045203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a27a19-8c91-474a-b6f2-e7f2a9ef2415 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:22.045788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a27a19-8c91-474a-b6f2-e7f2a9ef2415 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:22.046971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a27a19-8c91-474a-b6f2-e7f2a9ef2415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:22.049983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a27a19-8c91-474a-b6f2-e7f2a9ef2415 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:22.119127 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3354/6764] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:22 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:22.123290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d72a9-bdf1-443f-a53f-f4579552ce8b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:22.139778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d72a9-bdf1-443f-a53f-f4579552ce8b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:22.288771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d797-815d-4496-b1bf-32ccb41c2525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:22.290983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d797-815d-4496-b1bf-32ccb41c2525 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:22.291284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d797-815d-4496-b1bf-32ccb41c2525 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:22.291570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d797-815d-4496-b1bf-32ccb41c2525 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:22.293513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d797-815d-4496-b1bf-32ccb41c2525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:22.298352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d797-815d-4496-b1bf-32ccb41c2525 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:22.344013 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3411/6765] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:22 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:22.346558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a27a19-8c91-474a-b6f2-e7f2a9ef2415 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:22.360211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a27a19-8c91-474a-b6f2-e7f2a9ef2415 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:22.366495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa184206-60cc-4b19-b988-d0fea2ea938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:22.367302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa184206-60cc-4b19-b988-d0fea2ea938e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:22.367827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa184206-60cc-4b19-b988-d0fea2ea938e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:22.368283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa184206-60cc-4b19-b988-d0fea2ea938e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:22.371544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa184206-60cc-4b19-b988-d0fea2ea938e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:22.374964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa184206-60cc-4b19-b988-d0fea2ea938e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:22.401599 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3355/6766] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:22.402991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d797-815d-4496-b1bf-32ccb41c2525 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:22.418266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d797-815d-4496-b1bf-32ccb41c2525 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:22.432047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2f06ed-dcca-42da-bdcb-c6e512454643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:22.434574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f06ed-dcca-42da-bdcb-c6e512454643 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:22.435845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f06ed-dcca-42da-bdcb-c6e512454643 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:22.436149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f06ed-dcca-42da-bdcb-c6e512454643 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:22.437881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f06ed-dcca-42da-bdcb-c6e512454643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:22.439528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2f06ed-dcca-42da-bdcb-c6e512454643 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:22.465554 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3412/6767] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:22.468816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa184206-60cc-4b19-b988-d0fea2ea938e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:22.481771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa184206-60cc-4b19-b988-d0fea2ea938e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:22.487629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30a1e-f30a-4d01-8992-c9c7030895d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:22.488579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30a1e-f30a-4d01-8992-c9c7030895d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:22.489029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30a1e-f30a-4d01-8992-c9c7030895d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:22.489319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed30a1e-f30a-4d01-8992-c9c7030895d8 admin admin] PATH_INFO: `/v3/projects/85da98ab5e9649aa9326cc4859d0c8e6/users/fc3bc99ab8624397a49ebeb358e845e6/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:22.543491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30a1e-f30a-4d01-8992-c9c7030895d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85da98ab5e9649aa9326cc4859d0c8e6, user_id=fc3bc99ab8624397a49ebeb358e845e6, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:22.550169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed30a1e-f30a-4d01-8992-c9c7030895d8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:22.576024 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3356/6768] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:22 2022] PUT /identity/v3/projects/85da98ab5e9649aa9326cc4859d0c8e6/users/fc3bc99ab8624397a49ebeb358e845e6/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:22.588567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2fe8d-217c-4774-b493-399239e7e5d7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:22.588857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2fe8d-217c-4774-b493-399239e7e5d7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:22.589137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2fe8d-217c-4774-b493-399239e7e5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:22.663313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-39a2fe8d-217c-4774-b493-399239e7e5d7 None None] MFA Rules not processed for user `fc3bc99ab8624397a49ebeb358e845e6`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:22.664721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-39a2fe8d-217c-4774-b493-399239e7e5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:22.812889 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3413/6769] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:22.817184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30a1e-f30a-4d01-8992-c9c7030895d8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:22.935609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed30a1e-f30a-4d01-8992-c9c7030895d8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:22.944342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d30bd5-4689-4e74-89ac-a54f3ae6637d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:22.945246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d30bd5-4689-4e74-89ac-a54f3ae6637d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:22.945803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d30bd5-4689-4e74-89ac-a54f3ae6637d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:22.947143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d30bd5-4689-4e74-89ac-a54f3ae6637d admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:22.949268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d30bd5-4689-4e74-89ac-a54f3ae6637d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:22.951810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d30bd5-4689-4e74-89ac-a54f3ae6637d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:23.011866 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3357/6770] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:22 2022] POST /identity/v3/projects => generated 371 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:23.014108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2fe8d-217c-4774-b493-399239e7e5d7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:23.031827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2fe8d-217c-4774-b493-399239e7e5d7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:23.106265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d6a07-6291-4cdb-9e11-33c0c11cca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:23.107253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d6a07-6291-4cdb-9e11-33c0c11cca0b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.107746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d6a07-6291-4cdb-9e11-33c0c11cca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.108669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d6a07-6291-4cdb-9e11-33c0c11cca0b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.110029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d6a07-6291-4cdb-9e11-33c0c11cca0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:23.112362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d6a07-6291-4cdb-9e11-33c0c11cca0b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:23.143427 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3414/6771] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:23 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:23.149518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d30bd5-4689-4e74-89ac-a54f3ae6637d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:23.179124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d30bd5-4689-4e74-89ac-a54f3ae6637d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:23.189424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23219e-e356-4df1-ab39-de40e6e85584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:23.190609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23219e-e356-4df1-ab39-de40e6e85584 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.191238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23219e-e356-4df1-ab39-de40e6e85584 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.191993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23219e-e356-4df1-ab39-de40e6e85584 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.192958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23219e-e356-4df1-ab39-de40e6e85584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:23.194995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23219e-e356-4df1-ab39-de40e6e85584 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:23.222459 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3358/6772] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:23.228291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d6a07-6291-4cdb-9e11-33c0c11cca0b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:23.242140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d6a07-6291-4cdb-9e11-33c0c11cca0b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:23.251738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3a5a1-42f6-49f0-94d6-d317e148e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:23.253124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a5a1-42f6-49f0-94d6-d317e148e06c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.253672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a5a1-42f6-49f0-94d6-d317e148e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.254136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3a5a1-42f6-49f0-94d6-d317e148e06c admin admin] PATH_INFO: `/v3/projects/ad005b7863904096a94a83a519610fd0/users/cee0ac18493c4998bdff8c6f6d4ec227/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.279178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3a5a1-42f6-49f0-94d6-d317e148e06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad005b7863904096a94a83a519610fd0, user_id=cee0ac18493c4998bdff8c6f6d4ec227, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:23.283883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3a5a1-42f6-49f0-94d6-d317e148e06c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:23.304969 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3415/6773] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:23 2022] PUT /identity/v3/projects/ad005b7863904096a94a83a519610fd0/users/cee0ac18493c4998bdff8c6f6d4ec227/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:23.310216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23219e-e356-4df1-ab39-de40e6e85584 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:23.326729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23219e-e356-4df1-ab39-de40e6e85584 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:23.372098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3a5a1-42f6-49f0-94d6-d317e148e06c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:23.374052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e4a3a5a1-42f6-49f0-94d6-d317e148e06c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:23.433936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70696163-2d18-4934-b1ac-1061a42a8b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:23.435688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70696163-2d18-4934-b1ac-1061a42a8b4c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.440176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70696163-2d18-4934-b1ac-1061a42a8b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.440532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70696163-2d18-4934-b1ac-1061a42a8b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.441407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70696163-2d18-4934-b1ac-1061a42a8b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:23.443335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70696163-2d18-4934-b1ac-1061a42a8b4c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:23.466489 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3359/6774] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:23.467880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70696163-2d18-4934-b1ac-1061a42a8b4c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:23.490454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70696163-2d18-4934-b1ac-1061a42a8b4c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:23.506133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d84a3b-a6f6-4efd-bb69-8a8a9c9c631b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:23.508798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d84a3b-a6f6-4efd-bb69-8a8a9c9c631b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.510889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d84a3b-a6f6-4efd-bb69-8a8a9c9c631b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.511158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d84a3b-a6f6-4efd-bb69-8a8a9c9c631b admin admin] PATH_INFO: `/v3/projects/ad005b7863904096a94a83a519610fd0/users/cee0ac18493c4998bdff8c6f6d4ec227/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.515202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d84a3b-a6f6-4efd-bb69-8a8a9c9c631b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad005b7863904096a94a83a519610fd0, user_id=cee0ac18493c4998bdff8c6f6d4ec227, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:23.519427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d84a3b-a6f6-4efd-bb69-8a8a9c9c631b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:23.522984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3a5a1-42f6-49f0-94d6-d317e148e06c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:23.528933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:23.530193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.530706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.531241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] PATH_INFO: `/v3/users/97b0caf3705c4cdb83b4dbd7452aad81` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.533182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97b0caf3705c4cdb83b4dbd7452aad81)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:23.535551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:23.540050 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3360/6775] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:23 2022] PUT /identity/v3/projects/ad005b7863904096a94a83a519610fd0/users/cee0ac18493c4998bdff8c6f6d4ec227/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:23.549892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0f5d2-1f5d-413e-b7be-5c1a595dc57b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.550234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0f5d2-1f5d-413e-b7be-5c1a595dc57b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.550457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0f5d2-1f5d-413e-b7be-5c1a595dc57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.586691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-49f0f5d2-1f5d-413e-b7be-5c1a595dc57b None None] MFA Rules not processed for user `cee0ac18493c4998bdff8c6f6d4ec227`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:23.588169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49f0f5d2-1f5d-413e-b7be-5c1a595dc57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:23.610363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97b0caf3705c4cdb83b4dbd7452aad81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:23.619971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97b0caf3705c4cdb83b4dbd7452aad81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:23.620695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97b0caf3705c4cdb83b4dbd7452aad81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:23.621708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97b0caf3705c4cdb83b4dbd7452aad81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:23.635480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-59f09082-faeb-48da-8d2f-ee6de4cdcad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97b0caf3705c4cdb83b4dbd7452aad81'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:23.661109 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3416/6776] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:23 2022] DELETE /identity/v3/users/97b0caf3705c4cdb83b4dbd7452aad81 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:23.666182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce12f-ffb0-4aaa-a953-758c130cf691 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.666766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce12f-ffb0-4aaa-a953-758c130cf691 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.667820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ce12f-ffb0-4aaa-a953-758c130cf691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.677609 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3361/6777] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:23.682599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0f5d2-1f5d-413e-b7be-5c1a595dc57b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:23.695764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0f5d2-1f5d-413e-b7be-5c1a595dc57b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:23.699706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5b0ce12f-ffb0-4aaa-a953-758c130cf691 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:23.701333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b0ce12f-ffb0-4aaa-a953-758c130cf691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:23.788930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd32a-b789-48d5-929f-4481ea4609ff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:23.789609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd32a-b789-48d5-929f-4481ea4609ff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.789898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd32a-b789-48d5-929f-4481ea4609ff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.790727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fdd32a-b789-48d5-929f-4481ea4609ff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.791475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd32a-b789-48d5-929f-4481ea4609ff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:23.793150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fdd32a-b789-48d5-929f-4481ea4609ff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:23.801140 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3417/6778] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:23.813668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce12f-ffb0-4aaa-a953-758c130cf691 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:23.818849 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3362/6779] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:12:23 2022] POST /identity/v3/domains => generated 276 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:23.819036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b0ce12f-ffb0-4aaa-a953-758c130cf691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:23.820047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd32a-b789-48d5-929f-4481ea4609ff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:23.936565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ce12f-ffb0-4aaa-a953-758c130cf691 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:23.946416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fdd32a-b789-48d5-929f-4481ea4609ff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:23.957942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493dd6-f41d-434d-a357-22a9ac66c5e3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:23.960025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493dd6-f41d-434d-a357-22a9ac66c5e3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:23.960483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493dd6-f41d-434d-a357-22a9ac66c5e3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:23.960773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31493dd6-f41d-434d-a357-22a9ac66c5e3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:23.963885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31493dd6-f41d-434d-a357-22a9ac66c5e3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:23.966384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31493dd6-f41d-434d-a357-22a9ac66c5e3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:24.032539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0d9b9-0767-4ab1-992f-68770c858750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:24.033971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0d9b9-0767-4ab1-992f-68770c858750 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.034535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0d9b9-0767-4ab1-992f-68770c858750 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.035063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0d9b9-0767-4ab1-992f-68770c858750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.038619 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3363/6780] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:23 2022] POST /identity/v3/projects => generated 403 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:24.044628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493dd6-f41d-434d-a357-22a9ac66c5e3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:24.133692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0d9b9-0767-4ab1-992f-68770c858750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:24.135801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c0d9b9-0767-4ab1-992f-68770c858750 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:24.145708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31493dd6-f41d-434d-a357-22a9ac66c5e3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:24.152115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e27d-23ea-42d0-8ec7-f5b81aacb61c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:24.154489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e27d-23ea-42d0-8ec7-f5b81aacb61c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.154489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e27d-23ea-42d0-8ec7-f5b81aacb61c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.154489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b86e27d-23ea-42d0-8ec7-f5b81aacb61c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/groups` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.155287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86e27d-23ea-42d0-8ec7-f5b81aacb61c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:24.159418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b86e27d-23ea-42d0-8ec7-f5b81aacb61c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:24.162117 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3418/6781] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:24.176940 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3364/6782] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:12:24 2022] POST /identity/v3/groups => generated 301 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:24.184188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0d9b9-0767-4ab1-992f-68770c858750 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:24.195479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0d9b9-0767-4ab1-992f-68770c858750 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:24.215462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dee20-ed00-4142-87a7-7e60ec777dec tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:24.216413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dee20-ed00-4142-87a7-7e60ec777dec tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.216774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dee20-ed00-4142-87a7-7e60ec777dec tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.217630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dee20-ed00-4142-87a7-7e60ec777dec tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.218494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dee20-ed00-4142-87a7-7e60ec777dec tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:24.220636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dee20-ed00-4142-87a7-7e60ec777dec tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:24.247947 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3419/6783] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:24 2022] POST /identity/v3/users => generated 436 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:24.258956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e27d-23ea-42d0-8ec7-f5b81aacb61c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:24.284814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b86e27d-23ea-42d0-8ec7-f5b81aacb61c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:24.298084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f16eee-a9ff-4b0a-9051-e6574bb10bd6 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:24.299588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f16eee-a9ff-4b0a-9051-e6574bb10bd6 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.302884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f16eee-a9ff-4b0a-9051-e6574bb10bd6 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.303411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f16eee-a9ff-4b0a-9051-e6574bb10bd6 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.304373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f16eee-a9ff-4b0a-9051-e6574bb10bd6 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:24.306512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f16eee-a9ff-4b0a-9051-e6574bb10bd6 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:24.350081 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3365/6784] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:12:24 2022] POST /identity/v3/roles => generated 239 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:24.350778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dee20-ed00-4142-87a7-7e60ec777dec tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:24.366948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dee20-ed00-4142-87a7-7e60ec777dec tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:24.375859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c6bff-4f15-4641-83e6-4ba2a7e4889f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:24.376752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c6bff-4f15-4641-83e6-4ba2a7e4889f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.377041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c6bff-4f15-4641-83e6-4ba2a7e4889f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.377319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c6bff-4f15-4641-83e6-4ba2a7e4889f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/groups/fba9adc4bce044d29882326dbc6aae25/roles/1f81e55e54714095bc2b9bb9968dc5d1/inherited_to_projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.392667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c6bff-4f15-4641-83e6-4ba2a7e4889f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_grant(project_id=39398d836cec4267ac0295f23ff547ef, group_id=fba9adc4bce044d29882326dbc6aae25, role_id=1f81e55e54714095bc2b9bb9968dc5d1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:24.397710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c6bff-4f15-4641-83e6-4ba2a7e4889f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:24.423403 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3420/6785] 10.222.0.16 () {60 vars in 1584 bytes} [Sat Mar 26 21:12:24 2022] PUT /identity/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/groups/fba9adc4bce044d29882326dbc6aae25/roles/1f81e55e54714095bc2b9bb9968dc5d1/inherited_to_projects => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:24.424851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f16eee-a9ff-4b0a-9051-e6574bb10bd6 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:24.440337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f16eee-a9ff-4b0a-9051-e6574bb10bd6 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:24.532640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c6bff-4f15-4641-83e6-4ba2a7e4889f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:24.534419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-810c6bff-4f15-4641-83e6-4ba2a7e4889f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:24.607519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485684d-dcda-4fca-b72f-31b4a2f392a5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:24.608603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485684d-dcda-4fca-b72f-31b4a2f392a5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.609074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485684d-dcda-4fca-b72f-31b4a2f392a5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.609520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485684d-dcda-4fca-b72f-31b4a2f392a5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/groups/fba9adc4bce044d29882326dbc6aae25/roles/1f81e55e54714095bc2b9bb9968dc5d1/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.615687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485684d-dcda-4fca-b72f-31b4a2f392a5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:check_grant(project_id=39398d836cec4267ac0295f23ff547ef, group_id=fba9adc4bce044d29882326dbc6aae25, role_id=1f81e55e54714095bc2b9bb9968dc5d1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:24.625335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485684d-dcda-4fca-b72f-31b4a2f392a5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:24.659578 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3366/6786] 10.222.0.16 () {58 vars in 1566 bytes} [Sat Mar 26 21:12:24 2022] HEAD /identity/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/groups/fba9adc4bce044d29882326dbc6aae25/roles/1f81e55e54714095bc2b9bb9968dc5d1/inherited_to_projects => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:24.666630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485684d-dcda-4fca-b72f-31b4a2f392a5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:24.689432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485684d-dcda-4fca-b72f-31b4a2f392a5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:24.691371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c6bff-4f15-4641-83e6-4ba2a7e4889f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:24.699000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:24.699622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:24.700587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.700885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.701640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.701767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/groups/fba9adc4bce044d29882326dbc6aae25/roles/1f81e55e54714095bc2b9bb9968dc5d1/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.701886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.701886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] PATH_INFO: `/v3/projects/e94e4cb4734c45cda0a7786af1e5a34e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.704441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=39398d836cec4267ac0295f23ff547ef, group_id=fba9adc4bce044d29882326dbc6aae25, role_id=1f81e55e54714095bc2b9bb9968dc5d1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:24.707241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:24.708446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94e4cb4734c45cda0a7786af1e5a34e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:24.710496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:24.720034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role 1f81e55e54714095bc2b9bb9968dc5d1 was removed from group fba9adc4bce044d29882326dbc6aae25 on project 39398d836cec4267ac0295f23ff547ef. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:24.720168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:24.720835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:24.740273 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3367/6787] 10.222.0.16 () {58 vars in 1568 bytes} [Sat Mar 26 21:12:24 2022] DELETE /identity/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/groups/fba9adc4bce044d29882326dbc6aae25/roles/1f81e55e54714095bc2b9bb9968dc5d1/inherited_to_projects => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:24.756784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:24.765896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:24.782721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94e4cb4734c45cda0a7786af1e5a34e', 'request_id': 'req-99dc4008-381f-4a34-9154-dadcf192ff01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:24.794464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94e4cb4734c45cda0a7786af1e5a34e', 'request_id': 'req-99dc4008-381f-4a34-9154-dadcf192ff01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:24.803115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94e4cb4734c45cda0a7786af1e5a34e', 'request_id': 'req-99dc4008-381f-4a34-9154-dadcf192ff01'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:24.826949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] The token cache is being invalidate because project e94e4cb4734c45cda0a7786af1e5a34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:24.828020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:24.828988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99dc4008-381f-4a34-9154-dadcf192ff01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:24.831664 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3421/6788] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:24 2022] DELETE /identity/v3/projects/e94e4cb4734c45cda0a7786af1e5a34e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:24.837576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818160b8-aab5-45ae-9a3f-f3d1a302496e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.838204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818160b8-aab5-45ae-9a3f-f3d1a302496e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.838637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818160b8-aab5-45ae-9a3f-f3d1a302496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.875350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-818160b8-aab5-45ae-9a3f-f3d1a302496e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:24.876856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-818160b8-aab5-45ae-9a3f-f3d1a302496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:24.894592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548406f1-1b02-43f2-a736-52584f12268b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:24.976312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:24.978519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.979134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.979685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles/1f81e55e54714095bc2b9bb9968dc5d1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.986479 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3422/6789] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:24.988165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1f81e55e54714095bc2b9bb9968dc5d1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:24.989035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fdebb-b3f9-40f2-98d0-04569a6f35b6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:24.989488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fdebb-b3f9-40f2-98d0-04569a6f35b6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:24.990036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fdebb-b3f9-40f2-98d0-04569a6f35b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:24.990867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.027511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0f7fdebb-b3f9-40f2-98d0-04569a6f35b6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:25.028591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f7fdebb-b3f9-40f2-98d0-04569a6f35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:25.037642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role 1f81e55e54714095bc2b9bb9968dc5d1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:25.038253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:25.039221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:25.042367 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3423/6790] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:25.042900 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3368/6791] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:24 2022] DELETE /identity/v3/roles/1f81e55e54714095bc2b9bb9968dc5d1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:25.043843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.045968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:25.048382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fdebb-b3f9-40f2-98d0-04569a6f35b6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.050064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0f7fdebb-b3f9-40f2-98d0-04569a6f35b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:25.069265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fdebb-b3f9-40f2-98d0-04569a6f35b6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.142748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a365-1196-4338-8109-3a7c566dc7b3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.143545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a365-1196-4338-8109-3a7c566dc7b3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.143891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a365-1196-4338-8109-3a7c566dc7b3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.144280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1a365-1196-4338-8109-3a7c566dc7b3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.145481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a365-1196-4338-8109-3a7c566dc7b3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.147172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1a365-1196-4338-8109-3a7c566dc7b3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.169223 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3424/6792] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:12:25 2022] POST /identity/v3/roles => generated 240 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:25.173349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a365-1196-4338-8109-3a7c566dc7b3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.179439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66056bee-7f70-4150-b0a3-d0ea5cc83b2c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.187039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118f435-92f9-4714-8b88-6df06664832a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.187950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118f435-92f9-4714-8b88-6df06664832a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.190922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118f435-92f9-4714-8b88-6df06664832a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.191211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118f435-92f9-4714-8b88-6df06664832a admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.191996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118f435-92f9-4714-8b88-6df06664832a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:25.192315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ecb1a365-1196-4338-8109-3a7c566dc7b3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:25.192976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118f435-92f9-4714-8b88-6df06664832a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.195107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118f435-92f9-4714-8b88-6df06664832a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.208119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1a365-1196-4338-8109-3a7c566dc7b3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.211246 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3369/6793] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:25.215683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118f435-92f9-4714-8b88-6df06664832a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.217674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695938-a181-4649-acbe-b3c15cbbccc5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.218585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695938-a181-4649-acbe-b3c15cbbccc5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.218870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695938-a181-4649-acbe-b3c15cbbccc5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.219366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695938-a181-4649-acbe-b3c15cbbccc5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/498746ca1f52463889d8a98375c45287/inherited_to_projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.230515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118f435-92f9-4714-8b88-6df06664832a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.236713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716594-ea58-474c-8a36-61b491fc34aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.237467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716594-ea58-474c-8a36-61b491fc34aa admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.238023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716594-ea58-474c-8a36-61b491fc34aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.238478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01716594-ea58-474c-8a36-61b491fc34aa admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.239275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01716594-ea58-474c-8a36-61b491fc34aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.241347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01716594-ea58-474c-8a36-61b491fc34aa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.250326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695938-a181-4649-acbe-b3c15cbbccc5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_grant(project_id=39398d836cec4267ac0295f23ff547ef, user_id=638dfea8e6014f4999e274d698ce0540, role_id=498746ca1f52463889d8a98375c45287)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.254006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695938-a181-4649-acbe-b3c15cbbccc5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.272157 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3425/6794] 10.222.0.16 () {60 vars in 1581 bytes} [Sat Mar 26 21:12:25 2022] PUT /identity/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/498746ca1f52463889d8a98375c45287/inherited_to_projects => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:25.277030 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3370/6795] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:25 2022] POST /identity/v3/projects => generated 389 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:25.278458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695938-a181-4649-acbe-b3c15cbbccc5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.278868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716594-ea58-474c-8a36-61b491fc34aa admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.358419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01716594-ea58-474c-8a36-61b491fc34aa admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.364131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65675-3d48-49bb-af69-9130e3692c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.364842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65675-3d48-49bb-af69-9130e3692c2e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.365129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65675-3d48-49bb-af69-9130e3692c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.365408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e65675-3d48-49bb-af69-9130e3692c2e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.366105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65675-3d48-49bb-af69-9130e3692c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.369540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e65675-3d48-49bb-af69-9130e3692c2e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.383326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695938-a181-4649-acbe-b3c15cbbccc5 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.407394 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3371/6796] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:25 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:25.410997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65675-3d48-49bb-af69-9130e3692c2e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.422862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e65675-3d48-49bb-af69-9130e3692c2e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.429908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db700b4d-f106-4f5e-8685-e34f32f7b1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.430644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db700b4d-f106-4f5e-8685-e34f32f7b1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.431522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db700b4d-f106-4f5e-8685-e34f32f7b1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.433408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db700b4d-f106-4f5e-8685-e34f32f7b1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.434340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db700b4d-f106-4f5e-8685-e34f32f7b1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.436435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db700b4d-f106-4f5e-8685-e34f32f7b1d7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.449991 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3372/6797] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:25 2022] GET /identity/v3/roles => generated 1651 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:25.454221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db700b4d-f106-4f5e-8685-e34f32f7b1d7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.467379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db700b4d-f106-4f5e-8685-e34f32f7b1d7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.480568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271558e-c395-4580-b110-d9130f1127dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.481498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271558e-c395-4580-b110-d9130f1127dc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.481790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271558e-c395-4580-b110-d9130f1127dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.482070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271558e-c395-4580-b110-d9130f1127dc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.482802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271558e-c395-4580-b110-d9130f1127dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.484850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271558e-c395-4580-b110-d9130f1127dc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.506294 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3373/6798] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:25 2022] GET /identity/v3/roles => generated 1651 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:25.510549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271558e-c395-4580-b110-d9130f1127dc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.534589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29467634-f5aa-4f5b-8c1d-5ef096218e60 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.535449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29467634-f5aa-4f5b-8c1d-5ef096218e60 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.535739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29467634-f5aa-4f5b-8c1d-5ef096218e60 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.536034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29467634-f5aa-4f5b-8c1d-5ef096218e60 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/498746ca1f52463889d8a98375c45287/inherited_to_projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.539715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271558e-c395-4580-b110-d9130f1127dc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.540491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29467634-f5aa-4f5b-8c1d-5ef096218e60 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:check_grant(project_id=39398d836cec4267ac0295f23ff547ef, user_id=638dfea8e6014f4999e274d698ce0540, role_id=498746ca1f52463889d8a98375c45287)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.543193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29467634-f5aa-4f5b-8c1d-5ef096218e60 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.556700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8097-cf26-4e2f-b576-ce7cbb494ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.557694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8097-cf26-4e2f-b576-ce7cbb494ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.557988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8097-cf26-4e2f-b576-ce7cbb494ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.558265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8097-cf26-4e2f-b576-ce7cbb494ccf admin admin] PATH_INFO: `/v3/projects/a38093b64be349f98b602f89a37a8721/users/45fb1f41249b4e9daf200e30e7f150e4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.562429 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3426/6799] 10.222.0.16 () {58 vars in 1563 bytes} [Sat Mar 26 21:12:25 2022] HEAD /identity/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/498746ca1f52463889d8a98375c45287/inherited_to_projects => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:25.563388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29467634-f5aa-4f5b-8c1d-5ef096218e60 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.574620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29467634-f5aa-4f5b-8c1d-5ef096218e60 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.587301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952275d7-a2d5-4a38-be5a-1bdb02c62ac3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.588293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952275d7-a2d5-4a38-be5a-1bdb02c62ac3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.588584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952275d7-a2d5-4a38-be5a-1bdb02c62ac3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.588861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952275d7-a2d5-4a38-be5a-1bdb02c62ac3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/498746ca1f52463889d8a98375c45287/inherited_to_projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.592536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952275d7-a2d5-4a38-be5a-1bdb02c62ac3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=39398d836cec4267ac0295f23ff547ef, user_id=638dfea8e6014f4999e274d698ce0540, role_id=498746ca1f52463889d8a98375c45287)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.597251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c8097-cf26-4e2f-b576-ce7cbb494ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38093b64be349f98b602f89a37a8721, user_id=45fb1f41249b4e9daf200e30e7f150e4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.597411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952275d7-a2d5-4a38-be5a-1bdb02c62ac3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.604469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c8097-cf26-4e2f-b576-ce7cbb494ccf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:25.608482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-952275d7-a2d5-4a38-be5a-1bdb02c62ac3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role 498746ca1f52463889d8a98375c45287 was removed from user 638dfea8e6014f4999e274d698ce0540 on project 39398d836cec4267ac0295f23ff547ef. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:25.608778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-952275d7-a2d5-4a38-be5a-1bdb02c62ac3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:25.610325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-952275d7-a2d5-4a38-be5a-1bdb02c62ac3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:25.631131 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3374/6800] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:25 2022] PUT /identity/v3/projects/a38093b64be349f98b602f89a37a8721/users/45fb1f41249b4e9daf200e30e7f150e4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:25.639431 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3427/6801] 10.222.0.16 () {58 vars in 1565 bytes} [Sat Mar 26 21:12:25 2022] DELETE /identity/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/498746ca1f52463889d8a98375c45287/inherited_to_projects => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:25.641087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8097-cf26-4e2f-b576-ce7cbb494ccf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.643702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce11c0-e4c0-4f5f-b628-75a6b660b095 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.644012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce11c0-e4c0-4f5f-b628-75a6b660b095 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.645165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f05c8097-cf26-4e2f-b576-ce7cbb494ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:25.646599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ce11c0-e4c0-4f5f-b628-75a6b660b095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.711092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-64ce11c0-e4c0-4f5f-b628-75a6b660b095 None None] MFA Rules not processed for user `45fb1f41249b4e9daf200e30e7f150e4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:25.714356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-64ce11c0-e4c0-4f5f-b628-75a6b660b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:25.809589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8097-cf26-4e2f-b576-ce7cbb494ccf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:25.876934 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3428/6802] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:25.902817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce11c0-e4c0-4f5f-b628-75a6b660b095 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:25.907339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-64ce11c0-e4c0-4f5f-b628-75a6b660b095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:25.924780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:25.925708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:25.926004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:25.926279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles/498746ca1f52463889d8a98375c45287` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:25.934531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_role(role_id=498746ca1f52463889d8a98375c45287)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:25.937032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:26.023874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role 498746ca1f52463889d8a98375c45287 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:26.029232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:26.030445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:26.033102 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3375/6803] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:25 2022] DELETE /identity/v3/roles/498746ca1f52463889d8a98375c45287 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:26.038705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:26.042099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:26.060670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ce11c0-e4c0-4f5f-b628-75a6b660b095 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:26.140395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e41450-c5e1-4789-8dc7-02345091f24b tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:26.145461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806c870-8150-4caf-a918-19c8418830a1 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:26.146457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806c870-8150-4caf-a918-19c8418830a1 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:26.146907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806c870-8150-4caf-a918-19c8418830a1 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:26.147349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806c870-8150-4caf-a918-19c8418830a1 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:26.148308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806c870-8150-4caf-a918-19c8418830a1 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:26.150358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f806c870-8150-4caf-a918-19c8418830a1 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:26.155845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57814-1f6d-4e3f-ae1f-af80c6054bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:26.156441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57814-1f6d-4e3f-ae1f-af80c6054bee service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:26.157023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57814-1f6d-4e3f-ae1f-af80c6054bee service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:26.157484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57814-1f6d-4e3f-ae1f-af80c6054bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:26.161425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cad57814-1f6d-4e3f-ae1f-af80c6054bee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:26.176398 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3376/6804] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:12:26 2022] POST /identity/v3/roles => generated 239 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:26.180059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806c870-8150-4caf-a918-19c8418830a1 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:26.199290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806c870-8150-4caf-a918-19c8418830a1 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:26.209685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74e275-49b3-498c-8cd4-b203e8939ef8 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:26.212119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74e275-49b3-498c-8cd4-b203e8939ef8 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:26.212480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74e275-49b3-498c-8cd4-b203e8939ef8 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:26.212838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74e275-49b3-498c-8cd4-b203e8939ef8 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/groups/fba9adc4bce044d29882326dbc6aae25/roles/01c33668eb224ca88acd60466693621d/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:26.215554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74e275-49b3-498c-8cd4-b203e8939ef8 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f35f425d5cb040b8a0f01806bd7659c8, group_id=fba9adc4bce044d29882326dbc6aae25, role_id=01c33668eb224ca88acd60466693621d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:26.218840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74e275-49b3-498c-8cd4-b203e8939ef8 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:26.247664 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3377/6805] 10.222.0.16 () {60 vars in 1581 bytes} [Sat Mar 26 21:12:26 2022] PUT /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/groups/fba9adc4bce044d29882326dbc6aae25/roles/01c33668eb224ca88acd60466693621d/inherited_to_projects => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:26.249141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74e275-49b3-498c-8cd4-b203e8939ef8 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:26.303440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad57814-1f6d-4e3f-ae1f-af80c6054bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:26.305052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad57814-1f6d-4e3f-ae1f-af80c6054bee service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:26.324655 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3429/6806] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:26.355527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74e275-49b3-498c-8cd4-b203e8939ef8 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:26.365161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd566d-cf1c-4855-abb7-c781df60a0e7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:26.366080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd566d-cf1c-4855-abb7-c781df60a0e7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:26.366410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd566d-cf1c-4855-abb7-c781df60a0e7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:26.366697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd566d-cf1c-4855-abb7-c781df60a0e7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/groups/fba9adc4bce044d29882326dbc6aae25/roles/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:26.368777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd566d-cf1c-4855-abb7-c781df60a0e7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f35f425d5cb040b8a0f01806bd7659c8, group_id=fba9adc4bce044d29882326dbc6aae25)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:26.374323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd566d-cf1c-4855-abb7-c781df60a0e7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:26.391143 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3378/6807] 10.222.0.16 () {58 vars in 1463 bytes} [Sat Mar 26 21:12:26 2022] GET /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/groups/fba9adc4bce044d29882326dbc6aae25/roles/inherited_to_projects => generated 447 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:26.397737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57814-1f6d-4e3f-ae1f-af80c6054bee service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:26.421025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57814-1f6d-4e3f-ae1f-af80c6054bee service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:26.428007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eba6f-abc8-4eba-8e32-957aabf997fe tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:26.429963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eba6f-abc8-4eba-8e32-957aabf997fe tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:26.430093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eba6f-abc8-4eba-8e32-957aabf997fe tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:26.430272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56eba6f-abc8-4eba-8e32-957aabf997fe tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/groups/fba9adc4bce044d29882326dbc6aae25/roles/01c33668eb224ca88acd60466693621d/inherited_to_projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:26.439017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eba6f-abc8-4eba-8e32-957aabf997fe tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f35f425d5cb040b8a0f01806bd7659c8, group_id=fba9adc4bce044d29882326dbc6aae25, role_id=01c33668eb224ca88acd60466693621d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:26.442082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56eba6f-abc8-4eba-8e32-957aabf997fe tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:26.449591 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3430/6808] 10.222.0.16 () {58 vars in 1563 bytes} [Sat Mar 26 21:12:26 2022] HEAD /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/groups/fba9adc4bce044d29882326dbc6aae25/roles/01c33668eb224ca88acd60466693621d/inherited_to_projects => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:26.457058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd566d-cf1c-4855-abb7-c781df60a0e7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:26.490854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd566d-cf1c-4855-abb7-c781df60a0e7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:26.497307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:26.498266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:26.498631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:26.498993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/groups/fba9adc4bce044d29882326dbc6aae25/roles/01c33668eb224ca88acd60466693621d/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:26.501532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f35f425d5cb040b8a0f01806bd7659c8, group_id=fba9adc4bce044d29882326dbc6aae25, role_id=01c33668eb224ca88acd60466693621d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:26.504424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:26.514321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role 01c33668eb224ca88acd60466693621d was removed from group fba9adc4bce044d29882326dbc6aae25 on domain f35f425d5cb040b8a0f01806bd7659c8. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:26.514632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:26.516179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:26.538291 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3379/6809] 10.222.0.16 () {58 vars in 1565 bytes} [Sat Mar 26 21:12:26 2022] DELETE /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/groups/fba9adc4bce044d29882326dbc6aae25/roles/01c33668eb224ca88acd60466693621d/inherited_to_projects => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:26.543165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eba6f-abc8-4eba-8e32-957aabf997fe tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:26.544891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d56eba6f-abc8-4eba-8e32-957aabf997fe tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:26.565734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56eba6f-abc8-4eba-8e32-957aabf997fe tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:26.692442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:26.693728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:26.694222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:26.694720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles/01c33668eb224ca88acd60466693621d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:26.697735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_role(role_id=01c33668eb224ca88acd60466693621d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:26.700021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:26.757393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role 01c33668eb224ca88acd60466693621d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:26.757784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:26.759194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:26.768483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:26.769207 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3431/6810] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:26 2022] DELETE /identity/v3/roles/01c33668eb224ca88acd60466693621d => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:26.780607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2913ce-3cd5-4e8b-86a2-989417d9202e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:26.886763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beae1b-5fe7-4c0c-9f81-17f24e9fba29 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:26.887756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beae1b-5fe7-4c0c-9f81-17f24e9fba29 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:26.888277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beae1b-5fe7-4c0c-9f81-17f24e9fba29 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:26.888740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5beae1b-5fe7-4c0c-9f81-17f24e9fba29 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:26.889725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beae1b-5fe7-4c0c-9f81-17f24e9fba29 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:26.891621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5beae1b-5fe7-4c0c-9f81-17f24e9fba29 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:26.920033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:26.921508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:26.932461 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3380/6811] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:12:26 2022] POST /identity/v3/roles => generated 240 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:26.948978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d795bf6-22d8-4dfa-b055-943bf6036a6a tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:26.958012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0c52-8260-42ea-b8b7-a7864cfe6e65 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:26.959484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0c52-8260-42ea-b8b7-a7864cfe6e65 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:26.959949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0c52-8260-42ea-b8b7-a7864cfe6e65 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:26.964610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac0c52-8260-42ea-b8b7-a7864cfe6e65 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/976019bf702645b4ad450dea4a1e5b42/inherited_to_projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:26.971455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0c52-8260-42ea-b8b7-a7864cfe6e65 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f35f425d5cb040b8a0f01806bd7659c8, user_id=638dfea8e6014f4999e274d698ce0540, role_id=976019bf702645b4ad450dea4a1e5b42)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:26.978414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac0c52-8260-42ea-b8b7-a7864cfe6e65 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:27.013710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beae1b-5fe7-4c0c-9f81-17f24e9fba29 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:27.014617 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3432/6812] 10.222.0.16 () {60 vars in 1578 bytes} [Sat Mar 26 21:12:26 2022] PUT /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/976019bf702645b4ad450dea4a1e5b42/inherited_to_projects => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:27.026136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5beae1b-5fe7-4c0c-9f81-17f24e9fba29 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:27.127876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df9d3a-3911-456b-9f96-8d76815c7546 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:27.129137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9d3a-3911-456b-9f96-8d76815c7546 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:27.129432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9d3a-3911-456b-9f96-8d76815c7546 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:27.129714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df9d3a-3911-456b-9f96-8d76815c7546 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:27.131844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df9d3a-3911-456b-9f96-8d76815c7546 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f35f425d5cb040b8a0f01806bd7659c8, user_id=638dfea8e6014f4999e274d698ce0540)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:27.134697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df9d3a-3911-456b-9f96-8d76815c7546 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:27.152838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0c52-8260-42ea-b8b7-a7864cfe6e65 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:27.164135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac0c52-8260-42ea-b8b7-a7864cfe6e65 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:27.165134 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3381/6813] 10.222.0.16 () {58 vars in 1460 bytes} [Sat Mar 26 21:12:27 2022] GET /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/inherited_to_projects => generated 447 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:27.171146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d16cb5-b92f-4a39-9980-bdfcd17ac146 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:27.172413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d16cb5-b92f-4a39-9980-bdfcd17ac146 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:27.172709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d16cb5-b92f-4a39-9980-bdfcd17ac146 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:27.172998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d16cb5-b92f-4a39-9980-bdfcd17ac146 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/976019bf702645b4ad450dea4a1e5b42/inherited_to_projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:27.175364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d16cb5-b92f-4a39-9980-bdfcd17ac146 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f35f425d5cb040b8a0f01806bd7659c8, user_id=638dfea8e6014f4999e274d698ce0540, role_id=976019bf702645b4ad450dea4a1e5b42)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:27.178991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d16cb5-b92f-4a39-9980-bdfcd17ac146 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:27.188911 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3433/6814] 10.222.0.16 () {58 vars in 1560 bytes} [Sat Mar 26 21:12:27 2022] HEAD /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/976019bf702645b4ad450dea4a1e5b42/inherited_to_projects => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:27.191317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df9d3a-3911-456b-9f96-8d76815c7546 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:27.203137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df9d3a-3911-456b-9f96-8d76815c7546 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:27.209060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:27.210092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:27.210473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:27.211017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/976019bf702645b4ad450dea4a1e5b42/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:27.214541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f35f425d5cb040b8a0f01806bd7659c8, user_id=638dfea8e6014f4999e274d698ce0540, role_id=976019bf702645b4ad450dea4a1e5b42)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:27.217593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:27.228454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role 976019bf702645b4ad450dea4a1e5b42 was removed from user 638dfea8e6014f4999e274d698ce0540 on domain f35f425d5cb040b8a0f01806bd7659c8. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:27.228996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:27.230504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:27.259797 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3382/6815] 10.222.0.16 () {58 vars in 1562 bytes} [Sat Mar 26 21:12:27 2022] DELETE /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/976019bf702645b4ad450dea4a1e5b42/inherited_to_projects => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:27.261053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d16cb5-b92f-4a39-9980-bdfcd17ac146 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:27.265272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-46d16cb5-b92f-4a39-9980-bdfcd17ac146 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:27.285498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d16cb5-b92f-4a39-9980-bdfcd17ac146 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:27.383563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:27.385049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:27.385893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:27.386349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles/976019bf702645b4ad450dea4a1e5b42` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:27.389932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_role(role_id=976019bf702645b4ad450dea4a1e5b42)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:27.393179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:27.466905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role 976019bf702645b4ad450dea4a1e5b42 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:27.467312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:27.468019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:27.470692 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3434/6816] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:27 2022] DELETE /identity/v3/roles/976019bf702645b4ad450dea4a1e5b42 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:27.476145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:27.489329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b15eb-dff2-4200-ad67-ed9598a5c59e tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:27.593191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fbd0c-4503-4d31-a84f-c67f0faabd94 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:27.594007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fbd0c-4503-4d31-a84f-c67f0faabd94 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:27.596522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fbd0c-4503-4d31-a84f-c67f0faabd94 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:27.596969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fbd0c-4503-4d31-a84f-c67f0faabd94 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:27.598112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fbd0c-4503-4d31-a84f-c67f0faabd94 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:27.599866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fbd0c-4503-4d31-a84f-c67f0faabd94 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:27.630358 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3383/6817] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:12:27 2022] POST /identity/v3/roles => generated 240 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:27.634592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:27.636131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:27.665101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ddf701-eb06-4720-a239-dd3d299866c7 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:27.672308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a9879-24f3-4f2a-8861-e8da29d8b897 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:27.673566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9879-24f3-4f2a-8861-e8da29d8b897 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:27.673566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9879-24f3-4f2a-8861-e8da29d8b897 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:27.673566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a9879-24f3-4f2a-8861-e8da29d8b897 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:27.678608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a9879-24f3-4f2a-8861-e8da29d8b897 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:27.680900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a9879-24f3-4f2a-8861-e8da29d8b897 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:27.734707 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3435/6818] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:27 2022] POST /identity/v3/projects => generated 408 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:27.738597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fbd0c-4503-4d31-a84f-c67f0faabd94 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:27.752689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fbd0c-4503-4d31-a84f-c67f0faabd94 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:27.851022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fb2da-51f4-4781-aee3-33d5a9e4ee59 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:27.852327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fb2da-51f4-4781-aee3-33d5a9e4ee59 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:27.852755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fb2da-51f4-4781-aee3-33d5a9e4ee59 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:27.853231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20fb2da-51f4-4781-aee3-33d5a9e4ee59 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/f541ae9bb1ba449d8cc78dbdaea6b76a/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:27.857262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fb2da-51f4-4781-aee3-33d5a9e4ee59 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f35f425d5cb040b8a0f01806bd7659c8, user_id=638dfea8e6014f4999e274d698ce0540, role_id=f541ae9bb1ba449d8cc78dbdaea6b76a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:27.862783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20fb2da-51f4-4781-aee3-33d5a9e4ee59 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:27.889276 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3384/6819] 10.222.0.16 () {60 vars in 1578 bytes} [Sat Mar 26 21:12:27 2022] PUT /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/f541ae9bb1ba449d8cc78dbdaea6b76a/inherited_to_projects => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:27.894071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a9879-24f3-4f2a-8861-e8da29d8b897 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:27.915083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a9879-24f3-4f2a-8861-e8da29d8b897 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:28.075724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441da4-968a-4c14-bc70-0be278b0a0c9 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:28.076700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441da4-968a-4c14-bc70-0be278b0a0c9 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:28.086823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441da4-968a-4c14-bc70-0be278b0a0c9 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:28.087753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69441da4-968a-4c14-bc70-0be278b0a0c9 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:28.089019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441da4-968a-4c14-bc70-0be278b0a0c9 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Adding query filter params (scope.project.id=39398d836cec4267ac0295f23ff547ef, user.id=638dfea8e6014f4999e274d698ce0540) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:28.090044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441da4-968a-4c14-bc70-0be278b0a0c9 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:28.103874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69441da4-968a-4c14-bc70-0be278b0a0c9 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:28.196845 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3436/6820] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Mar 26 21:12:27 2022] GET /identity/v3/role_assignments?scope.project.id=39398d836cec4267ac0295f23ff547ef&user.id=638dfea8e6014f4999e274d698ce0540&effective => generated 648 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:28.200802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fb2da-51f4-4781-aee3-33d5a9e4ee59 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:28.222115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20fb2da-51f4-4781-aee3-33d5a9e4ee59 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:28.235858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:28.236814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:28.237328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:28.237874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:28.241181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Adding query filter params (scope.project.id=687a87c65dd44ad783a3880255d9ea47, user.id=638dfea8e6014f4999e274d698ce0540) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:28.241744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:28.252290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:28.348398 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3385/6821] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Mar 26 21:12:28 2022] GET /identity/v3/role_assignments?scope.project.id=687a87c65dd44ad783a3880255d9ea47&user.id=638dfea8e6014f4999e274d698ce0540&effective => generated 648 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:28.353102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441da4-968a-4c14-bc70-0be278b0a0c9 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:28.365430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69441da4-968a-4c14-bc70-0be278b0a0c9 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:28.384637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74213a-b9d9-4dd6-918d-8590c2ddabca tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:28.385531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74213a-b9d9-4dd6-918d-8590c2ddabca tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:28.385820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74213a-b9d9-4dd6-918d-8590c2ddabca tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:28.386118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74213a-b9d9-4dd6-918d-8590c2ddabca tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/f541ae9bb1ba449d8cc78dbdaea6b76a/inherited_to_projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:28.393945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74213a-b9d9-4dd6-918d-8590c2ddabca tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f35f425d5cb040b8a0f01806bd7659c8, user_id=638dfea8e6014f4999e274d698ce0540, role_id=f541ae9bb1ba449d8cc78dbdaea6b76a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:28.399224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74213a-b9d9-4dd6-918d-8590c2ddabca tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:28.414761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fc74213a-b9d9-4dd6-918d-8590c2ddabca tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role f541ae9bb1ba449d8cc78dbdaea6b76a was removed from user 638dfea8e6014f4999e274d698ce0540 on domain f35f425d5cb040b8a0f01806bd7659c8. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:28.415967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fc74213a-b9d9-4dd6-918d-8590c2ddabca tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:28.416988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fc74213a-b9d9-4dd6-918d-8590c2ddabca tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:28.448736 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3437/6822] 10.222.0.16 () {58 vars in 1562 bytes} [Sat Mar 26 21:12:28 2022] DELETE /identity/v3/OS-INHERIT/domains/f35f425d5cb040b8a0f01806bd7659c8/users/638dfea8e6014f4999e274d698ce0540/roles/f541ae9bb1ba449d8cc78dbdaea6b76a/inherited_to_projects => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:28.449000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:28.450720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:28.469545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7e5fc8-475b-494b-99ba-c346cacc1abd tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:28.568105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e080ba-2621-438d-a2f9-376185200379 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:28.569118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e080ba-2621-438d-a2f9-376185200379 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:28.569411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e080ba-2621-438d-a2f9-376185200379 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:28.569694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e080ba-2621-438d-a2f9-376185200379 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:28.570554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e080ba-2621-438d-a2f9-376185200379 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Adding query filter params (scope.project.id=39398d836cec4267ac0295f23ff547ef, user.id=638dfea8e6014f4999e274d698ce0540) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:28.570913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e080ba-2621-438d-a2f9-376185200379 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:28.573737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e080ba-2621-438d-a2f9-376185200379 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:28.634168 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3386/6823] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Mar 26 21:12:28 2022] GET /identity/v3/role_assignments?scope.project.id=39398d836cec4267ac0295f23ff547ef&user.id=638dfea8e6014f4999e274d698ce0540&effective => generated 228 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:12:28.639883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ff106-54b8-4168-a794-94d46e2fbf9c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:28.640392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ff106-54b8-4168-a794-94d46e2fbf9c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:28.640693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ff106-54b8-4168-a794-94d46e2fbf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:28.641091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e080ba-2621-438d-a2f9-376185200379 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:28.658510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e080ba-2621-438d-a2f9-376185200379 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:28.667462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38d62-9d6e-4173-848f-f60efe5e8eff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:28.668351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38d62-9d6e-4173-848f-f60efe5e8eff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:28.668870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38d62-9d6e-4173-848f-f60efe5e8eff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:28.669317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb38d62-9d6e-4173-848f-f60efe5e8eff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:28.670030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c35ff106-54b8-4168-a794-94d46e2fbf9c None None] MFA Rules not processed for user `41ad4fbc224446efaf5ad85c8c87eeab`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:28.670957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38d62-9d6e-4173-848f-f60efe5e8eff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Adding query filter params (scope.project.id=687a87c65dd44ad783a3880255d9ea47, user.id=638dfea8e6014f4999e274d698ce0540) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:28.671584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38d62-9d6e-4173-848f-f60efe5e8eff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:28.671716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c35ff106-54b8-4168-a794-94d46e2fbf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:28.675518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb38d62-9d6e-4173-848f-f60efe5e8eff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:28.752905 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3387/6824] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Mar 26 21:12:28 2022] GET /identity/v3/role_assignments?scope.project.id=687a87c65dd44ad783a3880255d9ea47&user.id=638dfea8e6014f4999e274d698ce0540&effective => generated 228 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:28.756338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38d62-9d6e-4173-848f-f60efe5e8eff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:28.769700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb38d62-9d6e-4173-848f-f60efe5e8eff tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:28.770174 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3438/6825] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:28.775532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:28.776703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:28.776996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:28.777264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/projects/687a87c65dd44ad783a3880255d9ea47` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:28.778491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_project(project_id=687a87c65dd44ad783a3880255d9ea47)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:28.791760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:28.903534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '687a87c65dd44ad783a3880255d9ea47', 'request_id': 'req-ea77ebd8-6679-4a87-b541-3f823f315698'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:28.915873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '687a87c65dd44ad783a3880255d9ea47', 'request_id': 'req-ea77ebd8-6679-4a87-b541-3f823f315698'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:28.930385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '687a87c65dd44ad783a3880255d9ea47', 'request_id': 'req-ea77ebd8-6679-4a87-b541-3f823f315698'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:28.948783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] The token cache is being invalidate because project 687a87c65dd44ad783a3880255d9ea47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:28.948783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:28.949271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:28.957258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ff106-54b8-4168-a794-94d46e2fbf9c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:28.959483 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3388/6826] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:28 2022] DELETE /identity/v3/projects/687a87c65dd44ad783a3880255d9ea47 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:28.980119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ff106-54b8-4168-a794-94d46e2fbf9c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:29.146547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:29.147432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:29.147723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:29.148101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles/f541ae9bb1ba449d8cc78dbdaea6b76a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:29.150329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f541ae9bb1ba449d8cc78dbdaea6b76a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:29.152028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:29.199879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role f541ae9bb1ba449d8cc78dbdaea6b76a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:29.200511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:29.201649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:29.204584 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3439/6827] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:28 2022] DELETE /identity/v3/roles/f541ae9bb1ba449d8cc78dbdaea6b76a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:29.209489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:29.211616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:29.242151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea77ebd8-6679-4a87-b541-3f823f315698 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:29.345160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5656fec-3589-4c71-b4eb-771d7b6fc2a2 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:29.346660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5656fec-3589-4c71-b4eb-771d7b6fc2a2 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:29.347058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5656fec-3589-4c71-b4eb-771d7b6fc2a2 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:29.347411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5656fec-3589-4c71-b4eb-771d7b6fc2a2 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:29.348356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5656fec-3589-4c71-b4eb-771d7b6fc2a2 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:29.350704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5656fec-3589-4c71-b4eb-771d7b6fc2a2 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:29.387504 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3389/6828] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:12:29 2022] POST /identity/v3/roles => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:29.391600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:29.393285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:29.407750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e1f4-8f19-4890-8581-2f344e4653db tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:29.413915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4985335-106d-4360-917d-1f7083feb8f3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:29.416250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4985335-106d-4360-917d-1f7083feb8f3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:29.417534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4985335-106d-4360-917d-1f7083feb8f3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:29.418995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4985335-106d-4360-917d-1f7083feb8f3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:29.419806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4985335-106d-4360-917d-1f7083feb8f3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:29.423546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4985335-106d-4360-917d-1f7083feb8f3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:29.474689 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3440/6829] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:29 2022] POST /identity/v3/projects => generated 410 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:29.479680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5656fec-3589-4c71-b4eb-771d7b6fc2a2 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:29.496346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5656fec-3589-4c71-b4eb-771d7b6fc2a2 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:29.582279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc366c-f557-4bbe-a392-462dfd07423c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:29.583451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc366c-f557-4bbe-a392-462dfd07423c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:29.583882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc366c-f557-4bbe-a392-462dfd07423c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:29.584453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc366c-f557-4bbe-a392-462dfd07423c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/ba8af357a3f54ef18bcf4d0db35cc05f/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:29.588357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc366c-f557-4bbe-a392-462dfd07423c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:create_grant(project_id=39398d836cec4267ac0295f23ff547ef, user_id=638dfea8e6014f4999e274d698ce0540, role_id=ba8af357a3f54ef18bcf4d0db35cc05f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:29.592208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc366c-f557-4bbe-a392-462dfd07423c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:29.611267 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3390/6830] 10.222.0.16 () {60 vars in 1581 bytes} [Sat Mar 26 21:12:29 2022] PUT /identity/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/ba8af357a3f54ef18bcf4d0db35cc05f/inherited_to_projects => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:29.617041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4985335-106d-4360-917d-1f7083feb8f3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:29.640463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4985335-106d-4360-917d-1f7083feb8f3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:29.730510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:29.731263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:29.731904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:29.731904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:29.732755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Adding query filter params (scope.project.id=aa90a1eacf0d41a8859ae31b20fb78f1, user.id=638dfea8e6014f4999e274d698ce0540) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:29.733478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:29.735285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:29.863112 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3441/6831] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Mar 26 21:12:29 2022] GET /identity/v3/role_assignments?scope.project.id=aa90a1eacf0d41a8859ae31b20fb78f1&user.id=638dfea8e6014f4999e274d698ce0540&effective => generated 649 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:29.864195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc366c-f557-4bbe-a392-462dfd07423c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:29.887449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc366c-f557-4bbe-a392-462dfd07423c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:29.909003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:29.913052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:29.913369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:29.913651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/ba8af357a3f54ef18bcf4d0db35cc05f/inherited_to_projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:29.926004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=39398d836cec4267ac0295f23ff547ef, user_id=638dfea8e6014f4999e274d698ce0540, role_id=ba8af357a3f54ef18bcf4d0db35cc05f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:29.930301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:29.937246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role ba8af357a3f54ef18bcf4d0db35cc05f was removed from user 638dfea8e6014f4999e274d698ce0540 on project 39398d836cec4267ac0295f23ff547ef. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:29.937559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:29.938348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:29.957706 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3391/6832] 10.222.0.16 () {58 vars in 1565 bytes} [Sat Mar 26 21:12:29 2022] DELETE /identity/v3/OS-INHERIT/projects/39398d836cec4267ac0295f23ff547ef/users/638dfea8e6014f4999e274d698ce0540/roles/ba8af357a3f54ef18bcf4d0db35cc05f/inherited_to_projects => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:29.961603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:29.964404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:29.983750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92b6c2-36d8-47c4-9e42-a71fe834c31c tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:30.087988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:30.088732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:30.089015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:30.089297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:30.090119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Adding query filter params (scope.project.id=aa90a1eacf0d41a8859ae31b20fb78f1, user.id=638dfea8e6014f4999e274d698ce0540) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:30.090427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:30.092448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:30.173181 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3442/6833] 10.222.0.16 () {58 vars in 1355 bytes} [Sat Mar 26 21:12:29 2022] GET /identity/v3/role_assignments?scope.project.id=aa90a1eacf0d41a8859ae31b20fb78f1&user.id=638dfea8e6014f4999e274d698ce0540&effective => generated 228 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:30.177401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:30.217793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b04889-651b-48b0-bd52-cd468ab7adf0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:30.224312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:30.225244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:30.225769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:30.226264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/projects/aa90a1eacf0d41a8859ae31b20fb78f1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:30.227542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aa90a1eacf0d41a8859ae31b20fb78f1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:30.229506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:30.296684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa90a1eacf0d41a8859ae31b20fb78f1', 'request_id': 'req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.308708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa90a1eacf0d41a8859ae31b20fb78f1', 'request_id': 'req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.317982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa90a1eacf0d41a8859ae31b20fb78f1', 'request_id': 'req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.334235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] The token cache is being invalidate because project aa90a1eacf0d41a8859ae31b20fb78f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:30.334565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.335237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.341325 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3392/6834] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:30 2022] DELETE /identity/v3/projects/aa90a1eacf0d41a8859ae31b20fb78f1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:30.342631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:30.344834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:30.375301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca3274-7ef5-48e8-8304-81c826c3e4b0 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:30.495012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:30.497104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:30.497231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:30.497457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/roles/ba8af357a3f54ef18bcf4d0db35cc05f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:30.504004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ba8af357a3f54ef18bcf4d0db35cc05f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:30.504004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:30.601083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invalidating the token cache because role ba8af357a3f54ef18bcf4d0db35cc05f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:30.601083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.601987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.604836 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3443/6835] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:30 2022] DELETE /identity/v3/roles/ba8af357a3f54ef18bcf4d0db35cc05f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:30.611902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:30.627310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efb568-f4b9-4ef8-a6bb-c55d7e6c021f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:30.779859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:30.785365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:30.785973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:30.787106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/users/638dfea8e6014f4999e274d698ce0540` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:30.788598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_user(user_id=638dfea8e6014f4999e274d698ce0540)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:30.793138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:30.894234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '638dfea8e6014f4999e274d698ce0540'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.915731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '638dfea8e6014f4999e274d698ce0540'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.916864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '638dfea8e6014f4999e274d698ce0540'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.917886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '638dfea8e6014f4999e274d698ce0540'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.934217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '638dfea8e6014f4999e274d698ce0540'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:30.964467 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3393/6836] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:30 2022] DELETE /identity/v3/users/638dfea8e6014f4999e274d698ce0540 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:30.965915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:30.968048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:31.019371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78c260-4d19-422c-aa45-43761dfbd240 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:31.238049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306cdfd-f6a9-4fe3-b124-6fb18b522a2f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:31.239852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306cdfd-f6a9-4fe3-b124-6fb18b522a2f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:31.240401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306cdfd-f6a9-4fe3-b124-6fb18b522a2f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:31.241617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306cdfd-f6a9-4fe3-b124-6fb18b522a2f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/groups/fba9adc4bce044d29882326dbc6aae25` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:31.243709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306cdfd-f6a9-4fe3-b124-6fb18b522a2f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_group(group_id=fba9adc4bce044d29882326dbc6aae25)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:31.253188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306cdfd-f6a9-4fe3-b124-6fb18b522a2f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:31.370257 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3444/6837] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:12:30 2022] DELETE /identity/v3/groups/fba9adc4bce044d29882326dbc6aae25 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:31.374562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:31.377264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:31.405125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0501ff-f18b-416b-9522-a977b16c8937 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:31.577366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:31.578534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:31.579133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:31.579582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/projects/39398d836cec4267ac0295f23ff547ef` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:31.581369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_project(project_id=39398d836cec4267ac0295f23ff547ef)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:31.584487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:31.691934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39398d836cec4267ac0295f23ff547ef', 'request_id': 'req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:31.714164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39398d836cec4267ac0295f23ff547ef', 'request_id': 'req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:31.726346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39398d836cec4267ac0295f23ff547ef', 'request_id': 'req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:31.762929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] The token cache is being invalidate because project 39398d836cec4267ac0295f23ff547ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:31.763260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:31.764310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:31.769145 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3394/6838] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:31 2022] DELETE /identity/v3/projects/39398d836cec4267ac0295f23ff547ef => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:31.780316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306cdfd-f6a9-4fe3-b124-6fb18b522a2f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:31.783127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e306cdfd-f6a9-4fe3-b124-6fb18b522a2f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:31.800564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306cdfd-f6a9-4fe3-b124-6fb18b522a2f tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:31.886765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:31.895179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:31.895692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:31.896043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/domains/f35f425d5cb040b8a0f01806bd7659c8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:31.898455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f35f425d5cb040b8a0f01806bd7659c8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:31.900843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:31.935666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:31.936465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:31.979079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:31.979820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:31.983635 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3445/6839] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:12:31 2022] PATCH /identity/v3/domains/f35f425d5cb040b8a0f01806bd7659c8 => generated 277 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:31.987843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:32.000541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c8e44-8cdc-4a5e-9f58-9f5ed2bb1022 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:32.127217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee0ac18493c4998bdff8c6f6d4ec227', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad005b7863904096a94a83a519610fd0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:32.128703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:32.129027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:32.129267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] PATH_INFO: `/v3/domains/f35f425d5cb040b8a0f01806bd7659c8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:32.144094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f35f425d5cb040b8a0f01806bd7659c8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:32.147153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:32.192269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.196376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.252900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8', 'request_id': 'req-6c53b44d-887f-4038-9788-7081279873cf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.261239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8', 'request_id': 'req-6c53b44d-887f-4038-9788-7081279873cf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.267941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8', 'request_id': 'req-6c53b44d-887f-4038-9788-7081279873cf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.284365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] The token cache is being invalidate because project f35f425d5cb040b8a0f01806bd7659c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:32.285000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.287039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.296885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8', 'request_id': 'req-6c53b44d-887f-4038-9788-7081279873cf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.297607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8', 'request_id': 'req-6c53b44d-887f-4038-9788-7081279873cf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.298234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c53b44d-887f-4038-9788-7081279873cf tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f35f425d5cb040b8a0f01806bd7659c8', 'request_id': 'req-6c53b44d-887f-4038-9788-7081279873cf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.308421 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3395/6840] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:12:31 2022] DELETE /identity/v3/domains/f35f425d5cb040b8a0f01806bd7659c8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:32.312361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:32.315502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:32.467611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2688ca8-3d58-4e60-9cab-efefc5caaef3 tempest-InheritsV3TestJSON-173492346 tempest-InheritsV3TestJSON-173492346-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:32.557596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:32.565793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:32.566231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:32.566525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] PATH_INFO: `/v3/users/fc3bc99ab8624397a49ebeb358e845e6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:32.579001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3bc99ab8624397a49ebeb358e845e6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:32.583166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:32.707090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3bc99ab8624397a49ebeb358e845e6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.733435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3bc99ab8624397a49ebeb358e845e6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.740094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3bc99ab8624397a49ebeb358e845e6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.741598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3bc99ab8624397a49ebeb358e845e6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.771421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3bc99ab8624397a49ebeb358e845e6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:32.838126 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3446/6841] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:32 2022] DELETE /identity/v3/users/fc3bc99ab8624397a49ebeb358e845e6 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:32.843575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a73a1-6c0d-45ac-8c7c-0af37751f76b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:32.844057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a73a1-6c0d-45ac-8c7c-0af37751f76b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:32.844249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a73a1-6c0d-45ac-8c7c-0af37751f76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:32.877180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-dd0a73a1-6c0d-45ac-8c7c-0af37751f76b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:32.878441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dd0a73a1-6c0d-45ac-8c7c-0af37751f76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:33.054275 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3396/6842] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:33.073198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:33.075170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:33.255047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156b9d-5e7c-4e15-91ea-0e2ec17448a0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:33.262745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42560878-f338-4752-a8e1-c59e9b429807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:33.263418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42560878-f338-4752-a8e1-c59e9b429807 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:33.264182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42560878-f338-4752-a8e1-c59e9b429807 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:33.264782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42560878-f338-4752-a8e1-c59e9b429807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:33.289462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42560878-f338-4752-a8e1-c59e9b429807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:33.298277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42560878-f338-4752-a8e1-c59e9b429807 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:33.331409 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3447/6843] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:34.540433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a73a1-6c0d-45ac-8c7c-0af37751f76b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:34.541977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dd0a73a1-6c0d-45ac-8c7c-0af37751f76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:34.555308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a73a1-6c0d-45ac-8c7c-0af37751f76b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:34.563358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:34.564506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:34.564987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:34.565739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] PATH_INFO: `/v3/projects/85da98ab5e9649aa9326cc4859d0c8e6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:34.567288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] RBAC: Authorizing `identity:delete_project(project_id=85da98ab5e9649aa9326cc4859d0c8e6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:34.570550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:34.681054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85da98ab5e9649aa9326cc4859d0c8e6', 'request_id': 'req-6f948a30-615c-49c9-80cc-461b3cb7cdca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:34.696739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85da98ab5e9649aa9326cc4859d0c8e6', 'request_id': 'req-6f948a30-615c-49c9-80cc-461b3cb7cdca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:34.704780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85da98ab5e9649aa9326cc4859d0c8e6', 'request_id': 'req-6f948a30-615c-49c9-80cc-461b3cb7cdca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:34.720362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] The token cache is being invalidate because project 85da98ab5e9649aa9326cc4859d0c8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:34.720859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:34.722163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:34.725125 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3397/6844] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:34 2022] DELETE /identity/v3/projects/85da98ab5e9649aa9326cc4859d0c8e6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:34.729466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42560878-f338-4752-a8e1-c59e9b429807 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:34.747052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42560878-f338-4752-a8e1-c59e9b429807 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:34.832730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:34.834072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:34.834679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:34.835890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] PATH_INFO: `/v3/users/cee0ac18493c4998bdff8c6f6d4ec227` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:34.838615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cee0ac18493c4998bdff8c6f6d4ec227)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:34.841164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:34.932595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cee0ac18493c4998bdff8c6f6d4ec227'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:34.956965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cee0ac18493c4998bdff8c6f6d4ec227'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:34.958011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cee0ac18493c4998bdff8c6f6d4ec227'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:34.958874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cee0ac18493c4998bdff8c6f6d4ec227'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:34.977012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6acf0abb-1089-4998-8595-280eeffc9873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cee0ac18493c4998bdff8c6f6d4ec227'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:35.028420 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3448/6845] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:34 2022] DELETE /identity/v3/users/cee0ac18493c4998bdff8c6f6d4ec227 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:36.015075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:36.017889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:36.083659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f948a30-615c-49c9-80cc-461b3cb7cdca admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:36.225126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:36.226139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:36.226599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:36.227053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] PATH_INFO: `/v3/projects/ad005b7863904096a94a83a519610fd0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:36.228620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad005b7863904096a94a83a519610fd0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:36.233311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:36.340886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad005b7863904096a94a83a519610fd0', 'request_id': 'req-0a5d980c-eabc-4286-8e10-e0749b99b305'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:36.355029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad005b7863904096a94a83a519610fd0', 'request_id': 'req-0a5d980c-eabc-4286-8e10-e0749b99b305'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:36.361767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad005b7863904096a94a83a519610fd0', 'request_id': 'req-0a5d980c-eabc-4286-8e10-e0749b99b305'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:36.396610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] The token cache is being invalidate because project ad005b7863904096a94a83a519610fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:36.397046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:36.397845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a5d980c-eabc-4286-8e10-e0749b99b305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:36.400064 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3398/6846] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:36 2022] DELETE /identity/v3/projects/ad005b7863904096a94a83a519610fd0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:36.405366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e686-a8d1-4d94-a47e-b9cd0b6d6ee3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:36.414099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e686-a8d1-4d94-a47e-b9cd0b6d6ee3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:36.416763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86e686-a8d1-4d94-a47e-b9cd0b6d6ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:36.473744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dd86e686-a8d1-4d94-a47e-b9cd0b6d6ee3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:36.476518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dd86e686-a8d1-4d94-a47e-b9cd0b6d6ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:36.598239 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3449/6847] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:36.608893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1261b92-edfe-4f4a-b97e-eb45cb64f573 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:36.609261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1261b92-edfe-4f4a-b97e-eb45cb64f573 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:36.609546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1261b92-edfe-4f4a-b97e-eb45cb64f573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:36.643298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a1261b92-edfe-4f4a-b97e-eb45cb64f573 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:36.647644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a1261b92-edfe-4f4a-b97e-eb45cb64f573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:36.674491 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3399/6848] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:36.679574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86e686-a8d1-4d94-a47e-b9cd0b6d6ee3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:36.705062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86e686-a8d1-4d94-a47e-b9cd0b6d6ee3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:36.721943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8362-cd7a-4c71-891a-54ccd1da6ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:36.724607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8362-cd7a-4c71-891a-54ccd1da6ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:36.725220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8362-cd7a-4c71-891a-54ccd1da6ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:36.725220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b8362-cd7a-4c71-891a-54ccd1da6ef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:36.726018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b8362-cd7a-4c71-891a-54ccd1da6ef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:36.726955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b8362-cd7a-4c71-891a-54ccd1da6ef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:36.730686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b8362-cd7a-4c71-891a-54ccd1da6ef9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:36.759337 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3450/6849] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:12:36.765710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1261b92-edfe-4f4a-b97e-eb45cb64f573 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:36.793840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1261b92-edfe-4f4a-b97e-eb45cb64f573 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:36.812544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63dd6-89d2-46a0-813e-d39e878efbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:36.815052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63dd6-89d2-46a0-813e-d39e878efbc0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:36.815342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63dd6-89d2-46a0-813e-d39e878efbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:36.816298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63dd6-89d2-46a0-813e-d39e878efbc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:36.818638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc63dd6-89d2-46a0-813e-d39e878efbc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:36.827045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc63dd6-89d2-46a0-813e-d39e878efbc0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:36.890738 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3400/6850] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:36 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:36.896141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8362-cd7a-4c71-891a-54ccd1da6ef9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:36.918280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b8362-cd7a-4c71-891a-54ccd1da6ef9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:37.067759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d710d1-b498-4ecb-9ad4-c246b75511a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:37.068823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d710d1-b498-4ecb-9ad4-c246b75511a4 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:37.069296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d710d1-b498-4ecb-9ad4-c246b75511a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:37.069728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d710d1-b498-4ecb-9ad4-c246b75511a4 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:37.071772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d710d1-b498-4ecb-9ad4-c246b75511a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:37.077368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d710d1-b498-4ecb-9ad4-c246b75511a4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:37.141473 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3451/6851] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:36 2022] POST /identity/v3/users => generated 284 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:37.142300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63dd6-89d2-46a0-813e-d39e878efbc0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:37.158571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63dd6-89d2-46a0-813e-d39e878efbc0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:37.176294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc23e-bc48-4488-bcb7-ab21d0c7ca5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:37.177179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc23e-bc48-4488-bcb7-ab21d0c7ca5b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:37.178302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc23e-bc48-4488-bcb7-ab21d0c7ca5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:37.178772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519bc23e-bc48-4488-bcb7-ab21d0c7ca5b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:37.179707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc23e-bc48-4488-bcb7-ab21d0c7ca5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:37.181849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519bc23e-bc48-4488-bcb7-ab21d0c7ca5b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:37.196880 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3401/6852] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:37.201364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d710d1-b498-4ecb-9ad4-c246b75511a4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:37.216177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d710d1-b498-4ecb-9ad4-c246b75511a4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:37.221903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7186f-035c-4650-b92d-fc6250295540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:37.222613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7186f-035c-4650-b92d-fc6250295540 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:37.222978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7186f-035c-4650-b92d-fc6250295540 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:37.223255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7186f-035c-4650-b92d-fc6250295540 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:37.224010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7186f-035c-4650-b92d-fc6250295540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:37.225907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7186f-035c-4650-b92d-fc6250295540 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:37.239222 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3452/6853] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:37.243144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc23e-bc48-4488-bcb7-ab21d0c7ca5b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:37.256280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519bc23e-bc48-4488-bcb7-ab21d0c7ca5b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:37.262801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c12f3-487f-4697-b45b-5c3262a9d848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:37.264193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c12f3-487f-4697-b45b-5c3262a9d848 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:37.264682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c12f3-487f-4697-b45b-5c3262a9d848 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:37.265181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c12f3-487f-4697-b45b-5c3262a9d848 admin admin] PATH_INFO: `/v3/projects/ef892c39aa8c4795a204291381f0833a/users/29e610229c15459facb3d27c05b1e0f0/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:37.292227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c12f3-487f-4697-b45b-5c3262a9d848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef892c39aa8c4795a204291381f0833a, user_id=29e610229c15459facb3d27c05b1e0f0, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:37.294906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c12f3-487f-4697-b45b-5c3262a9d848 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:37.316669 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3402/6854] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:37 2022] PUT /identity/v3/projects/ef892c39aa8c4795a204291381f0833a/users/29e610229c15459facb3d27c05b1e0f0/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:37.326677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925354df-1b08-4f06-ad1c-256657f93484 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:37.327191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925354df-1b08-4f06-ad1c-256657f93484 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:37.327698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925354df-1b08-4f06-ad1c-256657f93484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:37.368160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-925354df-1b08-4f06-ad1c-256657f93484 None None] MFA Rules not processed for user `29e610229c15459facb3d27c05b1e0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:37.369767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-925354df-1b08-4f06-ad1c-256657f93484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:37.438866 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3453/6855] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:37.444097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c12f3-487f-4697-b45b-5c3262a9d848 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:37.549422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c12f3-487f-4697-b45b-5c3262a9d848 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:37.554181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d228e24-1c53-4fb2-b99a-1b9701bef72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:37.555001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d228e24-1c53-4fb2-b99a-1b9701bef72f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:37.555839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d228e24-1c53-4fb2-b99a-1b9701bef72f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:37.556159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d228e24-1c53-4fb2-b99a-1b9701bef72f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:37.556858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d228e24-1c53-4fb2-b99a-1b9701bef72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:37.559037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d228e24-1c53-4fb2-b99a-1b9701bef72f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:37.591578 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3403/6856] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:37 2022] POST /identity/v3/projects => generated 369 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:37.592803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925354df-1b08-4f06-ad1c-256657f93484 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:37.614537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925354df-1b08-4f06-ad1c-256657f93484 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:37.718712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c61f-9164-47a3-8638-c8ed76798bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:37.728294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c61f-9164-47a3-8638-c8ed76798bba admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:37.728294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c61f-9164-47a3-8638-c8ed76798bba admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:37.728294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c61f-9164-47a3-8638-c8ed76798bba admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:37.728294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5c61f-9164-47a3-8638-c8ed76798bba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:37.729559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5c61f-9164-47a3-8638-c8ed76798bba admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:37.757515 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3454/6857] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:37 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:37.762088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d228e24-1c53-4fb2-b99a-1b9701bef72f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:37.773609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d228e24-1c53-4fb2-b99a-1b9701bef72f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:37.790510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50abe6-0467-451b-9f9a-a663d19a1543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:37.791641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50abe6-0467-451b-9f9a-a663d19a1543 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:37.793325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50abe6-0467-451b-9f9a-a663d19a1543 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:37.793619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50abe6-0467-451b-9f9a-a663d19a1543 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:37.794362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50abe6-0467-451b-9f9a-a663d19a1543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:37.796045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50abe6-0467-451b-9f9a-a663d19a1543 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:37.811819 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3404/6858] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:37.816364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c61f-9164-47a3-8638-c8ed76798bba admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:37.833295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c61f-9164-47a3-8638-c8ed76798bba admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:37.840842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b4d5d-351f-4093-94ab-d6d2c9fc9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:37.841972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b4d5d-351f-4093-94ab-d6d2c9fc9c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:37.842412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b4d5d-351f-4093-94ab-d6d2c9fc9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:37.842879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b4d5d-351f-4093-94ab-d6d2c9fc9c21 admin admin] PATH_INFO: `/v3/projects/9be8379443fd4cd587a7e3f28ecbdd01/users/fff25f79649842cb9c48a978d21c5a93/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:37.907380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b4d5d-351f-4093-94ab-d6d2c9fc9c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be8379443fd4cd587a7e3f28ecbdd01, user_id=fff25f79649842cb9c48a978d21c5a93, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:37.913470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3b4d5d-351f-4093-94ab-d6d2c9fc9c21 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:37.950360 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3455/6859] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:37 2022] PUT /identity/v3/projects/9be8379443fd4cd587a7e3f28ecbdd01/users/fff25f79649842cb9c48a978d21c5a93/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:37.952160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50abe6-0467-451b-9f9a-a663d19a1543 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:37.963785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50abe6-0467-451b-9f9a-a663d19a1543 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.098092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a451eb-18f8-4c82-ba6c-0a9c94d36a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.101146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a451eb-18f8-4c82-ba6c-0a9c94d36a24 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.102921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a451eb-18f8-4c82-ba6c-0a9c94d36a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.103367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a451eb-18f8-4c82-ba6c-0a9c94d36a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.104650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a451eb-18f8-4c82-ba6c-0a9c94d36a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.106863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a451eb-18f8-4c82-ba6c-0a9c94d36a24 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.123935 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3405/6860] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:38.128479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b4d5d-351f-4093-94ab-d6d2c9fc9c21 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.142561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b4d5d-351f-4093-94ab-d6d2c9fc9c21 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.155365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889e9a5-0c4e-45ac-bb7a-bdc9705ac25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.157162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889e9a5-0c4e-45ac-bb7a-bdc9705ac25b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.157607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889e9a5-0c4e-45ac-bb7a-bdc9705ac25b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.158071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889e9a5-0c4e-45ac-bb7a-bdc9705ac25b admin admin] PATH_INFO: `/v3/projects/9be8379443fd4cd587a7e3f28ecbdd01/users/fff25f79649842cb9c48a978d21c5a93/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.161588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889e9a5-0c4e-45ac-bb7a-bdc9705ac25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be8379443fd4cd587a7e3f28ecbdd01, user_id=fff25f79649842cb9c48a978d21c5a93, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.169834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889e9a5-0c4e-45ac-bb7a-bdc9705ac25b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.185991 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3456/6861] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:38 2022] PUT /identity/v3/projects/9be8379443fd4cd587a7e3f28ecbdd01/users/fff25f79649842cb9c48a978d21c5a93/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:38.196381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc5d6-b18e-4ef3-808a-7ee1267866bf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.196965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc5d6-b18e-4ef3-808a-7ee1267866bf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.197233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bc5d6-b18e-4ef3-808a-7ee1267866bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.229714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-848bc5d6-b18e-4ef3-808a-7ee1267866bf None None] MFA Rules not processed for user `fff25f79649842cb9c48a978d21c5a93`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:38.231114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-848bc5d6-b18e-4ef3-808a-7ee1267866bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:38.327903 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3406/6862] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:38.329168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889e9a5-0c4e-45ac-bb7a-bdc9705ac25b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.344387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889e9a5-0c4e-45ac-bb7a-bdc9705ac25b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.350230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d5483-f28b-4c94-9cb7-48c702a4e548 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.351311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d5483-f28b-4c94-9cb7-48c702a4e548 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.351844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d5483-f28b-4c94-9cb7-48c702a4e548 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.353536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773d5483-f28b-4c94-9cb7-48c702a4e548 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.354513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d5483-f28b-4c94-9cb7-48c702a4e548 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.356798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773d5483-f28b-4c94-9cb7-48c702a4e548 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.377819 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3457/6863] 10.222.0.16 () {60 vars in 1151 bytes} [Sat Mar 26 21:12:38 2022] POST /identity/v3/services => generated 241 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:38.382256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc5d6-b18e-4ef3-808a-7ee1267866bf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.393899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bc5d6-b18e-4ef3-808a-7ee1267866bf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.418160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c500-f754-40ba-b8a6-4d8961c26a73 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.419346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c500-f754-40ba-b8a6-4d8961c26a73 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.419903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c500-f754-40ba-b8a6-4d8961c26a73 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.420410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877c500-f754-40ba-b8a6-4d8961c26a73 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services/63b90fb5d88e4b2fbf92947ff6813893` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.422423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877c500-f754-40ba-b8a6-4d8961c26a73 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:delete_service(service_id=63b90fb5d88e4b2fbf92947ff6813893)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.424307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877c500-f754-40ba-b8a6-4d8961c26a73 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.460387 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3407/6864] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:38 2022] DELETE /identity/v3/services/63b90fb5d88e4b2fbf92947ff6813893 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:38.462578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d5483-f28b-4c94-9cb7-48c702a4e548 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.475023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773d5483-f28b-4c94-9cb7-48c702a4e548 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.492726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e838742-1fff-4c9e-9aae-c5cf7d052f5c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.493903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e838742-1fff-4c9e-9aae-c5cf7d052f5c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.494352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e838742-1fff-4c9e-9aae-c5cf7d052f5c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.494805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e838742-1fff-4c9e-9aae-c5cf7d052f5c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.495693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e838742-1fff-4c9e-9aae-c5cf7d052f5c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.497810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e838742-1fff-4c9e-9aae-c5cf7d052f5c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.521253 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3458/6865] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:38 2022] POST /identity/v3/services => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:38.522153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c500-f754-40ba-b8a6-4d8961c26a73 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.540777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877c500-f754-40ba-b8a6-4d8961c26a73 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.557038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a6432-6f76-496a-93f4-294d686ab504 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.557895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a6432-6f76-496a-93f4-294d686ab504 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.558353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a6432-6f76-496a-93f4-294d686ab504 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.558891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a6432-6f76-496a-93f4-294d686ab504 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services/bd1633aabf8c4b66a577d2fc3cff862c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.559624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a6432-6f76-496a-93f4-294d686ab504 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:update_service(service_id=bd1633aabf8c4b66a577d2fc3cff862c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.560693 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-ab5a6432-6f76-496a-93f4-294d686ab504 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:12:38.560693 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:12:38.560693 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:12:38.561577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a6432-6f76-496a-93f4-294d686ab504 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.584909 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3408/6866] 10.222.0.16 () {60 vars in 1251 bytes} [Sat Mar 26 21:12:38 2022] PATCH /identity/v3/services/bd1633aabf8c4b66a577d2fc3cff862c => generated 283 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:12:38.588417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e838742-1fff-4c9e-9aae-c5cf7d052f5c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.599695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e838742-1fff-4c9e-9aae-c5cf7d052f5c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.623432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563793a4-d844-4108-8161-9c0d40b8670e tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.624353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563793a4-d844-4108-8161-9c0d40b8670e tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.624651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563793a4-d844-4108-8161-9c0d40b8670e tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.624935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563793a4-d844-4108-8161-9c0d40b8670e tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services/bd1633aabf8c4b66a577d2fc3cff862c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.625592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563793a4-d844-4108-8161-9c0d40b8670e tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:get_service(service_id=bd1633aabf8c4b66a577d2fc3cff862c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.626632 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-563793a4-d844-4108-8161-9c0d40b8670e tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:12:38.626632 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:12:38.626632 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:12:38.627514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563793a4-d844-4108-8161-9c0d40b8670e tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.634583 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3459/6867] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:12:38 2022] GET /identity/v3/services/bd1633aabf8c4b66a577d2fc3cff862c => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:38.638737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a6432-6f76-496a-93f4-294d686ab504 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.651672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a6432-6f76-496a-93f4-294d686ab504 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.662951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47247f-5334-4f2c-80e4-8bb8f77cf9a8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.664084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47247f-5334-4f2c-80e4-8bb8f77cf9a8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.664457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47247f-5334-4f2c-80e4-8bb8f77cf9a8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.664825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47247f-5334-4f2c-80e4-8bb8f77cf9a8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services/bd1633aabf8c4b66a577d2fc3cff862c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.665548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47247f-5334-4f2c-80e4-8bb8f77cf9a8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:delete_service(service_id=bd1633aabf8c4b66a577d2fc3cff862c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.667263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47247f-5334-4f2c-80e4-8bb8f77cf9a8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.689485 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3409/6868] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:38 2022] DELETE /identity/v3/services/bd1633aabf8c4b66a577d2fc3cff862c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:38.693675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563793a4-d844-4108-8161-9c0d40b8670e tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.704476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563793a4-d844-4108-8161-9c0d40b8670e tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.719395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925eac-2816-4f95-9dca-18a4353baa29 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.720266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925eac-2816-4f95-9dca-18a4353baa29 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.720578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925eac-2816-4f95-9dca-18a4353baa29 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.720969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925eac-2816-4f95-9dca-18a4353baa29 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services/bd1633aabf8c4b66a577d2fc3cff862c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.721619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae925eac-2816-4f95-9dca-18a4353baa29 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:get_service(service_id=bd1633aabf8c4b66a577d2fc3cff862c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.723435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae925eac-2816-4f95-9dca-18a4353baa29 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.736275 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-ae925eac-2816-4f95-9dca-18a4353baa29 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Could not find service: bd1633aabf8c4b66a577d2fc3cff862c.: keystone.exception.ServiceNotFound: Could not find service: bd1633aabf8c4b66a577d2fc3cff862c. Mar 26 21:12:38.737484 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3460/6869] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:12:38 2022] GET /identity/v3/services/bd1633aabf8c4b66a577d2fc3cff862c => generated 113 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:12:38.742983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47247f-5334-4f2c-80e4-8bb8f77cf9a8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.753436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47247f-5334-4f2c-80e4-8bb8f77cf9a8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.758019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf3bde-4641-41b6-975d-a90e6ea7427c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.759172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf3bde-4641-41b6-975d-a90e6ea7427c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.759460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf3bde-4641-41b6-975d-a90e6ea7427c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.759741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf3bde-4641-41b6-975d-a90e6ea7427c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.760495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf3bde-4641-41b6-975d-a90e6ea7427c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.761523 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-3ecf3bde-4641-41b6-975d-a90e6ea7427c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:12:38.761523 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:12:38.761523 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:12:38.762436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf3bde-4641-41b6-975d-a90e6ea7427c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.780285 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3410/6870] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:38 2022] POST /identity/v3/services => generated 275 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:38.781269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925eac-2816-4f95-9dca-18a4353baa29 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.791116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925eac-2816-4f95-9dca-18a4353baa29 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.806638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c8ab2-9680-4dd2-9089-3289d84ab2d0 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.807399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c8ab2-9680-4dd2-9089-3289d84ab2d0 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.807709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c8ab2-9680-4dd2-9089-3289d84ab2d0 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.808002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c8ab2-9680-4dd2-9089-3289d84ab2d0 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.808995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c8ab2-9680-4dd2-9089-3289d84ab2d0 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.810610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c8ab2-9680-4dd2-9089-3289d84ab2d0 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.825047 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3461/6871] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:38 2022] POST /identity/v3/services => generated 275 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:38.829178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf3bde-4641-41b6-975d-a90e6ea7427c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.840874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf3bde-4641-41b6-975d-a90e6ea7427c tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.860812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc3729-673e-4fea-bdae-299faa400d82 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.861531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc3729-673e-4fea-bdae-299faa400d82 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.861742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc3729-673e-4fea-bdae-299faa400d82 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.862020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc3729-673e-4fea-bdae-299faa400d82 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.862759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc3729-673e-4fea-bdae-299faa400d82 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.864400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc3729-673e-4fea-bdae-299faa400d82 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.882460 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3411/6872] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:38 2022] POST /identity/v3/services => generated 274 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:38.886619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c8ab2-9680-4dd2-9089-3289d84ab2d0 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.898227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c8ab2-9680-4dd2-9089-3289d84ab2d0 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.913617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ec03-ee49-4f59-9f0e-074319adab86 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.914269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ec03-ee49-4f59-9f0e-074319adab86 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.914715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ec03-ee49-4f59-9f0e-074319adab86 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.914992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528ec03-ee49-4f59-9f0e-074319adab86 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.915669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528ec03-ee49-4f59-9f0e-074319adab86 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.916877 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-c528ec03-ee49-4f59-9f0e-074319adab86 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:12:38.916877 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:12:38.916877 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:12:38.917766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c528ec03-ee49-4f59-9f0e-074319adab86 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.926023 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3462/6873] 10.222.0.16 () {58 vars in 1130 bytes} [Sat Mar 26 21:12:38 2022] GET /identity/v3/services => generated 2979 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:38.930625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc3729-673e-4fea-bdae-299faa400d82 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.943491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc3729-673e-4fea-bdae-299faa400d82 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.949170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.949832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.950125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.950410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.951118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1899962055) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:38.951428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.952530 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:12:38.952530 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:12:38.952530 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:12:38.953423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.963097 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3412/6874] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Mar 26 21:12:38 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1899962055 => generated 418 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:38.964345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ec03-ee49-4f59-9f0e-074319adab86 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:38.975782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528ec03-ee49-4f59-9f0e-074319adab86 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:38.982536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9fe00-503b-4588-b6a2-62c052e787e5 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:38.982536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9fe00-503b-4588-b6a2-62c052e787e5 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:38.982876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9fe00-503b-4588-b6a2-62c052e787e5 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:38.983459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9fe00-503b-4588-b6a2-62c052e787e5 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:38.984309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9fe00-503b-4588-b6a2-62c052e787e5 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1506078526) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:38.984688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9fe00-503b-4588-b6a2-62c052e787e5 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:38.986437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9fe00-503b-4588-b6a2-62c052e787e5 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:38.995570 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3463/6875] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Mar 26 21:12:38 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1506078526 => generated 418 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:38.999308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:39.013329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee1331-a910-48f4-97f6-4639c598c844 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:39.021074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf346ee-166c-43fb-bce4-75455267f3d7 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:39.022088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf346ee-166c-43fb-bce4-75455267f3d7 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:39.022652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf346ee-166c-43fb-bce4-75455267f3d7 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:39.023230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf346ee-166c-43fb-bce4-75455267f3d7 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:39.024868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf346ee-166c-43fb-bce4-75455267f3d7 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1734680041) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:39.025408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf346ee-166c-43fb-bce4-75455267f3d7 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:39.029867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf346ee-166c-43fb-bce4-75455267f3d7 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:39.039214 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3413/6876] 10.222.0.16 () {58 vars in 1221 bytes} [Sat Mar 26 21:12:38 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1734680041 => generated 417 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:39.040985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9fe00-503b-4588-b6a2-62c052e787e5 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:39.052093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9fe00-503b-4588-b6a2-62c052e787e5 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:39.060991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363da51-b8e6-4f4d-88f0-6092c53387c8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:39.062306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363da51-b8e6-4f4d-88f0-6092c53387c8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:39.062597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363da51-b8e6-4f4d-88f0-6092c53387c8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:39.062906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8363da51-b8e6-4f4d-88f0-6092c53387c8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services/4b402f4912a34f93a2dbffda3b5817e0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:39.063575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363da51-b8e6-4f4d-88f0-6092c53387c8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4b402f4912a34f93a2dbffda3b5817e0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:39.064923 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-8363da51-b8e6-4f4d-88f0-6092c53387c8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:12:39.064923 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:12:39.064923 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:12:39.065994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8363da51-b8e6-4f4d-88f0-6092c53387c8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:39.112480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf346ee-166c-43fb-bce4-75455267f3d7 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:39.113849 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3464/6877] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:39 2022] DELETE /identity/v3/services/4b402f4912a34f93a2dbffda3b5817e0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:39.137997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf346ee-166c-43fb-bce4-75455267f3d7 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:39.151263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ba1c8-5a4b-4e35-8779-d3cff7a21ac3 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:39.152158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ba1c8-5a4b-4e35-8779-d3cff7a21ac3 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:39.152451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ba1c8-5a4b-4e35-8779-d3cff7a21ac3 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:39.152976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ba1c8-5a4b-4e35-8779-d3cff7a21ac3 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services/08dc2ee6e59242f69bfa8696c2eca5d3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:39.153389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ba1c8-5a4b-4e35-8779-d3cff7a21ac3 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:delete_service(service_id=08dc2ee6e59242f69bfa8696c2eca5d3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:39.155358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ba1c8-5a4b-4e35-8779-d3cff7a21ac3 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:39.179320 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3414/6878] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:39 2022] DELETE /identity/v3/services/08dc2ee6e59242f69bfa8696c2eca5d3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:39.184455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363da51-b8e6-4f4d-88f0-6092c53387c8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:39.198462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8363da51-b8e6-4f4d-88f0-6092c53387c8 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:39.222900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c5132-8aa1-4e9b-bf59-e11bc21ca916 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff25f79649842cb9c48a978d21c5a93', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9be8379443fd4cd587a7e3f28ecbdd01', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:39.224029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c5132-8aa1-4e9b-bf59-e11bc21ca916 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:39.224408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c5132-8aa1-4e9b-bf59-e11bc21ca916 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:39.224781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c5132-8aa1-4e9b-bf59-e11bc21ca916 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] PATH_INFO: `/v3/services/4c0a768c705a42c99214df4125189852` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:39.225788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c5132-8aa1-4e9b-bf59-e11bc21ca916 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4c0a768c705a42c99214df4125189852)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:39.227769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c5132-8aa1-4e9b-bf59-e11bc21ca916 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:39.267500 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3465/6879] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:39 2022] DELETE /identity/v3/services/4c0a768c705a42c99214df4125189852 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:39.273023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ba1c8-5a4b-4e35-8779-d3cff7a21ac3 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:39.382844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ba1c8-5a4b-4e35-8779-d3cff7a21ac3 tempest-ServicesTestJSON-1818143463 tempest-ServicesTestJSON-1818143463-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:39.409403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:39.410402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:39.410688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:39.411051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] PATH_INFO: `/v3/users/29e610229c15459facb3d27c05b1e0f0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:39.413001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e610229c15459facb3d27c05b1e0f0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:39.415894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:39.493570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e610229c15459facb3d27c05b1e0f0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:39.514476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e610229c15459facb3d27c05b1e0f0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:39.516987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e610229c15459facb3d27c05b1e0f0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:39.517890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e610229c15459facb3d27c05b1e0f0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:39.538351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e610229c15459facb3d27c05b1e0f0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:39.559458 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3415/6880] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:39 2022] DELETE /identity/v3/users/29e610229c15459facb3d27c05b1e0f0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:39.563997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c403f2b-bce5-416e-9aa5-99521db7258f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:39.564511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c403f2b-bce5-416e-9aa5-99521db7258f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:39.564606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c403f2b-bce5-416e-9aa5-99521db7258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:39.585831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3c403f2b-bce5-416e-9aa5-99521db7258f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:39.587629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c403f2b-bce5-416e-9aa5-99521db7258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:39.662211 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3466/6881] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:39.699473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:39.701601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:39.816372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c8729-eb8c-4f22-b931-514674d7daec admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:39.820635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cfb66-1af3-4722-9ff8-87c13f2b5f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:39.821333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cfb66-1af3-4722-9ff8-87c13f2b5f62 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:39.821967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cfb66-1af3-4722-9ff8-87c13f2b5f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:39.823024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cfb66-1af3-4722-9ff8-87c13f2b5f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:39.833595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cfb66-1af3-4722-9ff8-87c13f2b5f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:39.835694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cfb66-1af3-4722-9ff8-87c13f2b5f62 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:39.868874 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3416/6882] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:40.270339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c403f2b-bce5-416e-9aa5-99521db7258f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:40.272238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3c403f2b-bce5-416e-9aa5-99521db7258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:40.310567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c403f2b-bce5-416e-9aa5-99521db7258f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:40.323690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:40.325188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:40.325789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:40.326383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] PATH_INFO: `/v3/projects/ef892c39aa8c4795a204291381f0833a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:40.335942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef892c39aa8c4795a204291381f0833a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:40.342251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:40.434368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef892c39aa8c4795a204291381f0833a', 'request_id': 'req-70fa09a6-8331-4611-b2f1-d2c2520630c0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.449013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef892c39aa8c4795a204291381f0833a', 'request_id': 'req-70fa09a6-8331-4611-b2f1-d2c2520630c0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.462610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef892c39aa8c4795a204291381f0833a', 'request_id': 'req-70fa09a6-8331-4611-b2f1-d2c2520630c0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.479813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] The token cache is being invalidate because project ef892c39aa8c4795a204291381f0833a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:40.480562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.481363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.495177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cfb66-1af3-4722-9ff8-87c13f2b5f62 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:40.513004 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3467/6883] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:40 2022] DELETE /identity/v3/projects/ef892c39aa8c4795a204291381f0833a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:40.525620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cfb66-1af3-4722-9ff8-87c13f2b5f62 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:40.637768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:40.640137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:40.640432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:40.641669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] PATH_INFO: `/v3/users/fff25f79649842cb9c48a978d21c5a93` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:40.644508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fff25f79649842cb9c48a978d21c5a93)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:40.648220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:40.724711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fff25f79649842cb9c48a978d21c5a93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.737771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fff25f79649842cb9c48a978d21c5a93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.739208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fff25f79649842cb9c48a978d21c5a93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.741563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fff25f79649842cb9c48a978d21c5a93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.763400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409e5ab8-eb13-4d8b-a6a5-04d0abf5806f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fff25f79649842cb9c48a978d21c5a93'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:40.784340 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3417/6884] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:40 2022] DELETE /identity/v3/users/fff25f79649842cb9c48a978d21c5a93 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:41.185681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:41.188216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:41.212058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa09a6-8331-4611-b2f1-d2c2520630c0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:41.272034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:41.273081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:41.273364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:41.273640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] PATH_INFO: `/v3/projects/9be8379443fd4cd587a7e3f28ecbdd01` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:41.275397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be8379443fd4cd587a7e3f28ecbdd01)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:41.277471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:41.328542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be8379443fd4cd587a7e3f28ecbdd01', 'request_id': 'req-0ed0fdab-ebca-418c-a1ec-55bb39448877'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.339266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be8379443fd4cd587a7e3f28ecbdd01', 'request_id': 'req-0ed0fdab-ebca-418c-a1ec-55bb39448877'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.347803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be8379443fd4cd587a7e3f28ecbdd01', 'request_id': 'req-0ed0fdab-ebca-418c-a1ec-55bb39448877'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.362540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] The token cache is being invalidate because project 9be8379443fd4cd587a7e3f28ecbdd01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:41.363027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.363764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.365718 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3468/6885] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:41 2022] DELETE /identity/v3/projects/9be8379443fd4cd587a7e3f28ecbdd01 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:41.371416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99452a77-58ce-4266-a74e-7684bc09e1fa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:41.371960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99452a77-58ce-4266-a74e-7684bc09e1fa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:41.372346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99452a77-58ce-4266-a74e-7684bc09e1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:41.409272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-99452a77-58ce-4266-a74e-7684bc09e1fa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:41.410758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-99452a77-58ce-4266-a74e-7684bc09e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:41.417323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:41.419203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:41.493170 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3418/6886] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:41.500866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0fdab-ebca-418c-a1ec-55bb39448877 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:41.504460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23b59-1925-4534-bdb5-f5e65cafecee None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:41.506630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23b59-1925-4534-bdb5-f5e65cafecee None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:41.507136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d23b59-1925-4534-bdb5-f5e65cafecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:41.508674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:41.509775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:41.510079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:41.510470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] PATH_INFO: `/v3/users/70b9b99519bd4335ab090702734a345b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:41.511997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b9b99519bd4335ab090702734a345b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:41.515859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:41.557895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-89d23b59-1925-4534-bdb5-f5e65cafecee None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:41.564999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-89d23b59-1925-4534-bdb5-f5e65cafecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:41.601935 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3419/6887] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:41.606758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d23b59-1925-4534-bdb5-f5e65cafecee None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:41.629989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d23b59-1925-4534-bdb5-f5e65cafecee None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:41.639389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b9b99519bd4335ab090702734a345b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.642230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:41.643058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:41.643344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:41.643622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:41.644437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:41.645368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:41.649845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:41.656536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b9b99519bd4335ab090702734a345b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.660359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b9b99519bd4335ab090702734a345b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.662626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b9b99519bd4335ab090702734a345b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.683003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae2c28e7-82c1-4270-8f74-8e99f8fda4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b9b99519bd4335ab090702734a345b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:41.685990 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3420/6888] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:41.690582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:41.695556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:41.726305 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3469/6889] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:41 2022] DELETE /identity/v3/users/70b9b99519bd4335ab090702734a345b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:41.729655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bda23-d2c5-44bd-a1e8-aa5b33e91164 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:41.730357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bda23-d2c5-44bd-a1e8-aa5b33e91164 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:41.731176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bda23-d2c5-44bd-a1e8-aa5b33e91164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:41.745962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703301d6-fffb-4435-b893-b121a1d71a11 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:41.764314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c52bda23-d2c5-44bd-a1e8-aa5b33e91164 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:41.765864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c52bda23-d2c5-44bd-a1e8-aa5b33e91164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:41.891154 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3470/6890] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:41.916804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bda23-d2c5-44bd-a1e8-aa5b33e91164 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:41.919601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c52bda23-d2c5-44bd-a1e8-aa5b33e91164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:41.933795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab6c53-8007-4e17-bd28-32d08e0030cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:41.934469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab6c53-8007-4e17-bd28-32d08e0030cd admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:41.934759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab6c53-8007-4e17-bd28-32d08e0030cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:41.935155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab6c53-8007-4e17-bd28-32d08e0030cd admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:41.935855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab6c53-8007-4e17-bd28-32d08e0030cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:41.937929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab6c53-8007-4e17-bd28-32d08e0030cd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:41.993695 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3421/6891] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:41 2022] POST /identity/v3/projects => generated 371 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:42.001548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab6c53-8007-4e17-bd28-32d08e0030cd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:42.054317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bda23-d2c5-44bd-a1e8-aa5b33e91164 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:42.125885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004a1a8-bb8f-422e-b0c7-5943b9226a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:42.126896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a1a8-bb8f-422e-b0c7-5943b9226a5b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:42.127108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a1a8-bb8f-422e-b0c7-5943b9226a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:42.127950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004a1a8-bb8f-422e-b0c7-5943b9226a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:42.140225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004a1a8-bb8f-422e-b0c7-5943b9226a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:42.141979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004a1a8-bb8f-422e-b0c7-5943b9226a5b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:42.150643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab6c53-8007-4e17-bd28-32d08e0030cd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:42.157374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19ed93-1fe6-4183-b248-ef7aba9e6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:42.158410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19ed93-1fe6-4183-b248-ef7aba9e6283 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:42.159158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19ed93-1fe6-4183-b248-ef7aba9e6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:42.159802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19ed93-1fe6-4183-b248-ef7aba9e6283 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:42.174558 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3471/6892] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:12:42.192954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19ed93-1fe6-4183-b248-ef7aba9e6283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:42.195147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19ed93-1fe6-4183-b248-ef7aba9e6283 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:42.271464 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3422/6893] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:41 2022] POST /identity/v3/users => generated 286 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:42.275822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004a1a8-bb8f-422e-b0c7-5943b9226a5b service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:42.289918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004a1a8-bb8f-422e-b0c7-5943b9226a5b service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:42.300919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fc9bc-4f10-45f8-b0e2-8bd68922e603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:42.302746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fc9bc-4f10-45f8-b0e2-8bd68922e603 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:42.303156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fc9bc-4f10-45f8-b0e2-8bd68922e603 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:42.303582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fc9bc-4f10-45f8-b0e2-8bd68922e603 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:42.305695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fc9bc-4f10-45f8-b0e2-8bd68922e603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:42.309521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310fc9bc-4f10-45f8-b0e2-8bd68922e603 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:42.332307 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3472/6894] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:42.334939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19ed93-1fe6-4183-b248-ef7aba9e6283 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:42.351074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19ed93-1fe6-4183-b248-ef7aba9e6283 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:42.360651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f7985-192f-44c6-bc3e-b9a6aafc9b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:42.361770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f7985-192f-44c6-bc3e-b9a6aafc9b25 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:42.362579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f7985-192f-44c6-bc3e-b9a6aafc9b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:42.362816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f7985-192f-44c6-bc3e-b9a6aafc9b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:42.364217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f7985-192f-44c6-bc3e-b9a6aafc9b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:42.366640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f7985-192f-44c6-bc3e-b9a6aafc9b25 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:42.388313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fc9bc-4f10-45f8-b0e2-8bd68922e603 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:42.400556 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3423/6895] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:42.402856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310fc9bc-4f10-45f8-b0e2-8bd68922e603 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:42.408589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f47f3-59d8-4ff7-8bba-349de1c85866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:42.410017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f47f3-59d8-4ff7-8bba-349de1c85866 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:42.410700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f47f3-59d8-4ff7-8bba-349de1c85866 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:42.411278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f47f3-59d8-4ff7-8bba-349de1c85866 admin admin] PATH_INFO: `/v3/projects/c842ac69b8cd4cc594a25c823009a2da/users/31eaaa15286d4db49841f66762025af7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:42.430923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f47f3-59d8-4ff7-8bba-349de1c85866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c842ac69b8cd4cc594a25c823009a2da, user_id=31eaaa15286d4db49841f66762025af7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:42.434596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f47f3-59d8-4ff7-8bba-349de1c85866 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:42.467419 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3473/6896] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:42 2022] PUT /identity/v3/projects/c842ac69b8cd4cc594a25c823009a2da/users/31eaaa15286d4db49841f66762025af7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:42.469378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4b5f1-b23a-447b-a336-a2118df951f7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:42.470514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4b5f1-b23a-447b-a336-a2118df951f7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:42.470955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4b5f1-b23a-447b-a336-a2118df951f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:42.505489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a4c4b5f1-b23a-447b-a336-a2118df951f7 None None] MFA Rules not processed for user `31eaaa15286d4db49841f66762025af7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:42.509695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a4c4b5f1-b23a-447b-a336-a2118df951f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:42.623613 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3424/6897] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:42.625807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f47f3-59d8-4ff7-8bba-349de1c85866 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:42.640883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f47f3-59d8-4ff7-8bba-349de1c85866 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:42.646019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94117d-818f-491c-832a-68a37846c374 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:42.647169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94117d-818f-491c-832a-68a37846c374 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:42.647625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94117d-818f-491c-832a-68a37846c374 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:42.648111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94117d-818f-491c-832a-68a37846c374 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/application_credentials` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:42.649708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94117d-818f-491c-832a-68a37846c374 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:create_application_credential(user_id=31eaaa15286d4db49841f66762025af7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:42.651103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94117d-818f-491c-832a-68a37846c374 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:42.760197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4b5f1-b23a-447b-a336-a2118df951f7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:42.761884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a4c4b5f1-b23a-447b-a336-a2118df951f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:42.819245 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3474/6898] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Mar 26 21:12:42 2022] POST /identity/v3/users/31eaaa15286d4db49841f66762025af7/application_credentials => generated 920 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:42.820498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94117d-818f-491c-832a-68a37846c374 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:42.838454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94117d-818f-491c-832a-68a37846c374 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:42.846457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eef0d3-69d3-428d-92aa-a1dd503a9c0e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:42.856173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eef0d3-69d3-428d-92aa-a1dd503a9c0e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:42.856173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eef0d3-69d3-428d-92aa-a1dd503a9c0e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:42.856173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eef0d3-69d3-428d-92aa-a1dd503a9c0e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/access_rules/08750ff739d14003bbba555e5a133c7e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:42.860116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eef0d3-69d3-428d-92aa-a1dd503a9c0e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:delete_access_rule(user_id=31eaaa15286d4db49841f66762025af7, access_rule_id=08750ff739d14003bbba555e5a133c7e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:42.860116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eef0d3-69d3-428d-92aa-a1dd503a9c0e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:42.955812 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-88eef0d3-69d3-428d-92aa-a1dd503a9c0e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Mar 26 21:12:42.957676 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3475/6899] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Mar 26 21:12:42 2022] DELETE /identity/v3/users/31eaaa15286d4db49841f66762025af7/access_rules/08750ff739d14003bbba555e5a133c7e => generated 89 bytes in 138 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Mar 26 21:12:42.958893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4b5f1-b23a-447b-a336-a2118df951f7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:42.963081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eef0d3-69d3-428d-92aa-a1dd503a9c0e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:42.972351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:42.973349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:42.973734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:42.974109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] PATH_INFO: `/v3/projects/527d34e41144408c95c2b93cb797c5bc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:42.979949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eef0d3-69d3-428d-92aa-a1dd503a9c0e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:42.980891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527d34e41144408c95c2b93cb797c5bc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:42.982975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:43.003910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67127ef-3c5e-40d8-b1d7-ff0a2172c663 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:43.005582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67127ef-3c5e-40d8-b1d7-ff0a2172c663 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.006174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67127ef-3c5e-40d8-b1d7-ff0a2172c663 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.006832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67127ef-3c5e-40d8-b1d7-ff0a2172c663 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/application_credentials/97270d6baa9047538ddfab45482929e0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.063394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67127ef-3c5e-40d8-b1d7-ff0a2172c663 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:delete_application_credential(user_id=31eaaa15286d4db49841f66762025af7, application_credential_id=97270d6baa9047538ddfab45482929e0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:43.065139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67127ef-3c5e-40d8-b1d7-ff0a2172c663 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:43.098097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527d34e41144408c95c2b93cb797c5bc', 'request_id': 'req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:43.109658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527d34e41144408c95c2b93cb797c5bc', 'request_id': 'req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:43.110460 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3476/6900] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Mar 26 21:12:42 2022] DELETE /identity/v3/users/31eaaa15286d4db49841f66762025af7/application_credentials/97270d6baa9047538ddfab45482929e0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:43.115008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67127ef-3c5e-40d8-b1d7-ff0a2172c663 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:43.117227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527d34e41144408c95c2b93cb797c5bc', 'request_id': 'req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:43.132788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] The token cache is being invalidate because project 527d34e41144408c95c2b93cb797c5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:43.133744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:43.134498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-33b0a7d6-7dc3-4eec-82db-c1c8839312e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:43.141422 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3425/6901] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:42 2022] DELETE /identity/v3/projects/527d34e41144408c95c2b93cb797c5bc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:43.142740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67127ef-3c5e-40d8-b1d7-ff0a2172c663 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:43.143236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc28559-298a-4b25-8380-4a3323c1fcc9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.143677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc28559-298a-4b25-8380-4a3323c1fcc9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.144336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc28559-298a-4b25-8380-4a3323c1fcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.172143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ddc28559-298a-4b25-8380-4a3323c1fcc9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:43.173656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ddc28559-298a-4b25-8380-4a3323c1fcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:43.327529 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3426/6902] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:43.329516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb300-366f-4ee7-aa93-ab204472796d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.329918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb300-366f-4ee7-aa93-ab204472796d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.330348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0bb300-366f-4ee7-aa93-ab204472796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.332244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be56ad-4a4b-411d-a35b-bf6cdb7c026e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:43.333128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be56ad-4a4b-411d-a35b-bf6cdb7c026e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.333418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be56ad-4a4b-411d-a35b-bf6cdb7c026e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.333704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be56ad-4a4b-411d-a35b-bf6cdb7c026e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/access_rules` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.337129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be56ad-4a4b-411d-a35b-bf6cdb7c026e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:list_access_rules(user_id=31eaaa15286d4db49841f66762025af7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:43.338666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be56ad-4a4b-411d-a35b-bf6cdb7c026e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:43.389781 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3477/6903] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 21:12:43 2022] GET /identity/v3/users/31eaaa15286d4db49841f66762025af7/access_rules => generated 369 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:43.393916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be56ad-4a4b-411d-a35b-bf6cdb7c026e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:43.397419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0d0bb300-366f-4ee7-aa93-ab204472796d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:43.398365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c3be56ad-4a4b-411d-a35b-bf6cdb7c026e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:43.401375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0d0bb300-366f-4ee7-aa93-ab204472796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:43.426387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be56ad-4a4b-411d-a35b-bf6cdb7c026e tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:43.438944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb1cb7-52d8-40f2-82ed-b4a3814962ad tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:43.440026 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3427/6904] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:43.441915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb1cb7-52d8-40f2-82ed-b4a3814962ad tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.442232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb1cb7-52d8-40f2-82ed-b4a3814962ad tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.442665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb1cb7-52d8-40f2-82ed-b4a3814962ad tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/access_rules/08750ff739d14003bbba555e5a133c7e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.444017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb300-366f-4ee7-aa93-ab204472796d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:43.445541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb1cb7-52d8-40f2-82ed-b4a3814962ad tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:delete_access_rule(user_id=31eaaa15286d4db49841f66762025af7, access_rule_id=08750ff739d14003bbba555e5a133c7e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:43.448130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb1cb7-52d8-40f2-82ed-b4a3814962ad tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:43.491691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0bb300-366f-4ee7-aa93-ab204472796d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:43.499461 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3478/6905] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Mar 26 21:12:43 2022] DELETE /identity/v3/users/31eaaa15286d4db49841f66762025af7/access_rules/08750ff739d14003bbba555e5a133c7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:43.503489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb1cb7-52d8-40f2-82ed-b4a3814962ad tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:43.512233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e10c-1a89-48ed-8af7-dc864f94f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:43.512925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e10c-1a89-48ed-8af7-dc864f94f927 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.513211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e10c-1a89-48ed-8af7-dc864f94f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.513487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63e10c-1a89-48ed-8af7-dc864f94f927 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.514213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63e10c-1a89-48ed-8af7-dc864f94f927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:43.514516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63e10c-1a89-48ed-8af7-dc864f94f927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:43.517642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63e10c-1a89-48ed-8af7-dc864f94f927 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:43.520211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb1cb7-52d8-40f2-82ed-b4a3814962ad tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:43.544623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565cd88-3da6-487d-b765-b57e0114db03 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:43.545955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565cd88-3da6-487d-b765-b57e0114db03 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.546444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565cd88-3da6-487d-b765-b57e0114db03 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.546923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565cd88-3da6-487d-b765-b57e0114db03 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/access_rules` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.549826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565cd88-3da6-487d-b765-b57e0114db03 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:list_access_rules(user_id=31eaaa15286d4db49841f66762025af7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:43.551626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565cd88-3da6-487d-b765-b57e0114db03 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:43.566411 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3428/6906] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:43.568597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e10c-1a89-48ed-8af7-dc864f94f927 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:43.571690 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3479/6907] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 21:12:43 2022] GET /identity/v3/users/31eaaa15286d4db49841f66762025af7/access_rules => generated 158 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:43.576945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565cd88-3da6-487d-b765-b57e0114db03 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:43.596817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63e10c-1a89-48ed-8af7-dc864f94f927 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:43.612200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565cd88-3da6-487d-b765-b57e0114db03 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:43.619123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beb452-2f62-4eec-be83-abdd0992042b tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:43.620449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beb452-2f62-4eec-be83-abdd0992042b tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.620962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beb452-2f62-4eec-be83-abdd0992042b tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.621590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15beb452-2f62-4eec-be83-abdd0992042b tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/application_credentials` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.622674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beb452-2f62-4eec-be83-abdd0992042b tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:create_application_credential(user_id=31eaaa15286d4db49841f66762025af7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:43.623616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767e64-e231-49f8-92f8-b995ae806da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:43.624395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767e64-e231-49f8-92f8-b995ae806da4 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.624661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767e64-e231-49f8-92f8-b995ae806da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.624936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a767e64-e231-49f8-92f8-b995ae806da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.625790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15beb452-2f62-4eec-be83-abdd0992042b tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:43.626120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a767e64-e231-49f8-92f8-b995ae806da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:43.631198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a767e64-e231-49f8-92f8-b995ae806da4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:43.703699 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3429/6908] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:43 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:43.708248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767e64-e231-49f8-92f8-b995ae806da4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:43.875869 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3480/6909] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Mar 26 21:12:43 2022] POST /identity/v3/users/31eaaa15286d4db49841f66762025af7/application_credentials => generated 920 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:43.880996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beb452-2f62-4eec-be83-abdd0992042b tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:43.893612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a767e64-e231-49f8-92f8-b995ae806da4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:43.897550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15beb452-2f62-4eec-be83-abdd0992042b tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:43.908790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e27fe-52cc-432d-862c-9b6762212364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:43.909885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e27fe-52cc-432d-862c-9b6762212364 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:43.910172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e27fe-52cc-432d-862c-9b6762212364 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:43.910445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e27fe-52cc-432d-862c-9b6762212364 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:43.911135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e27fe-52cc-432d-862c-9b6762212364 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:43.914096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e27fe-52cc-432d-862c-9b6762212364 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:43.969790 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3430/6910] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:43 2022] POST /identity/v3/users => generated 295 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:43.974787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e27fe-52cc-432d-862c-9b6762212364 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.001345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e27fe-52cc-432d-862c-9b6762212364 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.013849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d406-af58-4bba-a5af-4136d01ad832 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.015992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d406-af58-4bba-a5af-4136d01ad832 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.016395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d406-af58-4bba-a5af-4136d01ad832 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.016780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62d406-af58-4bba-a5af-4136d01ad832 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/access_rules` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.018272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62d406-af58-4bba-a5af-4136d01ad832 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:list_access_rules(user_id=31eaaa15286d4db49841f66762025af7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.020277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62d406-af58-4bba-a5af-4136d01ad832 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.027892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b9ae3-f888-42ec-814b-ff5b17d3640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.028565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b9ae3-f888-42ec-814b-ff5b17d3640a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.028852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b9ae3-f888-42ec-814b-ff5b17d3640a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.029131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b9ae3-f888-42ec-814b-ff5b17d3640a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.038708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b9ae3-f888-42ec-814b-ff5b17d3640a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.038983 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3481/6911] 10.222.0.16 () {58 vars in 1259 bytes} [Sat Mar 26 21:12:43 2022] GET /identity/v3/users/31eaaa15286d4db49841f66762025af7/access_rules => generated 369 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:44.038983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d406-af58-4bba-a5af-4136d01ad832 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.039180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b9ae3-f888-42ec-814b-ff5b17d3640a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.049195 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3431/6912] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:44.052929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b9ae3-f888-42ec-814b-ff5b17d3640a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.059282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62d406-af58-4bba-a5af-4136d01ad832 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.069192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad439096-3794-4f31-a7a2-5cd43185a994 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.070180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439096-3794-4f31-a7a2-5cd43185a994 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.070488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439096-3794-4f31-a7a2-5cd43185a994 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.071298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad439096-3794-4f31-a7a2-5cd43185a994 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/application_credentials` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.072090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad439096-3794-4f31-a7a2-5cd43185a994 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:create_application_credential(user_id=31eaaa15286d4db49841f66762025af7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.072595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b9ae3-f888-42ec-814b-ff5b17d3640a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.073351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad439096-3794-4f31-a7a2-5cd43185a994 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.082859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6560-51ee-4156-bbfb-4e7c44d9f002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.085204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6560-51ee-4156-bbfb-4e7c44d9f002 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.087438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6560-51ee-4156-bbfb-4e7c44d9f002 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.088054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6560-51ee-4156-bbfb-4e7c44d9f002 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.090170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6560-51ee-4156-bbfb-4e7c44d9f002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.093079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6560-51ee-4156-bbfb-4e7c44d9f002 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.112066 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3432/6913] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:44.117138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6560-51ee-4156-bbfb-4e7c44d9f002 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.142121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6560-51ee-4156-bbfb-4e7c44d9f002 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.149853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf124c47-a227-48ec-b8c6-9c5b1b7d328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.150822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf124c47-a227-48ec-b8c6-9c5b1b7d328d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.151423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf124c47-a227-48ec-b8c6-9c5b1b7d328d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.151727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf124c47-a227-48ec-b8c6-9c5b1b7d328d admin admin] PATH_INFO: `/v3/projects/fc922ea5d1564695ac143b86d7123f25/users/981e1bf6531f45c4b8911579995eecc0/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.176436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf124c47-a227-48ec-b8c6-9c5b1b7d328d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc922ea5d1564695ac143b86d7123f25, user_id=981e1bf6531f45c4b8911579995eecc0, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.180427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf124c47-a227-48ec-b8c6-9c5b1b7d328d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.201347 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3482/6914] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Mar 26 21:12:44 2022] POST /identity/v3/users/31eaaa15286d4db49841f66762025af7/application_credentials => generated 921 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:44.201819 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3433/6915] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:44 2022] PUT /identity/v3/projects/fc922ea5d1564695ac143b86d7123f25/users/981e1bf6531f45c4b8911579995eecc0/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:44.209125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad439096-3794-4f31-a7a2-5cd43185a994 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.213336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e335545-a982-4c56-af98-5a47d2937c43 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.213855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e335545-a982-4c56-af98-5a47d2937c43 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.214353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e335545-a982-4c56-af98-5a47d2937c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.221017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad439096-3794-4f31-a7a2-5cd43185a994 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.269254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3e335545-a982-4c56-af98-5a47d2937c43 None None] MFA Rules not processed for user `981e1bf6531f45c4b8911579995eecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:44.270488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3e335545-a982-4c56-af98-5a47d2937c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:44.281363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76c71a-1625-4a2a-bb5c-84810ef33570 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31eaaa15286d4db49841f66762025af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c842ac69b8cd4cc594a25c823009a2da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.282292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76c71a-1625-4a2a-bb5c-84810ef33570 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.282724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76c71a-1625-4a2a-bb5c-84810ef33570 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.283306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76c71a-1625-4a2a-bb5c-84810ef33570 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7/access_rules/0605cc6372434c7eb26b9c7d8fca4255` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.285161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76c71a-1625-4a2a-bb5c-84810ef33570 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorizing `identity:get_access_rule(user_id=31eaaa15286d4db49841f66762025af7, access_rule_id=0605cc6372434c7eb26b9c7d8fca4255)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.286657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76c71a-1625-4a2a-bb5c-84810ef33570 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.296096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3483/6916] 10.222.0.16 () {58 vars in 1358 bytes} [Sat Mar 26 21:12:44 2022] GET /identity/v3/users/31eaaa15286d4db49841f66762025af7/access_rules/0605cc6372434c7eb26b9c7d8fca4255 => generated 229 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:44.297491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76c71a-1625-4a2a-bb5c-84810ef33570 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.299742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9e76c71a-1625-4a2a-bb5c-84810ef33570 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:44.344220 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3434/6917] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:44.348332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e335545-a982-4c56-af98-5a47d2937c43 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.380467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76c71a-1625-4a2a-bb5c-84810ef33570 tempest-AccessRulesV3Test-1867768034 tempest-AccessRulesV3Test-1867768034-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.386219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.387228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.387517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.387791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] PATH_INFO: `/v3/users/31eaaa15286d4db49841f66762025af7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.389043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=31eaaa15286d4db49841f66762025af7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.391377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.419049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e335545-a982-4c56-af98-5a47d2937c43 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.425263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34e91-d8d5-4afc-bb3e-58869d79be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.426213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34e91-d8d5-4afc-bb3e-58869d79be5a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.426511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34e91-d8d5-4afc-bb3e-58869d79be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.426804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34e91-d8d5-4afc-bb3e-58869d79be5a admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.427521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c34e91-d8d5-4afc-bb3e-58869d79be5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.430443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c34e91-d8d5-4afc-bb3e-58869d79be5a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.452079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31eaaa15286d4db49841f66762025af7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:44.459796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31eaaa15286d4db49841f66762025af7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:44.460513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31eaaa15286d4db49841f66762025af7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:44.463870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31eaaa15286d4db49841f66762025af7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:44.464051 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3435/6918] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:44 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:44.464916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34e91-d8d5-4afc-bb3e-58869d79be5a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.466606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d7c34e91-d8d5-4afc-bb3e-58869d79be5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:44.471104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2418f895-7f0a-4d6b-aa03-a50cceddf3ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31eaaa15286d4db49841f66762025af7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:44.522586 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3484/6919] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:44 2022] DELETE /identity/v3/users/31eaaa15286d4db49841f66762025af7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:44.527552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cc7c-d2a5-4d0a-bf54-324ff1f6fde2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.527935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cc7c-d2a5-4d0a-bf54-324ff1f6fde2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.528247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cc7c-d2a5-4d0a-bf54-324ff1f6fde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.538578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34e91-d8d5-4afc-bb3e-58869d79be5a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.547120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dad8cc7c-d2a5-4d0a-bf54-324ff1f6fde2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:44.548616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dad8cc7c-d2a5-4d0a-bf54-324ff1f6fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:44.603025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362582-72c9-4799-9945-2491addf54dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.603704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362582-72c9-4799-9945-2491addf54dd admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.604062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362582-72c9-4799-9945-2491addf54dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.604292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca362582-72c9-4799-9945-2491addf54dd admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.604991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca362582-72c9-4799-9945-2491addf54dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.606976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca362582-72c9-4799-9945-2491addf54dd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.618552 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3485/6920] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:44.630204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8cc7c-d2a5-4d0a-bf54-324ff1f6fde2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.632083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dad8cc7c-d2a5-4d0a-bf54-324ff1f6fde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:44.639116 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3436/6921] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:44 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:44.640948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362582-72c9-4799-9945-2491addf54dd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.652821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca362582-72c9-4799-9945-2491addf54dd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.662292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1657fd-804d-446a-8d99-753e7cdfa1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.662974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1657fd-804d-446a-8d99-753e7cdfa1ba admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.663259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1657fd-804d-446a-8d99-753e7cdfa1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.663537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1657fd-804d-446a-8d99-753e7cdfa1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.665111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1657fd-804d-446a-8d99-753e7cdfa1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.666462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1657fd-804d-446a-8d99-753e7cdfa1ba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.678121 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3437/6922] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:44.682337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1657fd-804d-446a-8d99-753e7cdfa1ba admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.700058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1657fd-804d-446a-8d99-753e7cdfa1ba admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.710548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd57d91-b866-4fb4-8006-4a6e1b66f109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.711535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd57d91-b866-4fb4-8006-4a6e1b66f109 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.712003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd57d91-b866-4fb4-8006-4a6e1b66f109 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.712325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd57d91-b866-4fb4-8006-4a6e1b66f109 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.713660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd57d91-b866-4fb4-8006-4a6e1b66f109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.714350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8cc7c-d2a5-4d0a-bf54-324ff1f6fde2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.715710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd57d91-b866-4fb4-8006-4a6e1b66f109 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.718993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97afcfa-f977-4a54-9047-bcd95c542b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.720090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97afcfa-f977-4a54-9047-bcd95c542b99 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.720766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97afcfa-f977-4a54-9047-bcd95c542b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.720766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97afcfa-f977-4a54-9047-bcd95c542b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.730521 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3438/6923] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:44.732782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97afcfa-f977-4a54-9047-bcd95c542b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.734082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd57d91-b866-4fb4-8006-4a6e1b66f109 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.734262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97afcfa-f977-4a54-9047-bcd95c542b99 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.747957 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3486/6924] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:12:44.749887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd57d91-b866-4fb4-8006-4a6e1b66f109 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:44.755208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25026fc-64da-4ae1-b32f-8f92729a9f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:44.756170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25026fc-64da-4ae1-b32f-8f92729a9f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.756461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25026fc-64da-4ae1-b32f-8f92729a9f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.756743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25026fc-64da-4ae1-b32f-8f92729a9f27 admin admin] PATH_INFO: `/v3/projects/8692439ff0be4094bf83ca69d34e8b00/users/9b6d5feb76034397937002fcd45c2ebd/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.783457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25026fc-64da-4ae1-b32f-8f92729a9f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8692439ff0be4094bf83ca69d34e8b00, user_id=9b6d5feb76034397937002fcd45c2ebd, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:44.786945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25026fc-64da-4ae1-b32f-8f92729a9f27 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:44.807430 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3439/6925] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:44 2022] PUT /identity/v3/projects/8692439ff0be4094bf83ca69d34e8b00/users/9b6d5feb76034397937002fcd45c2ebd/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:44.819074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d8ac-aad4-45a1-9066-5ca9e39a7b35 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:44.819369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d8ac-aad4-45a1-9066-5ca9e39a7b35 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:44.819655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c2d8ac-aad4-45a1-9066-5ca9e39a7b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:44.849920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-59c2d8ac-aad4-45a1-9066-5ca9e39a7b35 None None] MFA Rules not processed for user `9b6d5feb76034397937002fcd45c2ebd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:44.851161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-59c2d8ac-aad4-45a1-9066-5ca9e39a7b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:44.951072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25026fc-64da-4ae1-b32f-8f92729a9f27 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:44.951898 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3487/6926] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:45.025817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25026fc-64da-4ae1-b32f-8f92729a9f27 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:45.031830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887554-574a-4d88-a8f4-53d4c64c054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:45.032790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887554-574a-4d88-a8f4-53d4c64c054d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:45.033148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887554-574a-4d88-a8f4-53d4c64c054d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:45.033741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea887554-574a-4d88-a8f4-53d4c64c054d admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:45.036073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea887554-574a-4d88-a8f4-53d4c64c054d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:45.038269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea887554-574a-4d88-a8f4-53d4c64c054d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:45.076495 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3440/6927] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:44 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:45.080447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2d8ac-aad4-45a1-9066-5ca9e39a7b35 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:45.094693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c2d8ac-aad4-45a1-9066-5ca9e39a7b35 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:45.158946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb88027-b2b0-4276-bc64-9e86c128b18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:45.159956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb88027-b2b0-4276-bc64-9e86c128b18d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:45.159956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb88027-b2b0-4276-bc64-9e86c128b18d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:45.160263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb88027-b2b0-4276-bc64-9e86c128b18d admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:45.160908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb88027-b2b0-4276-bc64-9e86c128b18d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:45.163195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb88027-b2b0-4276-bc64-9e86c128b18d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:45.194152 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3488/6928] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:45 2022] POST /identity/v3/users => generated 301 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:45.197749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887554-574a-4d88-a8f4-53d4c64c054d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:45.208068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea887554-574a-4d88-a8f4-53d4c64c054d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:45.214322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aff60e-f3ea-4923-b9e2-21a3197deedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:45.214322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aff60e-f3ea-4923-b9e2-21a3197deedb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:45.214694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aff60e-f3ea-4923-b9e2-21a3197deedb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:45.214908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aff60e-f3ea-4923-b9e2-21a3197deedb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:45.215673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aff60e-f3ea-4923-b9e2-21a3197deedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:45.217543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aff60e-f3ea-4923-b9e2-21a3197deedb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:45.233434 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3441/6929] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:45.234608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb88027-b2b0-4276-bc64-9e86c128b18d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:45.248319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb88027-b2b0-4276-bc64-9e86c128b18d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:45.253373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52794fa8-04c8-473e-9c2f-b0b2f87c0e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:45.254279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52794fa8-04c8-473e-9c2f-b0b2f87c0e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:45.254564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52794fa8-04c8-473e-9c2f-b0b2f87c0e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:45.254841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52794fa8-04c8-473e-9c2f-b0b2f87c0e7a admin admin] PATH_INFO: `/v3/projects/9ea71753ae8c419c9a3aa67bd2f24583/users/c73b47dca1de4527976932c2e883fb1a/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:45.271779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52794fa8-04c8-473e-9c2f-b0b2f87c0e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea71753ae8c419c9a3aa67bd2f24583, user_id=c73b47dca1de4527976932c2e883fb1a, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:45.275554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52794fa8-04c8-473e-9c2f-b0b2f87c0e7a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:45.297977 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3489/6930] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:45 2022] PUT /identity/v3/projects/9ea71753ae8c419c9a3aa67bd2f24583/users/c73b47dca1de4527976932c2e883fb1a/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:45.311479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aff60e-f3ea-4923-b9e2-21a3197deedb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:45.324880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aff60e-f3ea-4923-b9e2-21a3197deedb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:45.423810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f379576-67af-499c-9f2b-a7cb58d274f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:45.425215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379576-67af-499c-9f2b-a7cb58d274f1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:45.425684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379576-67af-499c-9f2b-a7cb58d274f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:45.426168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f379576-67af-499c-9f2b-a7cb58d274f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:45.427887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f379576-67af-499c-9f2b-a7cb58d274f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:45.429854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f379576-67af-499c-9f2b-a7cb58d274f1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:45.448998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52794fa8-04c8-473e-9c2f-b0b2f87c0e7a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:45.451163 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3442/6931] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:45.470131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52794fa8-04c8-473e-9c2f-b0b2f87c0e7a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:45.479219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea947-7a95-4542-a010-145cdb641bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:45.479219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea947-7a95-4542-a010-145cdb641bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:45.479219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea947-7a95-4542-a010-145cdb641bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:45.479219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea947-7a95-4542-a010-145cdb641bf2 admin admin] PATH_INFO: `/v3/projects/9ea71753ae8c419c9a3aa67bd2f24583/users/c73b47dca1de4527976932c2e883fb1a/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:45.479630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eea947-7a95-4542-a010-145cdb641bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea71753ae8c419c9a3aa67bd2f24583, user_id=c73b47dca1de4527976932c2e883fb1a, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:45.482713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eea947-7a95-4542-a010-145cdb641bf2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:45.497295 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3490/6932] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:45 2022] PUT /identity/v3/projects/9ea71753ae8c419c9a3aa67bd2f24583/users/c73b47dca1de4527976932c2e883fb1a/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:45.507571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb7b55-a0a3-476f-a771-2a495e416bde None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:45.508599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb7b55-a0a3-476f-a771-2a495e416bde None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:45.509052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb7b55-a0a3-476f-a771-2a495e416bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:45.543806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5abb7b55-a0a3-476f-a771-2a495e416bde None None] MFA Rules not processed for user `c73b47dca1de4527976932c2e883fb1a`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:45.545357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5abb7b55-a0a3-476f-a771-2a495e416bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:45.664017 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3443/6933] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:45.673215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea947-7a95-4542-a010-145cdb641bf2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:45.675097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b3eea947-7a95-4542-a010-145cdb641bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:45.754889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb7b55-a0a3-476f-a771-2a495e416bde None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:45.756571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5abb7b55-a0a3-476f-a771-2a495e416bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:45.837776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea947-7a95-4542-a010-145cdb641bf2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:45.856345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0222415-6a6f-42bb-882c-9a9a5b1c480c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:45.858171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0222415-6a6f-42bb-882c-9a9a5b1c480c service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:45.859117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0222415-6a6f-42bb-882c-9a9a5b1c480c service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:45.860144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0222415-6a6f-42bb-882c-9a9a5b1c480c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:45.864820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f0222415-6a6f-42bb-882c-9a9a5b1c480c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:45.913437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb7b55-a0a3-476f-a771-2a495e416bde None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:45.924725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:45.925873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:45.926486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:45.926939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] PATH_INFO: `/v3/projects/c842ac69b8cd4cc594a25c823009a2da` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:45.932510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c842ac69b8cd4cc594a25c823009a2da)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:45.934854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:46.004100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0222415-6a6f-42bb-882c-9a9a5b1c480c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:46.015752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0222415-6a6f-42bb-882c-9a9a5b1c480c service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:46.034802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c842ac69b8cd4cc594a25c823009a2da', 'request_id': 'req-025d6c73-619a-4e58-bdf5-c6fd0ef82048'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:46.037006 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3491/6934] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:46.059070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c842ac69b8cd4cc594a25c823009a2da', 'request_id': 'req-025d6c73-619a-4e58-bdf5-c6fd0ef82048'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:46.065848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c842ac69b8cd4cc594a25c823009a2da', 'request_id': 'req-025d6c73-619a-4e58-bdf5-c6fd0ef82048'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:46.080218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] The token cache is being invalidate because project c842ac69b8cd4cc594a25c823009a2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:46.080665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:46.081428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-025d6c73-619a-4e58-bdf5-c6fd0ef82048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:46.085089 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3444/6935] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:45 2022] DELETE /identity/v3/projects/c842ac69b8cd4cc594a25c823009a2da => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:46.091098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6202b7b-8a97-4aa1-9d2c-4dcad665fc32 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.092253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6202b7b-8a97-4aa1-9d2c-4dcad665fc32 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.092640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6202b7b-8a97-4aa1-9d2c-4dcad665fc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.135939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b6202b7b-8a97-4aa1-9d2c-4dcad665fc32 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:46.137587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b6202b7b-8a97-4aa1-9d2c-4dcad665fc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:46.228789 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3492/6936] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:46.236428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03875386-d2e8-478a-9aaf-9bd27d3138bc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.236933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03875386-d2e8-478a-9aaf-9bd27d3138bc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.237319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03875386-d2e8-478a-9aaf-9bd27d3138bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.264182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-03875386-d2e8-478a-9aaf-9bd27d3138bc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:46.265568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-03875386-d2e8-478a-9aaf-9bd27d3138bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:46.276804 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3445/6937] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:46.280982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6202b7b-8a97-4aa1-9d2c-4dcad665fc32 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:46.291025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6202b7b-8a97-4aa1-9d2c-4dcad665fc32 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:46.295972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb2f25-abd5-4b82-89d5-5416176c1c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:46.297149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb2f25-abd5-4b82-89d5-5416176c1c83 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.297149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb2f25-abd5-4b82-89d5-5416176c1c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.297460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb2f25-abd5-4b82-89d5-5416176c1c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.298424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb2f25-abd5-4b82-89d5-5416176c1c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:46.298707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb2f25-abd5-4b82-89d5-5416176c1c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:46.300616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb2f25-abd5-4b82-89d5-5416176c1c83 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:46.314703 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3493/6938] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:46.319051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03875386-d2e8-478a-9aaf-9bd27d3138bc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:46.331083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03875386-d2e8-478a-9aaf-9bd27d3138bc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:46.339188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91290621-6155-45b2-8a8b-795b01763f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:46.340093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91290621-6155-45b2-8a8b-795b01763f1c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.340349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91290621-6155-45b2-8a8b-795b01763f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.340587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91290621-6155-45b2-8a8b-795b01763f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.341507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91290621-6155-45b2-8a8b-795b01763f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:46.343967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91290621-6155-45b2-8a8b-795b01763f1c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:46.372509 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3446/6939] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:46 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:46.376818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb2f25-abd5-4b82-89d5-5416176c1c83 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:46.390104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb2f25-abd5-4b82-89d5-5416176c1c83 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:46.495650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42556f-1da3-420e-9ae6-104c961af9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:46.496370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42556f-1da3-420e-9ae6-104c961af9f7 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.496653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42556f-1da3-420e-9ae6-104c961af9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.496934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42556f-1da3-420e-9ae6-104c961af9f7 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.497670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42556f-1da3-420e-9ae6-104c961af9f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:46.499808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42556f-1da3-420e-9ae6-104c961af9f7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:46.533307 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3494/6940] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:46 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:46.537462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91290621-6155-45b2-8a8b-795b01763f1c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:46.558846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91290621-6155-45b2-8a8b-795b01763f1c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:46.567777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6275d-abbb-4c4e-98b1-7557613050c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:46.568854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6275d-abbb-4c4e-98b1-7557613050c6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.570418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6275d-abbb-4c4e-98b1-7557613050c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.571937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6275d-abbb-4c4e-98b1-7557613050c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.572905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6275d-abbb-4c4e-98b1-7557613050c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:46.574864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6275d-abbb-4c4e-98b1-7557613050c6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:46.598325 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3447/6941] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:46.598648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42556f-1da3-420e-9ae6-104c961af9f7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:46.609530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42556f-1da3-420e-9ae6-104c961af9f7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:46.615496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cde6d7-e19a-4b3c-9cbd-eedac2c41bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:46.616543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde6d7-e19a-4b3c-9cbd-eedac2c41bfe admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.617050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde6d7-e19a-4b3c-9cbd-eedac2c41bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.618917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cde6d7-e19a-4b3c-9cbd-eedac2c41bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.619886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cde6d7-e19a-4b3c-9cbd-eedac2c41bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:46.623460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cde6d7-e19a-4b3c-9cbd-eedac2c41bfe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:46.646104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6275d-abbb-4c4e-98b1-7557613050c6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:46.656314 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3495/6942] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:46.660523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6275d-abbb-4c4e-98b1-7557613050c6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:46.665185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e569ba6-5c16-485a-9691-0712e7310283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:46.666211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e569ba6-5c16-485a-9691-0712e7310283 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.666494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e569ba6-5c16-485a-9691-0712e7310283 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.666768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e569ba6-5c16-485a-9691-0712e7310283 admin admin] PATH_INFO: `/v3/projects/b6a0c0c432a64b059eee3fda3ffba6b2/users/e7610572c17f4a3291d2b2160d367ce7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.682846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e569ba6-5c16-485a-9691-0712e7310283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a0c0c432a64b059eee3fda3ffba6b2, user_id=e7610572c17f4a3291d2b2160d367ce7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:46.686062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e569ba6-5c16-485a-9691-0712e7310283 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:46.721311 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3448/6943] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:46 2022] PUT /identity/v3/projects/b6a0c0c432a64b059eee3fda3ffba6b2/users/e7610572c17f4a3291d2b2160d367ce7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:46.821546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e63e8-cc68-4811-ba0f-8d55b38cc94d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.821837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e63e8-cc68-4811-ba0f-8d55b38cc94d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.822929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e63e8-cc68-4811-ba0f-8d55b38cc94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.853617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-049e63e8-cc68-4811-ba0f-8d55b38cc94d None None] MFA Rules not processed for user `e7610572c17f4a3291d2b2160d367ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:46.854962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-049e63e8-cc68-4811-ba0f-8d55b38cc94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:46.966963 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3496/6944] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:46.968041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e569ba6-5c16-485a-9691-0712e7310283 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:46.982031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e569ba6-5c16-485a-9691-0712e7310283 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:46.988096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5664f4-bd3e-4291-9690-13513b08655a tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7610572c17f4a3291d2b2160d367ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a0c0c432a64b059eee3fda3ffba6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:46.989813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5664f4-bd3e-4291-9690-13513b08655a tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:46.990261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5664f4-bd3e-4291-9690-13513b08655a tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:46.990602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5664f4-bd3e-4291-9690-13513b08655a tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] PATH_INFO: `/v3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:46.996291 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3449/6945] 10.222.0.16 () {58 vars in 1103 bytes} [Sat Mar 26 21:12:46 2022] GET /identity/v3 => generated 255 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:12:46.998507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e63e8-cc68-4811-ba0f-8d55b38cc94d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:47.011777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e63e8-cc68-4811-ba0f-8d55b38cc94d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:47.023961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004b68e-3db7-4183-8e12-f993b1fcf403 tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7610572c17f4a3291d2b2160d367ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a0c0c432a64b059eee3fda3ffba6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:47.023961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b68e-3db7-4183-8e12-f993b1fcf403 tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:47.023961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b68e-3db7-4183-8e12-f993b1fcf403 tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:47.024343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b68e-3db7-4183-8e12-f993b1fcf403 tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] PATH_INFO: `/v3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:47.024343 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3497/6946] 10.222.0.16 () {58 vars in 1103 bytes} [Sat Mar 26 21:12:46 2022] GET /identity/v3 => generated 255 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:47.028552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5664f4-bd3e-4291-9690-13513b08655a tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:47.040276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5664f4-bd3e-4291-9690-13513b08655a tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:47.046582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028be62-ca78-4b7d-8150-c2905785a412 tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7610572c17f4a3291d2b2160d367ce7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b6a0c0c432a64b059eee3fda3ffba6b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:47.047663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028be62-ca78-4b7d-8150-c2905785a412 tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:47.048296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028be62-ca78-4b7d-8150-c2905785a412 tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:47.048530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028be62-ca78-4b7d-8150-c2905785a412 tempest-TestApiDiscovery-1186763665 tempest-TestApiDiscovery-1186763665-project] PATH_INFO: `/v3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:47.050460 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3450/6947] 10.222.0.16 () {58 vars in 1103 bytes} [Sat Mar 26 21:12:47 2022] GET /identity/v3 => generated 255 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:12:47.056749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2edfc1-2d99-4e69-9304-237929469169 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:47.057157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2edfc1-2d99-4e69-9304-237929469169 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:47.057603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2edfc1-2d99-4e69-9304-237929469169 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:47.059960 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3498/6948] 10.222.0.16 () {56 vars in 894 bytes} [Sat Mar 26 21:12:47 2022] GET /identity/ => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:12:47.064731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed8a7c-ceba-403f-a2c5-4945237f7452 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:47.065143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed8a7c-ceba-403f-a2c5-4945237f7452 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:47.065539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed8a7c-ceba-403f-a2c5-4945237f7452 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:47.068586 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3451/6949] 10.222.0.16 () {56 vars in 894 bytes} [Sat Mar 26 21:12:47 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:12:47.072536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2edfc1-2d99-4e69-9304-237929469169 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:47.159104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2edfc1-2d99-4e69-9304-237929469169 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:47.163878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:47.165608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:47.165898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:47.166291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] PATH_INFO: `/v3/users/e7610572c17f4a3291d2b2160d367ce7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:47.167581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7610572c17f4a3291d2b2160d367ce7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:47.170740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:47.234250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7610572c17f4a3291d2b2160d367ce7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:47.244835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7610572c17f4a3291d2b2160d367ce7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:47.245704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7610572c17f4a3291d2b2160d367ce7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:47.246611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7610572c17f4a3291d2b2160d367ce7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:47.262359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7610572c17f4a3291d2b2160d367ce7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:47.304150 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3499/6950] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:47 2022] DELETE /identity/v3/users/e7610572c17f4a3291d2b2160d367ce7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:47.306336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09074c-b94a-4248-8bf0-78b220977607 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:47.306738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09074c-b94a-4248-8bf0-78b220977607 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:47.307120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09074c-b94a-4248-8bf0-78b220977607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:47.329954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9d09074c-b94a-4248-8bf0-78b220977607 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:47.332336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d09074c-b94a-4248-8bf0-78b220977607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:47.433286 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3452/6951] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:47.448613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:47.450530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:47.518933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b0662-d545-41a9-8989-2976cc55f407 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:47.522930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9127b7-d15d-4d40-a1b7-aba12a1a4f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:47.524242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9127b7-d15d-4d40-a1b7-aba12a1a4f1c service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:47.524533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9127b7-d15d-4d40-a1b7-aba12a1a4f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:47.524811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9127b7-d15d-4d40-a1b7-aba12a1a4f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:47.535060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9127b7-d15d-4d40-a1b7-aba12a1a4f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:47.537346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9127b7-d15d-4d40-a1b7-aba12a1a4f1c service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:47.550525 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3500/6952] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:48.275287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09074c-b94a-4248-8bf0-78b220977607 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:48.276814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d09074c-b94a-4248-8bf0-78b220977607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:48.293818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09074c-b94a-4248-8bf0-78b220977607 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:48.312072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:48.313365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:48.313716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:48.314227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] PATH_INFO: `/v3/projects/b6a0c0c432a64b059eee3fda3ffba6b2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:48.324915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a0c0c432a64b059eee3fda3ffba6b2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:48.326999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:48.425314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a0c0c432a64b059eee3fda3ffba6b2', 'request_id': 'req-6797a97c-3ec8-47cc-acd5-afae95760f6c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:48.448177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a0c0c432a64b059eee3fda3ffba6b2', 'request_id': 'req-6797a97c-3ec8-47cc-acd5-afae95760f6c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:48.456402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a0c0c432a64b059eee3fda3ffba6b2', 'request_id': 'req-6797a97c-3ec8-47cc-acd5-afae95760f6c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:48.480519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] The token cache is being invalidate because project b6a0c0c432a64b059eee3fda3ffba6b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:48.481038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:48.494260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6797a97c-3ec8-47cc-acd5-afae95760f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:48.497536 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3453/6953] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:48 2022] DELETE /identity/v3/projects/b6a0c0c432a64b059eee3fda3ffba6b2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:48.502461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42b86a-f45a-420d-8814-de8bbf13c7f9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:48.503002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42b86a-f45a-420d-8814-de8bbf13c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:48.503494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42b86a-f45a-420d-8814-de8bbf13c7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:48.548129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1e42b86a-f45a-420d-8814-de8bbf13c7f9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:48.552894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1e42b86a-f45a-420d-8814-de8bbf13c7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:48.696089 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3501/6954] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:48.700267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40ee23-011d-449e-887f-6482e93a74c6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:48.700823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40ee23-011d-449e-887f-6482e93a74c6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:48.701343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40ee23-011d-449e-887f-6482e93a74c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:48.740783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ea40ee23-011d-449e-887f-6482e93a74c6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:48.742198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ea40ee23-011d-449e-887f-6482e93a74c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:48.765142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3454/6955] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:48.766323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42b86a-f45a-420d-8814-de8bbf13c7f9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:48.779840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42b86a-f45a-420d-8814-de8bbf13c7f9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:48.801275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de4cd-9542-4e92-8960-08ebd816e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:48.801451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de4cd-9542-4e92-8960-08ebd816e7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:48.801700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de4cd-9542-4e92-8960-08ebd816e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:48.802411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880de4cd-9542-4e92-8960-08ebd816e7d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:48.802727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de4cd-9542-4e92-8960-08ebd816e7d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:48.803025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de4cd-9542-4e92-8960-08ebd816e7d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:48.806408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880de4cd-9542-4e92-8960-08ebd816e7d2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:48.833815 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3502/6956] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:48.838317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40ee23-011d-449e-887f-6482e93a74c6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:48.854917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40ee23-011d-449e-887f-6482e93a74c6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:48.859840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27100-e7d9-4290-9d3a-9368b0443a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:48.860533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27100-e7d9-4290-9d3a-9368b0443a3e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:48.860812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27100-e7d9-4290-9d3a-9368b0443a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:48.861081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27100-e7d9-4290-9d3a-9368b0443a3e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:48.861771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27100-e7d9-4290-9d3a-9368b0443a3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:48.863703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27100-e7d9-4290-9d3a-9368b0443a3e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:48.899987 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3455/6957] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:48 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:48.904058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de4cd-9542-4e92-8960-08ebd816e7d2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:48.919455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880de4cd-9542-4e92-8960-08ebd816e7d2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:49.079023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fc66d-a441-440a-80af-f3b5a2d2f42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:49.079708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fc66d-a441-440a-80af-f3b5a2d2f42d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:49.080226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fc66d-a441-440a-80af-f3b5a2d2f42d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:49.080732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fc66d-a441-440a-80af-f3b5a2d2f42d admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:49.082362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fc66d-a441-440a-80af-f3b5a2d2f42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:49.084394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fc66d-a441-440a-80af-f3b5a2d2f42d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:49.128006 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3503/6958] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:48 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:49.131410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27100-e7d9-4290-9d3a-9368b0443a3e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:49.153930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27100-e7d9-4290-9d3a-9368b0443a3e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:49.162175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55b544-d297-4da9-817b-885d1c9a45e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:49.162826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55b544-d297-4da9-817b-885d1c9a45e4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:49.163158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55b544-d297-4da9-817b-885d1c9a45e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:49.165025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55b544-d297-4da9-817b-885d1c9a45e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:49.166337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55b544-d297-4da9-817b-885d1c9a45e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:49.168733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55b544-d297-4da9-817b-885d1c9a45e4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:49.188003 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3456/6959] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:49.189758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fc66d-a441-440a-80af-f3b5a2d2f42d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:49.204560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fc66d-a441-440a-80af-f3b5a2d2f42d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:49.217238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb0cea-3731-4cb4-be5e-60c6a39a16a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:49.221672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb0cea-3731-4cb4-be5e-60c6a39a16a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:49.222007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb0cea-3731-4cb4-be5e-60c6a39a16a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:49.222292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb0cea-3731-4cb4-be5e-60c6a39a16a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:49.223177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb0cea-3731-4cb4-be5e-60c6a39a16a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:49.238383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb0cea-3731-4cb4-be5e-60c6a39a16a7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:49.265016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55b544-d297-4da9-817b-885d1c9a45e4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:49.266755 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3504/6960] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:49.276287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55b544-d297-4da9-817b-885d1c9a45e4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:49.306089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f066774-8f13-4bee-97cd-b8838255ada7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:49.309158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f066774-8f13-4bee-97cd-b8838255ada7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:49.309716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f066774-8f13-4bee-97cd-b8838255ada7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:49.310324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f066774-8f13-4bee-97cd-b8838255ada7 admin admin] PATH_INFO: `/v3/projects/60eddc0d728b41318681e57595b8236e/users/c01bc8d01a794b4caed0b886913d8963/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:49.361683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f066774-8f13-4bee-97cd-b8838255ada7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eddc0d728b41318681e57595b8236e, user_id=c01bc8d01a794b4caed0b886913d8963, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:49.366048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f066774-8f13-4bee-97cd-b8838255ada7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:49.405447 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3457/6961] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:49 2022] PUT /identity/v3/projects/60eddc0d728b41318681e57595b8236e/users/c01bc8d01a794b4caed0b886913d8963/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:49.416582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4d2ab-1c68-4ec6-ba14-d2016c8e9bc8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:49.416869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4d2ab-1c68-4ec6-ba14-d2016c8e9bc8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:49.417151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4d2ab-1c68-4ec6-ba14-d2016c8e9bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:49.541005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-47a4d2ab-1c68-4ec6-ba14-d2016c8e9bc8 None None] MFA Rules not processed for user `c01bc8d01a794b4caed0b886913d8963`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:49.542840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-47a4d2ab-1c68-4ec6-ba14-d2016c8e9bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:49.808632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f066774-8f13-4bee-97cd-b8838255ada7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:49.820735 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3505/6962] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:49.830026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f066774-8f13-4bee-97cd-b8838255ada7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:49.847736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f883e-41e3-4f2e-80e2-6873f3336af2 tempest-DefaultDomainTestJSON-193377847 tempest-DefaultDomainTestJSON-193377847-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c01bc8d01a794b4caed0b886913d8963', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60eddc0d728b41318681e57595b8236e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:49.848883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f883e-41e3-4f2e-80e2-6873f3336af2 tempest-DefaultDomainTestJSON-193377847 tempest-DefaultDomainTestJSON-193377847-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:49.865015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f883e-41e3-4f2e-80e2-6873f3336af2 tempest-DefaultDomainTestJSON-193377847 tempest-DefaultDomainTestJSON-193377847-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:49.869163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f883e-41e3-4f2e-80e2-6873f3336af2 tempest-DefaultDomainTestJSON-193377847 tempest-DefaultDomainTestJSON-193377847-project] PATH_INFO: `/v3/domains/default` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:49.875559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f883e-41e3-4f2e-80e2-6873f3336af2 tempest-DefaultDomainTestJSON-193377847 tempest-DefaultDomainTestJSON-193377847-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:49.885682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f883e-41e3-4f2e-80e2-6873f3336af2 tempest-DefaultDomainTestJSON-193377847 tempest-DefaultDomainTestJSON-193377847-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:49.890158 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3458/6963] 10.222.0.16 () {58 vars in 1151 bytes} [Sat Mar 26 21:12:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:49.893761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4d2ab-1c68-4ec6-ba14-d2016c8e9bc8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:50.060830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4d2ab-1c68-4ec6-ba14-d2016c8e9bc8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:50.078005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:50.081946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:50.082422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:50.082895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] PATH_INFO: `/v3/users/c01bc8d01a794b4caed0b886913d8963` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:50.085313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01bc8d01a794b4caed0b886913d8963)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:50.089729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:50.180632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01bc8d01a794b4caed0b886913d8963'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.203223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01bc8d01a794b4caed0b886913d8963'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.205444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01bc8d01a794b4caed0b886913d8963'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.206866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01bc8d01a794b4caed0b886913d8963'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.223503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01bc8d01a794b4caed0b886913d8963'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.258934 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3506/6964] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:49 2022] DELETE /identity/v3/users/c01bc8d01a794b4caed0b886913d8963 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:50.261035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1a136-adaf-4b17-bfb6-89d8536cf736 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:50.261381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1a136-adaf-4b17-bfb6-89d8536cf736 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:50.261837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1a136-adaf-4b17-bfb6-89d8536cf736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:50.293810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-79c1a136-adaf-4b17-bfb6-89d8536cf736 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:50.295428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-79c1a136-adaf-4b17-bfb6-89d8536cf736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:50.443572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:50.445160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:50.453646 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3459/6965] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:50.472600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae114484-641a-4d14-acd0-660393c43bea admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:50.480287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:50.481429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:50.481876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:50.482362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] PATH_INFO: `/v3/users/45fb1f41249b4e9daf200e30e7f150e4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:50.483865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45fb1f41249b4e9daf200e30e7f150e4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:50.486197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:50.491319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1a136-adaf-4b17-bfb6-89d8536cf736 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:50.493539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-79c1a136-adaf-4b17-bfb6-89d8536cf736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:50.585143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1a136-adaf-4b17-bfb6-89d8536cf736 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:50.590221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1faca5-e234-4a62-8a9a-8fb42861e4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:50.591293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1faca5-e234-4a62-8a9a-8fb42861e4da service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:50.591791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1faca5-e234-4a62-8a9a-8fb42861e4da service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:50.592318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1faca5-e234-4a62-8a9a-8fb42861e4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:50.594839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45fb1f41249b4e9daf200e30e7f150e4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.606527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1faca5-e234-4a62-8a9a-8fb42861e4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:50.608834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1faca5-e234-4a62-8a9a-8fb42861e4da service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:50.611965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45fb1f41249b4e9daf200e30e7f150e4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.612716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45fb1f41249b4e9daf200e30e7f150e4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.613327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45fb1f41249b4e9daf200e30e7f150e4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.624145 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3460/6966] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:12:50.631108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45fb1f41249b4e9daf200e30e7f150e4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:50.694053 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3507/6967] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:50 2022] DELETE /identity/v3/users/45fb1f41249b4e9daf200e30e7f150e4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:50.698407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8152e71-3b8e-4c52-b4ba-b3425cc0b44a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:50.698940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8152e71-3b8e-4c52-b4ba-b3425cc0b44a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:50.699828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8152e71-3b8e-4c52-b4ba-b3425cc0b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:50.722564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b8152e71-3b8e-4c52-b4ba-b3425cc0b44a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:50.723745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b8152e71-3b8e-4c52-b4ba-b3425cc0b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:50.882699 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3461/6968] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:50.925117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:50.926656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:51.059407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb34b49-0794-4dd3-825f-64b5190822e1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:51.084281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4a97b-465a-46d5-ae70-683a9205947e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:51.087391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4a97b-465a-46d5-ae70-683a9205947e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.087846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4a97b-465a-46d5-ae70-683a9205947e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.089116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4a97b-465a-46d5-ae70-683a9205947e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.110363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4a97b-465a-46d5-ae70-683a9205947e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:51.112290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4a97b-465a-46d5-ae70-683a9205947e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:51.132345 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3508/6969] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:51.340379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8152e71-3b8e-4c52-b4ba-b3425cc0b44a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:51.342011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b8152e71-3b8e-4c52-b4ba-b3425cc0b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:51.356892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8152e71-3b8e-4c52-b4ba-b3425cc0b44a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:51.363617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:51.364973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.365489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.366000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] PATH_INFO: `/v3/projects/60eddc0d728b41318681e57595b8236e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.367728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=60eddc0d728b41318681e57595b8236e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:51.370039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:51.422890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4a97b-465a-46d5-ae70-683a9205947e service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:51.425305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ced4a97b-465a-46d5-ae70-683a9205947e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:51.449348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4a97b-465a-46d5-ae70-683a9205947e service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:51.453954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60eddc0d728b41318681e57595b8236e', 'request_id': 'req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.475466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60eddc0d728b41318681e57595b8236e', 'request_id': 'req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.485398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60eddc0d728b41318681e57595b8236e', 'request_id': 'req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.503061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] The token cache is being invalidate because project 60eddc0d728b41318681e57595b8236e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:51.503798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.505017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf17d1dd-cc05-45ff-a10e-e8030400ac3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.507434 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3462/6970] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:51 2022] DELETE /identity/v3/projects/60eddc0d728b41318681e57595b8236e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:51.514241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64f0a7-c165-46f7-8f0e-0e923de61cd4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.514903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64f0a7-c165-46f7-8f0e-0e923de61cd4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.515879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64f0a7-c165-46f7-8f0e-0e923de61cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.538968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:51.540055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.540411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.540899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] PATH_INFO: `/v3/projects/a38093b64be349f98b602f89a37a8721` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.542157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bd64f0a7-c165-46f7-8f0e-0e923de61cd4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:51.542652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38093b64be349f98b602f89a37a8721)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:51.544067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bd64f0a7-c165-46f7-8f0e-0e923de61cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:51.545443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:51.578296 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3463/6971] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:51.589057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe01152-3e50-49a4-bb2a-792a5720085c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.589697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe01152-3e50-49a4-bb2a-792a5720085c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.590192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe01152-3e50-49a4-bb2a-792a5720085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.617350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4fe01152-3e50-49a4-bb2a-792a5720085c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:51.619001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4fe01152-3e50-49a4-bb2a-792a5720085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:51.644665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38093b64be349f98b602f89a37a8721', 'request_id': 'req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.661364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38093b64be349f98b602f89a37a8721', 'request_id': 'req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.691691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38093b64be349f98b602f89a37a8721', 'request_id': 'req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.707255 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3464/6972] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:51.711667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe01152-3e50-49a4-bb2a-792a5720085c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:51.722799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] The token cache is being invalidate because project a38093b64be349f98b602f89a37a8721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:51.723110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.723438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe01152-3e50-49a4-bb2a-792a5720085c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:51.725835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b753cfb5-b3b4-4921-93ee-369ab20cbd9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:51.729833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:51.731009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.731524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.732776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.733743 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3509/6973] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:51 2022] DELETE /identity/v3/projects/a38093b64be349f98b602f89a37a8721 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:51.736720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:51.737237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:51.738245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884b5ec-9601-4167-8cbe-75effec57c98 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.738938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884b5ec-9601-4167-8cbe-75effec57c98 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.738938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a884b5ec-9601-4167-8cbe-75effec57c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.739665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:51.764018 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3465/6974] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:12:51.764703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a884b5ec-9601-4167-8cbe-75effec57c98 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:51.765933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a884b5ec-9601-4167-8cbe-75effec57c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:51.767779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:51.769663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:51.791274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa492a-5efc-41cd-9c62-678e5f994ef9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:51.791471 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3510/6975] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:51.793201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ab86-71f5-4d51-9f52-78b18af6339e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.793647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ab86-71f5-4d51-9f52-78b18af6339e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.793939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549ab86-71f5-4d51-9f52-78b18af6339e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.795598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcf6c9-bde4-4fcc-ab5c-5bb62d211c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:51.796533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcf6c9-bde4-4fcc-ab5c-5bb62d211c47 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.796638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcf6c9-bde4-4fcc-ab5c-5bb62d211c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.796825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcf6c9-bde4-4fcc-ab5c-5bb62d211c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.803427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcf6c9-bde4-4fcc-ab5c-5bb62d211c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:51.807721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcf6c9-bde4-4fcc-ab5c-5bb62d211c47 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:51.821650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2549ab86-71f5-4d51-9f52-78b18af6339e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:51.824176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2549ab86-71f5-4d51-9f52-78b18af6339e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:51.850454 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3511/6976] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:51.855049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549ab86-71f5-4d51-9f52-78b18af6339e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:51.863941 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3466/6977] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:51 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:51.868380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcf6c9-bde4-4fcc-ab5c-5bb62d211c47 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:51.876435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549ab86-71f5-4d51-9f52-78b18af6339e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:51.993649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c9e86-ec8e-425b-879d-4208e4935669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:51.994536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c9e86-ec8e-425b-879d-4208e4935669 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:51.995629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c9e86-ec8e-425b-879d-4208e4935669 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:51.996057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c9e86-ec8e-425b-879d-4208e4935669 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:51.997086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c9e86-ec8e-425b-879d-4208e4935669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:51.997512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c9e86-ec8e-425b-879d-4208e4935669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:51.999486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c9e86-ec8e-425b-879d-4208e4935669 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.015227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcf6c9-bde4-4fcc-ab5c-5bb62d211c47 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.020126 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3512/6978] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:52.021704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c9e86-ec8e-425b-879d-4208e4935669 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.035618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c9e86-ec8e-425b-879d-4208e4935669 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.036489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046eb23-3209-4c60-9dab-eb0814c53522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.037375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046eb23-3209-4c60-9dab-eb0814c53522 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.037824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046eb23-3209-4c60-9dab-eb0814c53522 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.038264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046eb23-3209-4c60-9dab-eb0814c53522 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.039165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046eb23-3209-4c60-9dab-eb0814c53522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.042187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046eb23-3209-4c60-9dab-eb0814c53522 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.046602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70027128-30f9-4bc7-a6a0-4328e2864139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.047284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70027128-30f9-4bc7-a6a0-4328e2864139 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.047566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70027128-30f9-4bc7-a6a0-4328e2864139 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.047886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70027128-30f9-4bc7-a6a0-4328e2864139 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.049709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70027128-30f9-4bc7-a6a0-4328e2864139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.052261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70027128-30f9-4bc7-a6a0-4328e2864139 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.082967 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3467/6979] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:51 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:52.084458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046eb23-3209-4c60-9dab-eb0814c53522 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.089338 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3513/6980] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:52 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:52.093111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70027128-30f9-4bc7-a6a0-4328e2864139 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.096549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046eb23-3209-4c60-9dab-eb0814c53522 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.190773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70027128-30f9-4bc7-a6a0-4328e2864139 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.192206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6cd52-80ec-4b99-b847-f23bfa50843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.194191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6cd52-80ec-4b99-b847-f23bfa50843a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.195883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6cd52-80ec-4b99-b847-f23bfa50843a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.196255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6cd52-80ec-4b99-b847-f23bfa50843a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.197369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d44c1-af1b-4148-8e7d-b18b0844f986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.198222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d44c1-af1b-4148-8e7d-b18b0844f986 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.198576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6cd52-80ec-4b99-b847-f23bfa50843a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.198715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d44c1-af1b-4148-8e7d-b18b0844f986 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.199063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d44c1-af1b-4148-8e7d-b18b0844f986 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.200152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d44c1-af1b-4148-8e7d-b18b0844f986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.202281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6cd52-80ec-4b99-b847-f23bfa50843a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.202502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15d44c1-af1b-4148-8e7d-b18b0844f986 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.220296 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3468/6981] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:52.224577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6cd52-80ec-4b99-b847-f23bfa50843a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.238167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6cd52-80ec-4b99-b847-f23bfa50843a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.239108 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3514/6982] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:52 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:52.241869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d44c1-af1b-4148-8e7d-b18b0844f986 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.245141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e4eb0-cd37-4400-8283-793380f81750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.245906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e4eb0-cd37-4400-8283-793380f81750 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.246263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e4eb0-cd37-4400-8283-793380f81750 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.246607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e4eb0-cd37-4400-8283-793380f81750 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.247505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e4eb0-cd37-4400-8283-793380f81750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.249256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e4eb0-cd37-4400-8283-793380f81750 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.263067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d44c1-af1b-4148-8e7d-b18b0844f986 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.271718 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3469/6983] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:52.272060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc266d9-0077-4b57-b931-fa80c607a6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.272939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc266d9-0077-4b57-b931-fa80c607a6cb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.273068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e4eb0-cd37-4400-8283-793380f81750 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.274255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc266d9-0077-4b57-b931-fa80c607a6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.274707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc266d9-0077-4b57-b931-fa80c607a6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.275882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc266d9-0077-4b57-b931-fa80c607a6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.278360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc266d9-0077-4b57-b931-fa80c607a6cb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.287072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e4eb0-cd37-4400-8283-793380f81750 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.292379 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3515/6984] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:52.295839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f54548-ed95-45b9-82f8-86b999504957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.296856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f54548-ed95-45b9-82f8-86b999504957 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.297053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc266d9-0077-4b57-b931-fa80c607a6cb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.297271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f54548-ed95-45b9-82f8-86b999504957 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.297619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f54548-ed95-45b9-82f8-86b999504957 admin admin] PATH_INFO: `/v3/projects/a130b0f366fa4413a5ff5b85f156263b/users/36b845f2589e4ea4bb053a33374e1250/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.313069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc266d9-0077-4b57-b931-fa80c607a6cb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.320420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29badb83-48d9-405c-96b0-6d5ae277f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.321303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29badb83-48d9-405c-96b0-6d5ae277f3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.321618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f54548-ed95-45b9-82f8-86b999504957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a130b0f366fa4413a5ff5b85f156263b, user_id=36b845f2589e4ea4bb053a33374e1250, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.321945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29badb83-48d9-405c-96b0-6d5ae277f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.322569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29badb83-48d9-405c-96b0-6d5ae277f3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.323455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29badb83-48d9-405c-96b0-6d5ae277f3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.324748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f54548-ed95-45b9-82f8-86b999504957 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.325643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29badb83-48d9-405c-96b0-6d5ae277f3f3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.341368 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3516/6985] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:52.352985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29badb83-48d9-405c-96b0-6d5ae277f3f3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.358097 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3470/6986] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:52 2022] PUT /identity/v3/projects/a130b0f366fa4413a5ff5b85f156263b/users/36b845f2589e4ea4bb053a33374e1250/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:52.368930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18c500-315a-46d6-a1d8-5f9d39eca5e2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.369493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18c500-315a-46d6-a1d8-5f9d39eca5e2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.369947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18c500-315a-46d6-a1d8-5f9d39eca5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.371100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29badb83-48d9-405c-96b0-6d5ae277f3f3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.402173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6b18c500-315a-46d6-a1d8-5f9d39eca5e2 None None] MFA Rules not processed for user `36b845f2589e4ea4bb053a33374e1250`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:52.404002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6b18c500-315a-46d6-a1d8-5f9d39eca5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:52.463537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c4dea-5477-4adc-ad12-ba364af55e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.464719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c4dea-5477-4adc-ad12-ba364af55e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.465217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c4dea-5477-4adc-ad12-ba364af55e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.465681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c4dea-5477-4adc-ad12-ba364af55e13 admin admin] PATH_INFO: `/v3/projects/785ad376f67c4108a24b51cb1a8688e7/users/8cb4aaaa974f42f5beed61be54e119b4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.481818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c4dea-5477-4adc-ad12-ba364af55e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=785ad376f67c4108a24b51cb1a8688e7, user_id=8cb4aaaa974f42f5beed61be54e119b4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.484915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c4dea-5477-4adc-ad12-ba364af55e13 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.505027 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3517/6987] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:52 2022] PUT /identity/v3/projects/785ad376f67c4108a24b51cb1a8688e7/users/8cb4aaaa974f42f5beed61be54e119b4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:52.516875 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3471/6988] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:52.517145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b186eb-968d-47b0-b539-ec4cb769dfbd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.517476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b186eb-968d-47b0-b539-ec4cb769dfbd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.517703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b186eb-968d-47b0-b539-ec4cb769dfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.520976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18c500-315a-46d6-a1d8-5f9d39eca5e2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.535119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18c500-315a-46d6-a1d8-5f9d39eca5e2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.567844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f4b186eb-968d-47b0-b539-ec4cb769dfbd None None] MFA Rules not processed for user `8cb4aaaa974f42f5beed61be54e119b4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:52.569834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f4b186eb-968d-47b0-b539-ec4cb769dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:52.639102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e054-5ca8-4c6a-a6be-45b2d8ceadb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.640751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e054-5ca8-4c6a-a6be-45b2d8ceadb0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.641212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e054-5ca8-4c6a-a6be-45b2d8ceadb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.641645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09e054-5ca8-4c6a-a6be-45b2d8ceadb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.642531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e054-5ca8-4c6a-a6be-45b2d8ceadb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.645682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09e054-5ca8-4c6a-a6be-45b2d8ceadb0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.667246 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3518/6989] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:52.676040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b186eb-968d-47b0-b539-ec4cb769dfbd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.678801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f4b186eb-968d-47b0-b539-ec4cb769dfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:52.698032 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3472/6990] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:52 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:52.705719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e054-5ca8-4c6a-a6be-45b2d8ceadb0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.778169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b186eb-968d-47b0-b539-ec4cb769dfbd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.810403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09e054-5ca8-4c6a-a6be-45b2d8ceadb0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.817196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaab9b7-3025-46bd-8a55-07e097ad1881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.818767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaab9b7-3025-46bd-8a55-07e097ad1881 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.819112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaab9b7-3025-46bd-8a55-07e097ad1881 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.819449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaab9b7-3025-46bd-8a55-07e097ad1881 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.820297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaab9b7-3025-46bd-8a55-07e097ad1881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.822422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaab9b7-3025-46bd-8a55-07e097ad1881 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.852236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c39764-f95c-492f-b75c-2ab78da9f95f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.853020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c39764-f95c-492f-b75c-2ab78da9f95f service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.853935 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3473/6991] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:52 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:52.856138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c39764-f95c-492f-b75c-2ab78da9f95f service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.856508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c39764-f95c-492f-b75c-2ab78da9f95f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.857855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaab9b7-3025-46bd-8a55-07e097ad1881 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.873308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaab9b7-3025-46bd-8a55-07e097ad1881 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.879744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20751ea-af01-4a2d-82bd-fc55c2e2c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.881127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20751ea-af01-4a2d-82bd-fc55c2e2c864 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.881514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20751ea-af01-4a2d-82bd-fc55c2e2c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.882019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20751ea-af01-4a2d-82bd-fc55c2e2c864 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.883744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20751ea-af01-4a2d-82bd-fc55c2e2c864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.885572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20751ea-af01-4a2d-82bd-fc55c2e2c864 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.913214 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3474/6992] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:52.915795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20751ea-af01-4a2d-82bd-fc55c2e2c864 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:52.936665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20751ea-af01-4a2d-82bd-fc55c2e2c864 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:52.939587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c39764-f95c-492f-b75c-2ab78da9f95f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.942002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c39764-f95c-492f-b75c-2ab78da9f95f service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.944303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8c7dc-2c8a-4e30-8cb6-caec44d768cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:52.946713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8c7dc-2c8a-4e30-8cb6-caec44d768cc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:52.947316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8c7dc-2c8a-4e30-8cb6-caec44d768cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:52.947890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8c7dc-2c8a-4e30-8cb6-caec44d768cc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:52.949271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8c7dc-2c8a-4e30-8cb6-caec44d768cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:52.951942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8c7dc-2c8a-4e30-8cb6-caec44d768cc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:52.968388 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3519/6993] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:52.969618 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3475/6994] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:52.973781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c39764-f95c-492f-b75c-2ab78da9f95f service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:53.003537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c39764-f95c-492f-b75c-2ab78da9f95f service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:53.030268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269d0be-a27f-4fec-8661-6a6929fc916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:53.031305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269d0be-a27f-4fec-8661-6a6929fc916d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:53.031722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269d0be-a27f-4fec-8661-6a6929fc916d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:53.032151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269d0be-a27f-4fec-8661-6a6929fc916d admin admin] PATH_INFO: `/v3/projects/5cca4b75b4294a9e966a766dbf28d34e/users/489e1f44fb29463fa5270e9c945469a0/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:53.047728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8c7dc-2c8a-4e30-8cb6-caec44d768cc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:53.054066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f3a8c7dc-2c8a-4e30-8cb6-caec44d768cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:53.082756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8c7dc-2c8a-4e30-8cb6-caec44d768cc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:53.092865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269d0be-a27f-4fec-8661-6a6929fc916d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cca4b75b4294a9e966a766dbf28d34e, user_id=489e1f44fb29463fa5270e9c945469a0, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:53.099523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb0d11-77ee-4861-9c96-2412986132f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:53.100221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0d11-77ee-4861-9c96-2412986132f1 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:53.100505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0d11-77ee-4861-9c96-2412986132f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:53.100784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb0d11-77ee-4861-9c96-2412986132f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:53.103078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269d0be-a27f-4fec-8661-6a6929fc916d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:53.108909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dfbb0d11-77ee-4861-9c96-2412986132f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:53.134082 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3520/6995] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:52 2022] PUT /identity/v3/projects/5cca4b75b4294a9e966a766dbf28d34e/users/489e1f44fb29463fa5270e9c945469a0/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:53.136009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3934-c5c1-40b7-8f1e-72c22ad918f1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:53.136531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3934-c5c1-40b7-8f1e-72c22ad918f1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:53.137870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bd3934-c5c1-40b7-8f1e-72c22ad918f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:53.203766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-56bd3934-c5c1-40b7-8f1e-72c22ad918f1 None None] MFA Rules not processed for user `54a09bedd0ad4328b1e687fc5f7e3967`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:53.206391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-56bd3934-c5c1-40b7-8f1e-72c22ad918f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:53.291164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb0d11-77ee-4861-9c96-2412986132f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:53.299627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb0d11-77ee-4861-9c96-2412986132f1 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:53.331045 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3476/6996] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:53.332579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2438db-1eaa-4a1e-b889-d97f29d5e747 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:53.334729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2438db-1eaa-4a1e-b889-d97f29d5e747 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:53.336307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2438db-1eaa-4a1e-b889-d97f29d5e747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:53.372688 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3521/6997] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:53.387695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cb2438db-1eaa-4a1e-b889-d97f29d5e747 None None] MFA Rules not processed for user `489e1f44fb29463fa5270e9c945469a0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:53.389362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cb2438db-1eaa-4a1e-b889-d97f29d5e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:53.490851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd3934-c5c1-40b7-8f1e-72c22ad918f1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:53.542726 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3477/6998] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:53.565197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2438db-1eaa-4a1e-b889-d97f29d5e747 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:53.567074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cb2438db-1eaa-4a1e-b889-d97f29d5e747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:53.588547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bd3934-c5c1-40b7-8f1e-72c22ad918f1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:53.594874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:53.595763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:53.596108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:53.596383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] PATH_INFO: `/v3/users/8cb4aaaa974f42f5beed61be54e119b4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:53.598243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb4aaaa974f42f5beed61be54e119b4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:53.600860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:53.664992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2438db-1eaa-4a1e-b889-d97f29d5e747 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:53.671369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fdc8-55f6-4dfe-8981-b46ace03538f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:53.672119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fdc8-55f6-4dfe-8981-b46ace03538f service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:53.672409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fdc8-55f6-4dfe-8981-b46ace03538f service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:53.672687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1fdc8-55f6-4dfe-8981-b46ace03538f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:53.678105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb4aaaa974f42f5beed61be54e119b4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:53.692860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb4aaaa974f42f5beed61be54e119b4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:53.693854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb4aaaa974f42f5beed61be54e119b4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:53.694521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb4aaaa974f42f5beed61be54e119b4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:53.705318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8174f595-d6d2-4f15-9fa7-a1c18313a8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb4aaaa974f42f5beed61be54e119b4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:53.735533 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3522/6999] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:53 2022] DELETE /identity/v3/users/8cb4aaaa974f42f5beed61be54e119b4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:53.739612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c05782-58a9-4a9f-a795-25c2b2c3e55d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:53.741814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c05782-58a9-4a9f-a795-25c2b2c3e55d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:53.742819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c05782-58a9-4a9f-a795-25c2b2c3e55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:53.770053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-44c05782-58a9-4a9f-a795-25c2b2c3e55d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:53.771426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-44c05782-58a9-4a9f-a795-25c2b2c3e55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:53.775850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1fdc8-55f6-4dfe-8981-b46ace03538f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:53.777454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1fdc8-55f6-4dfe-8981-b46ace03538f service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:53.789941 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3478/7000] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:53.876914 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3523/7001] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:53.895231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fdc8-55f6-4dfe-8981-b46ace03538f service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:53.980301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7232e-d656-4bce-a24b-5455896f697c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:53.980596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7232e-d656-4bce-a24b-5455896f697c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:53.980874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7232e-d656-4bce-a24b-5455896f697c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:53.994830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1fdc8-55f6-4dfe-8981-b46ace03538f service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:54.085493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-25d7232e-d656-4bce-a24b-5455896f697c None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:54.087658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-25d7232e-d656-4bce-a24b-5455896f697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:54.117027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1ba9c-a855-439e-89d9-a6de2c721728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:54.117888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1ba9c-a855-439e-89d9-a6de2c721728 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:54.119883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1ba9c-a855-439e-89d9-a6de2c721728 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:54.120259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1ba9c-a855-439e-89d9-a6de2c721728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:54.152454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1ba9c-a855-439e-89d9-a6de2c721728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:54.162070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1ba9c-a855-439e-89d9-a6de2c721728 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:54.178265 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3479/7002] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:54.220708 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3524/7003] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:12:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:54.284815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1ba9c-a855-439e-89d9-a6de2c721728 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:54.287134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-26d1ba9c-a855-439e-89d9-a6de2c721728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:54.431833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1ba9c-a855-439e-89d9-a6de2c721728 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:54.438637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9d9cb-bf06-4cb4-801b-5439dd2e256b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:54.439333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9d9cb-bf06-4cb4-801b-5439dd2e256b service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:54.439621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9d9cb-bf06-4cb4-801b-5439dd2e256b service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:54.440006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9d9cb-bf06-4cb4-801b-5439dd2e256b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:54.453385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9d9cb-bf06-4cb4-801b-5439dd2e256b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:54.455231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9d9cb-bf06-4cb4-801b-5439dd2e256b service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:54.474162 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3480/7004] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:12:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:12:54.722322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7232e-d656-4bce-a24b-5455896f697c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:54.724514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-25d7232e-d656-4bce-a24b-5455896f697c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:54.851859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7232e-d656-4bce-a24b-5455896f697c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:54.857289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:54.857961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:54.858243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:54.858896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:54.860963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:54.988431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:54.990457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:55.024626 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3525/7005] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:55.137699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300c3fa-e2f6-4f32-a30b-17c50fea0137 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:55.138284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300c3fa-e2f6-4f32-a30b-17c50fea0137 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:55.138507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300c3fa-e2f6-4f32-a30b-17c50fea0137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:55.166791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2300c3fa-e2f6-4f32-a30b-17c50fea0137 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:55.168216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2300c3fa-e2f6-4f32-a30b-17c50fea0137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:55.223901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:55.236780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:55.296314 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3481/7006] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:55.297532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300c3fa-e2f6-4f32-a30b-17c50fea0137 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:55.300902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46c102-88a1-4636-8765-624f7dd162e7 service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:55.313827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:55.314971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:55.315667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:55.316128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] PATH_INFO: `/v3/projects/785ad376f67c4108a24b51cb1a8688e7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:55.318162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=785ad376f67c4108a24b51cb1a8688e7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:55.337967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:55.353113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300c3fa-e2f6-4f32-a30b-17c50fea0137 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:55.366103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519e028-66e3-4993-9db2-b0588a4e0b10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:55.366820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519e028-66e3-4993-9db2-b0588a4e0b10 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:55.368024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519e028-66e3-4993-9db2-b0588a4e0b10 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:55.368558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519e028-66e3-4993-9db2-b0588a4e0b10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:55.386828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519e028-66e3-4993-9db2-b0588a4e0b10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:55.394580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519e028-66e3-4993-9db2-b0588a4e0b10 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:55.407172 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3482/7007] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:12:55.475106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785ad376f67c4108a24b51cb1a8688e7', 'request_id': 'req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.495015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785ad376f67c4108a24b51cb1a8688e7', 'request_id': 'req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.510784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785ad376f67c4108a24b51cb1a8688e7', 'request_id': 'req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.561917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] The token cache is being invalidate because project 785ad376f67c4108a24b51cb1a8688e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:55.563144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.583836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.592473 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3526/7008] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:55 2022] DELETE /identity/v3/projects/785ad376f67c4108a24b51cb1a8688e7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:55.598873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea40213-41cf-43af-9f44-a4b1f7ce60c1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:55.599746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea40213-41cf-43af-9f44-a4b1f7ce60c1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:55.600217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea40213-41cf-43af-9f44-a4b1f7ce60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:55.635626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-aea40213-41cf-43af-9f44-a4b1f7ce60c1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:55.641186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aea40213-41cf-43af-9f44-a4b1f7ce60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:55.650330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:55.651857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:55.791281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cfc06-32cf-43c2-a11c-8d098f2e86d0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:55.803603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:55.805076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:55.805360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:55.805636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] PATH_INFO: `/v3/users/36b845f2589e4ea4bb053a33374e1250` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:55.810876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b845f2589e4ea4bb053a33374e1250)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:55.818468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:55.830632 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3483/7009] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:55.832207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82357939-6345-490a-91f9-1f0f6d2055c8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:55.832504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82357939-6345-490a-91f9-1f0f6d2055c8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:55.832789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82357939-6345-490a-91f9-1f0f6d2055c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:55.873064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-82357939-6345-490a-91f9-1f0f6d2055c8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:55.874407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-82357939-6345-490a-91f9-1f0f6d2055c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:55.891742 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3484/7010] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:55.896918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82357939-6345-490a-91f9-1f0f6d2055c8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:55.914549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82357939-6345-490a-91f9-1f0f6d2055c8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:55.920689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:55.922009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:55.922300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:55.922671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:55.923125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b845f2589e4ea4bb053a33374e1250'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.923864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:55.924191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:55.926104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:55.951330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b845f2589e4ea4bb053a33374e1250'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.952851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b845f2589e4ea4bb053a33374e1250'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.957587 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3485/7011] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:12:55.958655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b845f2589e4ea4bb053a33374e1250'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.962636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:55.964644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:55.982334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4e002f7-fe13-45ba-b12e-a66302d7f293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b845f2589e4ea4bb053a33374e1250'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:55.983135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cafff2-a0b7-4f8e-9200-d8ecb2bf0c13 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:55.989274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e93e-0a27-48f1-b8e1-2b7189a083a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:55.989955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e93e-0a27-48f1-b8e1-2b7189a083a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:55.990270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e93e-0a27-48f1-b8e1-2b7189a083a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:55.990539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e93e-0a27-48f1-b8e1-2b7189a083a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:55.991271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57e93e-0a27-48f1-b8e1-2b7189a083a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:55.994114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57e93e-0a27-48f1-b8e1-2b7189a083a6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:56.034207 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3527/7012] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:55 2022] DELETE /identity/v3/users/36b845f2589e4ea4bb053a33374e1250 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:12:56.042549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabab78-a7ee-4b43-bde6-09607805aabd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:56.043348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabab78-a7ee-4b43-bde6-09607805aabd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:56.043955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabab78-a7ee-4b43-bde6-09607805aabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:56.063346 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3486/7013] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:55 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:56.068143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e93e-0a27-48f1-b8e1-2b7189a083a6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:56.088904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6eabab78-a7ee-4b43-bde6-09607805aabd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:56.091359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6eabab78-a7ee-4b43-bde6-09607805aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:56.231891 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3528/7014] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:56.252726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e93e-0a27-48f1-b8e1-2b7189a083a6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:56.258984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476f914-23cc-4221-a777-dd5c0efa5eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:56.259418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabab78-a7ee-4b43-bde6-09607805aabd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:56.261840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6eabab78-a7ee-4b43-bde6-09607805aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:56.262528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476f914-23cc-4221-a777-dd5c0efa5eef admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:56.263025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476f914-23cc-4221-a777-dd5c0efa5eef admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:56.263389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476f914-23cc-4221-a777-dd5c0efa5eef admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:56.264567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476f914-23cc-4221-a777-dd5c0efa5eef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:56.276704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476f914-23cc-4221-a777-dd5c0efa5eef admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:56.341547 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3487/7015] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:56 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:56.346653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476f914-23cc-4221-a777-dd5c0efa5eef admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:56.382785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476f914-23cc-4221-a777-dd5c0efa5eef admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:56.391716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabab78-a7ee-4b43-bde6-09607805aabd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:56.416832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802c0cc-9bf4-4509-aff6-0af8c6421be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:56.418108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802c0cc-9bf4-4509-aff6-0af8c6421be6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:56.418599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802c0cc-9bf4-4509-aff6-0af8c6421be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:56.419972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802c0cc-9bf4-4509-aff6-0af8c6421be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:56.421824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802c0cc-9bf4-4509-aff6-0af8c6421be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:56.423701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802c0cc-9bf4-4509-aff6-0af8c6421be6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:56.434601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0d286-e314-4f60-a695-0b7c8f98f2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:56.438647 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3488/7016] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:56.442093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d286-e314-4f60-a695-0b7c8f98f2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:56.442383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d286-e314-4f60-a695-0b7c8f98f2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:56.442668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0d286-e314-4f60-a695-0b7c8f98f2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:56.443489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802c0cc-9bf4-4509-aff6-0af8c6421be6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:56.458676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0d286-e314-4f60-a695-0b7c8f98f2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:56.460397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0d286-e314-4f60-a695-0b7c8f98f2d7 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:56.461174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802c0cc-9bf4-4509-aff6-0af8c6421be6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:56.481027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb472b7-338e-465f-b914-df8ac58f1a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:56.482077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb472b7-338e-465f-b914-df8ac58f1a0e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:56.482939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb472b7-338e-465f-b914-df8ac58f1a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:56.483384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb472b7-338e-465f-b914-df8ac58f1a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:56.484312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb472b7-338e-465f-b914-df8ac58f1a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:56.486034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb472b7-338e-465f-b914-df8ac58f1a0e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:56.489968 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3529/7017] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:12:56.504895 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3489/7018] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:56.512789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0d286-e314-4f60-a695-0b7c8f98f2d7 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:56.524053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0d286-e314-4f60-a695-0b7c8f98f2d7 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:56.538670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c6351-3f00-41ee-adf5-632455a54a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:56.540344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c6351-3f00-41ee-adf5-632455a54a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:56.540630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c6351-3f00-41ee-adf5-632455a54a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:56.540908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c6351-3f00-41ee-adf5-632455a54a3c admin admin] PATH_INFO: `/v3/projects/c6ec1467add04a35afa59444b1f51296/users/aea79da16ff648a2ac334d901a057785/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:56.569858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c6351-3f00-41ee-adf5-632455a54a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ec1467add04a35afa59444b1f51296, user_id=aea79da16ff648a2ac334d901a057785, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:56.573236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c6351-3f00-41ee-adf5-632455a54a3c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:56.601410 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3530/7019] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:56 2022] PUT /identity/v3/projects/c6ec1467add04a35afa59444b1f51296/users/aea79da16ff648a2ac334d901a057785/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:56.604062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121f19-6ce3-40fb-93b2-38303c0b7c3a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:56.604860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121f19-6ce3-40fb-93b2-38303c0b7c3a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:56.605418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7121f19-6ce3-40fb-93b2-38303c0b7c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:56.639868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b7121f19-6ce3-40fb-93b2-38303c0b7c3a None None] MFA Rules not processed for user `aea79da16ff648a2ac334d901a057785`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:56.641392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b7121f19-6ce3-40fb-93b2-38303c0b7c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:56.758434 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3490/7020] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:56.763534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c6351-3f00-41ee-adf5-632455a54a3c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:56.886907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c6351-3f00-41ee-adf5-632455a54a3c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:56.901723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c706f-6cd5-4613-8ce4-54b6cd63f8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:56.902433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c706f-6cd5-4613-8ce4-54b6cd63f8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:56.902692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c706f-6cd5-4613-8ce4-54b6cd63f8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:56.902972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c706f-6cd5-4613-8ce4-54b6cd63f8e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:56.905833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c706f-6cd5-4613-8ce4-54b6cd63f8e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:56.913979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c706f-6cd5-4613-8ce4-54b6cd63f8e5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:56.987959 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3531/7021] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:56 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:56.992357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121f19-6ce3-40fb-93b2-38303c0b7c3a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:57.009230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7121f19-6ce3-40fb-93b2-38303c0b7c3a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:57.148918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d545c-9c7f-44fa-8cd8-90775d626fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:57.149495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d545c-9c7f-44fa-8cd8-90775d626fdf admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:57.149782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d545c-9c7f-44fa-8cd8-90775d626fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:57.150062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d545c-9c7f-44fa-8cd8-90775d626fdf admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:57.151186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d545c-9c7f-44fa-8cd8-90775d626fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:57.154144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d545c-9c7f-44fa-8cd8-90775d626fdf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:57.232382 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3491/7022] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:56 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:57.237082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c706f-6cd5-4613-8ce4-54b6cd63f8e5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:57.251187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c706f-6cd5-4613-8ce4-54b6cd63f8e5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:57.259042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954837fa-444a-49e3-b336-f0ab9c71070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:57.260570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954837fa-444a-49e3-b336-f0ab9c71070f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:57.261060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954837fa-444a-49e3-b336-f0ab9c71070f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:57.261512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954837fa-444a-49e3-b336-f0ab9c71070f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:57.262457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954837fa-444a-49e3-b336-f0ab9c71070f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:57.264355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954837fa-444a-49e3-b336-f0ab9c71070f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:57.280685 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3532/7023] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:57.284944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d545c-9c7f-44fa-8cd8-90775d626fdf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:57.309955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d545c-9c7f-44fa-8cd8-90775d626fdf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:57.326136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19677c-3ccc-40f9-b738-059351e0c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:57.327202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19677c-3ccc-40f9-b738-059351e0c46c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:57.328326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954837fa-444a-49e3-b336-f0ab9c71070f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:57.332301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19677c-3ccc-40f9-b738-059351e0c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:57.332449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-954837fa-444a-49e3-b336-f0ab9c71070f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:57.332776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19677c-3ccc-40f9-b738-059351e0c46c admin admin] PATH_INFO: `/v3/projects/f42ca6a4381443f5bb80e16f92bc2de7/users/c58984ca57a04adaac5e0e3b6ad5bce0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:57.387574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19677c-3ccc-40f9-b738-059351e0c46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42ca6a4381443f5bb80e16f92bc2de7, user_id=c58984ca57a04adaac5e0e3b6ad5bce0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:57.391258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19677c-3ccc-40f9-b738-059351e0c46c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:57.397861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954837fa-444a-49e3-b336-f0ab9c71070f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:57.406888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:57.407867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:57.408310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:57.409197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] PATH_INFO: `/v3/projects/a130b0f366fa4413a5ff5b85f156263b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:57.411009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a130b0f366fa4413a5ff5b85f156263b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:57.415116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:57.423037 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3492/7024] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:57 2022] PUT /identity/v3/projects/f42ca6a4381443f5bb80e16f92bc2de7/users/c58984ca57a04adaac5e0e3b6ad5bce0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:57.426725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19677c-3ccc-40f9-b738-059351e0c46c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:57.508018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a130b0f366fa4413a5ff5b85f156263b', 'request_id': 'req-b11b9605-5563-4664-a9c7-599443c21990'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.525786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a130b0f366fa4413a5ff5b85f156263b', 'request_id': 'req-b11b9605-5563-4664-a9c7-599443c21990'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.535107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a130b0f366fa4413a5ff5b85f156263b', 'request_id': 'req-b11b9605-5563-4664-a9c7-599443c21990'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.568562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] The token cache is being invalidate because project a130b0f366fa4413a5ff5b85f156263b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:57.568895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.572396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.576843 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3533/7025] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:57 2022] DELETE /identity/v3/projects/a130b0f366fa4413a5ff5b85f156263b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:57.580920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:57.582681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:57.620971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19677c-3ccc-40f9-b738-059351e0c46c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:57.758730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11b9605-5563-4664-a9c7-599443c21990 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:57.760744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e445c85-ef6f-4715-9ea9-958888fe264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:57.761440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e445c85-ef6f-4715-9ea9-958888fe264c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:57.761730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e445c85-ef6f-4715-9ea9-958888fe264c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:57.762068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e445c85-ef6f-4715-9ea9-958888fe264c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:57.763240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e445c85-ef6f-4715-9ea9-958888fe264c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:57.766070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e445c85-ef6f-4715-9ea9-958888fe264c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:57.772617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:57.774319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:57.774774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:57.775221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] PATH_INFO: `/v3/users/489e1f44fb29463fa5270e9c945469a0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:57.777815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] RBAC: Authorizing `identity:delete_user(user_id=489e1f44fb29463fa5270e9c945469a0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:57.780119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:57.803940 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3493/7026] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:12:57.805666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e445c85-ef6f-4715-9ea9-958888fe264c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:57.809854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e445c85-ef6f-4715-9ea9-958888fe264c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:57.857630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e445c85-ef6f-4715-9ea9-958888fe264c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:57.872993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66950b8-046b-42ff-8edb-8c57dbaa7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:57.876403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66950b8-046b-42ff-8edb-8c57dbaa7214 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:57.876743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66950b8-046b-42ff-8edb-8c57dbaa7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:57.877164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66950b8-046b-42ff-8edb-8c57dbaa7214 admin admin] PATH_INFO: `/v3/projects/f42ca6a4381443f5bb80e16f92bc2de7/users/c58984ca57a04adaac5e0e3b6ad5bce0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:57.878274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '489e1f44fb29463fa5270e9c945469a0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.883787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66950b8-046b-42ff-8edb-8c57dbaa7214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42ca6a4381443f5bb80e16f92bc2de7, user_id=c58984ca57a04adaac5e0e3b6ad5bce0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:57.887710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '489e1f44fb29463fa5270e9c945469a0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.889016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66950b8-046b-42ff-8edb-8c57dbaa7214 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:57.889918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '489e1f44fb29463fa5270e9c945469a0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.892114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '489e1f44fb29463fa5270e9c945469a0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.907746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '489e1f44fb29463fa5270e9c945469a0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:57.939177 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3494/7027] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:57 2022] PUT /identity/v3/projects/f42ca6a4381443f5bb80e16f92bc2de7/users/c58984ca57a04adaac5e0e3b6ad5bce0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:57.949058 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3534/7028] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:12:57 2022] DELETE /identity/v3/users/489e1f44fb29463fa5270e9c945469a0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:57.950109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd70c99-9ec3-48c7-987a-8ea391ce69c4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:57.950626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd70c99-9ec3-48c7-987a-8ea391ce69c4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:57.951119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd70c99-9ec3-48c7-987a-8ea391ce69c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:58.037228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3dd70c99-9ec3-48c7-987a-8ea391ce69c4 None None] MFA Rules not processed for user `c58984ca57a04adaac5e0e3b6ad5bce0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:58.039584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3dd70c99-9ec3-48c7-987a-8ea391ce69c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:58.152228 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3495/7029] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:12:58.165321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:58.167319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:58.359012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd432651-e647-4d0d-b500-4928457202da admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:58.366680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7230a4-bc2c-4570-9272-6afc240e847b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:58.367598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7230a4-bc2c-4570-9272-6afc240e847b service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:58.367890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7230a4-bc2c-4570-9272-6afc240e847b service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:58.368482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7230a4-bc2c-4570-9272-6afc240e847b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:58.373717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be7230a4-bc2c-4570-9272-6afc240e847b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:58.493034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7230a4-bc2c-4570-9272-6afc240e847b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:58.496258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7230a4-bc2c-4570-9272-6afc240e847b service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:58.514064 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3535/7030] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:12:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:12:58.888302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd70c99-9ec3-48c7-987a-8ea391ce69c4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:58.889877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3dd70c99-9ec3-48c7-987a-8ea391ce69c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:59.049239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd70c99-9ec3-48c7-987a-8ea391ce69c4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:59.057168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:59.060859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.065306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.065777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] PATH_INFO: `/v3/projects/5cca4b75b4294a9e966a766dbf28d34e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.067329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cca4b75b4294a9e966a766dbf28d34e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:59.070308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:59.175428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cca4b75b4294a9e966a766dbf28d34e', 'request_id': 'req-6c306d1e-f9fe-40eb-83f8-ec07347f619f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:59.190705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cca4b75b4294a9e966a766dbf28d34e', 'request_id': 'req-6c306d1e-f9fe-40eb-83f8-ec07347f619f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:59.198256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cca4b75b4294a9e966a766dbf28d34e', 'request_id': 'req-6c306d1e-f9fe-40eb-83f8-ec07347f619f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:59.221893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] The token cache is being invalidate because project 5cca4b75b4294a9e966a766dbf28d34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:12:59.222217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:59.223344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6c306d1e-f9fe-40eb-83f8-ec07347f619f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:12:59.225429 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3496/7031] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:12:58 2022] DELETE /identity/v3/projects/5cca4b75b4294a9e966a766dbf28d34e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:59.232220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d86fe-27eb-4ffe-aac3-e0ae2745e78a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.232611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d86fe-27eb-4ffe-aac3-e0ae2745e78a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.232834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d86fe-27eb-4ffe-aac3-e0ae2745e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.261601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4e0d86fe-27eb-4ffe-aac3-e0ae2745e78a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:59.266704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4e0d86fe-27eb-4ffe-aac3-e0ae2745e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:59.373002 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3536/7032] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:59.381997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114cc41-e2f3-465a-8a4f-af951d6115d4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.382292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114cc41-e2f3-465a-8a4f-af951d6115d4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.382623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114cc41-e2f3-465a-8a4f-af951d6115d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.425893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a114cc41-e2f3-465a-8a4f-af951d6115d4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:59.427283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a114cc41-e2f3-465a-8a4f-af951d6115d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:59.447207 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3497/7033] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:59.451198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d86fe-27eb-4ffe-aac3-e0ae2745e78a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:59.473093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d86fe-27eb-4ffe-aac3-e0ae2745e78a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:59.492677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1a21a-5315-4281-a684-672be9924c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:59.494750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1a21a-5315-4281-a684-672be9924c69 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.495374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1a21a-5315-4281-a684-672be9924c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.495813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1a21a-5315-4281-a684-672be9924c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.497632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1a21a-5315-4281-a684-672be9924c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:12:59.498182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1a21a-5315-4281-a684-672be9924c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:59.501920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb1a21a-5315-4281-a684-672be9924c69 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:59.522803 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3537/7034] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:12:59.527337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114cc41-e2f3-465a-8a4f-af951d6115d4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:59.538479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114cc41-e2f3-465a-8a4f-af951d6115d4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:59.545278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145e12-3632-4616-a4e9-3ab458323bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:59.546030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145e12-3632-4616-a4e9-3ab458323bfb admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.546392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145e12-3632-4616-a4e9-3ab458323bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.546739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef145e12-3632-4616-a4e9-3ab458323bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.547523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef145e12-3632-4616-a4e9-3ab458323bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:59.549592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef145e12-3632-4616-a4e9-3ab458323bfb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:59.590478 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3498/7035] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:59 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:12:59.591254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1a21a-5315-4281-a684-672be9924c69 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:59.604854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb1a21a-5315-4281-a684-672be9924c69 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:59.694537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940cc59-770a-4744-a83a-0f4e8c32a25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:59.696178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940cc59-770a-4744-a83a-0f4e8c32a25a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.696481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940cc59-770a-4744-a83a-0f4e8c32a25a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.696761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8940cc59-770a-4744-a83a-0f4e8c32a25a admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.697460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940cc59-770a-4744-a83a-0f4e8c32a25a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:59.699631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8940cc59-770a-4744-a83a-0f4e8c32a25a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:59.719812 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3538/7036] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:12:59 2022] POST /identity/v3/users => generated 282 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:12:59.724000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145e12-3632-4616-a4e9-3ab458323bfb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:59.734875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef145e12-3632-4616-a4e9-3ab458323bfb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:59.744915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbec3e6-e2e2-4d92-88c1-72e9609d8977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:59.745960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbec3e6-e2e2-4d92-88c1-72e9609d8977 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.746249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbec3e6-e2e2-4d92-88c1-72e9609d8977 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.746816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbec3e6-e2e2-4d92-88c1-72e9609d8977 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.747592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbec3e6-e2e2-4d92-88c1-72e9609d8977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:59.749683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbec3e6-e2e2-4d92-88c1-72e9609d8977 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:59.762883 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3499/7037] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:59.766700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940cc59-770a-4744-a83a-0f4e8c32a25a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:59.777615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8940cc59-770a-4744-a83a-0f4e8c32a25a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:59.782336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ce2cb-4b71-4d3a-8c0a-8c2c65b01e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:59.782991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ce2cb-4b71-4d3a-8c0a-8c2c65b01e46 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.783274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ce2cb-4b71-4d3a-8c0a-8c2c65b01e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.783551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ce2cb-4b71-4d3a-8c0a-8c2c65b01e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.784332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ce2cb-4b71-4d3a-8c0a-8c2c65b01e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:59.785938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ce2cb-4b71-4d3a-8c0a-8c2c65b01e46 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:59.796818 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3539/7038] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:12:59.801177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbec3e6-e2e2-4d92-88c1-72e9609d8977 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:12:59.812139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbec3e6-e2e2-4d92-88c1-72e9609d8977 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:12:59.816779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbf825-b9b1-4dc5-880b-09a139063a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:12:59.817956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbf825-b9b1-4dc5-880b-09a139063a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.817956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbf825-b9b1-4dc5-880b-09a139063a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.818268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbf825-b9b1-4dc5-880b-09a139063a0b admin admin] PATH_INFO: `/v3/projects/628d6fa767e94fa2a30feefd31085264/users/d787fc8afd7b4483a111310bf2107970/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.832674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbf825-b9b1-4dc5-880b-09a139063a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=628d6fa767e94fa2a30feefd31085264, user_id=d787fc8afd7b4483a111310bf2107970, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:12:59.835811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbf825-b9b1-4dc5-880b-09a139063a0b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:12:59.850029 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3500/7039] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:12:59 2022] PUT /identity/v3/projects/628d6fa767e94fa2a30feefd31085264/users/d787fc8afd7b4483a111310bf2107970/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:12:59.862233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9324b8-b34b-4ba2-8cc4-2dc834a0d2fe None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:12:59.862546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9324b8-b34b-4ba2-8cc4-2dc834a0d2fe None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:12:59.862824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9324b8-b34b-4ba2-8cc4-2dc834a0d2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:12:59.900850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1d9324b8-b34b-4ba2-8cc4-2dc834a0d2fe None None] MFA Rules not processed for user `d787fc8afd7b4483a111310bf2107970`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:12:59.901973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1d9324b8-b34b-4ba2-8cc4-2dc834a0d2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:12:59.993855 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3540/7040] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:12:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:12:59.995133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbf825-b9b1-4dc5-880b-09a139063a0b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:00.112239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbf825-b9b1-4dc5-880b-09a139063a0b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:00.117939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15344bf1-4179-421e-a078-5e070096d933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:00.118952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344bf1-4179-421e-a078-5e070096d933 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:00.119327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344bf1-4179-421e-a078-5e070096d933 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:00.119857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15344bf1-4179-421e-a078-5e070096d933 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:00.120805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15344bf1-4179-421e-a078-5e070096d933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:00.126225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15344bf1-4179-421e-a078-5e070096d933 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:00.183317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3501/7041] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:12:59 2022] POST /identity/v3/projects => generated 363 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:00.184879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9324b8-b34b-4ba2-8cc4-2dc834a0d2fe None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:00.206764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9324b8-b34b-4ba2-8cc4-2dc834a0d2fe None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:00.312695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e90e-3bb5-4a44-a2be-c4a211ae9cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:00.313698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e90e-3bb5-4a44-a2be-c4a211ae9cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:00.314186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e90e-3bb5-4a44-a2be-c4a211ae9cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:00.314593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3e90e-3bb5-4a44-a2be-c4a211ae9cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:00.316177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3e90e-3bb5-4a44-a2be-c4a211ae9cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:00.318657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3e90e-3bb5-4a44-a2be-c4a211ae9cc6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:00.349357 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3541/7042] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:13:00 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:00.351988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15344bf1-4179-421e-a078-5e070096d933 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:00.401825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15344bf1-4179-421e-a078-5e070096d933 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:00.420267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c3b7-381a-4611-b8fc-f15d43f96144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:00.421712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c3b7-381a-4611-b8fc-f15d43f96144 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:00.444786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c3b7-381a-4611-b8fc-f15d43f96144 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:00.445914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904c3b7-381a-4611-b8fc-f15d43f96144 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:00.447947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c3b7-381a-4611-b8fc-f15d43f96144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:00.455388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904c3b7-381a-4611-b8fc-f15d43f96144 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:00.476049 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3502/7043] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:00.480246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e90e-3bb5-4a44-a2be-c4a211ae9cc6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:00.505531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3e90e-3bb5-4a44-a2be-c4a211ae9cc6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:00.514654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457184f9-9940-4faf-870a-a2f3fb5d1396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:00.518054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457184f9-9940-4faf-870a-a2f3fb5d1396 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:00.518593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457184f9-9940-4faf-870a-a2f3fb5d1396 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:00.519104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457184f9-9940-4faf-870a-a2f3fb5d1396 admin admin] PATH_INFO: `/v3/projects/b0bb8c7296154e1e85125256031b2704/users/42f4c2fa187a496e8cf0c52f34b6d760/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:00.549513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457184f9-9940-4faf-870a-a2f3fb5d1396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0bb8c7296154e1e85125256031b2704, user_id=42f4c2fa187a496e8cf0c52f34b6d760, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:00.556301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457184f9-9940-4faf-870a-a2f3fb5d1396 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:00.588338 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3542/7044] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:00 2022] PUT /identity/v3/projects/b0bb8c7296154e1e85125256031b2704/users/42f4c2fa187a496e8cf0c52f34b6d760/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:00.592396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c3b7-381a-4611-b8fc-f15d43f96144 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:00.660673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904c3b7-381a-4611-b8fc-f15d43f96144 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:00.778343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1ec64-54a9-42f4-8e7d-62304d0fb353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:00.779283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1ec64-54a9-42f4-8e7d-62304d0fb353 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:00.779828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1ec64-54a9-42f4-8e7d-62304d0fb353 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:00.780270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1ec64-54a9-42f4-8e7d-62304d0fb353 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:00.788881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1ec64-54a9-42f4-8e7d-62304d0fb353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:00.792588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1ec64-54a9-42f4-8e7d-62304d0fb353 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:00.821046 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3503/7045] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:00.823187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457184f9-9940-4faf-870a-a2f3fb5d1396 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:00.836887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457184f9-9940-4faf-870a-a2f3fb5d1396 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:00.850702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92629332-8b60-45ca-a09e-c9e6b72561cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:00.859077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92629332-8b60-45ca-a09e-c9e6b72561cb admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:00.859375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92629332-8b60-45ca-a09e-c9e6b72561cb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:00.859728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92629332-8b60-45ca-a09e-c9e6b72561cb admin admin] PATH_INFO: `/v3/projects/b0bb8c7296154e1e85125256031b2704/users/42f4c2fa187a496e8cf0c52f34b6d760/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:00.867313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92629332-8b60-45ca-a09e-c9e6b72561cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0bb8c7296154e1e85125256031b2704, user_id=42f4c2fa187a496e8cf0c52f34b6d760, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:00.879977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92629332-8b60-45ca-a09e-c9e6b72561cb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:00.909634 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3543/7046] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:00 2022] PUT /identity/v3/projects/b0bb8c7296154e1e85125256031b2704/users/42f4c2fa187a496e8cf0c52f34b6d760/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:00.921504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f9efa-ef3d-47fa-800f-ac7e41122038 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:00.922045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f9efa-ef3d-47fa-800f-ac7e41122038 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:00.922531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f9efa-ef3d-47fa-800f-ac7e41122038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:00.962665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-590f9efa-ef3d-47fa-800f-ac7e41122038 None None] MFA Rules not processed for user `42f4c2fa187a496e8cf0c52f34b6d760`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:00.962665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-590f9efa-ef3d-47fa-800f-ac7e41122038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:01.060109 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3504/7047] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:00 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:01.079718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92629332-8b60-45ca-a09e-c9e6b72561cb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:01.081615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-92629332-8b60-45ca-a09e-c9e6b72561cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:01.179087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92629332-8b60-45ca-a09e-c9e6b72561cb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:01.191394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0939-493c-4369-8a20-eac52f79f1aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:01.192244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0939-493c-4369-8a20-eac52f79f1aa service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:01.192535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0939-493c-4369-8a20-eac52f79f1aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:01.192939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0939-493c-4369-8a20-eac52f79f1aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:01.208066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0939-493c-4369-8a20-eac52f79f1aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:01.209509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0939-493c-4369-8a20-eac52f79f1aa service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:01.225349 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3544/7048] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:01 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:01.327701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b57ed-7605-49dc-98b3-f1a2ad46c1a4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:01.328378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b57ed-7605-49dc-98b3-f1a2ad46c1a4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:01.329025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b57ed-7605-49dc-98b3-f1a2ad46c1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:01.356182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cf2b57ed-7605-49dc-98b3-f1a2ad46c1a4 None None] MFA Rules not processed for user `981e1bf6531f45c4b8911579995eecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:01.357836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf2b57ed-7605-49dc-98b3-f1a2ad46c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:01.456749 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3505/7049] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:02.548113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0939-493c-4369-8a20-eac52f79f1aa service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:02.549690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e3cc0939-493c-4369-8a20-eac52f79f1aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:02.662094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0939-493c-4369-8a20-eac52f79f1aa service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:02.668567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa19b33-1d26-4624-830e-0ab3de8ab85a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:02.669555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa19b33-1d26-4624-830e-0ab3de8ab85a service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:02.670028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa19b33-1d26-4624-830e-0ab3de8ab85a service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:02.670470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa19b33-1d26-4624-830e-0ab3de8ab85a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:02.673321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1aa19b33-1d26-4624-830e-0ab3de8ab85a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:02.760396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa19b33-1d26-4624-830e-0ab3de8ab85a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:02.761945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa19b33-1d26-4624-830e-0ab3de8ab85a service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:02.776565 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3545/7050] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:05.557174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b57ed-7605-49dc-98b3-f1a2ad46c1a4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:05.561501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf2b57ed-7605-49dc-98b3-f1a2ad46c1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:05.583825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b57ed-7605-49dc-98b3-f1a2ad46c1a4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:05.603781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89743-2cbe-4921-b27b-21f2adb1851d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:05.605843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89743-2cbe-4921-b27b-21f2adb1851d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:05.606243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89743-2cbe-4921-b27b-21f2adb1851d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:05.607569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89743-2cbe-4921-b27b-21f2adb1851d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:05.795769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89743-2cbe-4921-b27b-21f2adb1851d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:05.797445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89743-2cbe-4921-b27b-21f2adb1851d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:05.825189 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3506/7051] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:13:07.438280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa19b33-1d26-4624-830e-0ab3de8ab85a service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:07.516606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa19b33-1d26-4624-830e-0ab3de8ab85a service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:07.521817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:07.523470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:07.524024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:07.524555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] PATH_INFO: `/v3/users/d787fc8afd7b4483a111310bf2107970` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:07.526151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d787fc8afd7b4483a111310bf2107970)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:07.528443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:07.584615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd787fc8afd7b4483a111310bf2107970'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:07.594940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd787fc8afd7b4483a111310bf2107970'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:07.595819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd787fc8afd7b4483a111310bf2107970'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:07.596692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd787fc8afd7b4483a111310bf2107970'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:07.608500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd787fc8afd7b4483a111310bf2107970'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:07.632843 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3546/7052] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:07 2022] DELETE /identity/v3/users/d787fc8afd7b4483a111310bf2107970 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:07.638562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef0411-cff9-4ad4-921a-f3a50d163333 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:07.639424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef0411-cff9-4ad4-921a-f3a50d163333 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:07.639771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef0411-cff9-4ad4-921a-f3a50d163333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:07.659188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-85ef0411-cff9-4ad4-921a-f3a50d163333 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:07.661248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-85ef0411-cff9-4ad4-921a-f3a50d163333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:07.761697 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3507/7053] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:07.772321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:07.774273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:07.888713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593933b0-0f92-45e6-b756-621846d49ab0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:07.902497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e07e-fd7a-4c44-9f66-51c737b94666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:07.902497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e07e-fd7a-4c44-9f66-51c737b94666 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:07.902497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e07e-fd7a-4c44-9f66-51c737b94666 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:07.902933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580e07e-fd7a-4c44-9f66-51c737b94666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:07.922680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580e07e-fd7a-4c44-9f66-51c737b94666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:07.927577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580e07e-fd7a-4c44-9f66-51c737b94666 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:07.948924 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3547/7054] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:08.386807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef0411-cff9-4ad4-921a-f3a50d163333 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:08.388404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-85ef0411-cff9-4ad4-921a-f3a50d163333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:08.401624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ef0411-cff9-4ad4-921a-f3a50d163333 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:08.407125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:08.408128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:08.408427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:08.408704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] PATH_INFO: `/v3/projects/628d6fa767e94fa2a30feefd31085264` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:08.409929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=628d6fa767e94fa2a30feefd31085264)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:08.413735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:08.489215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '628d6fa767e94fa2a30feefd31085264', 'request_id': 'req-34811eaf-8559-421c-88ea-42b05de125dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.504287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '628d6fa767e94fa2a30feefd31085264', 'request_id': 'req-34811eaf-8559-421c-88ea-42b05de125dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.523761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '628d6fa767e94fa2a30feefd31085264', 'request_id': 'req-34811eaf-8559-421c-88ea-42b05de125dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.541087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] The token cache is being invalidate because project 628d6fa767e94fa2a30feefd31085264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:08.541797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.542727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.549077 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3508/7055] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:08 2022] DELETE /identity/v3/projects/628d6fa767e94fa2a30feefd31085264 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:08.550021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e07e-fd7a-4c44-9f66-51c737b94666 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:08.561412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580e07e-fd7a-4c44-9f66-51c737b94666 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:08.634778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:08.635975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:08.636293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:08.636717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] PATH_INFO: `/v3/users/42f4c2fa187a496e8cf0c52f34b6d760` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:08.638169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f4c2fa187a496e8cf0c52f34b6d760)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:08.640427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:08.714292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f4c2fa187a496e8cf0c52f34b6d760'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.728866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f4c2fa187a496e8cf0c52f34b6d760'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.729627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f4c2fa187a496e8cf0c52f34b6d760'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.730332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f4c2fa187a496e8cf0c52f34b6d760'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.740113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-63b1b927-7c23-458e-987a-5b99d173506b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f4c2fa187a496e8cf0c52f34b6d760'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:08.801477 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3548/7056] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:08 2022] DELETE /identity/v3/users/42f4c2fa187a496e8cf0c52f34b6d760 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:09.867572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:09.870004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:09.891123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34811eaf-8559-421c-88ea-42b05de125dd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:10.058979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:10.062348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.063224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.063680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] PATH_INFO: `/v3/projects/b0bb8c7296154e1e85125256031b2704` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.065230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0bb8c7296154e1e85125256031b2704)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:10.067390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:10.128843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0bb8c7296154e1e85125256031b2704', 'request_id': 'req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:10.139135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0bb8c7296154e1e85125256031b2704', 'request_id': 'req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:10.145993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0bb8c7296154e1e85125256031b2704', 'request_id': 'req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:10.158444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] The token cache is being invalidate because project b0bb8c7296154e1e85125256031b2704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:10.158911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:10.159626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dbae9bb2-2594-418b-9acd-c1f6a4ffe79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:10.161594 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3509/7057] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:09 2022] DELETE /identity/v3/projects/b0bb8c7296154e1e85125256031b2704 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:10.166961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889455c-8565-4545-995c-89811e71f377 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.167529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889455c-8565-4545-995c-89811e71f377 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.167529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889455c-8565-4545-995c-89811e71f377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.190706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f889455c-8565-4545-995c-89811e71f377 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:10.191892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f889455c-8565-4545-995c-89811e71f377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:10.255902 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3549/7058] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:10.263404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7656b-a090-40ec-960c-65420a8cbfbb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.263693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7656b-a090-40ec-960c-65420a8cbfbb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.264010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7656b-a090-40ec-960c-65420a8cbfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.285075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ead7656b-a090-40ec-960c-65420a8cbfbb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:10.287520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ead7656b-a090-40ec-960c-65420a8cbfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:10.302031 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3510/7059] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:13:10.304738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889455c-8565-4545-995c-89811e71f377 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:10.315513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889455c-8565-4545-995c-89811e71f377 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:10.321014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e8fa3-156e-4042-9722-ef47c4c61137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:10.321737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e8fa3-156e-4042-9722-ef47c4c61137 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.322020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e8fa3-156e-4042-9722-ef47c4c61137 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.322301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e8fa3-156e-4042-9722-ef47c4c61137 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.323158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e8fa3-156e-4042-9722-ef47c4c61137 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:13:10.324198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e8fa3-156e-4042-9722-ef47c4c61137 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:10.325853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e8fa3-156e-4042-9722-ef47c4c61137 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:10.345938 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3550/7060] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:13:10.348987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7656b-a090-40ec-960c-65420a8cbfbb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:10.359435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7656b-a090-40ec-960c-65420a8cbfbb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:10.364459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62baf6c-3a2a-4db9-88cb-9ce1f5ab2657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:10.365139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62baf6c-3a2a-4db9-88cb-9ce1f5ab2657 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.365430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62baf6c-3a2a-4db9-88cb-9ce1f5ab2657 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.365740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62baf6c-3a2a-4db9-88cb-9ce1f5ab2657 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.367014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62baf6c-3a2a-4db9-88cb-9ce1f5ab2657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:10.369061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62baf6c-3a2a-4db9-88cb-9ce1f5ab2657 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:10.398973 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3511/7061] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:13:10 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:13:10.403289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e8fa3-156e-4042-9722-ef47c4c61137 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:10.415737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e8fa3-156e-4042-9722-ef47c4c61137 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:10.482312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647577d-afa2-4d60-b627-7dba41dd8858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:10.482986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647577d-afa2-4d60-b627-7dba41dd8858 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.483398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647577d-afa2-4d60-b627-7dba41dd8858 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.483707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647577d-afa2-4d60-b627-7dba41dd8858 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.484636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647577d-afa2-4d60-b627-7dba41dd8858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:10.486752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647577d-afa2-4d60-b627-7dba41dd8858 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:10.511654 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3551/7062] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:13:10 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:10.513026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62baf6c-3a2a-4db9-88cb-9ce1f5ab2657 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:10.525707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62baf6c-3a2a-4db9-88cb-9ce1f5ab2657 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:10.530705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589adc5-0a7d-4a8c-84b3-0524a478bfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:10.531379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589adc5-0a7d-4a8c-84b3-0524a478bfa0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.531664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589adc5-0a7d-4a8c-84b3-0524a478bfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.531973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2589adc5-0a7d-4a8c-84b3-0524a478bfa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.532701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589adc5-0a7d-4a8c-84b3-0524a478bfa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:10.534323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2589adc5-0a7d-4a8c-84b3-0524a478bfa0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:10.546122 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3512/7063] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:10.550170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647577d-afa2-4d60-b627-7dba41dd8858 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:10.566949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647577d-afa2-4d60-b627-7dba41dd8858 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:10.576405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98903bf-39cc-4dfd-87a6-aa3eac6b0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:10.577571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98903bf-39cc-4dfd-87a6-aa3eac6b0cba admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.577571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98903bf-39cc-4dfd-87a6-aa3eac6b0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.577804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98903bf-39cc-4dfd-87a6-aa3eac6b0cba admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.578698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98903bf-39cc-4dfd-87a6-aa3eac6b0cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:10.580838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98903bf-39cc-4dfd-87a6-aa3eac6b0cba admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:10.596530 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3552/7064] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:13:10.597869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589adc5-0a7d-4a8c-84b3-0524a478bfa0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:10.608953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2589adc5-0a7d-4a8c-84b3-0524a478bfa0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:10.613669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cd57c-be46-4157-91fb-bf3830122e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:10.614554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cd57c-be46-4157-91fb-bf3830122e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.614838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cd57c-be46-4157-91fb-bf3830122e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.615115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cd57c-be46-4157-91fb-bf3830122e2e admin admin] PATH_INFO: `/v3/projects/bacc31d0868946c1acfdaf5a60ddd258/users/37085f06e4b44197bf1cdb202ecc9ac9/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.634534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cd57c-be46-4157-91fb-bf3830122e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bacc31d0868946c1acfdaf5a60ddd258, user_id=37085f06e4b44197bf1cdb202ecc9ac9, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:10.636204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cd57c-be46-4157-91fb-bf3830122e2e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:10.662381 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3513/7065] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:10 2022] PUT /identity/v3/projects/bacc31d0868946c1acfdaf5a60ddd258/users/37085f06e4b44197bf1cdb202ecc9ac9/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:10.664914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5f57-4e13-4e74-8082-378bb7f5ec14 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.665399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5f57-4e13-4e74-8082-378bb7f5ec14 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.665866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a5f57-4e13-4e74-8082-378bb7f5ec14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.708956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3f0a5f57-4e13-4e74-8082-378bb7f5ec14 None None] MFA Rules not processed for user `37085f06e4b44197bf1cdb202ecc9ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:10.710709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3f0a5f57-4e13-4e74-8082-378bb7f5ec14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:10.814763 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3553/7066] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:10.840979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cd57c-be46-4157-91fb-bf3830122e2e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:10.843569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-832cd57c-be46-4157-91fb-bf3830122e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:10.933422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cd57c-be46-4157-91fb-bf3830122e2e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:10.937585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7d024-f019-44b4-b431-2434c615e440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:10.938526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7d024-f019-44b4-b431-2434c615e440 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:10.938813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7d024-f019-44b4-b431-2434c615e440 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:10.939089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7d024-f019-44b4-b431-2434c615e440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:10.956723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7d024-f019-44b4-b431-2434c615e440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:10.959614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7d024-f019-44b4-b431-2434c615e440 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:10.972522 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3514/7067] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:18.842773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a5f57-4e13-4e74-8082-378bb7f5ec14 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:18.845612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3f0a5f57-4e13-4e74-8082-378bb7f5ec14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:19.073199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a5f57-4e13-4e74-8082-378bb7f5ec14 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:19.088788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:19.090561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:19.090561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:19.090561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] PATH_INFO: `/v3/users/aea79da16ff648a2ac334d901a057785` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:19.092975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea79da16ff648a2ac334d901a057785)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:19.099002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:19.189027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea79da16ff648a2ac334d901a057785'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:19.211968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea79da16ff648a2ac334d901a057785'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:19.211968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea79da16ff648a2ac334d901a057785'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:19.211968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea79da16ff648a2ac334d901a057785'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:19.226088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea79da16ff648a2ac334d901a057785'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:19.270457 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3554/7068] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:18 2022] DELETE /identity/v3/users/aea79da16ff648a2ac334d901a057785 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:19.273738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4fa6d-66f8-47a6-8699-c8c7e2cf05bb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:19.274329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4fa6d-66f8-47a6-8699-c8c7e2cf05bb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:19.274329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4fa6d-66f8-47a6-8699-c8c7e2cf05bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:19.296867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-33d4fa6d-66f8-47a6-8699-c8c7e2cf05bb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:19.299450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-33d4fa6d-66f8-47a6-8699-c8c7e2cf05bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:19.373569 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3515/7069] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:19.386536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:19.388868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:19.500600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23591f5c-05d1-4286-bce9-66c89b19ec70 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:19.505667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586ef9b-19f6-4488-8c64-d4c3c53b399d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:19.506315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ef9b-19f6-4488-8c64-d4c3c53b399d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:19.507143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ef9b-19f6-4488-8c64-d4c3c53b399d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:19.507494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586ef9b-19f6-4488-8c64-d4c3c53b399d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:19.520295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586ef9b-19f6-4488-8c64-d4c3c53b399d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:19.521789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586ef9b-19f6-4488-8c64-d4c3c53b399d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:19.550123 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3555/7070] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:20.239868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4fa6d-66f8-47a6-8699-c8c7e2cf05bb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:20.242160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-33d4fa6d-66f8-47a6-8699-c8c7e2cf05bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:20.275773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4fa6d-66f8-47a6-8699-c8c7e2cf05bb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:20.284584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:20.285968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:20.286473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:20.288776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] PATH_INFO: `/v3/projects/c6ec1467add04a35afa59444b1f51296` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:20.290703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ec1467add04a35afa59444b1f51296)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:20.293657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:20.398904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ec1467add04a35afa59444b1f51296', 'request_id': 'req-58c11405-f886-4463-af71-6f0fdb0e1fe3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.415861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ec1467add04a35afa59444b1f51296', 'request_id': 'req-58c11405-f886-4463-af71-6f0fdb0e1fe3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.444893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ec1467add04a35afa59444b1f51296', 'request_id': 'req-58c11405-f886-4463-af71-6f0fdb0e1fe3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.484736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] The token cache is being invalidate because project c6ec1467add04a35afa59444b1f51296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:20.486424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.487365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.493680 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3516/7071] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:20 2022] DELETE /identity/v3/projects/c6ec1467add04a35afa59444b1f51296 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:20.497495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586ef9b-19f6-4488-8c64-d4c3c53b399d service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:20.513761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586ef9b-19f6-4488-8c64-d4c3c53b399d service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:20.667078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:20.668286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:20.668682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:20.669172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] PATH_INFO: `/v3/users/c58984ca57a04adaac5e0e3b6ad5bce0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:20.670665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c58984ca57a04adaac5e0e3b6ad5bce0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:20.673659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:20.770732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c58984ca57a04adaac5e0e3b6ad5bce0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.785167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c58984ca57a04adaac5e0e3b6ad5bce0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.788615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c58984ca57a04adaac5e0e3b6ad5bce0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.789604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c58984ca57a04adaac5e0e3b6ad5bce0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.798947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a2915afc-b6e9-4d2e-8782-a89492564222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c58984ca57a04adaac5e0e3b6ad5bce0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:20.827609 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3556/7072] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:20 2022] DELETE /identity/v3/users/c58984ca57a04adaac5e0e3b6ad5bce0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:21.246204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:21.248054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:21.274475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c11405-f886-4463-af71-6f0fdb0e1fe3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:21.344815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:21.346453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:21.346907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:21.347349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] PATH_INFO: `/v3/projects/f42ca6a4381443f5bb80e16f92bc2de7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:21.348852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42ca6a4381443f5bb80e16f92bc2de7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:21.351747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:21.438710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42ca6a4381443f5bb80e16f92bc2de7', 'request_id': 'req-614006cc-198e-4b0e-999b-7bbb1287945c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:21.452728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42ca6a4381443f5bb80e16f92bc2de7', 'request_id': 'req-614006cc-198e-4b0e-999b-7bbb1287945c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:21.470286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42ca6a4381443f5bb80e16f92bc2de7', 'request_id': 'req-614006cc-198e-4b0e-999b-7bbb1287945c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:21.489475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] The token cache is being invalidate because project f42ca6a4381443f5bb80e16f92bc2de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:21.490023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:21.491671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-614006cc-198e-4b0e-999b-7bbb1287945c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:21.501874 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3517/7073] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:21 2022] DELETE /identity/v3/projects/f42ca6a4381443f5bb80e16f92bc2de7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:21.507545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141eb6a-8ddd-4236-9741-b276958711b1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:21.508172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141eb6a-8ddd-4236-9741-b276958711b1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:21.508721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141eb6a-8ddd-4236-9741-b276958711b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:21.537856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3141eb6a-8ddd-4236-9741-b276958711b1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:21.539899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3141eb6a-8ddd-4236-9741-b276958711b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:21.651188 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3557/7074] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:21.659047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1c892-1b06-4870-8381-c13d72a299b4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:21.659335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1c892-1b06-4870-8381-c13d72a299b4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:21.659838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd1c892-1b06-4870-8381-c13d72a299b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:21.702168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2fd1c892-1b06-4870-8381-c13d72a299b4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:21.703420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2fd1c892-1b06-4870-8381-c13d72a299b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:21.728143 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3518/7075] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:21.730012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141eb6a-8ddd-4236-9741-b276958711b1 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:21.746408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141eb6a-8ddd-4236-9741-b276958711b1 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:21.752091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21222296-f4bf-4138-aa21-6b68305b6683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:21.753574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21222296-f4bf-4138-aa21-6b68305b6683 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:21.753868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21222296-f4bf-4138-aa21-6b68305b6683 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:21.754148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21222296-f4bf-4138-aa21-6b68305b6683 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:21.754872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21222296-f4bf-4138-aa21-6b68305b6683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:13:21.755182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21222296-f4bf-4138-aa21-6b68305b6683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:21.765399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21222296-f4bf-4138-aa21-6b68305b6683 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:21.806904 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3558/7076] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:13:21.811898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1c892-1b06-4870-8381-c13d72a299b4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:21.822479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd1c892-1b06-4870-8381-c13d72a299b4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:21.859830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc86a-f825-49d8-b0bb-1c395fe5bef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:21.860700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc86a-f825-49d8-b0bb-1c395fe5bef1 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:21.862677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc86a-f825-49d8-b0bb-1c395fe5bef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:21.863027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bc86a-f825-49d8-b0bb-1c395fe5bef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:21.863833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bc86a-f825-49d8-b0bb-1c395fe5bef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:21.868460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bc86a-f825-49d8-b0bb-1c395fe5bef1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:21.996527 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3519/7077] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:13:21 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:22.000850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21222296-f4bf-4138-aa21-6b68305b6683 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:22.021799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21222296-f4bf-4138-aa21-6b68305b6683 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:22.138543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ac1c7-2e6e-490e-bcdb-7a6bcf786daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:22.139227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ac1c7-2e6e-490e-bcdb-7a6bcf786daa admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:22.139737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ac1c7-2e6e-490e-bcdb-7a6bcf786daa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:22.139943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ac1c7-2e6e-490e-bcdb-7a6bcf786daa admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:22.140964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ac1c7-2e6e-490e-bcdb-7a6bcf786daa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:22.142697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ac1c7-2e6e-490e-bcdb-7a6bcf786daa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:22.173118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc86a-f825-49d8-b0bb-1c395fe5bef1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:22.181037 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3559/7078] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:13:21 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:22.185997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bc86a-f825-49d8-b0bb-1c395fe5bef1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:22.191433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1984d-e742-499c-acbd-2e04aab0490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:22.192412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1984d-e742-499c-acbd-2e04aab0490a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:22.192764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1984d-e742-499c-acbd-2e04aab0490a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:22.193118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1984d-e742-499c-acbd-2e04aab0490a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:22.194249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1984d-e742-499c-acbd-2e04aab0490a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:22.196187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1984d-e742-499c-acbd-2e04aab0490a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:22.212993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ac1c7-2e6e-490e-bcdb-7a6bcf786daa admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:22.224305 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3520/7079] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:22.226396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ac1c7-2e6e-490e-bcdb-7a6bcf786daa admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:22.233929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b31ac-48ec-4d30-a01b-e2c14075603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:22.234686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b31ac-48ec-4d30-a01b-e2c14075603e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:22.235064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b31ac-48ec-4d30-a01b-e2c14075603e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:22.235869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b31ac-48ec-4d30-a01b-e2c14075603e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:22.236261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b31ac-48ec-4d30-a01b-e2c14075603e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:22.237993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b31ac-48ec-4d30-a01b-e2c14075603e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:22.254295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1984d-e742-499c-acbd-2e04aab0490a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:22.261364 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3560/7080] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:22.266584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1984d-e742-499c-acbd-2e04aab0490a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:22.272975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f1de-aac5-442d-b4ae-1876119b771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:22.274267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f1de-aac5-442d-b4ae-1876119b771a admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:22.274676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f1de-aac5-442d-b4ae-1876119b771a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:22.275001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f1de-aac5-442d-b4ae-1876119b771a admin admin] PATH_INFO: `/v3/projects/df696fca7ef64369aaa68766c4d28615/users/65ffc58fcf42460ea3d22691b5f772bd/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:22.299498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779f1de-aac5-442d-b4ae-1876119b771a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df696fca7ef64369aaa68766c4d28615, user_id=65ffc58fcf42460ea3d22691b5f772bd, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:22.308371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779f1de-aac5-442d-b4ae-1876119b771a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:22.338384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3eae-8892-46d1-aa93-17ddac2e2537 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:22.338598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3eae-8892-46d1-aa93-17ddac2e2537 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:22.338757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3eae-8892-46d1-aa93-17ddac2e2537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:22.340122 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3521/7081] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:22 2022] PUT /identity/v3/projects/df696fca7ef64369aaa68766c4d28615/users/65ffc58fcf42460ea3d22691b5f772bd/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:22.380008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b16b3eae-8892-46d1-aa93-17ddac2e2537 None None] MFA Rules not processed for user `65ffc58fcf42460ea3d22691b5f772bd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:22.381256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b16b3eae-8892-46d1-aa93-17ddac2e2537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:22.510775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f1de-aac5-442d-b4ae-1876119b771a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:22.512041 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3561/7082] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:22.621022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f1de-aac5-442d-b4ae-1876119b771a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:22.627877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921e5cf-a7e7-4e0c-ac02-d400aa3ca1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:22.629260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e5cf-a7e7-4e0c-ac02-d400aa3ca1cc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:22.629600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e5cf-a7e7-4e0c-ac02-d400aa3ca1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:22.629897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921e5cf-a7e7-4e0c-ac02-d400aa3ca1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:22.630797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921e5cf-a7e7-4e0c-ac02-d400aa3ca1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:22.637375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a921e5cf-a7e7-4e0c-ac02-d400aa3ca1cc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:22.689575 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3522/7083] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:13:22 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:13:22.695348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b3eae-8892-46d1-aa93-17ddac2e2537 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:22.712608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b3eae-8892-46d1-aa93-17ddac2e2537 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:22.811576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69c6f-231a-490c-9234-684e715d82e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:22.812458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69c6f-231a-490c-9234-684e715d82e8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:22.812810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69c6f-231a-490c-9234-684e715d82e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:22.813611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69c6f-231a-490c-9234-684e715d82e8 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:22.814648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b69c6f-231a-490c-9234-684e715d82e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:22.819620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b69c6f-231a-490c-9234-684e715d82e8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:22.858148 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3562/7084] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:13:22 2022] POST /identity/v3/users => generated 300 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:22.862152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921e5cf-a7e7-4e0c-ac02-d400aa3ca1cc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:22.879246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921e5cf-a7e7-4e0c-ac02-d400aa3ca1cc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:22.887707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe9de-9fc1-4f10-b269-e67e72763224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:22.889185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe9de-9fc1-4f10-b269-e67e72763224 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:22.889694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe9de-9fc1-4f10-b269-e67e72763224 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:22.890190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabe9de-9fc1-4f10-b269-e67e72763224 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:22.891177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabe9de-9fc1-4f10-b269-e67e72763224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:22.893053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabe9de-9fc1-4f10-b269-e67e72763224 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:22.912159 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3523/7085] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:22.917387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69c6f-231a-490c-9234-684e715d82e8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:22.933974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69c6f-231a-490c-9234-684e715d82e8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:22.942086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cefab0-c729-42ce-b98f-c8c09387a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:22.943388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cefab0-c729-42ce-b98f-c8c09387a40e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:22.945458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cefab0-c729-42ce-b98f-c8c09387a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:22.946229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cefab0-c729-42ce-b98f-c8c09387a40e admin admin] PATH_INFO: `/v3/projects/7befec12d6c043d183e0b4e52f948e2b/users/5c2507b35bcd41c89d759fb47ed5d833/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:22.978957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cefab0-c729-42ce-b98f-c8c09387a40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7befec12d6c043d183e0b4e52f948e2b, user_id=5c2507b35bcd41c89d759fb47ed5d833, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:22.982660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cefab0-c729-42ce-b98f-c8c09387a40e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:23.005855 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3563/7086] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:22 2022] PUT /identity/v3/projects/7befec12d6c043d183e0b4e52f948e2b/users/5c2507b35bcd41c89d759fb47ed5d833/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:23.009372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe9de-9fc1-4f10-b269-e67e72763224 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:23.026460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabe9de-9fc1-4f10-b269-e67e72763224 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:23.123550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8d598-57c7-4f3e-8442-5654850bdc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:23.124724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8d598-57c7-4f3e-8442-5654850bdc13 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:23.124724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8d598-57c7-4f3e-8442-5654850bdc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:23.125510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8d598-57c7-4f3e-8442-5654850bdc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:23.128213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8d598-57c7-4f3e-8442-5654850bdc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:23.129951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8d598-57c7-4f3e-8442-5654850bdc13 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:23.146836 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3524/7087] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:23.151470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cefab0-c729-42ce-b98f-c8c09387a40e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:23.164583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cefab0-c729-42ce-b98f-c8c09387a40e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:23.170419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4419b-a411-48ae-bac4-a0a3eb1cc28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:23.172051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4419b-a411-48ae-bac4-a0a3eb1cc28b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:23.172353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4419b-a411-48ae-bac4-a0a3eb1cc28b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:23.172802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4419b-a411-48ae-bac4-a0a3eb1cc28b admin admin] PATH_INFO: `/v3/projects/7befec12d6c043d183e0b4e52f948e2b/users/5c2507b35bcd41c89d759fb47ed5d833/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:23.175984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4419b-a411-48ae-bac4-a0a3eb1cc28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7befec12d6c043d183e0b4e52f948e2b, user_id=5c2507b35bcd41c89d759fb47ed5d833, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:23.196469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4419b-a411-48ae-bac4-a0a3eb1cc28b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:23.212386 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3564/7088] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:23 2022] PUT /identity/v3/projects/7befec12d6c043d183e0b4e52f948e2b/users/5c2507b35bcd41c89d759fb47ed5d833/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:23.223552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecff91f-7835-4889-8692-f9a20fb1ada2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:23.223947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecff91f-7835-4889-8692-f9a20fb1ada2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:23.224253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecff91f-7835-4889-8692-f9a20fb1ada2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:23.269690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5ecff91f-7835-4889-8692-f9a20fb1ada2 None None] MFA Rules not processed for user `5c2507b35bcd41c89d759fb47ed5d833`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:23.271166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5ecff91f-7835-4889-8692-f9a20fb1ada2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:23.377272 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3525/7089] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:13:23.389141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4419b-a411-48ae-bac4-a0a3eb1cc28b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:23.391131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b8c4419b-a411-48ae-bac4-a0a3eb1cc28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:23.543259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4419b-a411-48ae-bac4-a0a3eb1cc28b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:23.549714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab0441-5a97-45d9-a639-20b8e86b9579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:23.551727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab0441-5a97-45d9-a639-20b8e86b9579 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:23.552067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab0441-5a97-45d9-a639-20b8e86b9579 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:23.552477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab0441-5a97-45d9-a639-20b8e86b9579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:23.566294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab0441-5a97-45d9-a639-20b8e86b9579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:23.567806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab0441-5a97-45d9-a639-20b8e86b9579 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:23.608258 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3565/7090] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:23.699822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecff91f-7835-4889-8692-f9a20fb1ada2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:23.846428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecff91f-7835-4889-8692-f9a20fb1ada2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:23.858062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:23.860040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:23.860826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:23.861331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] PATH_INFO: `/v3/users/65ffc58fcf42460ea3d22691b5f772bd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:23.863573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ffc58fcf42460ea3d22691b5f772bd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:23.870930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:23.984821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ffc58fcf42460ea3d22691b5f772bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:23.998111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ffc58fcf42460ea3d22691b5f772bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:24.000018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ffc58fcf42460ea3d22691b5f772bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:24.001578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ffc58fcf42460ea3d22691b5f772bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:24.054284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ffc58fcf42460ea3d22691b5f772bd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:24.118758 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3526/7091] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:23 2022] DELETE /identity/v3/users/65ffc58fcf42460ea3d22691b5f772bd => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:24.125972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642267f-9324-41db-8c31-b34f853172d8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:24.126544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642267f-9324-41db-8c31-b34f853172d8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:24.127013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642267f-9324-41db-8c31-b34f853172d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:24.176928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4642267f-9324-41db-8c31-b34f853172d8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:24.178732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4642267f-9324-41db-8c31-b34f853172d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:24.310598 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3566/7092] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:13:24.335040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:24.336586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:24.502173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b73dab-381d-44b2-892b-06079ab3fc52 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:24.529295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63003d90-73f1-47ec-b68a-945631095c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:24.529941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63003d90-73f1-47ec-b68a-945631095c4a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:24.530229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63003d90-73f1-47ec-b68a-945631095c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:24.530521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63003d90-73f1-47ec-b68a-945631095c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:24.549638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63003d90-73f1-47ec-b68a-945631095c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:24.552176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63003d90-73f1-47ec-b68a-945631095c4a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:24.576971 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3527/7093] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:25.539910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642267f-9324-41db-8c31-b34f853172d8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:25.543214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4642267f-9324-41db-8c31-b34f853172d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:25.579191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642267f-9324-41db-8c31-b34f853172d8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:25.589982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:25.592172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:25.592692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:25.593460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] PATH_INFO: `/v3/projects/df696fca7ef64369aaa68766c4d28615` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:25.597331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df696fca7ef64369aaa68766c4d28615)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:25.609359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:25.729339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df696fca7ef64369aaa68766c4d28615', 'request_id': 'req-5d65d28e-94e3-4d90-8a29-d0280ac66b05'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:25.765447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df696fca7ef64369aaa68766c4d28615', 'request_id': 'req-5d65d28e-94e3-4d90-8a29-d0280ac66b05'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:25.792090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df696fca7ef64369aaa68766c4d28615', 'request_id': 'req-5d65d28e-94e3-4d90-8a29-d0280ac66b05'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:25.818653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] The token cache is being invalidate because project df696fca7ef64369aaa68766c4d28615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:25.829113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:25.831965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:25.858750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63003d90-73f1-47ec-b68a-945631095c4a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:25.859643 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3567/7094] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:25 2022] DELETE /identity/v3/projects/df696fca7ef64369aaa68766c4d28615 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:25.878683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63003d90-73f1-47ec-b68a-945631095c4a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:26.047765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:26.048623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:26.048803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:26.049088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] PATH_INFO: `/v3/users/5c2507b35bcd41c89d759fb47ed5d833` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:26.050362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2507b35bcd41c89d759fb47ed5d833)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:26.052700 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:26.155972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2507b35bcd41c89d759fb47ed5d833'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:26.180085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2507b35bcd41c89d759fb47ed5d833'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:26.183325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2507b35bcd41c89d759fb47ed5d833'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:26.184907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2507b35bcd41c89d759fb47ed5d833'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:26.232332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d493f35c-1b35-4820-a471-2fd9d9e04831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2507b35bcd41c89d759fb47ed5d833'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:26.253405 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3528/7095] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:25 2022] DELETE /identity/v3/users/5c2507b35bcd41c89d759fb47ed5d833 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:13:28.071534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:28.073768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:28.094862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65d28e-94e3-4d90-8a29-d0280ac66b05 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:28.202119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:28.204041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:28.204358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:28.204607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] PATH_INFO: `/v3/projects/7befec12d6c043d183e0b4e52f948e2b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:28.206256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7befec12d6c043d183e0b4e52f948e2b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:28.208542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:28.271220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7befec12d6c043d183e0b4e52f948e2b', 'request_id': 'req-08dc2957-44aa-4013-83f0-6d395d6a1293'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.283678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7befec12d6c043d183e0b4e52f948e2b', 'request_id': 'req-08dc2957-44aa-4013-83f0-6d395d6a1293'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.291773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7befec12d6c043d183e0b4e52f948e2b', 'request_id': 'req-08dc2957-44aa-4013-83f0-6d395d6a1293'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.308259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] The token cache is being invalidate because project 7befec12d6c043d183e0b4e52f948e2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:28.308523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.309310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.311650 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3568/7096] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:28 2022] DELETE /identity/v3/projects/7befec12d6c043d183e0b4e52f948e2b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:28.317015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3351a-f212-42d0-9048-f3bbae0a1eb9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:28.317772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3351a-f212-42d0-9048-f3bbae0a1eb9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:28.317772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3351a-f212-42d0-9048-f3bbae0a1eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:28.341585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-37a3351a-f212-42d0-9048-f3bbae0a1eb9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:28.341741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:28.343136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-37a3351a-f212-42d0-9048-f3bbae0a1eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:28.344665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:28.410053 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3529/7097] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:28.417660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5da2d-abeb-4c52-9d32-0d730f1dd8db None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:28.418023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5da2d-abeb-4c52-9d32-0d730f1dd8db None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:28.418378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5da2d-abeb-4c52-9d32-0d730f1dd8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:28.439793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc2957-44aa-4013-83f0-6d395d6a1293 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:28.440128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f1e5da2d-abeb-4c52-9d32-0d730f1dd8db None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:28.441404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f1e5da2d-abeb-4c52-9d32-0d730f1dd8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:28.445791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:28.446912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:28.447234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:28.447708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] PATH_INFO: `/v3/users/259d208f1dd1422a9bda8a7495c47f3a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:28.449410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=259d208f1dd1422a9bda8a7495c47f3a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:28.451511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:28.451906 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3530/7098] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:28.456067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5da2d-abeb-4c52-9d32-0d730f1dd8db None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:28.469801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5da2d-abeb-4c52-9d32-0d730f1dd8db None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:28.476719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74926915-f133-426c-892f-6f5a6883334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:28.477637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74926915-f133-426c-892f-6f5a6883334f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:28.478095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74926915-f133-426c-892f-6f5a6883334f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:28.479731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74926915-f133-426c-892f-6f5a6883334f admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:28.480683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74926915-f133-426c-892f-6f5a6883334f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:13:28.481174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74926915-f133-426c-892f-6f5a6883334f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:28.482983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74926915-f133-426c-892f-6f5a6883334f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:28.499829 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3531/7099] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:13:28.504880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74926915-f133-426c-892f-6f5a6883334f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:28.518560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74926915-f133-426c-892f-6f5a6883334f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:28.524473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23043-253c-4db6-b3e3-e4bd2c74363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:28.526142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23043-253c-4db6-b3e3-e4bd2c74363f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:28.526669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23043-253c-4db6-b3e3-e4bd2c74363f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:28.526969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259d208f1dd1422a9bda8a7495c47f3a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.527417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df23043-253c-4db6-b3e3-e4bd2c74363f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:28.528506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df23043-253c-4db6-b3e3-e4bd2c74363f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:28.531331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df23043-253c-4db6-b3e3-e4bd2c74363f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:28.534391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259d208f1dd1422a9bda8a7495c47f3a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.535396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259d208f1dd1422a9bda8a7495c47f3a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.536054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259d208f1dd1422a9bda8a7495c47f3a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.549753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9120ca5e-6070-4b32-8497-b78d8653bf6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259d208f1dd1422a9bda8a7495c47f3a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:28.567080 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3532/7100] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:13:28 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:28.571239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23043-253c-4db6-b3e3-e4bd2c74363f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:28.575063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4df23043-253c-4db6-b3e3-e4bd2c74363f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:28.585235 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3569/7101] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:28 2022] DELETE /identity/v3/users/259d208f1dd1422a9bda8a7495c47f3a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:28.592113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daadf2-36ab-4f21-8475-83df43704e73 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:28.592392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daadf2-36ab-4f21-8475-83df43704e73 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:28.592661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daadf2-36ab-4f21-8475-83df43704e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:28.633061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f6daadf2-36ab-4f21-8475-83df43704e73 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:28.634304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f6daadf2-36ab-4f21-8475-83df43704e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:28.769521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df23043-253c-4db6-b3e3-e4bd2c74363f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:28.784598 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3570/7102] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:28.807272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daadf2-36ab-4f21-8475-83df43704e73 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:28.818053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f6daadf2-36ab-4f21-8475-83df43704e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:28.883777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e13a4b-8b5d-40f3-a5af-b74ce4dc9a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:28.884863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13a4b-8b5d-40f3-a5af-b74ce4dc9a63 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:28.885270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13a4b-8b5d-40f3-a5af-b74ce4dc9a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:28.885829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e13a4b-8b5d-40f3-a5af-b74ce4dc9a63 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:28.887409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e13a4b-8b5d-40f3-a5af-b74ce4dc9a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:28.896964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e13a4b-8b5d-40f3-a5af-b74ce4dc9a63 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:28.935760 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3533/7103] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:13:28 2022] POST /identity/v3/users => generated 288 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:13:28.938921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e13a4b-8b5d-40f3-a5af-b74ce4dc9a63 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:28.963819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e13a4b-8b5d-40f3-a5af-b74ce4dc9a63 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:28.990208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c09bb-fb58-4b1d-9da0-0805e4df86db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:28.992348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c09bb-fb58-4b1d-9da0-0805e4df86db admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:28.992900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c09bb-fb58-4b1d-9da0-0805e4df86db admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:28.994394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c09bb-fb58-4b1d-9da0-0805e4df86db admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:28.995471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c09bb-fb58-4b1d-9da0-0805e4df86db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:28.998818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c09bb-fb58-4b1d-9da0-0805e4df86db admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:29.033292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daadf2-36ab-4f21-8475-83df43704e73 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:29.033850 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3534/7104] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:29.039391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c09bb-fb58-4b1d-9da0-0805e4df86db admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:29.042639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2cafb-9da7-4ee0-8ef1-baeb3782024a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:29.044309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2cafb-9da7-4ee0-8ef1-baeb3782024a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:29.044788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2cafb-9da7-4ee0-8ef1-baeb3782024a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:29.045234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2cafb-9da7-4ee0-8ef1-baeb3782024a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:29.068033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c09bb-fb58-4b1d-9da0-0805e4df86db admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:29.070189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2cafb-9da7-4ee0-8ef1-baeb3782024a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:29.075548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2cafb-9da7-4ee0-8ef1-baeb3782024a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:29.081125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b8f38-eda2-497d-a54d-549ed95535fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:29.083491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8f38-eda2-497d-a54d-549ed95535fa admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:29.084813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8f38-eda2-497d-a54d-549ed95535fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:29.085208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b8f38-eda2-497d-a54d-549ed95535fa admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:29.088642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b8f38-eda2-497d-a54d-549ed95535fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:29.095591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b8f38-eda2-497d-a54d-549ed95535fa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:29.108284 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3571/7105] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:29.121115 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3535/7106] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:13:29.125808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2cafb-9da7-4ee0-8ef1-baeb3782024a service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:29.141262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2cafb-9da7-4ee0-8ef1-baeb3782024a service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:29.147940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2a9cb-394a-4de5-9106-c0238352b14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:29.149859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2a9cb-394a-4de5-9106-c0238352b14c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:29.150345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2a9cb-394a-4de5-9106-c0238352b14c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:29.150880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2a9cb-394a-4de5-9106-c0238352b14c admin admin] PATH_INFO: `/v3/projects/cc6fb92c4f424aea8267c3a21b3d6cc1/users/d28f4446a2d34d50b6ad5d3ea85cba70/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:29.193683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2a9cb-394a-4de5-9106-c0238352b14c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6fb92c4f424aea8267c3a21b3d6cc1, user_id=d28f4446a2d34d50b6ad5d3ea85cba70, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:29.197791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2a9cb-394a-4de5-9106-c0238352b14c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:29.234735 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3572/7107] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:29 2022] PUT /identity/v3/projects/cc6fb92c4f424aea8267c3a21b3d6cc1/users/d28f4446a2d34d50b6ad5d3ea85cba70/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:29.245034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f670f-a693-430d-be1c-1831873e255a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:29.245838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f670f-a693-430d-be1c-1831873e255a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:29.246333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f670f-a693-430d-be1c-1831873e255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:29.291031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-412f670f-a693-430d-be1c-1831873e255a None None] MFA Rules not processed for user `d28f4446a2d34d50b6ad5d3ea85cba70`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:29.292636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-412f670f-a693-430d-be1c-1831873e255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:29.380249 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3536/7108] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:29.400382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2a9cb-394a-4de5-9106-c0238352b14c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:29.403180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-58d2a9cb-394a-4de5-9106-c0238352b14c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:29.506266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2a9cb-394a-4de5-9106-c0238352b14c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:29.523048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35499d6-3e72-4ed8-9bf2-c173f13799c9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:29.524462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35499d6-3e72-4ed8-9bf2-c173f13799c9 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:29.525837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35499d6-3e72-4ed8-9bf2-c173f13799c9 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:29.527376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35499d6-3e72-4ed8-9bf2-c173f13799c9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:29.560115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35499d6-3e72-4ed8-9bf2-c173f13799c9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:29.565987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35499d6-3e72-4ed8-9bf2-c173f13799c9 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:29.610810 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3573/7109] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:29.712535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f670f-a693-430d-be1c-1831873e255a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:29.714174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-412f670f-a693-430d-be1c-1831873e255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:29.888716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f670f-a693-430d-be1c-1831873e255a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:29.900155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:29.902162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:29.902772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:29.903594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] PATH_INFO: `/v3/projects/0386f864b38b404f8fa94d7578c95c16` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:29.906840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=0386f864b38b404f8fa94d7578c95c16)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:29.909961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:30.037712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0386f864b38b404f8fa94d7578c95c16', 'request_id': 'req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:30.050027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0386f864b38b404f8fa94d7578c95c16', 'request_id': 'req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:30.061787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0386f864b38b404f8fa94d7578c95c16', 'request_id': 'req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:30.087604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] The token cache is being invalidate because project 0386f864b38b404f8fa94d7578c95c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:30.087968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:30.088832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4e1ba30-92c3-46bb-a95a-ff49324c6eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:30.090483 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3537/7110] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:29 2022] DELETE /identity/v3/projects/0386f864b38b404f8fa94d7578c95c16 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:30.096355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36881e-81cb-46ef-9d8d-5bd33b8964a5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:30.097447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36881e-81cb-46ef-9d8d-5bd33b8964a5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:30.097910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36881e-81cb-46ef-9d8d-5bd33b8964a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:30.150210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1b36881e-81cb-46ef-9d8d-5bd33b8964a5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:30.151612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b36881e-81cb-46ef-9d8d-5bd33b8964a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:30.315842 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3574/7111] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:30.319292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1336e7-b2a5-4a9a-81f5-3a9200bd40df None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:30.320288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1336e7-b2a5-4a9a-81f5-3a9200bd40df None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:30.321500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1336e7-b2a5-4a9a-81f5-3a9200bd40df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:30.361121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0a1336e7-b2a5-4a9a-81f5-3a9200bd40df None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:30.363599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0a1336e7-b2a5-4a9a-81f5-3a9200bd40df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:30.397996 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3538/7112] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:30.402746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36881e-81cb-46ef-9d8d-5bd33b8964a5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:30.417262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36881e-81cb-46ef-9d8d-5bd33b8964a5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:30.430888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86b62-ac87-44b1-8657-6c4e4fcb966f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:30.431630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86b62-ac87-44b1-8657-6c4e4fcb966f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:30.431987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86b62-ac87-44b1-8657-6c4e4fcb966f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:30.432615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd86b62-ac87-44b1-8657-6c4e4fcb966f admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:30.434683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86b62-ac87-44b1-8657-6c4e4fcb966f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:13:30.435064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86b62-ac87-44b1-8657-6c4e4fcb966f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:30.436850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd86b62-ac87-44b1-8657-6c4e4fcb966f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:30.471800 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3575/7113] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:13:30.472736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1336e7-b2a5-4a9a-81f5-3a9200bd40df None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:30.484847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1336e7-b2a5-4a9a-81f5-3a9200bd40df None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:30.492919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e682a7a-7bb6-45f4-b6af-c4b54454eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:30.495538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682a7a-7bb6-45f4-b6af-c4b54454eea3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:30.496322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682a7a-7bb6-45f4-b6af-c4b54454eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:30.497356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e682a7a-7bb6-45f4-b6af-c4b54454eea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:30.498798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e682a7a-7bb6-45f4-b6af-c4b54454eea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:30.501408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e682a7a-7bb6-45f4-b6af-c4b54454eea3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:30.562558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86b62-ac87-44b1-8657-6c4e4fcb966f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:30.569632 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3539/7114] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:13:30 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:30.574412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd86b62-ac87-44b1-8657-6c4e4fcb966f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:30.674359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c4f74-8d82-4e43-b7a5-17851198a771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:30.675456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c4f74-8d82-4e43-b7a5-17851198a771 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:30.675456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c4f74-8d82-4e43-b7a5-17851198a771 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:30.675678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c4f74-8d82-4e43-b7a5-17851198a771 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:30.676298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c4f74-8d82-4e43-b7a5-17851198a771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:30.680915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c4f74-8d82-4e43-b7a5-17851198a771 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:30.717558 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3576/7115] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:13:30 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:30.722105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e682a7a-7bb6-45f4-b6af-c4b54454eea3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:30.738256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e682a7a-7bb6-45f4-b6af-c4b54454eea3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:30.746952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5d1e3-fd7d-4206-b6ca-5071f2cd85c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:30.748111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5d1e3-fd7d-4206-b6ca-5071f2cd85c2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:30.749161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5d1e3-fd7d-4206-b6ca-5071f2cd85c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:30.749662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5d1e3-fd7d-4206-b6ca-5071f2cd85c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:30.750845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5d1e3-fd7d-4206-b6ca-5071f2cd85c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:30.754156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5d1e3-fd7d-4206-b6ca-5071f2cd85c2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:30.774906 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3540/7116] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:30.781871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c4f74-8d82-4e43-b7a5-17851198a771 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:30.794280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c4f74-8d82-4e43-b7a5-17851198a771 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:30.801878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd57c6-bc09-4154-b1c0-e9b8b57ad7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:30.802580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd57c6-bc09-4154-b1c0-e9b8b57ad7ca admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:30.802870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd57c6-bc09-4154-b1c0-e9b8b57ad7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:30.803270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd57c6-bc09-4154-b1c0-e9b8b57ad7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:30.806822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd57c6-bc09-4154-b1c0-e9b8b57ad7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:30.808936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd57c6-bc09-4154-b1c0-e9b8b57ad7ca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:30.826146 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3577/7117] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:30.828735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5d1e3-fd7d-4206-b6ca-5071f2cd85c2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:30.864054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5d1e3-fd7d-4206-b6ca-5071f2cd85c2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:30.876949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcff92c-3189-4286-843f-a40fa9cca6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:30.878302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcff92c-3189-4286-843f-a40fa9cca6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:30.878811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcff92c-3189-4286-843f-a40fa9cca6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:30.879324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcff92c-3189-4286-843f-a40fa9cca6ff admin admin] PATH_INFO: `/v3/projects/3e41821346ff4549a92ebf31d3e5de7b/users/cf6fe4ee769a4e52b3fa27fbff98b59c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:30.905074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcff92c-3189-4286-843f-a40fa9cca6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e41821346ff4549a92ebf31d3e5de7b, user_id=cf6fe4ee769a4e52b3fa27fbff98b59c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:30.910425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcff92c-3189-4286-843f-a40fa9cca6ff admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:30.933769 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3541/7118] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:30 2022] PUT /identity/v3/projects/3e41821346ff4549a92ebf31d3e5de7b/users/cf6fe4ee769a4e52b3fa27fbff98b59c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:30.949440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa37501-cbb9-4ee4-b5c8-1eed0313c7e4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:30.951172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa37501-cbb9-4ee4-b5c8-1eed0313c7e4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:30.951853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa37501-cbb9-4ee4-b5c8-1eed0313c7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:31.052224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4aa37501-cbb9-4ee4-b5c8-1eed0313c7e4 None None] MFA Rules not processed for user `cf6fe4ee769a4e52b3fa27fbff98b59c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:31.054403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4aa37501-cbb9-4ee4-b5c8-1eed0313c7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:31.208387 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3578/7119] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:31.221776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcff92c-3189-4286-843f-a40fa9cca6ff admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:31.224511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8fcff92c-3189-4286-843f-a40fa9cca6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:31.349826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcff92c-3189-4286-843f-a40fa9cca6ff admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:31.362681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc7a4e9-daf6-42b4-8c99-b2ceda1adbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:31.363522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7a4e9-daf6-42b4-8c99-b2ceda1adbaf service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:31.364116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7a4e9-daf6-42b4-8c99-b2ceda1adbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:31.364494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7a4e9-daf6-42b4-8c99-b2ceda1adbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:31.391805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7a4e9-daf6-42b4-8c99-b2ceda1adbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:31.394894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc7a4e9-daf6-42b4-8c99-b2ceda1adbaf service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:31.419735 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3542/7120] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:35.410887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa37501-cbb9-4ee4-b5c8-1eed0313c7e4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:35.413307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4aa37501-cbb9-4ee4-b5c8-1eed0313c7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:35.550579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa37501-cbb9-4ee4-b5c8-1eed0313c7e4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:35.566200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:35.567096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:35.567365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:35.567635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] PATH_INFO: `/v3/users/d28f4446a2d34d50b6ad5d3ea85cba70` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:35.569012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28f4446a2d34d50b6ad5d3ea85cba70)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:35.571231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:35.657930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28f4446a2d34d50b6ad5d3ea85cba70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:35.672656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28f4446a2d34d50b6ad5d3ea85cba70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:35.673527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28f4446a2d34d50b6ad5d3ea85cba70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:35.675646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28f4446a2d34d50b6ad5d3ea85cba70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:35.688206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28f4446a2d34d50b6ad5d3ea85cba70'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:35.716551 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3579/7121] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:35 2022] DELETE /identity/v3/users/d28f4446a2d34d50b6ad5d3ea85cba70 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:35.721355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10679159-d746-42c8-b9b6-701136904597 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:35.721852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10679159-d746-42c8-b9b6-701136904597 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:35.721852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10679159-d746-42c8-b9b6-701136904597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:35.740679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-10679159-d746-42c8-b9b6-701136904597 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:35.742199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-10679159-d746-42c8-b9b6-701136904597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:35.845579 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3543/7122] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:35.888134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:35.890265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:35.984307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a39ca-1724-47d3-9233-53bbc2bf43d9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:35.990434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830f2b3-6470-4a98-8ae3-fdc2383f06fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:35.991243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830f2b3-6470-4a98-8ae3-fdc2383f06fb service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:35.992529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830f2b3-6470-4a98-8ae3-fdc2383f06fb service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:35.992898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830f2b3-6470-4a98-8ae3-fdc2383f06fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:36.005072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830f2b3-6470-4a98-8ae3-fdc2383f06fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:36.012876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830f2b3-6470-4a98-8ae3-fdc2383f06fb service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:36.034811 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3580/7123] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:37.592863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10679159-d746-42c8-b9b6-701136904597 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:37.595143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-10679159-d746-42c8-b9b6-701136904597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:37.618904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10679159-d746-42c8-b9b6-701136904597 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:37.633843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:37.635244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:37.635789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:37.637750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] PATH_INFO: `/v3/projects/cc6fb92c4f424aea8267c3a21b3d6cc1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:37.639385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc6fb92c4f424aea8267c3a21b3d6cc1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:37.648372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:37.738722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc6fb92c4f424aea8267c3a21b3d6cc1', 'request_id': 'req-0770e96e-29e1-4138-aba6-39f280e82b75'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:37.768857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc6fb92c4f424aea8267c3a21b3d6cc1', 'request_id': 'req-0770e96e-29e1-4138-aba6-39f280e82b75'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:37.780290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc6fb92c4f424aea8267c3a21b3d6cc1', 'request_id': 'req-0770e96e-29e1-4138-aba6-39f280e82b75'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:37.804633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] The token cache is being invalidate because project cc6fb92c4f424aea8267c3a21b3d6cc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:37.804943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:37.814946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0770e96e-29e1-4138-aba6-39f280e82b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:37.817306 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3544/7124] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:37 2022] DELETE /identity/v3/projects/cc6fb92c4f424aea8267c3a21b3d6cc1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:37.822561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9720532-ff81-40a2-87c8-67dd95259026 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:37.823438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9720532-ff81-40a2-87c8-67dd95259026 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:37.824130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9720532-ff81-40a2-87c8-67dd95259026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:37.861429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f9720532-ff81-40a2-87c8-67dd95259026 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:37.870949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f9720532-ff81-40a2-87c8-67dd95259026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:38.023902 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3581/7125] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:38.033772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0125f13-ceb3-407e-b849-28763b2d07ad None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:38.034406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0125f13-ceb3-407e-b849-28763b2d07ad None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:38.034969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0125f13-ceb3-407e-b849-28763b2d07ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:38.077248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d0125f13-ceb3-407e-b849-28763b2d07ad None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:38.083692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d0125f13-ceb3-407e-b849-28763b2d07ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:38.148341 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3545/7126] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:38.151811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9720532-ff81-40a2-87c8-67dd95259026 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:38.176050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9720532-ff81-40a2-87c8-67dd95259026 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:38.204135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709ed44-42d7-4cc6-98ba-d9bead10ac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:38.205530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709ed44-42d7-4cc6-98ba-d9bead10ac7b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:38.222530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709ed44-42d7-4cc6-98ba-d9bead10ac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:38.227146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3709ed44-42d7-4cc6-98ba-d9bead10ac7b admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:38.230137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709ed44-42d7-4cc6-98ba-d9bead10ac7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:13:38.238239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709ed44-42d7-4cc6-98ba-d9bead10ac7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:38.246675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3709ed44-42d7-4cc6-98ba-d9bead10ac7b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:38.301381 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3582/7127] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:13:38.302550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0125f13-ceb3-407e-b849-28763b2d07ad None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:38.319965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0125f13-ceb3-407e-b849-28763b2d07ad None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:38.338511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821bc2-ef9c-43ab-93f6-f73b35a4045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:38.339165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821bc2-ef9c-43ab-93f6-f73b35a4045f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:38.339274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821bc2-ef9c-43ab-93f6-f73b35a4045f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:38.339555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821bc2-ef9c-43ab-93f6-f73b35a4045f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:38.342539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42821bc2-ef9c-43ab-93f6-f73b35a4045f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:38.348004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42821bc2-ef9c-43ab-93f6-f73b35a4045f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:38.419302 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3546/7128] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:13:38 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:38.423211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709ed44-42d7-4cc6-98ba-d9bead10ac7b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:38.436450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3709ed44-42d7-4cc6-98ba-d9bead10ac7b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:38.560651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ab2a8-51e9-404f-868b-0d4467132440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:38.561488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ab2a8-51e9-404f-868b-0d4467132440 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:38.561882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ab2a8-51e9-404f-868b-0d4467132440 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:38.562236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ab2a8-51e9-404f-868b-0d4467132440 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:38.563068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ab2a8-51e9-404f-868b-0d4467132440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:38.568701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ab2a8-51e9-404f-868b-0d4467132440 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:38.624653 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3583/7129] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:13:38 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:38.626710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821bc2-ef9c-43ab-93f6-f73b35a4045f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:38.645632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821bc2-ef9c-43ab-93f6-f73b35a4045f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:38.677618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ab751-606a-4ef9-a958-d0f4e51179d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:38.679219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ab751-606a-4ef9-a958-d0f4e51179d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:38.685623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ab751-606a-4ef9-a958-d0f4e51179d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:38.686002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ab751-606a-4ef9-a958-d0f4e51179d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:38.686872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ab751-606a-4ef9-a958-d0f4e51179d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:38.689502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ab751-606a-4ef9-a958-d0f4e51179d4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:38.719772 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3547/7130] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:38.720770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ab2a8-51e9-404f-868b-0d4467132440 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:38.744915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ab2a8-51e9-404f-868b-0d4467132440 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:38.764503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f02e5-29d9-4cc2-9872-bba54146e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:38.765780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f02e5-29d9-4cc2-9872-bba54146e2af admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:38.767442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f02e5-29d9-4cc2-9872-bba54146e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:38.768846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f02e5-29d9-4cc2-9872-bba54146e2af admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:38.770466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f02e5-29d9-4cc2-9872-bba54146e2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:38.798197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f02e5-29d9-4cc2-9872-bba54146e2af admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:38.835514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ab751-606a-4ef9-a958-d0f4e51179d4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:38.857829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ab751-606a-4ef9-a958-d0f4e51179d4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:38.863612 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3584/7131] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:38.873736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98480db8-0901-4051-848b-7323d9d6e12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:38.874869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98480db8-0901-4051-848b-7323d9d6e12e admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:38.875257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98480db8-0901-4051-848b-7323d9d6e12e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:38.876079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98480db8-0901-4051-848b-7323d9d6e12e admin admin] PATH_INFO: `/v3/projects/15f1a08fcf2d470c85a370f1f111dcd1/users/8ec9bbf6ebb34979a3a9115bdd829150/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:38.914970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98480db8-0901-4051-848b-7323d9d6e12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f1a08fcf2d470c85a370f1f111dcd1, user_id=8ec9bbf6ebb34979a3a9115bdd829150, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:38.918590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98480db8-0901-4051-848b-7323d9d6e12e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:38.955007 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3548/7132] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:38 2022] PUT /identity/v3/projects/15f1a08fcf2d470c85a370f1f111dcd1/users/8ec9bbf6ebb34979a3a9115bdd829150/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:38.968498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1dc91-607f-48e8-8362-c4847cc4cbb5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:38.968839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1dc91-607f-48e8-8362-c4847cc4cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:38.969175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1dc91-607f-48e8-8362-c4847cc4cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:39.041592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0cb1dc91-607f-48e8-8362-c4847cc4cbb5 None None] MFA Rules not processed for user `8ec9bbf6ebb34979a3a9115bdd829150`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:39.056739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0cb1dc91-607f-48e8-8362-c4847cc4cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:39.144573 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3585/7133] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:39.162000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98480db8-0901-4051-848b-7323d9d6e12e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:39.166044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-98480db8-0901-4051-848b-7323d9d6e12e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:39.371907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98480db8-0901-4051-848b-7323d9d6e12e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:39.377010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2f76a-84ed-4f5f-a301-ec9a45ff677a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:39.377822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f76a-84ed-4f5f-a301-ec9a45ff677a service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:39.378115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f76a-84ed-4f5f-a301-ec9a45ff677a service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:39.378397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f76a-84ed-4f5f-a301-ec9a45ff677a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:39.391957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2f76a-84ed-4f5f-a301-ec9a45ff677a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:39.398206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2f76a-84ed-4f5f-a301-ec9a45ff677a service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:39.415595 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3549/7134] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:44.762356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5eab5c-9ea8-4863-bd0f-78a654508c13 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:44.762793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5eab5c-9ea8-4863-bd0f-78a654508c13 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:44.763108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5eab5c-9ea8-4863-bd0f-78a654508c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:44.796392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1b5eab5c-9ea8-4863-bd0f-78a654508c13 None None] MFA Rules not processed for user `41ad4fbc224446efaf5ad85c8c87eeab`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:44.797878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b5eab5c-9ea8-4863-bd0f-78a654508c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:44.919367 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3586/7135] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:13:45.412072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2f76a-84ed-4f5f-a301-ec9a45ff677a service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:45.527746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2f76a-84ed-4f5f-a301-ec9a45ff677a service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:45.535355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:45.536673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:45.537208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:45.537719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] PATH_INFO: `/v3/users/8ec9bbf6ebb34979a3a9115bdd829150` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:45.539330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec9bbf6ebb34979a3a9115bdd829150)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:45.542679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:45.650315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec9bbf6ebb34979a3a9115bdd829150'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:45.679757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec9bbf6ebb34979a3a9115bdd829150'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:45.680427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec9bbf6ebb34979a3a9115bdd829150'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:45.681295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec9bbf6ebb34979a3a9115bdd829150'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:45.707165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec9bbf6ebb34979a3a9115bdd829150'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:45.748629 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3550/7136] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:45 2022] DELETE /identity/v3/users/8ec9bbf6ebb34979a3a9115bdd829150 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:45.750333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9a66-84f4-458d-b75a-2c6012ca4334 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:45.750622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9a66-84f4-458d-b75a-2c6012ca4334 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:45.750952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb9a66-84f4-458d-b75a-2c6012ca4334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:45.769778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ddcb9a66-84f4-458d-b75a-2c6012ca4334 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:45.771803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ddcb9a66-84f4-458d-b75a-2c6012ca4334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:45.909450 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3587/7137] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:45.925543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:45.928209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:46.039021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d414b2-cabe-4d2b-856b-c82be3b9fda9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:46.046001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ed9f3-76e8-490b-815b-8cdaeabc5fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:46.047150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ed9f3-76e8-490b-815b-8cdaeabc5fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:46.047594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ed9f3-76e8-490b-815b-8cdaeabc5fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:46.048071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ed9f3-76e8-490b-815b-8cdaeabc5fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:46.061983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ed9f3-76e8-490b-815b-8cdaeabc5fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:46.063877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ed9f3-76e8-490b-815b-8cdaeabc5fa8 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:46.080536 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3551/7138] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:13:47.267307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb9a66-84f4-458d-b75a-2c6012ca4334 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:47.268835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ddcb9a66-84f4-458d-b75a-2c6012ca4334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:47.300587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb9a66-84f4-458d-b75a-2c6012ca4334 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:47.307709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:47.308621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:47.308894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:47.309166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] PATH_INFO: `/v3/projects/15f1a08fcf2d470c85a370f1f111dcd1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:47.310599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f1a08fcf2d470c85a370f1f111dcd1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:47.312750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:47.415715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f1a08fcf2d470c85a370f1f111dcd1', 'request_id': 'req-1763f728-7dd8-4132-b2e5-7bc227c98aa3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:47.441437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f1a08fcf2d470c85a370f1f111dcd1', 'request_id': 'req-1763f728-7dd8-4132-b2e5-7bc227c98aa3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:47.450467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f1a08fcf2d470c85a370f1f111dcd1', 'request_id': 'req-1763f728-7dd8-4132-b2e5-7bc227c98aa3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:47.487630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] The token cache is being invalidate because project 15f1a08fcf2d470c85a370f1f111dcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:47.488293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:47.492995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1763f728-7dd8-4132-b2e5-7bc227c98aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:47.496268 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3588/7139] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:47 2022] DELETE /identity/v3/projects/15f1a08fcf2d470c85a370f1f111dcd1 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:58.123711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ed9f3-76e8-490b-815b-8cdaeabc5fa8 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:58.129487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fd8ed9f3-76e8-490b-815b-8cdaeabc5fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:58.150489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ed9f3-76e8-490b-815b-8cdaeabc5fa8 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:58.220228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:58.221132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:58.221614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:58.221896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] PATH_INFO: `/v3/users/cf6fe4ee769a4e52b3fa27fbff98b59c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:58.223872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf6fe4ee769a4e52b3fa27fbff98b59c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:58.226691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:58.281495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf6fe4ee769a4e52b3fa27fbff98b59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:58.290779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf6fe4ee769a4e52b3fa27fbff98b59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:58.292676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf6fe4ee769a4e52b3fa27fbff98b59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:58.293590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf6fe4ee769a4e52b3fa27fbff98b59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:58.308251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf6fe4ee769a4e52b3fa27fbff98b59c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:58.323653 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3552/7140] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:13:58 2022] DELETE /identity/v3/users/cf6fe4ee769a4e52b3fa27fbff98b59c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:58.328925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b429d-d523-4a92-a646-22f657606e9b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:58.329813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b429d-d523-4a92-a646-22f657606e9b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:58.330144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b429d-d523-4a92-a646-22f657606e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:58.356653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d73b429d-d523-4a92-a646-22f657606e9b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:58.358087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d73b429d-d523-4a92-a646-22f657606e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:58.443213 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3589/7141] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:13:58.450367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:58.452017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:58.539616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a1bd4-e81b-4e07-8745-1bae41ea77d1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:58.543568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d45013-ae36-43a7-80e1-8504b61a9010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:58.544328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d45013-ae36-43a7-80e1-8504b61a9010 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:58.544679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d45013-ae36-43a7-80e1-8504b61a9010 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:58.545027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d45013-ae36-43a7-80e1-8504b61a9010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:58.563105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d45013-ae36-43a7-80e1-8504b61a9010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:58.565706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d45013-ae36-43a7-80e1-8504b61a9010 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:58.582077 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3553/7142] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:13:58.849151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b429d-d523-4a92-a646-22f657606e9b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:58.851185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d73b429d-d523-4a92-a646-22f657606e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:58.866344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b429d-d523-4a92-a646-22f657606e9b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:58.872176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:58.874131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:58.879086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:58.879491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] PATH_INFO: `/v3/projects/3e41821346ff4549a92ebf31d3e5de7b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:58.888145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e41821346ff4549a92ebf31d3e5de7b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:58.890827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:58.953776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e41821346ff4549a92ebf31d3e5de7b', 'request_id': 'req-eb46a063-1986-49f1-a834-32c790de30de'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:58.964824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e41821346ff4549a92ebf31d3e5de7b', 'request_id': 'req-eb46a063-1986-49f1-a834-32c790de30de'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:58.991462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e41821346ff4549a92ebf31d3e5de7b', 'request_id': 'req-eb46a063-1986-49f1-a834-32c790de30de'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:59.010718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] The token cache is being invalidate because project 3e41821346ff4549a92ebf31d3e5de7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:13:59.011005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:59.011666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-eb46a063-1986-49f1-a834-32c790de30de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:13:59.013513 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3590/7143] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:13:58 2022] DELETE /identity/v3/projects/3e41821346ff4549a92ebf31d3e5de7b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:59.018442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db6ab0-38d0-4f57-9080-0ae2db514c13 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.018816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db6ab0-38d0-4f57-9080-0ae2db514c13 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.019173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db6ab0-38d0-4f57-9080-0ae2db514c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.049845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-07db6ab0-38d0-4f57-9080-0ae2db514c13 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:59.052770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-07db6ab0-38d0-4f57-9080-0ae2db514c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:59.149926 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3554/7144] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:59.158933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9f30-7a7e-4cad-81cf-f7aef9fd5db0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.159474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9f30-7a7e-4cad-81cf-f7aef9fd5db0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.159797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc9f30-7a7e-4cad-81cf-f7aef9fd5db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.195947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6ecc9f30-7a7e-4cad-81cf-f7aef9fd5db0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:59.197266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6ecc9f30-7a7e-4cad-81cf-f7aef9fd5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:59.206303 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3591/7145] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:59.210607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db6ab0-38d0-4f57-9080-0ae2db514c13 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:59.225105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db6ab0-38d0-4f57-9080-0ae2db514c13 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:59.230994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea06d1-9f66-43b7-ac76-14a42a1ef3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:59.232012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea06d1-9f66-43b7-ac76-14a42a1ef3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.232569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea06d1-9f66-43b7-ac76-14a42a1ef3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.233070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea06d1-9f66-43b7-ac76-14a42a1ef3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.234568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea06d1-9f66-43b7-ac76-14a42a1ef3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:13:59.235372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea06d1-9f66-43b7-ac76-14a42a1ef3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:59.237583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea06d1-9f66-43b7-ac76-14a42a1ef3a4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:59.253468 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3555/7146] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:13:59.257880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc9f30-7a7e-4cad-81cf-f7aef9fd5db0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:59.268479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc9f30-7a7e-4cad-81cf-f7aef9fd5db0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:59.275958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c87484-eff7-4070-ab47-67b14b0f9ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:59.276764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87484-eff7-4070-ab47-67b14b0f9ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.277241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87484-eff7-4070-ab47-67b14b0f9ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.277693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87484-eff7-4070-ab47-67b14b0f9ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.278594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c87484-eff7-4070-ab47-67b14b0f9ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:59.280756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c87484-eff7-4070-ab47-67b14b0f9ab3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:59.324734 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3592/7147] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:13:59 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:59.329645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea06d1-9f66-43b7-ac76-14a42a1ef3a4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:59.344042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea06d1-9f66-43b7-ac76-14a42a1ef3a4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:59.422863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d92f9-a44a-403d-8499-9e8cb4250398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:59.424001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d92f9-a44a-403d-8499-9e8cb4250398 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.424746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d92f9-a44a-403d-8499-9e8cb4250398 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.425893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d92f9-a44a-403d-8499-9e8cb4250398 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.426817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d92f9-a44a-403d-8499-9e8cb4250398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:59.431033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d92f9-a44a-403d-8499-9e8cb4250398 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:59.466758 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3556/7148] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:13:59 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:13:59.471731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c87484-eff7-4070-ab47-67b14b0f9ab3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:59.488037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c87484-eff7-4070-ab47-67b14b0f9ab3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:59.493264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f4349-de25-40f5-9f80-18e613382a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:59.494253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f4349-de25-40f5-9f80-18e613382a7a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.494612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f4349-de25-40f5-9f80-18e613382a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.494957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f4349-de25-40f5-9f80-18e613382a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.495750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f4349-de25-40f5-9f80-18e613382a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:59.497640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f4349-de25-40f5-9f80-18e613382a7a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:59.508990 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3593/7149] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:13:59.512918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d92f9-a44a-403d-8499-9e8cb4250398 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:59.529277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d92f9-a44a-403d-8499-9e8cb4250398 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:59.535419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ab680-6f73-4406-a130-20c27a2b833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:59.537156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ab680-6f73-4406-a130-20c27a2b833c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.537647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ab680-6f73-4406-a130-20c27a2b833c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.537920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ab680-6f73-4406-a130-20c27a2b833c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.538656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ab680-6f73-4406-a130-20c27a2b833c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:59.540348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ab680-6f73-4406-a130-20c27a2b833c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:59.555419 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3557/7150] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:13:59.556864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f4349-de25-40f5-9f80-18e613382a7a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:59.568620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f4349-de25-40f5-9f80-18e613382a7a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:59.578972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c504-9c2e-4e6b-95ad-1e422cbf9f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:59.580012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c504-9c2e-4e6b-95ad-1e422cbf9f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.580536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c504-9c2e-4e6b-95ad-1e422cbf9f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.581052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94c504-9c2e-4e6b-95ad-1e422cbf9f98 admin admin] PATH_INFO: `/v3/projects/e5defb9a45bd466696c7cc3869dc61be/users/81e99de255c0475ea107ca298a83bda4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.597617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c504-9c2e-4e6b-95ad-1e422cbf9f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5defb9a45bd466696c7cc3869dc61be, user_id=81e99de255c0475ea107ca298a83bda4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:59.601060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94c504-9c2e-4e6b-95ad-1e422cbf9f98 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:59.624241 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3594/7151] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:13:59 2022] PUT /identity/v3/projects/e5defb9a45bd466696c7cc3869dc61be/users/81e99de255c0475ea107ca298a83bda4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:13:59.631545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4bb94-591b-4d6e-87d0-565364806c89 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.631770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4bb94-591b-4d6e-87d0-565364806c89 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.636303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc4bb94-591b-4d6e-87d0-565364806c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.678640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7fc4bb94-591b-4d6e-87d0-565364806c89 None None] MFA Rules not processed for user `81e99de255c0475ea107ca298a83bda4`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:13:59.680505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7fc4bb94-591b-4d6e-87d0-565364806c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:59.774995 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3558/7152] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:13:59.788673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c504-9c2e-4e6b-95ad-1e422cbf9f98 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:13:59.790504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aa94c504-9c2e-4e6b-95ad-1e422cbf9f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:13:59.861352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94c504-9c2e-4e6b-95ad-1e422cbf9f98 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:13:59.866419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5a798-35ab-4e58-b5c1-71d0a0d5f9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:13:59.870941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5a798-35ab-4e58-b5c1-71d0a0d5f9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:13:59.870941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5a798-35ab-4e58-b5c1-71d0a0d5f9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:13:59.871688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5a798-35ab-4e58-b5c1-71d0a0d5f9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:13:59.884290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5a798-35ab-4e58-b5c1-71d0a0d5f9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:13:59.887518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5a798-35ab-4e58-b5c1-71d0a0d5f9e5 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:13:59.910063 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3595/7153] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:13:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:08.889503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4bb94-591b-4d6e-87d0-565364806c89 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:08.961763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc4bb94-591b-4d6e-87d0-565364806c89 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:08.967263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:08.968182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:08.968458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:08.968732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] PATH_INFO: `/v3/users/81e99de255c0475ea107ca298a83bda4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:08.969956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e99de255c0475ea107ca298a83bda4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:08.971977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:09.026669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e99de255c0475ea107ca298a83bda4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:09.034503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e99de255c0475ea107ca298a83bda4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:09.035342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e99de255c0475ea107ca298a83bda4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:09.036087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e99de255c0475ea107ca298a83bda4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:09.052357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e99de255c0475ea107ca298a83bda4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:09.071841 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3559/7154] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:08 2022] DELETE /identity/v3/users/81e99de255c0475ea107ca298a83bda4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:09.073374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb8997-145e-4486-b184-2a19348cd324 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:09.074377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb8997-145e-4486-b184-2a19348cd324 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:09.074936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb8997-145e-4486-b184-2a19348cd324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:09.096509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-61bb8997-145e-4486-b184-2a19348cd324 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:09.098120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-61bb8997-145e-4486-b184-2a19348cd324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:09.183138 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3596/7155] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:14:09.197551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:09.199098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:09.266287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91019c-ee44-4ccb-adeb-3b6aa3f866d2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:09.271279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0b09b-e771-4b17-b642-631505443d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:09.271644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0b09b-e771-4b17-b642-631505443d0d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:09.272308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0b09b-e771-4b17-b642-631505443d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:09.273346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0b09b-e771-4b17-b642-631505443d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:09.287214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0b09b-e771-4b17-b642-631505443d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:09.290749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0b09b-e771-4b17-b642-631505443d0d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:09.308242 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3560/7156] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:09.862566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb8997-145e-4486-b184-2a19348cd324 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:09.864319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-61bb8997-145e-4486-b184-2a19348cd324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:09.890297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb8997-145e-4486-b184-2a19348cd324 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:09.901719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:09.902766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:09.903239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:09.903703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] PATH_INFO: `/v3/projects/e5defb9a45bd466696c7cc3869dc61be` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:09.908822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5defb9a45bd466696c7cc3869dc61be)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:09.911598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:10.023779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5defb9a45bd466696c7cc3869dc61be', 'request_id': 'req-b7879f56-3140-4f8c-9ff6-1211c070f222'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:10.038349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5defb9a45bd466696c7cc3869dc61be', 'request_id': 'req-b7879f56-3140-4f8c-9ff6-1211c070f222'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:10.050345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5defb9a45bd466696c7cc3869dc61be', 'request_id': 'req-b7879f56-3140-4f8c-9ff6-1211c070f222'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:10.068808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] The token cache is being invalidate because project e5defb9a45bd466696c7cc3869dc61be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:10.070050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:10.070916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7879f56-3140-4f8c-9ff6-1211c070f222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:10.079769 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3597/7157] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:09 2022] DELETE /identity/v3/projects/e5defb9a45bd466696c7cc3869dc61be => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:10.085952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cb848-c26c-4c06-9d8e-b5293e97e8f1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.086435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cb848-c26c-4c06-9d8e-b5293e97e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.086619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cb848-c26c-4c06-9d8e-b5293e97e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.111617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b11cb848-c26c-4c06-9d8e-b5293e97e8f1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:10.113152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b11cb848-c26c-4c06-9d8e-b5293e97e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:10.224386 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3561/7158] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:10.234175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b12ee-1fa6-4748-8029-40e91bbbb2ca None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.234777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b12ee-1fa6-4748-8029-40e91bbbb2ca None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.235246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b12ee-1fa6-4748-8029-40e91bbbb2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.276099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-432b12ee-1fa6-4748-8029-40e91bbbb2ca None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:10.281021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-432b12ee-1fa6-4748-8029-40e91bbbb2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:10.304012 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3598/7159] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:10.308416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cb848-c26c-4c06-9d8e-b5293e97e8f1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:10.321565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cb848-c26c-4c06-9d8e-b5293e97e8f1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:10.334684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dbce4-5e16-4b51-99b9-bed5cb1d01b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:10.335622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dbce4-5e16-4b51-99b9-bed5cb1d01b6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.336096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dbce4-5e16-4b51-99b9-bed5cb1d01b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.336529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dbce4-5e16-4b51-99b9-bed5cb1d01b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.337430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dbce4-5e16-4b51-99b9-bed5cb1d01b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:14:10.337959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dbce4-5e16-4b51-99b9-bed5cb1d01b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:10.340918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8dbce4-5e16-4b51-99b9-bed5cb1d01b6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:10.358502 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3562/7160] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:14:10.363295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b12ee-1fa6-4748-8029-40e91bbbb2ca None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:10.391550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b12ee-1fa6-4748-8029-40e91bbbb2ca None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:10.404859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46d1cb-8064-43f7-8a51-76582858eb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:10.406110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46d1cb-8064-43f7-8a51-76582858eb8e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.406569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46d1cb-8064-43f7-8a51-76582858eb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.407031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46d1cb-8064-43f7-8a51-76582858eb8e admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.408324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46d1cb-8064-43f7-8a51-76582858eb8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:10.414243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c46d1cb-8064-43f7-8a51-76582858eb8e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:10.459226 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3599/7161] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:14:10 2022] POST /identity/v3/projects => generated 351 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:14:10.462742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dbce4-5e16-4b51-99b9-bed5cb1d01b6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:10.478693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dbce4-5e16-4b51-99b9-bed5cb1d01b6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:10.604064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda00d1-313c-4e71-86e6-82f19a3c036d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:10.605032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda00d1-313c-4e71-86e6-82f19a3c036d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.605488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda00d1-313c-4e71-86e6-82f19a3c036d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.606219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda00d1-313c-4e71-86e6-82f19a3c036d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.607111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda00d1-313c-4e71-86e6-82f19a3c036d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:10.610156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda00d1-313c-4e71-86e6-82f19a3c036d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:10.682238 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3563/7162] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:14:10 2022] POST /identity/v3/users => generated 276 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:14:10.686530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46d1cb-8064-43f7-8a51-76582858eb8e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:10.708740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46d1cb-8064-43f7-8a51-76582858eb8e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:10.720261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1319ae-c28c-4b9a-a044-a5ef516a2a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:10.721009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1319ae-c28c-4b9a-a044-a5ef516a2a5b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.721212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1319ae-c28c-4b9a-a044-a5ef516a2a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.721498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1319ae-c28c-4b9a-a044-a5ef516a2a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.722224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1319ae-c28c-4b9a-a044-a5ef516a2a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:10.723905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1319ae-c28c-4b9a-a044-a5ef516a2a5b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:10.751651 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3600/7163] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:10.756071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda00d1-313c-4e71-86e6-82f19a3c036d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:10.772698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda00d1-313c-4e71-86e6-82f19a3c036d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:10.778471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a936a2-a90f-45b6-819c-6a40732a5aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:10.779517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a936a2-a90f-45b6-819c-6a40732a5aff admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.779995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a936a2-a90f-45b6-819c-6a40732a5aff admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.780367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a936a2-a90f-45b6-819c-6a40732a5aff admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.781212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a936a2-a90f-45b6-819c-6a40732a5aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:10.783225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a936a2-a90f-45b6-819c-6a40732a5aff admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:10.804280 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3564/7164] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:14:10.808881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1319ae-c28c-4b9a-a044-a5ef516a2a5b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:10.828020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1319ae-c28c-4b9a-a044-a5ef516a2a5b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:10.834382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf3162-8827-49e3-9917-a236bee502f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:10.835433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf3162-8827-49e3-9917-a236bee502f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.835812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf3162-8827-49e3-9917-a236bee502f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.836280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf3162-8827-49e3-9917-a236bee502f5 admin admin] PATH_INFO: `/v3/projects/ea049148b9a84f3eb2c8db293b84c0c5/users/de621b09985d404f978cfaf19d3a946c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.857625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf3162-8827-49e3-9917-a236bee502f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea049148b9a84f3eb2c8db293b84c0c5, user_id=de621b09985d404f978cfaf19d3a946c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:10.863285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf3162-8827-49e3-9917-a236bee502f5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:10.889730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b4bdb-cd76-4ade-b095-70c9a05670a7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.890616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b4bdb-cd76-4ade-b095-70c9a05670a7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.891365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b4bdb-cd76-4ade-b095-70c9a05670a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.901612 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3601/7165] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:10 2022] PUT /identity/v3/projects/ea049148b9a84f3eb2c8db293b84c0c5/users/de621b09985d404f978cfaf19d3a946c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:10.914074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62997c77-ff9d-4c58-b38b-a0142582211e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:10.914644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62997c77-ff9d-4c58-b38b-a0142582211e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:10.915085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62997c77-ff9d-4c58-b38b-a0142582211e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:10.921091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bd2b4bdb-cd76-4ade-b095-70c9a05670a7 None None] MFA Rules not processed for user `981e1bf6531f45c4b8911579995eecc0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:10.923080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bd2b4bdb-cd76-4ade-b095-70c9a05670a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:10.952309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-62997c77-ff9d-4c58-b38b-a0142582211e None None] MFA Rules not processed for user `de621b09985d404f978cfaf19d3a946c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:10.953618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-62997c77-ff9d-4c58-b38b-a0142582211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:11.024501 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3565/7166] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:11.095158 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3602/7167] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:10 2022] POST /identity/v3/auth/tokens => generated 3218 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:14:11.101350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b4bdb-cd76-4ade-b095-70c9a05670a7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:11.103347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bd2b4bdb-cd76-4ade-b095-70c9a05670a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:11.211610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b4bdb-cd76-4ade-b095-70c9a05670a7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:11.217199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d5c94-7c0b-4cc2-b4b9-d7d1a9857999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:11.218380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d5c94-7c0b-4cc2-b4b9-d7d1a9857999 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:11.219022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d5c94-7c0b-4cc2-b4b9-d7d1a9857999 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:11.219462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d5c94-7c0b-4cc2-b4b9-d7d1a9857999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:11.233452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d5c94-7c0b-4cc2-b4b9-d7d1a9857999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:11.235675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d5c94-7c0b-4cc2-b4b9-d7d1a9857999 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:11.254171 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3566/7168] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:11 2022] GET /identity/v3/auth/tokens => generated 3218 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:14:12.163002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62997c77-ff9d-4c58-b38b-a0142582211e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:12.165274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-62997c77-ff9d-4c58-b38b-a0142582211e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:12.187851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62997c77-ff9d-4c58-b38b-a0142582211e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:12.192474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce59cb-4803-4ecf-a7b8-48d11a07dffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:12.193523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce59cb-4803-4ecf-a7b8-48d11a07dffc service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:12.194177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce59cb-4803-4ecf-a7b8-48d11a07dffc service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:12.194902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce59cb-4803-4ecf-a7b8-48d11a07dffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:12.197355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-28ce59cb-4803-4ecf-a7b8-48d11a07dffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:12.297517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce59cb-4803-4ecf-a7b8-48d11a07dffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:12.299354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ce59cb-4803-4ecf-a7b8-48d11a07dffc service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:12.318313 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3603/7169] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:13.611707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d5c94-7c0b-4cc2-b4b9-d7d1a9857999 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:13.627897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d5c94-7c0b-4cc2-b4b9-d7d1a9857999 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:13.636126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c45f0-07ab-4422-aefe-22cb4f0a2979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:13.637333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c45f0-07ab-4422-aefe-22cb4f0a2979 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:13.637873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c45f0-07ab-4422-aefe-22cb4f0a2979 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:13.638768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c45f0-07ab-4422-aefe-22cb4f0a2979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:13.642962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e20c45f0-07ab-4422-aefe-22cb4f0a2979 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:13.667858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c45f0-07ab-4422-aefe-22cb4f0a2979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:13.670747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c45f0-07ab-4422-aefe-22cb4f0a2979 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:13.688793 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3567/7170] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:14:14.714462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce59cb-4803-4ecf-a7b8-48d11a07dffc service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:14.809036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce59cb-4803-4ecf-a7b8-48d11a07dffc service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:14.816290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:14.817595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:14.818125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:14.819105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] PATH_INFO: `/v3/users/de621b09985d404f978cfaf19d3a946c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:14.820581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de621b09985d404f978cfaf19d3a946c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:14.823168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:14.911308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de621b09985d404f978cfaf19d3a946c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:14.975824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de621b09985d404f978cfaf19d3a946c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:14.977027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de621b09985d404f978cfaf19d3a946c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:14.977820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de621b09985d404f978cfaf19d3a946c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:14.996611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de621b09985d404f978cfaf19d3a946c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:15.054138 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3604/7171] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:14 2022] DELETE /identity/v3/users/de621b09985d404f978cfaf19d3a946c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:15.055613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f54f0-cc77-4b2d-837f-4ea5c6f4d77d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:15.056135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f54f0-cc77-4b2d-837f-4ea5c6f4d77d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:15.056527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f54f0-cc77-4b2d-837f-4ea5c6f4d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:15.078973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-054f54f0-cc77-4b2d-837f-4ea5c6f4d77d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:15.091031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-054f54f0-cc77-4b2d-837f-4ea5c6f4d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:15.187634 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3568/7172] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:15.225948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:15.228020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:15.314889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa7328-d92c-4283-a7fd-00bc4b55fd61 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:15.322041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af004df-a29e-4f5b-90f8-4b517447ad4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:15.322710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af004df-a29e-4f5b-90f8-4b517447ad4b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:15.323001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af004df-a29e-4f5b-90f8-4b517447ad4b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:15.323283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af004df-a29e-4f5b-90f8-4b517447ad4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:15.341164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af004df-a29e-4f5b-90f8-4b517447ad4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:15.342640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af004df-a29e-4f5b-90f8-4b517447ad4b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:15.369692 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3605/7173] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:16.017134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f54f0-cc77-4b2d-837f-4ea5c6f4d77d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:16.027491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-054f54f0-cc77-4b2d-837f-4ea5c6f4d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:16.049409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f54f0-cc77-4b2d-837f-4ea5c6f4d77d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:16.061755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:16.062712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.063098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.063478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] PATH_INFO: `/v3/projects/ea049148b9a84f3eb2c8db293b84c0c5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.064890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea049148b9a84f3eb2c8db293b84c0c5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:16.068335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:16.155597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea049148b9a84f3eb2c8db293b84c0c5', 'request_id': 'req-e7a0bc47-4927-410a-851d-f8a7347c733a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:16.168726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea049148b9a84f3eb2c8db293b84c0c5', 'request_id': 'req-e7a0bc47-4927-410a-851d-f8a7347c733a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:16.175942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea049148b9a84f3eb2c8db293b84c0c5', 'request_id': 'req-e7a0bc47-4927-410a-851d-f8a7347c733a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:16.195549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] The token cache is being invalidate because project ea049148b9a84f3eb2c8db293b84c0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:16.195847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:16.197137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e7a0bc47-4927-410a-851d-f8a7347c733a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:16.199283 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3569/7174] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:16 2022] DELETE /identity/v3/projects/ea049148b9a84f3eb2c8db293b84c0c5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:16.204400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76cb86-8e10-46d0-aad0-7721385eb109 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.204925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76cb86-8e10-46d0-aad0-7721385eb109 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.205152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76cb86-8e10-46d0-aad0-7721385eb109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.238606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1e76cb86-8e10-46d0-aad0-7721385eb109 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:16.240197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1e76cb86-8e10-46d0-aad0-7721385eb109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:16.312012 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3606/7175] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:16.321307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdf25c-6b0f-4995-bbd1-421da82933ec None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.321829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdf25c-6b0f-4995-bbd1-421da82933ec None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.322564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdf25c-6b0f-4995-bbd1-421da82933ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.348163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d0fdf25c-6b0f-4995-bbd1-421da82933ec None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:16.356077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d0fdf25c-6b0f-4995-bbd1-421da82933ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:16.386737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76cb86-8e10-46d0-aad0-7721385eb109 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:16.386964 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3570/7176] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:16.395618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76cb86-8e10-46d0-aad0-7721385eb109 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:16.411770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b26f0d-e4c6-4719-aa00-1e11a61d15f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:16.413753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b26f0d-e4c6-4719-aa00-1e11a61d15f5 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.414627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b26f0d-e4c6-4719-aa00-1e11a61d15f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.416269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b26f0d-e4c6-4719-aa00-1e11a61d15f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.417245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b26f0d-e4c6-4719-aa00-1e11a61d15f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:14:16.418020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b26f0d-e4c6-4719-aa00-1e11a61d15f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:16.420100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b26f0d-e4c6-4719-aa00-1e11a61d15f5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:16.441135 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3607/7177] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:14:16.446802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdf25c-6b0f-4995-bbd1-421da82933ec None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:16.460082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdf25c-6b0f-4995-bbd1-421da82933ec None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:16.469467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41c480-548d-4d6d-abae-c0e8d48e2224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:16.470160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41c480-548d-4d6d-abae-c0e8d48e2224 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.470445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41c480-548d-4d6d-abae-c0e8d48e2224 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.470723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e41c480-548d-4d6d-abae-c0e8d48e2224 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.471428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41c480-548d-4d6d-abae-c0e8d48e2224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:16.481870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e41c480-548d-4d6d-abae-c0e8d48e2224 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:16.520459 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3571/7178] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:14:16 2022] POST /identity/v3/projects => generated 405 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:16.522836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b26f0d-e4c6-4719-aa00-1e11a61d15f5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:16.534783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b26f0d-e4c6-4719-aa00-1e11a61d15f5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:16.667348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b040-252a-4903-8323-4c74f35f6100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:16.668546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b040-252a-4903-8323-4c74f35f6100 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.669059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b040-252a-4903-8323-4c74f35f6100 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.669571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810b040-252a-4903-8323-4c74f35f6100 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.670555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810b040-252a-4903-8323-4c74f35f6100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:16.673020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810b040-252a-4903-8323-4c74f35f6100 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:16.712009 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3608/7179] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:14:16 2022] POST /identity/v3/users => generated 303 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:16.713732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41c480-548d-4d6d-abae-c0e8d48e2224 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:16.729490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e41c480-548d-4d6d-abae-c0e8d48e2224 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:16.735418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f902bd7-4f8d-4dd5-bf6f-bd23700c5247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:16.736435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f902bd7-4f8d-4dd5-bf6f-bd23700c5247 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.736929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f902bd7-4f8d-4dd5-bf6f-bd23700c5247 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.737406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f902bd7-4f8d-4dd5-bf6f-bd23700c5247 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.738350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f902bd7-4f8d-4dd5-bf6f-bd23700c5247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:16.741268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f902bd7-4f8d-4dd5-bf6f-bd23700c5247 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:16.759181 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3572/7180] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:16.764405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b040-252a-4903-8323-4c74f35f6100 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:16.782557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810b040-252a-4903-8323-4c74f35f6100 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:16.797414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20077a8c-06f7-4661-a1ec-585f326f4de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:16.798095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20077a8c-06f7-4661-a1ec-585f326f4de0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.798383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20077a8c-06f7-4661-a1ec-585f326f4de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.798668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20077a8c-06f7-4661-a1ec-585f326f4de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.802805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20077a8c-06f7-4661-a1ec-585f326f4de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:16.807806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20077a8c-06f7-4661-a1ec-585f326f4de0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:16.833105 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3609/7181] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:16.837172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f902bd7-4f8d-4dd5-bf6f-bd23700c5247 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:16.848385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f902bd7-4f8d-4dd5-bf6f-bd23700c5247 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:16.854874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d7c2-dd4c-4bcd-ba06-6dfb6d46be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:16.855787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d7c2-dd4c-4bcd-ba06-6dfb6d46be61 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.856127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d7c2-dd4c-4bcd-ba06-6dfb6d46be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.856641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64d7c2-dd4c-4bcd-ba06-6dfb6d46be61 admin admin] PATH_INFO: `/v3/projects/75c891428d78460c96e7c287f021e380/users/88fdcbacf3194f05a2000339f15f8a6b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.876222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d7c2-dd4c-4bcd-ba06-6dfb6d46be61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c891428d78460c96e7c287f021e380, user_id=88fdcbacf3194f05a2000339f15f8a6b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:16.879969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64d7c2-dd4c-4bcd-ba06-6dfb6d46be61 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:16.907165 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3573/7182] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:16 2022] PUT /identity/v3/projects/75c891428d78460c96e7c287f021e380/users/88fdcbacf3194f05a2000339f15f8a6b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:14:16.919394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f87d3-e956-4ce6-81c4-7eb0c1f907fb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:16.919684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f87d3-e956-4ce6-81c4-7eb0c1f907fb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:16.919996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f87d3-e956-4ce6-81c4-7eb0c1f907fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:16.950512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b83f87d3-e956-4ce6-81c4-7eb0c1f907fb None None] MFA Rules not processed for user `88fdcbacf3194f05a2000339f15f8a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:16.953347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b83f87d3-e956-4ce6-81c4-7eb0c1f907fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:17.038919 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3610/7183] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:17.044228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d7c2-dd4c-4bcd-ba06-6dfb6d46be61 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:17.139947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64d7c2-dd4c-4bcd-ba06-6dfb6d46be61 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:17.158355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08660f4-c0b6-4d51-9887-e23830b3b40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:17.159803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08660f4-c0b6-4d51-9887-e23830b3b40c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:17.160140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08660f4-c0b6-4d51-9887-e23830b3b40c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:17.160924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08660f4-c0b6-4d51-9887-e23830b3b40c admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:17.161830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08660f4-c0b6-4d51-9887-e23830b3b40c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:17.163796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08660f4-c0b6-4d51-9887-e23830b3b40c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:17.209843 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3574/7184] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:14:17 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:17.211288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f87d3-e956-4ce6-81c4-7eb0c1f907fb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:17.224901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f87d3-e956-4ce6-81c4-7eb0c1f907fb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:17.294959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021f67d-c930-4144-b1ca-9c018b432461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:17.295836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021f67d-c930-4144-b1ca-9c018b432461 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:17.296245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021f67d-c930-4144-b1ca-9c018b432461 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:17.296591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021f67d-c930-4144-b1ca-9c018b432461 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:17.297344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021f67d-c930-4144-b1ca-9c018b432461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:17.299555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021f67d-c930-4144-b1ca-9c018b432461 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:17.325247 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3611/7185] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:14:17 2022] POST /identity/v3/users => generated 307 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:17.326704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08660f4-c0b6-4d51-9887-e23830b3b40c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:17.337891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08660f4-c0b6-4d51-9887-e23830b3b40c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:17.343272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564c99e-7c50-4c22-b38d-3ed619d14973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:17.343961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564c99e-7c50-4c22-b38d-3ed619d14973 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:17.344257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564c99e-7c50-4c22-b38d-3ed619d14973 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:17.344537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564c99e-7c50-4c22-b38d-3ed619d14973 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:17.345264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564c99e-7c50-4c22-b38d-3ed619d14973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:17.346882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564c99e-7c50-4c22-b38d-3ed619d14973 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:17.362884 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3575/7186] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:14:17.364288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021f67d-c930-4144-b1ca-9c018b432461 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:17.376240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021f67d-c930-4144-b1ca-9c018b432461 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:17.383997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10ea2f-e27d-42e0-b1fb-addd0aa75d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:17.385513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10ea2f-e27d-42e0-b1fb-addd0aa75d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:17.386122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10ea2f-e27d-42e0-b1fb-addd0aa75d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:17.386821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10ea2f-e27d-42e0-b1fb-addd0aa75d35 admin admin] PATH_INFO: `/v3/projects/8833ea88d6524f1785d7b4c1b4b7eead/users/8278ecef34ca4fb58823d2888dc4b595/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:17.419674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10ea2f-e27d-42e0-b1fb-addd0aa75d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8833ea88d6524f1785d7b4c1b4b7eead, user_id=8278ecef34ca4fb58823d2888dc4b595, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:17.422115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10ea2f-e27d-42e0-b1fb-addd0aa75d35 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:17.456373 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3612/7187] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:17 2022] PUT /identity/v3/projects/8833ea88d6524f1785d7b4c1b4b7eead/users/8278ecef34ca4fb58823d2888dc4b595/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:17.461059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564c99e-7c50-4c22-b38d-3ed619d14973 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:17.473830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564c99e-7c50-4c22-b38d-3ed619d14973 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:17.569745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e323d70-35ac-49d8-926e-ff8417937673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:17.571356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e323d70-35ac-49d8-926e-ff8417937673 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:17.571639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e323d70-35ac-49d8-926e-ff8417937673 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:17.571910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e323d70-35ac-49d8-926e-ff8417937673 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:17.572838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e323d70-35ac-49d8-926e-ff8417937673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:17.575806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e323d70-35ac-49d8-926e-ff8417937673 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:17.607469 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3576/7188] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:17.608033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10ea2f-e27d-42e0-b1fb-addd0aa75d35 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:17.620961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10ea2f-e27d-42e0-b1fb-addd0aa75d35 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:17.625888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1af13-d360-4d65-98e1-66f70c60a665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:17.626487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1af13-d360-4d65-98e1-66f70c60a665 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:17.626771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1af13-d360-4d65-98e1-66f70c60a665 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:17.627163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1af13-d360-4d65-98e1-66f70c60a665 admin admin] PATH_INFO: `/v3/projects/8833ea88d6524f1785d7b4c1b4b7eead/users/8278ecef34ca4fb58823d2888dc4b595/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:17.629789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1af13-d360-4d65-98e1-66f70c60a665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8833ea88d6524f1785d7b4c1b4b7eead, user_id=8278ecef34ca4fb58823d2888dc4b595, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:17.633847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1af13-d360-4d65-98e1-66f70c60a665 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:17.647104 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3613/7189] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:17 2022] PUT /identity/v3/projects/8833ea88d6524f1785d7b4c1b4b7eead/users/8278ecef34ca4fb58823d2888dc4b595/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:14:17.658262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e7a1-681f-4e1c-9173-c5446896e279 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:17.659099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e7a1-681f-4e1c-9173-c5446896e279 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:17.660226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594e7a1-681f-4e1c-9173-c5446896e279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:17.691226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9594e7a1-681f-4e1c-9173-c5446896e279 None None] MFA Rules not processed for user `8278ecef34ca4fb58823d2888dc4b595`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:17.692630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9594e7a1-681f-4e1c-9173-c5446896e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:17.768321 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3577/7190] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:14:17.780770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1af13-d360-4d65-98e1-66f70c60a665 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:17.782499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c8b1af13-d360-4d65-98e1-66f70c60a665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:17.850617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1af13-d360-4d65-98e1-66f70c60a665 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:17.855005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31be5c-1c79-451c-bfe5-d301197daf1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:17.855706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31be5c-1c79-451c-bfe5-d301197daf1f service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:17.856038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31be5c-1c79-451c-bfe5-d301197daf1f service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:17.856329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31be5c-1c79-451c-bfe5-d301197daf1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:17.867249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31be5c-1c79-451c-bfe5-d301197daf1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:17.868730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c31be5c-1c79-451c-bfe5-d301197daf1f service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:17.879997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3614/7191] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:18.068927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e7a1-681f-4e1c-9173-c5446896e279 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:18.151345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594e7a1-681f-4e1c-9173-c5446896e279 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:18.158719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:18.160239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:18.161440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:18.161981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] PATH_INFO: `/v3/users/88fdcbacf3194f05a2000339f15f8a6b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:18.163405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fdcbacf3194f05a2000339f15f8a6b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:18.166271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:18.226530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fdcbacf3194f05a2000339f15f8a6b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:18.235392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fdcbacf3194f05a2000339f15f8a6b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:18.240316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fdcbacf3194f05a2000339f15f8a6b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:18.241127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fdcbacf3194f05a2000339f15f8a6b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:18.254805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fdcbacf3194f05a2000339f15f8a6b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:18.270565 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3578/7192] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:18 2022] DELETE /identity/v3/users/88fdcbacf3194f05a2000339f15f8a6b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:18.275432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842981f6-5cd5-4fce-b185-bb5a82e0a855 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:18.275947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842981f6-5cd5-4fce-b185-bb5a82e0a855 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:18.276041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842981f6-5cd5-4fce-b185-bb5a82e0a855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:18.295230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-842981f6-5cd5-4fce-b185-bb5a82e0a855 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:18.296891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-842981f6-5cd5-4fce-b185-bb5a82e0a855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:18.372283 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3615/7193] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:18.383474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:18.385310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:18.472740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d71d69-2737-466f-833b-816500e0c0fc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:18.478398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bb753-7560-48e1-9ebe-a466748a6212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:18.479053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb753-7560-48e1-9ebe-a466748a6212 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:18.479334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb753-7560-48e1-9ebe-a466748a6212 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:18.479614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bb753-7560-48e1-9ebe-a466748a6212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:18.491771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bb753-7560-48e1-9ebe-a466748a6212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:18.493358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bb753-7560-48e1-9ebe-a466748a6212 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:18.516657 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3579/7194] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:18.875549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842981f6-5cd5-4fce-b185-bb5a82e0a855 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:18.877233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-842981f6-5cd5-4fce-b185-bb5a82e0a855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:18.897840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842981f6-5cd5-4fce-b185-bb5a82e0a855 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:18.904994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:18.918936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:18.919370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:18.919667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] PATH_INFO: `/v3/projects/75c891428d78460c96e7c287f021e380` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:18.921566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c891428d78460c96e7c287f021e380)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:18.924463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:19.005674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c891428d78460c96e7c287f021e380', 'request_id': 'req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.016605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c891428d78460c96e7c287f021e380', 'request_id': 'req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.036754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c891428d78460c96e7c287f021e380', 'request_id': 'req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.052662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] The token cache is being invalidate because project 75c891428d78460c96e7c287f021e380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:19.053331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.054205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.056049 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3616/7195] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:18 2022] DELETE /identity/v3/projects/75c891428d78460c96e7c287f021e380 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:19.060252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bb753-7560-48e1-9ebe-a466748a6212 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:19.072100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bb753-7560-48e1-9ebe-a466748a6212 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:19.162503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:19.164209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:19.165503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:19.165878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] PATH_INFO: `/v3/users/8278ecef34ca4fb58823d2888dc4b595` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:19.168000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8278ecef34ca4fb58823d2888dc4b595)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:19.170648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:19.237180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8278ecef34ca4fb58823d2888dc4b595'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.246117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8278ecef34ca4fb58823d2888dc4b595'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.246825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8278ecef34ca4fb58823d2888dc4b595'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.247587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8278ecef34ca4fb58823d2888dc4b595'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.261050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-58e7b7c4-e7ad-4093-b977-dbd65f677621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8278ecef34ca4fb58823d2888dc4b595'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.274770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3580/7196] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:19 2022] DELETE /identity/v3/users/8278ecef34ca4fb58823d2888dc4b595 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:19.692564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:19.693978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:19.708200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea8ebb-ac25-4aac-b502-935b6dadeea4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:19.788244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:19.789333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:19.789713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:19.790119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] PATH_INFO: `/v3/projects/8833ea88d6524f1785d7b4c1b4b7eead` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:19.791898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8833ea88d6524f1785d7b4c1b4b7eead)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:19.794946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:19.882324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8833ea88d6524f1785d7b4c1b4b7eead', 'request_id': 'req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.891939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8833ea88d6524f1785d7b4c1b4b7eead', 'request_id': 'req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.902604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8833ea88d6524f1785d7b4c1b4b7eead', 'request_id': 'req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.915774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] The token cache is being invalidate because project 8833ea88d6524f1785d7b4c1b4b7eead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:19.916094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.916754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef544bd1-1e43-4874-bc82-8cf45ab9b09f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:19.919835 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3617/7197] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:19 2022] DELETE /identity/v3/projects/8833ea88d6524f1785d7b4c1b4b7eead => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:19.924380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35030-f7bd-45da-b915-234b2c6b1128 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:19.924754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35030-f7bd-45da-b915-234b2c6b1128 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:19.925110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35030-f7bd-45da-b915-234b2c6b1128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:19.948638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-52d35030-f7bd-45da-b915-234b2c6b1128 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:19.949869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-52d35030-f7bd-45da-b915-234b2c6b1128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:20.046717 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3581/7198] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:14:20.057177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178164b9-2e6f-4b8e-a000-d2d08b6e1985 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.057492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178164b9-2e6f-4b8e-a000-d2d08b6e1985 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.057774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178164b9-2e6f-4b8e-a000-d2d08b6e1985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.092116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-178164b9-2e6f-4b8e-a000-d2d08b6e1985 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:20.093356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-178164b9-2e6f-4b8e-a000-d2d08b6e1985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:20.105370 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3618/7199] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:20.106132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d35030-f7bd-45da-b915-234b2c6b1128 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.116323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d35030-f7bd-45da-b915-234b2c6b1128 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.122909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96a72-0b8e-422f-877a-40171a50fb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.123755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96a72-0b8e-422f-877a-40171a50fb12 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.124769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96a72-0b8e-422f-877a-40171a50fb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.125162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96a72-0b8e-422f-877a-40171a50fb12 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.125976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b96a72-0b8e-422f-877a-40171a50fb12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:14:20.126352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b96a72-0b8e-422f-877a-40171a50fb12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:20.128121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b96a72-0b8e-422f-877a-40171a50fb12 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:20.145780 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3582/7200] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:14:20.146404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178164b9-2e6f-4b8e-a000-d2d08b6e1985 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.157859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178164b9-2e6f-4b8e-a000-d2d08b6e1985 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.163081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be98517-2de8-4d75-939f-8a5ee096041b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.163762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be98517-2de8-4d75-939f-8a5ee096041b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.164068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be98517-2de8-4d75-939f-8a5ee096041b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.164346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be98517-2de8-4d75-939f-8a5ee096041b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.165030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be98517-2de8-4d75-939f-8a5ee096041b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:20.167428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be98517-2de8-4d75-939f-8a5ee096041b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:20.208393 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3619/7201] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:14:20 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:20.212602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96a72-0b8e-422f-877a-40171a50fb12 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.224813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96a72-0b8e-422f-877a-40171a50fb12 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.330449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c933a-43f7-4143-bd74-776147442bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.331314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c933a-43f7-4143-bd74-776147442bbf admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.331695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c933a-43f7-4143-bd74-776147442bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.332144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c933a-43f7-4143-bd74-776147442bbf admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.332979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c933a-43f7-4143-bd74-776147442bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:20.335102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227c933a-43f7-4143-bd74-776147442bbf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:20.371463 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3583/7202] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:14:20 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:20.375151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be98517-2de8-4d75-939f-8a5ee096041b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.387794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be98517-2de8-4d75-939f-8a5ee096041b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.393107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c144e-d6cc-4c60-a8f3-3ca563ee4135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.394085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c144e-d6cc-4c60-a8f3-3ca563ee4135 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.394773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c144e-d6cc-4c60-a8f3-3ca563ee4135 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.395217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c144e-d6cc-4c60-a8f3-3ca563ee4135 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.396152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c144e-d6cc-4c60-a8f3-3ca563ee4135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:20.398829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c144e-d6cc-4c60-a8f3-3ca563ee4135 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:20.415889 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3620/7203] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:20.416777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c933a-43f7-4143-bd74-776147442bbf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.434246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c933a-43f7-4143-bd74-776147442bbf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.447238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18941704-b43a-417a-960e-56791b1356d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.447802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18941704-b43a-417a-960e-56791b1356d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.448313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18941704-b43a-417a-960e-56791b1356d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.448743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18941704-b43a-417a-960e-56791b1356d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.449999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18941704-b43a-417a-960e-56791b1356d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:20.452541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18941704-b43a-417a-960e-56791b1356d6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:20.469262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c144e-d6cc-4c60-a8f3-3ca563ee4135 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.475343 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3584/7204] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:14:20.480789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c144e-d6cc-4c60-a8f3-3ca563ee4135 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.485947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74965ca-bd52-4041-bbed-3faa669c2561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.486639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74965ca-bd52-4041-bbed-3faa669c2561 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.486918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74965ca-bd52-4041-bbed-3faa669c2561 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.487190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74965ca-bd52-4041-bbed-3faa669c2561 admin admin] PATH_INFO: `/v3/projects/49c365bd76884059b3291b089c4f4fe0/users/d6454b55215841048dc4629a0b4987d8/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.519355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74965ca-bd52-4041-bbed-3faa669c2561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c365bd76884059b3291b089c4f4fe0, user_id=d6454b55215841048dc4629a0b4987d8, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:20.522168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74965ca-bd52-4041-bbed-3faa669c2561 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:20.541784 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3621/7205] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:20 2022] PUT /identity/v3/projects/49c365bd76884059b3291b089c4f4fe0/users/d6454b55215841048dc4629a0b4987d8/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:14:20.562284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66b84f-9285-48f5-95cd-e501d9592692 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.562784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66b84f-9285-48f5-95cd-e501d9592692 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.563344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66b84f-9285-48f5-95cd-e501d9592692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.597182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5a66b84f-9285-48f5-95cd-e501d9592692 None None] MFA Rules not processed for user `d6454b55215841048dc4629a0b4987d8`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:20.598753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5a66b84f-9285-48f5-95cd-e501d9592692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:20.674519 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3585/7206] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:20.680724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74965ca-bd52-4041-bbed-3faa669c2561 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.756849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74965ca-bd52-4041-bbed-3faa669c2561 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.762710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2859c0-c3e4-4e08-ba5c-559e06353d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.763380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2859c0-c3e4-4e08-ba5c-559e06353d64 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.763666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2859c0-c3e4-4e08-ba5c-559e06353d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.763977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2859c0-c3e4-4e08-ba5c-559e06353d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.764674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2859c0-c3e4-4e08-ba5c-559e06353d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:20.766914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2859c0-c3e4-4e08-ba5c-559e06353d64 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:20.795144 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3622/7207] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:14:20 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:20.799037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66b84f-9285-48f5-95cd-e501d9592692 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.811155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66b84f-9285-48f5-95cd-e501d9592692 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.878473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4761ba-cf03-4ff6-b037-3087424e08cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.879290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4761ba-cf03-4ff6-b037-3087424e08cf admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.879642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4761ba-cf03-4ff6-b037-3087424e08cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.880169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4761ba-cf03-4ff6-b037-3087424e08cf admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.880925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4761ba-cf03-4ff6-b037-3087424e08cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:20.883130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4761ba-cf03-4ff6-b037-3087424e08cf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:20.906157 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3586/7208] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:14:20 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:20.910129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2859c0-c3e4-4e08-ba5c-559e06353d64 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.921593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2859c0-c3e4-4e08-ba5c-559e06353d64 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.927849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188d364-cf2e-4dce-a507-6b8ec6cafcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.928593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188d364-cf2e-4dce-a507-6b8ec6cafcab admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.928953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188d364-cf2e-4dce-a507-6b8ec6cafcab admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.929308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188d364-cf2e-4dce-a507-6b8ec6cafcab admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:20.930326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188d364-cf2e-4dce-a507-6b8ec6cafcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:20.932420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c188d364-cf2e-4dce-a507-6b8ec6cafcab admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:20.952349 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3623/7209] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:20.956296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4761ba-cf03-4ff6-b037-3087424e08cf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:20.968103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4761ba-cf03-4ff6-b037-3087424e08cf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:20.974054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f9465-abc7-4641-8246-e4da7d01f97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:20.975097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f9465-abc7-4641-8246-e4da7d01f97b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:20.975514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f9465-abc7-4641-8246-e4da7d01f97b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:20.975897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f9465-abc7-4641-8246-e4da7d01f97b admin admin] PATH_INFO: `/v3/projects/d866a376099d44cbabdf6351092fa7bf/users/65b07d9ad28f42598ba061ed6c603254/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:21.013899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f9465-abc7-4641-8246-e4da7d01f97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d866a376099d44cbabdf6351092fa7bf, user_id=65b07d9ad28f42598ba061ed6c603254, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:21.021267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f9465-abc7-4641-8246-e4da7d01f97b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:21.044150 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3587/7210] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:20 2022] PUT /identity/v3/projects/d866a376099d44cbabdf6351092fa7bf/users/65b07d9ad28f42598ba061ed6c603254/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:21.048010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188d364-cf2e-4dce-a507-6b8ec6cafcab admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:21.064011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188d364-cf2e-4dce-a507-6b8ec6cafcab admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:21.162751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11610-b7db-4464-b7dc-1967755058fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:21.163448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11610-b7db-4464-b7dc-1967755058fb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:21.163735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11610-b7db-4464-b7dc-1967755058fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:21.164060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11610-b7db-4464-b7dc-1967755058fb admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:21.165730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b11610-b7db-4464-b7dc-1967755058fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:21.166501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b11610-b7db-4464-b7dc-1967755058fb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:21.188781 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3624/7211] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:21.190007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f9465-abc7-4641-8246-e4da7d01f97b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:21.201010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f9465-abc7-4641-8246-e4da7d01f97b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:21.206362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53957d1b-ae0c-4243-911f-37d80d780d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:21.208379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53957d1b-ae0c-4243-911f-37d80d780d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:21.208903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53957d1b-ae0c-4243-911f-37d80d780d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:21.209187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53957d1b-ae0c-4243-911f-37d80d780d55 admin admin] PATH_INFO: `/v3/projects/d866a376099d44cbabdf6351092fa7bf/users/65b07d9ad28f42598ba061ed6c603254/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:21.211639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53957d1b-ae0c-4243-911f-37d80d780d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d866a376099d44cbabdf6351092fa7bf, user_id=65b07d9ad28f42598ba061ed6c603254, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:21.214402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53957d1b-ae0c-4243-911f-37d80d780d55 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:21.228537 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3588/7212] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:21 2022] PUT /identity/v3/projects/d866a376099d44cbabdf6351092fa7bf/users/65b07d9ad28f42598ba061ed6c603254/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:21.239429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f92633-c3b1-4943-a030-aa30286d10e8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:21.239779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f92633-c3b1-4943-a030-aa30286d10e8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:21.240187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f92633-c3b1-4943-a030-aa30286d10e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:21.280719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-88f92633-c3b1-4943-a030-aa30286d10e8 None None] MFA Rules not processed for user `65b07d9ad28f42598ba061ed6c603254`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:21.282336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-88f92633-c3b1-4943-a030-aa30286d10e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:21.384209 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3625/7213] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:21.396619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53957d1b-ae0c-4243-911f-37d80d780d55 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:21.399676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-53957d1b-ae0c-4243-911f-37d80d780d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:21.486230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53957d1b-ae0c-4243-911f-37d80d780d55 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:21.490439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f366d7-4e43-4182-9043-6244ac34cd37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:21.491334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f366d7-4e43-4182-9043-6244ac34cd37 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:21.491764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f366d7-4e43-4182-9043-6244ac34cd37 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:21.492092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f366d7-4e43-4182-9043-6244ac34cd37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:21.503570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f366d7-4e43-4182-9043-6244ac34cd37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:21.505858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f366d7-4e43-4182-9043-6244ac34cd37 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:21.516425 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3589/7214] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:21.987786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f92633-c3b1-4943-a030-aa30286d10e8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:22.083998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f92633-c3b1-4943-a030-aa30286d10e8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:22.092260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:22.093715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:22.094640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:22.094942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] PATH_INFO: `/v3/users/d6454b55215841048dc4629a0b4987d8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:22.096459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6454b55215841048dc4629a0b4987d8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:22.100505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:22.168621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6454b55215841048dc4629a0b4987d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:22.179401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6454b55215841048dc4629a0b4987d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:22.179542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6454b55215841048dc4629a0b4987d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:22.180274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6454b55215841048dc4629a0b4987d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:22.193120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6454b55215841048dc4629a0b4987d8'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:22.226749 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3626/7215] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:21 2022] DELETE /identity/v3/users/d6454b55215841048dc4629a0b4987d8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:22.231427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13454f9c-d9c8-4454-8ffc-6630751e154f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:22.232954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13454f9c-d9c8-4454-8ffc-6630751e154f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:22.233242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13454f9c-d9c8-4454-8ffc-6630751e154f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:22.286639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-13454f9c-d9c8-4454-8ffc-6630751e154f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:22.288081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-13454f9c-d9c8-4454-8ffc-6630751e154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:22.372696 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3590/7216] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:14:22.385203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:22.387682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:22.470546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb422e-e704-427e-b29a-331eea79051d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:22.475898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73243-67ff-4f47-8255-ef17f98e9f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:22.476646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73243-67ff-4f47-8255-ef17f98e9f2a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:22.476866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73243-67ff-4f47-8255-ef17f98e9f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:22.477142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73243-67ff-4f47-8255-ef17f98e9f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:22.489371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c73243-67ff-4f47-8255-ef17f98e9f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:22.490922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c73243-67ff-4f47-8255-ef17f98e9f2a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:22.501373 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3627/7217] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:22.941273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13454f9c-d9c8-4454-8ffc-6630751e154f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:22.943286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-13454f9c-d9c8-4454-8ffc-6630751e154f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:22.948115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73243-67ff-4f47-8255-ef17f98e9f2a service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:22.949570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-62c73243-67ff-4f47-8255-ef17f98e9f2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:22.959056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13454f9c-d9c8-4454-8ffc-6630751e154f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:22.965433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:22.966616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:22.967259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:22.967749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] PATH_INFO: `/v3/projects/49c365bd76884059b3291b089c4f4fe0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:22.969287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c365bd76884059b3291b089c4f4fe0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:22.971550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:23.086659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c365bd76884059b3291b089c4f4fe0', 'request_id': 'req-409747b8-4274-41af-b152-d9ce25970698'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.101552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c365bd76884059b3291b089c4f4fe0', 'request_id': 'req-409747b8-4274-41af-b152-d9ce25970698'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.114087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73243-67ff-4f47-8255-ef17f98e9f2a service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:23.115208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c365bd76884059b3291b089c4f4fe0', 'request_id': 'req-409747b8-4274-41af-b152-d9ce25970698'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.145742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] The token cache is being invalidate because project 49c365bd76884059b3291b089c4f4fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:23.146077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.147754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.151026 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3591/7218] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:22 2022] DELETE /identity/v3/projects/49c365bd76884059b3291b089c4f4fe0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:23.156735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:23.158188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:23.239582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d38ecb-af82-4278-815b-593ac6b49ea0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:23.240380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d38ecb-af82-4278-815b-593ac6b49ea0 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:23.240725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d38ecb-af82-4278-815b-593ac6b49ea0 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:23.241225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d38ecb-af82-4278-815b-593ac6b49ea0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:23.243409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-66d38ecb-af82-4278-815b-593ac6b49ea0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:23.271258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409747b8-4274-41af-b152-d9ce25970698 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:23.276497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:23.277628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:23.278529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:23.278978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] PATH_INFO: `/v3/users/65b07d9ad28f42598ba061ed6c603254` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:23.280804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b07d9ad28f42598ba061ed6c603254)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:23.283260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:23.343304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d38ecb-af82-4278-815b-593ac6b49ea0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:23.345101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d38ecb-af82-4278-815b-593ac6b49ea0 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:23.370990 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3628/7219] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:14:23.372950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b07d9ad28f42598ba061ed6c603254'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.384711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b07d9ad28f42598ba061ed6c603254'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.392627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b07d9ad28f42598ba061ed6c603254'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.393440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b07d9ad28f42598ba061ed6c603254'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.411733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-78c204a8-b087-4428-bd63-d6948c2eee2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b07d9ad28f42598ba061ed6c603254'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:23.438316 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3592/7220] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:23 2022] DELETE /identity/v3/users/65b07d9ad28f42598ba061ed6c603254 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:23.992373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d38ecb-af82-4278-815b-593ac6b49ea0 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:24.010125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d38ecb-af82-4278-815b-593ac6b49ea0 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:24.105130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:24.106012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.106300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.106569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] PATH_INFO: `/v3/projects/d866a376099d44cbabdf6351092fa7bf` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.107820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d866a376099d44cbabdf6351092fa7bf)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:24.109835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:24.165812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd866a376099d44cbabdf6351092fa7bf', 'request_id': 'req-7a254d93-6b2f-4106-ab55-89884dd7129f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:24.178108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd866a376099d44cbabdf6351092fa7bf', 'request_id': 'req-7a254d93-6b2f-4106-ab55-89884dd7129f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:24.184772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd866a376099d44cbabdf6351092fa7bf', 'request_id': 'req-7a254d93-6b2f-4106-ab55-89884dd7129f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:24.197294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] The token cache is being invalidate because project d866a376099d44cbabdf6351092fa7bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:24.197607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:24.198280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7a254d93-6b2f-4106-ab55-89884dd7129f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:24.200084 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3629/7221] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:23 2022] DELETE /identity/v3/projects/d866a376099d44cbabdf6351092fa7bf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:24.205428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b4f13-8fe3-40cc-b503-389deeff4f88 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.205806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b4f13-8fe3-40cc-b503-389deeff4f88 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.206301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b4f13-8fe3-40cc-b503-389deeff4f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.226159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a76b4f13-8fe3-40cc-b503-389deeff4f88 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:24.227383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a76b4f13-8fe3-40cc-b503-389deeff4f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:24.322370 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3593/7222] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:24.331417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa77c5e-eeb3-42b4-bf28-8f78234e21f2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.331719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa77c5e-eeb3-42b4-bf28-8f78234e21f2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.332669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa77c5e-eeb3-42b4-bf28-8f78234e21f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.358144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-faa77c5e-eeb3-42b4-bf28-8f78234e21f2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:24.359373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-faa77c5e-eeb3-42b4-bf28-8f78234e21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:24.368519 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3630/7223] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:24.372686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b4f13-8fe3-40cc-b503-389deeff4f88 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:24.383981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b4f13-8fe3-40cc-b503-389deeff4f88 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:24.388937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b790ed3-7817-41e5-845f-e11cc852bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:24.389898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b790ed3-7817-41e5-845f-e11cc852bf58 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.390208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b790ed3-7817-41e5-845f-e11cc852bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.390471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b790ed3-7817-41e5-845f-e11cc852bf58 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.391405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b790ed3-7817-41e5-845f-e11cc852bf58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:14:24.391717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b790ed3-7817-41e5-845f-e11cc852bf58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:24.393441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b790ed3-7817-41e5-845f-e11cc852bf58 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:24.406966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3594/7224] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:14:24.411444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa77c5e-eeb3-42b4-bf28-8f78234e21f2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:24.422063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa77c5e-eeb3-42b4-bf28-8f78234e21f2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:24.434177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35ba3b-ec0e-4406-8615-6e04dfce49f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:24.434847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35ba3b-ec0e-4406-8615-6e04dfce49f1 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.435309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35ba3b-ec0e-4406-8615-6e04dfce49f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.435580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35ba3b-ec0e-4406-8615-6e04dfce49f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.436670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35ba3b-ec0e-4406-8615-6e04dfce49f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:24.438619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35ba3b-ec0e-4406-8615-6e04dfce49f1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:24.467739 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3631/7225] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:14:24 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:14:24.472013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b790ed3-7817-41e5-845f-e11cc852bf58 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:24.482323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b790ed3-7817-41e5-845f-e11cc852bf58 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:24.540828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616a269-96fe-484a-8b3f-e16dd1fd2ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:24.541942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616a269-96fe-484a-8b3f-e16dd1fd2ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.542368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616a269-96fe-484a-8b3f-e16dd1fd2ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.542644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616a269-96fe-484a-8b3f-e16dd1fd2ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.543398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616a269-96fe-484a-8b3f-e16dd1fd2ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:24.545418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616a269-96fe-484a-8b3f-e16dd1fd2ee7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:24.569148 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3595/7226] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:14:24 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:14:24.570321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35ba3b-ec0e-4406-8615-6e04dfce49f1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:24.581415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35ba3b-ec0e-4406-8615-6e04dfce49f1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:24.586668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c15a0-b2a2-4136-8227-d08e1e1dbd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:24.587468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c15a0-b2a2-4136-8227-d08e1e1dbd66 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.587748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c15a0-b2a2-4136-8227-d08e1e1dbd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.588072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c15a0-b2a2-4136-8227-d08e1e1dbd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.588789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c15a0-b2a2-4136-8227-d08e1e1dbd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:24.590389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c15a0-b2a2-4136-8227-d08e1e1dbd66 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:24.605218 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3632/7227] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:24.607194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616a269-96fe-484a-8b3f-e16dd1fd2ee7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:24.618858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616a269-96fe-484a-8b3f-e16dd1fd2ee7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:24.623790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e51840-c948-4953-8b67-852add600c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:24.624981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e51840-c948-4953-8b67-852add600c67 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.625267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e51840-c948-4953-8b67-852add600c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.625597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e51840-c948-4953-8b67-852add600c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.626542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e51840-c948-4953-8b67-852add600c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:24.628250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e51840-c948-4953-8b67-852add600c67 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:24.638985 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3596/7228] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:24.643094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c15a0-b2a2-4136-8227-d08e1e1dbd66 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:24.654857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c15a0-b2a2-4136-8227-d08e1e1dbd66 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:24.659628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f1622-1e43-4893-a6ca-7c40b74df7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:24.660575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f1622-1e43-4893-a6ca-7c40b74df7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.660857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f1622-1e43-4893-a6ca-7c40b74df7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.661245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f1622-1e43-4893-a6ca-7c40b74df7ad admin admin] PATH_INFO: `/v3/projects/ab496d26bdcf460eb2081b88189d7d6a/users/4cb484292e0e4dc197dc9cb16fbe7baf/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.676203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f1622-1e43-4893-a6ca-7c40b74df7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab496d26bdcf460eb2081b88189d7d6a, user_id=4cb484292e0e4dc197dc9cb16fbe7baf, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:24.679168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f1622-1e43-4893-a6ca-7c40b74df7ad admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:24.695530 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3633/7229] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:24 2022] PUT /identity/v3/projects/ab496d26bdcf460eb2081b88189d7d6a/users/4cb484292e0e4dc197dc9cb16fbe7baf/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:24.705738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75948deb-279a-477b-8e4c-c512d0776a55 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.706033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75948deb-279a-477b-8e4c-c512d0776a55 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.706317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75948deb-279a-477b-8e4c-c512d0776a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.737905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-75948deb-279a-477b-8e4c-c512d0776a55 None None] MFA Rules not processed for user `4cb484292e0e4dc197dc9cb16fbe7baf`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:24.739185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-75948deb-279a-477b-8e4c-c512d0776a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:24.822079 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3597/7230] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:14:24.835098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f1622-1e43-4893-a6ca-7c40b74df7ad admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:24.837103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c79f1622-1e43-4893-a6ca-7c40b74df7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:24.910962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f1622-1e43-4893-a6ca-7c40b74df7ad admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:24.920171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88b3bf-c738-4eac-9696-28d53fe56754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:24.921036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88b3bf-c738-4eac-9696-28d53fe56754 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:24.921384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88b3bf-c738-4eac-9696-28d53fe56754 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:24.921730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88b3bf-c738-4eac-9696-28d53fe56754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:24.942969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88b3bf-c738-4eac-9696-28d53fe56754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:24.945278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88b3bf-c738-4eac-9696-28d53fe56754 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:24.957947 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3634/7231] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:34.975005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75948deb-279a-477b-8e4c-c512d0776a55 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:35.079450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75948deb-279a-477b-8e4c-c512d0776a55 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:35.089489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:35.093030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:35.093323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:35.093610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] PATH_INFO: `/v3/users/4cb484292e0e4dc197dc9cb16fbe7baf` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:35.096444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb484292e0e4dc197dc9cb16fbe7baf)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:35.100923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:35.221849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb484292e0e4dc197dc9cb16fbe7baf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:35.234957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb484292e0e4dc197dc9cb16fbe7baf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:35.236044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb484292e0e4dc197dc9cb16fbe7baf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:35.237086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb484292e0e4dc197dc9cb16fbe7baf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:35.272604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb484292e0e4dc197dc9cb16fbe7baf'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:35.318031 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3598/7232] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:34 2022] DELETE /identity/v3/users/4cb484292e0e4dc197dc9cb16fbe7baf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:35.324130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc2c7-488c-4374-bc38-8a32a63a9bd4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:35.324610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc2c7-488c-4374-bc38-8a32a63a9bd4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:35.324610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc2c7-488c-4374-bc38-8a32a63a9bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:35.343650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dabfc2c7-488c-4374-bc38-8a32a63a9bd4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:35.345433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dabfc2c7-488c-4374-bc38-8a32a63a9bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:35.412431 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3635/7233] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:35.441463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:35.443758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:35.536360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffcaae-1963-42e7-a3cf-45b11cf86cee admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:35.541538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9189c-27b6-4904-a69e-0f58ae6acf54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:35.542427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9189c-27b6-4904-a69e-0f58ae6acf54 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:35.542901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9189c-27b6-4904-a69e-0f58ae6acf54 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:35.543345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9189c-27b6-4904-a69e-0f58ae6acf54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:35.568109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9189c-27b6-4904-a69e-0f58ae6acf54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:35.572397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9189c-27b6-4904-a69e-0f58ae6acf54 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:35.587779 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3599/7234] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:36.124507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfc2c7-488c-4374-bc38-8a32a63a9bd4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:36.128800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dabfc2c7-488c-4374-bc38-8a32a63a9bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:36.146602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfc2c7-488c-4374-bc38-8a32a63a9bd4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:36.152502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:36.153670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:36.154140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:36.154594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] PATH_INFO: `/v3/projects/ab496d26bdcf460eb2081b88189d7d6a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:36.156185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab496d26bdcf460eb2081b88189d7d6a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:36.158345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:36.257440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab496d26bdcf460eb2081b88189d7d6a', 'request_id': 'req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:36.270149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab496d26bdcf460eb2081b88189d7d6a', 'request_id': 'req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:36.279806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab496d26bdcf460eb2081b88189d7d6a', 'request_id': 'req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:36.304984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] The token cache is being invalidate because project ab496d26bdcf460eb2081b88189d7d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:36.305227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:36.307241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f899fd18-9506-4fd9-bf3b-4124cdcee3cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:36.309110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3636/7235] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:36 2022] DELETE /identity/v3/projects/ab496d26bdcf460eb2081b88189d7d6a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:36.314919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806909de-dffd-4d6e-b5de-250ae88798aa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:36.315460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806909de-dffd-4d6e-b5de-250ae88798aa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:36.315460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806909de-dffd-4d6e-b5de-250ae88798aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:36.344750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-806909de-dffd-4d6e-b5de-250ae88798aa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:36.346252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-806909de-dffd-4d6e-b5de-250ae88798aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:36.479443 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3600/7236] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:36.488420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7b28e-4e87-44d6-a266-dcf4eb2fdc39 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:36.488995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7b28e-4e87-44d6-a266-dcf4eb2fdc39 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:36.489208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d7b28e-4e87-44d6-a266-dcf4eb2fdc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:36.524006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e6d7b28e-4e87-44d6-a266-dcf4eb2fdc39 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:36.527233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e6d7b28e-4e87-44d6-a266-dcf4eb2fdc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:36.551250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806909de-dffd-4d6e-b5de-250ae88798aa None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:36.561682 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3637/7237] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:36.568260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806909de-dffd-4d6e-b5de-250ae88798aa None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:36.577498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef789c83-8c5e-4149-a84a-a78e173dd321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:36.578403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef789c83-8c5e-4149-a84a-a78e173dd321 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:36.578887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef789c83-8c5e-4149-a84a-a78e173dd321 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:36.579145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef789c83-8c5e-4149-a84a-a78e173dd321 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:36.580121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef789c83-8c5e-4149-a84a-a78e173dd321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:14:36.580656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef789c83-8c5e-4149-a84a-a78e173dd321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:36.583461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef789c83-8c5e-4149-a84a-a78e173dd321 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:36.608003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7b28e-4e87-44d6-a266-dcf4eb2fdc39 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:36.621070 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3601/7238] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:14:36.624518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d7b28e-4e87-44d6-a266-dcf4eb2fdc39 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:36.632984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eba52-5d9d-4499-aae8-3655400c797f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:36.633963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eba52-5d9d-4499-aae8-3655400c797f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:36.634438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eba52-5d9d-4499-aae8-3655400c797f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:36.634887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eba52-5d9d-4499-aae8-3655400c797f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:36.635747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eba52-5d9d-4499-aae8-3655400c797f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:36.638490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eba52-5d9d-4499-aae8-3655400c797f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:36.678934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef789c83-8c5e-4149-a84a-a78e173dd321 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:36.692679 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3638/7239] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:14:36 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:36.696016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef789c83-8c5e-4149-a84a-a78e173dd321 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:36.813038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e03e3-d495-4f54-a935-e8636c6d50c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:36.814168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e03e3-d495-4f54-a935-e8636c6d50c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:36.814842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e03e3-d495-4f54-a935-e8636c6d50c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:36.815365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e03e3-d495-4f54-a935-e8636c6d50c5 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:36.828430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e03e3-d495-4f54-a935-e8636c6d50c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:36.836621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9e03e3-d495-4f54-a935-e8636c6d50c5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:36.876389 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3602/7240] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:14:36 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:36.881032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eba52-5d9d-4499-aae8-3655400c797f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:36.897075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eba52-5d9d-4499-aae8-3655400c797f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:36.911695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7103c1e-e49e-46d6-8dfb-85792d2f0a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:36.912571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7103c1e-e49e-46d6-8dfb-85792d2f0a55 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:36.913115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7103c1e-e49e-46d6-8dfb-85792d2f0a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:36.913595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7103c1e-e49e-46d6-8dfb-85792d2f0a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:36.916466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7103c1e-e49e-46d6-8dfb-85792d2f0a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:36.921390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7103c1e-e49e-46d6-8dfb-85792d2f0a55 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:36.945568 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3639/7241] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:14:36.949837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e03e3-d495-4f54-a935-e8636c6d50c5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:36.973950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e03e3-d495-4f54-a935-e8636c6d50c5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:36.991599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25439f1c-76c3-4c1c-9580-cc688ca040e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:36.992341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439f1c-76c3-4c1c-9580-cc688ca040e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:36.992633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439f1c-76c3-4c1c-9580-cc688ca040e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:36.992917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439f1c-76c3-4c1c-9580-cc688ca040e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:36.994902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25439f1c-76c3-4c1c-9580-cc688ca040e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:36.996645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25439f1c-76c3-4c1c-9580-cc688ca040e6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:37.013855 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3603/7242] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:36 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:14:37.026381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7103c1e-e49e-46d6-8dfb-85792d2f0a55 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:37.084007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7103c1e-e49e-46d6-8dfb-85792d2f0a55 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:37.090622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2ec7-ed60-4636-8dfa-b1850a1b8804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:37.100447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2ec7-ed60-4636-8dfa-b1850a1b8804 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:37.102886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2ec7-ed60-4636-8dfa-b1850a1b8804 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:37.103334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2ec7-ed60-4636-8dfa-b1850a1b8804 admin admin] PATH_INFO: `/v3/projects/ec80ad7623e04c9180216b5bb1a38f1e/users/6aae7701ee964921bf4c26bb6c2a3793/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:37.148888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c2ec7-ed60-4636-8dfa-b1850a1b8804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec80ad7623e04c9180216b5bb1a38f1e, user_id=6aae7701ee964921bf4c26bb6c2a3793, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:37.152558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c2ec7-ed60-4636-8dfa-b1850a1b8804 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:37.212968 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3640/7243] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:37 2022] PUT /identity/v3/projects/ec80ad7623e04c9180216b5bb1a38f1e/users/6aae7701ee964921bf4c26bb6c2a3793/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:37.318625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf361f-88a2-4176-acf0-b461ca2ab13d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:37.319489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf361f-88a2-4176-acf0-b461ca2ab13d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:37.320000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf361f-88a2-4176-acf0-b461ca2ab13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:37.361982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-61cf361f-88a2-4176-acf0-b461ca2ab13d None None] MFA Rules not processed for user `6aae7701ee964921bf4c26bb6c2a3793`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:37.364268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-61cf361f-88a2-4176-acf0-b461ca2ab13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:37.454031 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3604/7244] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:37.467453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2ec7-ed60-4636-8dfa-b1850a1b8804 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:37.469725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e05c2ec7-ed60-4636-8dfa-b1850a1b8804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:37.612518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2ec7-ed60-4636-8dfa-b1850a1b8804 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:37.618869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16a8ea-7002-473c-9e4e-9b06c32f1109 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:37.620082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a8ea-7002-473c-9e4e-9b06c32f1109 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:37.620472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a8ea-7002-473c-9e4e-9b06c32f1109 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:37.620981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16a8ea-7002-473c-9e4e-9b06c32f1109 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:37.632861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16a8ea-7002-473c-9e4e-9b06c32f1109 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:37.635798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16a8ea-7002-473c-9e4e-9b06c32f1109 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:37.647723 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3641/7245] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:47.230697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf361f-88a2-4176-acf0-b461ca2ab13d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:47.232390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-61cf361f-88a2-4176-acf0-b461ca2ab13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:47.319548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf361f-88a2-4176-acf0-b461ca2ab13d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:47.323898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72278e8-cedd-4de0-ab9b-f60fe7f70271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:47.324829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72278e8-cedd-4de0-ab9b-f60fe7f70271 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:47.325305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72278e8-cedd-4de0-ab9b-f60fe7f70271 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:47.325757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72278e8-cedd-4de0-ab9b-f60fe7f70271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:47.336203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f72278e8-cedd-4de0-ab9b-f60fe7f70271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:47.512005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72278e8-cedd-4de0-ab9b-f60fe7f70271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:47.513505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72278e8-cedd-4de0-ab9b-f60fe7f70271 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:47.533437 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3605/7246] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:47.766516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16a8ea-7002-473c-9e4e-9b06c32f1109 service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:47.769343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b16a8ea-7002-473c-9e4e-9b06c32f1109 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:47.810372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16a8ea-7002-473c-9e4e-9b06c32f1109 service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:47.824584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:47.827088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:47.830802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:47.832170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] PATH_INFO: `/v3/users/981e1bf6531f45c4b8911579995eecc0` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:47.833893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981e1bf6531f45c4b8911579995eecc0)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:47.835939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:47.924361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981e1bf6531f45c4b8911579995eecc0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:47.952841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981e1bf6531f45c4b8911579995eecc0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:47.954035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981e1bf6531f45c4b8911579995eecc0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:47.955172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981e1bf6531f45c4b8911579995eecc0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:47.988800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981e1bf6531f45c4b8911579995eecc0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:48.054654 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3642/7247] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:47 2022] DELETE /identity/v3/users/981e1bf6531f45c4b8911579995eecc0 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:48.059671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ff4e4-cb1b-44f5-862c-d87110aac313 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:48.060077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ff4e4-cb1b-44f5-862c-d87110aac313 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:48.060357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ff4e4-cb1b-44f5-862c-d87110aac313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:48.098277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-311ff4e4-cb1b-44f5-862c-d87110aac313 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:48.101074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-311ff4e4-cb1b-44f5-862c-d87110aac313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:48.219771 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3606/7248] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:48.229721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:48.231303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:48.349326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1339672-cdcf-45b0-9e28-9d36c1597ff3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:48.353258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccc9a7-4964-4014-8091-394745cde463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:48.354057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccc9a7-4964-4014-8091-394745cde463 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:48.354348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccc9a7-4964-4014-8091-394745cde463 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:48.354629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccc9a7-4964-4014-8091-394745cde463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:48.365405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccc9a7-4964-4014-8091-394745cde463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:48.366872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccc9a7-4964-4014-8091-394745cde463 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:48.383585 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3643/7249] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:48.922962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ff4e4-cb1b-44f5-862c-d87110aac313 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:48.924919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-311ff4e4-cb1b-44f5-862c-d87110aac313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:48.946461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ff4e4-cb1b-44f5-862c-d87110aac313 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:48.960341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:48.961020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:48.961554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:48.962035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] PATH_INFO: `/v3/projects/fc922ea5d1564695ac143b86d7123f25` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:48.966258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc922ea5d1564695ac143b86d7123f25)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:48.968729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:49.048370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc922ea5d1564695ac143b86d7123f25', 'request_id': 'req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.062135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc922ea5d1564695ac143b86d7123f25', 'request_id': 'req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.073590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc922ea5d1564695ac143b86d7123f25', 'request_id': 'req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.099941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] The token cache is being invalidate because project fc922ea5d1564695ac143b86d7123f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:49.100242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.105282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.107188 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3607/7250] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:48 2022] DELETE /identity/v3/projects/fc922ea5d1564695ac143b86d7123f25 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:49.112069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccc9a7-4964-4014-8091-394745cde463 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:49.128877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccc9a7-4964-4014-8091-394745cde463 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:49.357902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:49.362529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:49.363447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:49.364471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] PATH_INFO: `/v3/users/9b6d5feb76034397937002fcd45c2ebd` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:49.366840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6d5feb76034397937002fcd45c2ebd)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:49.369227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:49.480561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6d5feb76034397937002fcd45c2ebd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.501567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6d5feb76034397937002fcd45c2ebd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.502330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6d5feb76034397937002fcd45c2ebd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.503478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6d5feb76034397937002fcd45c2ebd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.513319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6d5feb76034397937002fcd45c2ebd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:49.548063 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3644/7251] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:49 2022] DELETE /identity/v3/users/9b6d5feb76034397937002fcd45c2ebd => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:50.417020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:50.418641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:50.443401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a9960-cd1a-42a0-9d84-6fb118bc1a54 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:50.601899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:50.602628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:50.603169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:50.603516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] PATH_INFO: `/v3/projects/8692439ff0be4094bf83ca69d34e8b00` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:50.608985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8692439ff0be4094bf83ca69d34e8b00)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:50.612937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:50.704210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8692439ff0be4094bf83ca69d34e8b00', 'request_id': 'req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:50.727154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8692439ff0be4094bf83ca69d34e8b00', 'request_id': 'req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:50.758787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8692439ff0be4094bf83ca69d34e8b00', 'request_id': 'req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:50.786460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] The token cache is being invalidate because project 8692439ff0be4094bf83ca69d34e8b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:50.787790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:50.791821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:50.804745 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3608/7252] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:50 2022] DELETE /identity/v3/projects/8692439ff0be4094bf83ca69d34e8b00 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:50.810143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:50.812085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:50.850468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b9b7a9-3ea5-4873-aa06-2537de1eb774 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:50.961993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:50.976962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:50.977541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:50.978301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] PATH_INFO: `/v3/users/c73b47dca1de4527976932c2e883fb1a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:50.980079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c73b47dca1de4527976932c2e883fb1a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:50.988414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:51.105143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c73b47dca1de4527976932c2e883fb1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:51.115562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c73b47dca1de4527976932c2e883fb1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:51.116678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c73b47dca1de4527976932c2e883fb1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:51.117678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c73b47dca1de4527976932c2e883fb1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:51.133418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c73b47dca1de4527976932c2e883fb1a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:51.169793 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3645/7253] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:50 2022] DELETE /identity/v3/users/c73b47dca1de4527976932c2e883fb1a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:52.078084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:52.080661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:52.115644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd2ae8-5ad7-43de-8017-bffd198d1ae8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:52.211374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:52.212489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:52.212877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:52.213294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] PATH_INFO: `/v3/projects/9ea71753ae8c419c9a3aa67bd2f24583` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:52.214763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea71753ae8c419c9a3aa67bd2f24583)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:52.217359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:52.274573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea71753ae8c419c9a3aa67bd2f24583', 'request_id': 'req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:52.285535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea71753ae8c419c9a3aa67bd2f24583', 'request_id': 'req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:52.291603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea71753ae8c419c9a3aa67bd2f24583', 'request_id': 'req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:52.305480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] The token cache is being invalidate because project 9ea71753ae8c419c9a3aa67bd2f24583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:52.305758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:52.306867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:52.310072 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3609/7254] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:52 2022] DELETE /identity/v3/projects/9ea71753ae8c419c9a3aa67bd2f24583 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:53.561067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:53.570752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:53.594053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70661e2f-ec4f-42f5-9e83-d0c73ff6e589 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:53.762308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:53.763401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:53.764309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:53.764776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] PATH_INFO: `/v3/users/6aae7701ee964921bf4c26bb6c2a3793` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:53.766778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aae7701ee964921bf4c26bb6c2a3793)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:53.769890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:53.820888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:53.823034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:53.917291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aae7701ee964921bf4c26bb6c2a3793'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:53.926670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aae7701ee964921bf4c26bb6c2a3793'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:53.927644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aae7701ee964921bf4c26bb6c2a3793'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:53.928560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aae7701ee964921bf4c26bb6c2a3793'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:53.939324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd906f-ae26-4ed1-ae33-2f67c89f886f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:53.939979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4123db5f-7554-4518-8dfb-c9a925e75a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aae7701ee964921bf4c26bb6c2a3793'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:53.943258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:53.944196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:53.944496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:53.944778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:53.947015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:53.976389 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3646/7255] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:53 2022] DELETE /identity/v3/users/6aae7701ee964921bf4c26bb6c2a3793 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:53.980645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc949b-7f78-4903-afd4-515f9111219d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:53.981144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc949b-7f78-4903-afd4-515f9111219d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:53.981629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc949b-7f78-4903-afd4-515f9111219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:54.007886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-33dc949b-7f78-4903-afd4-515f9111219d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:54.009840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-33dc949b-7f78-4903-afd4-515f9111219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:54.039754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:54.041995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:54.057293 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3610/7256] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:14:54.097568 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3647/7257] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:54.103090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:54.104708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:54.437910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3cf52-06a8-411b-afa9-1f0098d8e314 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:54.515240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc6ba9-d50a-4f1f-9835-1e704a81aad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:54.516570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc6ba9-d50a-4f1f-9835-1e704a81aad0 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:54.517057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc6ba9-d50a-4f1f-9835-1e704a81aad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:54.517556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc6ba9-d50a-4f1f-9835-1e704a81aad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:54.532714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc6ba9-d50a-4f1f-9835-1e704a81aad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:54.535507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc6ba9-d50a-4f1f-9835-1e704a81aad0 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:54.552267 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3611/7258] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:55.449658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc949b-7f78-4903-afd4-515f9111219d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:55.451059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-33dc949b-7f78-4903-afd4-515f9111219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:55.465151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc949b-7f78-4903-afd4-515f9111219d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:55.472453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:55.474213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:55.475514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:55.476083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] PATH_INFO: `/v3/projects/ec80ad7623e04c9180216b5bb1a38f1e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:55.477765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec80ad7623e04c9180216b5bb1a38f1e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:55.481205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:55.575985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec80ad7623e04c9180216b5bb1a38f1e', 'request_id': 'req-dcd706fa-1554-48fd-9464-a63a104d5a22'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:55.593169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec80ad7623e04c9180216b5bb1a38f1e', 'request_id': 'req-dcd706fa-1554-48fd-9464-a63a104d5a22'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:55.600292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec80ad7623e04c9180216b5bb1a38f1e', 'request_id': 'req-dcd706fa-1554-48fd-9464-a63a104d5a22'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:55.627147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] The token cache is being invalidate because project ec80ad7623e04c9180216b5bb1a38f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:14:55.627550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:55.628195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dcd706fa-1554-48fd-9464-a63a104d5a22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:55.630548 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3648/7259] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:14:55 2022] DELETE /identity/v3/projects/ec80ad7623e04c9180216b5bb1a38f1e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:55.635430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e24d4-366e-40eb-887d-b6b72ba267b7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:55.636402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e24d4-366e-40eb-887d-b6b72ba267b7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:55.636906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e24d4-366e-40eb-887d-b6b72ba267b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:55.665761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a63e24d4-366e-40eb-887d-b6b72ba267b7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:55.672146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a63e24d4-366e-40eb-887d-b6b72ba267b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:55.808780 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3612/7260] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:55.821005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3e747-9646-439f-aa1f-923029a488b7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:55.821776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3e747-9646-439f-aa1f-923029a488b7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:55.822227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3e747-9646-439f-aa1f-923029a488b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:55.848840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d4a3e747-9646-439f-aa1f-923029a488b7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:55.850506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d4a3e747-9646-439f-aa1f-923029a488b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:55.861889 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3649/7261] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:55.866566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e24d4-366e-40eb-887d-b6b72ba267b7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:55.904522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e24d4-366e-40eb-887d-b6b72ba267b7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:55.911951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464c19-6023-4985-b0da-883b64f3f037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:55.912777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464c19-6023-4985-b0da-883b64f3f037 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:55.913306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464c19-6023-4985-b0da-883b64f3f037 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:55.913797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84464c19-6023-4985-b0da-883b64f3f037 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:55.914563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84464c19-6023-4985-b0da-883b64f3f037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:14:55.914872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84464c19-6023-4985-b0da-883b64f3f037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:55.917450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84464c19-6023-4985-b0da-883b64f3f037 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:55.959807 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3613/7262] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:14:55.965060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3e747-9646-439f-aa1f-923029a488b7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:55.980110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3e747-9646-439f-aa1f-923029a488b7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:55.991367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be3881-f1a0-4487-a329-c0034eb090fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:55.993382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be3881-f1a0-4487-a329-c0034eb090fc admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:55.993999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be3881-f1a0-4487-a329-c0034eb090fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:55.994510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be3881-f1a0-4487-a329-c0034eb090fc admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:55.995474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be3881-f1a0-4487-a329-c0034eb090fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:55.998005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be3881-f1a0-4487-a329-c0034eb090fc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:56.039893 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3650/7263] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:14:55 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:56.045174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464c19-6023-4985-b0da-883b64f3f037 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:56.059369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84464c19-6023-4985-b0da-883b64f3f037 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:56.149444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a072fa-da1e-4d6f-a43f-82f6d166290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:56.150672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a072fa-da1e-4d6f-a43f-82f6d166290d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.151206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a072fa-da1e-4d6f-a43f-82f6d166290d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.151704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a072fa-da1e-4d6f-a43f-82f6d166290d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:56.152665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a072fa-da1e-4d6f-a43f-82f6d166290d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:56.155349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a072fa-da1e-4d6f-a43f-82f6d166290d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:56.187484 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3614/7264] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:14:56 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:56.192256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be3881-f1a0-4487-a329-c0034eb090fc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:56.212459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be3881-f1a0-4487-a329-c0034eb090fc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:56.221020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a888a-e07c-424b-9de5-cd2917547b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:56.222166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a888a-e07c-424b-9de5-cd2917547b59 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.223391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a888a-e07c-424b-9de5-cd2917547b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.223905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a888a-e07c-424b-9de5-cd2917547b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:56.225135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a888a-e07c-424b-9de5-cd2917547b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:56.227275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a888a-e07c-424b-9de5-cd2917547b59 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:56.249587 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3651/7265] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:56.254565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a072fa-da1e-4d6f-a43f-82f6d166290d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:56.266471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a072fa-da1e-4d6f-a43f-82f6d166290d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:56.275057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235bf0c-7429-4fbe-896c-765bca90023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:56.276809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235bf0c-7429-4fbe-896c-765bca90023a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.277189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235bf0c-7429-4fbe-896c-765bca90023a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.277524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235bf0c-7429-4fbe-896c-765bca90023a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:56.278461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235bf0c-7429-4fbe-896c-765bca90023a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:56.280229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235bf0c-7429-4fbe-896c-765bca90023a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:56.293509 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3615/7266] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:56.298339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a888a-e07c-424b-9de5-cd2917547b59 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:56.321883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a888a-e07c-424b-9de5-cd2917547b59 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:56.330580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd3f98-74ae-4372-9fd8-f6f60260d08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:56.332914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd3f98-74ae-4372-9fd8-f6f60260d08e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.333127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd3f98-74ae-4372-9fd8-f6f60260d08e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.333350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd3f98-74ae-4372-9fd8-f6f60260d08e admin admin] PATH_INFO: `/v3/projects/0052e183717046b5bd0d5700fc86cc91/users/ca4d7925566241e6a5100366bad375fb/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:56.364768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd3f98-74ae-4372-9fd8-f6f60260d08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0052e183717046b5bd0d5700fc86cc91, user_id=ca4d7925566241e6a5100366bad375fb, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:56.370519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd3f98-74ae-4372-9fd8-f6f60260d08e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:56.403741 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3652/7267] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:56 2022] PUT /identity/v3/projects/0052e183717046b5bd0d5700fc86cc91/users/ca4d7925566241e6a5100366bad375fb/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:56.415800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6698142-1d67-4991-9c46-2a51976c1f97 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.416116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6698142-1d67-4991-9c46-2a51976c1f97 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.418460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6698142-1d67-4991-9c46-2a51976c1f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:56.457613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a6698142-1d67-4991-9c46-2a51976c1f97 None None] MFA Rules not processed for user `ca4d7925566241e6a5100366bad375fb`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:56.459167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a6698142-1d67-4991-9c46-2a51976c1f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:56.463097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a428-9811-4309-b227-2e0034ad0669 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.463597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a428-9811-4309-b227-2e0034ad0669 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.463752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20a428-9811-4309-b227-2e0034ad0669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:56.496078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cb20a428-9811-4309-b227-2e0034ad0669 None None] MFA Rules not processed for user `41ad4fbc224446efaf5ad85c8c87eeab`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:56.500156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cb20a428-9811-4309-b227-2e0034ad0669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:56.552750 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3616/7268] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:56.553883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6698142-1d67-4991-9c46-2a51976c1f97 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:56.605150 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3653/7269] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:14:56.708584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6698142-1d67-4991-9c46-2a51976c1f97 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:56.722765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff623a3-f330-45b1-80bb-2f615dddefbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:56.723532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff623a3-f330-45b1-80bb-2f615dddefbd admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.724090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff623a3-f330-45b1-80bb-2f615dddefbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.724588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff623a3-f330-45b1-80bb-2f615dddefbd admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:56.725506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff623a3-f330-45b1-80bb-2f615dddefbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:56.727654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff623a3-f330-45b1-80bb-2f615dddefbd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:56.770971 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3617/7270] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:14:56 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:14:56.771888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20a428-9811-4309-b227-2e0034ad0669 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:56.786630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20a428-9811-4309-b227-2e0034ad0669 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:56.869980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bf654-8c3d-4a9d-81ac-216bef097468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:56.870826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bf654-8c3d-4a9d-81ac-216bef097468 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.871208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bf654-8c3d-4a9d-81ac-216bef097468 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.871599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bf654-8c3d-4a9d-81ac-216bef097468 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:56.872852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bf654-8c3d-4a9d-81ac-216bef097468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:56.874792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bf654-8c3d-4a9d-81ac-216bef097468 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:56.915910 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3654/7271] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:14:56 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:14:56.920329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff623a3-f330-45b1-80bb-2f615dddefbd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:56.945131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff623a3-f330-45b1-80bb-2f615dddefbd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:56.950230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6710724-48e6-4316-a2f5-edec79887fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:56.951023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6710724-48e6-4316-a2f5-edec79887fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.951559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6710724-48e6-4316-a2f5-edec79887fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.952249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6710724-48e6-4316-a2f5-edec79887fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:56.953295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6710724-48e6-4316-a2f5-edec79887fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:56.955049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6710724-48e6-4316-a2f5-edec79887fd7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:56.967124 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3618/7272] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:14:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:14:56.977459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bf654-8c3d-4a9d-81ac-216bef097468 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:56.991862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bf654-8c3d-4a9d-81ac-216bef097468 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:56.997635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f65357-bb83-4800-887b-a7e6f0d55352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:56.998575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f65357-bb83-4800-887b-a7e6f0d55352 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:56.998860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f65357-bb83-4800-887b-a7e6f0d55352 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:56.999135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f65357-bb83-4800-887b-a7e6f0d55352 admin admin] PATH_INFO: `/v3/projects/03b58c5d8b9b483b8e43f9f596800da5/users/61aa4049e66348888374e82dc257ce63/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:57.025492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f65357-bb83-4800-887b-a7e6f0d55352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b58c5d8b9b483b8e43f9f596800da5, user_id=61aa4049e66348888374e82dc257ce63, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:57.031992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f65357-bb83-4800-887b-a7e6f0d55352 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:57.056456 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3655/7273] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:14:56 2022] PUT /identity/v3/projects/03b58c5d8b9b483b8e43f9f596800da5/users/61aa4049e66348888374e82dc257ce63/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:57.066880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef52a4-5a6f-46c2-9c87-33ff7b972450 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:57.067166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef52a4-5a6f-46c2-9c87-33ff7b972450 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:57.067441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef52a4-5a6f-46c2-9c87-33ff7b972450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:57.109442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-15ef52a4-5a6f-46c2-9c87-33ff7b972450 None None] MFA Rules not processed for user `61aa4049e66348888374e82dc257ce63`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:57.111624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-15ef52a4-5a6f-46c2-9c87-33ff7b972450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:57.213314 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3619/7274] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3259 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:57.261594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f65357-bb83-4800-887b-a7e6f0d55352 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:57.265363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07f65357-bb83-4800-887b-a7e6f0d55352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:57.391991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f65357-bb83-4800-887b-a7e6f0d55352 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:57.399058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03535a8-041e-4460-8acd-fd1a8ce3b5aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:57.400699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03535a8-041e-4460-8acd-fd1a8ce3b5aa service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:57.401272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03535a8-041e-4460-8acd-fd1a8ce3b5aa service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:57.401656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03535a8-041e-4460-8acd-fd1a8ce3b5aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:57.422739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03535a8-041e-4460-8acd-fd1a8ce3b5aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:57.427131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03535a8-041e-4460-8acd-fd1a8ce3b5aa service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:57.442897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3656/7275] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:14:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 678 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:14:58.211236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef52a4-5a6f-46c2-9c87-33ff7b972450 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:58.212756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-15ef52a4-5a6f-46c2-9c87-33ff7b972450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:58.441489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef52a4-5a6f-46c2-9c87-33ff7b972450 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:58.474649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:58.476079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:58.476594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:58.477483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:58.480410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:58.517012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:58.521384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:58.539406 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3620/7276] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:14:58.668329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03535a8-041e-4460-8acd-fd1a8ce3b5aa service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:58.803622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03535a8-041e-4460-8acd-fd1a8ce3b5aa service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:58.810420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:58.811678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:58.812225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:58.812722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] PATH_INFO: `/v3/users/ca4d7925566241e6a5100366bad375fb` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:58.814627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca4d7925566241e6a5100366bad375fb)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:58.818888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:58.896908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca4d7925566241e6a5100366bad375fb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:58.912746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca4d7925566241e6a5100366bad375fb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:58.915632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca4d7925566241e6a5100366bad375fb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:58.916955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca4d7925566241e6a5100366bad375fb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:58.946450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-67694e84-4d10-4637-a78d-c74114312cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca4d7925566241e6a5100366bad375fb'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:14:58.957728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:58.959840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:59.052909 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3657/7277] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:14:58 2022] DELETE /identity/v3/users/ca4d7925566241e6a5100366bad375fb => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:14:59.058176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b6a8-5eba-4d65-bf6e-5b6eb9cf2a20 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:59.058471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b6a8-5eba-4d65-bf6e-5b6eb9cf2a20 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:59.058756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354b6a8-5eba-4d65-bf6e-5b6eb9cf2a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:59.095071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2354b6a8-5eba-4d65-bf6e-5b6eb9cf2a20 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:14:59.097669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2354b6a8-5eba-4d65-bf6e-5b6eb9cf2a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:59.120840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca82e9a-24a6-4b4f-9ec1-038ec27e5b27 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:59.212188 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3658/7278] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:14:59.226433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354b6a8-5eba-4d65-bf6e-5b6eb9cf2a20 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:14:59.227865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2354b6a8-5eba-4d65-bf6e-5b6eb9cf2a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:59.286244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:59.288167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:59.288663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:59.289333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:59.293636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:14:59.320179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:59.322126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:59.362862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354b6a8-5eba-4d65-bf6e-5b6eb9cf2a20 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:14:59.388350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238763eb-26e7-40d4-9efc-efa98720be8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:14:59.389028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238763eb-26e7-40d4-9efc-efa98720be8f service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:14:59.389315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238763eb-26e7-40d4-9efc-efa98720be8f service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:14:59.395988 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3621/7279] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:14:59.396480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238763eb-26e7-40d4-9efc-efa98720be8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:14:59.422792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238763eb-26e7-40d4-9efc-efa98720be8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:14:59.426459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238763eb-26e7-40d4-9efc-efa98720be8f service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:14:59.452138 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3659/7280] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:00.142147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:00.144953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:00.169279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829f409-fd36-4212-b092-9463874a92c3 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:00.176055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:00.177234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:00.178401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:00.178774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] PATH_INFO: `/v3/projects/0052e183717046b5bd0d5700fc86cc91` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:00.180660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0052e183717046b5bd0d5700fc86cc91)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:00.182666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:00.294028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0052e183717046b5bd0d5700fc86cc91', 'request_id': 'req-04caf855-8980-460d-a52e-ad1a5a87fdc2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.313624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0052e183717046b5bd0d5700fc86cc91', 'request_id': 'req-04caf855-8980-460d-a52e-ad1a5a87fdc2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.326183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0052e183717046b5bd0d5700fc86cc91', 'request_id': 'req-04caf855-8980-460d-a52e-ad1a5a87fdc2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.348345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] The token cache is being invalidate because project 0052e183717046b5bd0d5700fc86cc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:00.348918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.351005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.354259 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3622/7281] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:00 2022] DELETE /identity/v3/projects/0052e183717046b5bd0d5700fc86cc91 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:00.358101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238763eb-26e7-40d4-9efc-efa98720be8f service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:00.376752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238763eb-26e7-40d4-9efc-efa98720be8f service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:00.460884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:00.461858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:00.462201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:00.462631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] PATH_INFO: `/v3/users/61aa4049e66348888374e82dc257ce63` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:00.468408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] RBAC: Authorizing `identity:delete_user(user_id=61aa4049e66348888374e82dc257ce63)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:00.470650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:00.606295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61aa4049e66348888374e82dc257ce63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.626850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61aa4049e66348888374e82dc257ce63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.627863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61aa4049e66348888374e82dc257ce63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.630074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61aa4049e66348888374e82dc257ce63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.645159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61aa4049e66348888374e82dc257ce63'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:00.701400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3660/7282] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:00 2022] DELETE /identity/v3/users/61aa4049e66348888374e82dc257ce63 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:02.230622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:02.233343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:02.251522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04caf855-8980-460d-a52e-ad1a5a87fdc2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:02.334171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:02.335372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:02.336349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:02.336494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:02.336937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] PATH_INFO: `/v3/projects/03b58c5d8b9b483b8e43f9f596800da5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:02.337790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:02.338108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b58c5d8b9b483b8e43f9f596800da5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:02.340192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:02.358599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996eafa1-5b16-49bf-82c4-395eb342570b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:02.370095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:02.370988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:02.371314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:02.371708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] PATH_INFO: `/v3/users/dd05073d7e52411c92d7b9def363dd50` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:02.375018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd05073d7e52411c92d7b9def363dd50)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:02.380583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:02.408040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b58c5d8b9b483b8e43f9f596800da5', 'request_id': 'req-3c37217f-5605-4f42-9c9e-ff84945acc00'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.425835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b58c5d8b9b483b8e43f9f596800da5', 'request_id': 'req-3c37217f-5605-4f42-9c9e-ff84945acc00'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.442805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b58c5d8b9b483b8e43f9f596800da5', 'request_id': 'req-3c37217f-5605-4f42-9c9e-ff84945acc00'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.462365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd05073d7e52411c92d7b9def363dd50'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.467195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] The token cache is being invalidate because project 03b58c5d8b9b483b8e43f9f596800da5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:02.467687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.469968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3c37217f-5605-4f42-9c9e-ff84945acc00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.474407 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3623/7283] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:02 2022] DELETE /identity/v3/projects/03b58c5d8b9b483b8e43f9f596800da5 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:02.478785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd05073d7e52411c92d7b9def363dd50'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.479601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3695f2-62ed-40df-9562-cd6c6b070f82 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:02.479790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd05073d7e52411c92d7b9def363dd50'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.480503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd05073d7e52411c92d7b9def363dd50'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.482877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3695f2-62ed-40df-9562-cd6c6b070f82 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:02.483592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3695f2-62ed-40df-9562-cd6c6b070f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:02.501189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-1f7e1c47-38cc-4a94-8915-dd2c7128d806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd05073d7e52411c92d7b9def363dd50'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:02.536744 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3661/7284] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:02 2022] DELETE /identity/v3/users/dd05073d7e52411c92d7b9def363dd50 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:02.540908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0e3695f2-62ed-40df-9562-cd6c6b070f82 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:02.543482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0e3695f2-62ed-40df-9562-cd6c6b070f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:02.670632 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3624/7285] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:02.678167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972439c-15c3-4a8f-b841-bc2f03cadc62 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:02.678541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972439c-15c3-4a8f-b841-bc2f03cadc62 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:02.679369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972439c-15c3-4a8f-b841-bc2f03cadc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:02.722349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1972439c-15c3-4a8f-b841-bc2f03cadc62 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:02.726532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1972439c-15c3-4a8f-b841-bc2f03cadc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:02.751007 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3662/7286] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:02.757039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3695f2-62ed-40df-9562-cd6c6b070f82 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:02.766965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3695f2-62ed-40df-9562-cd6c6b070f82 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:02.773771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91296395-d1c4-41c4-a4ce-a77ff7487c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:02.775461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91296395-d1c4-41c4-a4ce-a77ff7487c18 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:02.775993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91296395-d1c4-41c4-a4ce-a77ff7487c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:02.776449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91296395-d1c4-41c4-a4ce-a77ff7487c18 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:02.777362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91296395-d1c4-41c4-a4ce-a77ff7487c18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:02.777853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91296395-d1c4-41c4-a4ce-a77ff7487c18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:02.779702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91296395-d1c4-41c4-a4ce-a77ff7487c18 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:02.805258 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3625/7287] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:02.809381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972439c-15c3-4a8f-b841-bc2f03cadc62 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:02.824697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972439c-15c3-4a8f-b841-bc2f03cadc62 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:02.832014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a360dd3-3c53-4953-818d-a9066398f04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:02.832995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a360dd3-3c53-4953-818d-a9066398f04a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:02.835054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a360dd3-3c53-4953-818d-a9066398f04a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:02.835614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a360dd3-3c53-4953-818d-a9066398f04a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:02.836573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a360dd3-3c53-4953-818d-a9066398f04a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:02.838725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a360dd3-3c53-4953-818d-a9066398f04a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:02.879840 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3663/7288] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:02 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:02.883555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91296395-d1c4-41c4-a4ce-a77ff7487c18 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:02.899565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91296395-d1c4-41c4-a4ce-a77ff7487c18 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:03.048104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330bd16-a5e7-4814-a636-dbc0bc49f5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:03.051091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330bd16-a5e7-4814-a636-dbc0bc49f5fe admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:03.051381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330bd16-a5e7-4814-a636-dbc0bc49f5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:03.051731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330bd16-a5e7-4814-a636-dbc0bc49f5fe admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:03.052470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330bd16-a5e7-4814-a636-dbc0bc49f5fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:03.054419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330bd16-a5e7-4814-a636-dbc0bc49f5fe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:03.116609 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3626/7289] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:02 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:03.120682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a360dd3-3c53-4953-818d-a9066398f04a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:03.141142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a360dd3-3c53-4953-818d-a9066398f04a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:03.156216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7b56-0de9-4449-8a10-498edd7b4cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:03.157353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7b56-0de9-4449-8a10-498edd7b4cdf admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:03.157911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7b56-0de9-4449-8a10-498edd7b4cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:03.158466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a7b56-0de9-4449-8a10-498edd7b4cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:03.159760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7b56-0de9-4449-8a10-498edd7b4cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:03.162136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a7b56-0de9-4449-8a10-498edd7b4cdf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:03.181335 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3664/7290] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:03.182633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330bd16-a5e7-4814-a636-dbc0bc49f5fe admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:03.212209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330bd16-a5e7-4814-a636-dbc0bc49f5fe admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:03.227745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af03ca-3712-4952-8144-325b127b963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:03.228899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af03ca-3712-4952-8144-325b127b963a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:03.229181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af03ca-3712-4952-8144-325b127b963a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:03.229452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af03ca-3712-4952-8144-325b127b963a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:03.230940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af03ca-3712-4952-8144-325b127b963a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:03.231895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af03ca-3712-4952-8144-325b127b963a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:03.245329 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3627/7291] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:03.249794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7b56-0de9-4449-8a10-498edd7b4cdf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:03.269170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af03ca-3712-4952-8144-325b127b963a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:03.276733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-22af03ca-3712-4952-8144-325b127b963a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:03.278722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a7b56-0de9-4449-8a10-498edd7b4cdf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:03.286210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ff974-f161-4b16-809e-fb8ea496dfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:03.287339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ff974-f161-4b16-809e-fb8ea496dfa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:03.287686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ff974-f161-4b16-809e-fb8ea496dfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:03.288841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ff974-f161-4b16-809e-fb8ea496dfa5 admin admin] PATH_INFO: `/v3/projects/1a14cf15734c4aa881ff16a0bc734242/users/7ac02d48a08c4284ae0c82008c970e7f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:03.309515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af03ca-3712-4952-8144-325b127b963a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:03.312317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ff974-f161-4b16-809e-fb8ea496dfa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a14cf15734c4aa881ff16a0bc734242, user_id=7ac02d48a08c4284ae0c82008c970e7f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:03.317339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ff974-f161-4b16-809e-fb8ea496dfa5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:03.330691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:03.331682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:03.331975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:03.332255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] PATH_INFO: `/v3/projects/a821ba46f3f5408ab82098a1d2d8a926` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:03.336281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a821ba46f3f5408ab82098a1d2d8a926)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:03.338254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:03.339102 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3665/7292] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:03 2022] PUT /identity/v3/projects/1a14cf15734c4aa881ff16a0bc734242/users/7ac02d48a08c4284ae0c82008c970e7f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:03.344913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa61b5e-1a52-4f0d-9338-bf307792cf97 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:03.347609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa61b5e-1a52-4f0d-9338-bf307792cf97 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:03.348186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa61b5e-1a52-4f0d-9338-bf307792cf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:03.404646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6aa61b5e-1a52-4f0d-9338-bf307792cf97 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:03.406099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6aa61b5e-1a52-4f0d-9338-bf307792cf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:03.468008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a821ba46f3f5408ab82098a1d2d8a926', 'request_id': 'req-86c9a567-0b4d-4736-ad10-55d04fa7ba42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.488735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a821ba46f3f5408ab82098a1d2d8a926', 'request_id': 'req-86c9a567-0b4d-4736-ad10-55d04fa7ba42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.498458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a821ba46f3f5408ab82098a1d2d8a926', 'request_id': 'req-86c9a567-0b4d-4736-ad10-55d04fa7ba42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.523999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] The token cache is being invalidate because project a821ba46f3f5408ab82098a1d2d8a926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:03.525272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.527365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.528514 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3666/7293] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:03.532724 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3628/7294] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:03 2022] DELETE /identity/v3/projects/a821ba46f3f5408ab82098a1d2d8a926 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:03.541785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa61b5e-1a52-4f0d-9338-bf307792cf97 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:03.551322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:03.553126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:03.554863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa61b5e-1a52-4f0d-9338-bf307792cf97 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:03.632056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:03.633050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:03.634017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:03.634400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] PATH_INFO: `/v3/users/0ba639b89f7c49a18b63829c6223a058` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:03.635737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba639b89f7c49a18b63829c6223a058)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:03.638643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:03.690717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9a567-0b4d-4736-ad10-55d04fa7ba42 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:03.699499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:03.701316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:03.701569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:03.701853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:03.709173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:03.727977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:03.730601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:03.746670 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3629/7295] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:03.756685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba639b89f7c49a18b63829c6223a058'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.760725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba639b89f7c49a18b63829c6223a058'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.772508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba639b89f7c49a18b63829c6223a058'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.774133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba639b89f7c49a18b63829c6223a058'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.791601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-06afdc0b-78d0-4776-b949-85d77691504a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba639b89f7c49a18b63829c6223a058'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:03.826613 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3667/7296] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:03 2022] DELETE /identity/v3/users/0ba639b89f7c49a18b63829c6223a058 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:04.561409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:04.564455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:04.594870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9a049-6349-419d-8e80-b329af3562f1 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:04.667826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:04.668936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:04.669380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:04.669826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] PATH_INFO: `/v3/projects/77943410921f4996909908ab6806a2a1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:04.671426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77943410921f4996909908ab6806a2a1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:04.673691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:04.770920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77943410921f4996909908ab6806a2a1', 'request_id': 'req-6278a8be-183a-43dd-8412-8b4f23f84b2d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:04.784558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77943410921f4996909908ab6806a2a1', 'request_id': 'req-6278a8be-183a-43dd-8412-8b4f23f84b2d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:04.793813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77943410921f4996909908ab6806a2a1', 'request_id': 'req-6278a8be-183a-43dd-8412-8b4f23f84b2d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:04.813569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] The token cache is being invalidate because project 77943410921f4996909908ab6806a2a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:04.814151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:04.816412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6278a8be-183a-43dd-8412-8b4f23f84b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:04.821497 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3630/7297] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:04 2022] DELETE /identity/v3/projects/77943410921f4996909908ab6806a2a1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:04.829123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4cc95-eab2-4f9c-830b-337e2c3b3913 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:04.830028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4cc95-eab2-4f9c-830b-337e2c3b3913 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:04.831811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b4cc95-eab2-4f9c-830b-337e2c3b3913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:04.882330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-74b4cc95-eab2-4f9c-830b-337e2c3b3913 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:04.885997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-74b4cc95-eab2-4f9c-830b-337e2c3b3913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:05.026362 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3668/7298] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:05.034434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14f85-bfba-4dc3-a338-fd9a99d51c5b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:05.034845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14f85-bfba-4dc3-a338-fd9a99d51c5b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:05.035147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14f85-bfba-4dc3-a338-fd9a99d51c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:05.058624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8ff14f85-bfba-4dc3-a338-fd9a99d51c5b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:05.060515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8ff14f85-bfba-4dc3-a338-fd9a99d51c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:05.083584 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3631/7299] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:05.087964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4cc95-eab2-4f9c-830b-337e2c3b3913 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:05.109284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b4cc95-eab2-4f9c-830b-337e2c3b3913 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:05.119770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274de95-290f-4e92-904e-635f9eb8ffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:05.121669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274de95-290f-4e92-904e-635f9eb8ffb9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:05.122202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274de95-290f-4e92-904e-635f9eb8ffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:05.122701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274de95-290f-4e92-904e-635f9eb8ffb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:05.126513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274de95-290f-4e92-904e-635f9eb8ffb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:05.127423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274de95-290f-4e92-904e-635f9eb8ffb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:05.130690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274de95-290f-4e92-904e-635f9eb8ffb9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:05.146333 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3669/7300] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:05.151879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14f85-bfba-4dc3-a338-fd9a99d51c5b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:05.167194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff14f85-bfba-4dc3-a338-fd9a99d51c5b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:05.178871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8f2fb-2e6d-481a-b631-55f9e9cff703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:05.180340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8f2fb-2e6d-481a-b631-55f9e9cff703 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:05.180849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8f2fb-2e6d-481a-b631-55f9e9cff703 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:05.181199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8f2fb-2e6d-481a-b631-55f9e9cff703 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:05.182307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8f2fb-2e6d-481a-b631-55f9e9cff703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:05.185640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8f2fb-2e6d-481a-b631-55f9e9cff703 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:05.230583 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3632/7301] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:05 2022] POST /identity/v3/projects => generated 401 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:05.235132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274de95-290f-4e92-904e-635f9eb8ffb9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:05.247742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274de95-290f-4e92-904e-635f9eb8ffb9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:05.341425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8327506-fccb-48fd-8333-283d4168ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:05.342264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8327506-fccb-48fd-8333-283d4168ef17 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:05.343668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8327506-fccb-48fd-8333-283d4168ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:05.344084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8327506-fccb-48fd-8333-283d4168ef17 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:05.344871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8327506-fccb-48fd-8333-283d4168ef17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:05.348764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8327506-fccb-48fd-8333-283d4168ef17 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:05.389104 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3670/7302] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:05 2022] POST /identity/v3/users => generated 301 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:05.393753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8f2fb-2e6d-481a-b631-55f9e9cff703 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:05.410598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8f2fb-2e6d-481a-b631-55f9e9cff703 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:05.425804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c72e5-b59b-40a9-96f9-bc237755e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:05.427113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c72e5-b59b-40a9-96f9-bc237755e148 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:05.427618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c72e5-b59b-40a9-96f9-bc237755e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:05.429358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1c72e5-b59b-40a9-96f9-bc237755e148 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:05.430988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c72e5-b59b-40a9-96f9-bc237755e148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:05.436284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1c72e5-b59b-40a9-96f9-bc237755e148 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:05.463957 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3633/7303] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:05.464771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8327506-fccb-48fd-8333-283d4168ef17 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:05.494567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8327506-fccb-48fd-8333-283d4168ef17 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:05.501528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879654-5d36-46cd-963b-15901c9fc5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:05.502310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879654-5d36-46cd-963b-15901c9fc5bd admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:05.502810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879654-5d36-46cd-963b-15901c9fc5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:05.503283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879654-5d36-46cd-963b-15901c9fc5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:05.504515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879654-5d36-46cd-963b-15901c9fc5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:05.506207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879654-5d36-46cd-963b-15901c9fc5bd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:05.527402 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3671/7304] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:05.530914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c72e5-b59b-40a9-96f9-bc237755e148 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:05.560297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1c72e5-b59b-40a9-96f9-bc237755e148 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:05.570428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f758e-5d5e-4246-b725-a410fe3f4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:05.571639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f758e-5d5e-4246-b725-a410fe3f4d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:05.572168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f758e-5d5e-4246-b725-a410fe3f4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:05.572537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f758e-5d5e-4246-b725-a410fe3f4d5a admin admin] PATH_INFO: `/v3/projects/8f13a4f0368b4ba497a6349e890740db/users/c7e7cc0731eb42438bb2a9b822750e7e/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:05.595579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f758e-5d5e-4246-b725-a410fe3f4d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f13a4f0368b4ba497a6349e890740db, user_id=c7e7cc0731eb42438bb2a9b822750e7e, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:05.600215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f758e-5d5e-4246-b725-a410fe3f4d5a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:05.622485 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3634/7305] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:05 2022] PUT /identity/v3/projects/8f13a4f0368b4ba497a6349e890740db/users/c7e7cc0731eb42438bb2a9b822750e7e/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:05.636800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d19ce-5c9f-42b2-8ee7-a1a399cd6626 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:05.637881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d19ce-5c9f-42b2-8ee7-a1a399cd6626 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:05.638332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d19ce-5c9f-42b2-8ee7-a1a399cd6626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:05.694260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-655d19ce-5c9f-42b2-8ee7-a1a399cd6626 None None] MFA Rules not processed for user `c7e7cc0731eb42438bb2a9b822750e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:05.704178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-655d19ce-5c9f-42b2-8ee7-a1a399cd6626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:05.860889 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3672/7306] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:05.876123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f758e-5d5e-4246-b725-a410fe3f4d5a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:06.023315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f758e-5d5e-4246-b725-a410fe3f4d5a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:06.036419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:06.038784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:06.039251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:06.039714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] PATH_INFO: `/v3/users/c7e7cc0731eb42438bb2a9b822750e7e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:06.042610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e7cc0731eb42438bb2a9b822750e7e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:06.045008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:06.138918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e7cc0731eb42438bb2a9b822750e7e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:06.151015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e7cc0731eb42438bb2a9b822750e7e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:06.153731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e7cc0731eb42438bb2a9b822750e7e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:06.154609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e7cc0731eb42438bb2a9b822750e7e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:06.176246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e7cc0731eb42438bb2a9b822750e7e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:06.198346 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3635/7307] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:05 2022] DELETE /identity/v3/users/c7e7cc0731eb42438bb2a9b822750e7e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:06.203423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42983d-9974-4196-85a1-c0be7329b90b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:06.203944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42983d-9974-4196-85a1-c0be7329b90b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:06.204544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42983d-9974-4196-85a1-c0be7329b90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:06.239140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1e42983d-9974-4196-85a1-c0be7329b90b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:06.239140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1e42983d-9974-4196-85a1-c0be7329b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:06.420480 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3673/7308] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:06.436742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:06.439786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:06.602780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc6b56-a822-43dd-bebc-aaa2e3c2a5fd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:06.617688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db11b15-e35d-41e7-bffd-d9a77090597a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:06.618673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11b15-e35d-41e7-bffd-d9a77090597a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:06.619192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11b15-e35d-41e7-bffd-d9a77090597a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:06.620155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db11b15-e35d-41e7-bffd-d9a77090597a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:06.645932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11b15-e35d-41e7-bffd-d9a77090597a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:06.656582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db11b15-e35d-41e7-bffd-d9a77090597a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:06.687475 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3636/7309] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:08.160990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42983d-9974-4196-85a1-c0be7329b90b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:08.162647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1e42983d-9974-4196-85a1-c0be7329b90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:08.191688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42983d-9974-4196-85a1-c0be7329b90b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:08.219155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:08.221160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:08.221423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:08.221710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] PATH_INFO: `/v3/projects/8f13a4f0368b4ba497a6349e890740db` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:08.225336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f13a4f0368b4ba497a6349e890740db)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:08.227307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:08.382308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f13a4f0368b4ba497a6349e890740db', 'request_id': 'req-99b73bc3-234a-4f6f-ad75-51057e93054d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:08.399189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f13a4f0368b4ba497a6349e890740db', 'request_id': 'req-99b73bc3-234a-4f6f-ad75-51057e93054d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:08.413908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f13a4f0368b4ba497a6349e890740db', 'request_id': 'req-99b73bc3-234a-4f6f-ad75-51057e93054d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:08.438802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] The token cache is being invalidate because project 8f13a4f0368b4ba497a6349e890740db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:08.439298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:08.441738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99b73bc3-234a-4f6f-ad75-51057e93054d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:08.445754 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3674/7310] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:08 2022] DELETE /identity/v3/projects/8f13a4f0368b4ba497a6349e890740db => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:08.451596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f97ed-836d-4d10-956e-0c404e84a6b6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:08.452379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f97ed-836d-4d10-956e-0c404e84a6b6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:08.452379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f97ed-836d-4d10-956e-0c404e84a6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:08.480863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-eb3f97ed-836d-4d10-956e-0c404e84a6b6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:08.485593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-eb3f97ed-836d-4d10-956e-0c404e84a6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:08.584136 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3637/7311] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:08.586920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82e7f-5875-4968-8ef6-1b7fccdaa4ad None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:08.587851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82e7f-5875-4968-8ef6-1b7fccdaa4ad None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:08.589020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a82e7f-5875-4968-8ef6-1b7fccdaa4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:08.629906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e4a82e7f-5875-4968-8ef6-1b7fccdaa4ad None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:08.631346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e4a82e7f-5875-4968-8ef6-1b7fccdaa4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:08.641275 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3675/7312] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:08.646555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f97ed-836d-4d10-956e-0c404e84a6b6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:08.657127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f97ed-836d-4d10-956e-0c404e84a6b6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:08.663512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be883b4-8422-4647-9dc0-9534275aa0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:08.664448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be883b4-8422-4647-9dc0-9534275aa0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:08.664929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be883b4-8422-4647-9dc0-9534275aa0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:08.665393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be883b4-8422-4647-9dc0-9534275aa0c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:08.666309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be883b4-8422-4647-9dc0-9534275aa0c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:08.666788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be883b4-8422-4647-9dc0-9534275aa0c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:08.669155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be883b4-8422-4647-9dc0-9534275aa0c1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:08.691199 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3638/7313] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:08.692311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a82e7f-5875-4968-8ef6-1b7fccdaa4ad None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:08.702709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a82e7f-5875-4968-8ef6-1b7fccdaa4ad None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:08.710439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a899cd-a2c7-4f6f-a2c0-1842cf193cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:08.711243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a899cd-a2c7-4f6f-a2c0-1842cf193cdf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:08.711529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a899cd-a2c7-4f6f-a2c0-1842cf193cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:08.711803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a899cd-a2c7-4f6f-a2c0-1842cf193cdf admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:08.712530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a899cd-a2c7-4f6f-a2c0-1842cf193cdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:08.714463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a899cd-a2c7-4f6f-a2c0-1842cf193cdf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:08.757927 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3676/7314] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:08 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:08.761661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be883b4-8422-4647-9dc0-9534275aa0c1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:08.778210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be883b4-8422-4647-9dc0-9534275aa0c1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:08.870937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8344ed3-05e5-4bef-bd2e-0755014ca9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:08.872773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8344ed3-05e5-4bef-bd2e-0755014ca9fc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:08.873265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8344ed3-05e5-4bef-bd2e-0755014ca9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:08.873854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8344ed3-05e5-4bef-bd2e-0755014ca9fc admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:08.875475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8344ed3-05e5-4bef-bd2e-0755014ca9fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:08.878193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8344ed3-05e5-4bef-bd2e-0755014ca9fc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:08.906574 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3639/7315] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:08 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:08.911291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a899cd-a2c7-4f6f-a2c0-1842cf193cdf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:08.926517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a899cd-a2c7-4f6f-a2c0-1842cf193cdf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:08.943293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5838122-644c-478d-a84b-e70a00c4e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:08.944004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5838122-644c-478d-a84b-e70a00c4e98e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:08.944485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5838122-644c-478d-a84b-e70a00c4e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:08.945103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5838122-644c-478d-a84b-e70a00c4e98e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:08.947619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5838122-644c-478d-a84b-e70a00c4e98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:08.952015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5838122-644c-478d-a84b-e70a00c4e98e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:08.995408 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3677/7316] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:08.999952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8344ed3-05e5-4bef-bd2e-0755014ca9fc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:09.013135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8344ed3-05e5-4bef-bd2e-0755014ca9fc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:09.032005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0248b-b487-4e2b-9666-d9e417628e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:09.032662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0248b-b487-4e2b-9666-d9e417628e44 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:09.033032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0248b-b487-4e2b-9666-d9e417628e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:09.033347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0248b-b487-4e2b-9666-d9e417628e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:09.034363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0248b-b487-4e2b-9666-d9e417628e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:09.036292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0248b-b487-4e2b-9666-d9e417628e44 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:09.061510 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3640/7317] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:09.066389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5838122-644c-478d-a84b-e70a00c4e98e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:09.078564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5838122-644c-478d-a84b-e70a00c4e98e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:09.085925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806b9c2-49b0-4f5a-a41d-ef167abea531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:09.087380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806b9c2-49b0-4f5a-a41d-ef167abea531 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:09.088789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806b9c2-49b0-4f5a-a41d-ef167abea531 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:09.089322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806b9c2-49b0-4f5a-a41d-ef167abea531 admin admin] PATH_INFO: `/v3/projects/9a77f508d9954006963a9a90bbb051a8/users/f1fb538246e54b60a191a9658f42fa10/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:09.108512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806b9c2-49b0-4f5a-a41d-ef167abea531 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a77f508d9954006963a9a90bbb051a8, user_id=f1fb538246e54b60a191a9658f42fa10, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:09.112921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d806b9c2-49b0-4f5a-a41d-ef167abea531 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:09.133920 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3678/7318] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:09 2022] PUT /identity/v3/projects/9a77f508d9954006963a9a90bbb051a8/users/f1fb538246e54b60a191a9658f42fa10/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:09.145003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b48db2-54f2-4773-a69e-5a442ca5c07b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:09.145538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b48db2-54f2-4773-a69e-5a442ca5c07b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:09.145994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b48db2-54f2-4773-a69e-5a442ca5c07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:09.178975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d4b48db2-54f2-4773-a69e-5a442ca5c07b None None] MFA Rules not processed for user `f1fb538246e54b60a191a9658f42fa10`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:09.180802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d4b48db2-54f2-4773-a69e-5a442ca5c07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:09.288365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806b9c2-49b0-4f5a-a41d-ef167abea531 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:09.291457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d806b9c2-49b0-4f5a-a41d-ef167abea531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:09.300390 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3641/7319] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:09.390076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d806b9c2-49b0-4f5a-a41d-ef167abea531 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:09.397096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a9fdb4-c3c7-4beb-bcc0-210cf60e3619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:09.398585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9fdb4-c3c7-4beb-bcc0-210cf60e3619 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:09.399746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9fdb4-c3c7-4beb-bcc0-210cf60e3619 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:09.401757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9fdb4-c3c7-4beb-bcc0-210cf60e3619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:09.420727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9fdb4-c3c7-4beb-bcc0-210cf60e3619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:09.425914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a9fdb4-c3c7-4beb-bcc0-210cf60e3619 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:09.459656 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3679/7320] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:09.719552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b48db2-54f2-4773-a69e-5a442ca5c07b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:09.837072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b48db2-54f2-4773-a69e-5a442ca5c07b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:09.845079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:09.847218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:09.847671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:09.848311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] PATH_INFO: `/v3/users/f1fb538246e54b60a191a9658f42fa10` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:09.850898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fb538246e54b60a191a9658f42fa10)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:09.853470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:09.924240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fb538246e54b60a191a9658f42fa10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:09.946846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fb538246e54b60a191a9658f42fa10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:09.947493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fb538246e54b60a191a9658f42fa10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:09.948251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fb538246e54b60a191a9658f42fa10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:09.977178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fb538246e54b60a191a9658f42fa10'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:10.011357 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3642/7321] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:09 2022] DELETE /identity/v3/users/f1fb538246e54b60a191a9658f42fa10 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:10.014589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3072b-d466-4e4b-8ec0-1574eab92be5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:10.014877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3072b-d466-4e4b-8ec0-1574eab92be5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:10.015248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3072b-d466-4e4b-8ec0-1574eab92be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:10.080478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a7c3072b-d466-4e4b-8ec0-1574eab92be5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:10.081751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a7c3072b-d466-4e4b-8ec0-1574eab92be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:10.226954 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3680/7322] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:10.241448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:10.243114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:10.363012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a714a0c-5312-4a53-9223-b070e3811df8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:10.368466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337765b-75bf-4a29-9aae-493dd3cf0b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:10.369444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337765b-75bf-4a29-9aae-493dd3cf0b71 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:10.369805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337765b-75bf-4a29-9aae-493dd3cf0b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:10.370306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337765b-75bf-4a29-9aae-493dd3cf0b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:10.398328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337765b-75bf-4a29-9aae-493dd3cf0b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:10.404416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337765b-75bf-4a29-9aae-493dd3cf0b71 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:10.431988 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3643/7323] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:11.609665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3072b-d466-4e4b-8ec0-1574eab92be5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:11.613292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a7c3072b-d466-4e4b-8ec0-1574eab92be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:11.660159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3072b-d466-4e4b-8ec0-1574eab92be5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:11.672999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:11.678502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:11.679115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:11.679660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] PATH_INFO: `/v3/projects/9a77f508d9954006963a9a90bbb051a8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:11.684637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a77f508d9954006963a9a90bbb051a8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:11.692313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:11.797422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a77f508d9954006963a9a90bbb051a8', 'request_id': 'req-41a13abc-e622-4cce-95af-2a78065aaf00'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:11.812056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a77f508d9954006963a9a90bbb051a8', 'request_id': 'req-41a13abc-e622-4cce-95af-2a78065aaf00'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:11.826855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a77f508d9954006963a9a90bbb051a8', 'request_id': 'req-41a13abc-e622-4cce-95af-2a78065aaf00'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:11.857325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] The token cache is being invalidate because project 9a77f508d9954006963a9a90bbb051a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:11.858768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:11.859774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-41a13abc-e622-4cce-95af-2a78065aaf00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:11.862095 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3681/7324] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:11 2022] DELETE /identity/v3/projects/9a77f508d9954006963a9a90bbb051a8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:11.868698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105a21c-e8bd-4a27-9010-9e5e7b0ef5c3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:11.870184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105a21c-e8bd-4a27-9010-9e5e7b0ef5c3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:11.870765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105a21c-e8bd-4a27-9010-9e5e7b0ef5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:11.900826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a105a21c-e8bd-4a27-9010-9e5e7b0ef5c3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:11.902617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a105a21c-e8bd-4a27-9010-9e5e7b0ef5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:12.098159 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3644/7325] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:12.102099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36057197-698b-4199-a6e0-ce0030fa4e0f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:12.102656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36057197-698b-4199-a6e0-ce0030fa4e0f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:12.103163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36057197-698b-4199-a6e0-ce0030fa4e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:12.139797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-36057197-698b-4199-a6e0-ce0030fa4e0f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:12.141520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-36057197-698b-4199-a6e0-ce0030fa4e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:12.160440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105a21c-e8bd-4a27-9010-9e5e7b0ef5c3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:12.168716 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3682/7326] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:12.173470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105a21c-e8bd-4a27-9010-9e5e7b0ef5c3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:12.192472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921c450-8c7b-4fed-8c87-a8493a3aaadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:12.193996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921c450-8c7b-4fed-8c87-a8493a3aaadb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:12.195593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921c450-8c7b-4fed-8c87-a8493a3aaadb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:12.196867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921c450-8c7b-4fed-8c87-a8493a3aaadb admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:12.199416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921c450-8c7b-4fed-8c87-a8493a3aaadb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:12.200080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921c450-8c7b-4fed-8c87-a8493a3aaadb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:12.203243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921c450-8c7b-4fed-8c87-a8493a3aaadb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:12.240190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36057197-698b-4199-a6e0-ce0030fa4e0f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:12.254755 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3645/7327] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:12.259194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36057197-698b-4199-a6e0-ce0030fa4e0f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:12.269670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae872074-786b-4d48-90e8-ba75d986c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:12.271320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae872074-786b-4d48-90e8-ba75d986c382 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:12.271719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae872074-786b-4d48-90e8-ba75d986c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:12.273289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae872074-786b-4d48-90e8-ba75d986c382 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:12.274126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae872074-786b-4d48-90e8-ba75d986c382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:12.276499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae872074-786b-4d48-90e8-ba75d986c382 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:12.320204 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3683/7328] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:12 2022] POST /identity/v3/projects => generated 401 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:12.323318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921c450-8c7b-4fed-8c87-a8493a3aaadb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:12.336569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921c450-8c7b-4fed-8c87-a8493a3aaadb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:12.449254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff2ff6-e6e9-4fdb-859b-5992453067c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:12.450096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff2ff6-e6e9-4fdb-859b-5992453067c6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:12.450621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff2ff6-e6e9-4fdb-859b-5992453067c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:12.451573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff2ff6-e6e9-4fdb-859b-5992453067c6 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:12.452437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff2ff6-e6e9-4fdb-859b-5992453067c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:12.456128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff2ff6-e6e9-4fdb-859b-5992453067c6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:12.503875 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3646/7329] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:12 2022] POST /identity/v3/users => generated 301 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:12.504719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae872074-786b-4d48-90e8-ba75d986c382 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:12.522128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae872074-786b-4d48-90e8-ba75d986c382 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:12.533563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee4c8-7ac9-4aaa-a14f-7c7c366f9634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:12.534142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee4c8-7ac9-4aaa-a14f-7c7c366f9634 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:12.534375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee4c8-7ac9-4aaa-a14f-7c7c366f9634 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:12.534494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fee4c8-7ac9-4aaa-a14f-7c7c366f9634 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:12.535230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fee4c8-7ac9-4aaa-a14f-7c7c366f9634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:12.537143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fee4c8-7ac9-4aaa-a14f-7c7c366f9634 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:12.563561 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3684/7330] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:12.568736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff2ff6-e6e9-4fdb-859b-5992453067c6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:12.585316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff2ff6-e6e9-4fdb-859b-5992453067c6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:12.601195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06de03f-32bc-4394-8879-588153864185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:12.602082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de03f-32bc-4394-8879-588153864185 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:12.602477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de03f-32bc-4394-8879-588153864185 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:12.602861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06de03f-32bc-4394-8879-588153864185 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:12.603701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06de03f-32bc-4394-8879-588153864185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:12.611457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06de03f-32bc-4394-8879-588153864185 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:12.653882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee4c8-7ac9-4aaa-a14f-7c7c366f9634 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:12.660247 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3647/7331] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:12.668812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fee4c8-7ac9-4aaa-a14f-7c7c366f9634 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:12.686551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b82ec-d369-47f9-94c9-c2ad48b3240b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:12.687558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b82ec-d369-47f9-94c9-c2ad48b3240b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:12.689023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b82ec-d369-47f9-94c9-c2ad48b3240b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:12.690024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b82ec-d369-47f9-94c9-c2ad48b3240b admin admin] PATH_INFO: `/v3/projects/c4890e5c979b46189318199f34a85467/users/ac8715a483ef4718af9d97da91e7e10e/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:12.718500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b82ec-d369-47f9-94c9-c2ad48b3240b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4890e5c979b46189318199f34a85467, user_id=ac8715a483ef4718af9d97da91e7e10e, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:12.721694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b82ec-d369-47f9-94c9-c2ad48b3240b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:12.756784 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3685/7332] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:12 2022] PUT /identity/v3/projects/c4890e5c979b46189318199f34a85467/users/ac8715a483ef4718af9d97da91e7e10e/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:12.768969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314d6f9-6790-452e-a944-66162585d073 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:12.769141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314d6f9-6790-452e-a944-66162585d073 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:12.769421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314d6f9-6790-452e-a944-66162585d073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:12.802082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4314d6f9-6790-452e-a944-66162585d073 None None] MFA Rules not processed for user `ac8715a483ef4718af9d97da91e7e10e`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:12.803428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4314d6f9-6790-452e-a944-66162585d073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:12.888059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b82ec-d369-47f9-94c9-c2ad48b3240b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:12.895416 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3648/7333] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:13.008762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b82ec-d369-47f9-94c9-c2ad48b3240b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.033697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020044f-410d-48d9-9fe4-10670a88ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.035220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020044f-410d-48d9-9fe4-10670a88ab9f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.035507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020044f-410d-48d9-9fe4-10670a88ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.035814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020044f-410d-48d9-9fe4-10670a88ab9f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.036349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa529772-64ca-48e9-905d-1b7c10db6f00 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.036628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020044f-410d-48d9-9fe4-10670a88ab9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.036735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa529772-64ca-48e9-905d-1b7c10db6f00 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.036977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa529772-64ca-48e9-905d-1b7c10db6f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.041718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020044f-410d-48d9-9fe4-10670a88ab9f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.084546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fa529772-64ca-48e9-905d-1b7c10db6f00 None None] MFA Rules not processed for user `7ac02d48a08c4284ae0c82008c970e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:13.089813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fa529772-64ca-48e9-905d-1b7c10db6f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:13.104819 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3686/7334] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:12 2022] POST /identity/v3/projects => generated 401 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:13.106084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020044f-410d-48d9-9fe4-10670a88ab9f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.114766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9020044f-410d-48d9-9fe4-10670a88ab9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:13.264505 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3649/7335] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:13.268581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa529772-64ca-48e9-905d-1b7c10db6f00 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.277454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020044f-410d-48d9-9fe4-10670a88ab9f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.287166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.288173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.288852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa529772-64ca-48e9-905d-1b7c10db6f00 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.289015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.289703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.293033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:13.318550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.320685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.339337 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3687/7336] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:13.340497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.342209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:13.376504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0d7d3-f92c-4065-a5aa-77487e5e085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.378091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0d7d3-f92c-4065-a5aa-77487e5e085d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.378915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0d7d3-f92c-4065-a5aa-77487e5e085d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.379412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0d7d3-f92c-4065-a5aa-77487e5e085d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.380495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0d7d3-f92c-4065-a5aa-77487e5e085d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.382910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d0d7d3-f92c-4065-a5aa-77487e5e085d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.413162 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3650/7337] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:13 2022] POST /identity/v3/users => generated 307 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:13.414271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0d7d3-f92c-4065-a5aa-77487e5e085d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.426054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d0d7d3-f92c-4065-a5aa-77487e5e085d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.429945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dfb345-722a-42e1-a101-474ad6f2b554 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.436454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b6ac9-f753-43af-9d32-bd08d3bca612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.437327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6ac9-f753-43af-9d32-bd08d3bca612 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.437705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6ac9-f753-43af-9d32-bd08d3bca612 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.437960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff9ee-ab42-46cd-9cd3-4416e6b2f983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.438167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6ac9-f753-43af-9d32-bd08d3bca612 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.438974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b6ac9-f753-43af-9d32-bd08d3bca612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.439109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff9ee-ab42-46cd-9cd3-4416e6b2f983 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.444356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b6ac9-f753-43af-9d32-bd08d3bca612 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.444573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff9ee-ab42-46cd-9cd3-4416e6b2f983 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.444902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ff9ee-ab42-46cd-9cd3-4416e6b2f983 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.445683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ff9ee-ab42-46cd-9cd3-4416e6b2f983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.448040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ff9ee-ab42-46cd-9cd3-4416e6b2f983 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.480135 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3651/7338] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:13.481342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff9ee-ab42-46cd-9cd3-4416e6b2f983 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.495961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ff9ee-ab42-46cd-9cd3-4416e6b2f983 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.506678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd83e5-892f-4aff-8c45-466b4993dd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.507761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd83e5-892f-4aff-8c45-466b4993dd0a admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.508015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd83e5-892f-4aff-8c45-466b4993dd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.508289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd83e5-892f-4aff-8c45-466b4993dd0a admin admin] PATH_INFO: `/v3/projects/ba5318bd83d247298aff94f9963df59c/users/b3037ffe62a2422781b1eb232c42940a/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.513894 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3688/7339] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:13 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:13.515700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b6ac9-f753-43af-9d32-bd08d3bca612 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.517968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a29b6ac9-f753-43af-9d32-bd08d3bca612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:13.555675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd83e5-892f-4aff-8c45-466b4993dd0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5318bd83d247298aff94f9963df59c, user_id=b3037ffe62a2422781b1eb232c42940a, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.558577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd83e5-892f-4aff-8c45-466b4993dd0a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.591174 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3652/7340] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:13 2022] PUT /identity/v3/projects/ba5318bd83d247298aff94f9963df59c/users/b3037ffe62a2422781b1eb232c42940a/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:13.591174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd83e5-892f-4aff-8c45-466b4993dd0a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.653724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b6ac9-f753-43af-9d32-bd08d3bca612 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.738580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b92789-f7ef-478d-ad28-46c42d51462a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.739290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b92789-f7ef-478d-ad28-46c42d51462a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.739708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b92789-f7ef-478d-ad28-46c42d51462a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.740068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b92789-f7ef-478d-ad28-46c42d51462a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.742009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-74b92789-f7ef-478d-ad28-46c42d51462a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:13.743403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd83e5-892f-4aff-8c45-466b4993dd0a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.761100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b92789-f7ef-478d-ad28-46c42d51462a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.762793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b92789-f7ef-478d-ad28-46c42d51462a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.769732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4ed2d-26a5-4424-a60d-618d0a6d8a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.770556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4ed2d-26a5-4424-a60d-618d0a6d8a9e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.782384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4ed2d-26a5-4424-a60d-618d0a6d8a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.783378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4ed2d-26a5-4424-a60d-618d0a6d8a9e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.784353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4ed2d-26a5-4424-a60d-618d0a6d8a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.786698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4ed2d-26a5-4424-a60d-618d0a6d8a9e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.815771 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3689/7341] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:13.817917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b92789-f7ef-478d-ad28-46c42d51462a service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.846962 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3653/7342] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:13 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:13.851220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4ed2d-26a5-4424-a60d-618d0a6d8a9e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.856495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b92789-f7ef-478d-ad28-46c42d51462a service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.863070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23947e9a-eca7-4588-84c6-40dd6cebf4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.864167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23947e9a-eca7-4588-84c6-40dd6cebf4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.864562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23947e9a-eca7-4588-84c6-40dd6cebf4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.864938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23947e9a-eca7-4588-84c6-40dd6cebf4f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.867617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23947e9a-eca7-4588-84c6-40dd6cebf4f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.871268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4ed2d-26a5-4424-a60d-618d0a6d8a9e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.871563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23947e9a-eca7-4588-84c6-40dd6cebf4f0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.897764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3931ef-bca1-4dfc-a293-7591c2dbdd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.899198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3931ef-bca1-4dfc-a293-7591c2dbdd2f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.899824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3931ef-bca1-4dfc-a293-7591c2dbdd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.900303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3931ef-bca1-4dfc-a293-7591c2dbdd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.901424 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3690/7343] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:13.901789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3931ef-bca1-4dfc-a293-7591c2dbdd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.903271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23947e9a-eca7-4588-84c6-40dd6cebf4f0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.906831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3931ef-bca1-4dfc-a293-7591c2dbdd2f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.926802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23947e9a-eca7-4588-84c6-40dd6cebf4f0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.933125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda55073-cd47-44e3-a30a-db8a7df9428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:13.934258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda55073-cd47-44e3-a30a-db8a7df9428e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.934655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda55073-cd47-44e3-a30a-db8a7df9428e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.935037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda55073-cd47-44e3-a30a-db8a7df9428e admin admin] PATH_INFO: `/v3/projects/ba5318bd83d247298aff94f9963df59c/users/b3037ffe62a2422781b1eb232c42940a/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:13.936622 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3654/7344] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:13.942416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3931ef-bca1-4dfc-a293-7591c2dbdd2f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:13.943051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda55073-cd47-44e3-a30a-db8a7df9428e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5318bd83d247298aff94f9963df59c, user_id=b3037ffe62a2422781b1eb232c42940a, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:13.946479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda55073-cd47-44e3-a30a-db8a7df9428e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:13.961606 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3691/7345] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:13 2022] PUT /identity/v3/projects/ba5318bd83d247298aff94f9963df59c/users/b3037ffe62a2422781b1eb232c42940a/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:13.963619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3931ef-bca1-4dfc-a293-7591c2dbdd2f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:13.975191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71ed5-d4d8-49fc-9d64-6cce223b5894 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:13.975612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71ed5-d4d8-49fc-9d64-6cce223b5894 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:13.976049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71ed5-d4d8-49fc-9d64-6cce223b5894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:14.058271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-82c71ed5-d4d8-49fc-9d64-6cce223b5894 None None] MFA Rules not processed for user `b3037ffe62a2422781b1eb232c42940a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:14.062895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82c71ed5-d4d8-49fc-9d64-6cce223b5894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:14.149174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1898de0-5da1-48bf-a694-de2c0f4413b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:14.150322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1898de0-5da1-48bf-a694-de2c0f4413b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:14.150776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1898de0-5da1-48bf-a694-de2c0f4413b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:14.151383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1898de0-5da1-48bf-a694-de2c0f4413b0 admin admin] PATH_INFO: `/v3/projects/a586ca08318d4cdd862d7df097e9a736/users/10f32ba8b41641a4ac539ace0bb4ac5c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:14.205060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1898de0-5da1-48bf-a694-de2c0f4413b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a586ca08318d4cdd862d7df097e9a736, user_id=10f32ba8b41641a4ac539ace0bb4ac5c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:14.208716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1898de0-5da1-48bf-a694-de2c0f4413b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:14.234419 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3655/7346] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:13 2022] PUT /identity/v3/projects/a586ca08318d4cdd862d7df097e9a736/users/10f32ba8b41641a4ac539ace0bb4ac5c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:14.239287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1898de0-5da1-48bf-a694-de2c0f4413b0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:14.352339 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3692/7347] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:14.357803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c71ed5-d4d8-49fc-9d64-6cce223b5894 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:14.366210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1898de0-5da1-48bf-a694-de2c0f4413b0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:14.373719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77a35-a4a7-43a8-b55b-68a9e09b2bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:14.375414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77a35-a4a7-43a8-b55b-68a9e09b2bbf admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:14.376040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77a35-a4a7-43a8-b55b-68a9e09b2bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:14.376494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b77a35-a4a7-43a8-b55b-68a9e09b2bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:14.377498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77a35-a4a7-43a8-b55b-68a9e09b2bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:14.379876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b77a35-a4a7-43a8-b55b-68a9e09b2bbf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:14.381125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c71ed5-d4d8-49fc-9d64-6cce223b5894 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:14.403966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3656/7348] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:14 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:14.410767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77a35-a4a7-43a8-b55b-68a9e09b2bbf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:14.428710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b77a35-a4a7-43a8-b55b-68a9e09b2bbf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:14.442398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d304fa-9250-4296-8ae9-7b3bc39cc1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:14.443678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d304fa-9250-4296-8ae9-7b3bc39cc1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:14.445148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d304fa-9250-4296-8ae9-7b3bc39cc1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:14.445794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d304fa-9250-4296-8ae9-7b3bc39cc1d1 admin admin] PATH_INFO: `/v3/projects/a586ca08318d4cdd862d7df097e9a736/users/10f32ba8b41641a4ac539ace0bb4ac5c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:14.449828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d304fa-9250-4296-8ae9-7b3bc39cc1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a586ca08318d4cdd862d7df097e9a736, user_id=10f32ba8b41641a4ac539ace0bb4ac5c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:14.453894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d304fa-9250-4296-8ae9-7b3bc39cc1d1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:14.474554 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3657/7349] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:14 2022] PUT /identity/v3/projects/a586ca08318d4cdd862d7df097e9a736/users/10f32ba8b41641a4ac539ace0bb4ac5c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:14.540121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470de597-3f0a-4d46-b2ee-80e6a6d857d7 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3037ffe62a2422781b1eb232c42940a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba5318bd83d247298aff94f9963df59c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:14.543098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470de597-3f0a-4d46-b2ee-80e6a6d857d7 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:14.543590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470de597-3f0a-4d46-b2ee-80e6a6d857d7 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:14.544296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470de597-3f0a-4d46-b2ee-80e6a6d857d7 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:14.545578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470de597-3f0a-4d46-b2ee-80e6a6d857d7 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:14.548242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470de597-3f0a-4d46-b2ee-80e6a6d857d7 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:14.582971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d304fa-9250-4296-8ae9-7b3bc39cc1d1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:14.595271 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3693/7350] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:15:14 2022] POST /identity/v3/roles => generated 239 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:14.734837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d304fa-9250-4296-8ae9-7b3bc39cc1d1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:14.744459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab993f-ad53-4bdc-8d45-8c8b66d7d5e6 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3037ffe62a2422781b1eb232c42940a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba5318bd83d247298aff94f9963df59c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:14.745712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab993f-ad53-4bdc-8d45-8c8b66d7d5e6 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:14.746234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab993f-ad53-4bdc-8d45-8c8b66d7d5e6 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:14.748109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab993f-ad53-4bdc-8d45-8c8b66d7d5e6 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] PATH_INFO: `/v3/projects/c4890e5c979b46189318199f34a85467/users/ac8715a483ef4718af9d97da91e7e10e/roles/3012cebc51ef4dfe84a3b601699cb947` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:14.752322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab993f-ad53-4bdc-8d45-8c8b66d7d5e6 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] RBAC: Authorizing `identity:create_grant(project_id=c4890e5c979b46189318199f34a85467, user_id=ac8715a483ef4718af9d97da91e7e10e, role_id=3012cebc51ef4dfe84a3b601699cb947)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:14.756426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab993f-ad53-4bdc-8d45-8c8b66d7d5e6 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:14.781256 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3658/7351] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:14 2022] PUT /identity/v3/projects/c4890e5c979b46189318199f34a85467/users/ac8715a483ef4718af9d97da91e7e10e/roles/3012cebc51ef4dfe84a3b601699cb947 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:14.785735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470de597-3f0a-4d46-b2ee-80e6a6d857d7 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:14.912252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470de597-3f0a-4d46-b2ee-80e6a6d857d7 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:14.999954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43040765-e78c-4305-8f2e-d3cb517fda86 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8715a483ef4718af9d97da91e7e10e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4890e5c979b46189318199f34a85467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-657521192'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:15.001405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040765-e78c-4305-8f2e-d3cb517fda86 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:15.002398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040765-e78c-4305-8f2e-d3cb517fda86 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:15.002738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43040765-e78c-4305-8f2e-d3cb517fda86 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] PATH_INFO: `/v3/users/ac8715a483ef4718af9d97da91e7e10e/application_credentials` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:15.003613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43040765-e78c-4305-8f2e-d3cb517fda86 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] RBAC: Authorizing `identity:create_application_credential(user_id=ac8715a483ef4718af9d97da91e7e10e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:15.005678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43040765-e78c-4305-8f2e-d3cb517fda86 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:15.227399 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3694/7352] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Mar 26 21:15:14 2022] POST /identity/v3/users/ac8715a483ef4718af9d97da91e7e10e/application_credentials => generated 658 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:15.228642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951393-631b-4a15-9a0b-d6c109a422cb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:15.229444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951393-631b-4a15-9a0b-d6c109a422cb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:15.229444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951393-631b-4a15-9a0b-d6c109a422cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:15.297224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c5951393-631b-4a15-9a0b-d6c109a422cb None None] MFA Rules not processed for user `ac8715a483ef4718af9d97da91e7e10e`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:15.299697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c5951393-631b-4a15-9a0b-d6c109a422cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:15.500493 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3659/7353] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:15 2022] POST /identity/v3/auth/tokens => generated 3383 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Mar 26 21:15:15.504687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43040765-e78c-4305-8f2e-d3cb517fda86 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:15.519549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43040765-e78c-4305-8f2e-d3cb517fda86 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:15.534243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a3cf-eee2-4133-aeee-4dc2b5d6ef20 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac8715a483ef4718af9d97da91e7e10e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4890e5c979b46189318199f34a85467', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'tempest-test_role-657521192'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:15.537249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a3cf-eee2-4133-aeee-4dc2b5d6ef20 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:15.539910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a3cf-eee2-4133-aeee-4dc2b5d6ef20 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:15.540762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a3cf-eee2-4133-aeee-4dc2b5d6ef20 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] PATH_INFO: `/v3/users/ac8715a483ef4718af9d97da91e7e10e/application_credentials/452b3656c3444c6e8f37af7b705a0911` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:15.544357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61a3cf-eee2-4133-aeee-4dc2b5d6ef20 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] RBAC: Authorizing `identity:delete_application_credential(user_id=ac8715a483ef4718af9d97da91e7e10e, application_credential_id=452b3656c3444c6e8f37af7b705a0911)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:15.546353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61a3cf-eee2-4133-aeee-4dc2b5d6ef20 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:15.596258 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3695/7354] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Mar 26 21:15:15 2022] DELETE /identity/v3/users/ac8715a483ef4718af9d97da91e7e10e/application_credentials/452b3656c3444c6e8f37af7b705a0911 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:15.600308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5951393-631b-4a15-9a0b-d6c109a422cb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:15.734821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5951393-631b-4a15-9a0b-d6c109a422cb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:15.746563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b418ef5-f953-4a9d-a6a2-e5d4fe9a3a03 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3037ffe62a2422781b1eb232c42940a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ba5318bd83d247298aff94f9963df59c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:15.747617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b418ef5-f953-4a9d-a6a2-e5d4fe9a3a03 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:15.747938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b418ef5-f953-4a9d-a6a2-e5d4fe9a3a03 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:15.748436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b418ef5-f953-4a9d-a6a2-e5d4fe9a3a03 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] PATH_INFO: `/v3/roles/3012cebc51ef4dfe84a3b601699cb947` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:15.750209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b418ef5-f953-4a9d-a6a2-e5d4fe9a3a03 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3012cebc51ef4dfe84a3b601699cb947)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:15.751937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b418ef5-f953-4a9d-a6a2-e5d4fe9a3a03 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:15.821060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b418ef5-f953-4a9d-a6a2-e5d4fe9a3a03 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] Invalidating the token cache because role 3012cebc51ef4dfe84a3b601699cb947 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:15.821331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b418ef5-f953-4a9d-a6a2-e5d4fe9a3a03 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:15.822115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b418ef5-f953-4a9d-a6a2-e5d4fe9a3a03 tempest-ApplicationCredentialsV3AdminTest-450311793 tempest-ApplicationCredentialsV3AdminTest-450311793-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:15.829302 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3660/7355] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:15 2022] DELETE /identity/v3/roles/3012cebc51ef4dfe84a3b601699cb947 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:15.835106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a3cf-eee2-4133-aeee-4dc2b5d6ef20 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:15.837685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5a61a3cf-eee2-4133-aeee-4dc2b5d6ef20 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:15.979459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a3cf-eee2-4133-aeee-4dc2b5d6ef20 tempest-ApplicationCredentialsV3AdminTest-637271394 tempest-ApplicationCredentialsV3AdminTest-637271394-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:16.069939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:16.072050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:16.072955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:16.073409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] PATH_INFO: `/v3/users/ac8715a483ef4718af9d97da91e7e10e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:16.075378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8715a483ef4718af9d97da91e7e10e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:16.080934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:16.265105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8715a483ef4718af9d97da91e7e10e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:16.296433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8715a483ef4718af9d97da91e7e10e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:16.297207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8715a483ef4718af9d97da91e7e10e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:16.298300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8715a483ef4718af9d97da91e7e10e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:16.320643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8715a483ef4718af9d97da91e7e10e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:16.363410 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3696/7356] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:15 2022] DELETE /identity/v3/users/ac8715a483ef4718af9d97da91e7e10e => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:16.364486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1534b2-304f-4820-a86d-ee81d22f7186 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:16.365023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1534b2-304f-4820-a86d-ee81d22f7186 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:16.365140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1534b2-304f-4820-a86d-ee81d22f7186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:16.394718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bd1534b2-304f-4820-a86d-ee81d22f7186 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:16.396068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bd1534b2-304f-4820-a86d-ee81d22f7186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:16.488118 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3661/7357] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:16.534980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:16.539834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:16.660017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4b966-d643-465a-82cf-73e384f16c1e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:16.665995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694716a2-145b-4ba5-98b0-e51dec2cae9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:16.666920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694716a2-145b-4ba5-98b0-e51dec2cae9b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:16.667466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694716a2-145b-4ba5-98b0-e51dec2cae9b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:16.668014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694716a2-145b-4ba5-98b0-e51dec2cae9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:16.690928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694716a2-145b-4ba5-98b0-e51dec2cae9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:16.692680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694716a2-145b-4ba5-98b0-e51dec2cae9b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:16.708172 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3697/7358] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:17.534877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1534b2-304f-4820-a86d-ee81d22f7186 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:17.536521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bd1534b2-304f-4820-a86d-ee81d22f7186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:17.564744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1534b2-304f-4820-a86d-ee81d22f7186 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:17.575664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:17.577124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:17.578039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:17.578509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] PATH_INFO: `/v3/projects/c4890e5c979b46189318199f34a85467` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:17.581132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4890e5c979b46189318199f34a85467)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:17.584818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:17.697047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4890e5c979b46189318199f34a85467', 'request_id': 'req-f1f6382c-34f2-444e-9eb9-428d2dccc76f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:17.711962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4890e5c979b46189318199f34a85467', 'request_id': 'req-f1f6382c-34f2-444e-9eb9-428d2dccc76f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:17.727486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4890e5c979b46189318199f34a85467', 'request_id': 'req-f1f6382c-34f2-444e-9eb9-428d2dccc76f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:17.745126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] The token cache is being invalidate because project c4890e5c979b46189318199f34a85467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:17.745841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:17.747417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:17.754614 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3662/7359] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:17 2022] DELETE /identity/v3/projects/c4890e5c979b46189318199f34a85467 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:17.755263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694716a2-145b-4ba5-98b0-e51dec2cae9b service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:17.775949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694716a2-145b-4ba5-98b0-e51dec2cae9b service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:17.879029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:17.879945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:17.880713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:17.881016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] PATH_INFO: `/v3/users/b3037ffe62a2422781b1eb232c42940a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:17.883720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3037ffe62a2422781b1eb232c42940a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:17.887130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:17.973529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3037ffe62a2422781b1eb232c42940a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:17.985218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3037ffe62a2422781b1eb232c42940a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:17.986275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3037ffe62a2422781b1eb232c42940a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:17.986982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3037ffe62a2422781b1eb232c42940a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:17.996419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-14c154f7-86f2-42d0-89b6-6a6edd527103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3037ffe62a2422781b1eb232c42940a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:18.033887 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3698/7360] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:17 2022] DELETE /identity/v3/users/b3037ffe62a2422781b1eb232c42940a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:18.471101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:18.472636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:18.497082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6382c-34f2-444e-9eb9-428d2dccc76f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:18.579137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:18.581288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:18.581985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:18.582496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] PATH_INFO: `/v3/projects/ba5318bd83d247298aff94f9963df59c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:18.584081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5318bd83d247298aff94f9963df59c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:18.586663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:18.685547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5318bd83d247298aff94f9963df59c', 'request_id': 'req-4cb3e487-a9ba-4089-870e-fcbd750c329e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:18.697627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5318bd83d247298aff94f9963df59c', 'request_id': 'req-4cb3e487-a9ba-4089-870e-fcbd750c329e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:18.706974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5318bd83d247298aff94f9963df59c', 'request_id': 'req-4cb3e487-a9ba-4089-870e-fcbd750c329e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:18.732067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] The token cache is being invalidate because project ba5318bd83d247298aff94f9963df59c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:18.737235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:18.738399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4cb3e487-a9ba-4089-870e-fcbd750c329e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:18.744887 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3663/7361] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:18 2022] DELETE /identity/v3/projects/ba5318bd83d247298aff94f9963df59c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:18.745988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6c908-c726-49ab-a8b7-5745d947ecc6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:18.746357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6c908-c726-49ab-a8b7-5745d947ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:18.746719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6c908-c726-49ab-a8b7-5745d947ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:18.778495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-64d6c908-c726-49ab-a8b7-5745d947ecc6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:18.780381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-64d6c908-c726-49ab-a8b7-5745d947ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:18.921856 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3699/7362] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:18.932556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26544370-71a9-494e-8f49-d90dced51d25 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:18.933115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26544370-71a9-494e-8f49-d90dced51d25 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:18.933629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26544370-71a9-494e-8f49-d90dced51d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:18.961568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-26544370-71a9-494e-8f49-d90dced51d25 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:18.963322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-26544370-71a9-494e-8f49-d90dced51d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:18.984471 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3664/7363] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:18.985199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6c908-c726-49ab-a8b7-5745d947ecc6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:18.999683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6c908-c726-49ab-a8b7-5745d947ecc6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:19.010169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01ed12-95e4-4e31-ae15-c482c36218ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:19.012591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ed12-95e4-4e31-ae15-c482c36218ad admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:19.013122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ed12-95e4-4e31-ae15-c482c36218ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:19.014128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01ed12-95e4-4e31-ae15-c482c36218ad admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:19.015359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01ed12-95e4-4e31-ae15-c482c36218ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:19.015899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01ed12-95e4-4e31-ae15-c482c36218ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:19.018500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01ed12-95e4-4e31-ae15-c482c36218ad admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:19.037534 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3700/7364] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:19.041567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26544370-71a9-494e-8f49-d90dced51d25 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:19.051956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26544370-71a9-494e-8f49-d90dced51d25 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:19.057102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b8921-1f24-4dcb-b287-dc3fdf3df809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:19.057773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b8921-1f24-4dcb-b287-dc3fdf3df809 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:19.058064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b8921-1f24-4dcb-b287-dc3fdf3df809 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:19.058345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06b8921-1f24-4dcb-b287-dc3fdf3df809 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:19.059101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b8921-1f24-4dcb-b287-dc3fdf3df809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:19.061140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06b8921-1f24-4dcb-b287-dc3fdf3df809 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:19.097055 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3665/7365] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:19 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:19.101860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01ed12-95e4-4e31-ae15-c482c36218ad admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:19.116198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01ed12-95e4-4e31-ae15-c482c36218ad admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:19.207963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a70a-57ce-4a0b-ab5c-1408a16dfb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:19.209598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a70a-57ce-4a0b-ab5c-1408a16dfb9c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:19.210009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a70a-57ce-4a0b-ab5c-1408a16dfb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:19.210361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a70a-57ce-4a0b-ab5c-1408a16dfb9c admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:19.211222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a70a-57ce-4a0b-ab5c-1408a16dfb9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:19.214388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a70a-57ce-4a0b-ab5c-1408a16dfb9c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:19.255060 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3701/7366] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:19 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:19.256082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b8921-1f24-4dcb-b287-dc3fdf3df809 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:19.283222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06b8921-1f24-4dcb-b287-dc3fdf3df809 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:19.293635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ab11f-c006-475a-8f0e-b76206a932bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:19.295069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ab11f-c006-475a-8f0e-b76206a932bf admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:19.295473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ab11f-c006-475a-8f0e-b76206a932bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:19.296025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ab11f-c006-475a-8f0e-b76206a932bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:19.297341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ab11f-c006-475a-8f0e-b76206a932bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:19.300832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ab11f-c006-475a-8f0e-b76206a932bf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:19.317441 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3666/7367] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:19.322723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a70a-57ce-4a0b-ab5c-1408a16dfb9c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:19.338730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a70a-57ce-4a0b-ab5c-1408a16dfb9c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:19.347449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a19c0c-3e19-42a8-87db-6c68065bf0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:19.348610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a19c0c-3e19-42a8-87db-6c68065bf0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:19.349132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a19c0c-3e19-42a8-87db-6c68065bf0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:19.349662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a19c0c-3e19-42a8-87db-6c68065bf0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:19.350859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a19c0c-3e19-42a8-87db-6c68065bf0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:19.354217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a19c0c-3e19-42a8-87db-6c68065bf0d3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:19.368398 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3702/7368] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:19.372717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ab11f-c006-475a-8f0e-b76206a932bf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:19.384622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ab11f-c006-475a-8f0e-b76206a932bf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:19.393205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba6a9c-a0f8-42a1-acab-22f445e5acba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:19.394246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba6a9c-a0f8-42a1-acab-22f445e5acba admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:19.394468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba6a9c-a0f8-42a1-acab-22f445e5acba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:19.394984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba6a9c-a0f8-42a1-acab-22f445e5acba admin admin] PATH_INFO: `/v3/projects/f9e38e8c00034d389ea0392f785d7b62/users/72152ce0b0d74e1ca7aa7a396f4730f2/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:19.419563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba6a9c-a0f8-42a1-acab-22f445e5acba admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e38e8c00034d389ea0392f785d7b62, user_id=72152ce0b0d74e1ca7aa7a396f4730f2, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:19.423462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba6a9c-a0f8-42a1-acab-22f445e5acba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:19.459858 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3667/7369] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:19 2022] PUT /identity/v3/projects/f9e38e8c00034d389ea0392f785d7b62/users/72152ce0b0d74e1ca7aa7a396f4730f2/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:19.470792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a6020-4c30-444a-bc09-ba6175cc3a1a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:19.471358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a6020-4c30-444a-bc09-ba6175cc3a1a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:19.471851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a6020-4c30-444a-bc09-ba6175cc3a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:19.523907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cf2a6020-4c30-444a-bc09-ba6175cc3a1a None None] MFA Rules not processed for user `72152ce0b0d74e1ca7aa7a396f4730f2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:19.525281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cf2a6020-4c30-444a-bc09-ba6175cc3a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:19.692132 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3703/7370] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:19.696866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba6a9c-a0f8-42a1-acab-22f445e5acba admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:19.818858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba6a9c-a0f8-42a1-acab-22f445e5acba admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:19.829230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2f1a-e4a7-4828-9fa1-7d55c5f2deb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:19.831093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2f1a-e4a7-4828-9fa1-7d55c5f2deb3 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:19.831398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2f1a-e4a7-4828-9fa1-7d55c5f2deb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:19.831684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc2f1a-e4a7-4828-9fa1-7d55c5f2deb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:19.832452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc2f1a-e4a7-4828-9fa1-7d55c5f2deb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:19.834635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc2f1a-e4a7-4828-9fa1-7d55c5f2deb3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:19.874552 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3668/7371] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:19 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:19.878080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a6020-4c30-444a-bc09-ba6175cc3a1a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:19.898805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a6020-4c30-444a-bc09-ba6175cc3a1a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:20.037368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd002d-8d7a-4f24-9155-377749949c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:20.038487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd002d-8d7a-4f24-9155-377749949c0e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:20.038998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd002d-8d7a-4f24-9155-377749949c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:20.039462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd002d-8d7a-4f24-9155-377749949c0e admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:20.040366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd002d-8d7a-4f24-9155-377749949c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:20.042594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd002d-8d7a-4f24-9155-377749949c0e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:20.081107 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3704/7372] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:19 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:20.082064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2f1a-e4a7-4828-9fa1-7d55c5f2deb3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:20.101367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc2f1a-e4a7-4828-9fa1-7d55c5f2deb3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:20.109745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c504447-a023-4803-817a-e7aa228f455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:20.112234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504447-a023-4803-817a-e7aa228f455b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:20.112747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504447-a023-4803-817a-e7aa228f455b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:20.113352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c504447-a023-4803-817a-e7aa228f455b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:20.114901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c504447-a023-4803-817a-e7aa228f455b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:20.118024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c504447-a023-4803-817a-e7aa228f455b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:20.141367 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3669/7373] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:20.145331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd002d-8d7a-4f24-9155-377749949c0e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:20.163127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd002d-8d7a-4f24-9155-377749949c0e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:20.176838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc305650-4b19-4f15-8218-231ae7ab3a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:20.180345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc305650-4b19-4f15-8218-231ae7ab3a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:20.180740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc305650-4b19-4f15-8218-231ae7ab3a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:20.182315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc305650-4b19-4f15-8218-231ae7ab3a3d admin admin] PATH_INFO: `/v3/projects/cf4ef04f99064851aa8773a960f04977/users/48d4323f12734c0bb2b54d9f688c93f5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:20.249536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc305650-4b19-4f15-8218-231ae7ab3a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4ef04f99064851aa8773a960f04977, user_id=48d4323f12734c0bb2b54d9f688c93f5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:20.255206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc305650-4b19-4f15-8218-231ae7ab3a3d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:20.316680 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3705/7374] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:20 2022] PUT /identity/v3/projects/cf4ef04f99064851aa8773a960f04977/users/48d4323f12734c0bb2b54d9f688c93f5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:20.317822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c504447-a023-4803-817a-e7aa228f455b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:20.335771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c504447-a023-4803-817a-e7aa228f455b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:20.501935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece3ca4-d390-48d9-a3bd-a24b7cbbf635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:20.502632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece3ca4-d390-48d9-a3bd-a24b7cbbf635 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:20.513136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece3ca4-d390-48d9-a3bd-a24b7cbbf635 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:20.513482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece3ca4-d390-48d9-a3bd-a24b7cbbf635 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:20.514228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece3ca4-d390-48d9-a3bd-a24b7cbbf635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:20.515902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece3ca4-d390-48d9-a3bd-a24b7cbbf635 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:20.549884 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3670/7375] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:20.554711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc305650-4b19-4f15-8218-231ae7ab3a3d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:20.570159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc305650-4b19-4f15-8218-231ae7ab3a3d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:20.598472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed5a56-3ac2-4c5e-8ec1-f9ff97431b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:20.599579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed5a56-3ac2-4c5e-8ec1-f9ff97431b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:20.599730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed5a56-3ac2-4c5e-8ec1-f9ff97431b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:20.599962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed5a56-3ac2-4c5e-8ec1-f9ff97431b76 admin admin] PATH_INFO: `/v3/projects/cf4ef04f99064851aa8773a960f04977/users/48d4323f12734c0bb2b54d9f688c93f5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:20.603683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed5a56-3ac2-4c5e-8ec1-f9ff97431b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4ef04f99064851aa8773a960f04977, user_id=48d4323f12734c0bb2b54d9f688c93f5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:20.613961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed5a56-3ac2-4c5e-8ec1-f9ff97431b76 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:20.628510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3706/7376] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:20 2022] PUT /identity/v3/projects/cf4ef04f99064851aa8773a960f04977/users/48d4323f12734c0bb2b54d9f688c93f5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:20.640585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f0628-657a-4485-aae2-14d9527e5675 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:20.640933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f0628-657a-4485-aae2-14d9527e5675 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:20.641225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f0628-657a-4485-aae2-14d9527e5675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:20.696837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-335f0628-657a-4485-aae2-14d9527e5675 None None] MFA Rules not processed for user `48d4323f12734c0bb2b54d9f688c93f5`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:20.698518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-335f0628-657a-4485-aae2-14d9527e5675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:20.867263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed5a56-3ac2-4c5e-8ec1-f9ff97431b76 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:20.875212 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3671/7377] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:20.888101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed5a56-3ac2-4c5e-8ec1-f9ff97431b76 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:20.893730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c713be-7e66-4f10-a6d2-37b0b6d59763 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d4323f12734c0bb2b54d9f688c93f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ef04f99064851aa8773a960f04977', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:20.894410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c713be-7e66-4f10-a6d2-37b0b6d59763 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:20.894703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c713be-7e66-4f10-a6d2-37b0b6d59763 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:20.894989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c713be-7e66-4f10-a6d2-37b0b6d59763 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:20.896194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c713be-7e66-4f10-a6d2-37b0b6d59763 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:20.897932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c713be-7e66-4f10-a6d2-37b0b6d59763 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:20.925104 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3707/7378] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:15:20 2022] POST /identity/v3/domains => generated 246 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:20.929912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f0628-657a-4485-aae2-14d9527e5675 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:20.944740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f0628-657a-4485-aae2-14d9527e5675 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:21.159952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c713be-7e66-4f10-a6d2-37b0b6d59763 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:21.162199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e0c713be-7e66-4f10-a6d2-37b0b6d59763 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:21.162941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df339-afec-4551-ae2c-e32cb8d38ef7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d4323f12734c0bb2b54d9f688c93f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ef04f99064851aa8773a960f04977', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:21.163629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df339-afec-4551-ae2c-e32cb8d38ef7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:21.163953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df339-afec-4551-ae2c-e32cb8d38ef7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:21.164273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8df339-afec-4551-ae2c-e32cb8d38ef7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:21.166547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df339-afec-4551-ae2c-e32cb8d38ef7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:21.170527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8df339-afec-4551-ae2c-e32cb8d38ef7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:21.269204 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3672/7379] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:20 2022] POST /identity/v3/projects => generated 409 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:21.280911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df339-afec-4551-ae2c-e32cb8d38ef7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:21.347647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c713be-7e66-4f10-a6d2-37b0b6d59763 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:21.453572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae8cee-efb5-48b0-84be-93b97699af27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:21.454295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae8cee-efb5-48b0-84be-93b97699af27 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:21.456002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae8cee-efb5-48b0-84be-93b97699af27 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:21.456364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae8cee-efb5-48b0-84be-93b97699af27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:21.458850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e4ae8cee-efb5-48b0-84be-93b97699af27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:21.482543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae8cee-efb5-48b0-84be-93b97699af27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:21.484049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae8cee-efb5-48b0-84be-93b97699af27 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:21.485956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8df339-afec-4551-ae2c-e32cb8d38ef7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:21.503349 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3708/7380] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:21.505742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a28f15-a933-4cb4-a84e-28ddbb9a8a88 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d4323f12734c0bb2b54d9f688c93f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ef04f99064851aa8773a960f04977', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:21.506448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a28f15-a933-4cb4-a84e-28ddbb9a8a88 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:21.506737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a28f15-a933-4cb4-a84e-28ddbb9a8a88 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:21.507177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a28f15-a933-4cb4-a84e-28ddbb9a8a88 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:21.507838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a28f15-a933-4cb4-a84e-28ddbb9a8a88 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:21.511170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a28f15-a933-4cb4-a84e-28ddbb9a8a88 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:21.558516 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3673/7381] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:21 2022] POST /identity/v3/users => generated 348 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:21.558817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae8cee-efb5-48b0-84be-93b97699af27 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:21.580587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae8cee-efb5-48b0-84be-93b97699af27 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:21.599228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e146a-a24a-4040-868c-75cb57289600 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d4323f12734c0bb2b54d9f688c93f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ef04f99064851aa8773a960f04977', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:21.600678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e146a-a24a-4040-868c-75cb57289600 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:21.601167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e146a-a24a-4040-868c-75cb57289600 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:21.601620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e146a-a24a-4040-868c-75cb57289600 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:21.610257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e146a-a24a-4040-868c-75cb57289600 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:21.617949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e146a-a24a-4040-868c-75cb57289600 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:21.648286 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3709/7382] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:21.649283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a28f15-a933-4cb4-a84e-28ddbb9a8a88 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:21.662479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a28f15-a933-4cb4-a84e-28ddbb9a8a88 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:21.674579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e03932-6112-4db4-93bc-f034d8c2a342 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d4323f12734c0bb2b54d9f688c93f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ef04f99064851aa8773a960f04977', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:21.675817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e03932-6112-4db4-93bc-f034d8c2a342 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:21.678175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e03932-6112-4db4-93bc-f034d8c2a342 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:21.678606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e03932-6112-4db4-93bc-f034d8c2a342 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] PATH_INFO: `/v3/projects/0177502cd4ea409dbc276844de6bbe87/users/7ac02801a7d64dc7826029509f6aa67c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:21.721873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e03932-6112-4db4-93bc-f034d8c2a342 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0177502cd4ea409dbc276844de6bbe87, user_id=7ac02801a7d64dc7826029509f6aa67c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:21.725603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e03932-6112-4db4-93bc-f034d8c2a342 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:21.749800 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3674/7383] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:21 2022] PUT /identity/v3/projects/0177502cd4ea409dbc276844de6bbe87/users/7ac02801a7d64dc7826029509f6aa67c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:21.756642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632db1e-b601-4ffe-88eb-2f8d54f7cdca None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:21.756943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632db1e-b601-4ffe-88eb-2f8d54f7cdca None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:21.757226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632db1e-b601-4ffe-88eb-2f8d54f7cdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:21.929166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e632db1e-b601-4ffe-88eb-2f8d54f7cdca None None] MFA Rules not processed for user `7ac02801a7d64dc7826029509f6aa67c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:21.931426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e632db1e-b601-4ffe-88eb-2f8d54f7cdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:21.952859 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3710/7384] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:21.963598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c7503-70a2-4350-964f-689b850e5ae9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:21.963598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c7503-70a2-4350-964f-689b850e5ae9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:21.964022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c7503-70a2-4350-964f-689b850e5ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:21.997374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b15c7503-70a2-4350-964f-689b850e5ae9 None None] MFA Rules not processed for user `7ac02801a7d64dc7826029509f6aa67c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:21.998634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b15c7503-70a2-4350-964f-689b850e5ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:22.016801 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3675/7385] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:21 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:22.021326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632db1e-b601-4ffe-88eb-2f8d54f7cdca None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:22.034404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632db1e-b601-4ffe-88eb-2f8d54f7cdca None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:22.046922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd953ae-e768-4c48-b96b-c9a37e60fc3a tempest-test_project-1628700562 tempest-user-1463342939] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ac02801a7d64dc7826029509f6aa67c', 'user_domain_id': '83c444e1c89d45ba92ccbb88ce9de745', 'system_scope': None, 'project_id': '0177502cd4ea409dbc276844de6bbe87', 'project_domain_id': '83c444e1c89d45ba92ccbb88ce9de745', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:22.047591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd953ae-e768-4c48-b96b-c9a37e60fc3a tempest-test_project-1628700562 tempest-user-1463342939] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:22.047873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd953ae-e768-4c48-b96b-c9a37e60fc3a tempest-test_project-1628700562 tempest-user-1463342939] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:22.048698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd953ae-e768-4c48-b96b-c9a37e60fc3a tempest-test_project-1628700562 tempest-user-1463342939] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:22.069245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd953ae-e768-4c48-b96b-c9a37e60fc3a tempest-test_project-1628700562 tempest-user-1463342939] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:22.071045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd953ae-e768-4c48-b96b-c9a37e60fc3a tempest-test_project-1628700562 tempest-user-1463342939] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:22.095558 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3711/7386] 10.222.0.16 () {56 vars in 1283 bytes} [Sat Mar 26 21:15:22 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:22.100365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c7503-70a2-4350-964f-689b850e5ae9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:22.266741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c7503-70a2-4350-964f-689b850e5ae9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:22.292342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d4323f12734c0bb2b54d9f688c93f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ef04f99064851aa8773a960f04977', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:22.293620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:22.294086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:22.294527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] PATH_INFO: `/v3/users/7ac02801a7d64dc7826029509f6aa67c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:22.296088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7ac02801a7d64dc7826029509f6aa67c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:22.298889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:22.401848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac02801a7d64dc7826029509f6aa67c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.424050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac02801a7d64dc7826029509f6aa67c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.425493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac02801a7d64dc7826029509f6aa67c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.427279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac02801a7d64dc7826029509f6aa67c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.452310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac02801a7d64dc7826029509f6aa67c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.482040 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3676/7387] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:22 2022] DELETE /identity/v3/users/7ac02801a7d64dc7826029509f6aa67c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:22.487008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd953ae-e768-4c48-b96b-c9a37e60fc3a tempest-test_project-1628700562 tempest-user-1463342939] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:22.504511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd953ae-e768-4c48-b96b-c9a37e60fc3a tempest-test_project-1628700562 tempest-user-1463342939] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:22.603098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d4323f12734c0bb2b54d9f688c93f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ef04f99064851aa8773a960f04977', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:22.605405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:22.605908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:22.606361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] PATH_INFO: `/v3/projects/0177502cd4ea409dbc276844de6bbe87` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:22.608603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0177502cd4ea409dbc276844de6bbe87)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:22.611143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:22.692527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0177502cd4ea409dbc276844de6bbe87', 'request_id': 'req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.715162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0177502cd4ea409dbc276844de6bbe87', 'request_id': 'req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.724008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0177502cd4ea409dbc276844de6bbe87', 'request_id': 'req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.742291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] The token cache is being invalidate because project 0177502cd4ea409dbc276844de6bbe87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:22.742602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.743269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.745784 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3712/7388] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:22 2022] DELETE /identity/v3/projects/0177502cd4ea409dbc276844de6bbe87 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:22.749212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:22.750852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:22.774763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29d552-083d-459c-aa0d-ab1353dcf3c7 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:22.864051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d4323f12734c0bb2b54d9f688c93f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ef04f99064851aa8773a960f04977', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:22.865999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:22.867219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:22.867532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] PATH_INFO: `/v3/domains/83c444e1c89d45ba92ccbb88ce9de745` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:22.872512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=83c444e1c89d45ba92ccbb88ce9de745)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:22.874207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:22.921048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.925549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.980682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.981617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:22.985922 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3677/7389] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:15:22 2022] PATCH /identity/v3/domains/83c444e1c89d45ba92ccbb88ce9de745 => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:22.990677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:22.992390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:23.013787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d1353-1f82-44ee-85b0-f5e2e24f4eb6 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:23.094641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d4323f12734c0bb2b54d9f688c93f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cf4ef04f99064851aa8773a960f04977', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:23.095570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:23.095851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:23.096841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] PATH_INFO: `/v3/domains/83c444e1c89d45ba92ccbb88ce9de745` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:23.111888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=83c444e1c89d45ba92ccbb88ce9de745)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:23.114245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:23.154100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.157899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.261740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745', 'request_id': 'req-720689f9-5b42-4096-ba8c-33cc4a87648c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.274732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745', 'request_id': 'req-720689f9-5b42-4096-ba8c-33cc4a87648c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.291938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745', 'request_id': 'req-720689f9-5b42-4096-ba8c-33cc4a87648c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.311248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] The token cache is being invalidate because project 83c444e1c89d45ba92ccbb88ce9de745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:23.312007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.313006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.324278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745', 'request_id': 'req-720689f9-5b42-4096-ba8c-33cc4a87648c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.325675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745', 'request_id': 'req-720689f9-5b42-4096-ba8c-33cc4a87648c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.326574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-720689f9-5b42-4096-ba8c-33cc4a87648c tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '83c444e1c89d45ba92ccbb88ce9de745', 'request_id': 'req-720689f9-5b42-4096-ba8c-33cc4a87648c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.342791 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3713/7390] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:22 2022] DELETE /identity/v3/domains/83c444e1c89d45ba92ccbb88ce9de745 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:23.348884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:23.351353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:23.561125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5ecb1-9d7e-4839-997e-23e0e2406333 tempest-TestDefaultProjectId-849575454 tempest-TestDefaultProjectId-849575454-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:23.726639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:23.727555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:23.729303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:23.729802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] PATH_INFO: `/v3/users/72152ce0b0d74e1ca7aa7a396f4730f2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:23.731381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=72152ce0b0d74e1ca7aa7a396f4730f2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:23.734270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:23.851821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72152ce0b0d74e1ca7aa7a396f4730f2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.871976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72152ce0b0d74e1ca7aa7a396f4730f2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.873414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72152ce0b0d74e1ca7aa7a396f4730f2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.874714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72152ce0b0d74e1ca7aa7a396f4730f2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.908103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72152ce0b0d74e1ca7aa7a396f4730f2'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:23.947293 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3678/7391] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:23 2022] DELETE /identity/v3/users/72152ce0b0d74e1ca7aa7a396f4730f2 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:23.953465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24705-36d5-4cd8-8a6f-83366fd5d4ed None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:23.953789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24705-36d5-4cd8-8a6f-83366fd5d4ed None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:23.954032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef24705-36d5-4cd8-8a6f-83366fd5d4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:24.034515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2ef24705-36d5-4cd8-8a6f-83366fd5d4ed None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:24.040633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2ef24705-36d5-4cd8-8a6f-83366fd5d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:24.217419 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3714/7392] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:24.331787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:24.334203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:24.413866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2236ee-2f74-4c43-aebc-c0a0fb2395fb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:24.418339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c6181-48a3-4b67-b8bf-a1325ec80191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:24.419528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c6181-48a3-4b67-b8bf-a1325ec80191 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:24.420087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c6181-48a3-4b67-b8bf-a1325ec80191 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:24.420623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c6181-48a3-4b67-b8bf-a1325ec80191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:24.434545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c6181-48a3-4b67-b8bf-a1325ec80191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:24.436422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c6181-48a3-4b67-b8bf-a1325ec80191 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:24.450026 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3679/7393] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:24.602646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24705-36d5-4cd8-8a6f-83366fd5d4ed None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:24.609773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2ef24705-36d5-4cd8-8a6f-83366fd5d4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:24.649170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef24705-36d5-4cd8-8a6f-83366fd5d4ed None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:24.660034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:24.660855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:24.661147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:24.661426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:24.666414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:24.693080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:24.694600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:24.730433 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3715/7394] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:25.467655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cba5c-7154-4e1f-991f-afa4f4660a3f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:25.468345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cba5c-7154-4e1f-991f-afa4f4660a3f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:25.468457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cba5c-7154-4e1f-991f-afa4f4660a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:25.512987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-964cba5c-7154-4e1f-991f-afa4f4660a3f None None] MFA Rules not processed for user `10f32ba8b41641a4ac539ace0bb4ac5c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:25.514479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-964cba5c-7154-4e1f-991f-afa4f4660a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:25.538405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:25.541395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:25.582600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4b76b-2f9e-4e78-bd0d-4c63f1979864 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:25.611558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:25.612914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:25.613451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:25.613948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] PATH_INFO: `/v3/projects/f9e38e8c00034d389ea0392f785d7b62` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:25.615629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e38e8c00034d389ea0392f785d7b62)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:25.619800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:25.699265 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3680/7395] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:25.700589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cba5c-7154-4e1f-991f-afa4f4660a3f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:25.705235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-964cba5c-7154-4e1f-991f-afa4f4660a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:25.757821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e38e8c00034d389ea0392f785d7b62', 'request_id': 'req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:25.773557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e38e8c00034d389ea0392f785d7b62', 'request_id': 'req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:25.788448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e38e8c00034d389ea0392f785d7b62', 'request_id': 'req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:25.807894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] The token cache is being invalidate because project f9e38e8c00034d389ea0392f785d7b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:25.808629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:25.810728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:25.816377 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3716/7396] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:25 2022] DELETE /identity/v3/projects/f9e38e8c00034d389ea0392f785d7b62 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:25.820658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:25.824790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:25.888939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cba5c-7154-4e1f-991f-afa4f4660a3f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:25.987270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4c9ce-2c36-4913-8f41-c5dea97cbd6a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:25.993300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:25.994207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:25.994494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:25.995657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] PATH_INFO: `/v3/users/48d4323f12734c0bb2b54d9f688c93f5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:25.997076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48d4323f12734c0bb2b54d9f688c93f5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:25.999090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:26.047850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:26.055231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:26.056070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:26.056612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:26.059208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:26.103396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48d4323f12734c0bb2b54d9f688c93f5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.114074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48d4323f12734c0bb2b54d9f688c93f5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.115210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48d4323f12734c0bb2b54d9f688c93f5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.116099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48d4323f12734c0bb2b54d9f688c93f5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.139664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48d4323f12734c0bb2b54d9f688c93f5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.158000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:26.166763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:26.192401 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3717/7397] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:25 2022] DELETE /identity/v3/users/48d4323f12734c0bb2b54d9f688c93f5 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:26.193700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:26.199198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:26.199906 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3681/7398] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:26.316943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ba6cf-5db5-4d07-81dc-a264a6ecd959 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:26.322192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:26.323341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:26.324206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:26.324721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] PATH_INFO: `/v3/users/54a09bedd0ad4328b1e687fc5f7e3967` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:26.326385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a09bedd0ad4328b1e687fc5f7e3967)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:26.328679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:26.432874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a09bedd0ad4328b1e687fc5f7e3967'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.444254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a09bedd0ad4328b1e687fc5f7e3967'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.445639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a09bedd0ad4328b1e687fc5f7e3967'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.446511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a09bedd0ad4328b1e687fc5f7e3967'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.458432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3ff8aa97-881d-44a1-baa9-df51e9ee366d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a09bedd0ad4328b1e687fc5f7e3967'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:26.499528 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3718/7399] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:26 2022] DELETE /identity/v3/users/54a09bedd0ad4328b1e687fc5f7e3967 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:26.732472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:26.734679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:26.781144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5825c-452f-4b6e-86e8-37cec871ef3a service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:26.893386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:26.894132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:26.903013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:26.903533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] PATH_INFO: `/v3/projects/52b4455ec1a2447ebb1f737c0d97fc83` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:26.905027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b4455ec1a2447ebb1f737c0d97fc83)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:26.908590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:26.998707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b4455ec1a2447ebb1f737c0d97fc83', 'request_id': 'req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.026566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b4455ec1a2447ebb1f737c0d97fc83', 'request_id': 'req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.033236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b4455ec1a2447ebb1f737c0d97fc83', 'request_id': 'req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.059176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] The token cache is being invalidate because project 52b4455ec1a2447ebb1f737c0d97fc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:27.059422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.067580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.074830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f814-cff6-44b4-b696-fc29fa48326a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.075758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f814-cff6-44b4-b696-fc29fa48326a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.076354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f814-cff6-44b4-b696-fc29fa48326a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.078642 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3682/7400] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:26 2022] DELETE /identity/v3/projects/52b4455ec1a2447ebb1f737c0d97fc83 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:27.101361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a025f814-cff6-44b4-b696-fc29fa48326a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:27.103091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a025f814-cff6-44b4-b696-fc29fa48326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:27.139514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.142610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:27.245113 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3719/7401] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:27.246961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05111fc-4253-4087-b12a-86b5bbab1d6e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.247464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05111fc-4253-4087-b12a-86b5bbab1d6e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.249276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05111fc-4253-4087-b12a-86b5bbab1d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.278170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d05111fc-4253-4087-b12a-86b5bbab1d6e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:27.280156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d05111fc-4253-4087-b12a-86b5bbab1d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:27.298863 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3720/7402] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:27.300437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05111fc-4253-4087-b12a-86b5bbab1d6e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.309089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0af428-ac2d-4b56-bd66-2ad17c7440e5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.315893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05111fc-4253-4087-b12a-86b5bbab1d6e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.319719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:27.320996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.321699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.322703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] PATH_INFO: `/v3/projects/cf4ef04f99064851aa8773a960f04977` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.324966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf4ef04f99064851aa8773a960f04977)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:27.329809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af047a-fd30-45b1-97c5-6ca1cc69d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:27.330695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af047a-fd30-45b1-97c5-6ca1cc69d579 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.331083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af047a-fd30-45b1-97c5-6ca1cc69d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.331459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af047a-fd30-45b1-97c5-6ca1cc69d579 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.331984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:27.332842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af047a-fd30-45b1-97c5-6ca1cc69d579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:27.334913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af047a-fd30-45b1-97c5-6ca1cc69d579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:27.339279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af047a-fd30-45b1-97c5-6ca1cc69d579 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:27.357730 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3721/7403] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:27.362071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af047a-fd30-45b1-97c5-6ca1cc69d579 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.377349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af047a-fd30-45b1-97c5-6ca1cc69d579 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.382565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dff55-2418-4863-924e-569df9fd6489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:27.383353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dff55-2418-4863-924e-569df9fd6489 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.383734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dff55-2418-4863-924e-569df9fd6489 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.384147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90dff55-2418-4863-924e-569df9fd6489 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.385100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dff55-2418-4863-924e-569df9fd6489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:27.387716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90dff55-2418-4863-924e-569df9fd6489 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:27.402098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf4ef04f99064851aa8773a960f04977', 'request_id': 'req-1671c840-6aba-40b6-af73-c005f2f7d3e6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.416235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf4ef04f99064851aa8773a960f04977', 'request_id': 'req-1671c840-6aba-40b6-af73-c005f2f7d3e6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.426095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf4ef04f99064851aa8773a960f04977', 'request_id': 'req-1671c840-6aba-40b6-af73-c005f2f7d3e6'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.441655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] The token cache is being invalidate because project cf4ef04f99064851aa8773a960f04977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:27.442088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.442893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1671c840-6aba-40b6-af73-c005f2f7d3e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:27.444883 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3683/7404] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:27 2022] DELETE /identity/v3/projects/cf4ef04f99064851aa8773a960f04977 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:27.449440 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3722/7405] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:27 2022] POST /identity/v3/projects => generated 391 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:27.449864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66919-cf17-4ba4-95ca-cdf90abb7a9c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.450269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66919-cf17-4ba4-95ca-cdf90abb7a9c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.450485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dff55-2418-4863-924e-569df9fd6489 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.451512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab66919-cf17-4ba4-95ca-cdf90abb7a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.452663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e90dff55-2418-4863-924e-569df9fd6489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:27.495524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7ab66919-cf17-4ba4-95ca-cdf90abb7a9c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:27.497254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7ab66919-cf17-4ba4-95ca-cdf90abb7a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:27.570613 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3684/7406] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:27.578926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036264c-4bf9-4fe4-af89-3b64a391f250 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.580213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036264c-4bf9-4fe4-af89-3b64a391f250 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.580608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036264c-4bf9-4fe4-af89-3b64a391f250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.585322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90dff55-2418-4863-924e-569df9fd6489 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.591483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77c56-f1f9-4d0d-ad02-f8d2ee10d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:27.591890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77c56-f1f9-4d0d-ad02-f8d2ee10d37e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.592276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77c56-f1f9-4d0d-ad02-f8d2ee10d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.592662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f77c56-f1f9-4d0d-ad02-f8d2ee10d37e admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.593429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f77c56-f1f9-4d0d-ad02-f8d2ee10d37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:27.596509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f77c56-f1f9-4d0d-ad02-f8d2ee10d37e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:27.617127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4036264c-4bf9-4fe4-af89-3b64a391f250 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:27.618717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4036264c-4bf9-4fe4-af89-3b64a391f250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:27.628780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3723/7407] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:27 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:27.630123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77c56-f1f9-4d0d-ad02-f8d2ee10d37e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.632806 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3685/7408] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:27.633716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036264c-4bf9-4fe4-af89-3b64a391f250 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.647670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f77c56-f1f9-4d0d-ad02-f8d2ee10d37e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.648584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036264c-4bf9-4fe4-af89-3b64a391f250 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.654695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85954d-a075-4ff3-862d-f7f86e69934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:27.655191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f3190-f14f-4ded-9204-ac089fc2ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:27.655400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85954d-a075-4ff3-862d-f7f86e69934b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.655693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85954d-a075-4ff3-862d-f7f86e69934b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.656120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85954d-a075-4ff3-862d-f7f86e69934b admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.656350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f3190-f14f-4ded-9204-ac089fc2ea9a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.656731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f3190-f14f-4ded-9204-ac089fc2ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.656876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85954d-a075-4ff3-862d-f7f86e69934b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:27.657154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85954d-a075-4ff3-862d-f7f86e69934b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:27.657360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51f3190-f14f-4ded-9204-ac089fc2ea9a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.658377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f3190-f14f-4ded-9204-ac089fc2ea9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:27.659466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85954d-a075-4ff3-862d-f7f86e69934b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:27.660392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51f3190-f14f-4ded-9204-ac089fc2ea9a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:27.674789 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3724/7409] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:27.675839 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3686/7410] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:27.680730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85954d-a075-4ff3-862d-f7f86e69934b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.680939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f3190-f14f-4ded-9204-ac089fc2ea9a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.694289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85954d-a075-4ff3-862d-f7f86e69934b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.694449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51f3190-f14f-4ded-9204-ac089fc2ea9a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.699687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839708-48d1-4b14-93f7-5a790fd4e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:27.699905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dd4bb-dbf3-463d-9e7d-58be4fe48028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:27.700644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839708-48d1-4b14-93f7-5a790fd4e8bb admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.700775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dd4bb-dbf3-463d-9e7d-58be4fe48028 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.700988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839708-48d1-4b14-93f7-5a790fd4e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.701111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dd4bb-dbf3-463d-9e7d-58be4fe48028 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.701262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167dd4bb-dbf3-463d-9e7d-58be4fe48028 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.701386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81839708-48d1-4b14-93f7-5a790fd4e8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.702323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dd4bb-dbf3-463d-9e7d-58be4fe48028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:27.702465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81839708-48d1-4b14-93f7-5a790fd4e8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:27.705013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167dd4bb-dbf3-463d-9e7d-58be4fe48028 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:27.705328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81839708-48d1-4b14-93f7-5a790fd4e8bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:27.724193 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3725/7411] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:27.725580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dd4bb-dbf3-463d-9e7d-58be4fe48028 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.738188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167dd4bb-dbf3-463d-9e7d-58be4fe48028 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.745897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fec9cb-4eb4-4932-9d32-b8fe29912282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:27.749543 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3687/7412] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:27 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:27.750039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fec9cb-4eb4-4932-9d32-b8fe29912282 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.750039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fec9cb-4eb4-4932-9d32-b8fe29912282 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.750613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839708-48d1-4b14-93f7-5a790fd4e8bb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.751887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fec9cb-4eb4-4932-9d32-b8fe29912282 admin admin] PATH_INFO: `/v3/projects/1922967207fb4c17a20ee1aed55f8116/users/fa0e197e06274ad5811c8d50ed9c7570/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.781972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fec9cb-4eb4-4932-9d32-b8fe29912282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1922967207fb4c17a20ee1aed55f8116, user_id=fa0e197e06274ad5811c8d50ed9c7570, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:27.784807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fec9cb-4eb4-4932-9d32-b8fe29912282 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:27.812302 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3726/7413] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:27 2022] PUT /identity/v3/projects/1922967207fb4c17a20ee1aed55f8116/users/fa0e197e06274ad5811c8d50ed9c7570/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:27.815461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec254a8-5c1b-41a1-a9d3-ca99503fb67a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:27.815753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec254a8-5c1b-41a1-a9d3-ca99503fb67a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:27.817403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec254a8-5c1b-41a1-a9d3-ca99503fb67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:27.853752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-cec254a8-5c1b-41a1-a9d3-ca99503fb67a None None] MFA Rules not processed for user `fa0e197e06274ad5811c8d50ed9c7570`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:27.856099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cec254a8-5c1b-41a1-a9d3-ca99503fb67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:27.861554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81839708-48d1-4b14-93f7-5a790fd4e8bb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:27.972166 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3727/7414] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:27.986988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec254a8-5c1b-41a1-a9d3-ca99503fb67a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:27.989669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cec254a8-5c1b-41a1-a9d3-ca99503fb67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:28.000363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d97b5d-a8d1-4836-ba89-715333e27553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:28.002213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d97b5d-a8d1-4836-ba89-715333e27553 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.002489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d97b5d-a8d1-4836-ba89-715333e27553 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.002821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d97b5d-a8d1-4836-ba89-715333e27553 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.003715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d97b5d-a8d1-4836-ba89-715333e27553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:28.016150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d97b5d-a8d1-4836-ba89-715333e27553 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:28.060153 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3688/7415] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:27 2022] POST /identity/v3/users => generated 283 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:28.062105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d97b5d-a8d1-4836-ba89-715333e27553 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:28.077439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d97b5d-a8d1-4836-ba89-715333e27553 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:28.083532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db701e63-5e22-4d7e-9eac-6693fed5f59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:28.083940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db701e63-5e22-4d7e-9eac-6693fed5f59c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.084247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db701e63-5e22-4d7e-9eac-6693fed5f59c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.084529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db701e63-5e22-4d7e-9eac-6693fed5f59c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.085257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db701e63-5e22-4d7e-9eac-6693fed5f59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:28.087138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db701e63-5e22-4d7e-9eac-6693fed5f59c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:28.092215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec254a8-5c1b-41a1-a9d3-ca99503fb67a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:28.096464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613853f-7b26-4256-b092-e0013fa86ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:28.097407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613853f-7b26-4256-b092-e0013fa86ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.098073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613853f-7b26-4256-b092-e0013fa86ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.098458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613853f-7b26-4256-b092-e0013fa86ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.102621 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3689/7416] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:28.103626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db701e63-5e22-4d7e-9eac-6693fed5f59c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:28.114119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613853f-7b26-4256-b092-e0013fa86ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:28.115323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e613853f-7b26-4256-b092-e0013fa86ce9 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:28.119375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db701e63-5e22-4d7e-9eac-6693fed5f59c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:28.126785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08a4fe-1263-4911-9415-64101410beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:28.127511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08a4fe-1263-4911-9415-64101410beb1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.127819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08a4fe-1263-4911-9415-64101410beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.128154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08a4fe-1263-4911-9415-64101410beb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.130383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08a4fe-1263-4911-9415-64101410beb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:28.132164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08a4fe-1263-4911-9415-64101410beb1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:28.144959 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3728/7417] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:27 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:28.162028 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3690/7418] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:28.166495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613853f-7b26-4256-b092-e0013fa86ce9 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:28.180953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613853f-7b26-4256-b092-e0013fa86ce9 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:28.186935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85500-8820-4366-a8c7-8ec032c6855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:28.188004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85500-8820-4366-a8c7-8ec032c6855e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.188262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85500-8820-4366-a8c7-8ec032c6855e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.188587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85500-8820-4366-a8c7-8ec032c6855e admin admin] PATH_INFO: `/v3/projects/6662102b722b44f78c64a13a809ca434/users/ff45322546f549c795fe43acb3148108/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.213026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c85500-8820-4366-a8c7-8ec032c6855e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6662102b722b44f78c64a13a809ca434, user_id=ff45322546f549c795fe43acb3148108, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:28.216277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c85500-8820-4366-a8c7-8ec032c6855e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:28.249683 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3729/7419] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:28 2022] PUT /identity/v3/projects/6662102b722b44f78c64a13a809ca434/users/ff45322546f549c795fe43acb3148108/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:28.261917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476bdca-c776-449e-b2ca-df01049d8e0e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.262277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476bdca-c776-449e-b2ca-df01049d8e0e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.262492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476bdca-c776-449e-b2ca-df01049d8e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.296046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7476bdca-c776-449e-b2ca-df01049d8e0e None None] MFA Rules not processed for user `ff45322546f549c795fe43acb3148108`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:28.297282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7476bdca-c776-449e-b2ca-df01049d8e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:28.403245 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3691/7420] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:28.405131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85500-8820-4366-a8c7-8ec032c6855e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:28.568213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85500-8820-4366-a8c7-8ec032c6855e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:28.579900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86fa74d-f053-4b13-908f-8eb8fad6d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:28.580710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa74d-f053-4b13-908f-8eb8fad6d9da admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.581356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa74d-f053-4b13-908f-8eb8fad6d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.581648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86fa74d-f053-4b13-908f-8eb8fad6d9da admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.585635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa74d-f053-4b13-908f-8eb8fad6d9da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:28.588162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86fa74d-f053-4b13-908f-8eb8fad6d9da admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:28.631008 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3730/7421] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:28 2022] POST /identity/v3/projects => generated 367 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:28.632187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476bdca-c776-449e-b2ca-df01049d8e0e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:28.649878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476bdca-c776-449e-b2ca-df01049d8e0e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:28.762917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5683f3-17d5-4e04-980a-86cd53e50dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:28.763670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5683f3-17d5-4e04-980a-86cd53e50dcb admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.763994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5683f3-17d5-4e04-980a-86cd53e50dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.764204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5683f3-17d5-4e04-980a-86cd53e50dcb admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.764921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5683f3-17d5-4e04-980a-86cd53e50dcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:28.767380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5683f3-17d5-4e04-980a-86cd53e50dcb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:28.800200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728f068-0020-4c6e-bd93-0ab49513c5e3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.800558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728f068-0020-4c6e-bd93-0ab49513c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.800842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728f068-0020-4c6e-bd93-0ab49513c5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.814426 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3692/7422] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:28 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:28.814913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5683f3-17d5-4e04-980a-86cd53e50dcb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:28.837885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b728f068-0020-4c6e-bd93-0ab49513c5e3 None None] MFA Rules not processed for user `7ac02d48a08c4284ae0c82008c970e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:28.839213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b728f068-0020-4c6e-bd93-0ab49513c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:28.849595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5683f3-17d5-4e04-980a-86cd53e50dcb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:28.859215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfa2b5-8f31-44f8-8c44-23f5c3e0a130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:28.859899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfa2b5-8f31-44f8-8c44-23f5c3e0a130 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.860556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfa2b5-8f31-44f8-8c44-23f5c3e0a130 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.860849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfa2b5-8f31-44f8-8c44-23f5c3e0a130 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.861901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfa2b5-8f31-44f8-8c44-23f5c3e0a130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:28.865549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfa2b5-8f31-44f8-8c44-23f5c3e0a130 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:28.885242 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3693/7423] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:28.890908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfa2b5-8f31-44f8-8c44-23f5c3e0a130 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:28.913708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfa2b5-8f31-44f8-8c44-23f5c3e0a130 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:28.919212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa1af0-6a30-420a-8b73-7455b0462c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:28.920438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa1af0-6a30-420a-8b73-7455b0462c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:28.921282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa1af0-6a30-420a-8b73-7455b0462c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:28.921282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa1af0-6a30-420a-8b73-7455b0462c57 admin admin] PATH_INFO: `/v3/projects/68ccc2eff6ed4e1e90e1b2ede2a3f96e/users/dec6a673315a479cb33975e61c8c1a4c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:28.961223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa1af0-6a30-420a-8b73-7455b0462c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ccc2eff6ed4e1e90e1b2ede2a3f96e, user_id=dec6a673315a479cb33975e61c8c1a4c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:28.967209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa1af0-6a30-420a-8b73-7455b0462c57 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:28.993213 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3731/7424] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:29.036344 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3694/7425] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:28 2022] PUT /identity/v3/projects/68ccc2eff6ed4e1e90e1b2ede2a3f96e/users/dec6a673315a479cb33975e61c8c1a4c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:29.037353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728f068-0020-4c6e-bd93-0ab49513c5e3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:29.059245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728f068-0020-4c6e-bd93-0ab49513c5e3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:29.166508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3c2ba-37d3-4b1a-8aba-e5412876905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:29.167237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3c2ba-37d3-4b1a-8aba-e5412876905d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:29.167852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3c2ba-37d3-4b1a-8aba-e5412876905d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:29.168339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3c2ba-37d3-4b1a-8aba-e5412876905d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:29.169675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3c2ba-37d3-4b1a-8aba-e5412876905d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:29.174401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3c2ba-37d3-4b1a-8aba-e5412876905d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:29.198773 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3732/7426] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:29.200271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa1af0-6a30-420a-8b73-7455b0462c57 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:29.217208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa1af0-6a30-420a-8b73-7455b0462c57 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:29.224409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a169406-d2e3-4f08-b843-3be8307b336b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:29.225317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a169406-d2e3-4f08-b843-3be8307b336b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:29.225605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a169406-d2e3-4f08-b843-3be8307b336b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:29.225886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a169406-d2e3-4f08-b843-3be8307b336b admin admin] PATH_INFO: `/v3/projects/68ccc2eff6ed4e1e90e1b2ede2a3f96e/users/dec6a673315a479cb33975e61c8c1a4c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:29.227961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a169406-d2e3-4f08-b843-3be8307b336b admin admin] RBAC: Authorizing `identity:create_grant(project_id=68ccc2eff6ed4e1e90e1b2ede2a3f96e, user_id=dec6a673315a479cb33975e61c8c1a4c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:29.230811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a169406-d2e3-4f08-b843-3be8307b336b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:29.244817 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3695/7427] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:29 2022] PUT /identity/v3/projects/68ccc2eff6ed4e1e90e1b2ede2a3f96e/users/dec6a673315a479cb33975e61c8c1a4c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:29.255599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903df79-f8ad-4fd7-aa1e-81377128e01b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:29.255972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903df79-f8ad-4fd7-aa1e-81377128e01b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:29.256326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903df79-f8ad-4fd7-aa1e-81377128e01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:29.305035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f903df79-f8ad-4fd7-aa1e-81377128e01b None None] MFA Rules not processed for user `dec6a673315a479cb33975e61c8c1a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:29.306375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f903df79-f8ad-4fd7-aa1e-81377128e01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:29.400050 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3733/7428] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:29.404382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a169406-d2e3-4f08-b843-3be8307b336b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:29.418807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a169406-d2e3-4f08-b843-3be8307b336b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:29.423906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556a0a-3453-468f-97f3-f18f08694a3f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:29.424604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556a0a-3453-468f-97f3-f18f08694a3f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:29.424894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556a0a-3453-468f-97f3-f18f08694a3f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:29.425180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556a0a-3453-468f-97f3-f18f08694a3f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:29.425950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47556a0a-3453-468f-97f3-f18f08694a3f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:29.427707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47556a0a-3453-468f-97f3-f18f08694a3f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:29.463259 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3696/7429] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Mar 26 21:15:29 2022] POST /identity/v3/domains => generated 274 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:29.467067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903df79-f8ad-4fd7-aa1e-81377128e01b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:29.484170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903df79-f8ad-4fd7-aa1e-81377128e01b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:29.555646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b851742-f1ae-438b-ae05-5e7326d7a0a6 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:29.556689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b851742-f1ae-438b-ae05-5e7326d7a0a6 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:29.557342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b851742-f1ae-438b-ae05-5e7326d7a0a6 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:29.557342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b851742-f1ae-438b-ae05-5e7326d7a0a6 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:29.557958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b851742-f1ae-438b-ae05-5e7326d7a0a6 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:29.559593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b851742-f1ae-438b-ae05-5e7326d7a0a6 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:29.576634 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3734/7430] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Mar 26 21:15:29 2022] POST /identity/v3/domains => generated 277 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:29.581080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556a0a-3453-468f-97f3-f18f08694a3f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:29.591780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556a0a-3453-468f-97f3-f18f08694a3f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:29.664909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac96780-e953-48a9-8f2d-11fc6188a6e9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:29.665687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac96780-e953-48a9-8f2d-11fc6188a6e9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:29.666031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac96780-e953-48a9-8f2d-11fc6188a6e9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:29.666438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac96780-e953-48a9-8f2d-11fc6188a6e9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:29.667671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac96780-e953-48a9-8f2d-11fc6188a6e9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:29.669803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac96780-e953-48a9-8f2d-11fc6188a6e9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:29.686650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b851742-f1ae-438b-ae05-5e7326d7a0a6 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:29.689608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8b851742-f1ae-438b-ae05-5e7326d7a0a6 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:29.696006 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3697/7431] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Mar 26 21:15:29 2022] POST /identity/v3/domains => generated 276 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:29.696987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac96780-e953-48a9-8f2d-11fc6188a6e9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:29.767758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b851742-f1ae-438b-ae05-5e7326d7a0a6 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:29.770108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac96780-e953-48a9-8f2d-11fc6188a6e9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:29.776934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514d4e0-a02d-4e1d-97a8-bd3a842ee0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:29.778108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514d4e0-a02d-4e1d-97a8-bd3a842ee0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:29.778405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514d4e0-a02d-4e1d-97a8-bd3a842ee0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:29.778690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514d4e0-a02d-4e1d-97a8-bd3a842ee0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:29.779777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514d4e0-a02d-4e1d-97a8-bd3a842ee0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:29.782945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514d4e0-a02d-4e1d-97a8-bd3a842ee0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:29.832647 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3698/7432] 10.222.0.16 () {60 vars in 1149 bytes} [Sat Mar 26 21:15:29 2022] POST /identity/v3/domains => generated 279 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:29.833659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514d4e0-a02d-4e1d-97a8-bd3a842ee0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:29.846378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f01dc-eb0f-4028-88de-301a3dbe473a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:29.847339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f01dc-eb0f-4028-88de-301a3dbe473a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:29.847692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f01dc-eb0f-4028-88de-301a3dbe473a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:29.848341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f01dc-eb0f-4028-88de-301a3dbe473a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:29.850396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-319f01dc-eb0f-4028-88de-301a3dbe473a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:29.871933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f01dc-eb0f-4028-88de-301a3dbe473a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:29.874611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f01dc-eb0f-4028-88de-301a3dbe473a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:29.888544 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3735/7433] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:29.967463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514d4e0-a02d-4e1d-97a8-bd3a842ee0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:29.978853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:29.980232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:29.980525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:29.980966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/d5d58ee35b764f518c6b7f19abcc1f25` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:29.995248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d5d58ee35b764f518c6b7f19abcc1f25)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:29.997089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:30.042767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd5d58ee35b764f518c6b7f19abcc1f25'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.062408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd5d58ee35b764f518c6b7f19abcc1f25'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.164519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d58ee35b764f518c6b7f19abcc1f25', 'request_id': 'req-57656cc2-9141-4b4e-b117-4ac90efe918a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.171858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d58ee35b764f518c6b7f19abcc1f25', 'request_id': 'req-57656cc2-9141-4b4e-b117-4ac90efe918a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.180636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d58ee35b764f518c6b7f19abcc1f25', 'request_id': 'req-57656cc2-9141-4b4e-b117-4ac90efe918a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.199045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] The token cache is being invalidate because project d5d58ee35b764f518c6b7f19abcc1f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:30.199723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.200464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.209872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd5d58ee35b764f518c6b7f19abcc1f25', 'request_id': 'req-57656cc2-9141-4b4e-b117-4ac90efe918a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.210599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd5d58ee35b764f518c6b7f19abcc1f25', 'request_id': 'req-57656cc2-9141-4b4e-b117-4ac90efe918a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.211246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd5d58ee35b764f518c6b7f19abcc1f25', 'request_id': 'req-57656cc2-9141-4b4e-b117-4ac90efe918a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.221830 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3699/7434] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:29 2022] DELETE /identity/v3/domains/d5d58ee35b764f518c6b7f19abcc1f25 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:30.228141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f01dc-eb0f-4028-88de-301a3dbe473a service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:30.243958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f01dc-eb0f-4028-88de-301a3dbe473a service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:30.319840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2ff3-bc36-4470-9cd1-77eb905e8bea tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:30.320556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2ff3-bc36-4470-9cd1-77eb905e8bea tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:30.320838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2ff3-bc36-4470-9cd1-77eb905e8bea tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:30.321117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df2ff3-bc36-4470-9cd1-77eb905e8bea tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:30.321846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df2ff3-bc36-4470-9cd1-77eb905e8bea tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:30.323447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df2ff3-bc36-4470-9cd1-77eb905e8bea tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:30.344806 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3736/7435] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:15:30 2022] POST /identity/v3/domains => generated 249 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:30.349974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:30.351640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:30.368035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656cc2-9141-4b4e-b117-4ac90efe918a tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:30.462575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:30.463487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:30.463785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:30.464058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/4ed5dd74599a4b558b2786293a7a70b7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:30.477334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4ed5dd74599a4b558b2786293a7a70b7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:30.479194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:30.504040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.504982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.538111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.538847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.546044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3700/7436] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:15:30 2022] PATCH /identity/v3/domains/4ed5dd74599a4b558b2786293a7a70b7 => generated 250 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:30.546440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2ff3-bc36-4470-9cd1-77eb905e8bea tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:30.549113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d2df2ff3-bc36-4470-9cd1-77eb905e8bea tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:30.562920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df2ff3-bc36-4470-9cd1-77eb905e8bea tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:30.627177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:30.628148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:30.628441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:30.628720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/4ed5dd74599a4b558b2786293a7a70b7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:30.640464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4ed5dd74599a4b558b2786293a7a70b7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:30.642638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:30.671410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.675219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.744950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7', 'request_id': 'req-81dd976a-6e8d-42f3-9052-004ed50086a9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.754762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7', 'request_id': 'req-81dd976a-6e8d-42f3-9052-004ed50086a9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.762270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7', 'request_id': 'req-81dd976a-6e8d-42f3-9052-004ed50086a9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.797268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] The token cache is being invalidate because project 4ed5dd74599a4b558b2786293a7a70b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:30.797673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.799719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.819222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7', 'request_id': 'req-81dd976a-6e8d-42f3-9052-004ed50086a9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.820998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7', 'request_id': 'req-81dd976a-6e8d-42f3-9052-004ed50086a9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.823018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:30.823786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4ed5dd74599a4b558b2786293a7a70b7', 'request_id': 'req-81dd976a-6e8d-42f3-9052-004ed50086a9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:30.824462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:30.837997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3737/7437] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:30 2022] DELETE /identity/v3/domains/4ed5dd74599a4b558b2786293a7a70b7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:30.842676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:30.844793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:30.949599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318cfca7-c077-4df1-81df-647289169236 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:30.999618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd976a-6e8d-42f3-9052-004ed50086a9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:31.010885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accf7ba-2f9b-4527-8911-6d4a41f6cd6f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:31.011663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accf7ba-2f9b-4527-8911-6d4a41f6cd6f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.012106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accf7ba-2f9b-4527-8911-6d4a41f6cd6f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.012733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accf7ba-2f9b-4527-8911-6d4a41f6cd6f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.016657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accf7ba-2f9b-4527-8911-6d4a41f6cd6f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:31.021938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accf7ba-2f9b-4527-8911-6d4a41f6cd6f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:31.050631 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3738/7438] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:15:30 2022] POST /identity/v3/domains => generated 279 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:31.053250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:31.054139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.054675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.054949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] PATH_INFO: `/v3/users/37085f06e4b44197bf1cdb202ecc9ac9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.056207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37085f06e4b44197bf1cdb202ecc9ac9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:31.057287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accf7ba-2f9b-4527-8911-6d4a41f6cd6f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:31.058744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:31.146983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37085f06e4b44197bf1cdb202ecc9ac9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.183269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accf7ba-2f9b-4527-8911-6d4a41f6cd6f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:31.189372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:31.189573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37085f06e4b44197bf1cdb202ecc9ac9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.190139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37085f06e4b44197bf1cdb202ecc9ac9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.190920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37085f06e4b44197bf1cdb202ecc9ac9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.191502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.192076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.192594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/fd4e18ef10fc4012975d8501d958168b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.207289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=fd4e18ef10fc4012975d8501d958168b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:31.210003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:31.221865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-adc5d91a-689e-4f2b-909c-e8f6afca2e25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37085f06e4b44197bf1cdb202ecc9ac9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.243565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.245049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.252369 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3701/7439] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:30 2022] DELETE /identity/v3/users/37085f06e4b44197bf1cdb202ecc9ac9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:31.254086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d9d8-e5a4-4bc9-9619-143d77593b46 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.254383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d9d8-e5a4-4bc9-9619-143d77593b46 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.254789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d9d8-e5a4-4bc9-9619-143d77593b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.283698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.284685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.288382 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3739/7440] 10.222.0.16 () {60 vars in 1249 bytes} [Sat Mar 26 21:15:31 2022] PATCH /identity/v3/domains/fd4e18ef10fc4012975d8501d958168b => generated 276 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:31.297336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5295d9d8-e5a4-4bc9-9619-143d77593b46 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:31.297738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:31.299634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5295d9d8-e5a4-4bc9-9619-143d77593b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:31.303091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:31.398251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf51e4f-2432-48de-b347-1f7f7609d4e8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:31.434078 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3702/7441] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:31.444960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295d9d8-e5a4-4bc9-9619-143d77593b46 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:31.446390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5295d9d8-e5a4-4bc9-9619-143d77593b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:31.478851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807b300-4ff9-49e0-bdf5-e4bcc5c5488c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:31.479730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807b300-4ff9-49e0-bdf5-e4bcc5c5488c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.480057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807b300-4ff9-49e0-bdf5-e4bcc5c5488c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.480394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807b300-4ff9-49e0-bdf5-e4bcc5c5488c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/fd4e18ef10fc4012975d8501d958168b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.509247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807b300-4ff9-49e0-bdf5-e4bcc5c5488c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=fd4e18ef10fc4012975d8501d958168b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:31.512188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807b300-4ff9-49e0-bdf5-e4bcc5c5488c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:31.520357 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3740/7442] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:15:31 2022] GET /identity/v3/domains/fd4e18ef10fc4012975d8501d958168b => generated 276 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:15:31.524894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807b300-4ff9-49e0-bdf5-e4bcc5c5488c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:31.547215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807b300-4ff9-49e0-bdf5-e4bcc5c5488c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:31.555640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:31.556859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.557419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.557763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/fd4e18ef10fc4012975d8501d958168b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.559956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=fd4e18ef10fc4012975d8501d958168b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:31.561640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:31.578492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295d9d8-e5a4-4bc9-9619-143d77593b46 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:31.586066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88ce8d-232f-4efc-ad19-dd9c5c5f5b5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:31.586736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88ce8d-232f-4efc-ad19-dd9c5c5f5b5a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.587020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88ce8d-232f-4efc-ad19-dd9c5c5f5b5a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.587307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a88ce8d-232f-4efc-ad19-dd9c5c5f5b5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.598161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.603479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.633438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88ce8d-232f-4efc-ad19-dd9c5c5f5b5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:31.634962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a88ce8d-232f-4efc-ad19-dd9c5c5f5b5a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:31.670968 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3703/7443] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:31.684409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b', 'request_id': 'req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.696807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b', 'request_id': 'req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.705719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b', 'request_id': 'req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.729703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] The token cache is being invalidate because project fd4e18ef10fc4012975d8501d958168b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:31.729703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.730046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.741025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b', 'request_id': 'req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.742000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b', 'request_id': 'req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.748001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'fd4e18ef10fc4012975d8501d958168b', 'request_id': 'req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:31.758961 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3741/7444] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:31 2022] DELETE /identity/v3/domains/fd4e18ef10fc4012975d8501d958168b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:31.763360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88ce8d-232f-4efc-ad19-dd9c5c5f5b5a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:31.786730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a88ce8d-232f-4efc-ad19-dd9c5c5f5b5a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:31.862847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6019d70-b072-45e1-a1c4-cdeb45c66f13 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:31.863723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6019d70-b072-45e1-a1c4-cdeb45c66f13 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.864028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6019d70-b072-45e1-a1c4-cdeb45c66f13 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.864316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6019d70-b072-45e1-a1c4-cdeb45c66f13 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.865241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6019d70-b072-45e1-a1c4-cdeb45c66f13 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:31.866893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6019d70-b072-45e1-a1c4-cdeb45c66f13 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:31.890995 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3704/7445] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 21:15:31 2022] GET /identity/v3/domains => generated 1345 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:31.895785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:31.901873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:31.919587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c0917-f7f2-4c98-86cf-dc555f2ba1ae tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:31.921449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6019d70-b072-45e1-a1c4-cdeb45c66f13 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:31.924530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e6019d70-b072-45e1-a1c4-cdeb45c66f13 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:31.925367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b078fa-7970-409b-aeb9-dc89fc0c8dfa tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:31.926532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b078fa-7970-409b-aeb9-dc89fc0c8dfa tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.927062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b078fa-7970-409b-aeb9-dc89fc0c8dfa tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.927585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b078fa-7970-409b-aeb9-dc89fc0c8dfa tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/fd4e18ef10fc4012975d8501d958168b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.936700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b078fa-7970-409b-aeb9-dc89fc0c8dfa tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:15:31.950717 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-b9b078fa-7970-409b-aeb9-dc89fc0c8dfa tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Could not find domain: fd4e18ef10fc4012975d8501d958168b.: keystone.exception.DomainNotFound: Could not find domain: fd4e18ef10fc4012975d8501d958168b. Mar 26 21:15:31.960812 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3742/7446] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:15:31 2022] PATCH /identity/v3/domains/fd4e18ef10fc4012975d8501d958168b => generated 112 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Mar 26 21:15:31.962103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b078fa-7970-409b-aeb9-dc89fc0c8dfa tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:31.977967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b078fa-7970-409b-aeb9-dc89fc0c8dfa tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:31.983861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0be98-4246-43f3-8280-08e719c2e1d3 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:31.985024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0be98-4246-43f3-8280-08e719c2e1d3 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:31.985441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0be98-4246-43f3-8280-08e719c2e1d3 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:31.985926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0be98-4246-43f3-8280-08e719c2e1d3 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:31.987200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0be98-4246-43f3-8280-08e719c2e1d3 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:31.988830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0be98-4246-43f3-8280-08e719c2e1d3 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:32.018569 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3743/7447] 10.222.0.16 () {60 vars in 1148 bytes} [Sat Mar 26 21:15:31 2022] POST /identity/v3/domains => generated 277 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:32.023179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0be98-4246-43f3-8280-08e719c2e1d3 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:32.072747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6019d70-b072-45e1-a1c4-cdeb45c66f13 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:32.141151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0be98-4246-43f3-8280-08e719c2e1d3 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:32.151812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72048658-48c3-4d3b-beb0-98525f0a9e90 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:32.152539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72048658-48c3-4d3b-beb0-98525f0a9e90 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.154403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72048658-48c3-4d3b-beb0-98525f0a9e90 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.154706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72048658-48c3-4d3b-beb0-98525f0a9e90 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.156997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72048658-48c3-4d3b-beb0-98525f0a9e90 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:32.161634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72048658-48c3-4d3b-beb0-98525f0a9e90 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:32.168211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:32.170405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.170405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.170405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] PATH_INFO: `/v3/projects/bacc31d0868946c1acfdaf5a60ddd258` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.171478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bacc31d0868946c1acfdaf5a60ddd258)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:32.173540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:32.221182 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3744/7448] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:32 2022] POST /identity/v3/users => generated 348 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:32.223064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72048658-48c3-4d3b-beb0-98525f0a9e90 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:32.236830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72048658-48c3-4d3b-beb0-98525f0a9e90 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:32.245992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bacc31d0868946c1acfdaf5a60ddd258', 'request_id': 'req-002e9123-af34-4c8c-8027-5fef9c193627'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.260972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bacc31d0868946c1acfdaf5a60ddd258', 'request_id': 'req-002e9123-af34-4c8c-8027-5fef9c193627'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.271461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bacc31d0868946c1acfdaf5a60ddd258', 'request_id': 'req-002e9123-af34-4c8c-8027-5fef9c193627'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.286678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] The token cache is being invalidate because project bacc31d0868946c1acfdaf5a60ddd258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:32.288218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.289267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-002e9123-af34-4c8c-8027-5fef9c193627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.294642 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3705/7449] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:31 2022] DELETE /identity/v3/projects/bacc31d0868946c1acfdaf5a60ddd258 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:32.296376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0809a9-3b8e-49de-be8d-273ec490db2d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.296827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0809a9-3b8e-49de-be8d-273ec490db2d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.297029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0809a9-3b8e-49de-be8d-273ec490db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.313244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa3747-b4b2-42c5-a7d7-29735ea64d53 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:32.315241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa3747-b4b2-42c5-a7d7-29735ea64d53 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.316365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa3747-b4b2-42c5-a7d7-29735ea64d53 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.316906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa3747-b4b2-42c5-a7d7-29735ea64d53 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.318107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa3747-b4b2-42c5-a7d7-29735ea64d53 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:32.320610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa3747-b4b2-42c5-a7d7-29735ea64d53 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:32.327169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cd0809a9-3b8e-49de-be8d-273ec490db2d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:32.329778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cd0809a9-3b8e-49de-be8d-273ec490db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:32.340792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3745/7450] 10.222.0.16 () {60 vars in 1146 bytes} [Sat Mar 26 21:15:32 2022] POST /identity/v3/groups => generated 325 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:32.342088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa3747-b4b2-42c5-a7d7-29735ea64d53 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:32.344399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e5fa3747-b4b2-42c5-a7d7-29735ea64d53 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:32.363649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa3747-b4b2-42c5-a7d7-29735ea64d53 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:32.370326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:32.371221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.371510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.371786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/ca456c94a16c4082be8583b73723157e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.373317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ca456c94a16c4082be8583b73723157e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:32.374946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:32.398279 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3706/7451] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:32.404657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ca456c94a16c4082be8583b73723157e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.404657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ca456c94a16c4082be8583b73723157e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.406426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92c608-c809-4013-8df7-9a0220959b10 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.406725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92c608-c809-4013-8df7-9a0220959b10 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.407009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92c608-c809-4013-8df7-9a0220959b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.431694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0a92c608-c809-4013-8df7-9a0220959b10 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:32.433714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0a92c608-c809-4013-8df7-9a0220959b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:32.457101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ca456c94a16c4082be8583b73723157e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.458748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ca456c94a16c4082be8583b73723157e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.463987 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3746/7452] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:15:32 2022] PATCH /identity/v3/domains/ca456c94a16c4082be8583b73723157e => generated 278 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:32.467458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:32.471402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:32.517900 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3707/7453] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:32.521499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92c608-c809-4013-8df7-9a0220959b10 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:32.537303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92c608-c809-4013-8df7-9a0220959b10 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:32.544409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00b05c-5b90-4baa-914f-1150914a6434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:32.545451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b05c-5b90-4baa-914f-1150914a6434 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.545594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b05c-5b90-4baa-914f-1150914a6434 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.545851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00b05c-5b90-4baa-914f-1150914a6434 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.546591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00b05c-5b90-4baa-914f-1150914a6434 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:32.546900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00b05c-5b90-4baa-914f-1150914a6434 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:32.558848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00b05c-5b90-4baa-914f-1150914a6434 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:32.582535 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3708/7454] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:32.594903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00b05c-5b90-4baa-914f-1150914a6434 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:32.597547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556605ef-32a6-448d-9641-643d6c9f0b0c tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:32.603732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:32.604891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.605389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.606014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/ca456c94a16c4082be8583b73723157e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.625237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ca456c94a16c4082be8583b73723157e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:32.627500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:32.628422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00b05c-5b90-4baa-914f-1150914a6434 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:32.638238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f011812-ec88-40e5-95c1-c38effea9a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:32.639177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f011812-ec88-40e5-95c1-c38effea9a30 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.639488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f011812-ec88-40e5-95c1-c38effea9a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.639781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f011812-ec88-40e5-95c1-c38effea9a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.640567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f011812-ec88-40e5-95c1-c38effea9a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:32.642816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f011812-ec88-40e5-95c1-c38effea9a30 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:32.658912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ca456c94a16c4082be8583b73723157e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.663108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ca456c94a16c4082be8583b73723157e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.678310 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3709/7455] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:32 2022] POST /identity/v3/projects => generated 393 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:32.679495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f011812-ec88-40e5-95c1-c38effea9a30 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:32.682272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3f011812-ec88-40e5-95c1-c38effea9a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:32.781267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f011812-ec88-40e5-95c1-c38effea9a30 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:32.835605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83cebd9f1d28460bb817dc7205db3154'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.843244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83cebd9f1d28460bb817dc7205db3154'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.845107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83cebd9f1d28460bb817dc7205db3154'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.846006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83cebd9f1d28460bb817dc7205db3154'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.851995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:32.852733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:32.853014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:32.853343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:32.855230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83cebd9f1d28460bb817dc7205db3154'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.855438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:32.868149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:32.869629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:32.880650 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3710/7456] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:32.881470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:32.882768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:32.938733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca456c94a16c4082be8583b73723157e', 'request_id': 'req-df94771c-d635-4642-8ee7-2987c07fe261'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.962482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca456c94a16c4082be8583b73723157e', 'request_id': 'req-df94771c-d635-4642-8ee7-2987c07fe261'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.973224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c361bab7-1e39-499e-a90a-99bdf88ebb10 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:32.975114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca456c94a16c4082be8583b73723157e', 'request_id': 'req-df94771c-d635-4642-8ee7-2987c07fe261'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.994669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] The token cache is being invalidate because project ca456c94a16c4082be8583b73723157e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:32.994895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:32.995734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:33.008804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ca456c94a16c4082be8583b73723157e', 'request_id': 'req-df94771c-d635-4642-8ee7-2987c07fe261'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:33.009665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ca456c94a16c4082be8583b73723157e', 'request_id': 'req-df94771c-d635-4642-8ee7-2987c07fe261'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:33.010339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ca456c94a16c4082be8583b73723157e', 'request_id': 'req-df94771c-d635-4642-8ee7-2987c07fe261'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:33.029770 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3747/7457] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:32 2022] DELETE /identity/v3/domains/ca456c94a16c4082be8583b73723157e => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:33.034150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.035577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:33.117999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae0b07-6519-488e-804d-4f1c3fb2e426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.118694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae0b07-6519-488e-804d-4f1c3fb2e426 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.118981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae0b07-6519-488e-804d-4f1c3fb2e426 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.119277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ae0b07-6519-488e-804d-4f1c3fb2e426 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.120702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae0b07-6519-488e-804d-4f1c3fb2e426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.122839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ae0b07-6519-488e-804d-4f1c3fb2e426 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.138521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94771c-d635-4642-8ee7-2987c07fe261 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.146415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd9fda-dfc1-464f-94c7-c8d4392db7dc tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.147298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd9fda-dfc1-464f-94c7-c8d4392db7dc tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.147579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd9fda-dfc1-464f-94c7-c8d4392db7dc tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.147951 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3711/7458] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:32 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:33.149191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd9fda-dfc1-464f-94c7-c8d4392db7dc tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/ca456c94a16c4082be8583b73723157e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.151876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae0b07-6519-488e-804d-4f1c3fb2e426 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.154025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-10ae0b07-6519-488e-804d-4f1c3fb2e426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:33.157783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd9fda-dfc1-464f-94c7-c8d4392db7dc tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=ca456c94a16c4082be8583b73723157e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.159712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd9fda-dfc1-464f-94c7-c8d4392db7dc tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.169595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ae0b07-6519-488e-804d-4f1c3fb2e426 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.174854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec90bb-c4e7-469e-8472-6fbc2573cc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.176590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec90bb-c4e7-469e-8472-6fbc2573cc85 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.176590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec90bb-c4e7-469e-8472-6fbc2573cc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.176590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec90bb-c4e7-469e-8472-6fbc2573cc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.177475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec90bb-c4e7-469e-8472-6fbc2573cc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.179881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec90bb-c4e7-469e-8472-6fbc2573cc85 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.180120 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-f2cd9fda-dfc1-464f-94c7-c8d4392db7dc tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Could not find domain: ca456c94a16c4082be8583b73723157e.: keystone.exception.DomainNotFound: Could not find domain: ca456c94a16c4082be8583b73723157e. Mar 26 21:15:33.182298 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3748/7459] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:15:33 2022] GET /identity/v3/domains/ca456c94a16c4082be8583b73723157e => generated 112 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:15:33.186336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd9fda-dfc1-464f-94c7-c8d4392db7dc tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.193703 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3712/7460] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:33.197437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec90bb-c4e7-469e-8472-6fbc2573cc85 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.205495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd9fda-dfc1-464f-94c7-c8d4392db7dc tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.210538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9d24c-612d-44ae-b96f-3cbe45d4d569 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.210906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec90bb-c4e7-469e-8472-6fbc2573cc85 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.211694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9d24c-612d-44ae-b96f-3cbe45d4d569 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.212074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9d24c-612d-44ae-b96f-3cbe45d4d569 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.212361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9d24c-612d-44ae-b96f-3cbe45d4d569 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/users/83cebd9f1d28460bb817dc7205db3154` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.217171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93ac0-431f-464f-8758-d5dccdb157d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.218473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93ac0-431f-464f-8758-d5dccdb157d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.218764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93ac0-431f-464f-8758-d5dccdb157d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.219646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93ac0-431f-464f-8758-d5dccdb157d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.221322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd93ac0-431f-464f-8758-d5dccdb157d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.221767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9d24c-612d-44ae-b96f-3cbe45d4d569 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:get_user(user_id=83cebd9f1d28460bb817dc7205db3154)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.222656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd93ac0-431f-464f-8758-d5dccdb157d4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.224331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9d24c-612d-44ae-b96f-3cbe45d4d569 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.238171 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3713/7461] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:33.239336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93ac0-431f-464f-8758-d5dccdb157d4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.244387 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-77a9d24c-612d-44ae-b96f-3cbe45d4d569 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Could not find user: 83cebd9f1d28460bb817dc7205db3154.: keystone.exception.UserNotFound: Could not find user: 83cebd9f1d28460bb817dc7205db3154. Mar 26 21:15:33.245760 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3749/7462] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:15:33 2022] GET /identity/v3/users/83cebd9f1d28460bb817dc7205db3154 => generated 110 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:15:33.252395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9d24c-612d-44ae-b96f-3cbe45d4d569 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.253346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93ac0-431f-464f-8758-d5dccdb157d4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.258058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafb9e5-8e0b-41aa-a45b-971179ba53df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.259066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafb9e5-8e0b-41aa-a45b-971179ba53df admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.259360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafb9e5-8e0b-41aa-a45b-971179ba53df admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.259641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafb9e5-8e0b-41aa-a45b-971179ba53df admin admin] PATH_INFO: `/v3/projects/e7442ba4684047629c0de92ac34b7e42/users/a04f7dd42a6f4ebfb53d97768049c2ff/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.263548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9d24c-612d-44ae-b96f-3cbe45d4d569 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.269035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.269910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.270198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.270866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/groups/52f3e1efde0845058631beb4e08b6915` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.275378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:get_group(group_id=52f3e1efde0845058631beb4e08b6915)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.276463 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:15:33.276463 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:15:33.276463 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:15:33.277615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.277851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafb9e5-8e0b-41aa-a45b-971179ba53df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7442ba4684047629c0de92ac34b7e42, user_id=a04f7dd42a6f4ebfb53d97768049c2ff, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.280567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafb9e5-8e0b-41aa-a45b-971179ba53df admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.291473 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Could not find group: 52f3e1efde0845058631beb4e08b6915.: keystone.exception.GroupNotFound: Could not find group: 52f3e1efde0845058631beb4e08b6915. Mar 26 21:15:33.295908 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3750/7463] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:33 2022] GET /identity/v3/groups/52f3e1efde0845058631beb4e08b6915 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:15:33.297185 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3714/7464] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:33 2022] PUT /identity/v3/projects/e7442ba4684047629c0de92ac34b7e42/users/a04f7dd42a6f4ebfb53d97768049c2ff/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:33.297360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.307716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e15a0-4bf0-42fe-a708-cc36b65271c6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.308126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e15a0-4bf0-42fe-a708-cc36b65271c6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.308330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e15a0-4bf0-42fe-a708-cc36b65271c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.308942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36827f63-379b-4923-a7e3-3912a07b1bd1 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.337245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e92e15a0-4bf0-42fe-a708-cc36b65271c6 None None] MFA Rules not processed for user `a04f7dd42a6f4ebfb53d97768049c2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:33.338468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e92e15a0-4bf0-42fe-a708-cc36b65271c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:33.369940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731a82-8201-4a2f-a047-31558312f17f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.371089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731a82-8201-4a2f-a047-31558312f17f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.371391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731a82-8201-4a2f-a047-31558312f17f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.371832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31731a82-8201-4a2f-a047-31558312f17f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/groups/52f3e1efde0845058631beb4e08b6915` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.377588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31731a82-8201-4a2f-a047-31558312f17f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:15:33.387138 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-31731a82-8201-4a2f-a047-31558312f17f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Could not find group: 52f3e1efde0845058631beb4e08b6915.: keystone.exception.GroupNotFound: Could not find group: 52f3e1efde0845058631beb4e08b6915. Mar 26 21:15:33.388720 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3751/7465] 10.222.0.16 () {58 vars in 1226 bytes} [Sat Mar 26 21:15:33 2022] DELETE /identity/v3/groups/52f3e1efde0845058631beb4e08b6915 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Mar 26 21:15:33.393398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731a82-8201-4a2f-a047-31558312f17f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.403686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31731a82-8201-4a2f-a047-31558312f17f tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.408701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888973-8a52-4d25-a820-da1c8fe771d0 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.409562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888973-8a52-4d25-a820-da1c8fe771d0 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.409852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888973-8a52-4d25-a820-da1c8fe771d0 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.410266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55888973-8a52-4d25-a820-da1c8fe771d0 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/users/83cebd9f1d28460bb817dc7205db3154` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.415036 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3715/7466] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:33.421080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888973-8a52-4d25-a820-da1c8fe771d0 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:delete_user(user_id=83cebd9f1d28460bb817dc7205db3154)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.423234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55888973-8a52-4d25-a820-da1c8fe771d0 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.424757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e15a0-4bf0-42fe-a708-cc36b65271c6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.426164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e92e15a0-4bf0-42fe-a708-cc36b65271c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:33.444034 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-55888973-8a52-4d25-a820-da1c8fe771d0 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Could not find user: 83cebd9f1d28460bb817dc7205db3154.: keystone.exception.UserNotFound: Could not find user: 83cebd9f1d28460bb817dc7205db3154. Mar 26 21:15:33.448561 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3752/7467] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:33 2022] DELETE /identity/v3/users/83cebd9f1d28460bb817dc7205db3154 => generated 110 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:15:33.450924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888973-8a52-4d25-a820-da1c8fe771d0 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.463485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55888973-8a52-4d25-a820-da1c8fe771d0 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.469041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cff50-46c5-40fc-a1b2-8427648e03a4 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.470695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cff50-46c5-40fc-a1b2-8427648e03a4 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.471058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cff50-46c5-40fc-a1b2-8427648e03a4 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.471414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cff50-46c5-40fc-a1b2-8427648e03a4 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/ca456c94a16c4082be8583b73723157e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.481054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cff50-46c5-40fc-a1b2-8427648e03a4 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:15:33.493469 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-058cff50-46c5-40fc-a1b2-8427648e03a4 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Could not find domain: ca456c94a16c4082be8583b73723157e.: keystone.exception.DomainNotFound: Could not find domain: ca456c94a16c4082be8583b73723157e. Mar 26 21:15:33.495716 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3753/7468] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:15:33 2022] PATCH /identity/v3/domains/ca456c94a16c4082be8583b73723157e => generated 112 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:15:33.502388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cff50-46c5-40fc-a1b2-8427648e03a4 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.505109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92e15a0-4bf0-42fe-a708-cc36b65271c6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.510920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80748e9a-f169-4905-b211-91b338931c4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.512557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80748e9a-f169-4905-b211-91b338931c4c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.513665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80748e9a-f169-4905-b211-91b338931c4c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.514224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80748e9a-f169-4905-b211-91b338931c4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.517859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cff50-46c5-40fc-a1b2-8427648e03a4 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.525218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efee7c-52bd-42b7-9756-9c96b3074241 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.526240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efee7c-52bd-42b7-9756-9c96b3074241 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.526539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efee7c-52bd-42b7-9756-9c96b3074241 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.526825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8efee7c-52bd-42b7-9756-9c96b3074241 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.526954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80748e9a-f169-4905-b211-91b338931c4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.527816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efee7c-52bd-42b7-9756-9c96b3074241 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.528488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80748e9a-f169-4905-b211-91b338931c4c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.530147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8efee7c-52bd-42b7-9756-9c96b3074241 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.539254 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3716/7469] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:33.549562 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3754/7470] 10.222.0.16 () {58 vars in 1127 bytes} [Sat Mar 26 21:15:33 2022] GET /identity/v3/domains => generated 1345 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:33.554709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80748e9a-f169-4905-b211-91b338931c4c service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.568178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80748e9a-f169-4905-b211-91b338931c4c service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.573706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa056dc-3006-420a-8ff7-2e3c12a71a65 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.574434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa056dc-3006-420a-8ff7-2e3c12a71a65 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.574723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa056dc-3006-420a-8ff7-2e3c12a71a65 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.575005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa056dc-3006-420a-8ff7-2e3c12a71a65 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.575789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa056dc-3006-420a-8ff7-2e3c12a71a65 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:33.576139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa056dc-3006-420a-8ff7-2e3c12a71a65 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.577878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa056dc-3006-420a-8ff7-2e3c12a71a65 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.601622 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3717/7471] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:33 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:33.605853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efee7c-52bd-42b7-9756-9c96b3074241 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.621170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8efee7c-52bd-42b7-9756-9c96b3074241 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.640966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5357e-37db-49d4-9460-14bf95e8ece9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.642571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5357e-37db-49d4-9460-14bf95e8ece9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.647156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5357e-37db-49d4-9460-14bf95e8ece9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.648038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5357e-37db-49d4-9460-14bf95e8ece9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.649306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5357e-37db-49d4-9460-14bf95e8ece9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-30326356) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:33.650489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5357e-37db-49d4-9460-14bf95e8ece9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.655372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5357e-37db-49d4-9460-14bf95e8ece9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.683649 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3755/7472] 10.222.0.16 () {58 vars in 1194 bytes} [Sat Mar 26 21:15:33 2022] GET /identity/v3/domains?name=tempest-test_domain-30326356 => generated 404 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:33.689029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa056dc-3006-420a-8ff7-2e3c12a71a65 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.708554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa056dc-3006-420a-8ff7-2e3c12a71a65 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.713965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251e69d-8c7d-43a3-825c-0fc867119b7d tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.714892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251e69d-8c7d-43a3-825c-0fc867119b7d tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.715258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251e69d-8c7d-43a3-825c-0fc867119b7d tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.715540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251e69d-8c7d-43a3-825c-0fc867119b7d tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/ca456c94a16c4082be8583b73723157e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.756395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251e69d-8c7d-43a3-825c-0fc867119b7d tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:15:33.778264 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-5251e69d-8c7d-43a3-825c-0fc867119b7d tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Could not find domain: ca456c94a16c4082be8583b73723157e.: keystone.exception.DomainNotFound: Could not find domain: ca456c94a16c4082be8583b73723157e. Mar 26 21:15:33.780737 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3718/7473] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:15:33 2022] PATCH /identity/v3/domains/ca456c94a16c4082be8583b73723157e => generated 112 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:15:33.784250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5357e-37db-49d4-9460-14bf95e8ece9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.816957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5357e-37db-49d4-9460-14bf95e8ece9 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:33.830724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19caf1-0ac8-4dfd-a0ea-c0df89f5c9d7 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:33.832858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19caf1-0ac8-4dfd-a0ea-c0df89f5c9d7 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:33.835401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19caf1-0ac8-4dfd-a0ea-c0df89f5c9d7 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:33.835401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19caf1-0ac8-4dfd-a0ea-c0df89f5c9d7 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/77767337bea4492b849d70eeb8539c28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:33.864014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19caf1-0ac8-4dfd-a0ea-c0df89f5c9d7 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=77767337bea4492b849d70eeb8539c28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:33.866023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19caf1-0ac8-4dfd-a0ea-c0df89f5c9d7 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:33.971077 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3756/7474] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:15:33 2022] PATCH /identity/v3/domains/77767337bea4492b849d70eeb8539c28 => generated 276 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:33.972533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251e69d-8c7d-43a3-825c-0fc867119b7d tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:33.989182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251e69d-8c7d-43a3-825c-0fc867119b7d tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:34.007325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:34.007325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:34.007325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:34.007652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/77767337bea4492b849d70eeb8539c28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:34.030374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=77767337bea4492b849d70eeb8539c28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:34.032121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:34.072896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '77767337bea4492b849d70eeb8539c28'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.082879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '77767337bea4492b849d70eeb8539c28'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.169560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77767337bea4492b849d70eeb8539c28', 'request_id': 'req-0bb59f36-2daa-4f90-8fba-067f9283c450'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.184539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77767337bea4492b849d70eeb8539c28', 'request_id': 'req-0bb59f36-2daa-4f90-8fba-067f9283c450'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.191697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77767337bea4492b849d70eeb8539c28', 'request_id': 'req-0bb59f36-2daa-4f90-8fba-067f9283c450'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.216735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] The token cache is being invalidate because project 77767337bea4492b849d70eeb8539c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:34.216992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.217653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.229218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '77767337bea4492b849d70eeb8539c28', 'request_id': 'req-0bb59f36-2daa-4f90-8fba-067f9283c450'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.230107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '77767337bea4492b849d70eeb8539c28', 'request_id': 'req-0bb59f36-2daa-4f90-8fba-067f9283c450'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.232320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '77767337bea4492b849d70eeb8539c28', 'request_id': 'req-0bb59f36-2daa-4f90-8fba-067f9283c450'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.246913 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3719/7475] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:33 2022] DELETE /identity/v3/domains/77767337bea4492b849d70eeb8539c28 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:34.248199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19caf1-0ac8-4dfd-a0ea-c0df89f5c9d7 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:34.250190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7a19caf1-0ac8-4dfd-a0ea-c0df89f5c9d7 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:34.266857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19caf1-0ac8-4dfd-a0ea-c0df89f5c9d7 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:34.348197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:34.349105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:34.349397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:34.349848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/8a6dbeed5adb40b7ab45c3928c42f666` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:34.368650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=8a6dbeed5adb40b7ab45c3928c42f666)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:34.370346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:34.394441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.395314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.426491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.427250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.432462 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3757/7476] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:15:34 2022] PATCH /identity/v3/domains/8a6dbeed5adb40b7ab45c3928c42f666 => generated 278 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:15:34.438784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:34.446158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb59f36-2daa-4f90-8fba-067f9283c450 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:34.526263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:34.527141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:34.527667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:34.527984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/8a6dbeed5adb40b7ab45c3928c42f666` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:34.543073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=8a6dbeed5adb40b7ab45c3928c42f666)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:34.544877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:34.574570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.579412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.664313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666', 'request_id': 'req-34c3cf4a-6794-4d1c-8940-3e5918ada162'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.674035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666', 'request_id': 'req-34c3cf4a-6794-4d1c-8940-3e5918ada162'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.679872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666', 'request_id': 'req-34c3cf4a-6794-4d1c-8940-3e5918ada162'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.694384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] The token cache is being invalidate because project 8a6dbeed5adb40b7ab45c3928c42f666 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:34.694690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.695515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.704631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666', 'request_id': 'req-34c3cf4a-6794-4d1c-8940-3e5918ada162'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.705326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666', 'request_id': 'req-34c3cf4a-6794-4d1c-8940-3e5918ada162'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.706010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '8a6dbeed5adb40b7ab45c3928c42f666', 'request_id': 'req-34c3cf4a-6794-4d1c-8940-3e5918ada162'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.714740 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3720/7477] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:34 2022] DELETE /identity/v3/domains/8a6dbeed5adb40b7ab45c3928c42f666 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:34.718737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:34.721416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:34.733591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740eafc1-375b-42e2-89bd-86babb017aef tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:34.790946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:34.792356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:34.792356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:34.792610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/aca3d1790ee644dab75d3cbdcdb19616` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:34.805591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=aca3d1790ee644dab75d3cbdcdb19616)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:34.807526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:34.837553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.838192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.863899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.864605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:34.869963 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3758/7478] 10.222.0.16 () {60 vars in 1248 bytes} [Sat Mar 26 21:15:34 2022] PATCH /identity/v3/domains/aca3d1790ee644dab75d3cbdcdb19616 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:15:34.871372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:34.873319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:34.888178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3cf4a-6794-4d1c-8940-3e5918ada162 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:34.961042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dec6a673315a479cb33975e61c8c1a4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:34.962000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:34.962392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:34.962796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] PATH_INFO: `/v3/domains/aca3d1790ee644dab75d3cbdcdb19616` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:34.976357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=aca3d1790ee644dab75d3cbdcdb19616)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:34.978106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:35.005771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.018582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.096516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616', 'request_id': 'req-f0626665-2258-478e-9a26-afcd7b3bb0f8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.106630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616', 'request_id': 'req-f0626665-2258-478e-9a26-afcd7b3bb0f8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.113027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616', 'request_id': 'req-f0626665-2258-478e-9a26-afcd7b3bb0f8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.125677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] The token cache is being invalidate because project aca3d1790ee644dab75d3cbdcdb19616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:35.126541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.127237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.135244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616', 'request_id': 'req-f0626665-2258-478e-9a26-afcd7b3bb0f8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.136168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616', 'request_id': 'req-f0626665-2258-478e-9a26-afcd7b3bb0f8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.136943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f0626665-2258-478e-9a26-afcd7b3bb0f8 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'aca3d1790ee644dab75d3cbdcdb19616', 'request_id': 'req-f0626665-2258-478e-9a26-afcd7b3bb0f8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.147256 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3721/7479] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:34 2022] DELETE /identity/v3/domains/aca3d1790ee644dab75d3cbdcdb19616 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:35.151078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:35.152610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:35.247490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81c66e5-5f2f-4070-b396-7737cba05314 tempest-DomainsTestJSON-1255891258 tempest-DomainsTestJSON-1255891258-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:35.312498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:35.313972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:35.314355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:35.314701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] PATH_INFO: `/v3/users/ff45322546f549c795fe43acb3148108` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:35.316304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff45322546f549c795fe43acb3148108)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:35.318469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:35.381782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff45322546f549c795fe43acb3148108'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.389341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff45322546f549c795fe43acb3148108'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.390122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff45322546f549c795fe43acb3148108'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.391158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff45322546f549c795fe43acb3148108'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.403125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff45322546f549c795fe43acb3148108'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:35.427300 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3759/7480] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:35 2022] DELETE /identity/v3/users/ff45322546f549c795fe43acb3148108 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:35.430141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d299b4-ec76-41ca-8d85-9a99d9ff8525 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:35.430438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d299b4-ec76-41ca-8d85-9a99d9ff8525 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:35.430731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d299b4-ec76-41ca-8d85-9a99d9ff8525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:35.450430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a0d299b4-ec76-41ca-8d85-9a99d9ff8525 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:35.452199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a0d299b4-ec76-41ca-8d85-9a99d9ff8525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:35.531410 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3722/7481] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:35.541263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:35.542948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:35.652193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76216b-669a-459c-965e-dbbcaf97672a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:35.657991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dda4c-ab5e-450f-9564-6203ce66c5f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:35.658979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dda4c-ab5e-450f-9564-6203ce66c5f7 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:35.658979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dda4c-ab5e-450f-9564-6203ce66c5f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:35.659311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dda4c-ab5e-450f-9564-6203ce66c5f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:35.675066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dda4c-ab5e-450f-9564-6203ce66c5f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:35.677370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dda4c-ab5e-450f-9564-6203ce66c5f7 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:35.705789 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3760/7482] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:36.143671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d299b4-ec76-41ca-8d85-9a99d9ff8525 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:36.145551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a0d299b4-ec76-41ca-8d85-9a99d9ff8525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:36.160179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d299b4-ec76-41ca-8d85-9a99d9ff8525 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:36.167004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:36.167877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:36.168196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:36.168474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] PATH_INFO: `/v3/projects/6662102b722b44f78c64a13a809ca434` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:36.169704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6662102b722b44f78c64a13a809ca434)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:36.171635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:36.225066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6662102b722b44f78c64a13a809ca434', 'request_id': 'req-27231782-622a-4214-9815-e477b034ef7b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.232670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6662102b722b44f78c64a13a809ca434', 'request_id': 'req-27231782-622a-4214-9815-e477b034ef7b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.238859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6662102b722b44f78c64a13a809ca434', 'request_id': 'req-27231782-622a-4214-9815-e477b034ef7b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.251443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] The token cache is being invalidate because project 6662102b722b44f78c64a13a809ca434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:36.251742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.252580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.254121 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3723/7483] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:36 2022] DELETE /identity/v3/projects/6662102b722b44f78c64a13a809ca434 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:36.258053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dda4c-ab5e-450f-9564-6203ce66c5f7 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:36.267717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dda4c-ab5e-450f-9564-6203ce66c5f7 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:36.323058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:36.323941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:36.324234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:36.324511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] PATH_INFO: `/v3/users/dec6a673315a479cb33975e61c8c1a4c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:36.325698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec6a673315a479cb33975e61c8c1a4c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:36.327636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:36.381151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec6a673315a479cb33975e61c8c1a4c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.388450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec6a673315a479cb33975e61c8c1a4c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.389910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec6a673315a479cb33975e61c8c1a4c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.390525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec6a673315a479cb33975e61c8c1a4c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.397527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d7661803-e51a-4036-beae-8ecc21efc06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec6a673315a479cb33975e61c8c1a4c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.415086 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3761/7484] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:36 2022] DELETE /identity/v3/users/dec6a673315a479cb33975e61c8c1a4c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:36.714579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:36.716192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:36.731474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27231782-622a-4214-9815-e477b034ef7b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:36.802040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:36.804365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:36.804739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:36.805027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] PATH_INFO: `/v3/projects/68ccc2eff6ed4e1e90e1b2ede2a3f96e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:36.806320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68ccc2eff6ed4e1e90e1b2ede2a3f96e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:36.808369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:36.874315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'request_id': 'req-35b93cee-638c-4d74-be7d-9d02439c8d37'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.890620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'request_id': 'req-35b93cee-638c-4d74-be7d-9d02439c8d37'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.898973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68ccc2eff6ed4e1e90e1b2ede2a3f96e', 'request_id': 'req-35b93cee-638c-4d74-be7d-9d02439c8d37'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.915336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] The token cache is being invalidate because project 68ccc2eff6ed4e1e90e1b2ede2a3f96e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:36.915795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.916805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-35b93cee-638c-4d74-be7d-9d02439c8d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:36.920345 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3724/7485] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:36 2022] DELETE /identity/v3/projects/68ccc2eff6ed4e1e90e1b2ede2a3f96e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:36.925161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577894a-7298-4247-b348-4175d978863d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:36.926484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577894a-7298-4247-b348-4175d978863d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:36.926991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577894a-7298-4247-b348-4175d978863d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:36.991219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2577894a-7298-4247-b348-4175d978863d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:36.992587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2577894a-7298-4247-b348-4175d978863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:37.122161 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3762/7486] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:37.124530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9dc00-0b8c-4d1e-a1e0-906fd753de38 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:37.125032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9dc00-0b8c-4d1e-a1e0-906fd753de38 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:37.125444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9dc00-0b8c-4d1e-a1e0-906fd753de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:37.157119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-56d9dc00-0b8c-4d1e-a1e0-906fd753de38 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:37.158436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-56d9dc00-0b8c-4d1e-a1e0-906fd753de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:37.167823 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3725/7487] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:37.172476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577894a-7298-4247-b348-4175d978863d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:37.183293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577894a-7298-4247-b348-4175d978863d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:37.189063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8885-1bec-4a42-a52c-8228e926fc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:37.189806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8885-1bec-4a42-a52c-8228e926fc64 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:37.190155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8885-1bec-4a42-a52c-8228e926fc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:37.191087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a8885-1bec-4a42-a52c-8228e926fc64 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:37.191295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8885-1bec-4a42-a52c-8228e926fc64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:37.191677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8885-1bec-4a42-a52c-8228e926fc64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:37.193406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a8885-1bec-4a42-a52c-8228e926fc64 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:37.207964 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3763/7488] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:37.212859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9dc00-0b8c-4d1e-a1e0-906fd753de38 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:37.223153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9dc00-0b8c-4d1e-a1e0-906fd753de38 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:37.228998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2827794-4227-401b-90e6-9883a4f48210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:37.229652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2827794-4227-401b-90e6-9883a4f48210 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:37.229949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2827794-4227-401b-90e6-9883a4f48210 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:37.230217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2827794-4227-401b-90e6-9883a4f48210 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:37.230916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2827794-4227-401b-90e6-9883a4f48210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:37.232943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2827794-4227-401b-90e6-9883a4f48210 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:37.267590 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3726/7489] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:37 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:37.269069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8885-1bec-4a42-a52c-8228e926fc64 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:37.280300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a8885-1bec-4a42-a52c-8228e926fc64 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:37.370074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66e55-46da-4ca8-8581-aa9c3eeec81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:37.370759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66e55-46da-4ca8-8581-aa9c3eeec81b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:37.371035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66e55-46da-4ca8-8581-aa9c3eeec81b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:37.371501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d66e55-46da-4ca8-8581-aa9c3eeec81b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:37.373252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d66e55-46da-4ca8-8581-aa9c3eeec81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:37.375223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d66e55-46da-4ca8-8581-aa9c3eeec81b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:37.406114 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3764/7490] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:37 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:37.409491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2827794-4227-401b-90e6-9883a4f48210 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:37.432132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2827794-4227-401b-90e6-9883a4f48210 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:37.444354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fe21d-ea20-4fb1-9e1c-d25746564382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:37.445742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe21d-ea20-4fb1-9e1c-d25746564382 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:37.446392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe21d-ea20-4fb1-9e1c-d25746564382 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:37.446672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fe21d-ea20-4fb1-9e1c-d25746564382 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:37.448662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fe21d-ea20-4fb1-9e1c-d25746564382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:37.451270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83fe21d-ea20-4fb1-9e1c-d25746564382 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:37.470990 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3727/7491] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:37.471789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66e55-46da-4ca8-8581-aa9c3eeec81b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:37.489427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d66e55-46da-4ca8-8581-aa9c3eeec81b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:37.499241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a760e7d-559e-4e43-b81c-f32bf342eb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:37.500157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a760e7d-559e-4e43-b81c-f32bf342eb19 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:37.501260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a760e7d-559e-4e43-b81c-f32bf342eb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:37.501773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a760e7d-559e-4e43-b81c-f32bf342eb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:37.502875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a760e7d-559e-4e43-b81c-f32bf342eb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:37.504975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a760e7d-559e-4e43-b81c-f32bf342eb19 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:37.538148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fe21d-ea20-4fb1-9e1c-d25746564382 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:37.545894 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3765/7492] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:37.552045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fe21d-ea20-4fb1-9e1c-d25746564382 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:37.559837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbd387-1d23-45d6-a21d-c9bc2fd7d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:37.560785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbd387-1d23-45d6-a21d-c9bc2fd7d84c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:37.561065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbd387-1d23-45d6-a21d-c9bc2fd7d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:37.561341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bbd387-1d23-45d6-a21d-c9bc2fd7d84c admin admin] PATH_INFO: `/v3/projects/57bb7fba052c4f5f85e78439076094af/users/325ac4c7eaa24f908e9fa669205057c4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:37.577524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbd387-1d23-45d6-a21d-c9bc2fd7d84c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57bb7fba052c4f5f85e78439076094af, user_id=325ac4c7eaa24f908e9fa669205057c4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:37.580529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bbd387-1d23-45d6-a21d-c9bc2fd7d84c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:37.596726 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3728/7493] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:37 2022] PUT /identity/v3/projects/57bb7fba052c4f5f85e78439076094af/users/325ac4c7eaa24f908e9fa669205057c4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:37.607998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee2e59-52f0-4605-a331-e7f2f152021f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:37.608256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee2e59-52f0-4605-a331-e7f2f152021f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:37.608533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee2e59-52f0-4605-a331-e7f2f152021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:37.642703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-95ee2e59-52f0-4605-a331-e7f2f152021f None None] MFA Rules not processed for user `325ac4c7eaa24f908e9fa669205057c4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:37.644020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-95ee2e59-52f0-4605-a331-e7f2f152021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:37.737109 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3766/7494] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:37.741648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbd387-1d23-45d6-a21d-c9bc2fd7d84c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:37.833584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bbd387-1d23-45d6-a21d-c9bc2fd7d84c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:37.850390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2115392-5f0d-4b55-a180-a5254351fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:37.851263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2115392-5f0d-4b55-a180-a5254351fc50 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:37.851542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2115392-5f0d-4b55-a180-a5254351fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:37.852044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2115392-5f0d-4b55-a180-a5254351fc50 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:37.857241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2115392-5f0d-4b55-a180-a5254351fc50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:37.860882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2115392-5f0d-4b55-a180-a5254351fc50 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:37.903127 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3729/7495] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:37 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:37.904761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee2e59-52f0-4605-a331-e7f2f152021f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:37.935982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee2e59-52f0-4605-a331-e7f2f152021f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.042670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd156fe7-f2b4-4a5a-8fa6-48ba917f742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.043747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd156fe7-f2b4-4a5a-8fa6-48ba917f742c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.044095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd156fe7-f2b4-4a5a-8fa6-48ba917f742c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.044383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd156fe7-f2b4-4a5a-8fa6-48ba917f742c admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.046301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd156fe7-f2b4-4a5a-8fa6-48ba917f742c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.050575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd156fe7-f2b4-4a5a-8fa6-48ba917f742c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.083651 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3767/7496] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:37 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:38.084913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2115392-5f0d-4b55-a180-a5254351fc50 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.100599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2115392-5f0d-4b55-a180-a5254351fc50 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.113749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aca8c-80a2-4277-a949-dc5eda4f6160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.114395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aca8c-80a2-4277-a949-dc5eda4f6160 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.114822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aca8c-80a2-4277-a949-dc5eda4f6160 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.114955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807aca8c-80a2-4277-a949-dc5eda4f6160 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.115692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807aca8c-80a2-4277-a949-dc5eda4f6160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.117524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807aca8c-80a2-4277-a949-dc5eda4f6160 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.144717 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3730/7497] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:38.149003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd156fe7-f2b4-4a5a-8fa6-48ba917f742c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.160039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd156fe7-f2b4-4a5a-8fa6-48ba917f742c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.165056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d0c12-b391-499b-9e43-4ecaf2fa309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.165883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d0c12-b391-499b-9e43-4ecaf2fa309d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.166167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d0c12-b391-499b-9e43-4ecaf2fa309d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.166435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d0c12-b391-499b-9e43-4ecaf2fa309d admin admin] PATH_INFO: `/v3/projects/83c37d42cf154ffda6b7f0fb36b18be6/users/3a80780b72d84af58a61add284f4c883/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.187141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d0c12-b391-499b-9e43-4ecaf2fa309d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c37d42cf154ffda6b7f0fb36b18be6, user_id=3a80780b72d84af58a61add284f4c883, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.190401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d0c12-b391-499b-9e43-4ecaf2fa309d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.204949 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3768/7498] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:38 2022] PUT /identity/v3/projects/83c37d42cf154ffda6b7f0fb36b18be6/users/3a80780b72d84af58a61add284f4c883/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:38.209348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aca8c-80a2-4277-a949-dc5eda4f6160 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.222901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807aca8c-80a2-4277-a949-dc5eda4f6160 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.294680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac65c8-4691-4b50-94fb-6fef9feef400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.295638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac65c8-4691-4b50-94fb-6fef9feef400 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.295638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac65c8-4691-4b50-94fb-6fef9feef400 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.295973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac65c8-4691-4b50-94fb-6fef9feef400 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.298604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac65c8-4691-4b50-94fb-6fef9feef400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.298604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac65c8-4691-4b50-94fb-6fef9feef400 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.309957 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3731/7499] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:38.314202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d0c12-b391-499b-9e43-4ecaf2fa309d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.325264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d0c12-b391-499b-9e43-4ecaf2fa309d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.338984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981be7a8-2b2b-439b-9e0e-f89bd9c1bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.340011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981be7a8-2b2b-439b-9e0e-f89bd9c1bffd admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.340362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981be7a8-2b2b-439b-9e0e-f89bd9c1bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.340715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981be7a8-2b2b-439b-9e0e-f89bd9c1bffd admin admin] PATH_INFO: `/v3/projects/83c37d42cf154ffda6b7f0fb36b18be6/users/3a80780b72d84af58a61add284f4c883/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.343279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981be7a8-2b2b-439b-9e0e-f89bd9c1bffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83c37d42cf154ffda6b7f0fb36b18be6, user_id=3a80780b72d84af58a61add284f4c883, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.346817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981be7a8-2b2b-439b-9e0e-f89bd9c1bffd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.359619 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3769/7500] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:38 2022] PUT /identity/v3/projects/83c37d42cf154ffda6b7f0fb36b18be6/users/3a80780b72d84af58a61add284f4c883/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:38.373005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40199686-6e5b-4fe6-a2fb-f44c0f8ef4bb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.373982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40199686-6e5b-4fe6-a2fb-f44c0f8ef4bb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.374566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40199686-6e5b-4fe6-a2fb-f44c0f8ef4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.430099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-40199686-6e5b-4fe6-a2fb-f44c0f8ef4bb None None] MFA Rules not processed for user `3a80780b72d84af58a61add284f4c883`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:38.432793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-40199686-6e5b-4fe6-a2fb-f44c0f8ef4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:38.534808 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3732/7501] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:38.535464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981be7a8-2b2b-439b-9e0e-f89bd9c1bffd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.552144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981be7a8-2b2b-439b-9e0e-f89bd9c1bffd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.559798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b012bd-4556-44c0-a000-e8bc20211fd0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.560865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b012bd-4556-44c0-a000-e8bc20211fd0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.561524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b012bd-4556-44c0-a000-e8bc20211fd0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.561991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b012bd-4556-44c0-a000-e8bc20211fd0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.563251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b012bd-4556-44c0-a000-e8bc20211fd0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.564930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b012bd-4556-44c0-a000-e8bc20211fd0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.586221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3770/7502] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:38 2022] POST /identity/v3/services => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:38.590278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40199686-6e5b-4fe6-a2fb-f44c0f8ef4bb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.602902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40199686-6e5b-4fe6-a2fb-f44c0f8ef4bb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.626189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be38da-e9ae-4f99-8664-b66fff157898 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.626922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be38da-e9ae-4f99-8664-b66fff157898 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.627462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be38da-e9ae-4f99-8664-b66fff157898 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.627942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be38da-e9ae-4f99-8664-b66fff157898 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.628933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be38da-e9ae-4f99-8664-b66fff157898 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.630913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be38da-e9ae-4f99-8664-b66fff157898 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.657365 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-94be38da-e9ae-4f99-8664-b66fff157898 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-853463953. To ensure interoperability, identifiers should be a valid uuid. Mar 26 21:15:38.657365 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 21:15:38.657365 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:15:38.708372 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3733/7503] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 21:15:38 2022] POST /identity/v3/endpoints => generated 357 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:38.712181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b012bd-4556-44c0-a000-e8bc20211fd0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.724203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b012bd-4556-44c0-a000-e8bc20211fd0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.739947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec7a9-630e-418c-a495-79eb3e97af63 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.740947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec7a9-630e-418c-a495-79eb3e97af63 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.741237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec7a9-630e-418c-a495-79eb3e97af63 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.741513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baec7a9-630e-418c-a495-79eb3e97af63 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-853463953` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.742169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baec7a9-630e-418c-a495-79eb3e97af63 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-853463953)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.743493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baec7a9-630e-418c-a495-79eb3e97af63 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.745774 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3771/7504] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 21:15:38 2022] GET /identity/v3/regions/tempest-region-853463953 => generated 178 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:38.749432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be38da-e9ae-4f99-8664-b66fff157898 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.764137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be38da-e9ae-4f99-8664-b66fff157898 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.770079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a68e3-2873-4e87-91f5-6ed9b1c75cd4 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.770758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a68e3-2873-4e87-91f5-6ed9b1c75cd4 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.771045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a68e3-2873-4e87-91f5-6ed9b1c75cd4 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.771328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a68e3-2873-4e87-91f5-6ed9b1c75cd4 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.772242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a68e3-2873-4e87-91f5-6ed9b1c75cd4 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.774153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a68e3-2873-4e87-91f5-6ed9b1c75cd4 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.791767 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3734/7505] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:38 2022] POST /identity/v3/services => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:38.795590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec7a9-630e-418c-a495-79eb3e97af63 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.806811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baec7a9-630e-418c-a495-79eb3e97af63 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.827053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b61f7-b590-4aba-8ad7-cdb77ef4d6c0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.827860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b61f7-b590-4aba-8ad7-cdb77ef4d6c0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.828241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b61f7-b590-4aba-8ad7-cdb77ef4d6c0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.828527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b61f7-b590-4aba-8ad7-cdb77ef4d6c0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.829947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b61f7-b590-4aba-8ad7-cdb77ef4d6c0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.832402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b61f7-b590-4aba-8ad7-cdb77ef4d6c0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.848857 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-257b61f7-b590-4aba-8ad7-cdb77ef4d6c0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1743731310. To ensure interoperability, identifiers should be a valid uuid. Mar 26 21:15:38.848857 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 21:15:38.848857 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:15:38.895098 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3772/7506] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 21:15:38 2022] POST /identity/v3/endpoints => generated 362 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:38.896821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a68e3-2873-4e87-91f5-6ed9b1c75cd4 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.926847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a68e3-2873-4e87-91f5-6ed9b1c75cd4 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:38.964804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4813754-bf79-49d3-bb06-95cfeda5c32b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:38.966028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4813754-bf79-49d3-bb06-95cfeda5c32b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:38.966323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4813754-bf79-49d3-bb06-95cfeda5c32b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:38.966602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4813754-bf79-49d3-bb06-95cfeda5c32b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-1743731310` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:38.969445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4813754-bf79-49d3-bb06-95cfeda5c32b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1743731310)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:38.970849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4813754-bf79-49d3-bb06-95cfeda5c32b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:38.978304 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3735/7507] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Mar 26 21:15:38 2022] GET /identity/v3/regions/tempest-region-1743731310 => generated 180 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:15:38.983180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b61f7-b590-4aba-8ad7-cdb77ef4d6c0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:38.998966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b61f7-b590-4aba-8ad7-cdb77ef4d6c0 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.011695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493d89e-a59b-403c-a5c5-2c8e78bbc7e5 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.012455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493d89e-a59b-403c-a5c5-2c8e78bbc7e5 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.013061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493d89e-a59b-403c-a5c5-2c8e78bbc7e5 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.013061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493d89e-a59b-403c-a5c5-2c8e78bbc7e5 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.013753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493d89e-a59b-403c-a5c5-2c8e78bbc7e5 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.030102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493d89e-a59b-403c-a5c5-2c8e78bbc7e5 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.051525 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-0493d89e-a59b-403c-a5c5-2c8e78bbc7e5 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-983566210. To ensure interoperability, identifiers should be a valid uuid. Mar 26 21:15:39.051525 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 21:15:39.051525 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:15:39.094768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3773/7508] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 21:15:38 2022] POST /identity/v3/endpoints => generated 358 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:39.099074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4813754-bf79-49d3-bb06-95cfeda5c32b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.114810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4813754-bf79-49d3-bb06-95cfeda5c32b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.132526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c0f0b-7138-468b-9fbb-19233c99cb27 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.133783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c0f0b-7138-468b-9fbb-19233c99cb27 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.134007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c0f0b-7138-468b-9fbb-19233c99cb27 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.134425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c0f0b-7138-468b-9fbb-19233c99cb27 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-983566210` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.135087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c0f0b-7138-468b-9fbb-19233c99cb27 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-983566210)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.136463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c0f0b-7138-468b-9fbb-19233c99cb27 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.139216 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3736/7509] 10.222.0.16 () {58 vars in 1202 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/regions/tempest-region-983566210 => generated 178 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:39.143122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493d89e-a59b-403c-a5c5-2c8e78bbc7e5 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.158962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493d89e-a59b-403c-a5c5-2c8e78bbc7e5 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.164490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d84f-f67a-4b1f-97b8-baa2e05cd34a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.165243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d84f-f67a-4b1f-97b8-baa2e05cd34a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.165588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d84f-f67a-4b1f-97b8-baa2e05cd34a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.166115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42d84f-f67a-4b1f-97b8-baa2e05cd34a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.166894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42d84f-f67a-4b1f-97b8-baa2e05cd34a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.168931 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-ad42d84f-f67a-4b1f-97b8-baa2e05cd34a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:15:39.168931 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:15:39.168931 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:15:39.170142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42d84f-f67a-4b1f-97b8-baa2e05cd34a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.185058 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3774/7510] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/endpoints => generated 4381 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:39.188880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c0f0b-7138-468b-9fbb-19233c99cb27 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.204754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c0f0b-7138-468b-9fbb-19233c99cb27 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.209987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3566b1-da8e-4a2e-8904-018fa622beb7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.211597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3566b1-da8e-4a2e-8904-018fa622beb7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.212187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3566b1-da8e-4a2e-8904-018fa622beb7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.212708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3566b1-da8e-4a2e-8904-018fa622beb7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints/8c9f2550fb74458fb70db4a125df7a9d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.218594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3566b1-da8e-4a2e-8904-018fa622beb7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=8c9f2550fb74458fb70db4a125df7a9d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.220015 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-6e3566b1-da8e-4a2e-8904-018fa622beb7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:15:39.220015 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:15:39.220015 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:15:39.221339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3566b1-da8e-4a2e-8904-018fa622beb7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.223738 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3737/7511] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/endpoints/8c9f2550fb74458fb70db4a125df7a9d => generated 358 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:39.228123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d84f-f67a-4b1f-97b8-baa2e05cd34a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.239847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42d84f-f67a-4b1f-97b8-baa2e05cd34a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.244843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3054a02-e77f-4e5c-be43-2be2bccce4b7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.245872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3054a02-e77f-4e5c-be43-2be2bccce4b7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.247009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3054a02-e77f-4e5c-be43-2be2bccce4b7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.247009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3054a02-e77f-4e5c-be43-2be2bccce4b7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints/8c9f2550fb74458fb70db4a125df7a9d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.247884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3054a02-e77f-4e5c-be43-2be2bccce4b7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=8c9f2550fb74458fb70db4a125df7a9d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.249629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3054a02-e77f-4e5c-be43-2be2bccce4b7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.259164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c3054a02-e77f-4e5c-be43-2be2bccce4b7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '8c9f2550fb74458fb70db4a125df7a9d', 'request_id': 'req-c3054a02-e77f-4e5c-be43-2be2bccce4b7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:39.269086 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3775/7512] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:39 2022] DELETE /identity/v3/endpoints/8c9f2550fb74458fb70db4a125df7a9d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:39.272981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3566b1-da8e-4a2e-8904-018fa622beb7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.296908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3566b1-da8e-4a2e-8904-018fa622beb7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.316201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f2b70-3d44-4d84-b564-ef38ced5c57b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.317140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f2b70-3d44-4d84-b564-ef38ced5c57b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.317498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f2b70-3d44-4d84-b564-ef38ced5c57b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.317848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f2b70-3d44-4d84-b564-ef38ced5c57b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.318620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f2b70-3d44-4d84-b564-ef38ced5c57b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.319728 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-2e7f2b70-3d44-4d84-b564-ef38ced5c57b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:15:39.319728 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:15:39.319728 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:15:39.320756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f2b70-3d44-4d84-b564-ef38ced5c57b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.332530 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3738/7513] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/endpoints => generated 4036 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:39.333711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3054a02-e77f-4e5c-be43-2be2bccce4b7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.344543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3054a02-e77f-4e5c-be43-2be2bccce4b7 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.349106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd5f56-3cda-4a78-ba53-dd72c25d470d tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.349938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd5f56-3cda-4a78-ba53-dd72c25d470d tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.350222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd5f56-3cda-4a78-ba53-dd72c25d470d tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.350499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd5f56-3cda-4a78-ba53-dd72c25d470d tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints/8c9f2550fb74458fb70db4a125df7a9d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.354923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd5f56-3cda-4a78-ba53-dd72c25d470d tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 26 21:15:39.364872 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-c1cd5f56-3cda-4a78-ba53-dd72c25d470d tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Could not find endpoint: 8c9f2550fb74458fb70db4a125df7a9d.: keystone.exception.EndpointNotFound: Could not find endpoint: 8c9f2550fb74458fb70db4a125df7a9d. Mar 26 21:15:39.366071 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3776/7514] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:39 2022] DELETE /identity/v3/endpoints/8c9f2550fb74458fb70db4a125df7a9d => generated 114 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:15:39.370161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f2b70-3d44-4d84-b564-ef38ced5c57b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.381725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd5f56-3cda-4a78-ba53-dd72c25d470d tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.383729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c1cd5f56-3cda-4a78-ba53-dd72c25d470d tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:39.384728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f2b70-3d44-4d84-b564-ef38ced5c57b tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.390544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178b68e-7d64-48cf-9eb0-19d287510375 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.391432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178b68e-7d64-48cf-9eb0-19d287510375 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.391768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178b68e-7d64-48cf-9eb0-19d287510375 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.392110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178b68e-7d64-48cf-9eb0-19d287510375 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-983566210` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.392768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178b68e-7d64-48cf-9eb0-19d287510375 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-983566210)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.394444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178b68e-7d64-48cf-9eb0-19d287510375 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.408403 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-d178b68e-7d64-48cf-9eb0-19d287510375 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-983566210. To ensure interoperability, identifiers should be a valid uuid. Mar 26 21:15:39.408403 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 21:15:39.408403 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:15:39.416770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3739/7515] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Mar 26 21:15:39 2022] DELETE /identity/v3/regions/tempest-region-983566210 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:39.424981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178b68e-7d64-48cf-9eb0-19d287510375 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.448361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178b68e-7d64-48cf-9eb0-19d287510375 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.454008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811a6ce-3404-4189-b794-27fd793f5afe tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.454878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a6ce-3404-4189-b794-27fd793f5afe tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.455368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a6ce-3404-4189-b794-27fd793f5afe tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.455649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811a6ce-3404-4189-b794-27fd793f5afe tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.456382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811a6ce-3404-4189-b794-27fd793f5afe tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.458169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811a6ce-3404-4189-b794-27fd793f5afe tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.470880 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3740/7516] 10.222.0.16 () {58 vars in 1133 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/endpoints => generated 4036 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:39.472959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811a6ce-3404-4189-b794-27fd793f5afe tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.480412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd5f56-3cda-4a78-ba53-dd72c25d470d tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.483696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811a6ce-3404-4189-b794-27fd793f5afe tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.489520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc618-71b3-452f-88cc-545dcc417e6a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.490174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc618-71b3-452f-88cc-545dcc417e6a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.490592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc618-71b3-452f-88cc-545dcc417e6a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.491010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dc618-71b3-452f-88cc-545dcc417e6a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.491746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc618-71b3-452f-88cc-545dcc417e6a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Adding query filter params (service_id=2a05dc860db24db5b3bde881fded1c9e) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:39.493123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc618-71b3-452f-88cc-545dcc417e6a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.493746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dc618-71b3-452f-88cc-545dcc417e6a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.498657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.500368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.500515 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3741/7517] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/endpoints?service_id=2a05dc860db24db5b3bde881fded1c9e => generated 499 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:39.501000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.501303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] PATH_INFO: `/v3/users/a04f7dd42a6f4ebfb53d97768049c2ff` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.503521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04f7dd42a6f4ebfb53d97768049c2ff)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.504179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc618-71b3-452f-88cc-545dcc417e6a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.505942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.515471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dc618-71b3-452f-88cc-545dcc417e6a tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.520400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fec02e-b22c-4edb-98c6-0b4f4c95cb62 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.521048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fec02e-b22c-4edb-98c6-0b4f4c95cb62 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.521469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fec02e-b22c-4edb-98c6-0b4f4c95cb62 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.521881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fec02e-b22c-4edb-98c6-0b4f4c95cb62 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.522606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fec02e-b22c-4edb-98c6-0b4f4c95cb62 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Adding query filter params (service_id=4d6c70014c3c4ad29d148f2081074545) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:39.522910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fec02e-b22c-4edb-98c6-0b4f4c95cb62 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.524554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fec02e-b22c-4edb-98c6-0b4f4c95cb62 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.535019 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3742/7518] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/endpoints?service_id=4d6c70014c3c4ad29d148f2081074545 => generated 504 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:15:39.536513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fec02e-b22c-4edb-98c6-0b4f4c95cb62 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.547319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fec02e-b22c-4edb-98c6-0b4f4c95cb62 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.552834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.553488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.553775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.554311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.555033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:39.555347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.557262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.562338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04f7dd42a6f4ebfb53d97768049c2ff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:39.567465 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3743/7519] 10.222.0.16 () {58 vars in 1166 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/endpoints?interface=public => generated 3392 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:39.569355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04f7dd42a6f4ebfb53d97768049c2ff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:39.570415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04f7dd42a6f4ebfb53d97768049c2ff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:39.570844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04f7dd42a6f4ebfb53d97768049c2ff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:39.571396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.573199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:39.580240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-57f51f4e-719e-4ed2-a91b-837aaba94729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04f7dd42a6f4ebfb53d97768049c2ff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:39.588279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c4e3f-0a4c-4f17-b986-c4af3ca542a2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.601527 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3777/7520] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:39 2022] DELETE /identity/v3/users/a04f7dd42a6f4ebfb53d97768049c2ff => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:39.601838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ffab7-b40c-461d-bcf6-568e673a4414 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.602507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ffab7-b40c-461d-bcf6-568e673a4414 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.602824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ffab7-b40c-461d-bcf6-568e673a4414 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.603104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ffab7-b40c-461d-bcf6-568e673a4414 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.603863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ffab7-b40c-461d-bcf6-568e673a4414 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:39.604284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ffab7-b40c-461d-bcf6-568e673a4414 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.605871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8f636-4382-4816-82a8-6a95f49500fa None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.606157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8f636-4382-4816-82a8-6a95f49500fa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.606285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ffab7-b40c-461d-bcf6-568e673a4414 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.606434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8f636-4382-4816-82a8-6a95f49500fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.612519 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3744/7521] 10.222.0.16 () {58 vars in 1170 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:15:39.617415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ffab7-b40c-461d-bcf6-568e673a4414 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.625610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-92b8f636-4382-4816-82a8-6a95f49500fa None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:39.626823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-92b8f636-4382-4816-82a8-6a95f49500fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:39.628209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ffab7-b40c-461d-bcf6-568e673a4414 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.686186 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3778/7522] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:39 2022] POST /identity/v3/auth/tokens => generated 3857 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:39.686395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caa331-617d-4d3e-8e25-3e387d00ca53 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.687065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caa331-617d-4d3e-8e25-3e387d00ca53 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.687356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caa331-617d-4d3e-8e25-3e387d00ca53 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.687644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26caa331-617d-4d3e-8e25-3e387d00ca53 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.688432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caa331-617d-4d3e-8e25-3e387d00ca53 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.690304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26caa331-617d-4d3e-8e25-3e387d00ca53 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.695712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8f636-4382-4816-82a8-6a95f49500fa None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.697102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-92b8f636-4382-4816-82a8-6a95f49500fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:39.708941 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3745/7523] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:39 2022] POST /identity/v3/services => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:39.709929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caa331-617d-4d3e-8e25-3e387d00ca53 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.730382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26caa331-617d-4d3e-8e25-3e387d00ca53 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.735645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e482c01-cd2c-4cda-8203-3a0571656b2e tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.736331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e482c01-cd2c-4cda-8203-3a0571656b2e tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.736618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e482c01-cd2c-4cda-8203-3a0571656b2e tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.736905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e482c01-cd2c-4cda-8203-3a0571656b2e tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.737633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e482c01-cd2c-4cda-8203-3a0571656b2e tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.739235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e482c01-cd2c-4cda-8203-3a0571656b2e tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.753698 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-4e482c01-cd2c-4cda-8203-3a0571656b2e tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1329344404. To ensure interoperability, identifiers should be a valid uuid. Mar 26 21:15:39.753698 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 21:15:39.753698 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:15:39.765488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8f636-4382-4816-82a8-6a95f49500fa None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.779249 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3746/7524] 10.222.0.16 () {60 vars in 1155 bytes} [Sat Mar 26 21:15:39 2022] POST /identity/v3/endpoints => generated 360 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:39.780423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e482c01-cd2c-4cda-8203-3a0571656b2e tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.780558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bdda6-1972-42eb-b650-c0c9f4c835ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.781098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bdda6-1972-42eb-b650-c0c9f4c835ae service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.781416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bdda6-1972-42eb-b650-c0c9f4c835ae service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.781696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02bdda6-1972-42eb-b650-c0c9f4c835ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.792031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bdda6-1972-42eb-b650-c0c9f4c835ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.793480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02bdda6-1972-42eb-b650-c0c9f4c835ae service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.801416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e482c01-cd2c-4cda-8203-3a0571656b2e tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.806594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bd87d-7855-4dcc-aac5-f90cb7a80a0f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.807403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bd87d-7855-4dcc-aac5-f90cb7a80a0f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.807687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bd87d-7855-4dcc-aac5-f90cb7a80a0f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.807993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bd87d-7855-4dcc-aac5-f90cb7a80a0f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-1329344404` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.808642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bd87d-7855-4dcc-aac5-f90cb7a80a0f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1329344404)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.809733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bd87d-7855-4dcc-aac5-f90cb7a80a0f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.811553 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3747/7525] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/regions/tempest-region-1329344404 => generated 180 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:39.814087 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3779/7526] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/auth/tokens => generated 4174 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:39.815404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bd87d-7855-4dcc-aac5-f90cb7a80a0f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.824969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bd87d-7855-4dcc-aac5-f90cb7a80a0f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.830115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2acc7-495a-467d-b782-40ae49d55083 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.831053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2acc7-495a-467d-b782-40ae49d55083 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.831343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2acc7-495a-467d-b782-40ae49d55083 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.831616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2acc7-495a-467d-b782-40ae49d55083 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints/9ca89dd7ea9c43559ba3402922efdc95` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.836839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2acc7-495a-467d-b782-40ae49d55083 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=9ca89dd7ea9c43559ba3402922efdc95)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.838456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2acc7-495a-467d-b782-40ae49d55083 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.853630 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-a3a2acc7-495a-467d-b782-40ae49d55083 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1485415933. To ensure interoperability, identifiers should be a valid uuid. Mar 26 21:15:39.853630 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 21:15:39.853630 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:15:39.888938 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3748/7527] 10.222.0.16 () {60 vars in 1255 bytes} [Sat Mar 26 21:15:39 2022] PATCH /identity/v3/endpoints/9ca89dd7ea9c43559ba3402922efdc95 => generated 363 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:15:39.890228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bdda6-1972-42eb-b650-c0c9f4c835ae service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.912408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02bdda6-1972-42eb-b650-c0c9f4c835ae service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.926805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be146a42-3ff7-4bd3-b921-7e9c195066c3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.927631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be146a42-3ff7-4bd3-b921-7e9c195066c3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.927935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be146a42-3ff7-4bd3-b921-7e9c195066c3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.928219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be146a42-3ff7-4bd3-b921-7e9c195066c3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-1485415933` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.928859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be146a42-3ff7-4bd3-b921-7e9c195066c3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1485415933)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.930184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be146a42-3ff7-4bd3-b921-7e9c195066c3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.932182 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3780/7528] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Mar 26 21:15:39 2022] GET /identity/v3/regions/tempest-region-1485415933 => generated 180 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:39.936110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2acc7-495a-467d-b782-40ae49d55083 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.946448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2acc7-495a-467d-b782-40ae49d55083 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.951578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:39.952691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:39.952919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:39.954252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints/9ca89dd7ea9c43559ba3402922efdc95` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:39.959454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=9ca89dd7ea9c43559ba3402922efdc95)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:39.961450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:39.969207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '9ca89dd7ea9c43559ba3402922efdc95', 'request_id': 'req-1f4c022b-623e-44da-812f-cf5780efb3d1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:39.981653 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3749/7529] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:39 2022] DELETE /identity/v3/endpoints/9ca89dd7ea9c43559ba3402922efdc95 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:39.985801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be146a42-3ff7-4bd3-b921-7e9c195066c3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:39.996988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be146a42-3ff7-4bd3-b921-7e9c195066c3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:39.997946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.006240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:40.014565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d867f59-07af-4aa8-901c-b52ab514cc35 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.015503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d867f59-07af-4aa8-901c-b52ab514cc35 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.015858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d867f59-07af-4aa8-901c-b52ab514cc35 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.016813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d867f59-07af-4aa8-901c-b52ab514cc35 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-1485415933` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.021511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d867f59-07af-4aa8-901c-b52ab514cc35 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1485415933)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.021511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d867f59-07af-4aa8-901c-b52ab514cc35 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.041747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c022b-623e-44da-812f-cf5780efb3d1 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.047551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.048537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.048657 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-4d867f59-07af-4aa8-901c-b52ab514cc35 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1485415933. To ensure interoperability, identifiers should be a valid uuid. Mar 26 21:15:40.048657 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 21:15:40.048657 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:15:40.048960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.049168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] PATH_INFO: `/v3/projects/e7442ba4684047629c0de92ac34b7e42` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.050349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7442ba4684047629c0de92ac34b7e42)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.052810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.058810 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3781/7530] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Mar 26 21:15:39 2022] DELETE /identity/v3/regions/tempest-region-1485415933 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:40.061753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d867f59-07af-4aa8-901c-b52ab514cc35 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.084089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d867f59-07af-4aa8-901c-b52ab514cc35 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.090655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7525a60-f4ef-4e23-9405-e363ea2e87e3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.091523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7525a60-f4ef-4e23-9405-e363ea2e87e3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.091970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7525a60-f4ef-4e23-9405-e363ea2e87e3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.092265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7525a60-f4ef-4e23-9405-e363ea2e87e3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-1329344404` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.092920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7525a60-f4ef-4e23-9405-e363ea2e87e3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1329344404)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.095088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7525a60-f4ef-4e23-9405-e363ea2e87e3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.105980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7442ba4684047629c0de92ac34b7e42', 'request_id': 'req-53568a0a-3ab8-4d79-9d47-437777e80557'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:40.110442 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-d7525a60-f4ef-4e23-9405-e363ea2e87e3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1329344404. To ensure interoperability, identifiers should be a valid uuid. Mar 26 21:15:40.110442 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 21:15:40.110442 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:15:40.115316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7442ba4684047629c0de92ac34b7e42', 'request_id': 'req-53568a0a-3ab8-4d79-9d47-437777e80557'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:40.118520 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3782/7531] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Mar 26 21:15:40 2022] DELETE /identity/v3/regions/tempest-region-1329344404 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:40.122754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7525a60-f4ef-4e23-9405-e363ea2e87e3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.133411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7442ba4684047629c0de92ac34b7e42', 'request_id': 'req-53568a0a-3ab8-4d79-9d47-437777e80557'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:40.147027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] The token cache is being invalidate because project e7442ba4684047629c0de92ac34b7e42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:40.147437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:40.147592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7525a60-f4ef-4e23-9405-e363ea2e87e3 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.148152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-53568a0a-3ab8-4d79-9d47-437777e80557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:40.153501 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3750/7532] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:39 2022] DELETE /identity/v3/projects/e7442ba4684047629c0de92ac34b7e42 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:40.156093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7411cf-c38e-493b-8a7e-514dc27ab15d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.156436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7411cf-c38e-493b-8a7e-514dc27ab15d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.156856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7411cf-c38e-493b-8a7e-514dc27ab15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.177153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6e7411cf-c38e-493b-8a7e-514dc27ab15d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:40.178594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6e7411cf-c38e-493b-8a7e-514dc27ab15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:40.225623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b64c1-e4f9-4d52-88da-1c0d285081dc tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.226541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b64c1-e4f9-4d52-88da-1c0d285081dc tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.226826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b64c1-e4f9-4d52-88da-1c0d285081dc tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.227106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b64c1-e4f9-4d52-88da-1c0d285081dc tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/services/af5ec46dba4942d4942366506246ddf6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.227765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b64c1-e4f9-4d52-88da-1c0d285081dc tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_service(service_id=af5ec46dba4942d4942366506246ddf6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.229420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b64c1-e4f9-4d52-88da-1c0d285081dc tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.257942 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3783/7533] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:40 2022] DELETE /identity/v3/services/af5ec46dba4942d4942366506246ddf6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:40.258170 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3751/7534] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3857 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:40.261365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b64c1-e4f9-4d52-88da-1c0d285081dc tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.263220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebd42-43f7-47a2-a23a-26e65e5e389a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.263463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-113b64c1-e4f9-4d52-88da-1c0d285081dc tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:40.263612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebd42-43f7-47a2-a23a-26e65e5e389a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.263872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ebd42-43f7-47a2-a23a-26e65e5e389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.289735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b64c1-e4f9-4d52-88da-1c0d285081dc tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.290370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-644ebd42-43f7-47a2-a23a-26e65e5e389a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:40.291789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-644ebd42-43f7-47a2-a23a-26e65e5e389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:40.294978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df879f06-43bb-41ac-a9d0-83a98fa114b2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.295887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879f06-43bb-41ac-a9d0-83a98fa114b2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.296258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879f06-43bb-41ac-a9d0-83a98fa114b2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.296603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df879f06-43bb-41ac-a9d0-83a98fa114b2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints/36b4f91b1b81447d8f2a0bd401aac58b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.302979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df879f06-43bb-41ac-a9d0-83a98fa114b2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=36b4f91b1b81447d8f2a0bd401aac58b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.304981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df879f06-43bb-41ac-a9d0-83a98fa114b2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.313880 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3752/7535] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3857 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:40.316020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-df879f06-43bb-41ac-a9d0-83a98fa114b2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '36b4f91b1b81447d8f2a0bd401aac58b', 'request_id': 'req-df879f06-43bb-41ac-a9d0-83a98fa114b2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:40.318352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ebd42-43f7-47a2-a23a-26e65e5e389a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.327654 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3784/7536] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:40 2022] DELETE /identity/v3/endpoints/36b4f91b1b81447d8f2a0bd401aac58b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:40.329365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ebd42-43f7-47a2-a23a-26e65e5e389a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.333488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df879f06-43bb-41ac-a9d0-83a98fa114b2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.351335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41386471-1e5c-4632-9f25-390a22354d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.352033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41386471-1e5c-4632-9f25-390a22354d92 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.352414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41386471-1e5c-4632-9f25-390a22354d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.352684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41386471-1e5c-4632-9f25-390a22354d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.353477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41386471-1e5c-4632-9f25-390a22354d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:40.353804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41386471-1e5c-4632-9f25-390a22354d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.355449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41386471-1e5c-4632-9f25-390a22354d92 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.357964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df879f06-43bb-41ac-a9d0-83a98fa114b2 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.363372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47880-cc52-4613-ae94-d068e19466df tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.364483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47880-cc52-4613-ae94-d068e19466df tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.365182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47880-cc52-4613-ae94-d068e19466df tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.365475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47880-cc52-4613-ae94-d068e19466df tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-1743731310` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.366127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47880-cc52-4613-ae94-d068e19466df tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1743731310)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.367626 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3753/7537] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:40.371690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47880-cc52-4613-ae94-d068e19466df tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.372645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41386471-1e5c-4632-9f25-390a22354d92 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.384593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41386471-1e5c-4632-9f25-390a22354d92 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.392127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03703755-220c-4756-9925-90dd0f7f51c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.392938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03703755-220c-4756-9925-90dd0f7f51c7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.393345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03703755-220c-4756-9925-90dd0f7f51c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.393636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03703755-220c-4756-9925-90dd0f7f51c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.394555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03703755-220c-4756-9925-90dd0f7f51c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.396840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03703755-220c-4756-9925-90dd0f7f51c7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.402930 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3785/7538] 10.222.0.16 () {58 vars in 1208 bytes} [Sat Mar 26 21:15:40 2022] DELETE /identity/v3/regions/tempest-region-1743731310 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:40.403940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47880-cc52-4613-ae94-d068e19466df tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.429739 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3754/7539] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:40 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:40.434103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03703755-220c-4756-9925-90dd0f7f51c7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.436657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47880-cc52-4613-ae94-d068e19466df tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.522186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03703755-220c-4756-9925-90dd0f7f51c7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.526009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e778b-b4bb-4529-ae54-401df3cdf544 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.527399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e778b-b4bb-4529-ae54-401df3cdf544 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.528088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e778b-b4bb-4529-ae54-401df3cdf544 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.528893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e778b-b4bb-4529-ae54-401df3cdf544 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/services/4d6c70014c3c4ad29d148f2081074545` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.530374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e778b-b4bb-4529-ae54-401df3cdf544 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4d6c70014c3c4ad29d148f2081074545)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.532634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e778b-b4bb-4529-ae54-401df3cdf544 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.538883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917908b-8f65-4f67-85f5-51c60b2c444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.539710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917908b-8f65-4f67-85f5-51c60b2c444e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.540035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917908b-8f65-4f67-85f5-51c60b2c444e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.540317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917908b-8f65-4f67-85f5-51c60b2c444e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.541005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917908b-8f65-4f67-85f5-51c60b2c444e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.543123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917908b-8f65-4f67-85f5-51c60b2c444e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.564824 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3786/7540] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:40 2022] DELETE /identity/v3/services/4d6c70014c3c4ad29d148f2081074545 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:40.569202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e778b-b4bb-4529-ae54-401df3cdf544 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.573261 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3755/7541] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:40 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:40.574584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917908b-8f65-4f67-85f5-51c60b2c444e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.591344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917908b-8f65-4f67-85f5-51c60b2c444e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.592359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e778b-b4bb-4529-ae54-401df3cdf544 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.601477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e798080-58a3-4518-b4ff-b3f06c3df7d9 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.602330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e798080-58a3-4518-b4ff-b3f06c3df7d9 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.602618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e798080-58a3-4518-b4ff-b3f06c3df7d9 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.602899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e798080-58a3-4518-b4ff-b3f06c3df7d9 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/endpoints/800c9cfbb1cc43a2a131eb16736e6371` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.609190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbff40-1229-4e00-9dd5-3b311dc039ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.609515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbff40-1229-4e00-9dd5-3b311dc039ec admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.610482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbff40-1229-4e00-9dd5-3b311dc039ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.610881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbff40-1229-4e00-9dd5-3b311dc039ec admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.611497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbff40-1229-4e00-9dd5-3b311dc039ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.613163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbff40-1229-4e00-9dd5-3b311dc039ec admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.628957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e798080-58a3-4518-b4ff-b3f06c3df7d9 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=800c9cfbb1cc43a2a131eb16736e6371)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.631140 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3756/7542] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:40.631594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e798080-58a3-4518-b4ff-b3f06c3df7d9 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.632172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbff40-1229-4e00-9dd5-3b311dc039ec admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.644734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbff40-1229-4e00-9dd5-3b311dc039ec admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.649568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8e798080-58a3-4518-b4ff-b3f06c3df7d9 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '800c9cfbb1cc43a2a131eb16736e6371', 'request_id': 'req-8e798080-58a3-4518-b4ff-b3f06c3df7d9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:40.653860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909156c6-342b-4d74-a9ba-297fc82a00e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.654570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909156c6-342b-4d74-a9ba-297fc82a00e2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.654906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909156c6-342b-4d74-a9ba-297fc82a00e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.655197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909156c6-342b-4d74-a9ba-297fc82a00e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.656159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909156c6-342b-4d74-a9ba-297fc82a00e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.657825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909156c6-342b-4d74-a9ba-297fc82a00e2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.678663 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3757/7543] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:40.681034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909156c6-342b-4d74-a9ba-297fc82a00e2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.694211 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3787/7544] 10.222.0.16 () {58 vars in 1235 bytes} [Sat Mar 26 21:15:40 2022] DELETE /identity/v3/endpoints/800c9cfbb1cc43a2a131eb16736e6371 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:40.696183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909156c6-342b-4d74-a9ba-297fc82a00e2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.706159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e798080-58a3-4518-b4ff-b3f06c3df7d9 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.714030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8d17b-fc3c-4986-86ff-425c1247f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.715374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8d17b-fc3c-4986-86ff-425c1247f69d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.715774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8d17b-fc3c-4986-86ff-425c1247f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.716748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8d17b-fc3c-4986-86ff-425c1247f69d admin admin] PATH_INFO: `/v3/projects/94e253be6580437488b462210584566d/users/16be1b08924a44a4a0a4c283a7f6dc83/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.746945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e798080-58a3-4518-b4ff-b3f06c3df7d9 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.747593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8d17b-fc3c-4986-86ff-425c1247f69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94e253be6580437488b462210584566d, user_id=16be1b08924a44a4a0a4c283a7f6dc83, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.752775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8d17b-fc3c-4986-86ff-425c1247f69d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.754347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5024394-34b0-41be-ab1a-c92ab8e3d52f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.755620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5024394-34b0-41be-ab1a-c92ab8e3d52f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.756048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5024394-34b0-41be-ab1a-c92ab8e3d52f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.756317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5024394-34b0-41be-ab1a-c92ab8e3d52f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/regions/tempest-region-853463953` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.757036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5024394-34b0-41be-ab1a-c92ab8e3d52f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-853463953)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.758975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5024394-34b0-41be-ab1a-c92ab8e3d52f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.775929 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-a5024394-34b0-41be-ab1a-c92ab8e3d52f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-853463953. To ensure interoperability, identifiers should be a valid uuid. Mar 26 21:15:40.775929 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Mar 26 21:15:40.775929 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:15:40.777138 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3758/7545] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:40 2022] PUT /identity/v3/projects/94e253be6580437488b462210584566d/users/16be1b08924a44a4a0a4c283a7f6dc83/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:40.785574 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3788/7546] 10.222.0.16 () {58 vars in 1205 bytes} [Sat Mar 26 21:15:40 2022] DELETE /identity/v3/regions/tempest-region-853463953 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:40.788436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ab07-2bbe-42bb-9816-28736af24a4a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.788903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ab07-2bbe-42bb-9816-28736af24a4a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.789379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ab07-2bbe-42bb-9816-28736af24a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.789528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5024394-34b0-41be-ab1a-c92ab8e3d52f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.811534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5024394-34b0-41be-ab1a-c92ab8e3d52f tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:40.822831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1186ab07-2bbe-42bb-9816-28736af24a4a None None] MFA Rules not processed for user `16be1b08924a44a4a0a4c283a7f6dc83`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:40.824253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1186ab07-2bbe-42bb-9816-28736af24a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:40.897869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c30034-e04b-4797-a64d-c278874c2446 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a80780b72d84af58a61add284f4c883', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83c37d42cf154ffda6b7f0fb36b18be6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:40.898735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30034-e04b-4797-a64d-c278874c2446 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:40.899039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30034-e04b-4797-a64d-c278874c2446 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:40.900049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c30034-e04b-4797-a64d-c278874c2446 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] PATH_INFO: `/v3/services/2a05dc860db24db5b3bde881fded1c9e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:40.900182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c30034-e04b-4797-a64d-c278874c2446 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2a05dc860db24db5b3bde881fded1c9e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:40.901864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c30034-e04b-4797-a64d-c278874c2446 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:40.926845 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3759/7547] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3369 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:40.935178 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3789/7548] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:40 2022] DELETE /identity/v3/services/2a05dc860db24db5b3bde881fded1c9e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:40.936349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ab07-2bbe-42bb-9816-28736af24a4a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.937888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1186ab07-2bbe-42bb-9816-28736af24a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:40.941275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c30034-e04b-4797-a64d-c278874c2446 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:40.943161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-63c30034-e04b-4797-a64d-c278874c2446 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:41.046054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ab07-2bbe-42bb-9816-28736af24a4a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:41.057989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c30034-e04b-4797-a64d-c278874c2446 tempest-EndPointsTestJSON-196641631 tempest-EndPointsTestJSON-196641631-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:41.061397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4067d8-b55a-4042-bc45-f9af561c3919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:41.062045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4067d8-b55a-4042-bc45-f9af561c3919 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:41.062412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4067d8-b55a-4042-bc45-f9af561c3919 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:41.062786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4067d8-b55a-4042-bc45-f9af561c3919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:41.063853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:41.064757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:41.065043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:41.065321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] PATH_INFO: `/v3/users/325ac4c7eaa24f908e9fa669205057c4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:41.066521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325ac4c7eaa24f908e9fa669205057c4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:41.068526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:41.078432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4067d8-b55a-4042-bc45-f9af561c3919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:41.078432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4067d8-b55a-4042-bc45-f9af561c3919 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:41.099607 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3760/7549] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:41.118641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325ac4c7eaa24f908e9fa669205057c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.125954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325ac4c7eaa24f908e9fa669205057c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.126762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325ac4c7eaa24f908e9fa669205057c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.127446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325ac4c7eaa24f908e9fa669205057c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.137904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325ac4c7eaa24f908e9fa669205057c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.162411 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3790/7550] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:40 2022] DELETE /identity/v3/users/325ac4c7eaa24f908e9fa669205057c4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:41.164014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1e43d-b9fc-4f8a-ad7c-16e4d2dcd4f3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:41.164307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1e43d-b9fc-4f8a-ad7c-16e4d2dcd4f3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:41.164622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1e43d-b9fc-4f8a-ad7c-16e4d2dcd4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:41.189728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d7a1e43d-b9fc-4f8a-ad7c-16e4d2dcd4f3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:41.193927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:41.194115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d7a1e43d-b9fc-4f8a-ad7c-16e4d2dcd4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:41.195497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:41.259201 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3761/7551] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:41.270325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251dac52-cf44-4f82-91e4-e1a91fc59909 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:41.270673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1e43d-b9fc-4f8a-ad7c-16e4d2dcd4f3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:41.272451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d7a1e43d-b9fc-4f8a-ad7c-16e4d2dcd4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:41.275177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:41.276090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:41.276714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:41.277315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] PATH_INFO: `/v3/users/fa0e197e06274ad5811c8d50ed9c7570` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:41.278604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa0e197e06274ad5811c8d50ed9c7570)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:41.281055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:41.338286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa0e197e06274ad5811c8d50ed9c7570'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.346737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa0e197e06274ad5811c8d50ed9c7570'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.347011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1e43d-b9fc-4f8a-ad7c-16e4d2dcd4f3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:41.347700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa0e197e06274ad5811c8d50ed9c7570'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.348424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa0e197e06274ad5811c8d50ed9c7570'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.350809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:41.351480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:41.351755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:41.352093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:41.354394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:41.358264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2d45f750-3a06-4f08-9902-fc59aca4e75d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa0e197e06274ad5811c8d50ed9c7570'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.368145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:41.369629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:41.378893 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3791/7552] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:41 2022] DELETE /identity/v3/users/fa0e197e06274ad5811c8d50ed9c7570 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:41.383332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b5f56-9fa7-4bb3-ad68-68a2b0f5b625 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:41.384047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b5f56-9fa7-4bb3-ad68-68a2b0f5b625 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:41.384237 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3762/7553] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:41.384569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b5f56-9fa7-4bb3-ad68-68a2b0f5b625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:41.408772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8e9b5f56-9fa7-4bb3-ad68-68a2b0f5b625 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:41.410317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8e9b5f56-9fa7-4bb3-ad68-68a2b0f5b625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:41.477994 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3792/7554] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:41.492408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:41.494197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:41.508961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b22b41-b9f2-4adb-9b55-2b07cf38e8b7 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:41.570912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3032cb6-d595-432e-9fd0-046aef52bb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:41.571964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3032cb6-d595-432e-9fd0-046aef52bb4b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:41.572194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3032cb6-d595-432e-9fd0-046aef52bb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:41.572477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3032cb6-d595-432e-9fd0-046aef52bb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:41.583850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3032cb6-d595-432e-9fd0-046aef52bb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:41.585570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3032cb6-d595-432e-9fd0-046aef52bb4b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:41.599283 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3763/7555] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:41.749275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b5f56-9fa7-4bb3-ad68-68a2b0f5b625 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:41.750835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8e9b5f56-9fa7-4bb3-ad68-68a2b0f5b625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:41.766740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b5f56-9fa7-4bb3-ad68-68a2b0f5b625 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:41.773776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:41.774717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:41.775064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:41.775403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] PATH_INFO: `/v3/projects/57bb7fba052c4f5f85e78439076094af` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:41.776837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] RBAC: Authorizing `identity:delete_project(project_id=57bb7fba052c4f5f85e78439076094af)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:41.779075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:41.828416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57bb7fba052c4f5f85e78439076094af', 'request_id': 'req-f89323e7-5320-40fa-aea7-dc43cfb539af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.837349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57bb7fba052c4f5f85e78439076094af', 'request_id': 'req-f89323e7-5320-40fa-aea7-dc43cfb539af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.846465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57bb7fba052c4f5f85e78439076094af', 'request_id': 'req-f89323e7-5320-40fa-aea7-dc43cfb539af'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.877814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] The token cache is being invalidate because project 57bb7fba052c4f5f85e78439076094af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:41.878298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.881249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:41.883894 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3793/7556] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:41 2022] DELETE /identity/v3/projects/57bb7fba052c4f5f85e78439076094af => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:41.888077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3032cb6-d595-432e-9fd0-046aef52bb4b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:41.903242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3032cb6-d595-432e-9fd0-046aef52bb4b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:42.002680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:42.004330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:42.030219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:42.031212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:42.032542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:42.032542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] PATH_INFO: `/v3/users/3a80780b72d84af58a61add284f4c883` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:42.033885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a80780b72d84af58a61add284f4c883)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:42.036218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:42.092423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89323e7-5320-40fa-aea7-dc43cfb539af admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:42.097809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:42.099829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:42.100746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:42.100746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] PATH_INFO: `/v3/projects/1922967207fb4c17a20ee1aed55f8116` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:42.101978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1922967207fb4c17a20ee1aed55f8116)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:42.104001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:42.107637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a80780b72d84af58a61add284f4c883'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.116269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a80780b72d84af58a61add284f4c883'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.117109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a80780b72d84af58a61add284f4c883'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.118021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a80780b72d84af58a61add284f4c883'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.132136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a80780b72d84af58a61add284f4c883'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.146405 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3764/7557] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:41 2022] DELETE /identity/v3/users/3a80780b72d84af58a61add284f4c883 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:42.161293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1922967207fb4c17a20ee1aed55f8116', 'request_id': 'req-cb8031de-856f-45ef-b772-d01ae11402a5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.171400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1922967207fb4c17a20ee1aed55f8116', 'request_id': 'req-cb8031de-856f-45ef-b772-d01ae11402a5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.180868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1922967207fb4c17a20ee1aed55f8116', 'request_id': 'req-cb8031de-856f-45ef-b772-d01ae11402a5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.194461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] The token cache is being invalidate because project 1922967207fb4c17a20ee1aed55f8116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:42.194733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.195408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cb8031de-856f-45ef-b772-d01ae11402a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.196991 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3794/7558] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:42 2022] DELETE /identity/v3/projects/1922967207fb4c17a20ee1aed55f8116 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:42.486791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:42.489175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:42.572563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502676f8-d28d-46f2-869c-8c280d5b9a46 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:42.577192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:42.578058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:42.578337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:42.579201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] PATH_INFO: `/v3/projects/83c37d42cf154ffda6b7f0fb36b18be6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:42.580458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83c37d42cf154ffda6b7f0fb36b18be6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:42.582610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:42.637757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83c37d42cf154ffda6b7f0fb36b18be6', 'request_id': 'req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.645626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83c37d42cf154ffda6b7f0fb36b18be6', 'request_id': 'req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.651289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83c37d42cf154ffda6b7f0fb36b18be6', 'request_id': 'req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.662296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] The token cache is being invalidate because project 83c37d42cf154ffda6b7f0fb36b18be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:42.662585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.663259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-010a0ea0-43a3-4843-a762-4a98fe4a4cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:42.665089 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3765/7559] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:42 2022] DELETE /identity/v3/projects/83c37d42cf154ffda6b7f0fb36b18be6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:42.670080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2f5a8-58cb-4cc3-b0eb-04e179874993 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:42.671038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2f5a8-58cb-4cc3-b0eb-04e179874993 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:42.671038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef2f5a8-58cb-4cc3-b0eb-04e179874993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:42.692351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1ef2f5a8-58cb-4cc3-b0eb-04e179874993 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:42.693694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1ef2f5a8-58cb-4cc3-b0eb-04e179874993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:42.779375 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3795/7560] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:42.787849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110088-b023-4384-b557-2ccd97dd4c83 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:42.788165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110088-b023-4384-b557-2ccd97dd4c83 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:42.788446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110088-b023-4384-b557-2ccd97dd4c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:42.809558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ff110088-b023-4384-b557-2ccd97dd4c83 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:42.811265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ff110088-b023-4384-b557-2ccd97dd4c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:42.824533 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3766/7561] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:42.825617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2f5a8-58cb-4cc3-b0eb-04e179874993 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:42.836342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef2f5a8-58cb-4cc3-b0eb-04e179874993 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:42.841021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601a5f-d2d5-4e4f-b63a-6288b54e6c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:42.841725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601a5f-d2d5-4e4f-b63a-6288b54e6c33 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:42.842005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601a5f-d2d5-4e4f-b63a-6288b54e6c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:42.842294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72601a5f-d2d5-4e4f-b63a-6288b54e6c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:42.843123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72601a5f-d2d5-4e4f-b63a-6288b54e6c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:42.843481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72601a5f-d2d5-4e4f-b63a-6288b54e6c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:42.847633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72601a5f-d2d5-4e4f-b63a-6288b54e6c33 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:42.862349 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3796/7562] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:42.863559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff110088-b023-4384-b557-2ccd97dd4c83 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:42.873894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff110088-b023-4384-b557-2ccd97dd4c83 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:42.880949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886884-d771-4c5a-9c1c-1463db0adeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:42.881742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886884-d771-4c5a-9c1c-1463db0adeb7 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:42.881894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886884-d771-4c5a-9c1c-1463db0adeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:42.882168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b886884-d771-4c5a-9c1c-1463db0adeb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:42.883276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b886884-d771-4c5a-9c1c-1463db0adeb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:42.885254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b886884-d771-4c5a-9c1c-1463db0adeb7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:42.918502 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3767/7563] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:42 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:42.923951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601a5f-d2d5-4e4f-b63a-6288b54e6c33 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:42.937900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72601a5f-d2d5-4e4f-b63a-6288b54e6c33 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:42.988002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886884-d771-4c5a-9c1c-1463db0adeb7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:42.990215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1b886884-d771-4c5a-9c1c-1463db0adeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:43.006760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cd8c7-15f5-4a6b-8568-2dd696400c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.007427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd8c7-15f5-4a6b-8568-2dd696400c70 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.007709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd8c7-15f5-4a6b-8568-2dd696400c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.008011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd8c7-15f5-4a6b-8568-2dd696400c70 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.008694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cd8c7-15f5-4a6b-8568-2dd696400c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.010613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cd8c7-15f5-4a6b-8568-2dd696400c70 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.034254 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3797/7564] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:42 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:43.035303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cd8c7-15f5-4a6b-8568-2dd696400c70 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.048036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cd8c7-15f5-4a6b-8568-2dd696400c70 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.053095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f4009-ecf3-4db0-aebb-3842a33b571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.053755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f4009-ecf3-4db0-aebb-3842a33b571b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.054299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f4009-ecf3-4db0-aebb-3842a33b571b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.054580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f4009-ecf3-4db0-aebb-3842a33b571b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.055300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f4009-ecf3-4db0-aebb-3842a33b571b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.056961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f4009-ecf3-4db0-aebb-3842a33b571b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.068993 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3798/7565] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:43.073644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f4009-ecf3-4db0-aebb-3842a33b571b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.085365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b886884-d771-4c5a-9c1c-1463db0adeb7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.085708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f4009-ecf3-4db0-aebb-3842a33b571b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.089548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d9ddf-1eb4-46e1-845a-4b2d7bfd223b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.090196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d9ddf-1eb4-46e1-845a-4b2d7bfd223b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.090478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d9ddf-1eb4-46e1-845a-4b2d7bfd223b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.090754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d9ddf-1eb4-46e1-845a-4b2d7bfd223b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.091374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6496a4-a9ec-4658-8447-7ecd66c68c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.092194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6496a4-a9ec-4658-8447-7ecd66c68c6a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.092566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-884d9ddf-1eb4-46e1-845a-4b2d7bfd223b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:43.092686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6496a4-a9ec-4658-8447-7ecd66c68c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.093009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6496a4-a9ec-4658-8447-7ecd66c68c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.093817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6496a4-a9ec-4658-8447-7ecd66c68c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.095636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6496a4-a9ec-4658-8447-7ecd66c68c6a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.112664 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3799/7566] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:43.116581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6496a4-a9ec-4658-8447-7ecd66c68c6a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.127230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6496a4-a9ec-4658-8447-7ecd66c68c6a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.132325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ea6f9-3e75-41b0-9ace-999a9036f7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.133200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea6f9-3e75-41b0-9ace-999a9036f7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.133488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea6f9-3e75-41b0-9ace-999a9036f7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.133767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ea6f9-3e75-41b0-9ace-999a9036f7d3 admin admin] PATH_INFO: `/v3/projects/f5e30180d8764925bc3d2cd71eae548f/users/469518fd99444172b907617be25d5e42/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.149489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ea6f9-3e75-41b0-9ace-999a9036f7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e30180d8764925bc3d2cd71eae548f, user_id=469518fd99444172b907617be25d5e42, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.152461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644ea6f9-3e75-41b0-9ace-999a9036f7d3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.167392 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3800/7567] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:43 2022] PUT /identity/v3/projects/f5e30180d8764925bc3d2cd71eae548f/users/469518fd99444172b907617be25d5e42/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:43.172978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d9ddf-1eb4-46e1-845a-4b2d7bfd223b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.174673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d9ddf-1eb4-46e1-845a-4b2d7bfd223b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.179529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed5722-9e89-4fa2-88ca-db4b41881a37 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.179939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed5722-9e89-4fa2-88ca-db4b41881a37 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.180404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed5722-9e89-4fa2-88ca-db4b41881a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.198061 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3768/7568] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:43.213073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d8ed5722-9e89-4fa2-88ca-db4b41881a37 None None] MFA Rules not processed for user `469518fd99444172b907617be25d5e42`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:43.214288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d8ed5722-9e89-4fa2-88ca-db4b41881a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:43.289208 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3801/7569] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:43.293910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d9ddf-1eb4-46e1-845a-4b2d7bfd223b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.306595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d9ddf-1eb4-46e1-845a-4b2d7bfd223b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.370507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d1cb-83bc-468f-b98d-aba5d3e26d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.371401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d1cb-83bc-468f-b98d-aba5d3e26d02 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.371785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d1cb-83bc-468f-b98d-aba5d3e26d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.372204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870d1cb-83bc-468f-b98d-aba5d3e26d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.372998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d1cb-83bc-468f-b98d-aba5d3e26d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.375071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870d1cb-83bc-468f-b98d-aba5d3e26d02 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.403964 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3769/7570] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:43 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:43.405974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed5722-9e89-4fa2-88ca-db4b41881a37 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.417492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed5722-9e89-4fa2-88ca-db4b41881a37 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.478202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983fe2-d630-496c-b556-8e085edf7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.478917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983fe2-d630-496c-b556-8e085edf7333 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.479207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983fe2-d630-496c-b556-8e085edf7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.479483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5983fe2-d630-496c-b556-8e085edf7333 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.480211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5983fe2-d630-496c-b556-8e085edf7333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.482131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5983fe2-d630-496c-b556-8e085edf7333 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.502848 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3802/7571] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:43 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:43.507021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d1cb-83bc-468f-b98d-aba5d3e26d02 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.518215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870d1cb-83bc-468f-b98d-aba5d3e26d02 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.523149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5aa5a5-63fa-4cc5-9a56-d279d6d5764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.523801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aa5a5-63fa-4cc5-9a56-d279d6d5764d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.524114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aa5a5-63fa-4cc5-9a56-d279d6d5764d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.524392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5aa5a5-63fa-4cc5-9a56-d279d6d5764d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.525105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5aa5a5-63fa-4cc5-9a56-d279d6d5764d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.526710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5aa5a5-63fa-4cc5-9a56-d279d6d5764d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.538947 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3770/7572] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:43.543441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983fe2-d630-496c-b556-8e085edf7333 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.553810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5983fe2-d630-496c-b556-8e085edf7333 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.559282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00437e46-8914-4e20-9770-e5ce899bd321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.560199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00437e46-8914-4e20-9770-e5ce899bd321 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.560485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00437e46-8914-4e20-9770-e5ce899bd321 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.560779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00437e46-8914-4e20-9770-e5ce899bd321 admin admin] PATH_INFO: `/v3/projects/1602d2cbe0904660817ceebb99ca9916/users/be664844d30d4c8fa75efe726b4aedb8/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.575823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00437e46-8914-4e20-9770-e5ce899bd321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1602d2cbe0904660817ceebb99ca9916, user_id=be664844d30d4c8fa75efe726b4aedb8, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.579081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00437e46-8914-4e20-9770-e5ce899bd321 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.593053 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3803/7573] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:43 2022] PUT /identity/v3/projects/1602d2cbe0904660817ceebb99ca9916/users/be664844d30d4c8fa75efe726b4aedb8/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:43.598555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5aa5a5-63fa-4cc5-9a56-d279d6d5764d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.615481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5aa5a5-63fa-4cc5-9a56-d279d6d5764d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.680297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd652299-f575-4184-81c1-e55d9c1ce459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.681142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd652299-f575-4184-81c1-e55d9c1ce459 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.681518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd652299-f575-4184-81c1-e55d9c1ce459 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.681852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd652299-f575-4184-81c1-e55d9c1ce459 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.682774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd652299-f575-4184-81c1-e55d9c1ce459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.684617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd652299-f575-4184-81c1-e55d9c1ce459 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.697400 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3771/7574] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:43.701298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00437e46-8914-4e20-9770-e5ce899bd321 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.712982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00437e46-8914-4e20-9770-e5ce899bd321 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.717835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f8668-85f6-4381-9271-9a0e74621b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.718795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f8668-85f6-4381-9271-9a0e74621b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.719231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f8668-85f6-4381-9271-9a0e74621b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.720298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f8668-85f6-4381-9271-9a0e74621b13 admin admin] PATH_INFO: `/v3/projects/1602d2cbe0904660817ceebb99ca9916/users/be664844d30d4c8fa75efe726b4aedb8/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.722827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f8668-85f6-4381-9271-9a0e74621b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1602d2cbe0904660817ceebb99ca9916, user_id=be664844d30d4c8fa75efe726b4aedb8, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.725295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819f8668-85f6-4381-9271-9a0e74621b13 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.739409 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3804/7575] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:43 2022] PUT /identity/v3/projects/1602d2cbe0904660817ceebb99ca9916/users/be664844d30d4c8fa75efe726b4aedb8/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:43.750044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1466-eb65-49a6-8e74-11f6593cd1de None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.750374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1466-eb65-49a6-8e74-11f6593cd1de None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.750625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1466-eb65-49a6-8e74-11f6593cd1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.781299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-51fc1466-eb65-49a6-8e74-11f6593cd1de None None] MFA Rules not processed for user `be664844d30d4c8fa75efe726b4aedb8`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:43.783370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-51fc1466-eb65-49a6-8e74-11f6593cd1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:43.868712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3772/7576] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:43.870493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f8668-85f6-4381-9271-9a0e74621b13 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.884832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f8668-85f6-4381-9271-9a0e74621b13 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:43.889771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413f7cc-03cd-4d13-a5d2-ecc8780b6127 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:43.890434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f7cc-03cd-4d13-a5d2-ecc8780b6127 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:43.891069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f7cc-03cd-4d13-a5d2-ecc8780b6127 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:43.892145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413f7cc-03cd-4d13-a5d2-ecc8780b6127 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:43.893112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413f7cc-03cd-4d13-a5d2-ecc8780b6127 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:43.894966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413f7cc-03cd-4d13-a5d2-ecc8780b6127 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:43.928814 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3805/7577] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:43 2022] POST /identity/v3/projects => generated 360 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:43.933669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1466-eb65-49a6-8e74-11f6593cd1de None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:43.943528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1466-eb65-49a6-8e74-11f6593cd1de None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.024948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e02cb-ee12-4146-8fda-738c23d81289 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.025672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e02cb-ee12-4146-8fda-738c23d81289 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.025953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e02cb-ee12-4146-8fda-738c23d81289 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.026234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e02cb-ee12-4146-8fda-738c23d81289 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.027156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e02cb-ee12-4146-8fda-738c23d81289 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.028880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e02cb-ee12-4146-8fda-738c23d81289 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.054630 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3773/7578] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:43 2022] POST /identity/v3/users => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:44.059046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413f7cc-03cd-4d13-a5d2-ecc8780b6127 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.070449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413f7cc-03cd-4d13-a5d2-ecc8780b6127 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.076486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252f493-52dd-4588-9f4e-fe92e9c35357 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.077367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f493-52dd-4588-9f4e-fe92e9c35357 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.077656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f493-52dd-4588-9f4e-fe92e9c35357 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.077940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252f493-52dd-4588-9f4e-fe92e9c35357 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/1ca56b63b1de49ca8b356c0db79559ee` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.097519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252f493-52dd-4588-9f4e-fe92e9c35357 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:get_user(user_id=1ca56b63b1de49ca8b356c0db79559ee)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.099479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252f493-52dd-4588-9f4e-fe92e9c35357 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.101784 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3806/7579] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:15:44 2022] GET /identity/v3/users/1ca56b63b1de49ca8b356c0db79559ee => generated 371 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:44.106726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e02cb-ee12-4146-8fda-738c23d81289 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.120592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e02cb-ee12-4146-8fda-738c23d81289 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.128135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.129522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.129809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.130086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/1ca56b63b1de49ca8b356c0db79559ee` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.132228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1ca56b63b1de49ca8b356c0db79559ee)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.136427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.189913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca56b63b1de49ca8b356c0db79559ee'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.197031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca56b63b1de49ca8b356c0db79559ee'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.197939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca56b63b1de49ca8b356c0db79559ee'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.198716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca56b63b1de49ca8b356c0db79559ee'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.211050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca56b63b1de49ca8b356c0db79559ee'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.224380 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3774/7580] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:44 2022] DELETE /identity/v3/users/1ca56b63b1de49ca8b356c0db79559ee => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:44.228821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252f493-52dd-4588-9f4e-fe92e9c35357 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.232277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c252f493-52dd-4588-9f4e-fe92e9c35357 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:44.246119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252f493-52dd-4588-9f4e-fe92e9c35357 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.308655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.309815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.310349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.310664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects/3e38ba2afcb04e3f93751b0eceed9e48` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.311906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3e38ba2afcb04e3f93751b0eceed9e48)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.314652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.364726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e38ba2afcb04e3f93751b0eceed9e48', 'request_id': 'req-263acc13-cf71-4387-99ca-81e9c0434419'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.374654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e38ba2afcb04e3f93751b0eceed9e48', 'request_id': 'req-263acc13-cf71-4387-99ca-81e9c0434419'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.381798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e38ba2afcb04e3f93751b0eceed9e48', 'request_id': 'req-263acc13-cf71-4387-99ca-81e9c0434419'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.395750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] The token cache is being invalidate because project 3e38ba2afcb04e3f93751b0eceed9e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:44.396363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.397141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:44.398967 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3807/7581] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:44 2022] DELETE /identity/v3/projects/3e38ba2afcb04e3f93751b0eceed9e48 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:44.405123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.423498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05a45e-b1ec-448c-9aed-8e26069adcc1 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.491190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444f92-a077-4c6f-b20c-3bc7f1777e67 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.491998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444f92-a077-4c6f-b20c-3bc7f1777e67 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.492359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444f92-a077-4c6f-b20c-3bc7f1777e67 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.492856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f444f92-a077-4c6f-b20c-3bc7f1777e67 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.493598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444f92-a077-4c6f-b20c-3bc7f1777e67 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.495581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f444f92-a077-4c6f-b20c-3bc7f1777e67 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.529558 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3775/7582] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:44 2022] POST /identity/v3/projects => generated 359 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:44.534051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.535756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:44.555460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263acc13-cf71-4387-99ca-81e9c0434419 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.623418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c38034-cea1-4df2-aa46-8e793b18a34e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.624284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c38034-cea1-4df2-aa46-8e793b18a34e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.624636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c38034-cea1-4df2-aa46-8e793b18a34e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.625077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c38034-cea1-4df2-aa46-8e793b18a34e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.626500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c38034-cea1-4df2-aa46-8e793b18a34e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.628555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c38034-cea1-4df2-aa46-8e793b18a34e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.654001 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3808/7583] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:44 2022] POST /identity/v3/users => generated 414 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:44.659039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444f92-a077-4c6f-b20c-3bc7f1777e67 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.669849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f444f92-a077-4c6f-b20c-3bc7f1777e67 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.675139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb6088-6e45-40cf-97f9-65632ce2ec6a tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.675857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb6088-6e45-40cf-97f9-65632ce2ec6a tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.676189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb6088-6e45-40cf-97f9-65632ce2ec6a tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.676473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb6088-6e45-40cf-97f9-65632ce2ec6a tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.677219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb6088-6e45-40cf-97f9-65632ce2ec6a tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.679265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb6088-6e45-40cf-97f9-65632ce2ec6a tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.697879 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3776/7584] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:15:44 2022] POST /identity/v3/roles => generated 240 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:44.699345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c38034-cea1-4df2-aa46-8e793b18a34e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.710130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c38034-cea1-4df2-aa46-8e793b18a34e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.715262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33066c-eb30-4f95-9493-16b1c75a07cc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.716299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33066c-eb30-4f95-9493-16b1c75a07cc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.716634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33066c-eb30-4f95-9493-16b1c75a07cc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.716920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33066c-eb30-4f95-9493-16b1c75a07cc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/d8100d4c12774d069385e75ada6ffe0a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.731866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33066c-eb30-4f95-9493-16b1c75a07cc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:get_user(user_id=d8100d4c12774d069385e75ada6ffe0a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.734334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33066c-eb30-4f95-9493-16b1c75a07cc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.740227 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3809/7585] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:15:44 2022] GET /identity/v3/users/d8100d4c12774d069385e75ada6ffe0a => generated 414 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:44.741753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb6088-6e45-40cf-97f9-65632ce2ec6a tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.752548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb6088-6e45-40cf-97f9-65632ce2ec6a tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.757759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01cb2a-7ae9-40b7-ad51-6bd87dead433 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.758747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01cb2a-7ae9-40b7-ad51-6bd87dead433 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.759445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01cb2a-7ae9-40b7-ad51-6bd87dead433 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.759445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01cb2a-7ae9-40b7-ad51-6bd87dead433 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/roles/12470eddc7a04a069bfade8f2a135206` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.761165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01cb2a-7ae9-40b7-ad51-6bd87dead433 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:get_role(role_id=12470eddc7a04a069bfade8f2a135206)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.762417 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-4d01cb2a-7ae9-40b7-ad51-6bd87dead433 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:15:44.762417 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:15:44.762417 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:15:44.763397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01cb2a-7ae9-40b7-ad51-6bd87dead433 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.766405 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3777/7586] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:15:44 2022] GET /identity/v3/roles/12470eddc7a04a069bfade8f2a135206 => generated 240 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:44.769130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33066c-eb30-4f95-9493-16b1c75a07cc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.780302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33066c-eb30-4f95-9493-16b1c75a07cc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.790378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05468a-a936-4898-b149-b4e35488d202 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.791044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05468a-a936-4898-b149-b4e35488d202 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.791369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05468a-a936-4898-b149-b4e35488d202 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.791606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05468a-a936-4898-b149-b4e35488d202 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.792345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05468a-a936-4898-b149-b4e35488d202 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.794401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05468a-a936-4898-b149-b4e35488d202 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.836517 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3810/7587] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:44 2022] POST /identity/v3/projects => generated 360 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:44.840525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01cb2a-7ae9-40b7-ad51-6bd87dead433 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.852072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01cb2a-7ae9-40b7-ad51-6bd87dead433 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.915327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054f076-76aa-4adc-877b-8c3a74f37c90 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.916836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054f076-76aa-4adc-877b-8c3a74f37c90 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.917199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054f076-76aa-4adc-877b-8c3a74f37c90 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.917490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054f076-76aa-4adc-877b-8c3a74f37c90 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects/75da493088e747029eb5e804fd1aea82` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.918773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054f076-76aa-4adc-877b-8c3a74f37c90 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:get_project(project_id=75da493088e747029eb5e804fd1aea82)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.920939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054f076-76aa-4adc-877b-8c3a74f37c90 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.923600 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3778/7588] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:44 2022] GET /identity/v3/projects/75da493088e747029eb5e804fd1aea82 => generated 360 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:44.928156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05468a-a936-4898-b149-b4e35488d202 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.944961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05468a-a936-4898-b149-b4e35488d202 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:44.950583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84234cf4-239d-4380-803e-e12eb21ed4b9 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:44.951616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84234cf4-239d-4380-803e-e12eb21ed4b9 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:44.951906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84234cf4-239d-4380-803e-e12eb21ed4b9 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:44.952220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84234cf4-239d-4380-803e-e12eb21ed4b9 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects/75da493088e747029eb5e804fd1aea82/users/d8100d4c12774d069385e75ada6ffe0a/roles/12470eddc7a04a069bfade8f2a135206` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:44.954753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84234cf4-239d-4380-803e-e12eb21ed4b9 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_grant(project_id=75da493088e747029eb5e804fd1aea82, user_id=d8100d4c12774d069385e75ada6ffe0a, role_id=12470eddc7a04a069bfade8f2a135206)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:44.957951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84234cf4-239d-4380-803e-e12eb21ed4b9 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:44.975238 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3811/7589] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:44 2022] PUT /identity/v3/projects/75da493088e747029eb5e804fd1aea82/users/d8100d4c12774d069385e75ada6ffe0a/roles/12470eddc7a04a069bfade8f2a135206 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:44.979726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054f076-76aa-4adc-877b-8c3a74f37c90 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:44.991996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054f076-76aa-4adc-877b-8c3a74f37c90 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:45.059903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01fcf7-92a5-493e-8605-1493d23c049d tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:45.060616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01fcf7-92a5-493e-8605-1493d23c049d tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:45.060943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01fcf7-92a5-493e-8605-1493d23c049d tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:45.061175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01fcf7-92a5-493e-8605-1493d23c049d tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:45.061868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01fcf7-92a5-493e-8605-1493d23c049d tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:45.064394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01fcf7-92a5-493e-8605-1493d23c049d tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:45.102002 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3779/7590] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:44 2022] POST /identity/v3/projects => generated 359 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:45.106016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84234cf4-239d-4380-803e-e12eb21ed4b9 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:45.117027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84234cf4-239d-4380-803e-e12eb21ed4b9 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:45.184930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac4b6c-8187-414d-8e86-4b3f4fccaf4c tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:45.185892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac4b6c-8187-414d-8e86-4b3f4fccaf4c tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:45.186255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac4b6c-8187-414d-8e86-4b3f4fccaf4c tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:45.186620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac4b6c-8187-414d-8e86-4b3f4fccaf4c tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects/434eb4c3c9eb4f1aa7ea8211c9a1e903` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:45.188543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac4b6c-8187-414d-8e86-4b3f4fccaf4c tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:get_project(project_id=434eb4c3c9eb4f1aa7ea8211c9a1e903)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:45.190861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac4b6c-8187-414d-8e86-4b3f4fccaf4c tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:45.195734 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3812/7591] 10.222.0.16 () {58 vars in 1229 bytes} [Sat Mar 26 21:15:45 2022] GET /identity/v3/projects/434eb4c3c9eb4f1aa7ea8211c9a1e903 => generated 359 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:45.197244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01fcf7-92a5-493e-8605-1493d23c049d tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:45.208703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01fcf7-92a5-493e-8605-1493d23c049d tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:45.214658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e51a50-d674-4d16-9c28-5c7e6328bd28 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:45.215586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51a50-d674-4d16-9c28-5c7e6328bd28 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:45.215873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51a50-d674-4d16-9c28-5c7e6328bd28 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:45.216199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51a50-d674-4d16-9c28-5c7e6328bd28 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects/434eb4c3c9eb4f1aa7ea8211c9a1e903/users/d8100d4c12774d069385e75ada6ffe0a/roles/12470eddc7a04a069bfade8f2a135206` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:45.218555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51a50-d674-4d16-9c28-5c7e6328bd28 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_grant(project_id=434eb4c3c9eb4f1aa7ea8211c9a1e903, user_id=d8100d4c12774d069385e75ada6ffe0a, role_id=12470eddc7a04a069bfade8f2a135206)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:45.221561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51a50-d674-4d16-9c28-5c7e6328bd28 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:45.242617 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3780/7592] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:45 2022] PUT /identity/v3/projects/434eb4c3c9eb4f1aa7ea8211c9a1e903/users/d8100d4c12774d069385e75ada6ffe0a/roles/12470eddc7a04a069bfade8f2a135206 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:45.246779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac4b6c-8187-414d-8e86-4b3f4fccaf4c tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:45.259257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac4b6c-8187-414d-8e86-4b3f4fccaf4c tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:45.343231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447275b-7d79-48dc-be92-bacad124a94b tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:45.344335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447275b-7d79-48dc-be92-bacad124a94b tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:45.344688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447275b-7d79-48dc-be92-bacad124a94b tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:45.345031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447275b-7d79-48dc-be92-bacad124a94b tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/d8100d4c12774d069385e75ada6ffe0a/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:45.346543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447275b-7d79-48dc-be92-bacad124a94b tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=d8100d4c12774d069385e75ada6ffe0a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:45.350239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447275b-7d79-48dc-be92-bacad124a94b tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:45.399451 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3813/7593] 10.222.0.16 () {58 vars in 1247 bytes} [Sat Mar 26 21:15:45 2022] GET /identity/v3/users/d8100d4c12774d069385e75ada6ffe0a/projects => generated 843 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:45.404205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e51a50-d674-4d16-9c28-5c7e6328bd28 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:45.417319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e51a50-d674-4d16-9c28-5c7e6328bd28 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:45.426239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:45.427519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:45.428189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:45.428661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects/434eb4c3c9eb4f1aa7ea8211c9a1e903` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:45.430461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_project(project_id=434eb4c3c9eb4f1aa7ea8211c9a1e903)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:45.432627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:45.492397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '434eb4c3c9eb4f1aa7ea8211c9a1e903', 'request_id': 'req-5d80715d-7331-4ee1-beb2-afd6d438f94f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.501638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '434eb4c3c9eb4f1aa7ea8211c9a1e903', 'request_id': 'req-5d80715d-7331-4ee1-beb2-afd6d438f94f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.507098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '434eb4c3c9eb4f1aa7ea8211c9a1e903', 'request_id': 'req-5d80715d-7331-4ee1-beb2-afd6d438f94f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.519095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] The token cache is being invalidate because project 434eb4c3c9eb4f1aa7ea8211c9a1e903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:45.519386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.520191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.522095 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3781/7594] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:45 2022] DELETE /identity/v3/projects/434eb4c3c9eb4f1aa7ea8211c9a1e903 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:45.526173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447275b-7d79-48dc-be92-bacad124a94b tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:45.528492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8447275b-7d79-48dc-be92-bacad124a94b tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:45.546990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447275b-7d79-48dc-be92-bacad124a94b tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:45.618877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:45.618877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:45.619290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:45.619659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects/75da493088e747029eb5e804fd1aea82` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:45.621347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_project(project_id=75da493088e747029eb5e804fd1aea82)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:45.623397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:45.681165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75da493088e747029eb5e804fd1aea82', 'request_id': 'req-32afdbf5-57de-4bca-9c64-e02bd46745ab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.689599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75da493088e747029eb5e804fd1aea82', 'request_id': 'req-32afdbf5-57de-4bca-9c64-e02bd46745ab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.704467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75da493088e747029eb5e804fd1aea82', 'request_id': 'req-32afdbf5-57de-4bca-9c64-e02bd46745ab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.716876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] The token cache is being invalidate because project 75da493088e747029eb5e804fd1aea82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:45.717421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.718262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.720507 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3814/7595] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:45 2022] DELETE /identity/v3/projects/75da493088e747029eb5e804fd1aea82 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:45.724768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:45.737350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d80715d-7331-4ee1-beb2-afd6d438f94f tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:45.816957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:45.818396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:45.818396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:45.818396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/roles/12470eddc7a04a069bfade8f2a135206` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:45.819984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_role(role_id=12470eddc7a04a069bfade8f2a135206)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:45.821716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:45.877150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invalidating the token cache because role 12470eddc7a04a069bfade8f2a135206 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:45.877932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.878932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:45.882509 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3782/7596] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:45 2022] DELETE /identity/v3/roles/12470eddc7a04a069bfade8f2a135206 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:45.885638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:45.887152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:45.902070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afdbf5-57de-4bca-9c64-e02bd46745ab tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:45.985525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:45.987784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:45.988569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:45.989043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/d8100d4c12774d069385e75ada6ffe0a` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:45.991314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d8100d4c12774d069385e75ada6ffe0a)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:45.994911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:46.077966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8100d4c12774d069385e75ada6ffe0a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.088131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8100d4c12774d069385e75ada6ffe0a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.089321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8100d4c12774d069385e75ada6ffe0a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.090212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8100d4c12774d069385e75ada6ffe0a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.104856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8100d4c12774d069385e75ada6ffe0a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.162617 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3815/7597] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:45 2022] DELETE /identity/v3/users/d8100d4c12774d069385e75ada6ffe0a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:46.167263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:46.169452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:46.188995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33f344-4d16-4786-bec5-e680b01d0118 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:46.256529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:46.257491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:46.257780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:46.258054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects/7874016c460244a0b55f3dc684ef5310` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:46.259357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7874016c460244a0b55f3dc684ef5310)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:46.261414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:46.312557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7874016c460244a0b55f3dc684ef5310', 'request_id': 'req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.321991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7874016c460244a0b55f3dc684ef5310', 'request_id': 'req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.329138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7874016c460244a0b55f3dc684ef5310', 'request_id': 'req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.341401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] The token cache is being invalidate because project 7874016c460244a0b55f3dc684ef5310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:46.341698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.342379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1e931d1c-c6ea-4e8f-b1e6-b6ae80c74e36 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.344494 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3783/7598] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:46 2022] DELETE /identity/v3/projects/7874016c460244a0b55f3dc684ef5310 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:46.350347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:46.351856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:46.366814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ecb9b-647e-44f4-a340-9471e1b70cb4 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:46.439806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:46.441003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:46.441393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:46.441763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/469518fd99444172b907617be25d5e42` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:46.443359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:update_user(user_id=469518fd99444172b907617be25d5e42)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:46.446310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:46.488858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '469518fd99444172b907617be25d5e42'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.500692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invalidating the token cache because user 469518fd99444172b907617be25d5e42 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:46.500943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.501783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.507627 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3816/7599] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Mar 26 21:15:46 2022] PATCH /identity/v3/users/469518fd99444172b907617be25d5e42 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:46.509599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5670986-9b9d-4e49-be34-9edaf5d43d67 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:46.509899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5670986-9b9d-4e49-be34-9edaf5d43d67 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:46.510183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5670986-9b9d-4e49-be34-9edaf5d43d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:46.542857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b5670986-9b9d-4e49-be34-9edaf5d43d67 None None] MFA Rules not processed for user `469518fd99444172b907617be25d5e42`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:46.544221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b5670986-9b9d-4e49-be34-9edaf5d43d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:46.551013 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3784/7600] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:46 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:15:46.552712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:46.554782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:46.570982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f8d97-f611-4e54-b7fc-448fa7d9a5e5 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:46.577046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:46.577939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:46.578258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:46.579159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/469518fd99444172b907617be25d5e42` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:46.580680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:update_user(user_id=469518fd99444172b907617be25d5e42)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:46.583028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:46.621634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '469518fd99444172b907617be25d5e42'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.634184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invalidating the token cache because user 469518fd99444172b907617be25d5e42 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:46.634626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.635354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3c461af4-fc20-4f67-8470-258906a9e3ea tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.638184 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3817/7601] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Mar 26 21:15:46 2022] PATCH /identity/v3/users/469518fd99444172b907617be25d5e42 => generated 297 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:46.642505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5670986-9b9d-4e49-be34-9edaf5d43d67 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:46.656108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5670986-9b9d-4e49-be34-9edaf5d43d67 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:46.661374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:46.662238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:46.662528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:46.662811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/469518fd99444172b907617be25d5e42` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:46.677509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:update_user(user_id=469518fd99444172b907617be25d5e42)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:46.678634 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:15:46.678634 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:15:46.678634 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:15:46.680184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:46.714624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '469518fd99444172b907617be25d5e42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.723536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invalidating the token cache because user 469518fd99444172b907617be25d5e42 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:46.724006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.724613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.726870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3785/7602] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Mar 26 21:15:46 2022] PATCH /identity/v3/users/469518fd99444172b907617be25d5e42 => generated 297 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:46.731191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff7c92-880c-4991-9cdc-2057053f7735 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:46.731479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff7c92-880c-4991-9cdc-2057053f7735 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:46.731756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff7c92-880c-4991-9cdc-2057053f7735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:46.763121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-96ff7c92-880c-4991-9cdc-2057053f7735 None None] MFA Rules not processed for user `469518fd99444172b907617be25d5e42`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:46.764274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-96ff7c92-880c-4991-9cdc-2057053f7735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:46.768215 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3818/7603] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:46 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:15:46.772203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:46.773703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:46.787330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a83bc-e8d8-4872-b03f-953cbbbbadff tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:46.792308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:46.793307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:46.793712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:46.793997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/469518fd99444172b907617be25d5e42` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:46.795281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:update_user(user_id=469518fd99444172b907617be25d5e42)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:46.797300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:46.831959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '469518fd99444172b907617be25d5e42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.839997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invalidating the token cache because user 469518fd99444172b907617be25d5e42 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:46.840291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.840930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.847149 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3786/7604] 10.222.0.16 () {60 vars in 1242 bytes} [Sat Mar 26 21:15:46 2022] PATCH /identity/v3/users/469518fd99444172b907617be25d5e42 => generated 297 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:46.848323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff7c92-880c-4991-9cdc-2057053f7735 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:46.860385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff7c92-880c-4991-9cdc-2057053f7735 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:46.865588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa064fe3-c13e-4924-aecb-caafd2610380 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:46.866258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064fe3-c13e-4924-aecb-caafd2610380 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:46.866545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064fe3-c13e-4924-aecb-caafd2610380 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:46.866825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa064fe3-c13e-4924-aecb-caafd2610380 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:46.867506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064fe3-c13e-4924-aecb-caafd2610380 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:46.869411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa064fe3-c13e-4924-aecb-caafd2610380 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:46.896426 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3819/7605] 10.222.0.16 () {60 vars in 1142 bytes} [Sat Mar 26 21:15:46 2022] POST /identity/v3/users => generated 264 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:46.900828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:46.902338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:46.917117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f87539-4431-460d-9b62-cb95437711cb tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:46.923137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58f1e-e0ef-42b2-8a29-7463e4339208 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:46.924026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58f1e-e0ef-42b2-8a29-7463e4339208 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:46.924310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58f1e-e0ef-42b2-8a29-7463e4339208 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:46.924586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f58f1e-e0ef-42b2-8a29-7463e4339208 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/5f5c9ae38dc746a8bd8deafd5783034c/password` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:46.989801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d1f58f1e-e0ef-42b2-8a29-7463e4339208 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '5f5c9ae38dc746a8bd8deafd5783034c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:46.997624 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3787/7606] 10.222.0.16 () {60 vars in 1268 bytes} [Sat Mar 26 21:15:46 2022] POST /identity/v3/users/5f5c9ae38dc746a8bd8deafd5783034c/password => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:48.003333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc71a8-f5de-4833-9775-a62355db1b49 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.003882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc71a8-f5de-4833-9775-a62355db1b49 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.003882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc71a8-f5de-4833-9775-a62355db1b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.026609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-74bc71a8-f5de-4833-9775-a62355db1b49 None None] MFA Rules not processed for user `5f5c9ae38dc746a8bd8deafd5783034c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:48.028118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-74bc71a8-f5de-4833-9775-a62355db1b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:48.031385 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3820/7607] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:48 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 26 21:15:48.036472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58f1e-e0ef-42b2-8a29-7463e4339208 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:48.049000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f58f1e-e0ef-42b2-8a29-7463e4339208 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:48.054217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af33b9-f055-4b70-b1ac-674e2e5a97ed tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:48.055085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af33b9-f055-4b70-b1ac-674e2e5a97ed tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.055448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af33b9-f055-4b70-b1ac-674e2e5a97ed tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.055807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af33b9-f055-4b70-b1ac-674e2e5a97ed tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.062710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af33b9-f055-4b70-b1ac-674e2e5a97ed tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:48.065082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af33b9-f055-4b70-b1ac-674e2e5a97ed tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:48.074834 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3788/7608] 10.222.0.16 () {56 vars in 1262 bytes} [Sat Mar 26 21:15:48 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 26 21:15:48.076008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc71a8-f5de-4833-9775-a62355db1b49 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:48.088988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc71a8-f5de-4833-9775-a62355db1b49 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:48.095617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:48.096513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.096803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.097118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/5f5c9ae38dc746a8bd8deafd5783034c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.098541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5f5c9ae38dc746a8bd8deafd5783034c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:48.100705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:48.145491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5c9ae38dc746a8bd8deafd5783034c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.152876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5c9ae38dc746a8bd8deafd5783034c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.153735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5c9ae38dc746a8bd8deafd5783034c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.154353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5c9ae38dc746a8bd8deafd5783034c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.162042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5c9ae38dc746a8bd8deafd5783034c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.181186 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3821/7609] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:48 2022] DELETE /identity/v3/users/5f5c9ae38dc746a8bd8deafd5783034c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:48.186686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af33b9-f055-4b70-b1ac-674e2e5a97ed tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:48.197451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af33b9-f055-4b70-b1ac-674e2e5a97ed tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:48.258784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36c99d-df2d-4d5c-95ac-b060dd609300 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:48.259520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c99d-df2d-4d5c-95ac-b060dd609300 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.259813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c99d-df2d-4d5c-95ac-b060dd609300 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.260157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36c99d-df2d-4d5c-95ac-b060dd609300 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.260925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36c99d-df2d-4d5c-95ac-b060dd609300 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:48.262857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36c99d-df2d-4d5c-95ac-b060dd609300 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:48.289620 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3789/7610] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:48 2022] POST /identity/v3/users => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:48.293916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:48.295554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:48.309976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42525d26-81ca-47fa-af5d-d078f33dd687 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:48.315230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43694f71-6af7-4212-afb6-894322d1e018 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:48.315995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43694f71-6af7-4212-afb6-894322d1e018 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.316284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43694f71-6af7-4212-afb6-894322d1e018 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.316572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43694f71-6af7-4212-afb6-894322d1e018 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.317237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43694f71-6af7-4212-afb6-894322d1e018 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:48.319151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43694f71-6af7-4212-afb6-894322d1e018 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:48.350205 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3822/7611] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:48 2022] POST /identity/v3/projects => generated 360 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:48.354460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36c99d-df2d-4d5c-95ac-b060dd609300 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:48.364952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36c99d-df2d-4d5c-95ac-b060dd609300 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:48.424546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e69c0-b6c6-44fa-9849-2348dbaf42cd tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:48.425429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e69c0-b6c6-44fa-9849-2348dbaf42cd tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.425720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e69c0-b6c6-44fa-9849-2348dbaf42cd tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.426004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e69c0-b6c6-44fa-9849-2348dbaf42cd tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/7b7d769ce4be4654b781cd97fc5fdee2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.440997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e69c0-b6c6-44fa-9849-2348dbaf42cd tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:update_user(user_id=7b7d769ce4be4654b781cd97fc5fdee2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:48.443197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e69c0-b6c6-44fa-9849-2348dbaf42cd tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:48.477654 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3790/7612] 10.222.0.16 () {60 vars in 1243 bytes} [Sat Mar 26 21:15:48 2022] PATCH /identity/v3/users/7b7d769ce4be4654b781cd97fc5fdee2 => generated 524 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:48.479816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43694f71-6af7-4212-afb6-894322d1e018 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:48.491569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43694f71-6af7-4212-afb6-894322d1e018 tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:48.497152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf03a-535e-4903-9359-9edd7e6cf35e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:48.498344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf03a-535e-4903-9359-9edd7e6cf35e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.498344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf03a-535e-4903-9359-9edd7e6cf35e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.498607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bf03a-535e-4903-9359-9edd7e6cf35e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/7b7d769ce4be4654b781cd97fc5fdee2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.514083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bf03a-535e-4903-9359-9edd7e6cf35e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:get_user(user_id=7b7d769ce4be4654b781cd97fc5fdee2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:48.517022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957bf03a-535e-4903-9359-9edd7e6cf35e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:48.518744 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3823/7613] 10.222.0.16 () {58 vars in 1220 bytes} [Sat Mar 26 21:15:48 2022] GET /identity/v3/users/7b7d769ce4be4654b781cd97fc5fdee2 => generated 390 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:48.522841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e69c0-b6c6-44fa-9849-2348dbaf42cd tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:48.532926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e69c0-b6c6-44fa-9849-2348dbaf42cd tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:48.537599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:48.538459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.538750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.539032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/projects/7ef832eae3fa4553a5fa4b8a9931069c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.540332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ef832eae3fa4553a5fa4b8a9931069c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:48.542194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:48.589682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef832eae3fa4553a5fa4b8a9931069c', 'request_id': 'req-30413296-574a-433a-8f34-efe57d73f3ba'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.598761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef832eae3fa4553a5fa4b8a9931069c', 'request_id': 'req-30413296-574a-433a-8f34-efe57d73f3ba'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.604137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef832eae3fa4553a5fa4b8a9931069c', 'request_id': 'req-30413296-574a-433a-8f34-efe57d73f3ba'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.615969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] The token cache is being invalidate because project 7ef832eae3fa4553a5fa4b8a9931069c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:48.616264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.617030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.618675 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3791/7614] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:48 2022] DELETE /identity/v3/projects/7ef832eae3fa4553a5fa4b8a9931069c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:48.622855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf03a-535e-4903-9359-9edd7e6cf35e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:48.624788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-957bf03a-535e-4903-9359-9edd7e6cf35e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:48.639169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bf03a-535e-4903-9359-9edd7e6cf35e tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:48.696741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be664844d30d4c8fa75efe726b4aedb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1602d2cbe0904660817ceebb99ca9916', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:48.697612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.697901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.698179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] PATH_INFO: `/v3/users/7b7d769ce4be4654b781cd97fc5fdee2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.699416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7b7d769ce4be4654b781cd97fc5fdee2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:48.701472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:48.745988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7d769ce4be4654b781cd97fc5fdee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.753323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7d769ce4be4654b781cd97fc5fdee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.754113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7d769ce4be4654b781cd97fc5fdee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.754870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7d769ce4be4654b781cd97fc5fdee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.761760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-69f6c274-2e60-411e-becd-3366fcc99dbc tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7d769ce4be4654b781cd97fc5fdee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.780327 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3824/7615] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:48 2022] DELETE /identity/v3/users/7b7d769ce4be4654b781cd97fc5fdee2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:48.785332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:48.787392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:48.856967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30413296-574a-433a-8f34-efe57d73f3ba tempest-UsersV3TestJSON-1137894854 tempest-UsersV3TestJSON-1137894854-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:48.914851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:48.915757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:48.916081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:48.916493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] PATH_INFO: `/v3/users/469518fd99444172b907617be25d5e42` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:48.931471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] RBAC: Authorizing `identity:delete_user(user_id=469518fd99444172b907617be25d5e42)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:48.933480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:48.989223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469518fd99444172b907617be25d5e42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.996903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469518fd99444172b907617be25d5e42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.997532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469518fd99444172b907617be25d5e42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:48.998136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469518fd99444172b907617be25d5e42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.012162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469518fd99444172b907617be25d5e42'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.024529 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3792/7616] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:48 2022] DELETE /identity/v3/users/469518fd99444172b907617be25d5e42 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:49.029495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f9b49-1509-4222-9cda-9736bd90b90a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:49.029984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f9b49-1509-4222-9cda-9736bd90b90a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:49.030119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f9b49-1509-4222-9cda-9736bd90b90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:49.050390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-799f9b49-1509-4222-9cda-9736bd90b90a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:49.051541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-799f9b49-1509-4222-9cda-9736bd90b90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:49.112268 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3825/7617] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:49.122467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:49.124458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:49.184911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0ed49-62e2-4301-a043-fb929141652b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:49.189082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c4c1a-dba7-4360-97d0-c528a6124b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:49.189749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c4c1a-dba7-4360-97d0-c528a6124b41 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:49.190033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c4c1a-dba7-4360-97d0-c528a6124b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:49.190350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c4c1a-dba7-4360-97d0-c528a6124b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:49.199556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c4c1a-dba7-4360-97d0-c528a6124b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:49.201051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c4c1a-dba7-4360-97d0-c528a6124b41 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:49.210602 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3793/7618] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:49.413705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f9b49-1509-4222-9cda-9736bd90b90a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:49.414860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-799f9b49-1509-4222-9cda-9736bd90b90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:49.427293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f9b49-1509-4222-9cda-9736bd90b90a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:49.432390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:49.433254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:49.433547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:49.433864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] PATH_INFO: `/v3/users/16be1b08924a44a4a0a4c283a7f6dc83` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:49.435057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] RBAC: Authorizing `identity:delete_user(user_id=16be1b08924a44a4a0a4c283a7f6dc83)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:49.437032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:49.486263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16be1b08924a44a4a0a4c283a7f6dc83'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.488408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c4c1a-dba7-4360-97d0-c528a6124b41 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:49.489934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b77c4c1a-dba7-4360-97d0-c528a6124b41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:49.493861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16be1b08924a44a4a0a4c283a7f6dc83'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.494686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16be1b08924a44a4a0a4c283a7f6dc83'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.495354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16be1b08924a44a4a0a4c283a7f6dc83'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.504931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-77d3253f-5b93-4549-bcc2-51756f3d702a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16be1b08924a44a4a0a4c283a7f6dc83'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.507633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c4c1a-dba7-4360-97d0-c528a6124b41 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:49.520531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:49.521410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:49.521698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:49.522004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] PATH_INFO: `/v3/projects/f5e30180d8764925bc3d2cd71eae548f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:49.523214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e30180d8764925bc3d2cd71eae548f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:49.525193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:49.525335 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3826/7619] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:49 2022] DELETE /identity/v3/users/16be1b08924a44a4a0a4c283a7f6dc83 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:49.529522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351948-2b1b-44b5-a48d-a563542de510 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:49.529817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351948-2b1b-44b5-a48d-a563542de510 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:49.530102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82351948-2b1b-44b5-a48d-a563542de510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:49.547776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-82351948-2b1b-44b5-a48d-a563542de510 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:49.549412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82351948-2b1b-44b5-a48d-a563542de510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:49.573480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e30180d8764925bc3d2cd71eae548f', 'request_id': 'req-11ce0397-c15f-45d2-8dfa-46b1d0961a55'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.581944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e30180d8764925bc3d2cd71eae548f', 'request_id': 'req-11ce0397-c15f-45d2-8dfa-46b1d0961a55'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.587802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e30180d8764925bc3d2cd71eae548f', 'request_id': 'req-11ce0397-c15f-45d2-8dfa-46b1d0961a55'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.600347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] The token cache is being invalidate because project f5e30180d8764925bc3d2cd71eae548f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:49.600949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.601639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.604090 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3794/7620] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:49 2022] DELETE /identity/v3/projects/f5e30180d8764925bc3d2cd71eae548f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:49.607802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:49.609276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:49.611957 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3827/7621] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:49.622504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82351948-2b1b-44b5-a48d-a563542de510 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:49.623999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82351948-2b1b-44b5-a48d-a563542de510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:49.676591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce0397-c15f-45d2-8dfa-46b1d0961a55 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:49.681832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:49.682687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:49.682967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:49.683245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] PATH_INFO: `/v3/users/be664844d30d4c8fa75efe726b4aedb8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:49.684468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be664844d30d4c8fa75efe726b4aedb8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:49.684623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82351948-2b1b-44b5-a48d-a563542de510 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:49.686410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:49.733342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be664844d30d4c8fa75efe726b4aedb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.736652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d92878-1c8d-40e6-be5f-43f9e9f906b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:49.737383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d92878-1c8d-40e6-be5f-43f9e9f906b1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:49.737658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d92878-1c8d-40e6-be5f-43f9e9f906b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:49.737943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d92878-1c8d-40e6-be5f-43f9e9f906b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:49.741411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be664844d30d4c8fa75efe726b4aedb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.742594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be664844d30d4c8fa75efe726b4aedb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.743234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be664844d30d4c8fa75efe726b4aedb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.747337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d92878-1c8d-40e6-be5f-43f9e9f906b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:49.748836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d92878-1c8d-40e6-be5f-43f9e9f906b1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:49.755395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be664844d30d4c8fa75efe726b4aedb8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:49.758399 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3828/7622] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:49.767982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3795/7623] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:49 2022] DELETE /identity/v3/users/be664844d30d4c8fa75efe726b4aedb8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:49.958869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d92878-1c8d-40e6-be5f-43f9e9f906b1 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:49.960357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-15d92878-1c8d-40e6-be5f-43f9e9f906b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:49.985846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d92878-1c8d-40e6-be5f-43f9e9f906b1 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.048808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.050757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.051160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.051637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] PATH_INFO: `/v3/projects/94e253be6580437488b462210584566d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.052926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94e253be6580437488b462210584566d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.055454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.076980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.079192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:50.097314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00bad2-f79f-4216-8f66-a37446d83b70 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.111199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94e253be6580437488b462210584566d', 'request_id': 'req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.118603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94e253be6580437488b462210584566d', 'request_id': 'req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.124157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94e253be6580437488b462210584566d', 'request_id': 'req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.135411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] The token cache is being invalidate because project 94e253be6580437488b462210584566d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:50.135707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.136384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e3a5c4dc-69b1-4336-8b22-a57f1f6fea66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.137930 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3829/7624] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:49 2022] DELETE /identity/v3/projects/94e253be6580437488b462210584566d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:50.143588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca0a50-88d0-439e-8bd5-35258d681ea9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.143879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca0a50-88d0-439e-8bd5-35258d681ea9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.144660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca0a50-88d0-439e-8bd5-35258d681ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.159268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.160264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.160553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.160855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] PATH_INFO: `/v3/projects/1602d2cbe0904660817ceebb99ca9916` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.162319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1602d2cbe0904660817ceebb99ca9916)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.162532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f4ca0a50-88d0-439e-8bd5-35258d681ea9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:50.163759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f4ca0a50-88d0-439e-8bd5-35258d681ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:50.164362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.172055 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3830/7625] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:50.180819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626812f8-18d8-440a-8d5a-c9f58a8e514e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.181219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626812f8-18d8-440a-8d5a-c9f58a8e514e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.181567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626812f8-18d8-440a-8d5a-c9f58a8e514e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.200433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-626812f8-18d8-440a-8d5a-c9f58a8e514e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:50.201641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-626812f8-18d8-440a-8d5a-c9f58a8e514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:50.211363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1602d2cbe0904660817ceebb99ca9916', 'request_id': 'req-575f893d-52b4-4bc8-a848-9335c2ad8e30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.224158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1602d2cbe0904660817ceebb99ca9916', 'request_id': 'req-575f893d-52b4-4bc8-a848-9335c2ad8e30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.229537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1602d2cbe0904660817ceebb99ca9916', 'request_id': 'req-575f893d-52b4-4bc8-a848-9335c2ad8e30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.240611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] The token cache is being invalidate because project 1602d2cbe0904660817ceebb99ca9916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:50.240899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.241541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-575f893d-52b4-4bc8-a848-9335c2ad8e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:50.243077 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3796/7626] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:50 2022] DELETE /identity/v3/projects/1602d2cbe0904660817ceebb99ca9916 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:50.249096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b781a-dab6-4ccf-b995-c62721047ffb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.249388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b781a-dab6-4ccf-b995-c62721047ffb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.249672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b781a-dab6-4ccf-b995-c62721047ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.261510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3831/7627] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:50.265578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626812f8-18d8-440a-8d5a-c9f58a8e514e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.270323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-424b781a-dab6-4ccf-b995-c62721047ffb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:50.271657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-424b781a-dab6-4ccf-b995-c62721047ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:50.275063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626812f8-18d8-440a-8d5a-c9f58a8e514e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.279583 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3797/7628] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:50.279995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d58e3-0ce2-4989-bab9-2bba3a3d8e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.280639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d58e3-0ce2-4989-bab9-2bba3a3d8e2d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.280942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d58e3-0ce2-4989-bab9-2bba3a3d8e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.281206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d58e3-0ce2-4989-bab9-2bba3a3d8e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.281960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d58e3-0ce2-4989-bab9-2bba3a3d8e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:50.282273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d58e3-0ce2-4989-bab9-2bba3a3d8e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.283883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d58e3-0ce2-4989-bab9-2bba3a3d8e2d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.287412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf19c3-9337-44ca-b53b-c0eb796a8665 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.287695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf19c3-9337-44ca-b53b-c0eb796a8665 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.288001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf19c3-9337-44ca-b53b-c0eb796a8665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.296005 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3832/7629] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:50.301067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d58e3-0ce2-4989-bab9-2bba3a3d8e2d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.306653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fadf19c3-9337-44ca-b53b-c0eb796a8665 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:50.307818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fadf19c3-9337-44ca-b53b-c0eb796a8665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:50.310972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d58e3-0ce2-4989-bab9-2bba3a3d8e2d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.316159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca9691-6dae-45e6-84af-39213c16fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.316352 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3798/7630] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:50.319845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca9691-6dae-45e6-84af-39213c16fae0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.320176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca9691-6dae-45e6-84af-39213c16fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.320417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf19c3-9337-44ca-b53b-c0eb796a8665 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.320548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca9691-6dae-45e6-84af-39213c16fae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.321132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca9691-6dae-45e6-84af-39213c16fae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.323043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca9691-6dae-45e6-84af-39213c16fae0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.329696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf19c3-9337-44ca-b53b-c0eb796a8665 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.334331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d632c9-067b-474d-aed1-100ea772409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.334970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d632c9-067b-474d-aed1-100ea772409c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.335255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d632c9-067b-474d-aed1-100ea772409c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.335535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d632c9-067b-474d-aed1-100ea772409c admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.336282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d632c9-067b-474d-aed1-100ea772409c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:50.336595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d632c9-067b-474d-aed1-100ea772409c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.338242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d632c9-067b-474d-aed1-100ea772409c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.348686 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3833/7631] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:50.350964 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3799/7632] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:15:50.352726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca9691-6dae-45e6-84af-39213c16fae0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.354891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d632c9-067b-474d-aed1-100ea772409c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.365122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d632c9-067b-474d-aed1-100ea772409c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.412731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca9691-6dae-45e6-84af-39213c16fae0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.417661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646a3a-1643-436d-a56f-de2010fda5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.418312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646a3a-1643-436d-a56f-de2010fda5fd admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.418593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646a3a-1643-436d-a56f-de2010fda5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.418865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05646a3a-1643-436d-a56f-de2010fda5fd admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.419537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646a3a-1643-436d-a56f-de2010fda5fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.420746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40feac9-1404-4de7-b3aa-d1ab5b64db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.421399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40feac9-1404-4de7-b3aa-d1ab5b64db50 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.421542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05646a3a-1643-436d-a56f-de2010fda5fd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.421687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40feac9-1404-4de7-b3aa-d1ab5b64db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.422456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40feac9-1404-4de7-b3aa-d1ab5b64db50 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.423133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40feac9-1404-4de7-b3aa-d1ab5b64db50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.425081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40feac9-1404-4de7-b3aa-d1ab5b64db50 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.442469 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3834/7633] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:50.446460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646a3a-1643-436d-a56f-de2010fda5fd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.454939 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3800/7634] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:50.456318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05646a3a-1643-436d-a56f-de2010fda5fd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.458799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40feac9-1404-4de7-b3aa-d1ab5b64db50 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.512648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8f38-7b5a-4e77-809a-89a2d65d604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.513309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8f38-7b5a-4e77-809a-89a2d65d604d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.513594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8f38-7b5a-4e77-809a-89a2d65d604d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.513877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8f38-7b5a-4e77-809a-89a2d65d604d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.514602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac8f38-7b5a-4e77-809a-89a2d65d604d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.516303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac8f38-7b5a-4e77-809a-89a2d65d604d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.518167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40feac9-1404-4de7-b3aa-d1ab5b64db50 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.522859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc531de-e71d-4692-bf16-d506ebfaaa0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.523518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc531de-e71d-4692-bf16-d506ebfaaa0a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.523810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc531de-e71d-4692-bf16-d506ebfaaa0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.524138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc531de-e71d-4692-bf16-d506ebfaaa0a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.524806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc531de-e71d-4692-bf16-d506ebfaaa0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.526312 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3835/7635] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:50.526738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc531de-e71d-4692-bf16-d506ebfaaa0a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.530165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8f38-7b5a-4e77-809a-89a2d65d604d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.540274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8f38-7b5a-4e77-809a-89a2d65d604d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.545050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f211b1-a784-46e7-aa4d-4003deccf38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.545845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f211b1-a784-46e7-aa4d-4003deccf38c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.546133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f211b1-a784-46e7-aa4d-4003deccf38c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.546320 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3801/7636] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/users => generated 300 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:50.546522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f211b1-a784-46e7-aa4d-4003deccf38c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.547794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f211b1-a784-46e7-aa4d-4003deccf38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.549774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f211b1-a784-46e7-aa4d-4003deccf38c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.551032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc531de-e71d-4692-bf16-d506ebfaaa0a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.563677 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3836/7637] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:50.563903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc531de-e71d-4692-bf16-d506ebfaaa0a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.564702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f211b1-a784-46e7-aa4d-4003deccf38c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.567943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596f735-7186-440d-b965-ef3842c9fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.568641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596f735-7186-440d-b965-ef3842c9fc21 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.568952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596f735-7186-440d-b965-ef3842c9fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.569365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596f735-7186-440d-b965-ef3842c9fc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.569951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596f735-7186-440d-b965-ef3842c9fc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.571567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596f735-7186-440d-b965-ef3842c9fc21 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.574032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f211b1-a784-46e7-aa4d-4003deccf38c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.578600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94824447-9df8-4c6e-a152-398a832e0d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.579452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94824447-9df8-4c6e-a152-398a832e0d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.579733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94824447-9df8-4c6e-a152-398a832e0d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.580041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94824447-9df8-4c6e-a152-398a832e0d84 admin admin] PATH_INFO: `/v3/projects/805dc18820054dca83228dc85ce8101b/users/abfa602e90e24ed599dd3afc4dcfac55/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.581908 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3802/7638] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:50.585883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596f735-7186-440d-b965-ef3842c9fc21 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.594458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94824447-9df8-4c6e-a152-398a832e0d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=805dc18820054dca83228dc85ce8101b, user_id=abfa602e90e24ed599dd3afc4dcfac55, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.595512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596f735-7186-440d-b965-ef3842c9fc21 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.597159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94824447-9df8-4c6e-a152-398a832e0d84 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.600829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab21da-32e7-42fa-be0b-e2ec78e94234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.601861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab21da-32e7-42fa-be0b-e2ec78e94234 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.602234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab21da-32e7-42fa-be0b-e2ec78e94234 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.602595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab21da-32e7-42fa-be0b-e2ec78e94234 admin admin] PATH_INFO: `/v3/projects/1a8d8e130af14ed9ba92ae333d9b16ff/users/0113bb7353744810a96aca89bfb0a5ca/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.610665 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3837/7639] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:50 2022] PUT /identity/v3/projects/805dc18820054dca83228dc85ce8101b/users/abfa602e90e24ed599dd3afc4dcfac55/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:50.620515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab21da-32e7-42fa-be0b-e2ec78e94234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8d8e130af14ed9ba92ae333d9b16ff, user_id=0113bb7353744810a96aca89bfb0a5ca, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.621185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c85af-33e7-462b-87c1-d9d47e7b5066 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.621481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c85af-33e7-462b-87c1-d9d47e7b5066 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.621766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c85af-33e7-462b-87c1-d9d47e7b5066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.623287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab21da-32e7-42fa-be0b-e2ec78e94234 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.637593 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3803/7640] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:50 2022] PUT /identity/v3/projects/1a8d8e130af14ed9ba92ae333d9b16ff/users/0113bb7353744810a96aca89bfb0a5ca/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:50.641409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab21da-32e7-42fa-be0b-e2ec78e94234 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.649114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b78c85af-33e7-462b-87c1-d9d47e7b5066 None None] MFA Rules not processed for user `abfa602e90e24ed599dd3afc4dcfac55`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:50.650330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b78c85af-33e7-462b-87c1-d9d47e7b5066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:50.709883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab21da-32e7-42fa-be0b-e2ec78e94234 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.714283 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3838/7641] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:50.714688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69aa6d-9871-4d3e-8ddf-833bf3bd6030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.715352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69aa6d-9871-4d3e-8ddf-833bf3bd6030 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.715639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69aa6d-9871-4d3e-8ddf-833bf3bd6030 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.715947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69aa6d-9871-4d3e-8ddf-833bf3bd6030 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.716676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69aa6d-9871-4d3e-8ddf-833bf3bd6030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.718305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69aa6d-9871-4d3e-8ddf-833bf3bd6030 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.718634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c85af-33e7-462b-87c1-d9d47e7b5066 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.731803 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3804/7642] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:50.732055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c85af-33e7-462b-87c1-d9d47e7b5066 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.732759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69aa6d-9871-4d3e-8ddf-833bf3bd6030 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.735629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33bd96-1390-4eca-84ca-02be03d466e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.736284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33bd96-1390-4eca-84ca-02be03d466e3 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.736567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33bd96-1390-4eca-84ca-02be03d466e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.736834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33bd96-1390-4eca-84ca-02be03d466e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.737505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33bd96-1390-4eca-84ca-02be03d466e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.739424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33bd96-1390-4eca-84ca-02be03d466e3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.743233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69aa6d-9871-4d3e-8ddf-833bf3bd6030 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.747955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0f9db-1448-42e5-901d-c18491ec328f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.748821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0f9db-1448-42e5-901d-c18491ec328f admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.749109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0f9db-1448-42e5-901d-c18491ec328f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.749391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0f9db-1448-42e5-901d-c18491ec328f admin admin] PATH_INFO: `/v3/projects/1a8d8e130af14ed9ba92ae333d9b16ff/users/0113bb7353744810a96aca89bfb0a5ca/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.751448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0f9db-1448-42e5-901d-c18491ec328f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a8d8e130af14ed9ba92ae333d9b16ff, user_id=0113bb7353744810a96aca89bfb0a5ca, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.754168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0f9db-1448-42e5-901d-c18491ec328f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.766302 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3839/7643] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:50.766580 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3805/7644] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:50 2022] PUT /identity/v3/projects/1a8d8e130af14ed9ba92ae333d9b16ff/users/0113bb7353744810a96aca89bfb0a5ca/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:50.774306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0f9db-1448-42e5-901d-c18491ec328f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.777688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e28fb-43b6-4389-b9c4-6065273524ea None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.777981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e28fb-43b6-4389-b9c4-6065273524ea None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.778370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655e28fb-43b6-4389-b9c4-6065273524ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.805460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-655e28fb-43b6-4389-b9c4-6065273524ea None None] MFA Rules not processed for user `0113bb7353744810a96aca89bfb0a5ca`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:50.806660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-655e28fb-43b6-4389-b9c4-6065273524ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:50.837089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0f9db-1448-42e5-901d-c18491ec328f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.876662 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3840/7645] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:50.881002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e28fb-43b6-4389-b9c4-6065273524ea None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.892849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac504b-4c3b-4dce-89a9-51b803996c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.893524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac504b-4c3b-4dce-89a9-51b803996c30 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.893807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac504b-4c3b-4dce-89a9-51b803996c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.894085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac504b-4c3b-4dce-89a9-51b803996c30 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.894776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac504b-4c3b-4dce-89a9-51b803996c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.896741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac504b-4c3b-4dce-89a9-51b803996c30 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.920098 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3806/7646] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:50.922844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac504b-4c3b-4dce-89a9-51b803996c30 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.933476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac504b-4c3b-4dce-89a9-51b803996c30 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.938211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300372-5166-45e1-aff0-bdd38f522727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.938849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300372-5166-45e1-aff0-bdd38f522727 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.939149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300372-5166-45e1-aff0-bdd38f522727 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.939431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a300372-5166-45e1-aff0-bdd38f522727 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.940183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300372-5166-45e1-aff0-bdd38f522727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.942182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a300372-5166-45e1-aff0-bdd38f522727 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.943257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655e28fb-43b6-4389-b9c4-6065273524ea None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.947947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d5f5e-e377-4af0-b09b-5dd8ed1b5e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.948612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d5f5e-e377-4af0-b09b-5dd8ed1b5e00 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.948898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d5f5e-e377-4af0-b09b-5dd8ed1b5e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.949178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d5f5e-e377-4af0-b09b-5dd8ed1b5e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.949867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d5f5e-e377-4af0-b09b-5dd8ed1b5e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.951955 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3807/7647] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:50.952082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d5f5e-e377-4af0-b09b-5dd8ed1b5e00 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:50.955762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300372-5166-45e1-aff0-bdd38f522727 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.965840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a300372-5166-45e1-aff0-bdd38f522727 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:50.973607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d362b5-7965-43ab-acfe-47724eae74db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:50.974944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d362b5-7965-43ab-acfe-47724eae74db admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:50.975385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d362b5-7965-43ab-acfe-47724eae74db admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:50.975838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d362b5-7965-43ab-acfe-47724eae74db admin admin] PATH_INFO: `/v3/projects/8aaf2eb1095148abbedd3ee24df5d783/users/52c2398e259a495f9d71d5917bc7f8c7/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:50.980262 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3841/7648] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:50.983605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d5f5e-e377-4af0-b09b-5dd8ed1b5e00 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:50.994368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d362b5-7965-43ab-acfe-47724eae74db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aaf2eb1095148abbedd3ee24df5d783, user_id=52c2398e259a495f9d71d5917bc7f8c7, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:50.997536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d362b5-7965-43ab-acfe-47724eae74db admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.010672 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3808/7649] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:50 2022] PUT /identity/v3/projects/8aaf2eb1095148abbedd3ee24df5d783/users/52c2398e259a495f9d71d5917bc7f8c7/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:51.014466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d362b5-7965-43ab-acfe-47724eae74db admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:51.046205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d5f5e-e377-4af0-b09b-5dd8ed1b5e00 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.074698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d362b5-7965-43ab-acfe-47724eae74db admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.081058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b84adb-d6fb-486c-993a-845a82ee5724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.081722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b84adb-d6fb-486c-993a-845a82ee5724 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.082009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b84adb-d6fb-486c-993a-845a82ee5724 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.082292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b84adb-d6fb-486c-993a-845a82ee5724 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.083009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b84adb-d6fb-486c-993a-845a82ee5724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.084667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b84adb-d6fb-486c-993a-845a82ee5724 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.095035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3809/7650] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:51.099086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b84adb-d6fb-486c-993a-845a82ee5724 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:51.103565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a59cf-c03f-40bd-a9bb-9201fc33bcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.104272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a59cf-c03f-40bd-a9bb-9201fc33bcf8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.104572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a59cf-c03f-40bd-a9bb-9201fc33bcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.104839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a59cf-c03f-40bd-a9bb-9201fc33bcf8 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.105539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a59cf-c03f-40bd-a9bb-9201fc33bcf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.107580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a59cf-c03f-40bd-a9bb-9201fc33bcf8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.108889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b84adb-d6fb-486c-993a-845a82ee5724 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.113642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d03714-6e2f-4171-9d46-44b90e76e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.114556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d03714-6e2f-4171-9d46-44b90e76e807 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.114842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d03714-6e2f-4171-9d46-44b90e76e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.115124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d03714-6e2f-4171-9d46-44b90e76e807 admin admin] PATH_INFO: `/v3/projects/8aaf2eb1095148abbedd3ee24df5d783/users/52c2398e259a495f9d71d5917bc7f8c7/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.117287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d03714-6e2f-4171-9d46-44b90e76e807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aaf2eb1095148abbedd3ee24df5d783, user_id=52c2398e259a495f9d71d5917bc7f8c7, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.120514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d03714-6e2f-4171-9d46-44b90e76e807 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.129953 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3842/7651] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:50 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:51.130974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a59cf-c03f-40bd-a9bb-9201fc33bcf8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:51.131451 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3810/7652] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:51 2022] PUT /identity/v3/projects/8aaf2eb1095148abbedd3ee24df5d783/users/52c2398e259a495f9d71d5917bc7f8c7/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:51.141324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a59cf-c03f-40bd-a9bb-9201fc33bcf8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.141808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d22a2f-c69e-4bf7-a55c-1541efab767a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.142103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d22a2f-c69e-4bf7-a55c-1541efab767a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.142386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d22a2f-c69e-4bf7-a55c-1541efab767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.168550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-15d22a2f-c69e-4bf7-a55c-1541efab767a None None] MFA Rules not processed for user `52c2398e259a495f9d71d5917bc7f8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:51.169782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-15d22a2f-c69e-4bf7-a55c-1541efab767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:51.195934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714a69-9019-4ee9-aab0-b069d5affff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.196596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714a69-9019-4ee9-aab0-b069d5affff8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.196933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714a69-9019-4ee9-aab0-b069d5affff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.197147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74714a69-9019-4ee9-aab0-b069d5affff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.197885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74714a69-9019-4ee9-aab0-b069d5affff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.199475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74714a69-9019-4ee9-aab0-b069d5affff8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.209760 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3843/7653] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:51.213601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714a69-9019-4ee9-aab0-b069d5affff8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:51.223375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74714a69-9019-4ee9-aab0-b069d5affff8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.227849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c1e91-fcec-46fa-9db7-c3f6f484bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.228499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c1e91-fcec-46fa-9db7-c3f6f484bb45 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.228782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c1e91-fcec-46fa-9db7-c3f6f484bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.229060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c1e91-fcec-46fa-9db7-c3f6f484bb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.229753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c1e91-fcec-46fa-9db7-c3f6f484bb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.231309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c1e91-fcec-46fa-9db7-c3f6f484bb45 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.237841 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3811/7654] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:51.243775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3844/7655] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:51.244822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d22a2f-c69e-4bf7-a55c-1541efab767a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:51.249175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c1e91-fcec-46fa-9db7-c3f6f484bb45 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:51.250874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c19c1e91-fcec-46fa-9db7-c3f6f484bb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:51.255112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d22a2f-c69e-4bf7-a55c-1541efab767a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.259816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a770e-d84d-472b-96d8-84da863edb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.260873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a770e-d84d-472b-96d8-84da863edb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.261162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a770e-d84d-472b-96d8-84da863edb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.261442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a770e-d84d-472b-96d8-84da863edb34 admin admin] PATH_INFO: `/v3/projects/ab85c9fa0ad14c72840b270a42b25640/users/931655832e3547ba8dc8059d39b583be/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.276331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a770e-d84d-472b-96d8-84da863edb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab85c9fa0ad14c72840b270a42b25640, user_id=931655832e3547ba8dc8059d39b583be, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.279010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a770e-d84d-472b-96d8-84da863edb34 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.293396 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3812/7656] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:51 2022] PUT /identity/v3/projects/ab85c9fa0ad14c72840b270a42b25640/users/931655832e3547ba8dc8059d39b583be/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:51.304447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d668b52-48f0-4733-8761-cf3d0f02fe9f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.304730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d668b52-48f0-4733-8761-cf3d0f02fe9f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.305008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d668b52-48f0-4733-8761-cf3d0f02fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.317909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c1e91-fcec-46fa-9db7-c3f6f484bb45 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.331171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7d668b52-48f0-4733-8761-cf3d0f02fe9f None None] MFA Rules not processed for user `931655832e3547ba8dc8059d39b583be`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:51.332398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d668b52-48f0-4733-8761-cf3d0f02fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:51.364688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427425-62ef-4f2e-af7d-13477765941c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.365323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427425-62ef-4f2e-af7d-13477765941c service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.365604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427425-62ef-4f2e-af7d-13477765941c service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.365878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427425-62ef-4f2e-af7d-13477765941c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.400643 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3813/7657] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:51.411798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d668b52-48f0-4733-8761-cf3d0f02fe9f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:51.413310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7d668b52-48f0-4733-8761-cf3d0f02fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:51.432254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49427425-62ef-4f2e-af7d-13477765941c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.433702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49427425-62ef-4f2e-af7d-13477765941c service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.444181 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3845/7658] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:51.492652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d668b52-48f0-4733-8761-cf3d0f02fe9f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.497239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2731cde-5dfd-48fa-9efb-1b5023641853 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.498143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2731cde-5dfd-48fa-9efb-1b5023641853 service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.498478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2731cde-5dfd-48fa-9efb-1b5023641853 service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.498881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2731cde-5dfd-48fa-9efb-1b5023641853 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.519354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427425-62ef-4f2e-af7d-13477765941c service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:51.529252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427425-62ef-4f2e-af7d-13477765941c service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.533085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb2d4f-f564-4ef4-9610-1c2255bdf9ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.533717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb2d4f-f564-4ef4-9610-1c2255bdf9ad service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.534001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb2d4f-f564-4ef4-9610-1c2255bdf9ad service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.534277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb2d4f-f564-4ef4-9610-1c2255bdf9ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.560881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2731cde-5dfd-48fa-9efb-1b5023641853 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.562351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2731cde-5dfd-48fa-9efb-1b5023641853 service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.572698 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3814/7659] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:51.594018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb2d4f-f564-4ef4-9610-1c2255bdf9ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.595475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb2d4f-f564-4ef4-9610-1c2255bdf9ad service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.605066 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3846/7660] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:51.793505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2731cde-5dfd-48fa-9efb-1b5023641853 service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:51.854984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2731cde-5dfd-48fa-9efb-1b5023641853 service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:51.860126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:51.860985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.861275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.861553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] PATH_INFO: `/v3/users/0113bb7353744810a96aca89bfb0a5ca` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.862749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0113bb7353744810a96aca89bfb0a5ca)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:51.864734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:51.911264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0113bb7353744810a96aca89bfb0a5ca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:51.918081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0113bb7353744810a96aca89bfb0a5ca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:51.918703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0113bb7353744810a96aca89bfb0a5ca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:51.919346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0113bb7353744810a96aca89bfb0a5ca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:51.931529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0113bb7353744810a96aca89bfb0a5ca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:51.943688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3815/7661] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:51 2022] DELETE /identity/v3/users/0113bb7353744810a96aca89bfb0a5ca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:51.948323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6f36f-749d-4801-a623-e18521c27c78 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:51.948610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6f36f-749d-4801-a623-e18521c27c78 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:51.948887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6f36f-749d-4801-a623-e18521c27c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:51.966143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-aab6f36f-749d-4801-a623-e18521c27c78 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:51.967309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aab6f36f-749d-4801-a623-e18521c27c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:52.027176 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3847/7662] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:52.036910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:52.038315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:52.097256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449226b-c6d9-4b66-afc1-2689e7134543 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:52.100935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a9d7c-bd5c-410e-b2e2-89d8022f5869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:52.101586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a9d7c-bd5c-410e-b2e2-89d8022f5869 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:52.101892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a9d7c-bd5c-410e-b2e2-89d8022f5869 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:52.102171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a9d7c-bd5c-410e-b2e2-89d8022f5869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:52.111832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a9d7c-bd5c-410e-b2e2-89d8022f5869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:52.113332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a9d7c-bd5c-410e-b2e2-89d8022f5869 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:52.123038 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3816/7663] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:52.382904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6f36f-749d-4801-a623-e18521c27c78 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:52.384502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aab6f36f-749d-4801-a623-e18521c27c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:52.396292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6f36f-749d-4801-a623-e18521c27c78 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:52.401331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:52.402172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:52.402450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:52.402726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] PATH_INFO: `/v3/projects/1a8d8e130af14ed9ba92ae333d9b16ff` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:52.403902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a8d8e130af14ed9ba92ae333d9b16ff)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:52.405938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:52.451423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a8d8e130af14ed9ba92ae333d9b16ff', 'request_id': 'req-9b920835-25d4-4707-9e51-320b604e7f44'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.458008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a8d8e130af14ed9ba92ae333d9b16ff', 'request_id': 'req-9b920835-25d4-4707-9e51-320b604e7f44'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.463361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a8d8e130af14ed9ba92ae333d9b16ff', 'request_id': 'req-9b920835-25d4-4707-9e51-320b604e7f44'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.474618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] The token cache is being invalidate because project 1a8d8e130af14ed9ba92ae333d9b16ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:52.474847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.475485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.477041 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3848/7664] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:52 2022] DELETE /identity/v3/projects/1a8d8e130af14ed9ba92ae333d9b16ff => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:52.481007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a9d7c-bd5c-410e-b2e2-89d8022f5869 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:52.491109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a9d7c-bd5c-410e-b2e2-89d8022f5869 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:52.547085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:52.547972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:52.548259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:52.548540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] PATH_INFO: `/v3/users/931655832e3547ba8dc8059d39b583be` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:52.549719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=931655832e3547ba8dc8059d39b583be)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:52.551666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:52.596368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931655832e3547ba8dc8059d39b583be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.603120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931655832e3547ba8dc8059d39b583be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.603736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931655832e3547ba8dc8059d39b583be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.604376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931655832e3547ba8dc8059d39b583be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.615855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5f44a3ba-ba5c-40b7-b7f4-9440727f16c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931655832e3547ba8dc8059d39b583be'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:52.627900 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3817/7665] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:52 2022] DELETE /identity/v3/users/931655832e3547ba8dc8059d39b583be => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:52.893039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:52.894606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:52.922573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b920835-25d4-4707-9e51-320b604e7f44 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:52.987819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:52.988780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:52.989078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:52.989344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] PATH_INFO: `/v3/projects/ab85c9fa0ad14c72840b270a42b25640` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:52.990523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab85c9fa0ad14c72840b270a42b25640)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:52.992525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:53.044570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab85c9fa0ad14c72840b270a42b25640', 'request_id': 'req-0fcef8a1-c56a-44b2-89a9-af49751203ff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:53.053965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab85c9fa0ad14c72840b270a42b25640', 'request_id': 'req-0fcef8a1-c56a-44b2-89a9-af49751203ff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:53.060125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab85c9fa0ad14c72840b270a42b25640', 'request_id': 'req-0fcef8a1-c56a-44b2-89a9-af49751203ff'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:53.076602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] The token cache is being invalidate because project ab85c9fa0ad14c72840b270a42b25640 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:53.076602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:53.076602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0fcef8a1-c56a-44b2-89a9-af49751203ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:53.076602 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3849/7666] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:52 2022] DELETE /identity/v3/projects/ab85c9fa0ad14c72840b270a42b25640 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:53.081838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a202f8-ec1b-46f1-92b1-69a142229693 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.082233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a202f8-ec1b-46f1-92b1-69a142229693 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.082802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a202f8-ec1b-46f1-92b1-69a142229693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.106130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a5a202f8-ec1b-46f1-92b1-69a142229693 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:53.110066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a5a202f8-ec1b-46f1-92b1-69a142229693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:53.182348 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3818/7667] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:53.191663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faa0f7-9258-4c75-a9bd-ec07b50a5042 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.191984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faa0f7-9258-4c75-a9bd-ec07b50a5042 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.192305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faa0f7-9258-4c75-a9bd-ec07b50a5042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.211775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-06faa0f7-9258-4c75-a9bd-ec07b50a5042 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:53.213032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-06faa0f7-9258-4c75-a9bd-ec07b50a5042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:53.220876 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3850/7668] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:53.225073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a202f8-ec1b-46f1-92b1-69a142229693 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:53.234950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a202f8-ec1b-46f1-92b1-69a142229693 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:53.239392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4600e-cdd4-4363-af84-4c65012b0ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:53.240077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4600e-cdd4-4363-af84-4c65012b0ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.240360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4600e-cdd4-4363-af84-4c65012b0ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.240636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4600e-cdd4-4363-af84-4c65012b0ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.241839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4600e-cdd4-4363-af84-4c65012b0ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:53.242145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4600e-cdd4-4363-af84-4c65012b0ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:53.243757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4600e-cdd4-4363-af84-4c65012b0ed3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:53.258785 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3819/7669] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:53.263555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faa0f7-9258-4c75-a9bd-ec07b50a5042 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:53.274094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faa0f7-9258-4c75-a9bd-ec07b50a5042 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:53.278980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d881c2-1476-49a6-baf6-ad75250b1bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:53.279854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d881c2-1476-49a6-baf6-ad75250b1bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.280175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d881c2-1476-49a6-baf6-ad75250b1bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.280454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d881c2-1476-49a6-baf6-ad75250b1bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.281137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d881c2-1476-49a6-baf6-ad75250b1bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:53.283069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d881c2-1476-49a6-baf6-ad75250b1bc7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:53.309765 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3851/7670] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:53 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:53.314657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4600e-cdd4-4363-af84-4c65012b0ed3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:53.325161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4600e-cdd4-4363-af84-4c65012b0ed3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:53.379403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d693432-9b89-45a8-863d-b04cb0d73cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:53.380097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d693432-9b89-45a8-863d-b04cb0d73cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.380379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d693432-9b89-45a8-863d-b04cb0d73cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.380654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d693432-9b89-45a8-863d-b04cb0d73cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.381341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d693432-9b89-45a8-863d-b04cb0d73cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:53.383346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d693432-9b89-45a8-863d-b04cb0d73cb1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:53.403138 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3820/7671] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:53 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:53.407479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d881c2-1476-49a6-baf6-ad75250b1bc7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:53.417749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d881c2-1476-49a6-baf6-ad75250b1bc7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:53.422818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9efd8-4ae8-42bd-a9b0-49508b63bc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:53.423462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9efd8-4ae8-42bd-a9b0-49508b63bc54 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.423747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9efd8-4ae8-42bd-a9b0-49508b63bc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.424064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9efd8-4ae8-42bd-a9b0-49508b63bc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.424813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9efd8-4ae8-42bd-a9b0-49508b63bc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:53.426422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9efd8-4ae8-42bd-a9b0-49508b63bc54 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:53.436786 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3852/7672] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:53.441348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d693432-9b89-45a8-863d-b04cb0d73cb1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:53.451186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d693432-9b89-45a8-863d-b04cb0d73cb1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:53.456010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e355373-ca97-4790-a1ff-7f96d1f336b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:53.456661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e355373-ca97-4790-a1ff-7f96d1f336b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.456981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e355373-ca97-4790-a1ff-7f96d1f336b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.457257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e355373-ca97-4790-a1ff-7f96d1f336b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.457963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e355373-ca97-4790-a1ff-7f96d1f336b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:53.459553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e355373-ca97-4790-a1ff-7f96d1f336b8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:53.469505 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3821/7673] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:53.473567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9efd8-4ae8-42bd-a9b0-49508b63bc54 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:53.483228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9efd8-4ae8-42bd-a9b0-49508b63bc54 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:53.488498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbe10f-c57c-4c7f-ac7c-8dfed25a9d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:53.489332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe10f-c57c-4c7f-ac7c-8dfed25a9d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.489614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe10f-c57c-4c7f-ac7c-8dfed25a9d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.489897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe10f-c57c-4c7f-ac7c-8dfed25a9d8a admin admin] PATH_INFO: `/v3/projects/3afbbac851844922b87956fe729c7d35/users/f6ccd88fdafd4ada81a5d3aeca01b373/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.504429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbe10f-c57c-4c7f-ac7c-8dfed25a9d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3afbbac851844922b87956fe729c7d35, user_id=f6ccd88fdafd4ada81a5d3aeca01b373, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:53.507093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbe10f-c57c-4c7f-ac7c-8dfed25a9d8a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:53.519693 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3853/7674] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:53 2022] PUT /identity/v3/projects/3afbbac851844922b87956fe729c7d35/users/f6ccd88fdafd4ada81a5d3aeca01b373/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:53.529968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029571ed-02ac-4f96-b452-4998c6163816 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.530446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029571ed-02ac-4f96-b452-4998c6163816 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.530554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029571ed-02ac-4f96-b452-4998c6163816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.557843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-029571ed-02ac-4f96-b452-4998c6163816 None None] MFA Rules not processed for user `f6ccd88fdafd4ada81a5d3aeca01b373`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:53.559027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-029571ed-02ac-4f96-b452-4998c6163816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:53.621891 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3822/7675] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:53.633801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbe10f-c57c-4c7f-ac7c-8dfed25a9d8a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:53.635527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c3bbe10f-c57c-4c7f-ac7c-8dfed25a9d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:53.692741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbe10f-c57c-4c7f-ac7c-8dfed25a9d8a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:53.696372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b41abc-487d-41ed-86e7-0c8210ce9b3f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:53.697005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41abc-487d-41ed-86e7-0c8210ce9b3f service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:53.697310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41abc-487d-41ed-86e7-0c8210ce9b3f service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:53.697565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b41abc-487d-41ed-86e7-0c8210ce9b3f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:53.705813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b41abc-487d-41ed-86e7-0c8210ce9b3f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:53.707197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b41abc-487d-41ed-86e7-0c8210ce9b3f service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:53.715798 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3854/7676] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:54.273882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029571ed-02ac-4f96-b452-4998c6163816 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:54.340803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029571ed-02ac-4f96-b452-4998c6163816 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:54.346048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:54.346932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:54.347243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:54.347618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] PATH_INFO: `/v3/users/f6ccd88fdafd4ada81a5d3aeca01b373` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:54.349043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ccd88fdafd4ada81a5d3aeca01b373)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:54.351176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:54.421920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ccd88fdafd4ada81a5d3aeca01b373'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:54.429942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ccd88fdafd4ada81a5d3aeca01b373'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:54.430794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ccd88fdafd4ada81a5d3aeca01b373'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:54.431800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ccd88fdafd4ada81a5d3aeca01b373'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:54.446017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ccd88fdafd4ada81a5d3aeca01b373'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:54.461201 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3823/7677] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:54 2022] DELETE /identity/v3/users/f6ccd88fdafd4ada81a5d3aeca01b373 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:54.465703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db84b4-e09f-489f-844b-3296cce79523 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:54.466266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db84b4-e09f-489f-844b-3296cce79523 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:54.466430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db84b4-e09f-489f-844b-3296cce79523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:54.487381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-97db84b4-e09f-489f-844b-3296cce79523 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:54.488845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-97db84b4-e09f-489f-844b-3296cce79523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:54.550862 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3855/7678] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:54.563270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:54.564797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:54.637651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba046901-c74b-469c-92b6-535f0dc644e7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:54.642419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe1968-dd19-4d73-a0b3-9fe5a1edaac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:54.643059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe1968-dd19-4d73-a0b3-9fe5a1edaac3 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:54.643341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe1968-dd19-4d73-a0b3-9fe5a1edaac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:54.643614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe1968-dd19-4d73-a0b3-9fe5a1edaac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:54.653808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe1968-dd19-4d73-a0b3-9fe5a1edaac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:54.655995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe1968-dd19-4d73-a0b3-9fe5a1edaac3 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:54.666062 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3824/7679] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:54.936747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db84b4-e09f-489f-844b-3296cce79523 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:54.938610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-97db84b4-e09f-489f-844b-3296cce79523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:54.952203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db84b4-e09f-489f-844b-3296cce79523 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:54.957335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:54.958487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:54.958790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:54.959050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] PATH_INFO: `/v3/projects/3afbbac851844922b87956fe729c7d35` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:54.960376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3afbbac851844922b87956fe729c7d35)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:54.962235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:55.011102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3afbbac851844922b87956fe729c7d35', 'request_id': 'req-5212299e-ed3b-42dc-9a63-ae99a4604534'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:55.024998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3afbbac851844922b87956fe729c7d35', 'request_id': 'req-5212299e-ed3b-42dc-9a63-ae99a4604534'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:55.026632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3afbbac851844922b87956fe729c7d35', 'request_id': 'req-5212299e-ed3b-42dc-9a63-ae99a4604534'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:55.040134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] The token cache is being invalidate because project 3afbbac851844922b87956fe729c7d35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:55.040428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:55.041097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5212299e-ed3b-42dc-9a63-ae99a4604534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:55.046384 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3856/7680] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:54 2022] DELETE /identity/v3/projects/3afbbac851844922b87956fe729c7d35 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:55.049265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a150e0e-2cb3-4e90-bb13-40a28c8fd458 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.049554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a150e0e-2cb3-4e90-bb13-40a28c8fd458 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.050255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a150e0e-2cb3-4e90-bb13-40a28c8fd458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.071820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1a150e0e-2cb3-4e90-bb13-40a28c8fd458 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:55.073740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1a150e0e-2cb3-4e90-bb13-40a28c8fd458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:55.133795 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3825/7681] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:55.141553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dceb7-a771-49b1-b499-f3623fd21d9b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.141835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dceb7-a771-49b1-b499-f3623fd21d9b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.142119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dceb7-a771-49b1-b499-f3623fd21d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.161018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-8a5dceb7-a771-49b1-b499-f3623fd21d9b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:55.162213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8a5dceb7-a771-49b1-b499-f3623fd21d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:55.170208 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3857/7682] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:55.175150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a150e0e-2cb3-4e90-bb13-40a28c8fd458 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:55.185206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a150e0e-2cb3-4e90-bb13-40a28c8fd458 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:55.189944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf7825-9e5e-45fe-a1ba-e907090daf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:55.190595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf7825-9e5e-45fe-a1ba-e907090daf5f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.190884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf7825-9e5e-45fe-a1ba-e907090daf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.191167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf7825-9e5e-45fe-a1ba-e907090daf5f admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.191885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf7825-9e5e-45fe-a1ba-e907090daf5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:55.192310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf7825-9e5e-45fe-a1ba-e907090daf5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:55.193930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf7825-9e5e-45fe-a1ba-e907090daf5f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:55.205593 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3826/7683] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:55.209924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dceb7-a771-49b1-b499-f3623fd21d9b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:55.219464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dceb7-a771-49b1-b499-f3623fd21d9b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:55.224070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bfbb9-0a37-4cfd-9dc9-351259af5a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:55.224699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bfbb9-0a37-4cfd-9dc9-351259af5a32 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.224997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bfbb9-0a37-4cfd-9dc9-351259af5a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.225254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bfbb9-0a37-4cfd-9dc9-351259af5a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.225928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bfbb9-0a37-4cfd-9dc9-351259af5a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:55.227824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bfbb9-0a37-4cfd-9dc9-351259af5a32 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:55.253253 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3858/7684] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:55 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:55.257396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf7825-9e5e-45fe-a1ba-e907090daf5f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:55.268034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf7825-9e5e-45fe-a1ba-e907090daf5f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:55.322606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0238623-06fa-491b-b8bb-e08fd966684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:55.323198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0238623-06fa-491b-b8bb-e08fd966684f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.323514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0238623-06fa-491b-b8bb-e08fd966684f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.323801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0238623-06fa-491b-b8bb-e08fd966684f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.324532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0238623-06fa-491b-b8bb-e08fd966684f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:55.326480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0238623-06fa-491b-b8bb-e08fd966684f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:55.349129 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3827/7685] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:55 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:55.350327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bfbb9-0a37-4cfd-9dc9-351259af5a32 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:55.360359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bfbb9-0a37-4cfd-9dc9-351259af5a32 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:55.364927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbbbe6-fa96-4d4a-8cc3-6f90a36c1f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:55.365568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbbbe6-fa96-4d4a-8cc3-6f90a36c1f90 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.365851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbbbe6-fa96-4d4a-8cc3-6f90a36c1f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.366127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbbbe6-fa96-4d4a-8cc3-6f90a36c1f90 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.366841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbbbe6-fa96-4d4a-8cc3-6f90a36c1f90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:55.368479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbbbe6-fa96-4d4a-8cc3-6f90a36c1f90 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:55.380193 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3859/7686] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:55.383805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0238623-06fa-491b-b8bb-e08fd966684f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:55.394431 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0238623-06fa-491b-b8bb-e08fd966684f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:55.400343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24e9d-1aa7-406f-bc98-95b581e0ac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:55.401660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24e9d-1aa7-406f-bc98-95b581e0ac38 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.402204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24e9d-1aa7-406f-bc98-95b581e0ac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.402707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24e9d-1aa7-406f-bc98-95b581e0ac38 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.403904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a24e9d-1aa7-406f-bc98-95b581e0ac38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:55.405830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a24e9d-1aa7-406f-bc98-95b581e0ac38 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:55.416052 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3828/7687] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:55.419779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbbbe6-fa96-4d4a-8cc3-6f90a36c1f90 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:55.429905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbbbe6-fa96-4d4a-8cc3-6f90a36c1f90 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:55.434508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948a102-c157-41d3-ac52-a08e34f62fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:55.435364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a102-c157-41d3-ac52-a08e34f62fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.435642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a102-c157-41d3-ac52-a08e34f62fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.435909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948a102-c157-41d3-ac52-a08e34f62fa5 admin admin] PATH_INFO: `/v3/projects/d19c32be88564070bfba6232d1763f4f/users/3fe28e9cb4dc492d80eb679104f7c182/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.451857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948a102-c157-41d3-ac52-a08e34f62fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d19c32be88564070bfba6232d1763f4f, user_id=3fe28e9cb4dc492d80eb679104f7c182, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:55.455336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948a102-c157-41d3-ac52-a08e34f62fa5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:55.468465 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3860/7688] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:55 2022] PUT /identity/v3/projects/d19c32be88564070bfba6232d1763f4f/users/3fe28e9cb4dc492d80eb679104f7c182/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:55.479288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402abc-a1fc-48cb-a0cf-db572e57f7ca None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.479575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402abc-a1fc-48cb-a0cf-db572e57f7ca None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.479849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43402abc-a1fc-48cb-a0cf-db572e57f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.506841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-43402abc-a1fc-48cb-a0cf-db572e57f7ca None None] MFA Rules not processed for user `3fe28e9cb4dc492d80eb679104f7c182`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:55.508143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-43402abc-a1fc-48cb-a0cf-db572e57f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:55.576566 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3829/7689] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:55.589982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948a102-c157-41d3-ac52-a08e34f62fa5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:55.591667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1948a102-c157-41d3-ac52-a08e34f62fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:55.659336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948a102-c157-41d3-ac52-a08e34f62fa5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:55.663990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e5c41e-bb24-4a12-b1ca-292174d417df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:55.664647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5c41e-bb24-4a12-b1ca-292174d417df service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:55.664939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5c41e-bb24-4a12-b1ca-292174d417df service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:55.665219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e5c41e-bb24-4a12-b1ca-292174d417df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:55.674787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5c41e-bb24-4a12-b1ca-292174d417df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:55.676089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e5c41e-bb24-4a12-b1ca-292174d417df service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:55.691115 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3861/7690] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:55 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:15:56.102866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402abc-a1fc-48cb-a0cf-db572e57f7ca None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:56.166649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43402abc-a1fc-48cb-a0cf-db572e57f7ca None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:56.171159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:56.172717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:56.173003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:56.173279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] PATH_INFO: `/v3/users/3fe28e9cb4dc492d80eb679104f7c182` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:56.174504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe28e9cb4dc492d80eb679104f7c182)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:56.176517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:56.225296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe28e9cb4dc492d80eb679104f7c182'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.232844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe28e9cb4dc492d80eb679104f7c182'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.233564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe28e9cb4dc492d80eb679104f7c182'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.234200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe28e9cb4dc492d80eb679104f7c182'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.246574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe28e9cb4dc492d80eb679104f7c182'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.258943 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3830/7691] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:56 2022] DELETE /identity/v3/users/3fe28e9cb4dc492d80eb679104f7c182 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:56.263376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c92330-0794-4c6e-b096-b9bbce9c36e3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:56.263668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c92330-0794-4c6e-b096-b9bbce9c36e3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:56.263971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c92330-0794-4c6e-b096-b9bbce9c36e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:56.282644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-50c92330-0794-4c6e-b096-b9bbce9c36e3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:56.284018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-50c92330-0794-4c6e-b096-b9bbce9c36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:56.342940 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3862/7692] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:56.352405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:56.353790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:56.413608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80534e-2d8c-4965-a704-029bfa99b630 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:56.417424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a5ee1-6c52-41e4-b198-f4dcf262b0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:56.418080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a5ee1-6c52-41e4-b198-f4dcf262b0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:56.418364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a5ee1-6c52-41e4-b198-f4dcf262b0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:56.418644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a5ee1-6c52-41e4-b198-f4dcf262b0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:56.428337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a5ee1-6c52-41e4-b198-f4dcf262b0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:56.430176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a5ee1-6c52-41e4-b198-f4dcf262b0a3 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:56.439938 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3831/7693] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:56.700059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c92330-0794-4c6e-b096-b9bbce9c36e3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:56.702005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-50c92330-0794-4c6e-b096-b9bbce9c36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:56.715359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c92330-0794-4c6e-b096-b9bbce9c36e3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:56.720914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:56.722107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:56.722597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:56.723084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] PATH_INFO: `/v3/projects/d19c32be88564070bfba6232d1763f4f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:56.724352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d19c32be88564070bfba6232d1763f4f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:56.726410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:56.773543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd19c32be88564070bfba6232d1763f4f', 'request_id': 'req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.780414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd19c32be88564070bfba6232d1763f4f', 'request_id': 'req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.788059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd19c32be88564070bfba6232d1763f4f', 'request_id': 'req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.800124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] The token cache is being invalidate because project d19c32be88564070bfba6232d1763f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:56.800422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.801081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e0f453c6-5b74-42aa-b9f1-f1312720d7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:56.802684 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3863/7694] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:56 2022] DELETE /identity/v3/projects/d19c32be88564070bfba6232d1763f4f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:56.808117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702b98-162e-4c92-8ee1-a988d14116ac None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:56.808667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702b98-162e-4c92-8ee1-a988d14116ac None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:56.808667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62702b98-162e-4c92-8ee1-a988d14116ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:56.827052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-62702b98-162e-4c92-8ee1-a988d14116ac None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:56.828846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-62702b98-162e-4c92-8ee1-a988d14116ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:56.897551 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3832/7695] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:56.905607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0cfb-6d8b-4fdd-af50-25f149f7e13f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:56.905905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0cfb-6d8b-4fdd-af50-25f149f7e13f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:56.906730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf0cfb-6d8b-4fdd-af50-25f149f7e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:56.926873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d2bf0cfb-6d8b-4fdd-af50-25f149f7e13f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:56.928163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d2bf0cfb-6d8b-4fdd-af50-25f149f7e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:56.936330 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3864/7696] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:56.940643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62702b98-162e-4c92-8ee1-a988d14116ac None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:56.950684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62702b98-162e-4c92-8ee1-a988d14116ac None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:56.955243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851534ad-c07e-4f9f-8bee-2bd4a086f3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:56.955892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851534ad-c07e-4f9f-8bee-2bd4a086f3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:56.956209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851534ad-c07e-4f9f-8bee-2bd4a086f3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:56.956486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851534ad-c07e-4f9f-8bee-2bd4a086f3d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:56.957190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851534ad-c07e-4f9f-8bee-2bd4a086f3d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:15:56.957688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851534ad-c07e-4f9f-8bee-2bd4a086f3d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:56.959292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851534ad-c07e-4f9f-8bee-2bd4a086f3d5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:56.973308 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3833/7697] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:15:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:15:56.977510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf0cfb-6d8b-4fdd-af50-25f149f7e13f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:56.987722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf0cfb-6d8b-4fdd-af50-25f149f7e13f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:56.993814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85b3e-2729-4611-ad9f-63710606e129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:56.994646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85b3e-2729-4611-ad9f-63710606e129 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:56.995441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85b3e-2729-4611-ad9f-63710606e129 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:56.995720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc85b3e-2729-4611-ad9f-63710606e129 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:56.996462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc85b3e-2729-4611-ad9f-63710606e129 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:56.999154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc85b3e-2729-4611-ad9f-63710606e129 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.048000 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3865/7698] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:56 2022] POST /identity/v3/projects => generated 409 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:57.051409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851534ad-c07e-4f9f-8bee-2bd4a086f3d5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.061933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851534ad-c07e-4f9f-8bee-2bd4a086f3d5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.123302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd2c0f-ff1e-4c89-abef-c34658c35e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.124006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd2c0f-ff1e-4c89-abef-c34658c35e72 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.124290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd2c0f-ff1e-4c89-abef-c34658c35e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.124561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd2c0f-ff1e-4c89-abef-c34658c35e72 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.125283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd2c0f-ff1e-4c89-abef-c34658c35e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.127200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd2c0f-ff1e-4c89-abef-c34658c35e72 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.147795 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3834/7699] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:57 2022] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:57.151834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85b3e-2729-4611-ad9f-63710606e129 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.162930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc85b3e-2729-4611-ad9f-63710606e129 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.167525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95468-6fa8-4c2f-add4-8ae5ba78536f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.168204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95468-6fa8-4c2f-add4-8ae5ba78536f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.168489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95468-6fa8-4c2f-add4-8ae5ba78536f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.168767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f95468-6fa8-4c2f-add4-8ae5ba78536f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.169483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95468-6fa8-4c2f-add4-8ae5ba78536f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.171072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f95468-6fa8-4c2f-add4-8ae5ba78536f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.181549 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3866/7700] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:57.185513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd2c0f-ff1e-4c89-abef-c34658c35e72 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.195593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd2c0f-ff1e-4c89-abef-c34658c35e72 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.200318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994f0f8-3049-4a06-aa65-bded8d54df60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.201014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994f0f8-3049-4a06-aa65-bded8d54df60 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.201273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994f0f8-3049-4a06-aa65-bded8d54df60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.201550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994f0f8-3049-4a06-aa65-bded8d54df60 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.202262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994f0f8-3049-4a06-aa65-bded8d54df60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.204480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994f0f8-3049-4a06-aa65-bded8d54df60 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.215962 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3835/7701] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:15:57.219431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95468-6fa8-4c2f-add4-8ae5ba78536f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.231354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f95468-6fa8-4c2f-add4-8ae5ba78536f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.237598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17916ac9-24fa-4492-a2a0-e8cc9b8e28ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.239392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17916ac9-24fa-4492-a2a0-e8cc9b8e28ab admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.239693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17916ac9-24fa-4492-a2a0-e8cc9b8e28ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.240001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17916ac9-24fa-4492-a2a0-e8cc9b8e28ab admin admin] PATH_INFO: `/v3/projects/d20c15c48d634c78aefae709893a5063/users/03edd71479c142e599948f86041a6322/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.259136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17916ac9-24fa-4492-a2a0-e8cc9b8e28ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d20c15c48d634c78aefae709893a5063, user_id=03edd71479c142e599948f86041a6322, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.262211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17916ac9-24fa-4492-a2a0-e8cc9b8e28ab admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.277362 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3867/7702] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:57 2022] PUT /identity/v3/projects/d20c15c48d634c78aefae709893a5063/users/03edd71479c142e599948f86041a6322/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:57.288469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c6bf3-a165-4154-b7f9-1bcdca10908b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.288954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c6bf3-a165-4154-b7f9-1bcdca10908b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.289292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c6bf3-a165-4154-b7f9-1bcdca10908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.318236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a73c6bf3-a165-4154-b7f9-1bcdca10908b None None] MFA Rules not processed for user `03edd71479c142e599948f86041a6322`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:57.319686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a73c6bf3-a165-4154-b7f9-1bcdca10908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:57.388472 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3836/7703] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:57.393989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17916ac9-24fa-4492-a2a0-e8cc9b8e28ab admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.459461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17916ac9-24fa-4492-a2a0-e8cc9b8e28ab admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.464474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1371f58-62d1-4b3b-86f3-6005bb6a3ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.465134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1371f58-62d1-4b3b-86f3-6005bb6a3ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.465495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1371f58-62d1-4b3b-86f3-6005bb6a3ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.465856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1371f58-62d1-4b3b-86f3-6005bb6a3ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.466623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1371f58-62d1-4b3b-86f3-6005bb6a3ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.468820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1371f58-62d1-4b3b-86f3-6005bb6a3ee3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.497930 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3868/7704] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:15:57 2022] POST /identity/v3/projects => generated 411 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:15:57.499172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c6bf3-a165-4154-b7f9-1bcdca10908b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.513920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c6bf3-a165-4154-b7f9-1bcdca10908b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.573121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a431c1-f389-40df-81b2-be383e302b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.573888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a431c1-f389-40df-81b2-be383e302b85 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.574236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a431c1-f389-40df-81b2-be383e302b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.574527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a431c1-f389-40df-81b2-be383e302b85 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.575255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a431c1-f389-40df-81b2-be383e302b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.577311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a431c1-f389-40df-81b2-be383e302b85 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.602697 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3837/7705] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:15:57 2022] POST /identity/v3/users => generated 312 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:15:57.603947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1371f58-62d1-4b3b-86f3-6005bb6a3ee3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.616319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1371f58-62d1-4b3b-86f3-6005bb6a3ee3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.622105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c8fd7-bcff-4ed7-917e-61b6f82599af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.622798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c8fd7-bcff-4ed7-917e-61b6f82599af admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.623050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c8fd7-bcff-4ed7-917e-61b6f82599af admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.623355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c8fd7-bcff-4ed7-917e-61b6f82599af admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.624085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c8fd7-bcff-4ed7-917e-61b6f82599af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.626218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c8fd7-bcff-4ed7-917e-61b6f82599af admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.637765 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3869/7706] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:57.642714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a431c1-f389-40df-81b2-be383e302b85 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.654430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a431c1-f389-40df-81b2-be383e302b85 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.660076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9016e-2683-4f09-ac4f-b7b73b28b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.660968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9016e-2683-4f09-ac4f-b7b73b28b3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.661235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9016e-2683-4f09-ac4f-b7b73b28b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.661522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9016e-2683-4f09-ac4f-b7b73b28b3c9 admin admin] PATH_INFO: `/v3/projects/ff30643ff0c841c6bf8731e7dcd0e1c7/users/2ef61eb079b54a109f7ffd9984187682/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.678997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9016e-2683-4f09-ac4f-b7b73b28b3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff30643ff0c841c6bf8731e7dcd0e1c7, user_id=2ef61eb079b54a109f7ffd9984187682, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.681842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9016e-2683-4f09-ac4f-b7b73b28b3c9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.697031 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3838/7707] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:57 2022] PUT /identity/v3/projects/ff30643ff0c841c6bf8731e7dcd0e1c7/users/2ef61eb079b54a109f7ffd9984187682/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:57.701104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c8fd7-bcff-4ed7-917e-61b6f82599af admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.711526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c8fd7-bcff-4ed7-917e-61b6f82599af admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.764845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4afe12-e20a-47e8-94ed-6f3a46ac6f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.766133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4afe12-e20a-47e8-94ed-6f3a46ac6f2d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.766420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4afe12-e20a-47e8-94ed-6f3a46ac6f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.766700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4afe12-e20a-47e8-94ed-6f3a46ac6f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.767417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4afe12-e20a-47e8-94ed-6f3a46ac6f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.769065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4afe12-e20a-47e8-94ed-6f3a46ac6f2d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.778523 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3870/7708] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:15:57.782944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9016e-2683-4f09-ac4f-b7b73b28b3c9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:57.793462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9016e-2683-4f09-ac4f-b7b73b28b3c9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:57.798690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8d95-e144-4783-b256-b42705d9a46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:57.799598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8d95-e144-4783-b256-b42705d9a46b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.799881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8d95-e144-4783-b256-b42705d9a46b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.800192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8d95-e144-4783-b256-b42705d9a46b admin admin] PATH_INFO: `/v3/projects/ff30643ff0c841c6bf8731e7dcd0e1c7/users/2ef61eb079b54a109f7ffd9984187682/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.802224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf8d95-e144-4783-b256-b42705d9a46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff30643ff0c841c6bf8731e7dcd0e1c7, user_id=2ef61eb079b54a109f7ffd9984187682, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:57.806536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf8d95-e144-4783-b256-b42705d9a46b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:57.818046 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3839/7709] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:15:57 2022] PUT /identity/v3/projects/ff30643ff0c841c6bf8731e7dcd0e1c7/users/2ef61eb079b54a109f7ffd9984187682/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:57.905200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b314004-d3e4-4271-8301-6c9e64802a4a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:57.905430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b314004-d3e4-4271-8301-6c9e64802a4a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:57.905672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b314004-d3e4-4271-8301-6c9e64802a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:57.935993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5b314004-d3e4-4271-8301-6c9e64802a4a None None] MFA Rules not processed for user `2ef61eb079b54a109f7ffd9984187682`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:57.937280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b314004-d3e4-4271-8301-6c9e64802a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:58.004647 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3871/7710] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:57 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:58.015955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8d95-e144-4783-b256-b42705d9a46b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:58.017681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-addf8d95-e144-4783-b256-b42705d9a46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:58.077972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8d95-e144-4783-b256-b42705d9a46b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:58.081615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b71e69-f8e3-437b-9a5e-cbe5f10f1a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:58.082256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71e69-f8e3-437b-9a5e-cbe5f10f1a76 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:58.082545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71e69-f8e3-437b-9a5e-cbe5f10f1a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:58.082828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b71e69-f8e3-437b-9a5e-cbe5f10f1a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:58.091793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b71e69-f8e3-437b-9a5e-cbe5f10f1a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:58.093274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b71e69-f8e3-437b-9a5e-cbe5f10f1a76 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:58.102563 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3840/7711] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:58 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:58.448107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b314004-d3e4-4271-8301-6c9e64802a4a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:58.449606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b314004-d3e4-4271-8301-6c9e64802a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:58.514417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b314004-d3e4-4271-8301-6c9e64802a4a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:58.519893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:58.520817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:58.521099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:58.521376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] PATH_INFO: `/v3/users/abfa602e90e24ed599dd3afc4dcfac55` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:58.522564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfa602e90e24ed599dd3afc4dcfac55)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:58.524537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:58.572448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfa602e90e24ed599dd3afc4dcfac55'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:58.580078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfa602e90e24ed599dd3afc4dcfac55'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:58.580794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfa602e90e24ed599dd3afc4dcfac55'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:58.581417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfa602e90e24ed599dd3afc4dcfac55'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:58.588837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfa602e90e24ed599dd3afc4dcfac55'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:58.606837 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3872/7712] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:58 2022] DELETE /identity/v3/users/abfa602e90e24ed599dd3afc4dcfac55 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:58.611901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac7070-d871-4740-b067-1b66cf0987d1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:58.612219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac7070-d871-4740-b067-1b66cf0987d1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:58.612496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac7070-d871-4740-b067-1b66cf0987d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:58.630456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bdac7070-d871-4740-b067-1b66cf0987d1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:58.631840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bdac7070-d871-4740-b067-1b66cf0987d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:58.693076 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3841/7713] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:15:58.702568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:58.705179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:58.764379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0b2dd-36de-4b64-851b-86817dffacee admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:58.768734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92781107-b959-430d-ae81-343aece30738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:58.769376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92781107-b959-430d-ae81-343aece30738 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:58.769655 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92781107-b959-430d-ae81-343aece30738 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:58.769927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92781107-b959-430d-ae81-343aece30738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:58.790811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92781107-b959-430d-ae81-343aece30738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:58.792314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92781107-b959-430d-ae81-343aece30738 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:58.802320 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3873/7714] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:15:59.072600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac7070-d871-4740-b067-1b66cf0987d1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:59.074876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bdac7070-d871-4740-b067-1b66cf0987d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:59.090260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac7070-d871-4740-b067-1b66cf0987d1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:59.095252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:59.096487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:59.096805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:59.097091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] PATH_INFO: `/v3/projects/805dc18820054dca83228dc85ce8101b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:59.098454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805dc18820054dca83228dc85ce8101b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:59.100330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:59.147656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805dc18820054dca83228dc85ce8101b', 'request_id': 'req-8f945e5f-907f-41d4-9da5-cbe84f849ab8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.155101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805dc18820054dca83228dc85ce8101b', 'request_id': 'req-8f945e5f-907f-41d4-9da5-cbe84f849ab8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.161469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805dc18820054dca83228dc85ce8101b', 'request_id': 'req-8f945e5f-907f-41d4-9da5-cbe84f849ab8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.175507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] The token cache is being invalidate because project 805dc18820054dca83228dc85ce8101b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:59.177972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.178975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.180875 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3842/7715] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:59 2022] DELETE /identity/v3/projects/805dc18820054dca83228dc85ce8101b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:59.184862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92781107-b959-430d-ae81-343aece30738 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:59.195508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92781107-b959-430d-ae81-343aece30738 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:59.261452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:59.262355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:59.262802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:59.263092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] PATH_INFO: `/v3/users/52c2398e259a495f9d71d5917bc7f8c7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:59.264407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c2398e259a495f9d71d5917bc7f8c7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:59.267037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:59.322138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c2398e259a495f9d71d5917bc7f8c7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.330078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c2398e259a495f9d71d5917bc7f8c7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.330828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c2398e259a495f9d71d5917bc7f8c7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.331440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c2398e259a495f9d71d5917bc7f8c7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.342041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-508937a8-faca-4305-a8a7-cfd028d6003e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c2398e259a495f9d71d5917bc7f8c7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.365487 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3874/7716] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:15:59 2022] DELETE /identity/v3/users/52c2398e259a495f9d71d5917bc7f8c7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:15:59.708309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:15:59.711557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:59.732798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f945e5f-907f-41d4-9da5-cbe84f849ab8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:15:59.792792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:15:59.794264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:59.794673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:59.795055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] PATH_INFO: `/v3/projects/8aaf2eb1095148abbedd3ee24df5d783` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:59.796399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aaf2eb1095148abbedd3ee24df5d783)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:15:59.798896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:15:59.846238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aaf2eb1095148abbedd3ee24df5d783', 'request_id': 'req-dc867b5b-b521-4da2-abba-8a247f74616e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.853299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aaf2eb1095148abbedd3ee24df5d783', 'request_id': 'req-dc867b5b-b521-4da2-abba-8a247f74616e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.858683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aaf2eb1095148abbedd3ee24df5d783', 'request_id': 'req-dc867b5b-b521-4da2-abba-8a247f74616e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.870658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] The token cache is being invalidate because project 8aaf2eb1095148abbedd3ee24df5d783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:15:59.870948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.871591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dc867b5b-b521-4da2-abba-8a247f74616e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:15:59.873139 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3843/7717] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:15:59 2022] DELETE /identity/v3/projects/8aaf2eb1095148abbedd3ee24df5d783 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:15:59.878077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e54dc-2399-43fb-be83-0cc9b8a20b55 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:59.878574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e54dc-2399-43fb-be83-0cc9b8a20b55 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:59.878672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e54dc-2399-43fb-be83-0cc9b8a20b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:59.897221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-951e54dc-2399-43fb-be83-0cc9b8a20b55 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:59.898466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-951e54dc-2399-43fb-be83-0cc9b8a20b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:15:59.962532 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3875/7718] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:15:59.973855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba93e-ceb0-4f26-8e39-0198645d49f0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:15:59.974511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba93e-ceb0-4f26-8e39-0198645d49f0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:15:59.974804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba93e-ceb0-4f26-8e39-0198645d49f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:15:59.996877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9cfba93e-ceb0-4f26-8e39-0198645d49f0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:15:59.998099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9cfba93e-ceb0-4f26-8e39-0198645d49f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:00.009595 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3844/7719] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:00.011328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e54dc-2399-43fb-be83-0cc9b8a20b55 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.023663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e54dc-2399-43fb-be83-0cc9b8a20b55 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.029481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febdef2-493f-479c-a694-4c83e6e4fe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.030169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febdef2-493f-479c-a694-4c83e6e4fe07 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.030571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febdef2-493f-479c-a694-4c83e6e4fe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.030856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febdef2-493f-479c-a694-4c83e6e4fe07 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.032205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febdef2-493f-479c-a694-4c83e6e4fe07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:00.032509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febdef2-493f-479c-a694-4c83e6e4fe07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.034156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febdef2-493f-479c-a694-4c83e6e4fe07 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.046650 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3876/7720] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:00.051898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba93e-ceb0-4f26-8e39-0198645d49f0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.070996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba93e-ceb0-4f26-8e39-0198645d49f0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.083650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea222ff-feb9-4ae2-9bf7-0a37e9157d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.084517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea222ff-feb9-4ae2-9bf7-0a37e9157d1f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.084862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea222ff-feb9-4ae2-9bf7-0a37e9157d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.085205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea222ff-feb9-4ae2-9bf7-0a37e9157d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.085971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea222ff-feb9-4ae2-9bf7-0a37e9157d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.088111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea222ff-feb9-4ae2-9bf7-0a37e9157d1f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.119389 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3845/7721] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:00 2022] POST /identity/v3/projects => generated 367 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:00.123306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febdef2-493f-479c-a694-4c83e6e4fe07 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.135190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febdef2-493f-479c-a694-4c83e6e4fe07 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.162779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea222ff-feb9-4ae2-9bf7-0a37e9157d1f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.165701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3ea222ff-feb9-4ae2-9bf7-0a37e9157d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:00.206430 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da529e7-a1ac-4551-911f-a257b6f3ed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.207108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da529e7-a1ac-4551-911f-a257b6f3ed60 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.207393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da529e7-a1ac-4551-911f-a257b6f3ed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.207674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da529e7-a1ac-4551-911f-a257b6f3ed60 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.208458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da529e7-a1ac-4551-911f-a257b6f3ed60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.210621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da529e7-a1ac-4551-911f-a257b6f3ed60 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.231733 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3877/7722] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:00 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:00.236646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da529e7-a1ac-4551-911f-a257b6f3ed60 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.240780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea222ff-feb9-4ae2-9bf7-0a37e9157d1f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.247307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da529e7-a1ac-4551-911f-a257b6f3ed60 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.247596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.248530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.248818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.249093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] PATH_INFO: `/v3/users/03edd71479c142e599948f86041a6322` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.251433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03edd71479c142e599948f86041a6322)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.253510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.255067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20aba-2021-4e67-ae7e-e8c9ca2a0523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.256349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20aba-2021-4e67-ae7e-e8c9ca2a0523 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.256556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20aba-2021-4e67-ae7e-e8c9ca2a0523 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.256893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e20aba-2021-4e67-ae7e-e8c9ca2a0523 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.261460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e20aba-2021-4e67-ae7e-e8c9ca2a0523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.261460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e20aba-2021-4e67-ae7e-e8c9ca2a0523 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.271959 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3878/7723] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:00.274951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20aba-2021-4e67-ae7e-e8c9ca2a0523 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.285594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e20aba-2021-4e67-ae7e-e8c9ca2a0523 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.291840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1703e-552e-42f2-aec0-698454a84ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.292715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1703e-552e-42f2-aec0-698454a84ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.292990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1703e-552e-42f2-aec0-698454a84ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.293337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef1703e-552e-42f2-aec0-698454a84ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.294151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1703e-552e-42f2-aec0-698454a84ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.295911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef1703e-552e-42f2-aec0-698454a84ed9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.303705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03edd71479c142e599948f86041a6322'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.308220 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3879/7724] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:00.312458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03edd71479c142e599948f86041a6322'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.313071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03edd71479c142e599948f86041a6322'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.313220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1703e-552e-42f2-aec0-698454a84ed9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.313778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03edd71479c142e599948f86041a6322'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.315120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8ef1703e-552e-42f2-aec0-698454a84ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:00.327557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6a353403-3a3f-4281-9fde-c60e6ffaf0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03edd71479c142e599948f86041a6322'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.332044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef1703e-552e-42f2-aec0-698454a84ed9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.337615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d3b5-fd14-41b4-afe9-f7885c6b9b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.338499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d3b5-fd14-41b4-afe9-f7885c6b9b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.338779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d3b5-fd14-41b4-afe9-f7885c6b9b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.339079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d3b5-fd14-41b4-afe9-f7885c6b9b96 admin admin] PATH_INFO: `/v3/projects/1f3ceda47cd2400887c30cc23178dd80/users/545f02da7da54924963bb46c642a3752/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.341329 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3846/7725] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:00 2022] DELETE /identity/v3/users/03edd71479c142e599948f86041a6322 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:00.346344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb03bb4-2f5b-41bf-bc31-655e0c8f4a1f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.346636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb03bb4-2f5b-41bf-bc31-655e0c8f4a1f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.346915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb03bb4-2f5b-41bf-bc31-655e0c8f4a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.354561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d3b5-fd14-41b4-afe9-f7885c6b9b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f3ceda47cd2400887c30cc23178dd80, user_id=545f02da7da54924963bb46c642a3752, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.357317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d3b5-fd14-41b4-afe9-f7885c6b9b96 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.367682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0cb03bb4-2f5b-41bf-bc31-655e0c8f4a1f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:00.369060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0cb03bb4-2f5b-41bf-bc31-655e0c8f4a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:00.372119 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3880/7726] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:00 2022] PUT /identity/v3/projects/1f3ceda47cd2400887c30cc23178dd80/users/545f02da7da54924963bb46c642a3752/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:00.382892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022d0e9-7995-415c-964b-6b76ffac2368 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.383198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022d0e9-7995-415c-964b-6b76ffac2368 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.383451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022d0e9-7995-415c-964b-6b76ffac2368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.412965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6022d0e9-7995-415c-964b-6b76ffac2368 None None] MFA Rules not processed for user `545f02da7da54924963bb46c642a3752`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:00.414272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6022d0e9-7995-415c-964b-6b76ffac2368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:00.439076 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3847/7727] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:00.449912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb03bb4-2f5b-41bf-bc31-655e0c8f4a1f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.451344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0cb03bb4-2f5b-41bf-bc31-655e0c8f4a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:00.488706 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3881/7728] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:00.493060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022d0e9-7995-415c-964b-6b76ffac2368 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.504136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022d0e9-7995-415c-964b-6b76ffac2368 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.508729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61eff2-3cc9-4d82-9bfe-dbf8a24179f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.509364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61eff2-3cc9-4d82-9bfe-dbf8a24179f6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.509643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61eff2-3cc9-4d82-9bfe-dbf8a24179f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.509918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61eff2-3cc9-4d82-9bfe-dbf8a24179f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.510625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61eff2-3cc9-4d82-9bfe-dbf8a24179f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.512556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb03bb4-2f5b-41bf-bc31-655e0c8f4a1f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.512729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61eff2-3cc9-4d82-9bfe-dbf8a24179f6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.516956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbec7d-76e4-4d3e-ab32-029c1c65ac12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.517596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbec7d-76e4-4d3e-ab32-029c1c65ac12 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.517879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbec7d-76e4-4d3e-ab32-029c1c65ac12 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.518157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbec7d-76e4-4d3e-ab32-029c1c65ac12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.528362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbec7d-76e4-4d3e-ab32-029c1c65ac12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.530097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbec7d-76e4-4d3e-ab32-029c1c65ac12 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.539955 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3882/7729] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:00 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:00.542101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61eff2-3cc9-4d82-9bfe-dbf8a24179f6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.543043 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3848/7730] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:00.604051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61eff2-3cc9-4d82-9bfe-dbf8a24179f6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.608922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1c4e4-6496-4604-9613-681cf114a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.609589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c4e4-6496-4604-9613-681cf114a3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.609876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c4e4-6496-4604-9613-681cf114a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.610156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c4e4-6496-4604-9613-681cf114a3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.610870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1c4e4-6496-4604-9613-681cf114a3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.612857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1c4e4-6496-4604-9613-681cf114a3e6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.634071 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3883/7731] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:00 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:00.638210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbec7d-76e4-4d3e-ab32-029c1c65ac12 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.648731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbec7d-76e4-4d3e-ab32-029c1c65ac12 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.654240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d5fb3-c746-4121-a1c7-7b6d8d7d4a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.655012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d5fb3-c746-4121-a1c7-7b6d8d7d4a1b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.655682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d5fb3-c746-4121-a1c7-7b6d8d7d4a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.655682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d5fb3-c746-4121-a1c7-7b6d8d7d4a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.656270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d5fb3-c746-4121-a1c7-7b6d8d7d4a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.657859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d5fb3-c746-4121-a1c7-7b6d8d7d4a1b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.671449 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3849/7732] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:00.673051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1c4e4-6496-4604-9613-681cf114a3e6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.684115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1c4e4-6496-4604-9613-681cf114a3e6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.690175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf941a36-07f5-4ab4-9a9d-bedda2c560d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.691262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf941a36-07f5-4ab4-9a9d-bedda2c560d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.691693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf941a36-07f5-4ab4-9a9d-bedda2c560d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.692306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf941a36-07f5-4ab4-9a9d-bedda2c560d0 admin admin] PATH_INFO: `/v3/projects/63fa0d663a5c48b3b84f5c6a78b1c469/users/eed2f51ac06c463895d606329fb2105b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.708685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf941a36-07f5-4ab4-9a9d-bedda2c560d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fa0d663a5c48b3b84f5c6a78b1c469, user_id=eed2f51ac06c463895d606329fb2105b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.711472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf941a36-07f5-4ab4-9a9d-bedda2c560d0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.732012 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3884/7733] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:00 2022] PUT /identity/v3/projects/63fa0d663a5c48b3b84f5c6a78b1c469/users/eed2f51ac06c463895d606329fb2105b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:00.733503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d5fb3-c746-4121-a1c7-7b6d8d7d4a1b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.744041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d5fb3-c746-4121-a1c7-7b6d8d7d4a1b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.816306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668326cb-456e-4ce9-bf02-4c08d487ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.816977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668326cb-456e-4ce9-bf02-4c08d487ca1d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.817269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668326cb-456e-4ce9-bf02-4c08d487ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.817568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668326cb-456e-4ce9-bf02-4c08d487ca1d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.818292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668326cb-456e-4ce9-bf02-4c08d487ca1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.819978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668326cb-456e-4ce9-bf02-4c08d487ca1d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.832332 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3850/7734] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:00.836707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf941a36-07f5-4ab4-9a9d-bedda2c560d0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.846067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668326cb-456e-4ce9-bf02-4c08d487ca1d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.847981 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-668326cb-456e-4ce9-bf02-4c08d487ca1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:00.849405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf941a36-07f5-4ab4-9a9d-bedda2c560d0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.856269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39f177-a777-4008-bec6-728ec2c6308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.857578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39f177-a777-4008-bec6-728ec2c6308d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.857991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39f177-a777-4008-bec6-728ec2c6308d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.858339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39f177-a777-4008-bec6-728ec2c6308d admin admin] PATH_INFO: `/v3/projects/63fa0d663a5c48b3b84f5c6a78b1c469/users/eed2f51ac06c463895d606329fb2105b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.861769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39f177-a777-4008-bec6-728ec2c6308d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fa0d663a5c48b3b84f5c6a78b1c469, user_id=eed2f51ac06c463895d606329fb2105b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.865386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39f177-a777-4008-bec6-728ec2c6308d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.870007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668326cb-456e-4ce9-bf02-4c08d487ca1d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:00.878450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:00.879496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.879726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.880117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] PATH_INFO: `/v3/projects/d20c15c48d634c78aefae709893a5063` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.881432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d20c15c48d634c78aefae709893a5063)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:00.885392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:00.894173 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3885/7735] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:00 2022] PUT /identity/v3/projects/63fa0d663a5c48b3b84f5c6a78b1c469/users/eed2f51ac06c463895d606329fb2105b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:00.905190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c888a57-3ce1-4145-98c0-479c89a861bb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:00.905478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c888a57-3ce1-4145-98c0-479c89a861bb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:00.905760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c888a57-3ce1-4145-98c0-479c89a861bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:00.941230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7c888a57-3ce1-4145-98c0-479c89a861bb None None] MFA Rules not processed for user `eed2f51ac06c463895d606329fb2105b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:00.942620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7c888a57-3ce1-4145-98c0-479c89a861bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:00.949373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd20c15c48d634c78aefae709893a5063', 'request_id': 'req-30d92536-4c31-465b-bf6d-3077af621492'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.958973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd20c15c48d634c78aefae709893a5063', 'request_id': 'req-30d92536-4c31-465b-bf6d-3077af621492'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.969326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd20c15c48d634c78aefae709893a5063', 'request_id': 'req-30d92536-4c31-465b-bf6d-3077af621492'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.982775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] The token cache is being invalidate because project d20c15c48d634c78aefae709893a5063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:00.983338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.984882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:00.986677 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3851/7736] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:00 2022] DELETE /identity/v3/projects/d20c15c48d634c78aefae709893a5063 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:00.990348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:00.991742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:01.045393 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3886/7737] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:01.057838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c888a57-3ce1-4145-98c0-479c89a861bb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:01.059225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7c888a57-3ce1-4145-98c0-479c89a861bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:01.060013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d92536-4c31-465b-bf6d-3077af621492 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:01.068165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:01.070550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.070835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.071114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] PATH_INFO: `/v3/users/2ef61eb079b54a109f7ffd9984187682` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.072586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef61eb079b54a109f7ffd9984187682)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:01.074574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:01.129683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef61eb079b54a109f7ffd9984187682'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.130275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c888a57-3ce1-4145-98c0-479c89a861bb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:01.133059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e57d3a-6135-417f-8964-0f7feab195ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:01.133772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57d3a-6135-417f-8964-0f7feab195ad service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.134131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57d3a-6135-417f-8964-0f7feab195ad service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.134440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e57d3a-6135-417f-8964-0f7feab195ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.136571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef61eb079b54a109f7ffd9984187682'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.137188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef61eb079b54a109f7ffd9984187682'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.137805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef61eb079b54a109f7ffd9984187682'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.144567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e57d3a-6135-417f-8964-0f7feab195ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:01.146012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e57d3a-6135-417f-8964-0f7feab195ad service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:01.149708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-6cf4e282-87aa-47f5-bbb8-6c68b154a287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef61eb079b54a109f7ffd9984187682'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.155518 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3887/7738] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:01.162818 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3852/7739] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:00 2022] DELETE /identity/v3/users/2ef61eb079b54a109f7ffd9984187682 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:01.341140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e57d3a-6135-417f-8964-0f7feab195ad service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:01.360327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e57d3a-6135-417f-8964-0f7feab195ad service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:01.436829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:01.437730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.438021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.438355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] PATH_INFO: `/v3/projects/ff30643ff0c841c6bf8731e7dcd0e1c7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.439515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff30643ff0c841c6bf8731e7dcd0e1c7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:01.441525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:01.489242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff30643ff0c841c6bf8731e7dcd0e1c7', 'request_id': 'req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.509794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff30643ff0c841c6bf8731e7dcd0e1c7', 'request_id': 'req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.523350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff30643ff0c841c6bf8731e7dcd0e1c7', 'request_id': 'req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.538413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] The token cache is being invalidate because project ff30643ff0c841c6bf8731e7dcd0e1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:01.538636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.539346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4dc2076a-d5a2-49cc-ae87-b37c2719a7bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:01.541292 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3888/7740] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:01 2022] DELETE /identity/v3/projects/ff30643ff0c841c6bf8731e7dcd0e1c7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:01.547241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e86b-0f80-4a03-8f11-1ebe4239016d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.547528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e86b-0f80-4a03-8f11-1ebe4239016d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.547805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721e86b-0f80-4a03-8f11-1ebe4239016d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.566453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1721e86b-0f80-4a03-8f11-1ebe4239016d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:01.567692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1721e86b-0f80-4a03-8f11-1ebe4239016d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:01.629226 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3853/7741] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:01.637458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ba5a4-5c5f-4f14-833b-272a49e93b63 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.637780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ba5a4-5c5f-4f14-833b-272a49e93b63 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.638067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ba5a4-5c5f-4f14-833b-272a49e93b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.657457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0e1ba5a4-5c5f-4f14-833b-272a49e93b63 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:01.658658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0e1ba5a4-5c5f-4f14-833b-272a49e93b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:01.666581 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3889/7742] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:01.671047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721e86b-0f80-4a03-8f11-1ebe4239016d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:01.681204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721e86b-0f80-4a03-8f11-1ebe4239016d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:01.685869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b627c-d2c7-4446-a9d2-ae09c32bd460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:01.686519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b627c-d2c7-4446-a9d2-ae09c32bd460 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.686803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b627c-d2c7-4446-a9d2-ae09c32bd460 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.687123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b627c-d2c7-4446-a9d2-ae09c32bd460 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.687841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b627c-d2c7-4446-a9d2-ae09c32bd460 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:01.688184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b627c-d2c7-4446-a9d2-ae09c32bd460 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:01.689793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b627c-d2c7-4446-a9d2-ae09c32bd460 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:01.702554 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3854/7743] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:01.707247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ba5a4-5c5f-4f14-833b-272a49e93b63 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:01.720162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ba5a4-5c5f-4f14-833b-272a49e93b63 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:01.725776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8882-cdf3-47e6-9f68-b13e1b7692aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:01.726425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8882-cdf3-47e6-9f68-b13e1b7692aa admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.726708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8882-cdf3-47e6-9f68-b13e1b7692aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.726983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d8882-cdf3-47e6-9f68-b13e1b7692aa admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.727662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d8882-cdf3-47e6-9f68-b13e1b7692aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:01.729613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4d8882-cdf3-47e6-9f68-b13e1b7692aa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:01.754009 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3890/7744] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:01 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:01.757900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b627c-d2c7-4446-a9d2-ae09c32bd460 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:01.768507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b627c-d2c7-4446-a9d2-ae09c32bd460 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:01.827260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d9405-fe11-405d-8d50-2f702247babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:01.828637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d9405-fe11-405d-8d50-2f702247babb admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.828926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d9405-fe11-405d-8d50-2f702247babb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.829345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d9405-fe11-405d-8d50-2f702247babb admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.830022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d9405-fe11-405d-8d50-2f702247babb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:01.832017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d9405-fe11-405d-8d50-2f702247babb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:01.854961 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3855/7745] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:01 2022] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:01.859036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8882-cdf3-47e6-9f68-b13e1b7692aa admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:01.870233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d8882-cdf3-47e6-9f68-b13e1b7692aa admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:01.878872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccba3fe-f5f7-4ed9-9b5f-fda0b29c2b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:01.879614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccba3fe-f5f7-4ed9-9b5f-fda0b29c2b5f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.880043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccba3fe-f5f7-4ed9-9b5f-fda0b29c2b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.880323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccba3fe-f5f7-4ed9-9b5f-fda0b29c2b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.881045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccba3fe-f5f7-4ed9-9b5f-fda0b29c2b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:01.882652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccba3fe-f5f7-4ed9-9b5f-fda0b29c2b5f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:01.897853 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3891/7746] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:01.899330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d9405-fe11-405d-8d50-2f702247babb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:01.909588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d9405-fe11-405d-8d50-2f702247babb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:01.914679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56fbf2-c79a-45fd-97cd-ebe4c005d2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:01.915515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56fbf2-c79a-45fd-97cd-ebe4c005d2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.915802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56fbf2-c79a-45fd-97cd-ebe4c005d2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.916209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56fbf2-c79a-45fd-97cd-ebe4c005d2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.916843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56fbf2-c79a-45fd-97cd-ebe4c005d2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:01.918683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56fbf2-c79a-45fd-97cd-ebe4c005d2b3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:01.932169 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3856/7747] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:01.933369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccba3fe-f5f7-4ed9-9b5f-fda0b29c2b5f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:01.943779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccba3fe-f5f7-4ed9-9b5f-fda0b29c2b5f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:01.948401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d056049-18e7-46e6-8028-4b5f893ac3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:01.949302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d056049-18e7-46e6-8028-4b5f893ac3da admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.949580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d056049-18e7-46e6-8028-4b5f893ac3da admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.949854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d056049-18e7-46e6-8028-4b5f893ac3da admin admin] PATH_INFO: `/v3/projects/40119a50bd964bada5478be68d939c0f/users/0596e29d92be40ecac9b52f446d1aada/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:01.965630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d056049-18e7-46e6-8028-4b5f893ac3da admin admin] RBAC: Authorizing `identity:create_grant(project_id=40119a50bd964bada5478be68d939c0f, user_id=0596e29d92be40ecac9b52f446d1aada, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:01.968794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d056049-18e7-46e6-8028-4b5f893ac3da admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:01.981957 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3892/7748] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:01 2022] PUT /identity/v3/projects/40119a50bd964bada5478be68d939c0f/users/0596e29d92be40ecac9b52f446d1aada/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:01.986949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e3c8-aa3f-4682-b12c-3f6eb196a99b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:01.987279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e3c8-aa3f-4682-b12c-3f6eb196a99b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:01.987617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3e3c8-aa3f-4682-b12c-3f6eb196a99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:02.006039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-06c3e3c8-aa3f-4682-b12c-3f6eb196a99b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:02.007446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-06c3e3c8-aa3f-4682-b12c-3f6eb196a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:02.073515 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3857/7749] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:02.084039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d056049-18e7-46e6-8028-4b5f893ac3da admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:02.085888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3d056049-18e7-46e6-8028-4b5f893ac3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:02.148609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d056049-18e7-46e6-8028-4b5f893ac3da admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:02.153287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164780eb-eab9-423b-b289-873b58087782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:02.154038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164780eb-eab9-423b-b289-873b58087782 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:02.154416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164780eb-eab9-423b-b289-873b58087782 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:02.154806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164780eb-eab9-423b-b289-873b58087782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:02.165137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164780eb-eab9-423b-b289-873b58087782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:02.166971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164780eb-eab9-423b-b289-873b58087782 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:02.176981 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3893/7750] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:02.498620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e3c8-aa3f-4682-b12c-3f6eb196a99b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:02.500693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-06c3e3c8-aa3f-4682-b12c-3f6eb196a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:02.513361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3e3c8-aa3f-4682-b12c-3f6eb196a99b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:02.518484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:02.519365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:02.519630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:02.519935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] PATH_INFO: `/v3/users/545f02da7da54924963bb46c642a3752` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:02.521150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=545f02da7da54924963bb46c642a3752)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:02.523147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:02.575135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '545f02da7da54924963bb46c642a3752'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:02.587386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '545f02da7da54924963bb46c642a3752'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:02.588252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '545f02da7da54924963bb46c642a3752'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:02.588936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '545f02da7da54924963bb46c642a3752'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:02.603352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '545f02da7da54924963bb46c642a3752'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:02.619366 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3858/7751] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:02 2022] DELETE /identity/v3/users/545f02da7da54924963bb46c642a3752 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:02.624088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a46ef-7847-40ca-b993-9dc259d92d08 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:02.624373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a46ef-7847-40ca-b993-9dc259d92d08 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:02.625679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a46ef-7847-40ca-b993-9dc259d92d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:02.644894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e07a46ef-7847-40ca-b993-9dc259d92d08 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:02.646158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e07a46ef-7847-40ca-b993-9dc259d92d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:02.704570 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3894/7752] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:02.728342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:02.729995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:02.801826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16686596-4cb9-4e9a-b342-1b8766e05b11 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:02.806490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d754441-abd3-4806-8020-627ea5da2f4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:02.807889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754441-abd3-4806-8020-627ea5da2f4e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:02.808441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754441-abd3-4806-8020-627ea5da2f4e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:02.808733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d754441-abd3-4806-8020-627ea5da2f4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:02.819515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d754441-abd3-4806-8020-627ea5da2f4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:02.821136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d754441-abd3-4806-8020-627ea5da2f4e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:02.831962 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3859/7753] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:02.873324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe41f1-2531-4913-bff3-9e27b3005378 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:02.873656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe41f1-2531-4913-bff3-9e27b3005378 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:02.873899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe41f1-2531-4913-bff3-9e27b3005378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:02.916271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6dfe41f1-2531-4913-bff3-9e27b3005378 None None] MFA Rules not processed for user `0596e29d92be40ecac9b52f446d1aada`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:02.918571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6dfe41f1-2531-4913-bff3-9e27b3005378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:03.003357 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3895/7754] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:02 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:03.010781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d754441-abd3-4806-8020-627ea5da2f4e service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:03.012858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d754441-abd3-4806-8020-627ea5da2f4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:03.034285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d754441-abd3-4806-8020-627ea5da2f4e service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:03.039498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3416-48d9-44f9-9af5-decb9761d37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:03.040390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3416-48d9-44f9-9af5-decb9761d37d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:03.040795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3416-48d9-44f9-9af5-decb9761d37d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:03.041151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e3416-48d9-44f9-9af5-decb9761d37d admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:03.041911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e3416-48d9-44f9-9af5-decb9761d37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:03.044902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283e3416-48d9-44f9-9af5-decb9761d37d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:03.080192 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3860/7755] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:03 2022] POST /identity/v3/projects => generated 403 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:03.081528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe41f1-2531-4913-bff3-9e27b3005378 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:03.092760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe41f1-2531-4913-bff3-9e27b3005378 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:03.171774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169eee4-3db8-402a-8ce4-21d529cf40dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:03.172566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169eee4-3db8-402a-8ce4-21d529cf40dc admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:03.172918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169eee4-3db8-402a-8ce4-21d529cf40dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:03.173267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d169eee4-3db8-402a-8ce4-21d529cf40dc admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:03.174036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169eee4-3db8-402a-8ce4-21d529cf40dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:03.176792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d169eee4-3db8-402a-8ce4-21d529cf40dc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:03.211027 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3896/7756] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:03 2022] POST /identity/v3/users => generated 308 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:03.212612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3416-48d9-44f9-9af5-decb9761d37d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:03.224941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283e3416-48d9-44f9-9af5-decb9761d37d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:03.231363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23964973-22f6-4b2b-8c92-4a8ca746ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:03.232225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964973-22f6-4b2b-8c92-4a8ca746ac14 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:03.232616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964973-22f6-4b2b-8c92-4a8ca746ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:03.232997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23964973-22f6-4b2b-8c92-4a8ca746ac14 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:03.233845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23964973-22f6-4b2b-8c92-4a8ca746ac14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:03.235731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23964973-22f6-4b2b-8c92-4a8ca746ac14 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:03.250284 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3861/7757] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:03.254301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169eee4-3db8-402a-8ce4-21d529cf40dc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:03.265776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d169eee4-3db8-402a-8ce4-21d529cf40dc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:03.271412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6cd21-dabc-4b4c-a4b0-909839516cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:03.271941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6cd21-dabc-4b4c-a4b0-909839516cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:03.272239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6cd21-dabc-4b4c-a4b0-909839516cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:03.272528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6cd21-dabc-4b4c-a4b0-909839516cdf admin admin] PATH_INFO: `/v3/projects/24864e5771c342dab4306d14390ea893/users/3226be58c92841508306050910b7cecd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:03.304913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6cd21-dabc-4b4c-a4b0-909839516cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=24864e5771c342dab4306d14390ea893, user_id=3226be58c92841508306050910b7cecd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:03.308624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6cd21-dabc-4b4c-a4b0-909839516cdf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:03.319314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23964973-22f6-4b2b-8c92-4a8ca746ac14 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:03.326284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-23964973-22f6-4b2b-8c92-4a8ca746ac14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:03.340836 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3897/7758] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:03 2022] PUT /identity/v3/projects/24864e5771c342dab4306d14390ea893/users/3226be58c92841508306050910b7cecd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:03.346219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6cd21-dabc-4b4c-a4b0-909839516cdf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:03.357732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23964973-22f6-4b2b-8c92-4a8ca746ac14 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:03.435694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6cd21-dabc-4b4c-a4b0-909839516cdf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:03.443476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e16952-8416-4955-ba52-f3c048965dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:03.444535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e16952-8416-4955-ba52-f3c048965dbd admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:03.445048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e16952-8416-4955-ba52-f3c048965dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:03.445512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e16952-8416-4955-ba52-f3c048965dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:03.446450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e16952-8416-4955-ba52-f3c048965dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:03.448444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e16952-8416-4955-ba52-f3c048965dbd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:03.470316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:03.471167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:03.471466 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3898/7759] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:03.472555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e16952-8416-4955-ba52-f3c048965dbd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:03.474012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:03.474210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] PATH_INFO: `/v3/projects/1f3ceda47cd2400887c30cc23178dd80` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:03.477831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f3ceda47cd2400887c30cc23178dd80)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:03.481746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:03.490238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e16952-8416-4955-ba52-f3c048965dbd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:03.498134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dac330-9646-47df-8304-9bca2611a2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:03.499347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dac330-9646-47df-8304-9bca2611a2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:03.500444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dac330-9646-47df-8304-9bca2611a2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:03.500916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dac330-9646-47df-8304-9bca2611a2b3 admin admin] PATH_INFO: `/v3/projects/24864e5771c342dab4306d14390ea893/users/3226be58c92841508306050910b7cecd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:03.503736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dac330-9646-47df-8304-9bca2611a2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24864e5771c342dab4306d14390ea893, user_id=3226be58c92841508306050910b7cecd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:03.507001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dac330-9646-47df-8304-9bca2611a2b3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:03.523573 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3899/7760] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:03 2022] PUT /identity/v3/projects/24864e5771c342dab4306d14390ea893/users/3226be58c92841508306050910b7cecd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:03.548627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f3ceda47cd2400887c30cc23178dd80', 'request_id': 'req-2135465c-dcbd-4f06-850e-7ef0c3808657'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.558388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f3ceda47cd2400887c30cc23178dd80', 'request_id': 'req-2135465c-dcbd-4f06-850e-7ef0c3808657'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.568566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f3ceda47cd2400887c30cc23178dd80', 'request_id': 'req-2135465c-dcbd-4f06-850e-7ef0c3808657'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.582872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] The token cache is being invalidate because project 1f3ceda47cd2400887c30cc23178dd80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:03.583671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.584762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.587133 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3862/7761] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:03 2022] DELETE /identity/v3/projects/1f3ceda47cd2400887c30cc23178dd80 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:03.590887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dac330-9646-47df-8304-9bca2611a2b3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:03.593136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-35dac330-9646-47df-8304-9bca2611a2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:03.678213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dac330-9646-47df-8304-9bca2611a2b3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:03.762175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:03.763316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:03.763910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:03.764380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] PATH_INFO: `/v3/users/eed2f51ac06c463895d606329fb2105b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:03.766381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed2f51ac06c463895d606329fb2105b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:03.768566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:03.833843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed2f51ac06c463895d606329fb2105b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.858009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed2f51ac06c463895d606329fb2105b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.860450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed2f51ac06c463895d606329fb2105b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.861570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed2f51ac06c463895d606329fb2105b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.873827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a8ca4d8-f44a-477b-bb11-6b6df8784dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed2f51ac06c463895d606329fb2105b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:03.903530 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3900/7762] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:03 2022] DELETE /identity/v3/users/eed2f51ac06c463895d606329fb2105b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:04.442685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:04.455404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135465c-dcbd-4f06-850e-7ef0c3808657 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:04.491875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468b642-3d45-4015-b033-818f6a79b293 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:04.492526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468b642-3d45-4015-b033-818f6a79b293 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:04.492526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468b642-3d45-4015-b033-818f6a79b293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:04.527671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c468b642-3d45-4015-b033-818f6a79b293 None None] MFA Rules not processed for user `3226be58c92841508306050910b7cecd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:04.528940 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c468b642-3d45-4015-b033-818f6a79b293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:04.556280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:04.558089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:04.558564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:04.559030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] PATH_INFO: `/v3/projects/63fa0d663a5c48b3b84f5c6a78b1c469` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:04.560473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fa0d663a5c48b3b84f5c6a78b1c469)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:04.562678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:04.615403 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3901/7763] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:04.644515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fa0d663a5c48b3b84f5c6a78b1c469', 'request_id': 'req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:04.664694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fa0d663a5c48b3b84f5c6a78b1c469', 'request_id': 'req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:04.676445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fa0d663a5c48b3b84f5c6a78b1c469', 'request_id': 'req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:04.696584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] The token cache is being invalidate because project 63fa0d663a5c48b3b84f5c6a78b1c469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:04.697219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:04.698112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-07460cd4-ea1f-4a5a-8c61-81996d2d2df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:04.700402 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3863/7764] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:04 2022] DELETE /identity/v3/projects/63fa0d663a5c48b3b84f5c6a78b1c469 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:04.705538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83159d35-2471-4888-866e-4c2249b0bcf5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:04.705922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83159d35-2471-4888-866e-4c2249b0bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:04.706129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83159d35-2471-4888-866e-4c2249b0bcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:04.728928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-83159d35-2471-4888-866e-4c2249b0bcf5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:04.730744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-83159d35-2471-4888-866e-4c2249b0bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:04.847818 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3902/7765] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:04.849604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006e4e-8430-4f06-8d2c-26ef51eee91c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:04.849891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006e4e-8430-4f06-8d2c-26ef51eee91c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:04.850191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c006e4e-8430-4f06-8d2c-26ef51eee91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:04.872002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7c006e4e-8430-4f06-8d2c-26ef51eee91c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:04.873278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7c006e4e-8430-4f06-8d2c-26ef51eee91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:04.884321 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3864/7766] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:04.889096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83159d35-2471-4888-866e-4c2249b0bcf5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:04.901945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83159d35-2471-4888-866e-4c2249b0bcf5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:04.908518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d90d2-85a3-421b-92b9-45c2a4922ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:04.909192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d90d2-85a3-421b-92b9-45c2a4922ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:04.909517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d90d2-85a3-421b-92b9-45c2a4922ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:04.909802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d90d2-85a3-421b-92b9-45c2a4922ff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:04.910722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d90d2-85a3-421b-92b9-45c2a4922ff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:04.911026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d90d2-85a3-421b-92b9-45c2a4922ff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:04.912676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d90d2-85a3-421b-92b9-45c2a4922ff7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:04.930759 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3903/7767] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:04.936627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006e4e-8430-4f06-8d2c-26ef51eee91c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:04.952977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c006e4e-8430-4f06-8d2c-26ef51eee91c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:04.958953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9df6a7-5f15-46f8-9001-7d3d96412446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:04.959719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df6a7-5f15-46f8-9001-7d3d96412446 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:04.960047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df6a7-5f15-46f8-9001-7d3d96412446 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:04.960248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df6a7-5f15-46f8-9001-7d3d96412446 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:04.961085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9df6a7-5f15-46f8-9001-7d3d96412446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:04.963406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9df6a7-5f15-46f8-9001-7d3d96412446 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:04.999710 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3865/7768] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:04 2022] POST /identity/v3/projects => generated 401 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:05.004236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d90d2-85a3-421b-92b9-45c2a4922ff7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.042243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d90d2-85a3-421b-92b9-45c2a4922ff7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.119579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f1e4-b1fd-45d5-880f-b80f34016857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.120807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f1e4-b1fd-45d5-880f-b80f34016857 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.121157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f1e4-b1fd-45d5-880f-b80f34016857 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.121439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f1e4-b1fd-45d5-880f-b80f34016857 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.122181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8f1e4-b1fd-45d5-880f-b80f34016857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.124441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8f1e4-b1fd-45d5-880f-b80f34016857 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.151192 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3904/7769] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:05 2022] POST /identity/v3/users => generated 301 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:05.154890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9df6a7-5f15-46f8-9001-7d3d96412446 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.170422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9df6a7-5f15-46f8-9001-7d3d96412446 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.177797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafbed6-37e2-4672-bd0b-78d651605187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.178745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafbed6-37e2-4672-bd0b-78d651605187 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.179051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafbed6-37e2-4672-bd0b-78d651605187 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.179319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafbed6-37e2-4672-bd0b-78d651605187 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.180179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafbed6-37e2-4672-bd0b-78d651605187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.182003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafbed6-37e2-4672-bd0b-78d651605187 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.194086 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3866/7770] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:05.197727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f1e4-b1fd-45d5-880f-b80f34016857 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.210677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f1e4-b1fd-45d5-880f-b80f34016857 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.221135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b939d-3634-4c7d-932a-333a4d7da1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.225315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b939d-3634-4c7d-932a-333a4d7da1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.225785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b939d-3634-4c7d-932a-333a4d7da1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.226381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b939d-3634-4c7d-932a-333a4d7da1e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.227896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b939d-3634-4c7d-932a-333a4d7da1e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.231418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b939d-3634-4c7d-932a-333a4d7da1e9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.252773 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3905/7771] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:05.257354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafbed6-37e2-4672-bd0b-78d651605187 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.271082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafbed6-37e2-4672-bd0b-78d651605187 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.276458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e735-03e8-4d90-903f-64a30dc542e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.277586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e735-03e8-4d90-903f-64a30dc542e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.277975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e735-03e8-4d90-903f-64a30dc542e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.278351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d234e735-03e8-4d90-903f-64a30dc542e3 admin admin] PATH_INFO: `/v3/projects/f8690b216640459c93f31e499a14b364/users/00eed1658e37429c9aa2ac02e3e49c68/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.298259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234e735-03e8-4d90-903f-64a30dc542e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8690b216640459c93f31e499a14b364, user_id=00eed1658e37429c9aa2ac02e3e49c68, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.301205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d234e735-03e8-4d90-903f-64a30dc542e3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.320959 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3867/7772] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:05 2022] PUT /identity/v3/projects/f8690b216640459c93f31e499a14b364/users/00eed1658e37429c9aa2ac02e3e49c68/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:05.332705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966531cc-ec5a-477f-b1b4-9ba043050ab0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.333068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966531cc-ec5a-477f-b1b4-9ba043050ab0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.333534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966531cc-ec5a-477f-b1b4-9ba043050ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.363852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-966531cc-ec5a-477f-b1b4-9ba043050ab0 None None] MFA Rules not processed for user `00eed1658e37429c9aa2ac02e3e49c68`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:05.365220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-966531cc-ec5a-477f-b1b4-9ba043050ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:05.433817 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3906/7773] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:05.438499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e735-03e8-4d90-903f-64a30dc542e3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.515878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d234e735-03e8-4d90-903f-64a30dc542e3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.523276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321415b-35bf-4238-8095-193bf07823c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.524147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321415b-35bf-4238-8095-193bf07823c2 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.524524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321415b-35bf-4238-8095-193bf07823c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.525189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321415b-35bf-4238-8095-193bf07823c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.526124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321415b-35bf-4238-8095-193bf07823c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.528387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321415b-35bf-4238-8095-193bf07823c2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.559954 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3868/7774] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:05 2022] POST /identity/v3/projects => generated 399 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:05.563213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966531cc-ec5a-477f-b1b4-9ba043050ab0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.574250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966531cc-ec5a-477f-b1b4-9ba043050ab0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.639870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee83c2a-b147-4420-82bd-2bcb66a565fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.641383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee83c2a-b147-4420-82bd-2bcb66a565fa admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.641885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee83c2a-b147-4420-82bd-2bcb66a565fa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.642175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee83c2a-b147-4420-82bd-2bcb66a565fa admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.642919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee83c2a-b147-4420-82bd-2bcb66a565fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.644965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee83c2a-b147-4420-82bd-2bcb66a565fa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.666422 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3907/7775] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:05 2022] POST /identity/v3/users => generated 306 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:05.670510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321415b-35bf-4238-8095-193bf07823c2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.681270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321415b-35bf-4238-8095-193bf07823c2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.685904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fbdcd-e025-41a6-9e0a-197cb5992560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.686644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fbdcd-e025-41a6-9e0a-197cb5992560 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.687517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fbdcd-e025-41a6-9e0a-197cb5992560 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.687859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fbdcd-e025-41a6-9e0a-197cb5992560 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.688677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fbdcd-e025-41a6-9e0a-197cb5992560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.690382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fbdcd-e025-41a6-9e0a-197cb5992560 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.704434 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3869/7776] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:05.714669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee83c2a-b147-4420-82bd-2bcb66a565fa admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.726183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee83c2a-b147-4420-82bd-2bcb66a565fa admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.730950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167f05f-b965-44af-8f04-6b6326f17178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.731901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167f05f-b965-44af-8f04-6b6326f17178 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.732312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167f05f-b965-44af-8f04-6b6326f17178 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.732661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167f05f-b965-44af-8f04-6b6326f17178 admin admin] PATH_INFO: `/v3/projects/f0596cc92b0f42dfaed5a78bf048650a/users/50e73dffa225465183c5c1a7f5bbf631/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.749015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167f05f-b965-44af-8f04-6b6326f17178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0596cc92b0f42dfaed5a78bf048650a, user_id=50e73dffa225465183c5c1a7f5bbf631, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.752555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167f05f-b965-44af-8f04-6b6326f17178 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.776189 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3908/7777] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:05 2022] PUT /identity/v3/projects/f0596cc92b0f42dfaed5a78bf048650a/users/50e73dffa225465183c5c1a7f5bbf631/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:05.779968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fbdcd-e025-41a6-9e0a-197cb5992560 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.791031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fbdcd-e025-41a6-9e0a-197cb5992560 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.861953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd5a4d6-bac7-4dba-aa18-b2f7e02208a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.862630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a4d6-bac7-4dba-aa18-b2f7e02208a3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.862914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a4d6-bac7-4dba-aa18-b2f7e02208a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.863189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd5a4d6-bac7-4dba-aa18-b2f7e02208a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.863989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5a4d6-bac7-4dba-aa18-b2f7e02208a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.866386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd5a4d6-bac7-4dba-aa18-b2f7e02208a3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.881513 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3870/7778] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:05.893426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167f05f-b965-44af-8f04-6b6326f17178 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:05.906136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167f05f-b965-44af-8f04-6b6326f17178 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:05.911759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822e56d-85da-45b5-b724-697ac2156db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:05.913108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822e56d-85da-45b5-b724-697ac2156db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.913394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822e56d-85da-45b5-b724-697ac2156db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.913674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822e56d-85da-45b5-b724-697ac2156db9 admin admin] PATH_INFO: `/v3/projects/f0596cc92b0f42dfaed5a78bf048650a/users/50e73dffa225465183c5c1a7f5bbf631/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.915700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822e56d-85da-45b5-b724-697ac2156db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0596cc92b0f42dfaed5a78bf048650a, user_id=50e73dffa225465183c5c1a7f5bbf631, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:05.918489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822e56d-85da-45b5-b724-697ac2156db9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:05.930450 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3909/7779] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:05 2022] PUT /identity/v3/projects/f0596cc92b0f42dfaed5a78bf048650a/users/50e73dffa225465183c5c1a7f5bbf631/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:05.943585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ea17-4dca-41e3-9bab-763bcc755c0d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:05.943888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ea17-4dca-41e3-9bab-763bcc755c0d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:05.944215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79ea17-4dca-41e3-9bab-763bcc755c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:05.975857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4d79ea17-4dca-41e3-9bab-763bcc755c0d None None] MFA Rules not processed for user `50e73dffa225465183c5c1a7f5bbf631`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:05.977502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4d79ea17-4dca-41e3-9bab-763bcc755c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:06.069261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822e56d-85da-45b5-b724-697ac2156db9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:06.071199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b822e56d-85da-45b5-b724-697ac2156db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:06.075994 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3871/7780] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:06.085372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ea17-4dca-41e3-9bab-763bcc755c0d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:06.086742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4d79ea17-4dca-41e3-9bab-763bcc755c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:06.148702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822e56d-85da-45b5-b724-697ac2156db9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:06.154874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:06.155908 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:06.156306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:06.156580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79ea17-4dca-41e3-9bab-763bcc755c0d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:06.156706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] PATH_INFO: `/v3/users/0596e29d92be40ecac9b52f446d1aada` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:06.157881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0596e29d92be40ecac9b52f446d1aada)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:06.159832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:06.161944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624743-d627-4143-8b6f-834740d4eb2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:06.162711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624743-d627-4143-8b6f-834740d4eb2a service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:06.162927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624743-d627-4143-8b6f-834740d4eb2a service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:06.163203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb624743-d627-4143-8b6f-834740d4eb2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:06.174153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624743-d627-4143-8b6f-834740d4eb2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:06.175717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb624743-d627-4143-8b6f-834740d4eb2a service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:06.186400 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3872/7781] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:06 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:06.215208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0596e29d92be40ecac9b52f446d1aada'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.230738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0596e29d92be40ecac9b52f446d1aada'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.232181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0596e29d92be40ecac9b52f446d1aada'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.233012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0596e29d92be40ecac9b52f446d1aada'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.243989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0596e29d92be40ecac9b52f446d1aada'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.266105 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3910/7782] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:06 2022] DELETE /identity/v3/users/0596e29d92be40ecac9b52f446d1aada => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:06.270450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624743-d627-4143-8b6f-834740d4eb2a service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:06.282465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb624743-d627-4143-8b6f-834740d4eb2a service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:06.339319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f63490-6b6e-48b1-bb28-ba72ac7237e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:06.340382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63490-6b6e-48b1-bb28-ba72ac7237e9 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:06.340858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63490-6b6e-48b1-bb28-ba72ac7237e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:06.341131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f63490-6b6e-48b1-bb28-ba72ac7237e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:06.343266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b6f63490-6b6e-48b1-bb28-ba72ac7237e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:06.410844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f63490-6b6e-48b1-bb28-ba72ac7237e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:06.412538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f63490-6b6e-48b1-bb28-ba72ac7237e9 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:06.422431 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3873/7783] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:06 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:06.450907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:06.452992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:06.524160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129db2c-1446-4589-a3d2-7b118027d1c5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:06.529312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:06.530197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:06.530475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:06.531301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] PATH_INFO: `/v3/projects/40119a50bd964bada5478be68d939c0f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:06.532570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40119a50bd964bada5478be68d939c0f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:06.534519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:06.583493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40119a50bd964bada5478be68d939c0f', 'request_id': 'req-6ab99591-9b18-4c6d-944e-6efe1181d156'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.590808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40119a50bd964bada5478be68d939c0f', 'request_id': 'req-6ab99591-9b18-4c6d-944e-6efe1181d156'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.597039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40119a50bd964bada5478be68d939c0f', 'request_id': 'req-6ab99591-9b18-4c6d-944e-6efe1181d156'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.608764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] The token cache is being invalidate because project 40119a50bd964bada5478be68d939c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:06.609728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.610466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.614837 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3911/7784] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:06 2022] DELETE /identity/v3/projects/40119a50bd964bada5478be68d939c0f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:06.618770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f63490-6b6e-48b1-bb28-ba72ac7237e9 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:06.630803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f63490-6b6e-48b1-bb28-ba72ac7237e9 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:06.692814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:06.693381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:06.693664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:06.693945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] PATH_INFO: `/v3/users/3226be58c92841508306050910b7cecd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:06.695573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3226be58c92841508306050910b7cecd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:06.697740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:06.747547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3226be58c92841508306050910b7cecd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.754651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3226be58c92841508306050910b7cecd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.755381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3226be58c92841508306050910b7cecd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.756029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3226be58c92841508306050910b7cecd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.768485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-88e7da8d-0fca-415d-8d8b-8a758e983dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3226be58c92841508306050910b7cecd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:06.781518 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3874/7785] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:06 2022] DELETE /identity/v3/users/3226be58c92841508306050910b7cecd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:06.966610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:06.968884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:06.987544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab99591-9b18-4c6d-944e-6efe1181d156 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.055452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.057391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.057679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.057959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] PATH_INFO: `/v3/projects/24864e5771c342dab4306d14390ea893` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.059246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=24864e5771c342dab4306d14390ea893)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.061280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.112373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24864e5771c342dab4306d14390ea893', 'request_id': 'req-f9e144ea-ff6a-452c-8f41-f0406c9700ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:07.120770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24864e5771c342dab4306d14390ea893', 'request_id': 'req-f9e144ea-ff6a-452c-8f41-f0406c9700ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:07.127423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24864e5771c342dab4306d14390ea893', 'request_id': 'req-f9e144ea-ff6a-452c-8f41-f0406c9700ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:07.138731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] The token cache is being invalidate because project 24864e5771c342dab4306d14390ea893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:07.138884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:07.139544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f9e144ea-ff6a-452c-8f41-f0406c9700ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:07.141817 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3912/7786] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:06 2022] DELETE /identity/v3/projects/24864e5771c342dab4306d14390ea893 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:07.147306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf0c3-790b-4fa1-9302-0affb2c698ca None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.147635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf0c3-790b-4fa1-9302-0affb2c698ca None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.147934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ddf0c3-790b-4fa1-9302-0affb2c698ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.166411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-48ddf0c3-790b-4fa1-9302-0affb2c698ca None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:07.167851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-48ddf0c3-790b-4fa1-9302-0affb2c698ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:07.232597 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3875/7787] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:07.241270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d8af3-0e9d-4363-b782-bd709fa89a04 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.241531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d8af3-0e9d-4363-b782-bd709fa89a04 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.241815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d8af3-0e9d-4363-b782-bd709fa89a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.261359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-925d8af3-0e9d-4363-b782-bd709fa89a04 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:07.262605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-925d8af3-0e9d-4363-b782-bd709fa89a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:07.271884 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3913/7788] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:07.276528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddf0c3-790b-4fa1-9302-0affb2c698ca None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.287294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ddf0c3-790b-4fa1-9302-0affb2c698ca None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.292090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c56bf-2979-4066-be55-575159a0bd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.292744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c56bf-2979-4066-be55-575159a0bd2b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.293030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c56bf-2979-4066-be55-575159a0bd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.293308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c56bf-2979-4066-be55-575159a0bd2b admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.294024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c56bf-2979-4066-be55-575159a0bd2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:07.294332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c56bf-2979-4066-be55-575159a0bd2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.295973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c56bf-2979-4066-be55-575159a0bd2b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.308259 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3876/7789] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:07.313241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d8af3-0e9d-4363-b782-bd709fa89a04 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.323666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d8af3-0e9d-4363-b782-bd709fa89a04 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.329200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947fc5-b1f9-4f3d-a77e-f5c5cb19eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.329853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947fc5-b1f9-4f3d-a77e-f5c5cb19eeb3 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.330135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947fc5-b1f9-4f3d-a77e-f5c5cb19eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.330414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41947fc5-b1f9-4f3d-a77e-f5c5cb19eeb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.331107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41947fc5-b1f9-4f3d-a77e-f5c5cb19eeb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.333047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41947fc5-b1f9-4f3d-a77e-f5c5cb19eeb3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.359412 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3914/7790] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:07 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:07.363451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c56bf-2979-4066-be55-575159a0bd2b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.373740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c56bf-2979-4066-be55-575159a0bd2b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.434690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e6acc-b33e-4c1e-b46a-fe9324cdf7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.435362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e6acc-b33e-4c1e-b46a-fe9324cdf7dd admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.435645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e6acc-b33e-4c1e-b46a-fe9324cdf7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.435946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e6acc-b33e-4c1e-b46a-fe9324cdf7dd admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.436646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e6acc-b33e-4c1e-b46a-fe9324cdf7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.439304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e6acc-b33e-4c1e-b46a-fe9324cdf7dd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.465351 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3877/7791] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:07 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:07.466613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947fc5-b1f9-4f3d-a77e-f5c5cb19eeb3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.477915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41947fc5-b1f9-4f3d-a77e-f5c5cb19eeb3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.482444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422adee1-9c43-4502-ba5e-7d6985623536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.483140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422adee1-9c43-4502-ba5e-7d6985623536 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.483370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422adee1-9c43-4502-ba5e-7d6985623536 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.483647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422adee1-9c43-4502-ba5e-7d6985623536 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.484429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422adee1-9c43-4502-ba5e-7d6985623536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.486052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422adee1-9c43-4502-ba5e-7d6985623536 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.496196 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3915/7792] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:07.500708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e6acc-b33e-4c1e-b46a-fe9324cdf7dd admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.510633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e6acc-b33e-4c1e-b46a-fe9324cdf7dd admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.516015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bad7ea-dec7-41ac-8ac9-86b1e32050aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.516670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad7ea-dec7-41ac-8ac9-86b1e32050aa admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.516983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad7ea-dec7-41ac-8ac9-86b1e32050aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.517267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad7ea-dec7-41ac-8ac9-86b1e32050aa admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.517980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bad7ea-dec7-41ac-8ac9-86b1e32050aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.519590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bad7ea-dec7-41ac-8ac9-86b1e32050aa admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.529461 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3878/7793] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:07.533670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422adee1-9c43-4502-ba5e-7d6985623536 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.543780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422adee1-9c43-4502-ba5e-7d6985623536 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.548956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c713-cc22-4c56-9d87-9806a6eebac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.549824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c713-cc22-4c56-9d87-9806a6eebac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.550110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c713-cc22-4c56-9d87-9806a6eebac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.550419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611c713-cc22-4c56-9d87-9806a6eebac9 admin admin] PATH_INFO: `/v3/projects/119e0afe758a4e3c8aff0fe6f709cb22/users/bf334063c524416f943d5a30581912cf/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.565568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c713-cc22-4c56-9d87-9806a6eebac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119e0afe758a4e3c8aff0fe6f709cb22, user_id=bf334063c524416f943d5a30581912cf, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.568260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611c713-cc22-4c56-9d87-9806a6eebac9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.581794 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3916/7794] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:07 2022] PUT /identity/v3/projects/119e0afe758a4e3c8aff0fe6f709cb22/users/bf334063c524416f943d5a30581912cf/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:07.592985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10bf21-d6dd-431f-b86d-b373748a68b0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.593277 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10bf21-d6dd-431f-b86d-b373748a68b0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.593558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10bf21-d6dd-431f-b86d-b373748a68b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.619875 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ed10bf21-d6dd-431f-b86d-b373748a68b0 None None] MFA Rules not processed for user `bf334063c524416f943d5a30581912cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:07.621111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ed10bf21-d6dd-431f-b86d-b373748a68b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:07.683078 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3879/7795] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:07.688273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c713-cc22-4c56-9d87-9806a6eebac9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.748714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611c713-cc22-4c56-9d87-9806a6eebac9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.754187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c935d0-2202-41fc-8ce6-4acd44702c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.754813 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c935d0-2202-41fc-8ce6-4acd44702c09 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.755101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c935d0-2202-41fc-8ce6-4acd44702c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.755384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c935d0-2202-41fc-8ce6-4acd44702c09 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.756156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c935d0-2202-41fc-8ce6-4acd44702c09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.758231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c935d0-2202-41fc-8ce6-4acd44702c09 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.786947 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3917/7796] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:07 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:07.788174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10bf21-d6dd-431f-b86d-b373748a68b0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.799639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10bf21-d6dd-431f-b86d-b373748a68b0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.860440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de6b10-43be-4610-95c1-be166374407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.861148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de6b10-43be-4610-95c1-be166374407a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.861437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de6b10-43be-4610-95c1-be166374407a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.861747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de6b10-43be-4610-95c1-be166374407a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.862429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de6b10-43be-4610-95c1-be166374407a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.864969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de6b10-43be-4610-95c1-be166374407a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.885676 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3880/7797] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:07 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:07.889762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c935d0-2202-41fc-8ce6-4acd44702c09 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.900213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c935d0-2202-41fc-8ce6-4acd44702c09 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.905275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d28df-c0ec-46b3-aa4b-04c77b8eb231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.906649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d28df-c0ec-46b3-aa4b-04c77b8eb231 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.907020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d28df-c0ec-46b3-aa4b-04c77b8eb231 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.907334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d28df-c0ec-46b3-aa4b-04c77b8eb231 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.908159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d28df-c0ec-46b3-aa4b-04c77b8eb231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.909941 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d28df-c0ec-46b3-aa4b-04c77b8eb231 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.920726 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3918/7798] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:07.929336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de6b10-43be-4610-95c1-be166374407a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.940294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de6b10-43be-4610-95c1-be166374407a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:07.945046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5b3a-5758-47b5-add0-505c59ff623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:07.945923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5b3a-5758-47b5-add0-505c59ff623c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:07.946210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5b3a-5758-47b5-add0-505c59ff623c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:07.946492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b5b3a-5758-47b5-add0-505c59ff623c admin admin] PATH_INFO: `/v3/projects/3d8138ad1d184277b53649849db03dcb/users/d03816cdeafb4f6084abc21aae693029/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:07.961649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b5b3a-5758-47b5-add0-505c59ff623c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8138ad1d184277b53649849db03dcb, user_id=d03816cdeafb4f6084abc21aae693029, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:07.965060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0b5b3a-5758-47b5-add0-505c59ff623c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:07.979036 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3881/7799] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:07 2022] PUT /identity/v3/projects/3d8138ad1d184277b53649849db03dcb/users/d03816cdeafb4f6084abc21aae693029/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:07.983238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d28df-c0ec-46b3-aa4b-04c77b8eb231 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:07.994223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d28df-c0ec-46b3-aa4b-04c77b8eb231 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:08.074316 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24388ac1-96a7-445a-a619-f7cabb413329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:08.075021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24388ac1-96a7-445a-a619-f7cabb413329 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:08.075404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24388ac1-96a7-445a-a619-f7cabb413329 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:08.075729 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24388ac1-96a7-445a-a619-f7cabb413329 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:08.076481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24388ac1-96a7-445a-a619-f7cabb413329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:08.078443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24388ac1-96a7-445a-a619-f7cabb413329 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:08.088933 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3919/7800] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:08.093845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5b3a-5758-47b5-add0-505c59ff623c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:08.104266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b5b3a-5758-47b5-add0-505c59ff623c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:08.113313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1c804-50bf-49e7-8d52-13321f64054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:08.114766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1c804-50bf-49e7-8d52-13321f64054d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:08.115170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1c804-50bf-49e7-8d52-13321f64054d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:08.115554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1c804-50bf-49e7-8d52-13321f64054d admin admin] PATH_INFO: `/v3/projects/3d8138ad1d184277b53649849db03dcb/users/d03816cdeafb4f6084abc21aae693029/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:08.117862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1c804-50bf-49e7-8d52-13321f64054d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8138ad1d184277b53649849db03dcb, user_id=d03816cdeafb4f6084abc21aae693029, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:08.121471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1c804-50bf-49e7-8d52-13321f64054d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:08.138146 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3882/7801] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:08 2022] PUT /identity/v3/projects/3d8138ad1d184277b53649849db03dcb/users/d03816cdeafb4f6084abc21aae693029/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:08.148808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2f4c-c6ad-4989-ad05-6c929a03452e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:08.149108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2f4c-c6ad-4989-ad05-6c929a03452e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:08.149391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a2f4c-c6ad-4989-ad05-6c929a03452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:08.183898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-093a2f4c-c6ad-4989-ad05-6c929a03452e None None] MFA Rules not processed for user `d03816cdeafb4f6084abc21aae693029`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:08.185401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-093a2f4c-c6ad-4989-ad05-6c929a03452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:08.263566 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3920/7802] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:08 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:08.275870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1c804-50bf-49e7-8d52-13321f64054d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:08.277612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b6c1c804-50bf-49e7-8d52-13321f64054d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:08.341848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1c804-50bf-49e7-8d52-13321f64054d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:08.346127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6187a-c7b2-4992-8c7f-409d41cb8570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:08.346960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6187a-c7b2-4992-8c7f-409d41cb8570 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:08.347272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6187a-c7b2-4992-8c7f-409d41cb8570 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:08.347551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6187a-c7b2-4992-8c7f-409d41cb8570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:08.357829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6187a-c7b2-4992-8c7f-409d41cb8570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:08.359387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6187a-c7b2-4992-8c7f-409d41cb8570 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:08.369667 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3883/7803] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:08 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:08.443569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a2f4c-c6ad-4989-ad05-6c929a03452e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:08.456532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a2f4c-c6ad-4989-ad05-6c929a03452e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:08.460533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640581b6-34bd-4a78-a8da-b895b22b5ce4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:08.461295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640581b6-34bd-4a78-a8da-b895b22b5ce4 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:08.461671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640581b6-34bd-4a78-a8da-b895b22b5ce4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:08.461948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640581b6-34bd-4a78-a8da-b895b22b5ce4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:08.522869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640581b6-34bd-4a78-a8da-b895b22b5ce4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:08.524422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640581b6-34bd-4a78-a8da-b895b22b5ce4 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:08.534775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3921/7804] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:09.485012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6187a-c7b2-4992-8c7f-409d41cb8570 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:09.486557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-85a6187a-c7b2-4992-8c7f-409d41cb8570 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:09.545697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6187a-c7b2-4992-8c7f-409d41cb8570 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:09.550404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a47001-828e-492e-8389-eacfa9058cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:09.551034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a47001-828e-492e-8389-eacfa9058cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:09.551320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a47001-828e-492e-8389-eacfa9058cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:09.551710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a47001-828e-492e-8389-eacfa9058cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:09.553994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e4a47001-828e-492e-8389-eacfa9058cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:09.620508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a47001-828e-492e-8389-eacfa9058cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:09.621976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a47001-828e-492e-8389-eacfa9058cf2 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:09.633210 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3884/7805] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:10.462890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640581b6-34bd-4a78-a8da-b895b22b5ce4 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:10.464356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-640581b6-34bd-4a78-a8da-b895b22b5ce4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:10.477935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640581b6-34bd-4a78-a8da-b895b22b5ce4 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:10.482422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:10.483284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:10.483590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:10.486217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] PATH_INFO: `/v3/users/00eed1658e37429c9aa2ac02e3e49c68` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:10.487493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=00eed1658e37429c9aa2ac02e3e49c68)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:10.489473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:10.538626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00eed1658e37429c9aa2ac02e3e49c68'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:10.545837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00eed1658e37429c9aa2ac02e3e49c68'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:10.547203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00eed1658e37429c9aa2ac02e3e49c68'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:10.548305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00eed1658e37429c9aa2ac02e3e49c68'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:10.554630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00eed1658e37429c9aa2ac02e3e49c68'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:10.571842 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3922/7806] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:10 2022] DELETE /identity/v3/users/00eed1658e37429c9aa2ac02e3e49c68 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:10.576517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb9e9d-6f36-42c8-943d-0b3f2fb7e5b3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:10.577044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb9e9d-6f36-42c8-943d-0b3f2fb7e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:10.577044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb9e9d-6f36-42c8-943d-0b3f2fb7e5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:10.594652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bdcb9e9d-6f36-42c8-943d-0b3f2fb7e5b3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:10.595850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bdcb9e9d-6f36-42c8-943d-0b3f2fb7e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:10.662836 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3885/7807] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:10.673075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:10.674971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:10.740436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f5055-5a1f-4520-84a7-19bb52eae3ab admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:10.744721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ddcd-2079-4467-8e2f-807a288e73d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:10.745458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ddcd-2079-4467-8e2f-807a288e73d9 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:10.745805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ddcd-2079-4467-8e2f-807a288e73d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:10.746525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996ddcd-2079-4467-8e2f-807a288e73d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:10.756710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ddcd-2079-4467-8e2f-807a288e73d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:10.758454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996ddcd-2079-4467-8e2f-807a288e73d9 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:10.773676 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3923/7808] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:11.216878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb9e9d-6f36-42c8-943d-0b3f2fb7e5b3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:11.219263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bdcb9e9d-6f36-42c8-943d-0b3f2fb7e5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:11.250390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb9e9d-6f36-42c8-943d-0b3f2fb7e5b3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:11.256808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:11.257971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:11.258251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:11.258559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] PATH_INFO: `/v3/projects/f8690b216640459c93f31e499a14b364` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:11.259942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8690b216640459c93f31e499a14b364)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:11.262088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:11.329237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8690b216640459c93f31e499a14b364', 'request_id': 'req-b0443512-3d95-4444-bc71-81f6437889f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.339022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8690b216640459c93f31e499a14b364', 'request_id': 'req-b0443512-3d95-4444-bc71-81f6437889f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.349758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8690b216640459c93f31e499a14b364', 'request_id': 'req-b0443512-3d95-4444-bc71-81f6437889f4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.367179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] The token cache is being invalidate because project f8690b216640459c93f31e499a14b364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:11.367471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.368207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.373208 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3886/7809] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:11 2022] DELETE /identity/v3/projects/f8690b216640459c93f31e499a14b364 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:11.374754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ddcd-2079-4467-8e2f-807a288e73d9 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:11.387415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996ddcd-2079-4467-8e2f-807a288e73d9 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:11.464177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:11.465371 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:11.466112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:11.466489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] PATH_INFO: `/v3/users/50e73dffa225465183c5c1a7f5bbf631` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:11.468040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e73dffa225465183c5c1a7f5bbf631)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:11.470672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:11.546685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e73dffa225465183c5c1a7f5bbf631'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.556241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e73dffa225465183c5c1a7f5bbf631'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.557342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e73dffa225465183c5c1a7f5bbf631'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.558634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e73dffa225465183c5c1a7f5bbf631'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.570249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dab55cf1-944f-45fa-8b68-33b5f63d58c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e73dffa225465183c5c1a7f5bbf631'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:11.599145 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3924/7810] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:11 2022] DELETE /identity/v3/users/50e73dffa225465183c5c1a7f5bbf631 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:12.298665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:12.300323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:12.320311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0443512-3d95-4444-bc71-81f6437889f4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:12.390752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:12.391736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:12.392064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:12.392362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] PATH_INFO: `/v3/projects/f0596cc92b0f42dfaed5a78bf048650a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:12.393571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0596cc92b0f42dfaed5a78bf048650a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:12.395504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:12.446251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0596cc92b0f42dfaed5a78bf048650a', 'request_id': 'req-97399dd5-6e7c-43c5-872a-2cde5b862650'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:12.454352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0596cc92b0f42dfaed5a78bf048650a', 'request_id': 'req-97399dd5-6e7c-43c5-872a-2cde5b862650'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:12.463338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0596cc92b0f42dfaed5a78bf048650a', 'request_id': 'req-97399dd5-6e7c-43c5-872a-2cde5b862650'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:12.477101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] The token cache is being invalidate because project f0596cc92b0f42dfaed5a78bf048650a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:12.479539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:12.479539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97399dd5-6e7c-43c5-872a-2cde5b862650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:12.480162 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3887/7811] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:12 2022] DELETE /identity/v3/projects/f0596cc92b0f42dfaed5a78bf048650a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:12.486247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde600c-3744-4e98-9c48-68e12307419b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:12.493647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde600c-3744-4e98-9c48-68e12307419b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:12.494016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde600c-3744-4e98-9c48-68e12307419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:12.513978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7cde600c-3744-4e98-9c48-68e12307419b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:12.515306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7cde600c-3744-4e98-9c48-68e12307419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:12.604464 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3925/7812] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:12.605012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bbe26-03be-4692-9666-bb89ea4ac1fd None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:12.605377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bbe26-03be-4692-9666-bb89ea4ac1fd None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:12.605747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bbe26-03be-4692-9666-bb89ea4ac1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:12.633879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0b8bbe26-03be-4692-9666-bb89ea4ac1fd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:12.634934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0b8bbe26-03be-4692-9666-bb89ea4ac1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:12.668966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3888/7813] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:12.674047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde600c-3744-4e98-9c48-68e12307419b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:12.689931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde600c-3744-4e98-9c48-68e12307419b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:12.702082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec62c52-50bf-4a58-864a-f4d64289a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:12.702832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec62c52-50bf-4a58-864a-f4d64289a516 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:12.703145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec62c52-50bf-4a58-864a-f4d64289a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:12.703373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec62c52-50bf-4a58-864a-f4d64289a516 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:12.707971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec62c52-50bf-4a58-864a-f4d64289a516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:12.708331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec62c52-50bf-4a58-864a-f4d64289a516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:12.710037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec62c52-50bf-4a58-864a-f4d64289a516 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:12.729127 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3926/7814] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:16:12.734104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bbe26-03be-4692-9666-bb89ea4ac1fd None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:12.747415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bbe26-03be-4692-9666-bb89ea4ac1fd None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:12.753126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17144d-284f-4cb1-93c2-fc970c417e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:12.753927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17144d-284f-4cb1-93c2-fc970c417e17 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:12.754279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17144d-284f-4cb1-93c2-fc970c417e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:12.754558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17144d-284f-4cb1-93c2-fc970c417e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:12.755396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17144d-284f-4cb1-93c2-fc970c417e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:12.757294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17144d-284f-4cb1-93c2-fc970c417e17 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:12.794039 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3889/7815] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:12 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:12.798206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec62c52-50bf-4a58-864a-f4d64289a516 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:12.809688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec62c52-50bf-4a58-864a-f4d64289a516 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:12.895996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a2269-8c7f-4c1e-8b08-444c26938e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:12.896832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2269-8c7f-4c1e-8b08-444c26938e45 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:12.897214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2269-8c7f-4c1e-8b08-444c26938e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:12.897604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2269-8c7f-4c1e-8b08-444c26938e45 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:12.898880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a2269-8c7f-4c1e-8b08-444c26938e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:12.901014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a2269-8c7f-4c1e-8b08-444c26938e45 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:12.928997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3927/7816] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:12 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:12.933374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17144d-284f-4cb1-93c2-fc970c417e17 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:12.947641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17144d-284f-4cb1-93c2-fc970c417e17 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:12.955481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df6539-13c9-4b2a-9d1f-5321c374fc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:12.956400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df6539-13c9-4b2a-9d1f-5321c374fc5e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:12.956751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df6539-13c9-4b2a-9d1f-5321c374fc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:12.957095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df6539-13c9-4b2a-9d1f-5321c374fc5e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:12.958257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df6539-13c9-4b2a-9d1f-5321c374fc5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:12.960286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df6539-13c9-4b2a-9d1f-5321c374fc5e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:12.980035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3890/7817] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:12.983799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a2269-8c7f-4c1e-8b08-444c26938e45 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:13.039742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a2269-8c7f-4c1e-8b08-444c26938e45 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:13.055122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead722f-8629-4b63-9190-618bee21279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:13.056176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead722f-8629-4b63-9190-618bee21279e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:13.056673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead722f-8629-4b63-9190-618bee21279e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:13.057110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead722f-8629-4b63-9190-618bee21279e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:13.058406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead722f-8629-4b63-9190-618bee21279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:13.062476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead722f-8629-4b63-9190-618bee21279e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:13.090542 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3928/7818] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:13.095075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df6539-13c9-4b2a-9d1f-5321c374fc5e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:13.113170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df6539-13c9-4b2a-9d1f-5321c374fc5e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:13.125494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478888a-8f9f-4e9b-ad69-e03f2b080378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:13.126414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478888a-8f9f-4e9b-ad69-e03f2b080378 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:13.126704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478888a-8f9f-4e9b-ad69-e03f2b080378 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:13.128347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478888a-8f9f-4e9b-ad69-e03f2b080378 admin admin] PATH_INFO: `/v3/projects/42e98880faf84d28ad553bf14cd07acd/users/c9c36d1ec4c1447da3add85c97535a8e/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:13.166416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478888a-8f9f-4e9b-ad69-e03f2b080378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e98880faf84d28ad553bf14cd07acd, user_id=c9c36d1ec4c1447da3add85c97535a8e, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:13.171239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478888a-8f9f-4e9b-ad69-e03f2b080378 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:13.211078 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3891/7819] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:13 2022] PUT /identity/v3/projects/42e98880faf84d28ad553bf14cd07acd/users/c9c36d1ec4c1447da3add85c97535a8e/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:13.214206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa127c-5749-4e5b-8209-2939c3bd54d4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:13.214686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa127c-5749-4e5b-8209-2939c3bd54d4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:13.215133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa127c-5749-4e5b-8209-2939c3bd54d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:13.256028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f9fa127c-5749-4e5b-8209-2939c3bd54d4 None None] MFA Rules not processed for user `c9c36d1ec4c1447da3add85c97535a8e`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:13.257639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f9fa127c-5749-4e5b-8209-2939c3bd54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:13.379342 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3929/7820] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:13.392387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478888a-8f9f-4e9b-ad69-e03f2b080378 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:13.395385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4478888a-8f9f-4e9b-ad69-e03f2b080378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:13.472643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478888a-8f9f-4e9b-ad69-e03f2b080378 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:13.479527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30181d63-d6db-45a8-90bc-fbe586cf7615 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:13.480233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30181d63-d6db-45a8-90bc-fbe586cf7615 service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:13.480525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30181d63-d6db-45a8-90bc-fbe586cf7615 service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:13.480809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30181d63-d6db-45a8-90bc-fbe586cf7615 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:13.490729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30181d63-d6db-45a8-90bc-fbe586cf7615 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:13.492269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30181d63-d6db-45a8-90bc-fbe586cf7615 service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:13.501446 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3892/7821] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:13.659412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa127c-5749-4e5b-8209-2939c3bd54d4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:13.661315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f9fa127c-5749-4e5b-8209-2939c3bd54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:13.729260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa127c-5749-4e5b-8209-2939c3bd54d4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:13.733746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:13.734616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:13.734902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:13.735189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] PATH_INFO: `/v3/users/41ad4fbc224446efaf5ad85c8c87eeab` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:13.736442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ad4fbc224446efaf5ad85c8c87eeab)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:13.738382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:13.788682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ad4fbc224446efaf5ad85c8c87eeab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:13.795410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ad4fbc224446efaf5ad85c8c87eeab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:13.796140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ad4fbc224446efaf5ad85c8c87eeab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:13.796796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ad4fbc224446efaf5ad85c8c87eeab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:13.804585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2a5c59fa-b880-4424-b853-e0bff9b2900c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ad4fbc224446efaf5ad85c8c87eeab'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:13.822702 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3930/7822] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:13 2022] DELETE /identity/v3/users/41ad4fbc224446efaf5ad85c8c87eeab => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:14.019299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30181d63-d6db-45a8-90bc-fbe586cf7615 service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.035472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30181d63-d6db-45a8-90bc-fbe586cf7615 service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.099815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.100709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.100992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.101264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] PATH_INFO: `/v3/projects/3a8e16658cc541b2976c9325d1558792` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.102465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8e16658cc541b2976c9325d1558792)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.104436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.153895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8e16658cc541b2976c9325d1558792', 'request_id': 'req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:14.161596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8e16658cc541b2976c9325d1558792', 'request_id': 'req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:14.168765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8e16658cc541b2976c9325d1558792', 'request_id': 'req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:14.181183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] The token cache is being invalidate because project 3a8e16658cc541b2976c9325d1558792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:14.181599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:14.182373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-399bd4a5-d9ef-42cf-ac80-a3aeae4ec607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:14.184317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3893/7823] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:14 2022] DELETE /identity/v3/projects/3a8e16658cc541b2976c9325d1558792 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:14.191137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8da0-cecb-45d5-a3bd-e8fe1347dcdd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.191528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8da0-cecb-45d5-a3bd-e8fe1347dcdd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.191942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf8da0-cecb-45d5-a3bd-e8fe1347dcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.211245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-65cf8da0-cecb-45d5-a3bd-e8fe1347dcdd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:14.212482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65cf8da0-cecb-45d5-a3bd-e8fe1347dcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:14.277312 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3931/7824] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:14.285851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7f1c-1122-493f-8aea-fa21c3e08501 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.286140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7f1c-1122-493f-8aea-fa21c3e08501 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.286424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7f1c-1122-493f-8aea-fa21c3e08501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.306952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1dda7f1c-1122-493f-8aea-fa21c3e08501 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:14.308108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1dda7f1c-1122-493f-8aea-fa21c3e08501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:14.316085 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3894/7825] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:14.320255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf8da0-cecb-45d5-a3bd-e8fe1347dcdd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.330800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf8da0-cecb-45d5-a3bd-e8fe1347dcdd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.335489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e730e-2805-45a8-9ef0-69102db36bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.336179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e730e-2805-45a8-9ef0-69102db36bfd admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.336463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e730e-2805-45a8-9ef0-69102db36bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.336736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e730e-2805-45a8-9ef0-69102db36bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.337451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e730e-2805-45a8-9ef0-69102db36bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:14.337755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e730e-2805-45a8-9ef0-69102db36bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.339376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e730e-2805-45a8-9ef0-69102db36bfd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.351231 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3932/7826] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:14.355328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7f1c-1122-493f-8aea-fa21c3e08501 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.364443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7f1c-1122-493f-8aea-fa21c3e08501 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.369087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1fc9a-af0d-4636-be32-630fa825d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.369721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1fc9a-af0d-4636-be32-630fa825d90f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.370007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1fc9a-af0d-4636-be32-630fa825d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.370284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1fc9a-af0d-4636-be32-630fa825d90f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.370963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1fc9a-af0d-4636-be32-630fa825d90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.372902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1fc9a-af0d-4636-be32-630fa825d90f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.401171 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3895/7827] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:14 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:14.402295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e730e-2805-45a8-9ef0-69102db36bfd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.412824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e730e-2805-45a8-9ef0-69102db36bfd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.471964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8824ba-2a1f-4ddc-b49e-433d6c6e4b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.472637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8824ba-2a1f-4ddc-b49e-433d6c6e4b0c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.472923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8824ba-2a1f-4ddc-b49e-433d6c6e4b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.473201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8824ba-2a1f-4ddc-b49e-433d6c6e4b0c admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.473910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8824ba-2a1f-4ddc-b49e-433d6c6e4b0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.476058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8824ba-2a1f-4ddc-b49e-433d6c6e4b0c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.496118 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3933/7828] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:14 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:14.500362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1fc9a-af0d-4636-be32-630fa825d90f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.510739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1fc9a-af0d-4636-be32-630fa825d90f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.516025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8a66f-d294-4319-a051-84d15cd44c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.516740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8a66f-d294-4319-a051-84d15cd44c84 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.517094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8a66f-d294-4319-a051-84d15cd44c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.517432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8a66f-d294-4319-a051-84d15cd44c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.518339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8a66f-d294-4319-a051-84d15cd44c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.519936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8a66f-d294-4319-a051-84d15cd44c84 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.530223 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3896/7829] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:14.534741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8824ba-2a1f-4ddc-b49e-433d6c6e4b0c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.544833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8824ba-2a1f-4ddc-b49e-433d6c6e4b0c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.550383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c247c-f2db-4ee6-ac55-4db3707ab970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.551057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c247c-f2db-4ee6-ac55-4db3707ab970 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.551328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c247c-f2db-4ee6-ac55-4db3707ab970 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.551606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c247c-f2db-4ee6-ac55-4db3707ab970 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.552389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c247c-f2db-4ee6-ac55-4db3707ab970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.554295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c247c-f2db-4ee6-ac55-4db3707ab970 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.565449 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3934/7830] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:14.569501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8a66f-d294-4319-a051-84d15cd44c84 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.580373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8a66f-d294-4319-a051-84d15cd44c84 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.585257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30959a-41c2-42d6-825f-88f5f057a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.586143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30959a-41c2-42d6-825f-88f5f057a69d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.586430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30959a-41c2-42d6-825f-88f5f057a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.587127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30959a-41c2-42d6-825f-88f5f057a69d admin admin] PATH_INFO: `/v3/projects/bfecf204244943cab40edfd09e409186/users/9fb7835e73e3407e88375bc4b459378f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.602258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30959a-41c2-42d6-825f-88f5f057a69d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfecf204244943cab40edfd09e409186, user_id=9fb7835e73e3407e88375bc4b459378f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.605018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30959a-41c2-42d6-825f-88f5f057a69d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.618594 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3897/7831] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:14 2022] PUT /identity/v3/projects/bfecf204244943cab40edfd09e409186/users/9fb7835e73e3407e88375bc4b459378f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:14.630103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18c4d-3d8b-42d1-9f0c-70a8148cdeb5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.630392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18c4d-3d8b-42d1-9f0c-70a8148cdeb5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.630670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b18c4d-3d8b-42d1-9f0c-70a8148cdeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.656899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-04b18c4d-3d8b-42d1-9f0c-70a8148cdeb5 None None] MFA Rules not processed for user `9fb7835e73e3407e88375bc4b459378f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:14.658100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-04b18c4d-3d8b-42d1-9f0c-70a8148cdeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:14.724441 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3935/7832] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:14.729010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30959a-41c2-42d6-825f-88f5f057a69d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.791153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30959a-41c2-42d6-825f-88f5f057a69d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.795854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738f3e5-e876-48b4-a939-bce8f8738d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.796568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738f3e5-e876-48b4-a939-bce8f8738d48 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.796855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738f3e5-e876-48b4-a939-bce8f8738d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.797137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738f3e5-e876-48b4-a939-bce8f8738d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.797820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738f3e5-e876-48b4-a939-bce8f8738d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.799785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738f3e5-e876-48b4-a939-bce8f8738d48 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.825004 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3898/7833] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:14 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:14.829818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b18c4d-3d8b-42d1-9f0c-70a8148cdeb5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.840649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b18c4d-3d8b-42d1-9f0c-70a8148cdeb5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.895169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604fc25-5513-4a4f-b737-e99ac1087611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.895822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604fc25-5513-4a4f-b737-e99ac1087611 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.896136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604fc25-5513-4a4f-b737-e99ac1087611 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.896416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604fc25-5513-4a4f-b737-e99ac1087611 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.897107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604fc25-5513-4a4f-b737-e99ac1087611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.899022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604fc25-5513-4a4f-b737-e99ac1087611 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.919555 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3936/7834] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:14 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:14.921992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738f3e5-e876-48b4-a939-bce8f8738d48 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.932290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738f3e5-e876-48b4-a939-bce8f8738d48 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.937347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc12b2-595f-425c-be12-a2f9c9d5f511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.937988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc12b2-595f-425c-be12-a2f9c9d5f511 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.938268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc12b2-595f-425c-be12-a2f9c9d5f511 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.938543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc12b2-595f-425c-be12-a2f9c9d5f511 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.939253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc12b2-595f-425c-be12-a2f9c9d5f511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.940917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc12b2-595f-425c-be12-a2f9c9d5f511 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:14.955134 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3899/7835] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:14.957177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604fc25-5513-4a4f-b737-e99ac1087611 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:14.969227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604fc25-5513-4a4f-b737-e99ac1087611 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:14.973937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200a9f-72ee-4e69-82b5-f91386fd5a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:14.974811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200a9f-72ee-4e69-82b5-f91386fd5a8c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:14.975095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200a9f-72ee-4e69-82b5-f91386fd5a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:14.975373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e200a9f-72ee-4e69-82b5-f91386fd5a8c admin admin] PATH_INFO: `/v3/projects/0c2410f10ff94241aae824539804644a/users/17bb212a0edc4e848df1f1e3f30d48b3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:14.990064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e200a9f-72ee-4e69-82b5-f91386fd5a8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2410f10ff94241aae824539804644a, user_id=17bb212a0edc4e848df1f1e3f30d48b3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:14.992817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e200a9f-72ee-4e69-82b5-f91386fd5a8c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.007277 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3937/7836] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:14 2022] PUT /identity/v3/projects/0c2410f10ff94241aae824539804644a/users/17bb212a0edc4e848df1f1e3f30d48b3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:15.011415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc12b2-595f-425c-be12-a2f9c9d5f511 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.024955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc12b2-595f-425c-be12-a2f9c9d5f511 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.091232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bfa04-4ed1-4ba5-a95e-89c81e1bea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.092015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bfa04-4ed1-4ba5-a95e-89c81e1bea08 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.092368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bfa04-4ed1-4ba5-a95e-89c81e1bea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.092722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bfa04-4ed1-4ba5-a95e-89c81e1bea08 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.093509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bfa04-4ed1-4ba5-a95e-89c81e1bea08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.095437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bfa04-4ed1-4ba5-a95e-89c81e1bea08 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.112343 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3900/7837] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:15.113442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200a9f-72ee-4e69-82b5-f91386fd5a8c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.136288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e200a9f-72ee-4e69-82b5-f91386fd5a8c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.142785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced867c-9de5-49c1-ba44-b5e2c1befffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.144109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced867c-9de5-49c1-ba44-b5e2c1befffa admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.144593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced867c-9de5-49c1-ba44-b5e2c1befffa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.144868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced867c-9de5-49c1-ba44-b5e2c1befffa admin admin] PATH_INFO: `/v3/projects/0c2410f10ff94241aae824539804644a/users/17bb212a0edc4e848df1f1e3f30d48b3/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.147195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced867c-9de5-49c1-ba44-b5e2c1befffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2410f10ff94241aae824539804644a, user_id=17bb212a0edc4e848df1f1e3f30d48b3, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.150111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced867c-9de5-49c1-ba44-b5e2c1befffa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.170547 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3938/7838] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:15 2022] PUT /identity/v3/projects/0c2410f10ff94241aae824539804644a/users/17bb212a0edc4e848df1f1e3f30d48b3/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:15.181248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823522-2268-4e3e-bb33-ea4c52b8d0a3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.181605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823522-2268-4e3e-bb33-ea4c52b8d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.181929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51823522-2268-4e3e-bb33-ea4c52b8d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.226541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-51823522-2268-4e3e-bb33-ea4c52b8d0a3 None None] MFA Rules not processed for user `17bb212a0edc4e848df1f1e3f30d48b3`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:15.227790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-51823522-2268-4e3e-bb33-ea4c52b8d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:15.315153 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3901/7839] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:15.320299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced867c-9de5-49c1-ba44-b5e2c1befffa admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.333399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced867c-9de5-49c1-ba44-b5e2c1befffa admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.339862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23467c3c-d86a-4b9e-8f51-c68cb5bb8af2 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.340610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23467c3c-d86a-4b9e-8f51-c68cb5bb8af2 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.341002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23467c3c-d86a-4b9e-8f51-c68cb5bb8af2 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.341416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23467c3c-d86a-4b9e-8f51-c68cb5bb8af2 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.342267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23467c3c-d86a-4b9e-8f51-c68cb5bb8af2 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.344012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23467c3c-d86a-4b9e-8f51-c68cb5bb8af2 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.363284 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3939/7840] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:15 2022] POST /identity/v3/services => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:15.368108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51823522-2268-4e3e-bb33-ea4c52b8d0a3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.380598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51823522-2268-4e3e-bb33-ea4c52b8d0a3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.396417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b04d0-5e0a-4a7e-a0d2-e84124677f6b tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.397056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b04d0-5e0a-4a7e-a0d2-e84124677f6b tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.397966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b04d0-5e0a-4a7e-a0d2-e84124677f6b tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.398252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b04d0-5e0a-4a7e-a0d2-e84124677f6b tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.398971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b04d0-5e0a-4a7e-a0d2-e84124677f6b tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.400060 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-2b7b04d0-5e0a-4a7e-a0d2-e84124677f6b tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:16:15.400060 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:16:15.400060 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:16:15.400952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b04d0-5e0a-4a7e-a0d2-e84124677f6b tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.414102 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3902/7841] 10.222.0.16 () {60 vars in 1212 bytes} [Sat Mar 26 21:16:15 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:15.415359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23467c3c-d86a-4b9e-8f51-c68cb5bb8af2 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.426132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23467c3c-d86a-4b9e-8f51-c68cb5bb8af2 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.431421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e447668-5b7f-4dda-9734-0d027cc68fea tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.432314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e447668-5b7f-4dda-9734-0d027cc68fea tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.432598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e447668-5b7f-4dda-9734-0d027cc68fea tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.432873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e447668-5b7f-4dda-9734-0d027cc68fea tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/services` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.433604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e447668-5b7f-4dda-9734-0d027cc68fea tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.435206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e447668-5b7f-4dda-9734-0d027cc68fea tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.453026 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3940/7842] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:15 2022] POST /identity/v3/services => generated 287 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:15.454530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b04d0-5e0a-4a7e-a0d2-e84124677f6b tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.467609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b04d0-5e0a-4a7e-a0d2-e84124677f6b tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.485404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1edef7-817c-4ea8-b6e5-bdaf3e83beae tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.486043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1edef7-817c-4ea8-b6e5-bdaf3e83beae tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.486330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1edef7-817c-4ea8-b6e5-bdaf3e83beae tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.486613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1edef7-817c-4ea8-b6e5-bdaf3e83beae tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.487330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1edef7-817c-4ea8-b6e5-bdaf3e83beae tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.488989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1edef7-817c-4ea8-b6e5-bdaf3e83beae tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.498027 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3903/7843] 10.222.0.16 () {60 vars in 1212 bytes} [Sat Mar 26 21:16:15 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:15.502195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e447668-5b7f-4dda-9734-0d027cc68fea tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.513111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e447668-5b7f-4dda-9734-0d027cc68fea tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.518054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcad44-dbf0-4215-8be0-6595a09495f3 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.518684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcad44-dbf0-4215-8be0-6595a09495f3 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.518969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcad44-dbf0-4215-8be0-6595a09495f3 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.519244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcad44-dbf0-4215-8be0-6595a09495f3 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.519993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcad44-dbf0-4215-8be0-6595a09495f3 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.521012 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-e5dcad44-dbf0-4215-8be0-6595a09495f3 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:16:15.521012 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:16:15.521012 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:16:15.521889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcad44-dbf0-4215-8be0-6595a09495f3 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.532337 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3941/7844] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Mar 26 21:16:15 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:15.533570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1edef7-817c-4ea8-b6e5-bdaf3e83beae tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.543605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1edef7-817c-4ea8-b6e5-bdaf3e83beae tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.548782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9bd1a-eeeb-4858-ab8d-95afc2df32df tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.549612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9bd1a-eeeb-4858-ab8d-95afc2df32df tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.549921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9bd1a-eeeb-4858-ab8d-95afc2df32df tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.550193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9bd1a-eeeb-4858-ab8d-95afc2df32df tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c4c9d9dd1ea54cbf88bd0d3e1acef16d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.550834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9bd1a-eeeb-4858-ab8d-95afc2df32df tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=c4c9d9dd1ea54cbf88bd0d3e1acef16d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.551849 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-09a9bd1a-eeeb-4858-ab8d-95afc2df32df tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:16:15.551849 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:16:15.551849 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:16:15.552774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9bd1a-eeeb-4858-ab8d-95afc2df32df tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.559306 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3904/7845] 10.222.0.16 () {58 vars in 1289 bytes} [Sat Mar 26 21:16:15 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/c4c9d9dd1ea54cbf88bd0d3e1acef16d => generated 333 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:16:15.563622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcad44-dbf0-4215-8be0-6595a09495f3 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.574312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcad44-dbf0-4215-8be0-6595a09495f3 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.579418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef620a5-1658-4070-ae86-9d199a5854b9 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.580396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef620a5-1658-4070-ae86-9d199a5854b9 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `HEAD` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.580672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef620a5-1658-4070-ae86-9d199a5854b9 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.580953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef620a5-1658-4070-ae86-9d199a5854b9 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c4c9d9dd1ea54cbf88bd0d3e1acef16d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.581600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef620a5-1658-4070-ae86-9d199a5854b9 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=c4c9d9dd1ea54cbf88bd0d3e1acef16d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.582616 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-6ef620a5-1658-4070-ae86-9d199a5854b9 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:16:15.582616 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:16:15.582616 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:16:15.583485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef620a5-1658-4070-ae86-9d199a5854b9 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.589655 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3942/7846] 10.222.0.16 () {58 vars in 1290 bytes} [Sat Mar 26 21:16:15 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/c4c9d9dd1ea54cbf88bd0d3e1acef16d => generated 0 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Mar 26 21:16:15.594805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9bd1a-eeeb-4858-ab8d-95afc2df32df tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.607230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9bd1a-eeeb-4858-ab8d-95afc2df32df tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.612579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee675-4bd3-4449-9363-605977ad1ddb tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.613415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee675-4bd3-4449-9363-605977ad1ddb tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.613732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee675-4bd3-4449-9363-605977ad1ddb tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.614043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ee675-4bd3-4449-9363-605977ad1ddb tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c4c9d9dd1ea54cbf88bd0d3e1acef16d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.614694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee675-4bd3-4449-9363-605977ad1ddb tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c4c9d9dd1ea54cbf88bd0d3e1acef16d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.615728 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-fc5ee675-4bd3-4449-9363-605977ad1ddb tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:16:15.615728 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:16:15.615728 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:16:15.616671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ee675-4bd3-4449-9363-605977ad1ddb tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.626511 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3905/7847] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 21:16:15 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c4c9d9dd1ea54cbf88bd0d3e1acef16d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:15.630529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef620a5-1658-4070-ae86-9d199a5854b9 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.640692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef620a5-1658-4070-ae86-9d199a5854b9 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.645432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bfbc1-08ed-4bb2-a6e6-d9fd6050168a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.646052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bfbc1-08ed-4bb2-a6e6-d9fd6050168a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.646362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bfbc1-08ed-4bb2-a6e6-d9fd6050168a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.646649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bfbc1-08ed-4bb2-a6e6-d9fd6050168a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.647363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bfbc1-08ed-4bb2-a6e6-d9fd6050168a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.649030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bfbc1-08ed-4bb2-a6e6-d9fd6050168a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.653509 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3943/7848] 10.222.0.16 () {58 vars in 1190 bytes} [Sat Mar 26 21:16:15 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 451 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:15.657926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee675-4bd3-4449-9363-605977ad1ddb tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.668091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ee675-4bd3-4449-9363-605977ad1ddb tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.673416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a7e52-e751-4772-9e63-a2c97b1f91d4 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.674238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a7e52-e751-4772-9e63-a2c97b1f91d4 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.674530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a7e52-e751-4772-9e63-a2c97b1f91d4 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.674843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a7e52-e751-4772-9e63-a2c97b1f91d4 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c4c9d9dd1ea54cbf88bd0d3e1acef16d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.675492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a7e52-e751-4772-9e63-a2c97b1f91d4 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c4c9d9dd1ea54cbf88bd0d3e1acef16d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.677149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133a7e52-e751-4772-9e63-a2c97b1f91d4 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.689254 ncdv-master-1 devstack@keystone.service[97203]: WARNING keystone.server.flask.application [None req-133a7e52-e751-4772-9e63-a2c97b1f91d4 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Could not find Endpoint Group: c4c9d9dd1ea54cbf88bd0d3e1acef16d.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: c4c9d9dd1ea54cbf88bd0d3e1acef16d. Mar 26 21:16:15.690390 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3906/7849] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 21:16:15 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c4c9d9dd1ea54cbf88bd0d3e1acef16d => generated 120 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Mar 26 21:16:15.694155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bfbc1-08ed-4bb2-a6e6-d9fd6050168a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.704057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bfbc1-08ed-4bb2-a6e6-d9fd6050168a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.708748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6620c-bca4-4e2e-a62c-b2e153f6f097 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.709574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6620c-bca4-4e2e-a62c-b2e153f6f097 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.709862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6620c-bca4-4e2e-a62c-b2e153f6f097 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.710147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6620c-bca4-4e2e-a62c-b2e153f6f097 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/services/df7d24697b65441aadc52741f02431c2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.710798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6620c-bca4-4e2e-a62c-b2e153f6f097 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:delete_service(service_id=df7d24697b65441aadc52741f02431c2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.712470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6620c-bca4-4e2e-a62c-b2e153f6f097 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.734209 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3944/7850] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:15 2022] DELETE /identity/v3/services/df7d24697b65441aadc52741f02431c2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:15.739314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a7e52-e751-4772-9e63-a2c97b1f91d4 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.749112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a7e52-e751-4772-9e63-a2c97b1f91d4 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.764532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597233b4-a8e9-4eb6-b0eb-2fa22ea3403a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.765801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597233b4-a8e9-4eb6-b0eb-2fa22ea3403a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.766092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597233b4-a8e9-4eb6-b0eb-2fa22ea3403a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.766371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597233b4-a8e9-4eb6-b0eb-2fa22ea3403a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.767077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597233b4-a8e9-4eb6-b0eb-2fa22ea3403a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.769043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597233b4-a8e9-4eb6-b0eb-2fa22ea3403a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.788461 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3907/7851] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:15 2022] POST /identity/v3/services => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:15.792564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6620c-bca4-4e2e-a62c-b2e153f6f097 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.802899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6620c-bca4-4e2e-a62c-b2e153f6f097 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.817762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad544ff-1951-4a39-aa0f-64f9f14d6393 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.818621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad544ff-1951-4a39-aa0f-64f9f14d6393 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.818911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad544ff-1951-4a39-aa0f-64f9f14d6393 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.819193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad544ff-1951-4a39-aa0f-64f9f14d6393 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.820004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad544ff-1951-4a39-aa0f-64f9f14d6393 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.820968 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-9ad544ff-1951-4a39-aa0f-64f9f14d6393 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:16:15.820968 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:16:15.820968 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:16:15.821851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad544ff-1951-4a39-aa0f-64f9f14d6393 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.831943 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3945/7852] 10.222.0.16 () {60 vars in 1212 bytes} [Sat Mar 26 21:16:15 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:15.836308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597233b4-a8e9-4eb6-b0eb-2fa22ea3403a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.850012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597233b4-a8e9-4eb6-b0eb-2fa22ea3403a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.855196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a7592-fe6e-41fb-b500-f275b7d8362a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.855951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a7592-fe6e-41fb-b500-f275b7d8362a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.856345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a7592-fe6e-41fb-b500-f275b7d8362a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.856830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a7592-fe6e-41fb-b500-f275b7d8362a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.857640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a7592-fe6e-41fb-b500-f275b7d8362a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.859361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a7592-fe6e-41fb-b500-f275b7d8362a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.875966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3908/7853] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:15 2022] POST /identity/v3/services => generated 287 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:15.879902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad544ff-1951-4a39-aa0f-64f9f14d6393 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.891495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad544ff-1951-4a39-aa0f-64f9f14d6393 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.911006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539650a-e506-42ba-8599-269decd9ac8a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.912036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539650a-e506-42ba-8599-269decd9ac8a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `PATCH` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.912381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539650a-e506-42ba-8599-269decd9ac8a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.912674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539650a-e506-42ba-8599-269decd9ac8a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/095331e0066e4fdc9dd01729ccd9a590` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.913667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539650a-e506-42ba-8599-269decd9ac8a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=095331e0066e4fdc9dd01729ccd9a590)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.914915 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-0539650a-e506-42ba-8599-269decd9ac8a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:16:15.914915 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:16:15.914915 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:16:15.916025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539650a-e506-42ba-8599-269decd9ac8a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.927945 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3946/7854] 10.222.0.16 () {60 vars in 1312 bytes} [Sat Mar 26 21:16:15 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/095331e0066e4fdc9dd01729ccd9a590 => generated 335 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:15.932602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a7592-fe6e-41fb-b500-f275b7d8362a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:15.946086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a7592-fe6e-41fb-b500-f275b7d8362a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:15.954088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdbb53-5d64-4068-ac34-4f99271e0708 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:15.954993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdbb53-5d64-4068-ac34-4f99271e0708 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:15.955288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdbb53-5d64-4068-ac34-4f99271e0708 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:15.955646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdbb53-5d64-4068-ac34-4f99271e0708 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/services/5cc7cb18400f4b66bf6e07a496286727` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:15.956424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdbb53-5d64-4068-ac34-4f99271e0708 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:delete_service(service_id=5cc7cb18400f4b66bf6e07a496286727)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:15.958079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdbb53-5d64-4068-ac34-4f99271e0708 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:15.988359 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3909/7855] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:15 2022] DELETE /identity/v3/services/5cc7cb18400f4b66bf6e07a496286727 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:15.993306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539650a-e506-42ba-8599-269decd9ac8a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:16.003042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539650a-e506-42ba-8599-269decd9ac8a tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:16.029309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffc06a-7593-4bcd-a7ea-8017df12d4f0 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:16.030360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffc06a-7593-4bcd-a7ea-8017df12d4f0 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:16.031160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffc06a-7593-4bcd-a7ea-8017df12d4f0 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:16.031538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffc06a-7593-4bcd-a7ea-8017df12d4f0 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/095331e0066e4fdc9dd01729ccd9a590` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:16.032227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffc06a-7593-4bcd-a7ea-8017df12d4f0 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=095331e0066e4fdc9dd01729ccd9a590)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:16.033288 ncdv-master-1 devstack@keystone.service[97202]: WARNING py.warnings [None req-a2ffc06a-7593-4bcd-a7ea-8017df12d4f0 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:16:16.033288 ncdv-master-1 devstack@keystone.service[97202]: warnings.warn(msg) Mar 26 21:16:16.033288 ncdv-master-1 devstack@keystone.service[97202]: Mar 26 21:16:16.034167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffc06a-7593-4bcd-a7ea-8017df12d4f0 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:16.045288 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3947/7856] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 21:16:15 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/095331e0066e4fdc9dd01729ccd9a590 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:16.049528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdbb53-5d64-4068-ac34-4f99271e0708 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:16.060784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdbb53-5d64-4068-ac34-4f99271e0708 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:16.065263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f0df-149f-4a2f-8e6d-8b5b4397a028 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:16.066155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f0df-149f-4a2f-8e6d-8b5b4397a028 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:16.066375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f0df-149f-4a2f-8e6d-8b5b4397a028 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:16.066653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39f0df-149f-4a2f-8e6d-8b5b4397a028 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/services/d220947fccc8452fa7554fe43af7f2d5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:16.067301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39f0df-149f-4a2f-8e6d-8b5b4397a028 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d220947fccc8452fa7554fe43af7f2d5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:16.069045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39f0df-149f-4a2f-8e6d-8b5b4397a028 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:16.090981 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3910/7857] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:16 2022] DELETE /identity/v3/services/d220947fccc8452fa7554fe43af7f2d5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:16.097166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffc06a-7593-4bcd-a7ea-8017df12d4f0 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:16.106885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffc06a-7593-4bcd-a7ea-8017df12d4f0 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:16.121282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ade0-a640-46a4-b07a-7f91b9dcde5d tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:16.122209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ade0-a640-46a4-b07a-7f91b9dcde5d tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:16.122553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ade0-a640-46a4-b07a-7f91b9dcde5d tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:16.122836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043ade0-a640-46a4-b07a-7f91b9dcde5d tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/6a8025bd175c4a67949db662b500e7a2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:16.123663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043ade0-a640-46a4-b07a-7f91b9dcde5d tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=6a8025bd175c4a67949db662b500e7a2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:16.126199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043ade0-a640-46a4-b07a-7f91b9dcde5d tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:16.136432 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3948/7858] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 21:16:16 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/6a8025bd175c4a67949db662b500e7a2 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:16.141376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f0df-149f-4a2f-8e6d-8b5b4397a028 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:16.151713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39f0df-149f-4a2f-8e6d-8b5b4397a028 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:16.156734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75f733-f629-4349-bf5b-26bab84d6f08 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17bb212a0edc4e848df1f1e3f30d48b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c2410f10ff94241aae824539804644a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:16.157586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75f733-f629-4349-bf5b-26bab84d6f08 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:16.157930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75f733-f629-4349-bf5b-26bab84d6f08 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:16.158219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75f733-f629-4349-bf5b-26bab84d6f08 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] PATH_INFO: `/v3/services/80be2abd3a774443bc42e6a728e39f3c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:16.159057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75f733-f629-4349-bf5b-26bab84d6f08 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorizing `identity:delete_service(service_id=80be2abd3a774443bc42e6a728e39f3c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:16.160787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75f733-f629-4349-bf5b-26bab84d6f08 tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:16.183095 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3911/7859] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:16 2022] DELETE /identity/v3/services/80be2abd3a774443bc42e6a728e39f3c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:16.188134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ade0-a640-46a4-b07a-7f91b9dcde5d tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:16.260783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043ade0-a640-46a4-b07a-7f91b9dcde5d tempest-EndPointGroupsTest-2100985372 tempest-EndPointGroupsTest-2100985372-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:16.275406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:16.276377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:16.276661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:16.276963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] PATH_INFO: `/v3/users/9fb7835e73e3407e88375bc4b459378f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:16.278217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb7835e73e3407e88375bc4b459378f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:16.280215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:16.329447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb7835e73e3407e88375bc4b459378f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.336481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb7835e73e3407e88375bc4b459378f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.337688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb7835e73e3407e88375bc4b459378f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.338855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb7835e73e3407e88375bc4b459378f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.356674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb7835e73e3407e88375bc4b459378f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.375015 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3949/7860] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:16 2022] DELETE /identity/v3/users/9fb7835e73e3407e88375bc4b459378f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:16.379957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818b783-0ecc-407b-8b40-a4b08a629174 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:16.380329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818b783-0ecc-407b-8b40-a4b08a629174 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:16.380780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818b783-0ecc-407b-8b40-a4b08a629174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:16.399335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2818b783-0ecc-407b-8b40-a4b08a629174 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:16.400580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2818b783-0ecc-407b-8b40-a4b08a629174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:16.461120 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3912/7861] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:16.471233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:16.472808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:16.541616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b06bea-3a44-4138-91bb-bb299096430d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:16.545343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f420a-3599-475b-9c5e-4365429fbf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:16.546567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f420a-3599-475b-9c5e-4365429fbf6e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:16.546852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f420a-3599-475b-9c5e-4365429fbf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:16.547127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f420a-3599-475b-9c5e-4365429fbf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:16.556993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f420a-3599-475b-9c5e-4365429fbf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:16.558549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f420a-3599-475b-9c5e-4365429fbf6e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:16.568799 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3950/7862] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:16.830835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818b783-0ecc-407b-8b40-a4b08a629174 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:16.832278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2818b783-0ecc-407b-8b40-a4b08a629174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:16.844788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818b783-0ecc-407b-8b40-a4b08a629174 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:16.849913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:16.850771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:16.857509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:16.857801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] PATH_INFO: `/v3/projects/bfecf204244943cab40edfd09e409186` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:16.859625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfecf204244943cab40edfd09e409186)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:16.861631 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:16.919304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfecf204244943cab40edfd09e409186', 'request_id': 'req-42c8a2a9-d5be-4725-893f-a3af325680b8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.929152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfecf204244943cab40edfd09e409186', 'request_id': 'req-42c8a2a9-d5be-4725-893f-a3af325680b8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.935037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfecf204244943cab40edfd09e409186', 'request_id': 'req-42c8a2a9-d5be-4725-893f-a3af325680b8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.950932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] The token cache is being invalidate because project bfecf204244943cab40edfd09e409186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:16.950932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.950932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:16.961142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3913/7863] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:16 2022] DELETE /identity/v3/projects/bfecf204244943cab40edfd09e409186 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:16.961369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f420a-3599-475b-9c5e-4365429fbf6e service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:16.973387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f420a-3599-475b-9c5e-4365429fbf6e service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:17.047495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:17.048670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.049065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.049189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] PATH_INFO: `/v3/users/17bb212a0edc4e848df1f1e3f30d48b3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.050531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bb212a0edc4e848df1f1e3f30d48b3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:17.052514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:17.107524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bb212a0edc4e848df1f1e3f30d48b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.114759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bb212a0edc4e848df1f1e3f30d48b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.115431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bb212a0edc4e848df1f1e3f30d48b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.116151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bb212a0edc4e848df1f1e3f30d48b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.124130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-587ee2c8-73d5-4825-a46b-94518f675b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bb212a0edc4e848df1f1e3f30d48b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.141365 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3951/7864] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:16 2022] DELETE /identity/v3/users/17bb212a0edc4e848df1f1e3f30d48b3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:17.413027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:17.414460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:17.429603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8a2a9-d5be-4725-893f-a3af325680b8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:17.488144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:17.489004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.489462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.489963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] PATH_INFO: `/v3/projects/0c2410f10ff94241aae824539804644a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.491144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2410f10ff94241aae824539804644a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:17.493420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:17.539393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2410f10ff94241aae824539804644a', 'request_id': 'req-0a3bf977-ffe4-4f89-ba17-a583efe28e14'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.546939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2410f10ff94241aae824539804644a', 'request_id': 'req-0a3bf977-ffe4-4f89-ba17-a583efe28e14'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.552365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2410f10ff94241aae824539804644a', 'request_id': 'req-0a3bf977-ffe4-4f89-ba17-a583efe28e14'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.563425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] The token cache is being invalidate because project 0c2410f10ff94241aae824539804644a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:17.563736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.564381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0a3bf977-ffe4-4f89-ba17-a583efe28e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:17.566049 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3914/7865] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:17 2022] DELETE /identity/v3/projects/0c2410f10ff94241aae824539804644a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:17.571501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5671e40-8083-466e-935a-74fc4bbb6557 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.571895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5671e40-8083-466e-935a-74fc4bbb6557 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.572233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5671e40-8083-466e-935a-74fc4bbb6557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.591677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a5671e40-8083-466e-935a-74fc4bbb6557 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:17.593463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a5671e40-8083-466e-935a-74fc4bbb6557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:17.659990 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3952/7866] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:17.664809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92817e-1207-42d4-b9a0-fbfcbcd66313 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.665308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92817e-1207-42d4-b9a0-fbfcbcd66313 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.665707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad92817e-1207-42d4-b9a0-fbfcbcd66313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.685818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ad92817e-1207-42d4-b9a0-fbfcbcd66313 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:17.687641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ad92817e-1207-42d4-b9a0-fbfcbcd66313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:17.696865 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3915/7867] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:17.701160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5671e40-8083-466e-935a-74fc4bbb6557 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:17.713092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5671e40-8083-466e-935a-74fc4bbb6557 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:17.719099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aad38-6cb0-4a50-afeb-6aa895a59427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:17.719686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aad38-6cb0-4a50-afeb-6aa895a59427 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.720014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aad38-6cb0-4a50-afeb-6aa895a59427 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.720315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8aad38-6cb0-4a50-afeb-6aa895a59427 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.721044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aad38-6cb0-4a50-afeb-6aa895a59427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:17.721355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aad38-6cb0-4a50-afeb-6aa895a59427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:17.722971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8aad38-6cb0-4a50-afeb-6aa895a59427 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:17.735147 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3953/7868] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:17.740508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92817e-1207-42d4-b9a0-fbfcbcd66313 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:17.751902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad92817e-1207-42d4-b9a0-fbfcbcd66313 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:17.756968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d2c80-0d29-4aa9-bab2-d1296a8fa153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:17.757625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d2c80-0d29-4aa9-bab2-d1296a8fa153 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.757916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d2c80-0d29-4aa9-bab2-d1296a8fa153 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.758202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d2c80-0d29-4aa9-bab2-d1296a8fa153 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.758888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d2c80-0d29-4aa9-bab2-d1296a8fa153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:17.761243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d2c80-0d29-4aa9-bab2-d1296a8fa153 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:17.790721 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3916/7869] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:17 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:17.791829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aad38-6cb0-4a50-afeb-6aa895a59427 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:17.801834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8aad38-6cb0-4a50-afeb-6aa895a59427 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:17.859672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16da4-daa2-4e8e-b073-3a18c4285ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:17.860385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16da4-daa2-4e8e-b073-3a18c4285ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.860676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16da4-daa2-4e8e-b073-3a18c4285ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.860962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb16da4-daa2-4e8e-b073-3a18c4285ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.861718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb16da4-daa2-4e8e-b073-3a18c4285ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:17.863972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb16da4-daa2-4e8e-b073-3a18c4285ee2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:17.885493 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3954/7870] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:17 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:17.890491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d2c80-0d29-4aa9-bab2-d1296a8fa153 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:17.902566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d2c80-0d29-4aa9-bab2-d1296a8fa153 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:17.907887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083efa92-019f-4e36-9f4c-c234a709783a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:17.908582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083efa92-019f-4e36-9f4c-c234a709783a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.908871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083efa92-019f-4e36-9f4c-c234a709783a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.909158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083efa92-019f-4e36-9f4c-c234a709783a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.909882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083efa92-019f-4e36-9f4c-c234a709783a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:17.911516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083efa92-019f-4e36-9f4c-c234a709783a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:17.924202 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3917/7871] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:17.928708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16da4-daa2-4e8e-b073-3a18c4285ee2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:17.940835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb16da4-daa2-4e8e-b073-3a18c4285ee2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:17.945567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5bdbd5-db17-48c4-9613-b5acd8bc8336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:17.946224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bdbd5-db17-48c4-9613-b5acd8bc8336 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.946503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bdbd5-db17-48c4-9613-b5acd8bc8336 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.946873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5bdbd5-db17-48c4-9613-b5acd8bc8336 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.947591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bdbd5-db17-48c4-9613-b5acd8bc8336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:17.949255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5bdbd5-db17-48c4-9613-b5acd8bc8336 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:17.959910 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3955/7872] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:17.964153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083efa92-019f-4e36-9f4c-c234a709783a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:17.976691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083efa92-019f-4e36-9f4c-c234a709783a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:17.981394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05234e-eeef-4531-9056-8d12456a089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:17.982269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05234e-eeef-4531-9056-8d12456a089a admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:17.982553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05234e-eeef-4531-9056-8d12456a089a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:17.982829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05234e-eeef-4531-9056-8d12456a089a admin admin] PATH_INFO: `/v3/projects/1d5fbaf725654d24bc57c0b8317f452e/users/46f23f8afd654b05b6dcacdb9d3d1cfc/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:17.997586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05234e-eeef-4531-9056-8d12456a089a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5fbaf725654d24bc57c0b8317f452e, user_id=46f23f8afd654b05b6dcacdb9d3d1cfc, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.000956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05234e-eeef-4531-9056-8d12456a089a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.016876 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3918/7873] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:17 2022] PUT /identity/v3/projects/1d5fbaf725654d24bc57c0b8317f452e/users/46f23f8afd654b05b6dcacdb9d3d1cfc/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:18.029154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47d215-2240-45d5-a593-b7c210b1baa0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.029675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47d215-2240-45d5-a593-b7c210b1baa0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.029799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47d215-2240-45d5-a593-b7c210b1baa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.057319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5c47d215-2240-45d5-a593-b7c210b1baa0 None None] MFA Rules not processed for user `46f23f8afd654b05b6dcacdb9d3d1cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:18.058722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5c47d215-2240-45d5-a593-b7c210b1baa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:18.133688 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3956/7874] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:18.142374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05234e-eeef-4531-9056-8d12456a089a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.154759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05234e-eeef-4531-9056-8d12456a089a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.158980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe2814-74b2-4233-992f-f9add3b1bd29 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.159854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2814-74b2-4233-992f-f9add3b1bd29 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.160169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2814-74b2-4233-992f-f9add3b1bd29 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.160445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe2814-74b2-4233-992f-f9add3b1bd29 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.161224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe2814-74b2-4233-992f-f9add3b1bd29 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:create_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.162368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe2814-74b2-4233-992f-f9add3b1bd29 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.236754 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3919/7875] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Mar 26 21:16:18 2022] POST /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials => generated 788 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:18.238660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47d215-2240-45d5-a593-b7c210b1baa0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.247363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47d215-2240-45d5-a593-b7c210b1baa0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.252770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc2ec-e9c5-41d0-9488-685d4f029308 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.253811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc2ec-e9c5-41d0-9488-685d4f029308 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.254169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc2ec-e9c5-41d0-9488-685d4f029308 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.254519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc2ec-e9c5-41d0-9488-685d4f029308 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/ee289c96ffff40a489df35ae7d598f45` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.263794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfc2ec-e9c5-41d0-9488-685d4f029308 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:get_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc, application_credential_id=ee289c96ffff40a489df35ae7d598f45)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.265493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbfc2ec-e9c5-41d0-9488-685d4f029308 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.267187 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3957/7876] 10.222.0.16 () {58 vars in 1391 bytes} [Sat Mar 26 21:16:18 2022] GET /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/ee289c96ffff40a489df35ae7d598f45 => generated 688 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:16:18.274920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd9c80-8020-4b84-9d9b-5f1a18c01c97 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.275214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd9c80-8020-4b84-9d9b-5f1a18c01c97 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.275494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd9c80-8020-4b84-9d9b-5f1a18c01c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.290437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a5cd9c80-8020-4b84-9d9b-5f1a18c01c97 None None] MFA Rules not processed for user `46f23f8afd654b05b6dcacdb9d3d1cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:18.292037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a5cd9c80-8020-4b84-9d9b-5f1a18c01c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:18.400146 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3920/7877] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3414 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Mar 26 21:16:18.404529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc2ec-e9c5-41d0-9488-685d4f029308 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.415170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc2ec-e9c5-41d0-9488-685d4f029308 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.420094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e2e01-97aa-4121-a099-4fddf316215a tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.421648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e2e01-97aa-4121-a099-4fddf316215a tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.422001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e2e01-97aa-4121-a099-4fddf316215a tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.422292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e2e01-97aa-4121-a099-4fddf316215a tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/ee289c96ffff40a489df35ae7d598f45` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.423474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e2e01-97aa-4121-a099-4fddf316215a tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:delete_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc, application_credential_id=ee289c96ffff40a489df35ae7d598f45)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.425008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e2e01-97aa-4121-a099-4fddf316215a tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.446593 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3958/7878] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Mar 26 21:16:18 2022] DELETE /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/ee289c96ffff40a489df35ae7d598f45 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:18.452050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd9c80-8020-4b84-9d9b-5f1a18c01c97 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.462512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd9c80-8020-4b84-9d9b-5f1a18c01c97 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.468254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141e691-34d4-417a-be69-42d81cdbb1f0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.469165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141e691-34d4-417a-be69-42d81cdbb1f0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.469446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141e691-34d4-417a-be69-42d81cdbb1f0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.469729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141e691-34d4-417a-be69-42d81cdbb1f0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.470483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141e691-34d4-417a-be69-42d81cdbb1f0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:create_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.471785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141e691-34d4-417a-be69-42d81cdbb1f0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.563221 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3921/7879] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Mar 26 21:16:18 2022] POST /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials => generated 921 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:18.564607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e2e01-97aa-4121-a099-4fddf316215a tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.574572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e2e01-97aa-4121-a099-4fddf316215a tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.578977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36eb9d-e0d8-445d-90f8-0fdaa0fea5a3 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.579902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36eb9d-e0d8-445d-90f8-0fdaa0fea5a3 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.580352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36eb9d-e0d8-445d-90f8-0fdaa0fea5a3 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.580507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36eb9d-e0d8-445d-90f8-0fdaa0fea5a3 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/ac027a06095b4a8e82a5129404568e5e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.590722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36eb9d-e0d8-445d-90f8-0fdaa0fea5a3 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:delete_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc, application_credential_id=ac027a06095b4a8e82a5129404568e5e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.592275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36eb9d-e0d8-445d-90f8-0fdaa0fea5a3 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.616258 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3959/7880] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Mar 26 21:16:18 2022] DELETE /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/ac027a06095b4a8e82a5129404568e5e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:18.621362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141e691-34d4-417a-be69-42d81cdbb1f0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.631141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141e691-34d4-417a-be69-42d81cdbb1f0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.635371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7b5a-eb9d-4441-a85e-5d099852aa72 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.636274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7b5a-eb9d-4441-a85e-5d099852aa72 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.636557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7b5a-eb9d-4441-a85e-5d099852aa72 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.636835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e7b5a-eb9d-4441-a85e-5d099852aa72 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.637598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e7b5a-eb9d-4441-a85e-5d099852aa72 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:create_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.638762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e7b5a-eb9d-4441-a85e-5d099852aa72 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.707932 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3922/7881] 10.222.0.16 () {60 vars in 1314 bytes} [Sat Mar 26 21:16:18 2022] POST /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials => generated 813 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:18.712210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36eb9d-e0d8-445d-90f8-0fdaa0fea5a3 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.726045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36eb9d-e0d8-445d-90f8-0fdaa0fea5a3 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.730934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1598b-9855-4028-a894-38539e6d1591 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.731897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1598b-9855-4028-a894-38539e6d1591 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.732223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1598b-9855-4028-a894-38539e6d1591 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.732503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1598b-9855-4028-a894-38539e6d1591 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/8dc67a2a70d345bd90c5cb77da4df5bd` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.742699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1598b-9855-4028-a894-38539e6d1591 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:delete_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc, application_credential_id=8dc67a2a70d345bd90c5cb77da4df5bd)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.744282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1598b-9855-4028-a894-38539e6d1591 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.762228 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3960/7882] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Mar 26 21:16:18 2022] DELETE /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/8dc67a2a70d345bd90c5cb77da4df5bd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:18.767768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7b5a-eb9d-4441-a85e-5d099852aa72 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.777477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e7b5a-eb9d-4441-a85e-5d099852aa72 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.783239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcb2c-0436-4b81-bc8d-bacd86c0f9d5 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.784309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcb2c-0436-4b81-bc8d-bacd86c0f9d5 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.784607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcb2c-0436-4b81-bc8d-bacd86c0f9d5 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.784949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fcb2c-0436-4b81-bc8d-bacd86c0f9d5 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.785616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fcb2c-0436-4b81-bc8d-bacd86c0f9d5 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:create_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.786885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fcb2c-0436-4b81-bc8d-bacd86c0f9d5 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.853868 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3923/7883] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Mar 26 21:16:18 2022] POST /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials => generated 788 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:18.857939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1598b-9855-4028-a894-38539e6d1591 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.867154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1598b-9855-4028-a894-38539e6d1591 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.871274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc44e8-f29b-4e05-9c4f-9af46ee7d361 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.872158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc44e8-f29b-4e05-9c4f-9af46ee7d361 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.872449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc44e8-f29b-4e05-9c4f-9af46ee7d361 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.872724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc44e8-f29b-4e05-9c4f-9af46ee7d361 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.873441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc44e8-f29b-4e05-9c4f-9af46ee7d361 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:create_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.874636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc44e8-f29b-4e05-9c4f-9af46ee7d361 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.945537 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3961/7884] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Mar 26 21:16:18 2022] POST /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials => generated 789 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:18.950244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcb2c-0436-4b81-bc8d-bacd86c0f9d5 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.960816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fcb2c-0436-4b81-bc8d-bacd86c0f9d5 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:18.965207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899a9a2-96dc-458c-8812-84b9d41e0d7d tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:18.966143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899a9a2-96dc-458c-8812-84b9d41e0d7d tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:18.966740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899a9a2-96dc-458c-8812-84b9d41e0d7d tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:18.966740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899a9a2-96dc-458c-8812-84b9d41e0d7d tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:18.968283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899a9a2-96dc-458c-8812-84b9d41e0d7d tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:list_application_credentials(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:18.970173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899a9a2-96dc-458c-8812-84b9d41e0d7d tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:18.983252 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3924/7885] 10.222.0.16 () {58 vars in 1292 bytes} [Sat Mar 26 21:16:18 2022] GET /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials => generated 1501 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:18.988181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc44e8-f29b-4e05-9c4f-9af46ee7d361 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:18.998031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc44e8-f29b-4e05-9c4f-9af46ee7d361 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:19.009144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bafb1-c5c9-438f-95c6-3c684c9d9d55 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:19.009144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bafb1-c5c9-438f-95c6-3c684c9d9d55 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.009144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bafb1-c5c9-438f-95c6-3c684c9d9d55 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.009364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bafb1-c5c9-438f-95c6-3c684c9d9d55 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/c1c3cc566dae49989bbf988e3ce00c47` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.015715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bafb1-c5c9-438f-95c6-3c684c9d9d55 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:delete_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc, application_credential_id=c1c3cc566dae49989bbf988e3ce00c47)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:19.017541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bafb1-c5c9-438f-95c6-3c684c9d9d55 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:19.038876 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3962/7886] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Mar 26 21:16:18 2022] DELETE /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/c1c3cc566dae49989bbf988e3ce00c47 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:19.044389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899a9a2-96dc-458c-8812-84b9d41e0d7d tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:19.057647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899a9a2-96dc-458c-8812-84b9d41e0d7d tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:19.062007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26cbbf-1784-4004-b87e-66b845094bc0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:19.062943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26cbbf-1784-4004-b87e-66b845094bc0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.063229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26cbbf-1784-4004-b87e-66b845094bc0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.065440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26cbbf-1784-4004-b87e-66b845094bc0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/a6e058fa9cd94215bc7a6bf4da2398fb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.074735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26cbbf-1784-4004-b87e-66b845094bc0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:delete_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc, application_credential_id=a6e058fa9cd94215bc7a6bf4da2398fb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:19.076365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26cbbf-1784-4004-b87e-66b845094bc0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:19.098419 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3925/7887] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Mar 26 21:16:19 2022] DELETE /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/a6e058fa9cd94215bc7a6bf4da2398fb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:19.104148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bafb1-c5c9-438f-95c6-3c684c9d9d55 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:19.116199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bafb1-c5c9-438f-95c6-3c684c9d9d55 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:19.120838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f038c7e-93cd-4ca2-bc80-671689a63ee8 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:19.121709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038c7e-93cd-4ca2-bc80-671689a63ee8 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.121989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038c7e-93cd-4ca2-bc80-671689a63ee8 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.122263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f038c7e-93cd-4ca2-bc80-671689a63ee8 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.123026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f038c7e-93cd-4ca2-bc80-671689a63ee8 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:create_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:19.124714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f038c7e-93cd-4ca2-bc80-671689a63ee8 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:19.197706 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3963/7888] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Mar 26 21:16:19 2022] POST /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials => generated 789 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:19.201705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26cbbf-1784-4004-b87e-66b845094bc0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:19.211470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26cbbf-1784-4004-b87e-66b845094bc0 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:19.215652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3747cd0-a9a7-4b1c-ba04-e1ecc92bcd4e tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:19.216565 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3747cd0-a9a7-4b1c-ba04-e1ecc92bcd4e tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.216855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3747cd0-a9a7-4b1c-ba04-e1ecc92bcd4e tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.217149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3747cd0-a9a7-4b1c-ba04-e1ecc92bcd4e tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.217904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3747cd0-a9a7-4b1c-ba04-e1ecc92bcd4e tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:create_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:19.219073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3747cd0-a9a7-4b1c-ba04-e1ecc92bcd4e tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:19.287980 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3926/7889] 10.222.0.16 () {60 vars in 1313 bytes} [Sat Mar 26 21:16:19 2022] POST /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials => generated 788 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:19.291998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f038c7e-93cd-4ca2-bc80-671689a63ee8 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:19.301797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f038c7e-93cd-4ca2-bc80-671689a63ee8 tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:19.306322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c6b8-a055-474d-965c-8d31f7afcfac tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:19.307178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c6b8-a055-474d-965c-8d31f7afcfac tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.307464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c6b8-a055-474d-965c-8d31f7afcfac tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.307743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c6b8-a055-474d-965c-8d31f7afcfac tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.308474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c6b8-a055-474d-965c-8d31f7afcfac tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Adding query filter params (name=tempest-application_credential-507621674) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:19.308793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c6b8-a055-474d-965c-8d31f7afcfac tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:list_application_credentials(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:19.310441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c6b8-a055-474d-965c-8d31f7afcfac tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:19.320860 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3964/7890] 10.222.0.16 () {58 vars in 1383 bytes} [Sat Mar 26 21:16:19 2022] GET /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials?name=tempest-application_credential-507621674 => generated 885 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:19.325006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3747cd0-a9a7-4b1c-ba04-e1ecc92bcd4e tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:19.334791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3747cd0-a9a7-4b1c-ba04-e1ecc92bcd4e tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:19.338915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f74d0-9b0a-4c2f-acf3-344432f37d5f tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:19.339838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f74d0-9b0a-4c2f-acf3-344432f37d5f tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.340161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f74d0-9b0a-4c2f-acf3-344432f37d5f tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.340446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f74d0-9b0a-4c2f-acf3-344432f37d5f tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/6fb8957079ed437ba97db141a11b275b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.348657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f74d0-9b0a-4c2f-acf3-344432f37d5f tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:delete_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc, application_credential_id=6fb8957079ed437ba97db141a11b275b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:19.350176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f74d0-9b0a-4c2f-acf3-344432f37d5f tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:19.370260 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3927/7891] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Mar 26 21:16:19 2022] DELETE /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/6fb8957079ed437ba97db141a11b275b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:19.371887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c6b8-a055-474d-965c-8d31f7afcfac tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:19.381946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c6b8-a055-474d-965c-8d31f7afcfac tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:19.386140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd132571-60f9-45e2-a2fa-3ace28e738cf tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46f23f8afd654b05b6dcacdb9d3d1cfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1d5fbaf725654d24bc57c0b8317f452e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:19.387188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132571-60f9-45e2-a2fa-3ace28e738cf tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.387524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132571-60f9-45e2-a2fa-3ace28e738cf tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.387742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd132571-60f9-45e2-a2fa-3ace28e738cf tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/a01a0861987b4be89d5138e1989c25e6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.397298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132571-60f9-45e2-a2fa-3ace28e738cf tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorizing `identity:delete_application_credential(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc, application_credential_id=a01a0861987b4be89d5138e1989c25e6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:19.398735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd132571-60f9-45e2-a2fa-3ace28e738cf tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:19.417240 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3965/7892] 10.222.0.16 () {58 vars in 1394 bytes} [Sat Mar 26 21:16:19 2022] DELETE /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc/application_credentials/a01a0861987b4be89d5138e1989c25e6 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:19.425629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f74d0-9b0a-4c2f-acf3-344432f37d5f tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:19.489614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f74d0-9b0a-4c2f-acf3-344432f37d5f tempest-ApplicationCredentialsV3Test-669311024 tempest-ApplicationCredentialsV3Test-669311024-project] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:19.494252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:19.495143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.495423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.495689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] PATH_INFO: `/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.497029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f23f8afd654b05b6dcacdb9d3d1cfc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:19.499410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:19.546761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f23f8afd654b05b6dcacdb9d3d1cfc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:19.554358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f23f8afd654b05b6dcacdb9d3d1cfc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:19.555078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f23f8afd654b05b6dcacdb9d3d1cfc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:19.555708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f23f8afd654b05b6dcacdb9d3d1cfc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:19.580473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f23f8afd654b05b6dcacdb9d3d1cfc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:19.595092 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3928/7893] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:19 2022] DELETE /identity/v3/users/46f23f8afd654b05b6dcacdb9d3d1cfc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:19.599434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c85570-5316-423c-a8a4-56a0066c8dff None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.599725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c85570-5316-423c-a8a4-56a0066c8dff None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.600313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c85570-5316-423c-a8a4-56a0066c8dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.622021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f4c85570-5316-423c-a8a4-56a0066c8dff None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:19.623212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f4c85570-5316-423c-a8a4-56a0066c8dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:19.681480 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3966/7894] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:19.691765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:19.693176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:19.752989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02f6f4-2424-4a9b-af6d-7f8eac0eacc8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:19.756643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a8064-47a2-4d5b-94b6-00bb42f7e4dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:19.757279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8064-47a2-4d5b-94b6-00bb42f7e4dd service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:19.757558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8064-47a2-4d5b-94b6-00bb42f7e4dd service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:19.757831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a8064-47a2-4d5b-94b6-00bb42f7e4dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:19.767199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a8064-47a2-4d5b-94b6-00bb42f7e4dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:19.768686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a8064-47a2-4d5b-94b6-00bb42f7e4dd service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:19.778058 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3929/7895] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:20.068874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c85570-5316-423c-a8a4-56a0066c8dff None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:20.071042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f4c85570-5316-423c-a8a4-56a0066c8dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:20.084928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c85570-5316-423c-a8a4-56a0066c8dff None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:20.089690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:20.090578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.090871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.091126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] PATH_INFO: `/v3/projects/1d5fbaf725654d24bc57c0b8317f452e` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.092525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5fbaf725654d24bc57c0b8317f452e)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:20.095730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:20.145730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5fbaf725654d24bc57c0b8317f452e', 'request_id': 'req-30877aa4-74c7-49c2-8d59-66d063bb1c1b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:20.153040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5fbaf725654d24bc57c0b8317f452e', 'request_id': 'req-30877aa4-74c7-49c2-8d59-66d063bb1c1b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:20.158760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5fbaf725654d24bc57c0b8317f452e', 'request_id': 'req-30877aa4-74c7-49c2-8d59-66d063bb1c1b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:20.170145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] The token cache is being invalidate because project 1d5fbaf725654d24bc57c0b8317f452e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:20.170515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:20.171254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30877aa4-74c7-49c2-8d59-66d063bb1c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:20.173113 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3967/7896] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:20 2022] DELETE /identity/v3/projects/1d5fbaf725654d24bc57c0b8317f452e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:20.178525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ba1f5-6e1c-40f5-a01a-853e611821a9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.178864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ba1f5-6e1c-40f5-a01a-853e611821a9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.179284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ba1f5-6e1c-40f5-a01a-853e611821a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.199669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-de9ba1f5-6e1c-40f5-a01a-853e611821a9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:20.201098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-de9ba1f5-6e1c-40f5-a01a-853e611821a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:20.261510 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3930/7897] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:20.269996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fad39e-a0aa-4bf7-9ef5-d0cddf001510 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.270281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fad39e-a0aa-4bf7-9ef5-d0cddf001510 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.270559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fad39e-a0aa-4bf7-9ef5-d0cddf001510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.289278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-96fad39e-a0aa-4bf7-9ef5-d0cddf001510 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:20.290454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-96fad39e-a0aa-4bf7-9ef5-d0cddf001510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:20.298844 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3968/7898] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:20.303220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ba1f5-6e1c-40f5-a01a-853e611821a9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:20.313624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ba1f5-6e1c-40f5-a01a-853e611821a9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:20.318192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da591778-6a0d-41af-8ecb-6de87931b4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:20.318838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da591778-6a0d-41af-8ecb-6de87931b4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.319123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da591778-6a0d-41af-8ecb-6de87931b4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.319397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da591778-6a0d-41af-8ecb-6de87931b4c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.320143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da591778-6a0d-41af-8ecb-6de87931b4c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:20.320449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da591778-6a0d-41af-8ecb-6de87931b4c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:20.322048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da591778-6a0d-41af-8ecb-6de87931b4c3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:20.333444 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3931/7899] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:20.337487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fad39e-a0aa-4bf7-9ef5-d0cddf001510 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:20.346775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fad39e-a0aa-4bf7-9ef5-d0cddf001510 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:20.351454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7192-2964-4251-ba9f-79e286c1be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:20.352152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7192-2964-4251-ba9f-79e286c1be37 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.352434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7192-2964-4251-ba9f-79e286c1be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.352709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f7192-2964-4251-ba9f-79e286c1be37 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.353429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7192-2964-4251-ba9f-79e286c1be37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:20.355385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f7192-2964-4251-ba9f-79e286c1be37 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:20.380833 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3969/7900] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:20 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:20.384843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da591778-6a0d-41af-8ecb-6de87931b4c3 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:20.394653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da591778-6a0d-41af-8ecb-6de87931b4c3 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:20.450569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c524a9-e0de-4854-93ba-283928cb504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:20.451269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c524a9-e0de-4854-93ba-283928cb504a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.451556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c524a9-e0de-4854-93ba-283928cb504a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.451835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c524a9-e0de-4854-93ba-283928cb504a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.452574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c524a9-e0de-4854-93ba-283928cb504a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:20.454515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c524a9-e0de-4854-93ba-283928cb504a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:20.480809 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3932/7901] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:20 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:20.482249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7192-2964-4251-ba9f-79e286c1be37 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:20.493149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f7192-2964-4251-ba9f-79e286c1be37 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:20.497735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1703a-d2fd-47e2-9d02-2045ffccdf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:20.498339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1703a-d2fd-47e2-9d02-2045ffccdf17 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.498618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1703a-d2fd-47e2-9d02-2045ffccdf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.500680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1703a-d2fd-47e2-9d02-2045ffccdf17 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.500680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1703a-d2fd-47e2-9d02-2045ffccdf17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:20.501774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1703a-d2fd-47e2-9d02-2045ffccdf17 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:20.512237 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3970/7902] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:20.516332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c524a9-e0de-4854-93ba-283928cb504a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:20.526476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c524a9-e0de-4854-93ba-283928cb504a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:20.531542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c336c-e43e-4d40-bad0-02bec3659c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:20.532238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c336c-e43e-4d40-bad0-02bec3659c8e admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.532701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c336c-e43e-4d40-bad0-02bec3659c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.532991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c336c-e43e-4d40-bad0-02bec3659c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.533754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c336c-e43e-4d40-bad0-02bec3659c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:20.535363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c336c-e43e-4d40-bad0-02bec3659c8e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:20.549116 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3933/7903] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:20.550326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1703a-d2fd-47e2-9d02-2045ffccdf17 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:20.560415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1703a-d2fd-47e2-9d02-2045ffccdf17 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:20.565985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda65de0-8122-4325-bdde-21a07b2645ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:20.566866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda65de0-8122-4325-bdde-21a07b2645ff admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.567153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda65de0-8122-4325-bdde-21a07b2645ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.567468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda65de0-8122-4325-bdde-21a07b2645ff admin admin] PATH_INFO: `/v3/projects/abf1035634c947b8b470d65c648ab2ad/users/f9e51be34ac349cf9decb5d56f7dd947/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.582253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda65de0-8122-4325-bdde-21a07b2645ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf1035634c947b8b470d65c648ab2ad, user_id=f9e51be34ac349cf9decb5d56f7dd947, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:20.585045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda65de0-8122-4325-bdde-21a07b2645ff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:20.599423 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3971/7904] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:20 2022] PUT /identity/v3/projects/abf1035634c947b8b470d65c648ab2ad/users/f9e51be34ac349cf9decb5d56f7dd947/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:20.610031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e80d9-0888-4227-bc03-2872aa2c2eb6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.610500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e80d9-0888-4227-bc03-2872aa2c2eb6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.610608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e80d9-0888-4227-bc03-2872aa2c2eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.639841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-804e80d9-0888-4227-bc03-2872aa2c2eb6 None None] MFA Rules not processed for user `f9e51be34ac349cf9decb5d56f7dd947`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:20.641039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-804e80d9-0888-4227-bc03-2872aa2c2eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:20.649218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda65de0-8122-4325-bdde-21a07b2645ff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:20.650867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bda65de0-8122-4325-bdde-21a07b2645ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:20.714348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda65de0-8122-4325-bdde-21a07b2645ff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:20.718422 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3934/7905] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:20.723556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be991b46-e9cc-409e-9e8f-a5d111c507bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:20.724181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be991b46-e9cc-409e-9e8f-a5d111c507bc service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.724466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be991b46-e9cc-409e-9e8f-a5d111c507bc service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.724741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be991b46-e9cc-409e-9e8f-a5d111c507bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.726675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be991b46-e9cc-409e-9e8f-a5d111c507bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:20.730144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e80d9-0888-4227-bc03-2872aa2c2eb6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:20.731273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-804e80d9-0888-4227-bc03-2872aa2c2eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:20.739304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be991b46-e9cc-409e-9e8f-a5d111c507bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:20.740781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be991b46-e9cc-409e-9e8f-a5d111c507bc service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:20.750516 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3972/7906] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:20.818176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e80d9-0888-4227-bc03-2872aa2c2eb6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:20.826022 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1225d34-df8a-418d-9eab-f9b2ea32d8f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:20.826810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225d34-df8a-418d-9eab-f9b2ea32d8f0 service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:20.827103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225d34-df8a-418d-9eab-f9b2ea32d8f0 service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:20.827581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1225d34-df8a-418d-9eab-f9b2ea32d8f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:20.836893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225d34-df8a-418d-9eab-f9b2ea32d8f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:20.838426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1225d34-df8a-418d-9eab-f9b2ea32d8f0 service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:20.849152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3935/7907] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:20.962736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be991b46-e9cc-409e-9e8f-a5d111c507bc service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:21.041421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be991b46-e9cc-409e-9e8f-a5d111c507bc service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:21.047468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:21.048412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:21.048732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:21.048969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] PATH_INFO: `/v3/users/f9e51be34ac349cf9decb5d56f7dd947` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:21.050272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e51be34ac349cf9decb5d56f7dd947)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:21.052234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:21.098212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e51be34ac349cf9decb5d56f7dd947'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.105040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e51be34ac349cf9decb5d56f7dd947'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.105718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e51be34ac349cf9decb5d56f7dd947'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.106323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e51be34ac349cf9decb5d56f7dd947'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.113737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e51be34ac349cf9decb5d56f7dd947'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.130669 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3973/7908] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:20 2022] DELETE /identity/v3/users/f9e51be34ac349cf9decb5d56f7dd947 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:21.135079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58501050-7142-4859-9450-a17c9f284e79 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:21.135357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58501050-7142-4859-9450-a17c9f284e79 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:21.135643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58501050-7142-4859-9450-a17c9f284e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:21.154577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-58501050-7142-4859-9450-a17c9f284e79 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:21.156512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-58501050-7142-4859-9450-a17c9f284e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:21.228729 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3936/7909] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:21.244132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:21.247399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:21.319719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ebecd-a9db-49bf-8ed7-3c51e059f72d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:21.328403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf571ba-7378-4f6c-9f0e-6ffffb3297fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:21.329121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf571ba-7378-4f6c-9f0e-6ffffb3297fe service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:21.329576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf571ba-7378-4f6c-9f0e-6ffffb3297fe service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:21.329958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf571ba-7378-4f6c-9f0e-6ffffb3297fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:21.349234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf571ba-7378-4f6c-9f0e-6ffffb3297fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:21.350716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf571ba-7378-4f6c-9f0e-6ffffb3297fe service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:21.372397 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3974/7910] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:21.671462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58501050-7142-4859-9450-a17c9f284e79 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:21.673213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-58501050-7142-4859-9450-a17c9f284e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:21.687408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58501050-7142-4859-9450-a17c9f284e79 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:21.692279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:21.693393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:21.693679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:21.693955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] PATH_INFO: `/v3/projects/abf1035634c947b8b470d65c648ab2ad` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:21.696010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf1035634c947b8b470d65c648ab2ad)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:21.698165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:21.749806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf1035634c947b8b470d65c648ab2ad', 'request_id': 'req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.756601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf1035634c947b8b470d65c648ab2ad', 'request_id': 'req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.762041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf1035634c947b8b470d65c648ab2ad', 'request_id': 'req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.773445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] The token cache is being invalidate because project abf1035634c947b8b470d65c648ab2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:21.773732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.774364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d0af6f9a-75dc-4e1a-9b66-7d47c0ea027a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:21.775944 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3937/7911] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:21 2022] DELETE /identity/v3/projects/abf1035634c947b8b470d65c648ab2ad => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:21.780810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddd675-1617-4537-bd5c-d550f1061cbd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:21.781104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddd675-1617-4537-bd5c-d550f1061cbd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:21.781389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddd675-1617-4537-bd5c-d550f1061cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:21.799547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-85ddd675-1617-4537-bd5c-d550f1061cbd None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:21.800783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-85ddd675-1617-4537-bd5c-d550f1061cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:21.857156 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3975/7912] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:21.866463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758abac-7e22-4974-9023-2436959ba026 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:21.866757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758abac-7e22-4974-9023-2436959ba026 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:21.867075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758abac-7e22-4974-9023-2436959ba026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:21.885829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a758abac-7e22-4974-9023-2436959ba026 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:21.887051 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a758abac-7e22-4974-9023-2436959ba026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:21.895253 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3938/7913] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:21.899292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddd675-1617-4537-bd5c-d550f1061cbd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:21.908802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddd675-1617-4537-bd5c-d550f1061cbd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:21.913379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe068-c7e1-4427-8427-52a266dbcced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:21.914018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe068-c7e1-4427-8427-52a266dbcced admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:21.914302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe068-c7e1-4427-8427-52a266dbcced admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:21.914613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98efe068-c7e1-4427-8427-52a266dbcced admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:21.915356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efe068-c7e1-4427-8427-52a266dbcced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:21.915665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efe068-c7e1-4427-8427-52a266dbcced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:21.917321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98efe068-c7e1-4427-8427-52a266dbcced admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:21.930008 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3976/7914] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:21.934027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758abac-7e22-4974-9023-2436959ba026 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:21.944556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758abac-7e22-4974-9023-2436959ba026 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:21.949804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e638ef-0a34-4126-9336-c70b3fac161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:21.950532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e638ef-0a34-4126-9336-c70b3fac161b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:21.950861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e638ef-0a34-4126-9336-c70b3fac161b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:21.951260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e638ef-0a34-4126-9336-c70b3fac161b admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:21.951991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e638ef-0a34-4126-9336-c70b3fac161b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:21.954397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e638ef-0a34-4126-9336-c70b3fac161b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:21.988409 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3939/7915] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:21 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:21.992997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe068-c7e1-4427-8427-52a266dbcced admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.004769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98efe068-c7e1-4427-8427-52a266dbcced admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.075470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5efa68-e1a8-45aa-be57-81c9cc25462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.076465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5efa68-e1a8-45aa-be57-81c9cc25462f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.076465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5efa68-e1a8-45aa-be57-81c9cc25462f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.077076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5efa68-e1a8-45aa-be57-81c9cc25462f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.077537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5efa68-e1a8-45aa-be57-81c9cc25462f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.079632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5efa68-e1a8-45aa-be57-81c9cc25462f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.102459 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3977/7916] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:21 2022] POST /identity/v3/users => generated 285 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:22.106720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e638ef-0a34-4126-9336-c70b3fac161b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.119578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e638ef-0a34-4126-9336-c70b3fac161b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.129553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d3c79-3ee5-4459-92b7-f547f3a45c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.130217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d3c79-3ee5-4459-92b7-f547f3a45c44 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.130499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d3c79-3ee5-4459-92b7-f547f3a45c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.130770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d3c79-3ee5-4459-92b7-f547f3a45c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.131491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d3c79-3ee5-4459-92b7-f547f3a45c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.133241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d3c79-3ee5-4459-92b7-f547f3a45c44 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.144677 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3940/7917] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:22.149055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5efa68-e1a8-45aa-be57-81c9cc25462f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.161333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5efa68-e1a8-45aa-be57-81c9cc25462f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.166481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08b379-9f0e-4db7-aa25-1ae9628701a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.167270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b379-9f0e-4db7-aa25-1ae9628701a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.167468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b379-9f0e-4db7-aa25-1ae9628701a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.168223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08b379-9f0e-4db7-aa25-1ae9628701a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.168836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08b379-9f0e-4db7-aa25-1ae9628701a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.170139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08b379-9f0e-4db7-aa25-1ae9628701a8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.182211 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3978/7918] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:22.186325 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d3c79-3ee5-4459-92b7-f547f3a45c44 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.196813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d3c79-3ee5-4459-92b7-f547f3a45c44 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.203794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b69d7-9e5d-4742-9672-0db9d437594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.204706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b69d7-9e5d-4742-9672-0db9d437594b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.204993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b69d7-9e5d-4742-9672-0db9d437594b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.205268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b69d7-9e5d-4742-9672-0db9d437594b admin admin] PATH_INFO: `/v3/projects/af34e69d8af74a9b900783174be0cec2/users/c30814377b094a7687335ff16430dcd5/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.220647 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b69d7-9e5d-4742-9672-0db9d437594b admin admin] RBAC: Authorizing `identity:create_grant(project_id=af34e69d8af74a9b900783174be0cec2, user_id=c30814377b094a7687335ff16430dcd5, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.223511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b69d7-9e5d-4742-9672-0db9d437594b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.237758 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3941/7919] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:22 2022] PUT /identity/v3/projects/af34e69d8af74a9b900783174be0cec2/users/c30814377b094a7687335ff16430dcd5/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:22.248152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f24dd4-b07b-4e98-b9d0-c7ef80a36b77 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.248448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f24dd4-b07b-4e98-b9d0-c7ef80a36b77 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.248766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f24dd4-b07b-4e98-b9d0-c7ef80a36b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.276516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-88f24dd4-b07b-4e98-b9d0-c7ef80a36b77 None None] MFA Rules not processed for user `c30814377b094a7687335ff16430dcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:22.277719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-88f24dd4-b07b-4e98-b9d0-c7ef80a36b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:22.342166 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3979/7920] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:22.347594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b69d7-9e5d-4742-9672-0db9d437594b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.433554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b69d7-9e5d-4742-9672-0db9d437594b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.438960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c7b23-2bad-49dd-a93d-6b707284313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.439756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c7b23-2bad-49dd-a93d-6b707284313a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.440291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c7b23-2bad-49dd-a93d-6b707284313a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.440575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c7b23-2bad-49dd-a93d-6b707284313a admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.441289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c7b23-2bad-49dd-a93d-6b707284313a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.443357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c7b23-2bad-49dd-a93d-6b707284313a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.480204 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3942/7921] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:22 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:22.485095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f24dd4-b07b-4e98-b9d0-c7ef80a36b77 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.496572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f24dd4-b07b-4e98-b9d0-c7ef80a36b77 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.556373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c91601-30e8-4f7d-b726-4b759d784d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.557043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c91601-30e8-4f7d-b726-4b759d784d3e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.557323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c91601-30e8-4f7d-b726-4b759d784d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.557599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c91601-30e8-4f7d-b726-4b759d784d3e admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.558277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c91601-30e8-4f7d-b726-4b759d784d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.560487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c91601-30e8-4f7d-b726-4b759d784d3e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.583099 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3980/7922] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:22 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:22.584572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c7b23-2bad-49dd-a93d-6b707284313a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.596857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c7b23-2bad-49dd-a93d-6b707284313a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.602719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053700-c4ec-4c8d-929d-7a782de08a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.603464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053700-c4ec-4c8d-929d-7a782de08a48 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.603845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053700-c4ec-4c8d-929d-7a782de08a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.604320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0053700-c4ec-4c8d-929d-7a782de08a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.605032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0053700-c4ec-4c8d-929d-7a782de08a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.606742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0053700-c4ec-4c8d-929d-7a782de08a48 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.619507 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3943/7923] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:22.624240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c91601-30e8-4f7d-b726-4b759d784d3e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.636658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c91601-30e8-4f7d-b726-4b759d784d3e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.641892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe29e95-9255-4641-a834-64c8d6e93c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.642777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe29e95-9255-4641-a834-64c8d6e93c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.643057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe29e95-9255-4641-a834-64c8d6e93c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.643333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe29e95-9255-4641-a834-64c8d6e93c80 admin admin] PATH_INFO: `/v3/projects/1683012b48d942ebabd3616a39ac330c/users/dd71a574328e43f8ae53ce01b9ec91e4/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.660436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe29e95-9255-4641-a834-64c8d6e93c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1683012b48d942ebabd3616a39ac330c, user_id=dd71a574328e43f8ae53ce01b9ec91e4, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.663118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe29e95-9255-4641-a834-64c8d6e93c80 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.677238 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3981/7924] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:22 2022] PUT /identity/v3/projects/1683012b48d942ebabd3616a39ac330c/users/dd71a574328e43f8ae53ce01b9ec91e4/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:22.681493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053700-c4ec-4c8d-929d-7a782de08a48 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.692005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0053700-c4ec-4c8d-929d-7a782de08a48 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.753136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28f765-b372-4f9d-beaf-dbf85d0001f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.753805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28f765-b372-4f9d-beaf-dbf85d0001f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.754094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28f765-b372-4f9d-beaf-dbf85d0001f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.754375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28f765-b372-4f9d-beaf-dbf85d0001f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.755093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28f765-b372-4f9d-beaf-dbf85d0001f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.756885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28f765-b372-4f9d-beaf-dbf85d0001f4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.768112 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3944/7925] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:22.772633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe29e95-9255-4641-a834-64c8d6e93c80 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.784996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe29e95-9255-4641-a834-64c8d6e93c80 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:22.790355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d1191-b25b-49df-916b-b91d8f0f20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:22.791238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d1191-b25b-49df-916b-b91d8f0f20b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.791516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d1191-b25b-49df-916b-b91d8f0f20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.791800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d1191-b25b-49df-916b-b91d8f0f20b3 admin admin] PATH_INFO: `/v3/projects/1683012b48d942ebabd3616a39ac330c/users/dd71a574328e43f8ae53ce01b9ec91e4/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.793953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d1191-b25b-49df-916b-b91d8f0f20b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1683012b48d942ebabd3616a39ac330c, user_id=dd71a574328e43f8ae53ce01b9ec91e4, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:22.796726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d1191-b25b-49df-916b-b91d8f0f20b3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:22.807768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3982/7926] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:22 2022] PUT /identity/v3/projects/1683012b48d942ebabd3616a39ac330c/users/dd71a574328e43f8ae53ce01b9ec91e4/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:22.818243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a09c4e-65c4-4fa2-a16c-4e053056e1fa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:22.818536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a09c4e-65c4-4fa2-a16c-4e053056e1fa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:22.818817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a09c4e-65c4-4fa2-a16c-4e053056e1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:22.847486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-22a09c4e-65c4-4fa2-a16c-4e053056e1fa None None] MFA Rules not processed for user `dd71a574328e43f8ae53ce01b9ec91e4`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:22.849188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-22a09c4e-65c4-4fa2-a16c-4e053056e1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:22.920452 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3945/7927] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:22.930671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d1191-b25b-49df-916b-b91d8f0f20b3 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:22.932492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-610d1191-b25b-49df-916b-b91d8f0f20b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:22.999301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d1191-b25b-49df-916b-b91d8f0f20b3 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:23.003225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9a8f8-bac2-40d6-978b-9b4b2aa3aaa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:23.004030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a8f8-bac2-40d6-978b-9b4b2aa3aaa2 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:23.004436 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a8f8-bac2-40d6-978b-9b4b2aa3aaa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:23.004716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9a8f8-bac2-40d6-978b-9b4b2aa3aaa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:23.021390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9a8f8-bac2-40d6-978b-9b4b2aa3aaa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:23.022976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9a8f8-bac2-40d6-978b-9b4b2aa3aaa2 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:23.036287 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3983/7928] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:24.578297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a09c4e-65c4-4fa2-a16c-4e053056e1fa None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:24.639078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a09c4e-65c4-4fa2-a16c-4e053056e1fa None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:24.644365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:24.645268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:24.645558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:24.645833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] PATH_INFO: `/v3/users/c30814377b094a7687335ff16430dcd5` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:24.647026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30814377b094a7687335ff16430dcd5)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:24.649012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:24.696824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30814377b094a7687335ff16430dcd5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:24.706610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30814377b094a7687335ff16430dcd5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:24.712306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30814377b094a7687335ff16430dcd5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:24.712991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30814377b094a7687335ff16430dcd5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:24.727775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30814377b094a7687335ff16430dcd5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:24.743991 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3946/7929] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:24 2022] DELETE /identity/v3/users/c30814377b094a7687335ff16430dcd5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:24.745849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28291de2-8859-488b-a99b-3379fb310001 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:24.746300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28291de2-8859-488b-a99b-3379fb310001 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:24.746382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28291de2-8859-488b-a99b-3379fb310001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:24.768782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-28291de2-8859-488b-a99b-3379fb310001 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:24.769980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-28291de2-8859-488b-a99b-3379fb310001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:24.826431 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3984/7930] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:24.836003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:24.837383 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:24.893919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eae4e-a26a-48dd-954e-5b46d2a8f864 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:24.897517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8352d-77bf-47f3-a4a3-c14f527a2910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:24.898122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8352d-77bf-47f3-a4a3-c14f527a2910 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:24.898405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8352d-77bf-47f3-a4a3-c14f527a2910 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:24.898680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8352d-77bf-47f3-a4a3-c14f527a2910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:24.907464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8352d-77bf-47f3-a4a3-c14f527a2910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:24.908928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c8352d-77bf-47f3-a4a3-c14f527a2910 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:24.918030 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3947/7931] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:25.205605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28291de2-8859-488b-a99b-3379fb310001 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:25.207140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-28291de2-8859-488b-a99b-3379fb310001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:25.221023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28291de2-8859-488b-a99b-3379fb310001 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:25.226411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:25.227497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:25.228023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:25.228451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] PATH_INFO: `/v3/projects/af34e69d8af74a9b900783174be0cec2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:25.229800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af34e69d8af74a9b900783174be0cec2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:25.231858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:25.281315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af34e69d8af74a9b900783174be0cec2', 'request_id': 'req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.288631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af34e69d8af74a9b900783174be0cec2', 'request_id': 'req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.293898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af34e69d8af74a9b900783174be0cec2', 'request_id': 'req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.305280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] The token cache is being invalidate because project af34e69d8af74a9b900783174be0cec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:25.305571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.306224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.307780 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3985/7932] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:25 2022] DELETE /identity/v3/projects/af34e69d8af74a9b900783174be0cec2 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:25.311842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8352d-77bf-47f3-a4a3-c14f527a2910 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:25.321550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c8352d-77bf-47f3-a4a3-c14f527a2910 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:25.376069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:25.376873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:25.377154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:25.377432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] PATH_INFO: `/v3/users/dd71a574328e43f8ae53ce01b9ec91e4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:25.378607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd71a574328e43f8ae53ce01b9ec91e4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:25.380598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:25.422598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd71a574328e43f8ae53ce01b9ec91e4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.429044 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd71a574328e43f8ae53ce01b9ec91e4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.429682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd71a574328e43f8ae53ce01b9ec91e4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.430285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd71a574328e43f8ae53ce01b9ec91e4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.441476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8e369e2a-36cd-4396-95e3-c97b000ea81c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd71a574328e43f8ae53ce01b9ec91e4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.454047 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3948/7933] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:25 2022] DELETE /identity/v3/users/dd71a574328e43f8ae53ce01b9ec91e4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:25.715202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:25.722481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:25.735898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da58e8-6382-4e5b-aca1-235c3ae46c6b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:25.797353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:25.798274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:25.798561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:25.798838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] PATH_INFO: `/v3/projects/1683012b48d942ebabd3616a39ac330c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:25.800065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1683012b48d942ebabd3616a39ac330c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:25.802003 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:25.860201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1683012b48d942ebabd3616a39ac330c', 'request_id': 'req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.872968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1683012b48d942ebabd3616a39ac330c', 'request_id': 'req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.880058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1683012b48d942ebabd3616a39ac330c', 'request_id': 'req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.893025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] The token cache is being invalidate because project 1683012b48d942ebabd3616a39ac330c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:25.893378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.894084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-438dedf4-76ed-43b4-a53b-2e03a6e5fbcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:25.896376 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3986/7934] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:25 2022] DELETE /identity/v3/projects/1683012b48d942ebabd3616a39ac330c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:25.905593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ef08-e5f7-4456-9cd9-520e6d10c6e8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:25.906551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ef08-e5f7-4456-9cd9-520e6d10c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:25.907000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870ef08-e5f7-4456-9cd9-520e6d10c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:25.936638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a870ef08-e5f7-4456-9cd9-520e6d10c6e8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:25.937850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a870ef08-e5f7-4456-9cd9-520e6d10c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:26.018965 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3949/7935] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:26.028173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0eea9-88ac-414b-865e-36f5edf7a925 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.028517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0eea9-88ac-414b-865e-36f5edf7a925 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.028850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf0eea9-88ac-414b-865e-36f5edf7a925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.049081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bcf0eea9-88ac-414b-865e-36f5edf7a925 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:26.065934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bcf0eea9-88ac-414b-865e-36f5edf7a925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:26.070631 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3987/7936] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:26.075458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ef08-e5f7-4456-9cd9-520e6d10c6e8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.088154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870ef08-e5f7-4456-9cd9-520e6d10c6e8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.093487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086a090-2e6a-4247-aaff-00c6619e42d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.094253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086a090-2e6a-4247-aaff-00c6619e42d6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.094590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086a090-2e6a-4247-aaff-00c6619e42d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.094876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086a090-2e6a-4247-aaff-00c6619e42d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.095785 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086a090-2e6a-4247-aaff-00c6619e42d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:26.096257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086a090-2e6a-4247-aaff-00c6619e42d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.098131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086a090-2e6a-4247-aaff-00c6619e42d6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.111972 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3950/7937] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:26.115991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0eea9-88ac-414b-865e-36f5edf7a925 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.126965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf0eea9-88ac-414b-865e-36f5edf7a925 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.132987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a884-03c2-4e66-91cd-67c836ffd3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.133706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a884-03c2-4e66-91cd-67c836ffd3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.134008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a884-03c2-4e66-91cd-67c836ffd3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.134340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a884-03c2-4e66-91cd-67c836ffd3f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.135317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37a884-03c2-4e66-91cd-67c836ffd3f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.137418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37a884-03c2-4e66-91cd-67c836ffd3f8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.165363 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3988/7938] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:26 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:26.169482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086a090-2e6a-4247-aaff-00c6619e42d6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.180894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086a090-2e6a-4247-aaff-00c6619e42d6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.240207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada6ce-76d0-4507-878f-368886ea5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.240724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada6ce-76d0-4507-878f-368886ea5a47 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.241242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada6ce-76d0-4507-878f-368886ea5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.241511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada6ce-76d0-4507-878f-368886ea5a47 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.242244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eada6ce-76d0-4507-878f-368886ea5a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.244371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eada6ce-76d0-4507-878f-368886ea5a47 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.265865 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3951/7939] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:26 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:26.269956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a884-03c2-4e66-91cd-67c836ffd3f8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.280185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a884-03c2-4e66-91cd-67c836ffd3f8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.284689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6997d9-087c-46e2-9ad4-1b096e70f1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.285337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6997d9-087c-46e2-9ad4-1b096e70f1ae admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.285620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6997d9-087c-46e2-9ad4-1b096e70f1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.285898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6997d9-087c-46e2-9ad4-1b096e70f1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.286616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6997d9-087c-46e2-9ad4-1b096e70f1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.288278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6997d9-087c-46e2-9ad4-1b096e70f1ae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.298890 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3989/7940] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:26.302681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada6ce-76d0-4507-878f-368886ea5a47 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.313301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada6ce-76d0-4507-878f-368886ea5a47 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.317808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1892d-87c1-482b-bdec-68ffd32fa0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.318445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1892d-87c1-482b-bdec-68ffd32fa0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.318727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1892d-87c1-482b-bdec-68ffd32fa0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.319001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1892d-87c1-482b-bdec-68ffd32fa0d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.319703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1892d-87c1-482b-bdec-68ffd32fa0d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.321343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1892d-87c1-482b-bdec-68ffd32fa0d0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.330902 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3952/7941] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:26.334709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6997d9-087c-46e2-9ad4-1b096e70f1ae admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.344477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6997d9-087c-46e2-9ad4-1b096e70f1ae admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.349130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7f2a-1fc1-413a-ad18-c7a5d20569ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.349976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7f2a-1fc1-413a-ad18-c7a5d20569ac admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.350254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7f2a-1fc1-413a-ad18-c7a5d20569ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.350554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dc7f2a-1fc1-413a-ad18-c7a5d20569ac admin admin] PATH_INFO: `/v3/projects/77d7320e1afa4f5a90e32fa60cb856bd/users/818b2e353eed465ab2c83b2365f84e17/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.370270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc7f2a-1fc1-413a-ad18-c7a5d20569ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d7320e1afa4f5a90e32fa60cb856bd, user_id=818b2e353eed465ab2c83b2365f84e17, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.372972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dc7f2a-1fc1-413a-ad18-c7a5d20569ac admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.385587 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3990/7942] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:26 2022] PUT /identity/v3/projects/77d7320e1afa4f5a90e32fa60cb856bd/users/818b2e353eed465ab2c83b2365f84e17/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:26.395674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae7a7-446a-4c17-b68c-6c56fda69e44 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.396034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae7a7-446a-4c17-b68c-6c56fda69e44 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.396317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae7a7-446a-4c17-b68c-6c56fda69e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.422368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-facae7a7-446a-4c17-b68c-6c56fda69e44 None None] MFA Rules not processed for user `818b2e353eed465ab2c83b2365f84e17`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:26.423542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-facae7a7-446a-4c17-b68c-6c56fda69e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:26.486935 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3953/7943] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:26.491297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7f2a-1fc1-413a-ad18-c7a5d20569ac admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.549955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dc7f2a-1fc1-413a-ad18-c7a5d20569ac admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.554755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560392f-e3a1-4179-92cc-77644b31d373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.555390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560392f-e3a1-4179-92cc-77644b31d373 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.555673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560392f-e3a1-4179-92cc-77644b31d373 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.555981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b560392f-e3a1-4179-92cc-77644b31d373 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.556678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560392f-e3a1-4179-92cc-77644b31d373 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.558571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b560392f-e3a1-4179-92cc-77644b31d373 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.582706 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3991/7944] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:26 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:26.586635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae7a7-446a-4c17-b68c-6c56fda69e44 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.597343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae7a7-446a-4c17-b68c-6c56fda69e44 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.651779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e9d6-ef08-457d-b69f-bb6fa73f92c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.652485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e9d6-ef08-457d-b69f-bb6fa73f92c1 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.652843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e9d6-ef08-457d-b69f-bb6fa73f92c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.653033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678e9d6-ef08-457d-b69f-bb6fa73f92c1 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.653722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e9d6-ef08-457d-b69f-bb6fa73f92c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.656229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678e9d6-ef08-457d-b69f-bb6fa73f92c1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.675712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3954/7945] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:26 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:26.680008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560392f-e3a1-4179-92cc-77644b31d373 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.690120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b560392f-e3a1-4179-92cc-77644b31d373 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.694714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41f669-786c-4eba-875f-402654ea5c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.695355 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f669-786c-4eba-875f-402654ea5c53 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.695669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f669-786c-4eba-875f-402654ea5c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.695982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41f669-786c-4eba-875f-402654ea5c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.696700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41f669-786c-4eba-875f-402654ea5c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.698291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41f669-786c-4eba-875f-402654ea5c53 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.709806 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3992/7946] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:26.713736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e9d6-ef08-457d-b69f-bb6fa73f92c1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.724577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678e9d6-ef08-457d-b69f-bb6fa73f92c1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.729263 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d34ccb-9759-4b25-9dc1-993fd4eefa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.730131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34ccb-9759-4b25-9dc1-993fd4eefa9c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.730419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34ccb-9759-4b25-9dc1-993fd4eefa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.730699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d34ccb-9759-4b25-9dc1-993fd4eefa9c admin admin] PATH_INFO: `/v3/projects/0e68b4775a174941b1fb7d7508e29663/users/ba14e915ea72464c9aa0d66e1d6612d1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.746020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d34ccb-9759-4b25-9dc1-993fd4eefa9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e68b4775a174941b1fb7d7508e29663, user_id=ba14e915ea72464c9aa0d66e1d6612d1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.748768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d34ccb-9759-4b25-9dc1-993fd4eefa9c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.761311 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3955/7947] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:26 2022] PUT /identity/v3/projects/0e68b4775a174941b1fb7d7508e29663/users/ba14e915ea72464c9aa0d66e1d6612d1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:26.765102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41f669-786c-4eba-875f-402654ea5c53 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.774857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41f669-786c-4eba-875f-402654ea5c53 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.827840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b95b6-07a2-46fb-aae0-0bd11157715c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.828571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b95b6-07a2-46fb-aae0-0bd11157715c admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.828785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b95b6-07a2-46fb-aae0-0bd11157715c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.829059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b95b6-07a2-46fb-aae0-0bd11157715c admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.829757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b95b6-07a2-46fb-aae0-0bd11157715c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.831354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b95b6-07a2-46fb-aae0-0bd11157715c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.840584 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3993/7948] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:26.845028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d34ccb-9759-4b25-9dc1-993fd4eefa9c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:26.854814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d34ccb-9759-4b25-9dc1-993fd4eefa9c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:26.859903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca530780-3fac-4791-89e2-7ab4252fa136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:26.860790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca530780-3fac-4791-89e2-7ab4252fa136 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.861067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca530780-3fac-4791-89e2-7ab4252fa136 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.861335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca530780-3fac-4791-89e2-7ab4252fa136 admin admin] PATH_INFO: `/v3/projects/0e68b4775a174941b1fb7d7508e29663/users/ba14e915ea72464c9aa0d66e1d6612d1/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.863283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca530780-3fac-4791-89e2-7ab4252fa136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e68b4775a174941b1fb7d7508e29663, user_id=ba14e915ea72464c9aa0d66e1d6612d1, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:26.865933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca530780-3fac-4791-89e2-7ab4252fa136 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:26.875701 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3956/7949] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:26 2022] PUT /identity/v3/projects/0e68b4775a174941b1fb7d7508e29663/users/ba14e915ea72464c9aa0d66e1d6612d1/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:26.885335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcba579-39df-4c0a-90e0-1921e8e48253 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:26.885623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcba579-39df-4c0a-90e0-1921e8e48253 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:26.885915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcba579-39df-4c0a-90e0-1921e8e48253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:26.912026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1fcba579-39df-4c0a-90e0-1921e8e48253 None None] MFA Rules not processed for user `ba14e915ea72464c9aa0d66e1d6612d1`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:26.913266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1fcba579-39df-4c0a-90e0-1921e8e48253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:26.984221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3994/7950] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:26.989212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca530780-3fac-4791-89e2-7ab4252fa136 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:27.002407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca530780-3fac-4791-89e2-7ab4252fa136 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:27.012783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8954a1-28c4-4af6-bf40-ccd11c3f6c2f tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba14e915ea72464c9aa0d66e1d6612d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e68b4775a174941b1fb7d7508e29663', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:27.013482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8954a1-28c4-4af6-bf40-ccd11c3f6c2f tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:27.013751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8954a1-28c4-4af6-bf40-ccd11c3f6c2f tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:27.014627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8954a1-28c4-4af6-bf40-ccd11c3f6c2f tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:27.016028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8954a1-28c4-4af6-bf40-ccd11c3f6c2f tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:27.016226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8954a1-28c4-4af6-bf40-ccd11c3f6c2f tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:27.019228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8954a1-28c4-4af6-bf40-ccd11c3f6c2f tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:27.038452 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3957/7951] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:27.041833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcba579-39df-4c0a-90e0-1921e8e48253 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:27.052948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcba579-39df-4c0a-90e0-1921e8e48253 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:27.059594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1710-6a06-4757-a5c8-c07dd0feb8b1 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba14e915ea72464c9aa0d66e1d6612d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e68b4775a174941b1fb7d7508e29663', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:27.061496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1710-6a06-4757-a5c8-c07dd0feb8b1 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:27.061496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1710-6a06-4757-a5c8-c07dd0feb8b1 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:27.061496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e1710-6a06-4757-a5c8-c07dd0feb8b1 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:27.062028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e1710-6a06-4757-a5c8-c07dd0feb8b1 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:27.064185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e1710-6a06-4757-a5c8-c07dd0feb8b1 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:27.090372 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3995/7952] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:27 2022] POST /identity/v3/projects => generated 348 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:27.094984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8954a1-28c4-4af6-bf40-ccd11c3f6c2f tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:27.104685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8954a1-28c4-4af6-bf40-ccd11c3f6c2f tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:27.162194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba14e915ea72464c9aa0d66e1d6612d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e68b4775a174941b1fb7d7508e29663', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:27.162961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:27.163265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:27.163491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:27.164259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:27.164592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:27.166455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:27.179339 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3958/7953] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:27.189570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1710-6a06-4757-a5c8-c07dd0feb8b1 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:27.191394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1e1e1710-6a06-4757-a5c8-c07dd0feb8b1 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:27.253722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e1710-6a06-4757-a5c8-c07dd0feb8b1 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:27.257720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ec2f0-86d1-42b5-8a70-c0381c32915b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:27.258401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ec2f0-86d1-42b5-8a70-c0381c32915b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:27.258700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ec2f0-86d1-42b5-8a70-c0381c32915b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:27.258978 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ec2f0-86d1-42b5-8a70-c0381c32915b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:27.268600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ec2f0-86d1-42b5-8a70-c0381c32915b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:27.270045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ec2f0-86d1-42b5-8a70-c0381c32915b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:27.279410 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3996/7954] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:27.963302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:27.965168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:28.041754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdfc07-7aa8-49e6-a243-83bc3d2aafd3 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:28.047569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:28.048683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.048975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.049255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] PATH_INFO: `/v3/users/c9c36d1ec4c1447da3add85c97535a8e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.050524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c36d1ec4c1447da3add85c97535a8e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:28.052520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:28.102863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c36d1ec4c1447da3add85c97535a8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.115721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c36d1ec4c1447da3add85c97535a8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.116553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c36d1ec4c1447da3add85c97535a8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.117218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c36d1ec4c1447da3add85c97535a8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.131525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c36d1ec4c1447da3add85c97535a8e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.146217 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3959/7955] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:27 2022] DELETE /identity/v3/users/c9c36d1ec4c1447da3add85c97535a8e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:28.150690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232b6c7-5c31-4387-87d4-50164e5f503d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.151157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232b6c7-5c31-4387-87d4-50164e5f503d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.151333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232b6c7-5c31-4387-87d4-50164e5f503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.176265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a232b6c7-5c31-4387-87d4-50164e5f503d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:28.178218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a232b6c7-5c31-4387-87d4-50164e5f503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:28.249734 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3997/7956] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:28.260608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:28.262283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:28.337255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fa498-48d1-4908-8af4-81fe282e167a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:28.341337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf46c97-f272-436e-9956-523490b3126c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:28.342644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf46c97-f272-436e-9956-523490b3126c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.342957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf46c97-f272-436e-9956-523490b3126c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.343232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf46c97-f272-436e-9956-523490b3126c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.354760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf46c97-f272-436e-9956-523490b3126c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:28.356351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf46c97-f272-436e-9956-523490b3126c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:28.368237 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3960/7957] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:28.619552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232b6c7-5c31-4387-87d4-50164e5f503d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:28.621066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a232b6c7-5c31-4387-87d4-50164e5f503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:28.664665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf46c97-f272-436e-9956-523490b3126c service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:28.667550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6cf46c97-f272-436e-9956-523490b3126c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:28.685284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf46c97-f272-436e-9956-523490b3126c service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:28.691813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:28.692697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.692937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232b6c7-5c31-4387-87d4-50164e5f503d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:28.693039 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.693248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] PATH_INFO: `/v3/projects/42e98880faf84d28ad553bf14cd07acd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.694612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e98880faf84d28ad553bf14cd07acd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:28.696570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:28.697983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba14e915ea72464c9aa0d66e1d6612d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e68b4775a174941b1fb7d7508e29663', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:28.698842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.699122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.699402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] PATH_INFO: `/v3/projects/9c514472d53d4b1fac7e1c1be85ec2ee` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.700619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9c514472d53d4b1fac7e1c1be85ec2ee)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:28.703099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:28.745455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e98880faf84d28ad553bf14cd07acd', 'request_id': 'req-bf268ef5-540c-49fd-a368-0e1421f64933'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.749556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c514472d53d4b1fac7e1c1be85ec2ee', 'request_id': 'req-2109bc08-d09f-472f-93b6-6d0ce4157ac2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.753042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e98880faf84d28ad553bf14cd07acd', 'request_id': 'req-bf268ef5-540c-49fd-a368-0e1421f64933'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.756760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c514472d53d4b1fac7e1c1be85ec2ee', 'request_id': 'req-2109bc08-d09f-472f-93b6-6d0ce4157ac2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.759786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e98880faf84d28ad553bf14cd07acd', 'request_id': 'req-bf268ef5-540c-49fd-a368-0e1421f64933'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.762289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c514472d53d4b1fac7e1c1be85ec2ee', 'request_id': 'req-2109bc08-d09f-472f-93b6-6d0ce4157ac2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.771829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] The token cache is being invalidate because project 42e98880faf84d28ad553bf14cd07acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:28.772090 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.772736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-bf268ef5-540c-49fd-a368-0e1421f64933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.773687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] The token cache is being invalidate because project 9c514472d53d4b1fac7e1c1be85ec2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:28.773982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.778156 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3961/7958] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:28 2022] DELETE /identity/v3/projects/42e98880faf84d28ad553bf14cd07acd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:28.778287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.779547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c8fa3-6c22-41f4-b55f-8f571a154319 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.780314 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3998/7959] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:28 2022] DELETE /identity/v3/projects/9c514472d53d4b1fac7e1c1be85ec2ee => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:28.780526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c8fa3-6c22-41f4-b55f-8f571a154319 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.780866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c8fa3-6c22-41f4-b55f-8f571a154319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.784901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:28.786375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:28.800081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8a1c8fa3-6c22-41f4-b55f-8f571a154319 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:28.801210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8a1c8fa3-6c22-41f4-b55f-8f571a154319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:28.853405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109bc08-d09f-472f-93b6-6d0ce4157ac2 tempest-QuotasNegativeTest-1197435012 tempest-QuotasNegativeTest-1197435012-project-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:28.858842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:28.859784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.860158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.860480 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] PATH_INFO: `/v3/users/818b2e353eed465ab2c83b2365f84e17` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.860691 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3962/7960] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:28.861683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] RBAC: Authorizing `identity:delete_user(user_id=818b2e353eed465ab2c83b2365f84e17)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:28.863668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:28.868192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d46e-cd48-49a5-8f1b-766384722b1c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.868487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d46e-cd48-49a5-8f1b-766384722b1c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.868835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d46e-cd48-49a5-8f1b-766384722b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.886799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bf39d46e-cd48-49a5-8f1b-766384722b1c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:28.888221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bf39d46e-cd48-49a5-8f1b-766384722b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:28.897577 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3963/7961] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:28.901608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d46e-cd48-49a5-8f1b-766384722b1c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:28.908944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '818b2e353eed465ab2c83b2365f84e17'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.910708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d46e-cd48-49a5-8f1b-766384722b1c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:28.915392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:28.915528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '818b2e353eed465ab2c83b2365f84e17'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.916110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.916225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '818b2e353eed465ab2c83b2365f84e17'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.916401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.916681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.916788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '818b2e353eed465ab2c83b2365f84e17'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.917417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:28.917726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:28.919341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:28.924364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-44552767-e876-44e6-8df9-0da96b9e184a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '818b2e353eed465ab2c83b2365f84e17'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:28.935163 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3964/7962] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:16:28.936850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:28.938533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:28.944774 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 3999/7963] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:28 2022] DELETE /identity/v3/users/818b2e353eed465ab2c83b2365f84e17 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:28.946182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853371e8-5704-406c-8f74-8ce3b72ade87 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:28.946471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853371e8-5704-406c-8f74-8ce3b72ade87 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:28.946752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853371e8-5704-406c-8f74-8ce3b72ade87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:28.953648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8611011-7062-4519-89c2-eb03e9009714 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:28.964912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-853371e8-5704-406c-8f74-8ce3b72ade87 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:28.966091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-853371e8-5704-406c-8f74-8ce3b72ade87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:29.014862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c614b-de5e-46b5-be2a-50f15f93fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.015538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c614b-de5e-46b5-be2a-50f15f93fb94 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.015826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c614b-de5e-46b5-be2a-50f15f93fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.016196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c614b-de5e-46b5-be2a-50f15f93fb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.016945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c614b-de5e-46b5-be2a-50f15f93fb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.018911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c614b-de5e-46b5-be2a-50f15f93fb94 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.040817 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4000/7964] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:29.051424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853371e8-5704-406c-8f74-8ce3b72ade87 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.053648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-853371e8-5704-406c-8f74-8ce3b72ade87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:29.056782 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3965/7965] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:28 2022] POST /identity/v3/projects => generated 393 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:29.061493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c614b-de5e-46b5-be2a-50f15f93fb94 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.127093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853371e8-5704-406c-8f74-8ce3b72ade87 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.129074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c614b-de5e-46b5-be2a-50f15f93fb94 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.134474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d16861-be32-42d1-b708-fd8a82204795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.135132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d16861-be32-42d1-b708-fd8a82204795 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.135414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d16861-be32-42d1-b708-fd8a82204795 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.135690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d16861-be32-42d1-b708-fd8a82204795 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.136415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d16861-be32-42d1-b708-fd8a82204795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.138349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d16861-be32-42d1-b708-fd8a82204795 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.163966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3966/7966] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:29 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:29.165617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d16861-be32-42d1-b708-fd8a82204795 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.176659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d16861-be32-42d1-b708-fd8a82204795 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.181593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c36dd9-639a-47bc-8d20-644b608f9eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.182242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c36dd9-639a-47bc-8d20-644b608f9eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.182527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c36dd9-639a-47bc-8d20-644b608f9eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.182691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8b17d-8b93-48ce-a849-2045ac9cf388 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.183163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c36dd9-639a-47bc-8d20-644b608f9eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.183337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8b17d-8b93-48ce-a849-2045ac9cf388 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.183571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c36dd9-639a-47bc-8d20-644b608f9eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.183665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8b17d-8b93-48ce-a849-2045ac9cf388 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.183886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8b17d-8b93-48ce-a849-2045ac9cf388 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.185226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c36dd9-639a-47bc-8d20-644b608f9eb8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.193896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8b17d-8b93-48ce-a849-2045ac9cf388 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.195386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8b17d-8b93-48ce-a849-2045ac9cf388 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.196005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3967/7967] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:29.200122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c36dd9-639a-47bc-8d20-644b608f9eb8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.206121 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4001/7968] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:29.210293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c36dd9-639a-47bc-8d20-644b608f9eb8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.215459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb67598-cb37-4883-8c17-2cb3b15b5db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.216170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb67598-cb37-4883-8c17-2cb3b15b5db2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.216458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb67598-cb37-4883-8c17-2cb3b15b5db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.216738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb67598-cb37-4883-8c17-2cb3b15b5db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.217485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb67598-cb37-4883-8c17-2cb3b15b5db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.219099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb67598-cb37-4883-8c17-2cb3b15b5db2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.229709 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3968/7969] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:29.236996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8b17d-8b93-48ce-a849-2045ac9cf388 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.246443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8b17d-8b93-48ce-a849-2045ac9cf388 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.252052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374554d-e91b-425c-87ed-cd9e6deec1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.252991 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374554d-e91b-425c-87ed-cd9e6deec1f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.253300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374554d-e91b-425c-87ed-cd9e6deec1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.253598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374554d-e91b-425c-87ed-cd9e6deec1f4 admin admin] PATH_INFO: `/v3/projects/39045df80a6f442b972ee88f13343d34/users/2ce0a0696d1244589ef6242917432858/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.270104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374554d-e91b-425c-87ed-cd9e6deec1f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39045df80a6f442b972ee88f13343d34, user_id=2ce0a0696d1244589ef6242917432858, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.273190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374554d-e91b-425c-87ed-cd9e6deec1f4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.286249 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4002/7970] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:29 2022] PUT /identity/v3/projects/39045df80a6f442b972ee88f13343d34/users/2ce0a0696d1244589ef6242917432858/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:29.297000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3110-63f4-4e98-9d5d-7c602acd7c79 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.297292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3110-63f4-4e98-9d5d-7c602acd7c79 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.297573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c3110-63f4-4e98-9d5d-7c602acd7c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.324743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-da3c3110-63f4-4e98-9d5d-7c602acd7c79 None None] MFA Rules not processed for user `2ce0a0696d1244589ef6242917432858`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:29.325980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-da3c3110-63f4-4e98-9d5d-7c602acd7c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:29.390880 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3969/7971] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:29.395513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374554d-e91b-425c-87ed-cd9e6deec1f4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.456453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374554d-e91b-425c-87ed-cd9e6deec1f4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.461159 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61cedf-a369-459d-a9e7-5b35b3b0e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.461811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61cedf-a369-459d-a9e7-5b35b3b0e39a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.462097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61cedf-a369-459d-a9e7-5b35b3b0e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.462379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61cedf-a369-459d-a9e7-5b35b3b0e39a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.463123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61cedf-a369-459d-a9e7-5b35b3b0e39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.465064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61cedf-a369-459d-a9e7-5b35b3b0e39a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.499809 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4003/7972] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:29 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:29.499809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61cedf-a369-459d-a9e7-5b35b3b0e39a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.499998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3110-63f4-4e98-9d5d-7c602acd7c79 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.499998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-da3c3110-63f4-4e98-9d5d-7c602acd7c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:29.514021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c3110-63f4-4e98-9d5d-7c602acd7c79 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.572280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61cedf-a369-459d-a9e7-5b35b3b0e39a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.576994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5e1a-99f2-42c5-a674-c60636ec30ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.577651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5e1a-99f2-42c5-a674-c60636ec30ba admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.577934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5e1a-99f2-42c5-a674-c60636ec30ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.578208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb5e1a-99f2-42c5-a674-c60636ec30ba admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.578522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.578886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb5e1a-99f2-42c5-a674-c60636ec30ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.579388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.579674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.579985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] PATH_INFO: `/v3/projects/77d7320e1afa4f5a90e32fa60cb856bd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.580860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb5e1a-99f2-42c5-a674-c60636ec30ba admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.581177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d7320e1afa4f5a90e32fa60cb856bd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.583130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.600352 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4004/7973] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:29 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:29.604304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5e1a-99f2-42c5-a674-c60636ec30ba admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.614728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb5e1a-99f2-42c5-a674-c60636ec30ba admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.619470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82ed59-e100-4a69-9c37-f193d25cc9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.620217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82ed59-e100-4a69-9c37-f193d25cc9ef admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.620489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82ed59-e100-4a69-9c37-f193d25cc9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.620776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82ed59-e100-4a69-9c37-f193d25cc9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.621709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82ed59-e100-4a69-9c37-f193d25cc9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.623356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f82ed59-e100-4a69-9c37-f193d25cc9ef admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.629742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d7320e1afa4f5a90e32fa60cb856bd', 'request_id': 'req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.636775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4005/7974] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:29.637763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82ed59-e100-4a69-9c37-f193d25cc9ef admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.640603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d7320e1afa4f5a90e32fa60cb856bd', 'request_id': 'req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.646524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d7320e1afa4f5a90e32fa60cb856bd', 'request_id': 'req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.651013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f82ed59-e100-4a69-9c37-f193d25cc9ef admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.662682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] The token cache is being invalidate because project 77d7320e1afa4f5a90e32fa60cb856bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:29.663009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.663684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.665249 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3970/7975] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:29 2022] DELETE /identity/v3/projects/77d7320e1afa4f5a90e32fa60cb856bd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:29.668989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.671038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:29.712254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11aadd-0e33-4a50-a219-066a521236c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.713140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11aadd-0e33-4a50-a219-066a521236c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.713422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11aadd-0e33-4a50-a219-066a521236c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.713699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11aadd-0e33-4a50-a219-066a521236c6 admin admin] PATH_INFO: `/v3/projects/b3b6f802f2f946e9b7b7f069ab789e09/users/7ee61895e452426fa20d33778753d30f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.728026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11aadd-0e33-4a50-a219-066a521236c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b6f802f2f946e9b7b7f069ab789e09, user_id=7ee61895e452426fa20d33778753d30f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.730728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11aadd-0e33-4a50-a219-066a521236c6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.732745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481193bc-dc33-4f8b-8831-cbf1ebfe3b99 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.738118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.738987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.739269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.739563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] PATH_INFO: `/v3/users/ba14e915ea72464c9aa0d66e1d6612d1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.740791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba14e915ea72464c9aa0d66e1d6612d1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.742728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.744105 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4006/7976] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:29 2022] PUT /identity/v3/projects/b3b6f802f2f946e9b7b7f069ab789e09/users/7ee61895e452426fa20d33778753d30f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:29.747925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11aadd-0e33-4a50-a219-066a521236c6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.749583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7e11aadd-0e33-4a50-a219-066a521236c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:29.788227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba14e915ea72464c9aa0d66e1d6612d1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.796829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba14e915ea72464c9aa0d66e1d6612d1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.797459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba14e915ea72464c9aa0d66e1d6612d1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.798080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba14e915ea72464c9aa0d66e1d6612d1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.809923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba14e915ea72464c9aa0d66e1d6612d1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:29.814110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11aadd-0e33-4a50-a219-066a521236c6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.818799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95f896-1f34-4d2d-8be0-2c0023c84ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.819464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95f896-1f34-4d2d-8be0-2c0023c84ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.819749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95f896-1f34-4d2d-8be0-2c0023c84ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.820067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95f896-1f34-4d2d-8be0-2c0023c84ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.820811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95f896-1f34-4d2d-8be0-2c0023c84ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.822423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95f896-1f34-4d2d-8be0-2c0023c84ae4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.825330 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3971/7977] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:29 2022] DELETE /identity/v3/users/ba14e915ea72464c9aa0d66e1d6612d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:29.835427 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4007/7978] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:29.836644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:29.838157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:29.903481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b707496-575b-454f-8410-c10045a781fc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:29.908613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27155e4d-0d01-4da6-8218-88cafd9c2140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:29.909500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27155e4d-0d01-4da6-8218-88cafd9c2140 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:29.909776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27155e4d-0d01-4da6-8218-88cafd9c2140 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:29.910054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27155e4d-0d01-4da6-8218-88cafd9c2140 admin admin] PATH_INFO: `/v3/projects/b3b6f802f2f946e9b7b7f069ab789e09/users/7ee61895e452426fa20d33778753d30f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:29.912130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27155e4d-0d01-4da6-8218-88cafd9c2140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b6f802f2f946e9b7b7f069ab789e09, user_id=7ee61895e452426fa20d33778753d30f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:29.914793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27155e4d-0d01-4da6-8218-88cafd9c2140 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:29.926041 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3972/7979] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:29 2022] PUT /identity/v3/projects/b3b6f802f2f946e9b7b7f069ab789e09/users/7ee61895e452426fa20d33778753d30f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:30.030638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54099-aa9b-42ec-8ee9-a0a9632a4984 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.031071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54099-aa9b-42ec-8ee9-a0a9632a4984 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.031205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f54099-aa9b-42ec-8ee9-a0a9632a4984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.064659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-65f54099-aa9b-42ec-8ee9-a0a9632a4984 None None] MFA Rules not processed for user `7ee61895e452426fa20d33778753d30f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:30.067009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65f54099-aa9b-42ec-8ee9-a0a9632a4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:30.135138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27155e4d-0d01-4da6-8218-88cafd9c2140 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:30.138222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-27155e4d-0d01-4da6-8218-88cafd9c2140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:30.169007 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4008/7980] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:30.175590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54099-aa9b-42ec-8ee9-a0a9632a4984 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:30.181089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65f54099-aa9b-42ec-8ee9-a0a9632a4984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:30.227472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27155e4d-0d01-4da6-8218-88cafd9c2140 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:30.232294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:30.233185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.233470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.233778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] PATH_INFO: `/v3/projects/0e68b4775a174941b1fb7d7508e29663` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.235025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e68b4775a174941b1fb7d7508e29663)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:30.236996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:30.272635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f54099-aa9b-42ec-8ee9-a0a9632a4984 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:30.284605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e68b4775a174941b1fb7d7508e29663', 'request_id': 'req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:30.292188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e68b4775a174941b1fb7d7508e29663', 'request_id': 'req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:30.297689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e68b4775a174941b1fb7d7508e29663', 'request_id': 'req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:30.308684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] The token cache is being invalidate because project 0e68b4775a174941b1fb7d7508e29663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:30.308968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:30.309607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a4a94000-e2ee-4d1a-b17c-7d11d63c0233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:30.311171 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3973/7981] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:30 2022] DELETE /identity/v3/projects/0e68b4775a174941b1fb7d7508e29663 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:30.316927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e7d9-9cd6-4a8d-9240-af9bf0c69547 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.317213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e7d9-9cd6-4a8d-9240-af9bf0c69547 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.317498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e7d9-9cd6-4a8d-9240-af9bf0c69547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.336395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea904-b4ac-4719-95f0-410171ecc3eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:30.337184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea904-b4ac-4719-95f0-410171ecc3eb service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.337403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6e67e7d9-9cd6-4a8d-9240-af9bf0c69547 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:30.337497 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea904-b4ac-4719-95f0-410171ecc3eb service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.337755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbea904-b4ac-4719-95f0-410171ecc3eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.338611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6e67e7d9-9cd6-4a8d-9240-af9bf0c69547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:30.339506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0dbea904-b4ac-4719-95f0-410171ecc3eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:30.396284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbea904-b4ac-4719-95f0-410171ecc3eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:30.408108 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3974/7982] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:30.408288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbea904-b4ac-4719-95f0-410171ecc3eb service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:30.408288 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4009/7983] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:30.480454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9706788-644d-490c-9e09-d7bf127eb732 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.480745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9706788-644d-490c-9e09-d7bf127eb732 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.481025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9706788-644d-490c-9e09-d7bf127eb732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.499965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f9706788-644d-490c-9e09-d7bf127eb732 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:30.501148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f9706788-644d-490c-9e09-d7bf127eb732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:30.510399 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3975/7984] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:30.515260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea904-b4ac-4719-95f0-410171ecc3eb service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:30.525939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbea904-b4ac-4719-95f0-410171ecc3eb service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:30.531603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2780-61bb-4acb-991a-77ce341a8246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:30.532294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2780-61bb-4acb-991a-77ce341a8246 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.532619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2780-61bb-4acb-991a-77ce341a8246 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.532893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d2780-61bb-4acb-991a-77ce341a8246 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.533598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2780-61bb-4acb-991a-77ce341a8246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:30.533894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2780-61bb-4acb-991a-77ce341a8246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:30.535633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d2780-61bb-4acb-991a-77ce341a8246 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:30.553569 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4010/7985] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:30.553650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9706788-644d-490c-9e09-d7bf127eb732 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:30.562391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9706788-644d-490c-9e09-d7bf127eb732 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:30.567069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bc61c-0ae7-4c7a-98a9-a63560f43b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:30.567711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc61c-0ae7-4c7a-98a9-a63560f43b57 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.568024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc61c-0ae7-4c7a-98a9-a63560f43b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.568303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bc61c-0ae7-4c7a-98a9-a63560f43b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.569097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bc61c-0ae7-4c7a-98a9-a63560f43b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:30.571216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bc61c-0ae7-4c7a-98a9-a63560f43b57 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:30.606417 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3976/7986] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:30 2022] POST /identity/v3/projects => generated 397 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:30.608085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2780-61bb-4acb-991a-77ce341a8246 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:30.619317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d2780-61bb-4acb-991a-77ce341a8246 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:30.684418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859c872-191a-4a31-a97e-902d6b02e320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:30.685169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c872-191a-4a31-a97e-902d6b02e320 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.685674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c872-191a-4a31-a97e-902d6b02e320 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.686544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c872-191a-4a31-a97e-902d6b02e320 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.687413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859c872-191a-4a31-a97e-902d6b02e320 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:30.689629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859c872-191a-4a31-a97e-902d6b02e320 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:30.716256 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4011/7987] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:30 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:30.720756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bc61c-0ae7-4c7a-98a9-a63560f43b57 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:30.734371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bc61c-0ae7-4c7a-98a9-a63560f43b57 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:30.743120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb2122-3850-4d6d-81c9-5a67e9969e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:30.743972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb2122-3850-4d6d-81c9-5a67e9969e69 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.745546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb2122-3850-4d6d-81c9-5a67e9969e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.746011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb2122-3850-4d6d-81c9-5a67e9969e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.746858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb2122-3850-4d6d-81c9-5a67e9969e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:30.749239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb2122-3850-4d6d-81c9-5a67e9969e69 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:30.771584 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3977/7988] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:30.774720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859c872-191a-4a31-a97e-902d6b02e320 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:30.792878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859c872-191a-4a31-a97e-902d6b02e320 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:30.799327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d890de-622b-4678-8228-ca7a8b41c0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:30.800210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d890de-622b-4678-8228-ca7a8b41c0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.800881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d890de-622b-4678-8228-ca7a8b41c0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.801235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d890de-622b-4678-8228-ca7a8b41c0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.801971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d890de-622b-4678-8228-ca7a8b41c0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:30.804011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d890de-622b-4678-8228-ca7a8b41c0f4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:30.819982 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4012/7989] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:30.821714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb2122-3850-4d6d-81c9-5a67e9969e69 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:30.836149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb2122-3850-4d6d-81c9-5a67e9969e69 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:30.846139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c295-c5a5-4ba9-8ef6-4a707b00355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:30.848429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c295-c5a5-4ba9-8ef6-4a707b00355d admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.848939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c295-c5a5-4ba9-8ef6-4a707b00355d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.849283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2c295-c5a5-4ba9-8ef6-4a707b00355d admin admin] PATH_INFO: `/v3/projects/4aa48692c08b4bcaa33dc8137560d75d/users/961a7642578748699517ceb08b801d94/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.869993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2c295-c5a5-4ba9-8ef6-4a707b00355d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa48692c08b4bcaa33dc8137560d75d, user_id=961a7642578748699517ceb08b801d94, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:30.874025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2c295-c5a5-4ba9-8ef6-4a707b00355d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:30.899091 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3978/7990] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:30 2022] PUT /identity/v3/projects/4aa48692c08b4bcaa33dc8137560d75d/users/961a7642578748699517ceb08b801d94/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:30.901206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5d68-3342-4ca5-98bc-89095015ec41 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:30.901527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5d68-3342-4ca5-98bc-89095015ec41 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:30.901804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5d68-3342-4ca5-98bc-89095015ec41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:30.944113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0b5e5d68-3342-4ca5-98bc-89095015ec41 None None] MFA Rules not processed for user `961a7642578748699517ceb08b801d94`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:30.945438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0b5e5d68-3342-4ca5-98bc-89095015ec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:31.029155 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4013/7991] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:31.033787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c295-c5a5-4ba9-8ef6-4a707b00355d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:31.118584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2c295-c5a5-4ba9-8ef6-4a707b00355d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:31.123258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30119835-9bd9-4a7f-be33-f6caffc7aafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:31.124569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30119835-9bd9-4a7f-be33-f6caffc7aafc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:31.124852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30119835-9bd9-4a7f-be33-f6caffc7aafc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:31.125130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30119835-9bd9-4a7f-be33-f6caffc7aafc admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:31.125828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30119835-9bd9-4a7f-be33-f6caffc7aafc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:31.127743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30119835-9bd9-4a7f-be33-f6caffc7aafc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:31.156230 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3979/7992] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:31 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:31.160535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5d68-3342-4ca5-98bc-89095015ec41 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:31.172564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5d68-3342-4ca5-98bc-89095015ec41 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:31.231471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ef1ba-35c5-47a1-a364-08728de68a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:31.232175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef1ba-35c5-47a1-a364-08728de68a74 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:31.232467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef1ba-35c5-47a1-a364-08728de68a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:31.233296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ef1ba-35c5-47a1-a364-08728de68a74 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:31.234093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ef1ba-35c5-47a1-a364-08728de68a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:31.236049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ef1ba-35c5-47a1-a364-08728de68a74 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:31.258279 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4014/7993] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:31 2022] POST /identity/v3/users => generated 306 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:31.259711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30119835-9bd9-4a7f-be33-f6caffc7aafc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:31.270462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30119835-9bd9-4a7f-be33-f6caffc7aafc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:31.275291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a472c-a939-4e26-939f-71a5761dbfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:31.275976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a472c-a939-4e26-939f-71a5761dbfea admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:31.276265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a472c-a939-4e26-939f-71a5761dbfea admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:31.276546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6a472c-a939-4e26-939f-71a5761dbfea admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:31.277421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a472c-a939-4e26-939f-71a5761dbfea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:31.279010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6a472c-a939-4e26-939f-71a5761dbfea admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:31.290193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3980/7994] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:31.294726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ef1ba-35c5-47a1-a364-08728de68a74 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:31.305610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ef1ba-35c5-47a1-a364-08728de68a74 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:31.310209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2e6b8-59ff-41d4-b03f-ba30fb6fd4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:31.311181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2e6b8-59ff-41d4-b03f-ba30fb6fd4c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:31.311396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2e6b8-59ff-41d4-b03f-ba30fb6fd4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:31.311668 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2e6b8-59ff-41d4-b03f-ba30fb6fd4c0 admin admin] PATH_INFO: `/v3/projects/e535d0e230c04fdaa9b4336df1be2288/users/dd9d3304c6e14b34a22df3a958191e4e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:31.327475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2e6b8-59ff-41d4-b03f-ba30fb6fd4c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e535d0e230c04fdaa9b4336df1be2288, user_id=dd9d3304c6e14b34a22df3a958191e4e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:31.330308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2e6b8-59ff-41d4-b03f-ba30fb6fd4c0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:31.345716 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4015/7995] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:31 2022] PUT /identity/v3/projects/e535d0e230c04fdaa9b4336df1be2288/users/dd9d3304c6e14b34a22df3a958191e4e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:31.349606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a472c-a939-4e26-939f-71a5761dbfea admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:31.360812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6a472c-a939-4e26-939f-71a5761dbfea admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:31.422192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d3994-42f7-4850-99a8-ee46477cac37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:31.422919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3994-42f7-4850-99a8-ee46477cac37 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:31.423209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3994-42f7-4850-99a8-ee46477cac37 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:31.423488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d3994-42f7-4850-99a8-ee46477cac37 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:31.424295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d3994-42f7-4850-99a8-ee46477cac37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:31.426326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d3994-42f7-4850-99a8-ee46477cac37 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:31.439152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3981/7996] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:31.443347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2e6b8-59ff-41d4-b03f-ba30fb6fd4c0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:31.454428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2e6b8-59ff-41d4-b03f-ba30fb6fd4c0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:31.461714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5a54e-4a48-44d7-896f-9f45bae4a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:31.462633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5a54e-4a48-44d7-896f-9f45bae4a4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:31.463024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5a54e-4a48-44d7-896f-9f45bae4a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:31.463189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5a54e-4a48-44d7-896f-9f45bae4a4ec admin admin] PATH_INFO: `/v3/projects/e535d0e230c04fdaa9b4336df1be2288/users/dd9d3304c6e14b34a22df3a958191e4e/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:31.465219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5a54e-4a48-44d7-896f-9f45bae4a4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e535d0e230c04fdaa9b4336df1be2288, user_id=dd9d3304c6e14b34a22df3a958191e4e, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:31.468809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5a54e-4a48-44d7-896f-9f45bae4a4ec admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:31.480158 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4016/7997] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:31 2022] PUT /identity/v3/projects/e535d0e230c04fdaa9b4336df1be2288/users/dd9d3304c6e14b34a22df3a958191e4e/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:31.492790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b650-461f-4269-90d3-fa8c07fba62d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:31.493156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b650-461f-4269-90d3-fa8c07fba62d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:31.493516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b650-461f-4269-90d3-fa8c07fba62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:31.520444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-30b8b650-461f-4269-90d3-fa8c07fba62d None None] MFA Rules not processed for user `dd9d3304c6e14b34a22df3a958191e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:31.521697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-30b8b650-461f-4269-90d3-fa8c07fba62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:31.594778 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3982/7998] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:31.604472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5a54e-4a48-44d7-896f-9f45bae4a4ec admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:31.606189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3fb5a54e-4a48-44d7-896f-9f45bae4a4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:31.666490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5a54e-4a48-44d7-896f-9f45bae4a4ec admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:31.671071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a398-d22f-4859-81fb-0c88ff07deb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:31.671727 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a398-d22f-4859-81fb-0c88ff07deb6 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:31.672044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a398-d22f-4859-81fb-0c88ff07deb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:31.672326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648a398-d22f-4859-81fb-0c88ff07deb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:31.734356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648a398-d22f-4859-81fb-0c88ff07deb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:31.736342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648a398-d22f-4859-81fb-0c88ff07deb6 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:31.746979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4017/7999] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:32.048880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8b650-461f-4269-90d3-fa8c07fba62d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:32.051589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-30b8b650-461f-4269-90d3-fa8c07fba62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:32.172481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8b650-461f-4269-90d3-fa8c07fba62d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:32.184462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdabbb-ab6f-46d4-b39d-7130c0b9883c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:32.185464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdabbb-ab6f-46d4-b39d-7130c0b9883c service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:32.186918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdabbb-ab6f-46d4-b39d-7130c0b9883c service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:32.187408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdabbb-ab6f-46d4-b39d-7130c0b9883c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:32.202344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdabbb-ab6f-46d4-b39d-7130c0b9883c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:32.204350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdabbb-ab6f-46d4-b39d-7130c0b9883c service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:32.220112 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3983/8000] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:33.979027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a398-d22f-4859-81fb-0c88ff07deb6 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:33.980787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3648a398-d22f-4859-81fb-0c88ff07deb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:33.996237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648a398-d22f-4859-81fb-0c88ff07deb6 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:34.001538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7768-104e-4bfa-9cde-322c68892837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:34.002420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7768-104e-4bfa-9cde-322c68892837 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:34.002611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7768-104e-4bfa-9cde-322c68892837 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:34.002896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7768-104e-4bfa-9cde-322c68892837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:34.005361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f8ca7768-104e-4bfa-9cde-322c68892837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:34.095056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca7768-104e-4bfa-9cde-322c68892837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:34.096955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca7768-104e-4bfa-9cde-322c68892837 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:34.126485 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4018/8001] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:37.942813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f461c89-f8bf-46b7-924c-55604a4b325f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:37.943285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f461c89-f8bf-46b7-924c-55604a4b325f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:37.943373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f461c89-f8bf-46b7-924c-55604a4b325f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:37.963743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2f461c89-f8bf-46b7-924c-55604a4b325f None None] MFA Rules not processed for user `2ce0a0696d1244589ef6242917432858`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:37.965281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f461c89-f8bf-46b7-924c-55604a4b325f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:38.076719 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3984/8002] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:38.691773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7768-104e-4bfa-9cde-322c68892837 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:38.703996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7768-104e-4bfa-9cde-322c68892837 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:38.717871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5275e-3fb9-4622-bd26-207ff14d8dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:38.718579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5275e-3fb9-4622-bd26-207ff14d8dfa service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:38.718869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5275e-3fb9-4622-bd26-207ff14d8dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:38.719239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5275e-3fb9-4622-bd26-207ff14d8dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:38.729133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d5b5275e-3fb9-4622-bd26-207ff14d8dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:38.766068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5275e-3fb9-4622-bd26-207ff14d8dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:38.767554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5275e-3fb9-4622-bd26-207ff14d8dfa service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:38.797819 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4019/8003] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:39.396379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f461c89-f8bf-46b7-924c-55604a4b325f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:39.501249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f461c89-f8bf-46b7-924c-55604a4b325f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:39.508402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:39.509365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:39.509723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:39.510151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] PATH_INFO: `/v3/users/961a7642578748699517ceb08b801d94` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:39.511522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=961a7642578748699517ceb08b801d94)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:39.514198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:39.609176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961a7642578748699517ceb08b801d94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:39.622741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961a7642578748699517ceb08b801d94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:39.623994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961a7642578748699517ceb08b801d94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:39.625028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961a7642578748699517ceb08b801d94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:39.647100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961a7642578748699517ceb08b801d94'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:39.673261 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3985/8004] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:39 2022] DELETE /identity/v3/users/961a7642578748699517ceb08b801d94 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:39.674937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2800ee-b8a1-4b69-b596-094f5ddfd40b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:39.675478 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2800ee-b8a1-4b69-b596-094f5ddfd40b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:39.675899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2800ee-b8a1-4b69-b596-094f5ddfd40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:39.717289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2f2800ee-b8a1-4b69-b596-094f5ddfd40b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:39.718524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2f2800ee-b8a1-4b69-b596-094f5ddfd40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:39.823803 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4020/8005] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:39.833239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:39.834874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:39.912371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e28ea-dbdb-46b5-a95d-f4abc3bd6f35 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:39.922966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462fac3-6265-469b-bb5f-1045b16de81f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:39.923809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462fac3-6265-469b-bb5f-1045b16de81f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:39.924618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462fac3-6265-469b-bb5f-1045b16de81f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:39.924618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462fac3-6265-469b-bb5f-1045b16de81f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:39.936806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462fac3-6265-469b-bb5f-1045b16de81f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:39.938287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462fac3-6265-469b-bb5f-1045b16de81f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:39.951246 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3986/8006] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:40.216419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2800ee-b8a1-4b69-b596-094f5ddfd40b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:40.218961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2f2800ee-b8a1-4b69-b596-094f5ddfd40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:40.271418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2800ee-b8a1-4b69-b596-094f5ddfd40b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:40.309000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:40.310434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:40.310798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:40.311404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] PATH_INFO: `/v3/projects/4aa48692c08b4bcaa33dc8137560d75d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:40.313034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa48692c08b4bcaa33dc8137560d75d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:40.315477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:40.389658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa48692c08b4bcaa33dc8137560d75d', 'request_id': 'req-aaa9fb9c-30f1-484f-9e08-c36e012f452d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.399047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa48692c08b4bcaa33dc8137560d75d', 'request_id': 'req-aaa9fb9c-30f1-484f-9e08-c36e012f452d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.408373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa48692c08b4bcaa33dc8137560d75d', 'request_id': 'req-aaa9fb9c-30f1-484f-9e08-c36e012f452d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.424734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] The token cache is being invalidate because project 4aa48692c08b4bcaa33dc8137560d75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:40.425228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.425999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.428261 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4021/8007] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:40 2022] DELETE /identity/v3/projects/4aa48692c08b4bcaa33dc8137560d75d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:40.432560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462fac3-6265-469b-bb5f-1045b16de81f service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:40.442923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462fac3-6265-469b-bb5f-1045b16de81f service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:40.512691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:40.514227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:40.514460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:40.514766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] PATH_INFO: `/v3/users/dd9d3304c6e14b34a22df3a958191e4e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:40.516036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9d3304c6e14b34a22df3a958191e4e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:40.518015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:40.564642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9d3304c6e14b34a22df3a958191e4e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.573710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9d3304c6e14b34a22df3a958191e4e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.574447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9d3304c6e14b34a22df3a958191e4e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.575095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9d3304c6e14b34a22df3a958191e4e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.588823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3d2d78fc-db08-4224-b785-177a981f4cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9d3304c6e14b34a22df3a958191e4e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:40.603696 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3987/8008] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:40 2022] DELETE /identity/v3/users/dd9d3304c6e14b34a22df3a958191e4e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:40.820541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:40.822550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:40.849994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9fb9c-30f1-484f-9e08-c36e012f452d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:40.937630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:40.938856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:40.939203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:40.939562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] PATH_INFO: `/v3/projects/e535d0e230c04fdaa9b4336df1be2288` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:40.941007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e535d0e230c04fdaa9b4336df1be2288)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:40.943122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:41.028397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e535d0e230c04fdaa9b4336df1be2288', 'request_id': 'req-ae20eb2d-366f-4e61-9d43-da655352ce05'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:41.037776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e535d0e230c04fdaa9b4336df1be2288', 'request_id': 'req-ae20eb2d-366f-4e61-9d43-da655352ce05'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:41.047175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e535d0e230c04fdaa9b4336df1be2288', 'request_id': 'req-ae20eb2d-366f-4e61-9d43-da655352ce05'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:41.064083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] The token cache is being invalidate because project e535d0e230c04fdaa9b4336df1be2288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:41.064283 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:41.065248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ae20eb2d-366f-4e61-9d43-da655352ce05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:41.066916 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4022/8009] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:40 2022] DELETE /identity/v3/projects/e535d0e230c04fdaa9b4336df1be2288 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:41.072569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2681ec-ac40-4ee0-bf9e-2d8b6ec77ca2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.072863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2681ec-ac40-4ee0-bf9e-2d8b6ec77ca2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.073142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2681ec-ac40-4ee0-bf9e-2d8b6ec77ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.099097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8e2681ec-ac40-4ee0-bf9e-2d8b6ec77ca2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:41.100702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8e2681ec-ac40-4ee0-bf9e-2d8b6ec77ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:41.181411 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3988/8010] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:41.189532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1db59-5c13-4c6e-9cac-afd53c892c92 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.189827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1db59-5c13-4c6e-9cac-afd53c892c92 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.190109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1db59-5c13-4c6e-9cac-afd53c892c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.219280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-13f1db59-5c13-4c6e-9cac-afd53c892c92 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:41.221413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-13f1db59-5c13-4c6e-9cac-afd53c892c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:41.231184 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4023/8011] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:41.235878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2681ec-ac40-4ee0-bf9e-2d8b6ec77ca2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:41.254402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2681ec-ac40-4ee0-bf9e-2d8b6ec77ca2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:41.263568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a486680-a151-4190-afe1-fb7601f3d673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:41.264961 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486680-a151-4190-afe1-fb7601f3d673 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.265342 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486680-a151-4190-afe1-fb7601f3d673 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.265717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a486680-a151-4190-afe1-fb7601f3d673 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.266603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a486680-a151-4190-afe1-fb7601f3d673 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:41.267145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a486680-a151-4190-afe1-fb7601f3d673 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:41.269424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a486680-a151-4190-afe1-fb7601f3d673 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:41.291147 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3989/8012] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:41.292994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1db59-5c13-4c6e-9cac-afd53c892c92 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:41.307899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1db59-5c13-4c6e-9cac-afd53c892c92 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:41.316150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c551c9-572f-4aa8-8e74-53d9fd318213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:41.316928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c551c9-572f-4aa8-8e74-53d9fd318213 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.317324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c551c9-572f-4aa8-8e74-53d9fd318213 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.317753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c551c9-572f-4aa8-8e74-53d9fd318213 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.318603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c551c9-572f-4aa8-8e74-53d9fd318213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:41.320913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c551c9-572f-4aa8-8e74-53d9fd318213 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:41.373971 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4024/8013] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:41 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:41.378053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a486680-a151-4190-afe1-fb7601f3d673 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:41.392006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a486680-a151-4190-afe1-fb7601f3d673 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:41.470412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a6cf9-e034-49df-9b81-f644d40b74d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:41.471190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a6cf9-e034-49df-9b81-f644d40b74d8 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.471658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a6cf9-e034-49df-9b81-f644d40b74d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.471980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9a6cf9-e034-49df-9b81-f644d40b74d8 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.472696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a6cf9-e034-49df-9b81-f644d40b74d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:41.474716 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9a6cf9-e034-49df-9b81-f644d40b74d8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:41.501412 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3990/8014] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:41 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:41.505350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c551c9-572f-4aa8-8e74-53d9fd318213 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:41.517581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c551c9-572f-4aa8-8e74-53d9fd318213 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:41.523751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fb05f-8422-40a1-a50f-6d32c59ad87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:41.524638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fb05f-8422-40a1-a50f-6d32c59ad87b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.525017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fb05f-8422-40a1-a50f-6d32c59ad87b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.525318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fb05f-8422-40a1-a50f-6d32c59ad87b admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.526155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fb05f-8422-40a1-a50f-6d32c59ad87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:41.527859 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fb05f-8422-40a1-a50f-6d32c59ad87b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:41.539948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4025/8015] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:41.544152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a6cf9-e034-49df-9b81-f644d40b74d8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:41.559899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9a6cf9-e034-49df-9b81-f644d40b74d8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:41.586588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f550076-3d85-4032-b9cb-8b411c59d2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:41.589186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f550076-3d85-4032-b9cb-8b411c59d2e6 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.589637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f550076-3d85-4032-b9cb-8b411c59d2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.589927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f550076-3d85-4032-b9cb-8b411c59d2e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.590703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f550076-3d85-4032-b9cb-8b411c59d2e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:41.592430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f550076-3d85-4032-b9cb-8b411c59d2e6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:41.614109 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3991/8016] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:41.618746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fb05f-8422-40a1-a50f-6d32c59ad87b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:41.633570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fb05f-8422-40a1-a50f-6d32c59ad87b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:41.643590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f6084-77c4-4d11-a369-359eb31f0bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:41.644749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f6084-77c4-4d11-a369-359eb31f0bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.645167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f6084-77c4-4d11-a369-359eb31f0bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.645598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f6084-77c4-4d11-a369-359eb31f0bbe admin admin] PATH_INFO: `/v3/projects/3e8108ff8ea6449b8a6582f0f6722461/users/99a35b27367a4fa6a92d61e2f8e41134/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.679961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f6084-77c4-4d11-a369-359eb31f0bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8108ff8ea6449b8a6582f0f6722461, user_id=99a35b27367a4fa6a92d61e2f8e41134, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:41.682650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f6084-77c4-4d11-a369-359eb31f0bbe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:41.703525 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4026/8017] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:41 2022] PUT /identity/v3/projects/3e8108ff8ea6449b8a6582f0f6722461/users/99a35b27367a4fa6a92d61e2f8e41134/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:41.714925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac139b7-fc62-4e36-80e6-361fe87b269e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.715249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac139b7-fc62-4e36-80e6-361fe87b269e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.715644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac139b7-fc62-4e36-80e6-361fe87b269e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.748748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3ac139b7-fc62-4e36-80e6-361fe87b269e None None] MFA Rules not processed for user `99a35b27367a4fa6a92d61e2f8e41134`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:41.750532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3ac139b7-fc62-4e36-80e6-361fe87b269e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:41.867858 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3992/8018] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:41.872742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f6084-77c4-4d11-a369-359eb31f0bbe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:41.977111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f6084-77c4-4d11-a369-359eb31f0bbe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:41.985762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05742dda-97bb-4c2f-89e2-43cb2c5293a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:41.986548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05742dda-97bb-4c2f-89e2-43cb2c5293a0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:41.987031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05742dda-97bb-4c2f-89e2-43cb2c5293a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:41.987260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05742dda-97bb-4c2f-89e2-43cb2c5293a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:41.988413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05742dda-97bb-4c2f-89e2-43cb2c5293a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:41.990950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05742dda-97bb-4c2f-89e2-43cb2c5293a0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:42.044541 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4027/8019] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:41 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:42.049283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac139b7-fc62-4e36-80e6-361fe87b269e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:42.065274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac139b7-fc62-4e36-80e6-361fe87b269e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:42.132797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88868b-b4a8-4b9c-bb9e-fe2686df6c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:42.133571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88868b-b4a8-4b9c-bb9e-fe2686df6c9b admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:42.136102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88868b-b4a8-4b9c-bb9e-fe2686df6c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:42.137956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88868b-b4a8-4b9c-bb9e-fe2686df6c9b admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:42.139675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88868b-b4a8-4b9c-bb9e-fe2686df6c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:42.142201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88868b-b4a8-4b9c-bb9e-fe2686df6c9b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:42.172895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05742dda-97bb-4c2f-89e2-43cb2c5293a0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:42.182942 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3993/8020] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:42 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:42.186915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05742dda-97bb-4c2f-89e2-43cb2c5293a0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:42.191961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb7ae-6256-41a0-b7cf-e9b93d066632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:42.192835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb7ae-6256-41a0-b7cf-e9b93d066632 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:42.193374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb7ae-6256-41a0-b7cf-e9b93d066632 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:42.193575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bb7ae-6256-41a0-b7cf-e9b93d066632 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:42.194368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bb7ae-6256-41a0-b7cf-e9b93d066632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:42.196175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bb7ae-6256-41a0-b7cf-e9b93d066632 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:42.210017 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4028/8021] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:42.214136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88868b-b4a8-4b9c-bb9e-fe2686df6c9b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:42.226017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88868b-b4a8-4b9c-bb9e-fe2686df6c9b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:42.230838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2799a8-c56c-44f3-b547-796c254ee028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:42.231663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2799a8-c56c-44f3-b547-796c254ee028 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:42.231976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2799a8-c56c-44f3-b547-796c254ee028 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:42.232319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2799a8-c56c-44f3-b547-796c254ee028 admin admin] PATH_INFO: `/v3/projects/2173af40073f4cc58a6ddb6cfaab7373/users/f60f7b23b1bf42ad99641295297cc5d0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:42.250966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2799a8-c56c-44f3-b547-796c254ee028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2173af40073f4cc58a6ddb6cfaab7373, user_id=f60f7b23b1bf42ad99641295297cc5d0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:42.253710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2799a8-c56c-44f3-b547-796c254ee028 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:42.271765 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3994/8022] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:42 2022] PUT /identity/v3/projects/2173af40073f4cc58a6ddb6cfaab7373/users/f60f7b23b1bf42ad99641295297cc5d0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:42.273695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb7ae-6256-41a0-b7cf-e9b93d066632 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:42.285133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bb7ae-6256-41a0-b7cf-e9b93d066632 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:42.346296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c4621-f6dd-4f9f-860b-648157402cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:42.346965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c4621-f6dd-4f9f-860b-648157402cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:42.347248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c4621-f6dd-4f9f-860b-648157402cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:42.347522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c4621-f6dd-4f9f-860b-648157402cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:42.348281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c4621-f6dd-4f9f-860b-648157402cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:42.350538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c4621-f6dd-4f9f-860b-648157402cd6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:42.361428 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4029/8023] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:42.366102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2799a8-c56c-44f3-b547-796c254ee028 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:42.377282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2799a8-c56c-44f3-b547-796c254ee028 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:42.382232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99917337-b732-441d-8e94-64be2f178a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:42.383129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99917337-b732-441d-8e94-64be2f178a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:42.383415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99917337-b732-441d-8e94-64be2f178a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:42.383692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99917337-b732-441d-8e94-64be2f178a69 admin admin] PATH_INFO: `/v3/projects/2173af40073f4cc58a6ddb6cfaab7373/users/f60f7b23b1bf42ad99641295297cc5d0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:42.389133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99917337-b732-441d-8e94-64be2f178a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2173af40073f4cc58a6ddb6cfaab7373, user_id=f60f7b23b1bf42ad99641295297cc5d0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:42.391877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99917337-b732-441d-8e94-64be2f178a69 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:42.404999 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3995/8024] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:42 2022] PUT /identity/v3/projects/2173af40073f4cc58a6ddb6cfaab7373/users/f60f7b23b1bf42ad99641295297cc5d0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:42.416367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7096c66-c927-4a26-9853-edb9dcca0ebb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:42.416658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7096c66-c927-4a26-9853-edb9dcca0ebb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:42.416942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7096c66-c927-4a26-9853-edb9dcca0ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:42.456812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d7096c66-c927-4a26-9853-edb9dcca0ebb None None] MFA Rules not processed for user `f60f7b23b1bf42ad99641295297cc5d0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:42.458352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d7096c66-c927-4a26-9853-edb9dcca0ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:42.539699 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4030/8025] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:42.550109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99917337-b732-441d-8e94-64be2f178a69 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:42.552020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-99917337-b732-441d-8e94-64be2f178a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:42.648547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99917337-b732-441d-8e94-64be2f178a69 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:42.654278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a719-63b7-487f-a969-497b4f425039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:42.654946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a719-63b7-487f-a969-497b4f425039 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:42.655234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a719-63b7-487f-a969-497b4f425039 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:42.655513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a719-63b7-487f-a969-497b4f425039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:42.666021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5a719-63b7-487f-a969-497b4f425039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:42.667526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5a719-63b7-487f-a969-497b4f425039 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:42.686802 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3996/8026] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:43.133284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7096c66-c927-4a26-9853-edb9dcca0ebb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:43.134766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d7096c66-c927-4a26-9853-edb9dcca0ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:43.205417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7096c66-c927-4a26-9853-edb9dcca0ebb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:43.210289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:43.211303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:43.211755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:43.212246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] PATH_INFO: `/v3/users/bf334063c524416f943d5a30581912cf` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:43.213477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf334063c524416f943d5a30581912cf)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:43.215725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:43.275241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf334063c524416f943d5a30581912cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.285262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf334063c524416f943d5a30581912cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.286112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf334063c524416f943d5a30581912cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.287002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf334063c524416f943d5a30581912cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.300362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf334063c524416f943d5a30581912cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.321383 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4031/8027] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:43 2022] DELETE /identity/v3/users/bf334063c524416f943d5a30581912cf => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:43.326495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6118af-19e3-4ea8-9a7e-01334a8eb00e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:43.326796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6118af-19e3-4ea8-9a7e-01334a8eb00e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:43.327076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6118af-19e3-4ea8-9a7e-01334a8eb00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:43.345122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3d6118af-19e3-4ea8-9a7e-01334a8eb00e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:43.346329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3d6118af-19e3-4ea8-9a7e-01334a8eb00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:43.408218 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3997/8028] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:43.418253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:43.420495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:43.481910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdce860-afa5-44b2-9bd0-b3987224ec14 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:43.486213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcc7ee-4229-43f6-88cb-22bdb8d7e989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:43.486907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcc7ee-4229-43f6-88cb-22bdb8d7e989 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:43.487195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcc7ee-4229-43f6-88cb-22bdb8d7e989 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:43.487523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcc7ee-4229-43f6-88cb-22bdb8d7e989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:43.498151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcc7ee-4229-43f6-88cb-22bdb8d7e989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:43.499983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcc7ee-4229-43f6-88cb-22bdb8d7e989 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:43.510521 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4032/8029] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:43.804322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6118af-19e3-4ea8-9a7e-01334a8eb00e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:43.806347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3d6118af-19e3-4ea8-9a7e-01334a8eb00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:43.821210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6118af-19e3-4ea8-9a7e-01334a8eb00e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:43.826810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:43.827807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:43.828120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:43.828548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] PATH_INFO: `/v3/projects/119e0afe758a4e3c8aff0fe6f709cb22` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:43.830083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119e0afe758a4e3c8aff0fe6f709cb22)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:43.833222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:43.882921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119e0afe758a4e3c8aff0fe6f709cb22', 'request_id': 'req-ba6094c8-cced-4a39-bfd2-16d60ba031f7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.891587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119e0afe758a4e3c8aff0fe6f709cb22', 'request_id': 'req-ba6094c8-cced-4a39-bfd2-16d60ba031f7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.897371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119e0afe758a4e3c8aff0fe6f709cb22', 'request_id': 'req-ba6094c8-cced-4a39-bfd2-16d60ba031f7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.908346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] The token cache is being invalidate because project 119e0afe758a4e3c8aff0fe6f709cb22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:43.908635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.909294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:43.910826 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3998/8030] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:43 2022] DELETE /identity/v3/projects/119e0afe758a4e3c8aff0fe6f709cb22 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:43.914845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcc7ee-4229-43f6-88cb-22bdb8d7e989 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:43.924868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcc7ee-4229-43f6-88cb-22bdb8d7e989 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:43.985769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:43.986854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:43.987179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:43.987498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] PATH_INFO: `/v3/users/d03816cdeafb4f6084abc21aae693029` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:43.988786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d03816cdeafb4f6084abc21aae693029)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:43.990722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:44.041299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd03816cdeafb4f6084abc21aae693029'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.050539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd03816cdeafb4f6084abc21aae693029'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.051151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd03816cdeafb4f6084abc21aae693029'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.051758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd03816cdeafb4f6084abc21aae693029'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.059696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b9790e1d-5d79-4946-a5bf-ee3fe8822bae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd03816cdeafb4f6084abc21aae693029'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.078310 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4033/8031] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:43 2022] DELETE /identity/v3/users/d03816cdeafb4f6084abc21aae693029 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:44.375375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:44.377254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:44.396471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6094c8-cced-4a39-bfd2-16d60ba031f7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:44.463663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:44.464601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:44.464858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:44.465234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] PATH_INFO: `/v3/projects/3d8138ad1d184277b53649849db03dcb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:44.469840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8138ad1d184277b53649849db03dcb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:44.473009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:44.525295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8138ad1d184277b53649849db03dcb', 'request_id': 'req-64c6751c-66e1-4175-be2a-c47469c61392'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.533859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8138ad1d184277b53649849db03dcb', 'request_id': 'req-64c6751c-66e1-4175-be2a-c47469c61392'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.540087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8138ad1d184277b53649849db03dcb', 'request_id': 'req-64c6751c-66e1-4175-be2a-c47469c61392'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.553116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] The token cache is being invalidate because project 3d8138ad1d184277b53649849db03dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:44.553292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.554082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-64c6751c-66e1-4175-be2a-c47469c61392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:44.556022 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 3999/8032] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:44 2022] DELETE /identity/v3/projects/3d8138ad1d184277b53649849db03dcb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:44.561629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a2262-dded-44ec-9d99-7e670c45c019 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:44.562580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a2262-dded-44ec-9d99-7e670c45c019 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:44.562863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a2262-dded-44ec-9d99-7e670c45c019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:44.583462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ed8a2262-dded-44ec-9d99-7e670c45c019 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:44.585110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ed8a2262-dded-44ec-9d99-7e670c45c019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:44.647384 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4034/8033] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:44.656714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d6b8a-e98d-49c8-96ed-82700e9f52bc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:44.657008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d6b8a-e98d-49c8-96ed-82700e9f52bc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:44.657297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d6b8a-e98d-49c8-96ed-82700e9f52bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:44.676477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-778d6b8a-e98d-49c8-96ed-82700e9f52bc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:44.677971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-778d6b8a-e98d-49c8-96ed-82700e9f52bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:44.689810 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4000/8034] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:44.691124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a2262-dded-44ec-9d99-7e670c45c019 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:44.701958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a2262-dded-44ec-9d99-7e670c45c019 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:44.706720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54474e-317e-4a78-bbc3-883c53914224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:44.707370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54474e-317e-4a78-bbc3-883c53914224 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:44.707653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54474e-317e-4a78-bbc3-883c53914224 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:44.707942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54474e-317e-4a78-bbc3-883c53914224 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:44.708675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54474e-317e-4a78-bbc3-883c53914224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:44.708981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54474e-317e-4a78-bbc3-883c53914224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:44.710581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54474e-317e-4a78-bbc3-883c53914224 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:44.722729 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4035/8035] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:44.726784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d6b8a-e98d-49c8-96ed-82700e9f52bc None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:44.736636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d6b8a-e98d-49c8-96ed-82700e9f52bc None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:44.741589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095185c-f561-4d48-bbbf-06e6d5fd04bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:44.742266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095185c-f561-4d48-bbbf-06e6d5fd04bf admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:44.742550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095185c-f561-4d48-bbbf-06e6d5fd04bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:44.742846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095185c-f561-4d48-bbbf-06e6d5fd04bf admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:44.743534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095185c-f561-4d48-bbbf-06e6d5fd04bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:44.745492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095185c-f561-4d48-bbbf-06e6d5fd04bf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:44.770821 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4001/8036] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:44 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:44.774944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54474e-317e-4a78-bbc3-883c53914224 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:44.785337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54474e-317e-4a78-bbc3-883c53914224 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:44.840860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ab609-72d8-45b4-9326-f11a9c9d2ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:44.842326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ab609-72d8-45b4-9326-f11a9c9d2ffe admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:44.842926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ab609-72d8-45b4-9326-f11a9c9d2ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:44.842926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ab609-72d8-45b4-9326-f11a9c9d2ffe admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:44.843553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ab609-72d8-45b4-9326-f11a9c9d2ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:44.845548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ab609-72d8-45b4-9326-f11a9c9d2ffe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:44.867680 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4036/8037] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:44 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:44.871896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095185c-f561-4d48-bbbf-06e6d5fd04bf admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:44.882841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095185c-f561-4d48-bbbf-06e6d5fd04bf admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:44.888201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cab12e-3a76-422a-a389-d4a57d20867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:44.888901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cab12e-3a76-422a-a389-d4a57d20867c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:44.889794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cab12e-3a76-422a-a389-d4a57d20867c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:44.889794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cab12e-3a76-422a-a389-d4a57d20867c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:44.890328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cab12e-3a76-422a-a389-d4a57d20867c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:44.892139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cab12e-3a76-422a-a389-d4a57d20867c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:44.903016 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4002/8038] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:44.907512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ab609-72d8-45b4-9326-f11a9c9d2ffe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:44.917885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ab609-72d8-45b4-9326-f11a9c9d2ffe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:44.924350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d14ab-88b4-4187-80aa-5498f18fc82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:44.925011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d14ab-88b4-4187-80aa-5498f18fc82e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:44.925317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d14ab-88b4-4187-80aa-5498f18fc82e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:44.925601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d14ab-88b4-4187-80aa-5498f18fc82e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:44.926336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d14ab-88b4-4187-80aa-5498f18fc82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:44.928221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d14ab-88b4-4187-80aa-5498f18fc82e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:44.938337 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4037/8039] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:44.942482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cab12e-3a76-422a-a389-d4a57d20867c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:44.952273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cab12e-3a76-422a-a389-d4a57d20867c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:44.956873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33f73c-df45-4909-890e-b0721828e711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:44.957746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f73c-df45-4909-890e-b0721828e711 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:44.958034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f73c-df45-4909-890e-b0721828e711 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:44.958303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f73c-df45-4909-890e-b0721828e711 admin admin] PATH_INFO: `/v3/projects/d98fcc44d147442c8f2b0201393f8bd1/users/28ef7119146a43299c05e8cd9241aef4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:44.975394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33f73c-df45-4909-890e-b0721828e711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98fcc44d147442c8f2b0201393f8bd1, user_id=28ef7119146a43299c05e8cd9241aef4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:44.978715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33f73c-df45-4909-890e-b0721828e711 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:44.995223 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4003/8040] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:44 2022] PUT /identity/v3/projects/d98fcc44d147442c8f2b0201393f8bd1/users/28ef7119146a43299c05e8cd9241aef4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:45.005712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf19c6-a572-4184-8057-e7368ccddefb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:45.006013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf19c6-a572-4184-8057-e7368ccddefb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:45.006302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf19c6-a572-4184-8057-e7368ccddefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:45.035589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-07cf19c6-a572-4184-8057-e7368ccddefb None None] MFA Rules not processed for user `28ef7119146a43299c05e8cd9241aef4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:45.036852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07cf19c6-a572-4184-8057-e7368ccddefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:45.101012 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4038/8041] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:45.105499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33f73c-df45-4909-890e-b0721828e711 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:45.169355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33f73c-df45-4909-890e-b0721828e711 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:45.174091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738c2ff-a955-4766-b5a2-1ce67c56b99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:45.174748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c2ff-a955-4766-b5a2-1ce67c56b99e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:45.175035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c2ff-a955-4766-b5a2-1ce67c56b99e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:45.175318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c2ff-a955-4766-b5a2-1ce67c56b99e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:45.176082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738c2ff-a955-4766-b5a2-1ce67c56b99e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:45.178354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738c2ff-a955-4766-b5a2-1ce67c56b99e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:45.205396 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4004/8042] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:45 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:45.209394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf19c6-a572-4184-8057-e7368ccddefb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:45.220555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf19c6-a572-4184-8057-e7368ccddefb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:45.278347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c7337-beb9-4432-9028-de2281633ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:45.279767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c7337-beb9-4432-9028-de2281633ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:45.280111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c7337-beb9-4432-9028-de2281633ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:45.280392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c7337-beb9-4432-9028-de2281633ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:45.281081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c7337-beb9-4432-9028-de2281633ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:45.283043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c7337-beb9-4432-9028-de2281633ac0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:45.302083 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4039/8043] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:45 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:45.306393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738c2ff-a955-4766-b5a2-1ce67c56b99e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:45.316783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738c2ff-a955-4766-b5a2-1ce67c56b99e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:45.321493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75905085-b496-4d39-8550-6e41abb0ba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:45.322144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905085-b496-4d39-8550-6e41abb0ba2b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:45.322426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905085-b496-4d39-8550-6e41abb0ba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:45.322702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75905085-b496-4d39-8550-6e41abb0ba2b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:45.324497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75905085-b496-4d39-8550-6e41abb0ba2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:45.326963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75905085-b496-4d39-8550-6e41abb0ba2b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:45.343785 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4005/8044] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:45.345751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c7337-beb9-4432-9028-de2281633ac0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:45.357416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c7337-beb9-4432-9028-de2281633ac0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:45.362493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948950-274e-4297-9ad0-e2b5d5f60e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:45.363421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948950-274e-4297-9ad0-e2b5d5f60e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:45.363832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948950-274e-4297-9ad0-e2b5d5f60e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:45.364179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff948950-274e-4297-9ad0-e2b5d5f60e91 admin admin] PATH_INFO: `/v3/projects/dab55b06eddc42a09d7eb59253abc953/users/989c69a120ca491ba19895f88916ce5b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:45.380176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948950-274e-4297-9ad0-e2b5d5f60e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab55b06eddc42a09d7eb59253abc953, user_id=989c69a120ca491ba19895f88916ce5b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:45.382988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff948950-274e-4297-9ad0-e2b5d5f60e91 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:45.396768 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4040/8045] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:45 2022] PUT /identity/v3/projects/dab55b06eddc42a09d7eb59253abc953/users/989c69a120ca491ba19895f88916ce5b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:45.400738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75905085-b496-4d39-8550-6e41abb0ba2b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:45.410989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75905085-b496-4d39-8550-6e41abb0ba2b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:45.467451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907afbd2-be88-4a07-8a81-39e1640e5f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:45.468276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907afbd2-be88-4a07-8a81-39e1640e5f64 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:45.468558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907afbd2-be88-4a07-8a81-39e1640e5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:45.468832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907afbd2-be88-4a07-8a81-39e1640e5f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:45.469542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907afbd2-be88-4a07-8a81-39e1640e5f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:45.471161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907afbd2-be88-4a07-8a81-39e1640e5f64 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:45.484142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4006/8046] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:45.485370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948950-274e-4297-9ad0-e2b5d5f60e91 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:45.495886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff948950-274e-4297-9ad0-e2b5d5f60e91 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:45.501060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba1a99-2d1a-4b76-863f-eb3ac0ba50fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:45.501928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba1a99-2d1a-4b76-863f-eb3ac0ba50fd admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:45.502213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba1a99-2d1a-4b76-863f-eb3ac0ba50fd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:45.502486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba1a99-2d1a-4b76-863f-eb3ac0ba50fd admin admin] PATH_INFO: `/v3/projects/dab55b06eddc42a09d7eb59253abc953/users/989c69a120ca491ba19895f88916ce5b/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:45.504537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba1a99-2d1a-4b76-863f-eb3ac0ba50fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab55b06eddc42a09d7eb59253abc953, user_id=989c69a120ca491ba19895f88916ce5b, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:45.507212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba1a99-2d1a-4b76-863f-eb3ac0ba50fd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:45.518520 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4041/8047] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:45 2022] PUT /identity/v3/projects/dab55b06eddc42a09d7eb59253abc953/users/989c69a120ca491ba19895f88916ce5b/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:45.529073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e27de-ce03-4699-8842-4649eb8dc16e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:45.529363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e27de-ce03-4699-8842-4649eb8dc16e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:45.529638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e27de-ce03-4699-8842-4649eb8dc16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:45.556382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-957e27de-ce03-4699-8842-4649eb8dc16e None None] MFA Rules not processed for user `989c69a120ca491ba19895f88916ce5b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:45.557584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-957e27de-ce03-4699-8842-4649eb8dc16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:45.633529 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4007/8048] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:45.645799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba1a99-2d1a-4b76-863f-eb3ac0ba50fd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:45.649945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c5ba1a99-2d1a-4b76-863f-eb3ac0ba50fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:45.723621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba1a99-2d1a-4b76-863f-eb3ac0ba50fd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:45.734815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac4f14-51f2-4500-8277-006c5ce6610b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:45.735471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac4f14-51f2-4500-8277-006c5ce6610b service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:45.735755 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac4f14-51f2-4500-8277-006c5ce6610b service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:45.736073 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac4f14-51f2-4500-8277-006c5ce6610b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:45.745857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac4f14-51f2-4500-8277-006c5ce6610b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:45.747400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac4f14-51f2-4500-8277-006c5ce6610b service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:45.757763 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4042/8049] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:46.150759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e27de-ce03-4699-8842-4649eb8dc16e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:46.213992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e27de-ce03-4699-8842-4649eb8dc16e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:46.219145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:46.220217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:46.220602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:46.220977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] PATH_INFO: `/v3/users/28ef7119146a43299c05e8cd9241aef4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:46.222301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ef7119146a43299c05e8cd9241aef4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:46.224359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:46.269665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ef7119146a43299c05e8cd9241aef4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.276877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ef7119146a43299c05e8cd9241aef4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.277499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ef7119146a43299c05e8cd9241aef4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.278126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ef7119146a43299c05e8cd9241aef4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.290182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ef7119146a43299c05e8cd9241aef4'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.303276 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4008/8050] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:46 2022] DELETE /identity/v3/users/28ef7119146a43299c05e8cd9241aef4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:46.307797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd737039-fd42-4cf7-9371-a6ee116c3ba3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:46.308124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd737039-fd42-4cf7-9371-a6ee116c3ba3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:46.308411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd737039-fd42-4cf7-9371-a6ee116c3ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:46.327079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bd737039-fd42-4cf7-9371-a6ee116c3ba3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:46.328339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bd737039-fd42-4cf7-9371-a6ee116c3ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:46.386881 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4043/8051] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:46.396179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:46.397654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:46.460882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db878ea6-7afc-453b-8079-7d3bbce5a2ea admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:46.464570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5a76-553f-4689-98bb-abe1d1bb2716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:46.465217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5a76-553f-4689-98bb-abe1d1bb2716 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:46.465812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5a76-553f-4689-98bb-abe1d1bb2716 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:46.465812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b5a76-553f-4689-98bb-abe1d1bb2716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:46.476184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b5a76-553f-4689-98bb-abe1d1bb2716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:46.477644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b5a76-553f-4689-98bb-abe1d1bb2716 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:46.488407 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4009/8052] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:46.781410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd737039-fd42-4cf7-9371-a6ee116c3ba3 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:46.783176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bd737039-fd42-4cf7-9371-a6ee116c3ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:46.797599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd737039-fd42-4cf7-9371-a6ee116c3ba3 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:46.802661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:46.803510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:46.803808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:46.804188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] PATH_INFO: `/v3/projects/d98fcc44d147442c8f2b0201393f8bd1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:46.805372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98fcc44d147442c8f2b0201393f8bd1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:46.807284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:46.863139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98fcc44d147442c8f2b0201393f8bd1', 'request_id': 'req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.873592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98fcc44d147442c8f2b0201393f8bd1', 'request_id': 'req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.880338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98fcc44d147442c8f2b0201393f8bd1', 'request_id': 'req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.893650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] The token cache is being invalidate because project d98fcc44d147442c8f2b0201393f8bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:46.893823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.894475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:46.896035 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4044/8053] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:46 2022] DELETE /identity/v3/projects/d98fcc44d147442c8f2b0201393f8bd1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:46.900185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5a76-553f-4689-98bb-abe1d1bb2716 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:46.911692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b5a76-553f-4689-98bb-abe1d1bb2716 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:47.015494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:47.016660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:47.016948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:47.018512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] PATH_INFO: `/v3/users/989c69a120ca491ba19895f88916ce5b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:47.023482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] RBAC: Authorizing `identity:delete_user(user_id=989c69a120ca491ba19895f88916ce5b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:47.028895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:47.094399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989c69a120ca491ba19895f88916ce5b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.102356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989c69a120ca491ba19895f88916ce5b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.102986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989c69a120ca491ba19895f88916ce5b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.103591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989c69a120ca491ba19895f88916ce5b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.117667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3e7e052a-2f5a-45d5-a0e9-5c224de0642a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989c69a120ca491ba19895f88916ce5b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.132192 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4010/8054] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:46 2022] DELETE /identity/v3/users/989c69a120ca491ba19895f88916ce5b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:47.428477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:47.430475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:47.448862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acda8df-30c8-4117-ba0d-d9e1fb25c25d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:47.513803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:47.514977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:47.515404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:47.515829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] PATH_INFO: `/v3/projects/dab55b06eddc42a09d7eb59253abc953` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:47.517266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab55b06eddc42a09d7eb59253abc953)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:47.519603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:47.570486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab55b06eddc42a09d7eb59253abc953', 'request_id': 'req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.579530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab55b06eddc42a09d7eb59253abc953', 'request_id': 'req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.587071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab55b06eddc42a09d7eb59253abc953', 'request_id': 'req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.598179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] The token cache is being invalidate because project dab55b06eddc42a09d7eb59253abc953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:47.598476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.599369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d6fc20ec-9ac9-4d3d-a917-b8e6bffd91b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:47.601498 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4045/8055] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:47 2022] DELETE /identity/v3/projects/dab55b06eddc42a09d7eb59253abc953 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:47.608117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db5367-2fcd-4828-a04f-2a253841628b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:47.608717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db5367-2fcd-4828-a04f-2a253841628b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:47.608717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db5367-2fcd-4828-a04f-2a253841628b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:47.627643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-49db5367-2fcd-4828-a04f-2a253841628b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:47.628892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49db5367-2fcd-4828-a04f-2a253841628b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:47.703391 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4011/8056] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:47.705191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370b7cb-21ce-4ad6-b147-bb83ed534e67 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:47.705488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370b7cb-21ce-4ad6-b147-bb83ed534e67 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:47.705761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370b7cb-21ce-4ad6-b147-bb83ed534e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:47.727022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f370b7cb-21ce-4ad6-b147-bb83ed534e67 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:47.728517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f370b7cb-21ce-4ad6-b147-bb83ed534e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:47.737583 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4046/8057] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:47.741840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db5367-2fcd-4828-a04f-2a253841628b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:47.753153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db5367-2fcd-4828-a04f-2a253841628b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:47.757973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffd5ce-a11f-4958-8cd2-6cf3b5ce60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:47.758708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd5ce-a11f-4958-8cd2-6cf3b5ce60ca admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:47.759070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd5ce-a11f-4958-8cd2-6cf3b5ce60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:47.759414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffd5ce-a11f-4958-8cd2-6cf3b5ce60ca admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:47.760247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffd5ce-a11f-4958-8cd2-6cf3b5ce60ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:47.760625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffd5ce-a11f-4958-8cd2-6cf3b5ce60ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:47.762570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffd5ce-a11f-4958-8cd2-6cf3b5ce60ca admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:47.774949 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4012/8058] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:47.779542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370b7cb-21ce-4ad6-b147-bb83ed534e67 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:47.789172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370b7cb-21ce-4ad6-b147-bb83ed534e67 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:47.793896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d8ac1-1e0f-43ba-ac7b-182f2f12e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:47.795145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d8ac1-1e0f-43ba-ac7b-182f2f12e66f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:47.795432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d8ac1-1e0f-43ba-ac7b-182f2f12e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:47.795712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d8ac1-1e0f-43ba-ac7b-182f2f12e66f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:47.796516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d8ac1-1e0f-43ba-ac7b-182f2f12e66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:47.798434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d8ac1-1e0f-43ba-ac7b-182f2f12e66f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:47.828541 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4047/8059] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:47 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:47.829678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffd5ce-a11f-4958-8cd2-6cf3b5ce60ca admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:47.839843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffd5ce-a11f-4958-8cd2-6cf3b5ce60ca admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:47.896190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2525-bf02-4f8b-b126-27b8772a6b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:47.897398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2525-bf02-4f8b-b126-27b8772a6b76 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:47.897679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2525-bf02-4f8b-b126-27b8772a6b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:47.897965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e2525-bf02-4f8b-b126-27b8772a6b76 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:47.898640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e2525-bf02-4f8b-b126-27b8772a6b76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:47.900602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e2525-bf02-4f8b-b126-27b8772a6b76 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:47.921381 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4013/8060] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:47 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:47.925407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d8ac1-1e0f-43ba-ac7b-182f2f12e66f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:47.936131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d8ac1-1e0f-43ba-ac7b-182f2f12e66f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:47.941104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9e4f-a545-4468-b0b4-d87fe54517aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:47.941876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9e4f-a545-4468-b0b4-d87fe54517aa admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:47.942165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9e4f-a545-4468-b0b4-d87fe54517aa admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:47.942435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f9e4f-a545-4468-b0b4-d87fe54517aa admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:47.943155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f9e4f-a545-4468-b0b4-d87fe54517aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:47.945367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f9e4f-a545-4468-b0b4-d87fe54517aa admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:47.959530 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4048/8061] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:47.960738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2525-bf02-4f8b-b126-27b8772a6b76 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:47.971321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e2525-bf02-4f8b-b126-27b8772a6b76 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:47.976805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a024e-aef1-4b4f-886d-c99d930de2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:47.977478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a024e-aef1-4b4f-886d-c99d930de2ef admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:47.977752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a024e-aef1-4b4f-886d-c99d930de2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:47.978113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a024e-aef1-4b4f-886d-c99d930de2ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:47.978732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a024e-aef1-4b4f-886d-c99d930de2ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:47.980400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a024e-aef1-4b4f-886d-c99d930de2ef admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:47.991453 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4014/8062] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:47.995721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9e4f-a545-4468-b0b4-d87fe54517aa admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.005955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f9e4f-a545-4468-b0b4-d87fe54517aa admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.010758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26664214-19d8-4809-93a4-5b1ae923cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.011657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26664214-19d8-4809-93a4-5b1ae923cfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.011967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26664214-19d8-4809-93a4-5b1ae923cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.012259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26664214-19d8-4809-93a4-5b1ae923cfc8 admin admin] PATH_INFO: `/v3/projects/db137c76c0d447e2b06211d3d724a8ca/users/df4baa4bef2c4357bd473d26cff5ab84/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.028464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26664214-19d8-4809-93a4-5b1ae923cfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db137c76c0d447e2b06211d3d724a8ca, user_id=df4baa4bef2c4357bd473d26cff5ab84, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.031696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26664214-19d8-4809-93a4-5b1ae923cfc8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.047181 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4049/8063] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:47 2022] PUT /identity/v3/projects/db137c76c0d447e2b06211d3d724a8ca/users/df4baa4bef2c4357bd473d26cff5ab84/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:48.058686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06afe55-7981-48a6-ac36-526ab46a3168 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.058999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06afe55-7981-48a6-ac36-526ab46a3168 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.063571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06afe55-7981-48a6-ac36-526ab46a3168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.096838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b06afe55-7981-48a6-ac36-526ab46a3168 None None] MFA Rules not processed for user `df4baa4bef2c4357bd473d26cff5ab84`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:48.098042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b06afe55-7981-48a6-ac36-526ab46a3168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:48.167101 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4015/8064] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:48.171492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26664214-19d8-4809-93a4-5b1ae923cfc8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.245520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26664214-19d8-4809-93a4-5b1ae923cfc8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.250297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e043db-12eb-43af-86e5-b5ddd2266bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.250960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e043db-12eb-43af-86e5-b5ddd2266bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.251248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e043db-12eb-43af-86e5-b5ddd2266bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.251527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e043db-12eb-43af-86e5-b5ddd2266bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.252262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e043db-12eb-43af-86e5-b5ddd2266bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.254187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e043db-12eb-43af-86e5-b5ddd2266bd5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.281049 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4050/8065] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:48 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:48.285066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06afe55-7981-48a6-ac36-526ab46a3168 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.299448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06afe55-7981-48a6-ac36-526ab46a3168 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.359402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a7d92-03ad-4145-8c4f-a2632f98bfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.360134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a7d92-03ad-4145-8c4f-a2632f98bfe4 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.360422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a7d92-03ad-4145-8c4f-a2632f98bfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.360701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a7d92-03ad-4145-8c4f-a2632f98bfe4 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.361388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a7d92-03ad-4145-8c4f-a2632f98bfe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.363351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a7d92-03ad-4145-8c4f-a2632f98bfe4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.382882 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4016/8066] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:48 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:48.386980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e043db-12eb-43af-86e5-b5ddd2266bd5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.398696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e043db-12eb-43af-86e5-b5ddd2266bd5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.404479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ce124-be12-449d-abe4-228bb0b44643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.405516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ce124-be12-449d-abe4-228bb0b44643 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.406040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ce124-be12-449d-abe4-228bb0b44643 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.406641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ce124-be12-449d-abe4-228bb0b44643 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.407651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ce124-be12-449d-abe4-228bb0b44643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.409589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ce124-be12-449d-abe4-228bb0b44643 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.428941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a7d92-03ad-4145-8c4f-a2632f98bfe4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.429825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3d4a7d92-03ad-4145-8c4f-a2632f98bfe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:48.430321 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4051/8067] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:48.434135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ce124-be12-449d-abe4-228bb0b44643 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.452392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ce124-be12-449d-abe4-228bb0b44643 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.458089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e3e1-2867-4e72-a18a-44de6bbdd453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.459349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e3e1-2867-4e72-a18a-44de6bbdd453 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.459640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e3e1-2867-4e72-a18a-44de6bbdd453 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.459953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20e3e1-2867-4e72-a18a-44de6bbdd453 admin admin] PATH_INFO: `/v3/projects/7a5d42f7c4f446aeb32787d52ce29ce8/users/a220267ab29a4f2a89cc12613caaf96f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.486185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e3e1-2867-4e72-a18a-44de6bbdd453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5d42f7c4f446aeb32787d52ce29ce8, user_id=a220267ab29a4f2a89cc12613caaf96f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.490098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f20e3e1-2867-4e72-a18a-44de6bbdd453 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.508310 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4052/8068] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:48 2022] PUT /identity/v3/projects/7a5d42f7c4f446aeb32787d52ce29ce8/users/a220267ab29a4f2a89cc12613caaf96f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:48.512844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e3e1-2867-4e72-a18a-44de6bbdd453 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.532439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a7d92-03ad-4145-8c4f-a2632f98bfe4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.589168 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20e3e1-2867-4e72-a18a-44de6bbdd453 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.594566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9961-8df8-4cba-8e85-0a70cd9e7521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.595239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9961-8df8-4cba-8e85-0a70cd9e7521 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.595589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9961-8df8-4cba-8e85-0a70cd9e7521 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.595784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9961-8df8-4cba-8e85-0a70cd9e7521 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.596558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa9961-8df8-4cba-8e85-0a70cd9e7521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.598772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa9961-8df8-4cba-8e85-0a70cd9e7521 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.610286 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4053/8069] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:48.614688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9961-8df8-4cba-8e85-0a70cd9e7521 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.619842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4dac9-6b76-4e2c-ae70-45a172654ad6 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f60f7b23b1bf42ad99641295297cc5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173af40073f4cc58a6ddb6cfaab7373', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.620817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4dac9-6b76-4e2c-ae70-45a172654ad6 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.621232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4dac9-6b76-4e2c-ae70-45a172654ad6 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.622159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4dac9-6b76-4e2c-ae70-45a172654ad6 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.625172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4dac9-6b76-4e2c-ae70-45a172654ad6 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:48.625611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4dac9-6b76-4e2c-ae70-45a172654ad6 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.626187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9961-8df8-4cba-8e85-0a70cd9e7521 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.628006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4dac9-6b76-4e2c-ae70-45a172654ad6 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.631858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67915aae-e683-4ed9-bac7-f3becf88bbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.632819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915aae-e683-4ed9-bac7-f3becf88bbba admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.633041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915aae-e683-4ed9-bac7-f3becf88bbba admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.633367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67915aae-e683-4ed9-bac7-f3becf88bbba admin admin] PATH_INFO: `/v3/projects/7a5d42f7c4f446aeb32787d52ce29ce8/users/a220267ab29a4f2a89cc12613caaf96f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.635759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915aae-e683-4ed9-bac7-f3becf88bbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5d42f7c4f446aeb32787d52ce29ce8, user_id=a220267ab29a4f2a89cc12613caaf96f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.640360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67915aae-e683-4ed9-bac7-f3becf88bbba admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.647437 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4017/8070] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:16:48.649208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4dac9-6b76-4e2c-ae70-45a172654ad6 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.660532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4dac9-6b76-4e2c-ae70-45a172654ad6 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.663428 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4054/8071] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:48 2022] PUT /identity/v3/projects/7a5d42f7c4f446aeb32787d52ce29ce8/users/a220267ab29a4f2a89cc12613caaf96f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:48.665305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614c5a3-4679-45d0-a391-40c252a6fe9d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.665586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614c5a3-4679-45d0-a391-40c252a6fe9d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.665856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614c5a3-4679-45d0-a391-40c252a6fe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.699628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4614c5a3-4679-45d0-a391-40c252a6fe9d None None] MFA Rules not processed for user `a220267ab29a4f2a89cc12613caaf96f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:48.701508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4614c5a3-4679-45d0-a391-40c252a6fe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:48.735321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23775fa-f471-499d-82d5-27c9f2f75bee tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f60f7b23b1bf42ad99641295297cc5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173af40073f4cc58a6ddb6cfaab7373', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.736381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23775fa-f471-499d-82d5-27c9f2f75bee tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.736381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23775fa-f471-499d-82d5-27c9f2f75bee tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.737632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23775fa-f471-499d-82d5-27c9f2f75bee tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.737632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23775fa-f471-499d-82d5-27c9f2f75bee tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.739993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23775fa-f471-499d-82d5-27c9f2f75bee tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.778530 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4018/8072] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:48 2022] POST /identity/v3/projects => generated 347 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:48.782302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23775fa-f471-499d-82d5-27c9f2f75bee tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.824211 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4055/8073] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:16:48.832155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614c5a3-4679-45d0-a391-40c252a6fe9d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:48.834026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4614c5a3-4679-45d0-a391-40c252a6fe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:48.865255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23775fa-f471-499d-82d5-27c9f2f75bee tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.872223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c982a1-544c-4fdf-9db8-ba4c3deb6aa5 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f60f7b23b1bf42ad99641295297cc5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173af40073f4cc58a6ddb6cfaab7373', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.873751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c982a1-544c-4fdf-9db8-ba4c3deb6aa5 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.874179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c982a1-544c-4fdf-9db8-ba4c3deb6aa5 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.874630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c982a1-544c-4fdf-9db8-ba4c3deb6aa5 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:48.875933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c982a1-544c-4fdf-9db8-ba4c3deb6aa5 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:48.876396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c982a1-544c-4fdf-9db8-ba4c3deb6aa5 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:48.878774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c982a1-544c-4fdf-9db8-ba4c3deb6aa5 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:48.897519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614c5a3-4679-45d0-a391-40c252a6fe9d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:48.899547 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4019/8074] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:16:48.952097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713a2dd-aec1-4cfb-9032-06ffc9d70bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:48.952988 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713a2dd-aec1-4cfb-9032-06ffc9d70bae service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:48.953402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713a2dd-aec1-4cfb-9032-06ffc9d70bae service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:48.953849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713a2dd-aec1-4cfb-9032-06ffc9d70bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:49.030116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713a2dd-aec1-4cfb-9032-06ffc9d70bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:49.031591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713a2dd-aec1-4cfb-9032-06ffc9d70bae service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:49.042636 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4056/8075] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:49.465237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c982a1-544c-4fdf-9db8-ba4c3deb6aa5 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:49.527728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c982a1-544c-4fdf-9db8-ba4c3deb6aa5 tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:49.533049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:49.533913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:49.534202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:49.534480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] PATH_INFO: `/v3/users/df4baa4bef2c4357bd473d26cff5ab84` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:49.535674 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4baa4bef2c4357bd473d26cff5ab84)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:49.537639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:49.583331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4baa4bef2c4357bd473d26cff5ab84'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.593016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4baa4bef2c4357bd473d26cff5ab84'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.593633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4baa4bef2c4357bd473d26cff5ab84'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.594245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4baa4bef2c4357bd473d26cff5ab84'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.609970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4baa4bef2c4357bd473d26cff5ab84'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.622602 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4020/8076] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:49 2022] DELETE /identity/v3/users/df4baa4bef2c4357bd473d26cff5ab84 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:49.627264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7de2d-4198-43e9-9ae2-326b0c22ae8e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:49.627679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7de2d-4198-43e9-9ae2-326b0c22ae8e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:49.628199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7de2d-4198-43e9-9ae2-326b0c22ae8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:49.646687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-36b7de2d-4198-43e9-9ae2-326b0c22ae8e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:49.647906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-36b7de2d-4198-43e9-9ae2-326b0c22ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:49.677370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:49.678828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:49.717499 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4057/8077] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:49.727046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7de2d-4198-43e9-9ae2-326b0c22ae8e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:49.728494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-36b7de2d-4198-43e9-9ae2-326b0c22ae8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:49.746204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532499e5-5be4-4852-89d4-10557e551e82 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:49.750984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f60f7b23b1bf42ad99641295297cc5d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2173af40073f4cc58a6ddb6cfaab7373', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:49.751844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:49.752165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:49.752832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] PATH_INFO: `/v3/projects/6a2aac5272e64588ba0eafbbd3a3e3d2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:49.753664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a2aac5272e64588ba0eafbbd3a3e3d2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:49.755597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:49.787656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7de2d-4198-43e9-9ae2-326b0c22ae8e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:49.791363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c18af-beea-4098-92b5-55cbf6fd59ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:49.792090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c18af-beea-4098-92b5-55cbf6fd59ef service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:49.792501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c18af-beea-4098-92b5-55cbf6fd59ef service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:49.792781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c18af-beea-4098-92b5-55cbf6fd59ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:49.802828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c18af-beea-4098-92b5-55cbf6fd59ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:49.803250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2aac5272e64588ba0eafbbd3a3e3d2', 'request_id': 'req-574556be-86cd-43ba-8afe-109a063e5d1e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.804321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c18af-beea-4098-92b5-55cbf6fd59ef service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:49.811396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2aac5272e64588ba0eafbbd3a3e3d2', 'request_id': 'req-574556be-86cd-43ba-8afe-109a063e5d1e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.815229 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4058/8078] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:16:49.817079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2aac5272e64588ba0eafbbd3a3e3d2', 'request_id': 'req-574556be-86cd-43ba-8afe-109a063e5d1e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.828391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] The token cache is being invalidate because project 6a2aac5272e64588ba0eafbbd3a3e3d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:49.828690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.829343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:49.831346 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4021/8079] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:49 2022] DELETE /identity/v3/projects/6a2aac5272e64588ba0eafbbd3a3e3d2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:49.841989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c18af-beea-4098-92b5-55cbf6fd59ef service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:49.843463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ce4c18af-beea-4098-92b5-55cbf6fd59ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:49.858801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c18af-beea-4098-92b5-55cbf6fd59ef service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:49.906983 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11b06-fe6c-4ad7-b067-eb31b90b9345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:49.907878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11b06-fe6c-4ad7-b067-eb31b90b9345 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:49.908320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11b06-fe6c-4ad7-b067-eb31b90b9345 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:49.908594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11b06-fe6c-4ad7-b067-eb31b90b9345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:49.911016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-23c11b06-fe6c-4ad7-b067-eb31b90b9345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:49.979970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c11b06-fe6c-4ad7-b067-eb31b90b9345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:49.984071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c11b06-fe6c-4ad7-b067-eb31b90b9345 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:49.998544 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4059/8080] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:50.290505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:50.292562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:50.359535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574556be-86cd-43ba-8afe-109a063e5d1e tempest-RoutersAdminTest-145788574 tempest-RoutersAdminTest-145788574-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:50.364165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:50.365014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:50.365301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:50.365579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] PATH_INFO: `/v3/projects/db137c76c0d447e2b06211d3d724a8ca` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:50.366756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db137c76c0d447e2b06211d3d724a8ca)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:50.368722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:50.414304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db137c76c0d447e2b06211d3d724a8ca', 'request_id': 'req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.421919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db137c76c0d447e2b06211d3d724a8ca', 'request_id': 'req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.427710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db137c76c0d447e2b06211d3d724a8ca', 'request_id': 'req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.438760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] The token cache is being invalidate because project db137c76c0d447e2b06211d3d724a8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:50.439045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.439713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.441273 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4022/8081] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:50 2022] DELETE /identity/v3/projects/db137c76c0d447e2b06211d3d724a8ca => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:50.445188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11b06-fe6c-4ad7-b067-eb31b90b9345 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:50.456651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11b06-fe6c-4ad7-b067-eb31b90b9345 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:50.516161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:50.517021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:50.517303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:50.517651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] PATH_INFO: `/v3/users/a220267ab29a4f2a89cc12613caaf96f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:50.518777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a220267ab29a4f2a89cc12613caaf96f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:50.520723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:50.569998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a220267ab29a4f2a89cc12613caaf96f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.577462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a220267ab29a4f2a89cc12613caaf96f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.578140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a220267ab29a4f2a89cc12613caaf96f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.578776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a220267ab29a4f2a89cc12613caaf96f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.587018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-51ee8327-3a42-41c4-bd0c-8842e21c3d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a220267ab29a4f2a89cc12613caaf96f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:50.607667 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4060/8082] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:50 2022] DELETE /identity/v3/users/a220267ab29a4f2a89cc12613caaf96f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:51.113828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:51.115294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:51.130613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5d868-6452-4eee-9b2d-965cc1d70e0a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:51.204330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:51.205512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.205979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.206398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] PATH_INFO: `/v3/projects/7a5d42f7c4f446aeb32787d52ce29ce8` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.207746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a5d42f7c4f446aeb32787d52ce29ce8)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:51.210193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:51.266458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a5d42f7c4f446aeb32787d52ce29ce8', 'request_id': 'req-646dc05a-14ac-47f2-a52c-17a44cd4c649'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:51.277768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a5d42f7c4f446aeb32787d52ce29ce8', 'request_id': 'req-646dc05a-14ac-47f2-a52c-17a44cd4c649'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:51.284641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a5d42f7c4f446aeb32787d52ce29ce8', 'request_id': 'req-646dc05a-14ac-47f2-a52c-17a44cd4c649'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:51.297724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] The token cache is being invalidate because project 7a5d42f7c4f446aeb32787d52ce29ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:51.298037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:51.298688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-646dc05a-14ac-47f2-a52c-17a44cd4c649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:51.305822 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4023/8083] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:51 2022] DELETE /identity/v3/projects/7a5d42f7c4f446aeb32787d52ce29ce8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:51.307612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387f46-8631-4dd5-b193-20472d904b37 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.308145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387f46-8631-4dd5-b193-20472d904b37 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.308225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab387f46-8631-4dd5-b193-20472d904b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.328658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ab387f46-8631-4dd5-b193-20472d904b37 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:51.329871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ab387f46-8631-4dd5-b193-20472d904b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:51.404329 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4061/8084] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:51.406561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690ab5-e98d-4a2a-b671-346b2a060204 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.406936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690ab5-e98d-4a2a-b671-346b2a060204 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.407226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4690ab5-e98d-4a2a-b671-346b2a060204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.429763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d4690ab5-e98d-4a2a-b671-346b2a060204 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:51.430990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d4690ab5-e98d-4a2a-b671-346b2a060204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:51.439484 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4024/8085] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:51.443773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab387f46-8631-4dd5-b193-20472d904b37 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:51.453609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab387f46-8631-4dd5-b193-20472d904b37 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:51.460181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f65865-48f4-40d5-abd4-337c58587360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:51.460843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f65865-48f4-40d5-abd4-337c58587360 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.461129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f65865-48f4-40d5-abd4-337c58587360 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.461534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f65865-48f4-40d5-abd4-337c58587360 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.462271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f65865-48f4-40d5-abd4-337c58587360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:51.462578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f65865-48f4-40d5-abd4-337c58587360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:51.464229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f65865-48f4-40d5-abd4-337c58587360 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:51.476883 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4062/8086] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:51.481153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4690ab5-e98d-4a2a-b671-346b2a060204 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:51.491525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4690ab5-e98d-4a2a-b671-346b2a060204 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:51.498377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03db39-0da3-4689-8fb9-917aeccaba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:51.499041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03db39-0da3-4689-8fb9-917aeccaba20 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.499333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03db39-0da3-4689-8fb9-917aeccaba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.499611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03db39-0da3-4689-8fb9-917aeccaba20 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.500602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03db39-0da3-4689-8fb9-917aeccaba20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:51.502291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03db39-0da3-4689-8fb9-917aeccaba20 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:51.532124 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4025/8087] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:51 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:51.534454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f65865-48f4-40d5-abd4-337c58587360 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:51.546391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f65865-48f4-40d5-abd4-337c58587360 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:51.618504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46072acc-5bfc-469b-8ddc-6f17d5007c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:51.619531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46072acc-5bfc-469b-8ddc-6f17d5007c19 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.619903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46072acc-5bfc-469b-8ddc-6f17d5007c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.620342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46072acc-5bfc-469b-8ddc-6f17d5007c19 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.621218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46072acc-5bfc-469b-8ddc-6f17d5007c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:51.623301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46072acc-5bfc-469b-8ddc-6f17d5007c19 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:51.650824 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4063/8088] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:51 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:51.655373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03db39-0da3-4689-8fb9-917aeccaba20 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:51.665682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03db39-0da3-4689-8fb9-917aeccaba20 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:51.671295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fecad0-1486-4f6e-965f-3ad225ce5519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:51.671993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fecad0-1486-4f6e-965f-3ad225ce5519 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.672284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fecad0-1486-4f6e-965f-3ad225ce5519 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.672561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fecad0-1486-4f6e-965f-3ad225ce5519 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.673289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fecad0-1486-4f6e-965f-3ad225ce5519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:51.674916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fecad0-1486-4f6e-965f-3ad225ce5519 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:51.687977 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4026/8089] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:51.691691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46072acc-5bfc-469b-8ddc-6f17d5007c19 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:51.704228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46072acc-5bfc-469b-8ddc-6f17d5007c19 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:51.710357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b99956-963f-4176-b6fd-e4843f9431be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:51.711075 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b99956-963f-4176-b6fd-e4843f9431be admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.711474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b99956-963f-4176-b6fd-e4843f9431be admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.711756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b99956-963f-4176-b6fd-e4843f9431be admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.712559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b99956-963f-4176-b6fd-e4843f9431be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:51.714178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b99956-963f-4176-b6fd-e4843f9431be admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:51.726036 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4064/8090] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:51.730000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fecad0-1486-4f6e-965f-3ad225ce5519 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:51.740693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fecad0-1486-4f6e-965f-3ad225ce5519 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:51.745609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af283-e3a9-44f1-967a-230e60e12e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:51.746497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af283-e3a9-44f1-967a-230e60e12e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.746784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af283-e3a9-44f1-967a-230e60e12e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.747089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af283-e3a9-44f1-967a-230e60e12e2a admin admin] PATH_INFO: `/v3/projects/fa6ac8cc2334460aa71aa6271be99657/users/902fbbde71b24a3488eca13596a67833/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.762116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276af283-e3a9-44f1-967a-230e60e12e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa6ac8cc2334460aa71aa6271be99657, user_id=902fbbde71b24a3488eca13596a67833, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:51.765411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276af283-e3a9-44f1-967a-230e60e12e2a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:51.789317 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4027/8091] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:51 2022] PUT /identity/v3/projects/fa6ac8cc2334460aa71aa6271be99657/users/902fbbde71b24a3488eca13596a67833/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:51.791010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371b46-b39e-424a-b6bf-17817c372cd4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:51.791306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371b46-b39e-424a-b6bf-17817c372cd4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:51.791583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af371b46-b39e-424a-b6bf-17817c372cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:51.822772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-af371b46-b39e-424a-b6bf-17817c372cd4 None None] MFA Rules not processed for user `902fbbde71b24a3488eca13596a67833`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:51.824686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af371b46-b39e-424a-b6bf-17817c372cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:51.915779 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4065/8092] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:51.922558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af283-e3a9-44f1-967a-230e60e12e2a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:52.004534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af283-e3a9-44f1-967a-230e60e12e2a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:52.018921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bd58e-6962-4615-bc96-af044754e1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:52.019641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bd58e-6962-4615-bc96-af044754e1dc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:52.019856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bd58e-6962-4615-bc96-af044754e1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:52.020213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bd58e-6962-4615-bc96-af044754e1dc admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:52.020894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bd58e-6962-4615-bc96-af044754e1dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:52.022852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9bd58e-6962-4615-bc96-af044754e1dc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:52.056983 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4028/8093] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:51 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:52.061533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371b46-b39e-424a-b6bf-17817c372cd4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:52.072818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af371b46-b39e-424a-b6bf-17817c372cd4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:52.138483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902564d-1e32-4760-910d-d2d584aea65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:52.139175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902564d-1e32-4760-910d-d2d584aea65c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:52.139448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902564d-1e32-4760-910d-d2d584aea65c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:52.139850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902564d-1e32-4760-910d-d2d584aea65c admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:52.140486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902564d-1e32-4760-910d-d2d584aea65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:52.142874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902564d-1e32-4760-910d-d2d584aea65c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:52.166783 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4066/8094] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:52 2022] POST /identity/v3/users => generated 302 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:52.173339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bd58e-6962-4615-bc96-af044754e1dc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:52.186258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bd58e-6962-4615-bc96-af044754e1dc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:52.192883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2faf3-270c-4c4f-8e3a-45a132c26c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:52.193758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2faf3-270c-4c4f-8e3a-45a132c26c01 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:52.194212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2faf3-270c-4c4f-8e3a-45a132c26c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:52.194592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2faf3-270c-4c4f-8e3a-45a132c26c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:52.195445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2faf3-270c-4c4f-8e3a-45a132c26c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:52.197331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2faf3-270c-4c4f-8e3a-45a132c26c01 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:52.214044 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4029/8095] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:52.218796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902564d-1e32-4760-910d-d2d584aea65c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:52.229176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902564d-1e32-4760-910d-d2d584aea65c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:52.234980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214c0b1-40fe-467b-ba5f-bbffd40c1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:52.236087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c0b1-40fe-467b-ba5f-bbffd40c1018 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:52.236238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c0b1-40fe-467b-ba5f-bbffd40c1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:52.236445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214c0b1-40fe-467b-ba5f-bbffd40c1018 admin admin] PATH_INFO: `/v3/projects/3a1154f0dad448bfa5eef9f885b17627/users/f4d4bc99e23747fb989e2f3313e982cf/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:52.254427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214c0b1-40fe-467b-ba5f-bbffd40c1018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1154f0dad448bfa5eef9f885b17627, user_id=f4d4bc99e23747fb989e2f3313e982cf, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:52.257665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214c0b1-40fe-467b-ba5f-bbffd40c1018 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:52.273719 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4067/8096] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:52 2022] PUT /identity/v3/projects/3a1154f0dad448bfa5eef9f885b17627/users/f4d4bc99e23747fb989e2f3313e982cf/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:52.279103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2faf3-270c-4c4f-8e3a-45a132c26c01 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:52.290516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2faf3-270c-4c4f-8e3a-45a132c26c01 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:52.359621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8754d9-bb3c-4d4c-97d9-158eee107954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:52.360763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8754d9-bb3c-4d4c-97d9-158eee107954 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:52.361054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8754d9-bb3c-4d4c-97d9-158eee107954 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:52.361335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8754d9-bb3c-4d4c-97d9-158eee107954 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:52.362707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8754d9-bb3c-4d4c-97d9-158eee107954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:52.364606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8754d9-bb3c-4d4c-97d9-158eee107954 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:52.379569 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4030/8097] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:52.381052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214c0b1-40fe-467b-ba5f-bbffd40c1018 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:52.392405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214c0b1-40fe-467b-ba5f-bbffd40c1018 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:52.397333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094518a6-fe45-409d-bec6-2fb729c2dedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:52.398323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094518a6-fe45-409d-bec6-2fb729c2dedc admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:52.398797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094518a6-fe45-409d-bec6-2fb729c2dedc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:52.399178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094518a6-fe45-409d-bec6-2fb729c2dedc admin admin] PATH_INFO: `/v3/projects/3a1154f0dad448bfa5eef9f885b17627/users/f4d4bc99e23747fb989e2f3313e982cf/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:52.401294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094518a6-fe45-409d-bec6-2fb729c2dedc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1154f0dad448bfa5eef9f885b17627, user_id=f4d4bc99e23747fb989e2f3313e982cf, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:52.404642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094518a6-fe45-409d-bec6-2fb729c2dedc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:52.422076 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4068/8098] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:52 2022] PUT /identity/v3/projects/3a1154f0dad448bfa5eef9f885b17627/users/f4d4bc99e23747fb989e2f3313e982cf/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:52.433663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577190e-5897-465b-8d86-b45ad9bd305e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:52.434367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577190e-5897-465b-8d86-b45ad9bd305e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:52.434745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577190e-5897-465b-8d86-b45ad9bd305e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:52.462210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c577190e-5897-465b-8d86-b45ad9bd305e None None] MFA Rules not processed for user `f4d4bc99e23747fb989e2f3313e982cf`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:52.463434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c577190e-5897-465b-8d86-b45ad9bd305e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:52.544109 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4031/8099] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:52.555952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094518a6-fe45-409d-bec6-2fb729c2dedc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:52.558111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-094518a6-fe45-409d-bec6-2fb729c2dedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:52.618486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094518a6-fe45-409d-bec6-2fb729c2dedc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:52.622734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be44b8-b80c-4f6e-a4b3-390113cda9cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:52.623380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be44b8-b80c-4f6e-a4b3-390113cda9cc service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:52.624172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be44b8-b80c-4f6e-a4b3-390113cda9cc service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:52.624172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be44b8-b80c-4f6e-a4b3-390113cda9cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:52.635907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be44b8-b80c-4f6e-a4b3-390113cda9cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:52.638802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93be44b8-b80c-4f6e-a4b3-390113cda9cc service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:52.648911 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4069/8100] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:52.703814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577190e-5897-465b-8d86-b45ad9bd305e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:52.706193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c577190e-5897-465b-8d86-b45ad9bd305e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:52.725351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577190e-5897-465b-8d86-b45ad9bd305e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:52.729133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb402f6a-09c1-4ab9-9895-8cc87303a853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:52.729782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb402f6a-09c1-4ab9-9895-8cc87303a853 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:52.730068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb402f6a-09c1-4ab9-9895-8cc87303a853 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:52.730344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb402f6a-09c1-4ab9-9895-8cc87303a853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:52.790907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb402f6a-09c1-4ab9-9895-8cc87303a853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:52.792508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb402f6a-09c1-4ab9-9895-8cc87303a853 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:52.802583 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4032/8101] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:56.121288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be44b8-b80c-4f6e-a4b3-390113cda9cc service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:56.193373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93be44b8-b80c-4f6e-a4b3-390113cda9cc service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:56.200102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:56.201860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:56.202000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:56.202299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] PATH_INFO: `/v3/users/902fbbde71b24a3488eca13596a67833` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:56.203552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902fbbde71b24a3488eca13596a67833)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:56.205613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:56.256319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902fbbde71b24a3488eca13596a67833'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.264495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902fbbde71b24a3488eca13596a67833'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.265207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902fbbde71b24a3488eca13596a67833'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.265897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902fbbde71b24a3488eca13596a67833'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.274150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902fbbde71b24a3488eca13596a67833'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.297702 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4070/8102] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:56 2022] DELETE /identity/v3/users/902fbbde71b24a3488eca13596a67833 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:56.302537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973ab57-64ac-43dd-b1c5-b180bfbc9485 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:56.303024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973ab57-64ac-43dd-b1c5-b180bfbc9485 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:56.303348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973ab57-64ac-43dd-b1c5-b180bfbc9485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:56.324118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d973ab57-64ac-43dd-b1c5-b180bfbc9485 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:56.325351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d973ab57-64ac-43dd-b1c5-b180bfbc9485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:56.397124 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4033/8103] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:56.408416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:56.410579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:56.477091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c303e-6ce0-4a00-b1a4-0ceb456afe77 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:56.480938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14ed3-7d61-4333-86e3-08a7074ec447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:56.482135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14ed3-7d61-4333-86e3-08a7074ec447 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:56.482429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14ed3-7d61-4333-86e3-08a7074ec447 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:56.482713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14ed3-7d61-4333-86e3-08a7074ec447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:56.494363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14ed3-7d61-4333-86e3-08a7074ec447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:56.495834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14ed3-7d61-4333-86e3-08a7074ec447 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:56.508886 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4071/8104] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:56.821046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973ab57-64ac-43dd-b1c5-b180bfbc9485 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:56.824168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d973ab57-64ac-43dd-b1c5-b180bfbc9485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:56.846728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973ab57-64ac-43dd-b1c5-b180bfbc9485 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:56.851549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:56.860935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:56.861317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:56.861616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] PATH_INFO: `/v3/projects/fa6ac8cc2334460aa71aa6271be99657` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:56.863953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa6ac8cc2334460aa71aa6271be99657)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:56.866101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:56.921464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa6ac8cc2334460aa71aa6271be99657', 'request_id': 'req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.930122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa6ac8cc2334460aa71aa6271be99657', 'request_id': 'req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.935805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa6ac8cc2334460aa71aa6271be99657', 'request_id': 'req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.947186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] The token cache is being invalidate because project fa6ac8cc2334460aa71aa6271be99657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:56.947474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.952966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:56.954985 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4034/8105] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:56 2022] DELETE /identity/v3/projects/fa6ac8cc2334460aa71aa6271be99657 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:16:56.959081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14ed3-7d61-4333-86e3-08a7074ec447 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:56.970664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14ed3-7d61-4333-86e3-08a7074ec447 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:57.055629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:57.056826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:57.057132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:57.057416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] PATH_INFO: `/v3/users/f4d4bc99e23747fb989e2f3313e982cf` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:57.058669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d4bc99e23747fb989e2f3313e982cf)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:57.060778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:57.111447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d4bc99e23747fb989e2f3313e982cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.118614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d4bc99e23747fb989e2f3313e982cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.119447 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d4bc99e23747fb989e2f3313e982cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.120087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d4bc99e23747fb989e2f3313e982cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.128820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3a84bcdd-7e0d-4810-8689-0660884ebd93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d4bc99e23747fb989e2f3313e982cf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.148799 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4072/8106] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:16:56 2022] DELETE /identity/v3/users/f4d4bc99e23747fb989e2f3313e982cf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:57.542476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:57.544867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:57.558775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf49c8-4faf-4bbd-988d-a56aa5b8353a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:57.624932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:57.625653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:57.625956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:57.626230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] PATH_INFO: `/v3/projects/3a1154f0dad448bfa5eef9f885b17627` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:57.627801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1154f0dad448bfa5eef9f885b17627)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:57.630089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:57.688848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1154f0dad448bfa5eef9f885b17627', 'request_id': 'req-9ee519f7-71cd-4470-9134-e67d298215d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.701061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1154f0dad448bfa5eef9f885b17627', 'request_id': 'req-9ee519f7-71cd-4470-9134-e67d298215d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.712332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1154f0dad448bfa5eef9f885b17627', 'request_id': 'req-9ee519f7-71cd-4470-9134-e67d298215d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.727545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] The token cache is being invalidate because project 3a1154f0dad448bfa5eef9f885b17627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:16:57.728061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.728737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9ee519f7-71cd-4470-9134-e67d298215d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:16:57.730592 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4035/8107] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:16:57 2022] DELETE /identity/v3/projects/3a1154f0dad448bfa5eef9f885b17627 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:57.735373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dac211-4741-4a03-a85c-c615bcf440a8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:57.735876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dac211-4741-4a03-a85c-c615bcf440a8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:57.736343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dac211-4741-4a03-a85c-c615bcf440a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:57.756492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f5dac211-4741-4a03-a85c-c615bcf440a8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:57.757932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f5dac211-4741-4a03-a85c-c615bcf440a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:57.832682 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4073/8108] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:57.835143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4a4f1-07c0-406c-84d0-b428b14cef06 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:57.835593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4a4f1-07c0-406c-84d0-b428b14cef06 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:57.836142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4a4f1-07c0-406c-84d0-b428b14cef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:57.858757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-81b4a4f1-07c0-406c-84d0-b428b14cef06 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:57.860151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-81b4a4f1-07c0-406c-84d0-b428b14cef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:57.881584 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4036/8109] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:57.883408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dac211-4741-4a03-a85c-c615bcf440a8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:57.896290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dac211-4741-4a03-a85c-c615bcf440a8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:57.901433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4dfdb-da90-4b8a-a9be-884cd8f9590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:57.902230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4dfdb-da90-4b8a-a9be-884cd8f9590b admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:57.902611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4dfdb-da90-4b8a-a9be-884cd8f9590b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:57.902981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4dfdb-da90-4b8a-a9be-884cd8f9590b admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:57.903857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4dfdb-da90-4b8a-a9be-884cd8f9590b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:16:57.904653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4dfdb-da90-4b8a-a9be-884cd8f9590b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:57.907106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4dfdb-da90-4b8a-a9be-884cd8f9590b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:57.926346 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4074/8110] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:16:57.928406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4a4f1-07c0-406c-84d0-b428b14cef06 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:57.943233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4a4f1-07c0-406c-84d0-b428b14cef06 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:57.954681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579f35e-561f-45c0-a880-1bdbfb30f06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:57.955428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f35e-561f-45c0-a880-1bdbfb30f06a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:57.955873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f35e-561f-45c0-a880-1bdbfb30f06a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:57.956252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579f35e-561f-45c0-a880-1bdbfb30f06a admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:57.957185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579f35e-561f-45c0-a880-1bdbfb30f06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:57.959575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d579f35e-561f-45c0-a880-1bdbfb30f06a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:57.999712 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4037/8111] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:57 2022] POST /identity/v3/projects => generated 367 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:58.004446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4dfdb-da90-4b8a-a9be-884cd8f9590b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.027666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4dfdb-da90-4b8a-a9be-884cd8f9590b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.112542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc82157-5557-446f-a256-707d5f248546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.113557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc82157-5557-446f-a256-707d5f248546 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.114064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc82157-5557-446f-a256-707d5f248546 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.114261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc82157-5557-446f-a256-707d5f248546 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.115153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc82157-5557-446f-a256-707d5f248546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.117521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc82157-5557-446f-a256-707d5f248546 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.146026 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4075/8112] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:58 2022] POST /identity/v3/users => generated 284 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:58.147251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579f35e-561f-45c0-a880-1bdbfb30f06a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.158871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579f35e-561f-45c0-a880-1bdbfb30f06a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.172850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e22fac-0f72-44e3-bd13-bc3fe0cf8e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.173483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e22fac-0f72-44e3-bd13-bc3fe0cf8e87 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.173770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e22fac-0f72-44e3-bd13-bc3fe0cf8e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.174062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e22fac-0f72-44e3-bd13-bc3fe0cf8e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.174801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e22fac-0f72-44e3-bd13-bc3fe0cf8e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.176522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e22fac-0f72-44e3-bd13-bc3fe0cf8e87 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.200427 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4038/8113] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:16:58.204459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc82157-5557-446f-a256-707d5f248546 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.217578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc82157-5557-446f-a256-707d5f248546 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.224346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae3cb1-41e7-4f6d-838e-99ea75adecb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.225470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae3cb1-41e7-4f6d-838e-99ea75adecb8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.225909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae3cb1-41e7-4f6d-838e-99ea75adecb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.226334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae3cb1-41e7-4f6d-838e-99ea75adecb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.227228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae3cb1-41e7-4f6d-838e-99ea75adecb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.229128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae3cb1-41e7-4f6d-838e-99ea75adecb8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.241298 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4076/8114] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:58.245789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e22fac-0f72-44e3-bd13-bc3fe0cf8e87 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.256487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e22fac-0f72-44e3-bd13-bc3fe0cf8e87 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.262029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252fae3-8c06-4b75-a117-422837b79c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.262970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252fae3-8c06-4b75-a117-422837b79c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.263254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252fae3-8c06-4b75-a117-422837b79c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.263532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252fae3-8c06-4b75-a117-422837b79c34 admin admin] PATH_INFO: `/v3/projects/9f2aae09addd4e8f8c67112a16fd6b7a/users/9ab3dfeb7c5f416ba0a4a0cf2c986ee2/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.283181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252fae3-8c06-4b75-a117-422837b79c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f2aae09addd4e8f8c67112a16fd6b7a, user_id=9ab3dfeb7c5f416ba0a4a0cf2c986ee2, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.286087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252fae3-8c06-4b75-a117-422837b79c34 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.306377 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4039/8115] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:58 2022] PUT /identity/v3/projects/9f2aae09addd4e8f8c67112a16fd6b7a/users/9ab3dfeb7c5f416ba0a4a0cf2c986ee2/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:58.317542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54bfbe-e14a-417e-bec1-adfdf12c83c4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.318130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54bfbe-e14a-417e-bec1-adfdf12c83c4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.318790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54bfbe-e14a-417e-bec1-adfdf12c83c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.349440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-db54bfbe-e14a-417e-bec1-adfdf12c83c4 None None] MFA Rules not processed for user `9ab3dfeb7c5f416ba0a4a0cf2c986ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:58.350661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-db54bfbe-e14a-417e-bec1-adfdf12c83c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:58.443142 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4077/8116] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:58.448009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252fae3-8c06-4b75-a117-422837b79c34 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.531703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252fae3-8c06-4b75-a117-422837b79c34 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.537042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89ef1-55f1-4df0-a3e7-69c8572f5d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.537733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89ef1-55f1-4df0-a3e7-69c8572f5d76 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.538015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89ef1-55f1-4df0-a3e7-69c8572f5d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.538293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf89ef1-55f1-4df0-a3e7-69c8572f5d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.538989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf89ef1-55f1-4df0-a3e7-69c8572f5d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.541168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf89ef1-55f1-4df0-a3e7-69c8572f5d76 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.567705 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4040/8117] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:16:58 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:16:58.571753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54bfbe-e14a-417e-bec1-adfdf12c83c4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.583187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54bfbe-e14a-417e-bec1-adfdf12c83c4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.641272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd92ce5-10e8-452b-9c6c-23f603b50156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.641932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd92ce5-10e8-452b-9c6c-23f603b50156 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.642215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd92ce5-10e8-452b-9c6c-23f603b50156 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.642487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd92ce5-10e8-452b-9c6c-23f603b50156 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.643187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd92ce5-10e8-452b-9c6c-23f603b50156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.645182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd92ce5-10e8-452b-9c6c-23f603b50156 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.669717 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4078/8118] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:16:58 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:16:58.671013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89ef1-55f1-4df0-a3e7-69c8572f5d76 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.683906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf89ef1-55f1-4df0-a3e7-69c8572f5d76 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.689479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62915d81-d239-43ef-9b82-b8047cb93669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.690300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62915d81-d239-43ef-9b82-b8047cb93669 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.690691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62915d81-d239-43ef-9b82-b8047cb93669 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.691062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62915d81-d239-43ef-9b82-b8047cb93669 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.692023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62915d81-d239-43ef-9b82-b8047cb93669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.693709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62915d81-d239-43ef-9b82-b8047cb93669 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.706385 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4041/8119] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:58.710779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd92ce5-10e8-452b-9c6c-23f603b50156 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.722004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd92ce5-10e8-452b-9c6c-23f603b50156 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.726893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335e51c-59d9-43b3-87bf-119e2a27d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.727791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335e51c-59d9-43b3-87bf-119e2a27d503 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.728114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335e51c-59d9-43b3-87bf-119e2a27d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.728401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335e51c-59d9-43b3-87bf-119e2a27d503 admin admin] PATH_INFO: `/v3/projects/4aa5bbc07fd84d02a1138ba58da19b88/users/7301566ad019474ab6892f28bf4057d5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.747226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335e51c-59d9-43b3-87bf-119e2a27d503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa5bbc07fd84d02a1138ba58da19b88, user_id=7301566ad019474ab6892f28bf4057d5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.749992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335e51c-59d9-43b3-87bf-119e2a27d503 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.765420 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4079/8120] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:58 2022] PUT /identity/v3/projects/4aa5bbc07fd84d02a1138ba58da19b88/users/7301566ad019474ab6892f28bf4057d5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:58.769460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62915d81-d239-43ef-9b82-b8047cb93669 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.795427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62915d81-d239-43ef-9b82-b8047cb93669 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.860863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d9079-6409-4b8a-b251-7519b9fca9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.861666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d9079-6409-4b8a-b251-7519b9fca9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.862019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d9079-6409-4b8a-b251-7519b9fca9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.862510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d9079-6409-4b8a-b251-7519b9fca9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.863429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d9079-6409-4b8a-b251-7519b9fca9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.865152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d9079-6409-4b8a-b251-7519b9fca9f2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.879373 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4042/8121] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:16:58.880835 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335e51c-59d9-43b3-87bf-119e2a27d503 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:58.892212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335e51c-59d9-43b3-87bf-119e2a27d503 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:58.896955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd2a6a-ab98-4ad8-a0a3-2a069bc6d418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:58.897852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd2a6a-ab98-4ad8-a0a3-2a069bc6d418 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.898135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd2a6a-ab98-4ad8-a0a3-2a069bc6d418 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.898413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd2a6a-ab98-4ad8-a0a3-2a069bc6d418 admin admin] PATH_INFO: `/v3/projects/4aa5bbc07fd84d02a1138ba58da19b88/users/7301566ad019474ab6892f28bf4057d5/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.900451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd2a6a-ab98-4ad8-a0a3-2a069bc6d418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa5bbc07fd84d02a1138ba58da19b88, user_id=7301566ad019474ab6892f28bf4057d5, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:58.903128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd2a6a-ab98-4ad8-a0a3-2a069bc6d418 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:58.914506 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4080/8122] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:16:58 2022] PUT /identity/v3/projects/4aa5bbc07fd84d02a1138ba58da19b88/users/7301566ad019474ab6892f28bf4057d5/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:16:58.925963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f944bc6-ae5b-4d7c-96a6-8ab038fea8fa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:58.926248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f944bc6-ae5b-4d7c-96a6-8ab038fea8fa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:58.926532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f944bc6-ae5b-4d7c-96a6-8ab038fea8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:58.960819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0f944bc6-ae5b-4d7c-96a6-8ab038fea8fa None None] MFA Rules not processed for user `7301566ad019474ab6892f28bf4057d5`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:16:58.961951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0f944bc6-ae5b-4d7c-96a6-8ab038fea8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:59.085162 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4043/8123] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:16:58 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:16:59.098048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd2a6a-ab98-4ad8-a0a3-2a069bc6d418 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:59.100080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-10cd2a6a-ab98-4ad8-a0a3-2a069bc6d418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:16:59.162956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd2a6a-ab98-4ad8-a0a3-2a069bc6d418 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:59.166916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439b0a4-1596-492e-94c9-eaf2fac225c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:59.167569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439b0a4-1596-492e-94c9-eaf2fac225c4 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:59.167853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439b0a4-1596-492e-94c9-eaf2fac225c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:59.168171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439b0a4-1596-492e-94c9-eaf2fac225c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:59.178086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439b0a4-1596-492e-94c9-eaf2fac225c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:59.179548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439b0a4-1596-492e-94c9-eaf2fac225c4 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:59.191026 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4081/8124] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:16:59.472126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f944bc6-ae5b-4d7c-96a6-8ab038fea8fa None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:16:59.483768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f944bc6-ae5b-4d7c-96a6-8ab038fea8fa None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:16:59.487265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b062ec7-2758-4ee0-8f26-693e5b89f028 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:16:59.487935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b062ec7-2758-4ee0-8f26-693e5b89f028 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:16:59.488225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b062ec7-2758-4ee0-8f26-693e5b89f028 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:16:59.489205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b062ec7-2758-4ee0-8f26-693e5b89f028 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:16:59.545548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b062ec7-2758-4ee0-8f26-693e5b89f028 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:16:59.547016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b062ec7-2758-4ee0-8f26-693e5b89f028 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:16:59.556686 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4044/8125] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:16:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:04.487190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439b0a4-1596-492e-94c9-eaf2fac225c4 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:04.548277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439b0a4-1596-492e-94c9-eaf2fac225c4 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:04.553027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:04.553889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:04.554173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:04.554451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] PATH_INFO: `/v3/users/9ab3dfeb7c5f416ba0a4a0cf2c986ee2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:04.555626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab3dfeb7c5f416ba0a4a0cf2c986ee2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:04.557638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:04.607485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab3dfeb7c5f416ba0a4a0cf2c986ee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:04.614804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab3dfeb7c5f416ba0a4a0cf2c986ee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:04.615550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab3dfeb7c5f416ba0a4a0cf2c986ee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:04.616195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab3dfeb7c5f416ba0a4a0cf2c986ee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:04.625647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab3dfeb7c5f416ba0a4a0cf2c986ee2'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:04.644918 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4082/8126] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:04 2022] DELETE /identity/v3/users/9ab3dfeb7c5f416ba0a4a0cf2c986ee2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:04.649681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33bad-f81e-47ca-866d-b0ca11d87a28 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:04.650245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33bad-f81e-47ca-866d-b0ca11d87a28 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:04.650245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b33bad-f81e-47ca-866d-b0ca11d87a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:04.668793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-31b33bad-f81e-47ca-866d-b0ca11d87a28 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:04.670014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-31b33bad-f81e-47ca-866d-b0ca11d87a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:04.732509 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4045/8127] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:04.742884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:04.744543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:04.806027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232df7d8-5878-4b02-b395-589075147860 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:04.809575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fff0d-56a1-4e0e-bca0-d9b08346fb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:04.810224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fff0d-56a1-4e0e-bca0-d9b08346fb08 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:04.810503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fff0d-56a1-4e0e-bca0-d9b08346fb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:04.810782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fff0d-56a1-4e0e-bca0-d9b08346fb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:04.820743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fff0d-56a1-4e0e-bca0-d9b08346fb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:04.822254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fff0d-56a1-4e0e-bca0-d9b08346fb08 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:04.833298 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4083/8128] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:05.266533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33bad-f81e-47ca-866d-b0ca11d87a28 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:05.268132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-31b33bad-f81e-47ca-866d-b0ca11d87a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:05.281858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b33bad-f81e-47ca-866d-b0ca11d87a28 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:05.286613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:05.287477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:05.287761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:05.288079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] PATH_INFO: `/v3/projects/9f2aae09addd4e8f8c67112a16fd6b7a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:05.289273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f2aae09addd4e8f8c67112a16fd6b7a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:05.291712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:05.339965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f2aae09addd4e8f8c67112a16fd6b7a', 'request_id': 'req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.347012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f2aae09addd4e8f8c67112a16fd6b7a', 'request_id': 'req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.352804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f2aae09addd4e8f8c67112a16fd6b7a', 'request_id': 'req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.364423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] The token cache is being invalidate because project 9f2aae09addd4e8f8c67112a16fd6b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:05.364708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.365346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.369739 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4046/8129] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:05 2022] DELETE /identity/v3/projects/9f2aae09addd4e8f8c67112a16fd6b7a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:05.371015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fff0d-56a1-4e0e-bca0-d9b08346fb08 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:05.381582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fff0d-56a1-4e0e-bca0-d9b08346fb08 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:05.438830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:05.439704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:05.440022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:05.440303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] PATH_INFO: `/v3/users/7301566ad019474ab6892f28bf4057d5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:05.441487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7301566ad019474ab6892f28bf4057d5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:05.443402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:05.487308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7301566ad019474ab6892f28bf4057d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.494055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7301566ad019474ab6892f28bf4057d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.494744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7301566ad019474ab6892f28bf4057d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.495357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7301566ad019474ab6892f28bf4057d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.503931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ca08eebd-b41e-479c-9b35-1ecd71cf4761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7301566ad019474ab6892f28bf4057d5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:05.521587 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4084/8130] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:05 2022] DELETE /identity/v3/users/7301566ad019474ab6892f28bf4057d5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:05.869641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:05.871177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:05.887607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df48cfb-a233-47a7-ac95-2a59ce6fb59e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:05.953288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:05.954146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:05.954430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:05.954826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] PATH_INFO: `/v3/projects/4aa5bbc07fd84d02a1138ba58da19b88` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:05.956036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa5bbc07fd84d02a1138ba58da19b88)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:05.957954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.008741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa5bbc07fd84d02a1138ba58da19b88', 'request_id': 'req-cfacac32-0214-4e65-9446-7e8ec74955c8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:06.017419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa5bbc07fd84d02a1138ba58da19b88', 'request_id': 'req-cfacac32-0214-4e65-9446-7e8ec74955c8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:06.023177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa5bbc07fd84d02a1138ba58da19b88', 'request_id': 'req-cfacac32-0214-4e65-9446-7e8ec74955c8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:06.036539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] The token cache is being invalidate because project 4aa5bbc07fd84d02a1138ba58da19b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:06.036832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:06.037562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-cfacac32-0214-4e65-9446-7e8ec74955c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:06.039135 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4047/8131] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:05 2022] DELETE /identity/v3/projects/4aa5bbc07fd84d02a1138ba58da19b88 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:06.044267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598897a-a018-47ba-9451-6234518bf702 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.044564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598897a-a018-47ba-9451-6234518bf702 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.044839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598897a-a018-47ba-9451-6234518bf702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.063420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b598897a-a018-47ba-9451-6234518bf702 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:06.064642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b598897a-a018-47ba-9451-6234518bf702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:06.124880 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4085/8132] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:06.132973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10c1af-22fc-4dc8-890c-7ddcc23d137b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.133294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10c1af-22fc-4dc8-890c-7ddcc23d137b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.133579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10c1af-22fc-4dc8-890c-7ddcc23d137b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.155380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5e10c1af-22fc-4dc8-890c-7ddcc23d137b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:06.156626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5e10c1af-22fc-4dc8-890c-7ddcc23d137b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:06.164765 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4048/8133] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:06.169247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598897a-a018-47ba-9451-6234518bf702 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.179266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598897a-a018-47ba-9451-6234518bf702 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.183754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dacd7-d7e1-4db1-bba9-58cfdbf51575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.184483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dacd7-d7e1-4db1-bba9-58cfdbf51575 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.184760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dacd7-d7e1-4db1-bba9-58cfdbf51575 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.185035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63dacd7-d7e1-4db1-bba9-58cfdbf51575 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.185802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dacd7-d7e1-4db1-bba9-58cfdbf51575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:06.186106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dacd7-d7e1-4db1-bba9-58cfdbf51575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.187696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63dacd7-d7e1-4db1-bba9-58cfdbf51575 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.202845 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4086/8134] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:06.204265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10c1af-22fc-4dc8-890c-7ddcc23d137b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.213571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10c1af-22fc-4dc8-890c-7ddcc23d137b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.218839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65615fc5-cc60-46df-a661-320a52c87b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.219656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65615fc5-cc60-46df-a661-320a52c87b27 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.219966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65615fc5-cc60-46df-a661-320a52c87b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.220343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65615fc5-cc60-46df-a661-320a52c87b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.221056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65615fc5-cc60-46df-a661-320a52c87b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.222967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65615fc5-cc60-46df-a661-320a52c87b27 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.252225 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4049/8135] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:06 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:06.253445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dacd7-d7e1-4db1-bba9-58cfdbf51575 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.264116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63dacd7-d7e1-4db1-bba9-58cfdbf51575 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.318570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5522-4dd8-4286-884d-18be764e88a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.319237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5522-4dd8-4286-884d-18be764e88a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.319550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5522-4dd8-4286-884d-18be764e88a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.319861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c5522-4dd8-4286-884d-18be764e88a6 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.320587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c5522-4dd8-4286-884d-18be764e88a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.322525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c5522-4dd8-4286-884d-18be764e88a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.347074 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4087/8136] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:06 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:06.348349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65615fc5-cc60-46df-a661-320a52c87b27 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.363203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65615fc5-cc60-46df-a661-320a52c87b27 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.368841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cf6eb-9611-4d23-a356-99d232a490f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.369729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cf6eb-9611-4d23-a356-99d232a490f8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.370133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cf6eb-9611-4d23-a356-99d232a490f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.370472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cf6eb-9611-4d23-a356-99d232a490f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.371370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cf6eb-9611-4d23-a356-99d232a490f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.374002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188cf6eb-9611-4d23-a356-99d232a490f8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.385580 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4050/8137] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:06.390531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5522-4dd8-4286-884d-18be764e88a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.401068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c5522-4dd8-4286-884d-18be764e88a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.405607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b6911-d554-4228-9dbe-7761634b7773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.406248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b6911-d554-4228-9dbe-7761634b7773 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.406529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b6911-d554-4228-9dbe-7761634b7773 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.406809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b6911-d554-4228-9dbe-7761634b7773 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.407520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b6911-d554-4228-9dbe-7761634b7773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.409190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b6911-d554-4228-9dbe-7761634b7773 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.419305 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4088/8138] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:17:06.423435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cf6eb-9611-4d23-a356-99d232a490f8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.434903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cf6eb-9611-4d23-a356-99d232a490f8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.439573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c949f2-6abe-417a-905f-b01efe617996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.440488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c949f2-6abe-417a-905f-b01efe617996 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.440774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c949f2-6abe-417a-905f-b01efe617996 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.441053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c949f2-6abe-417a-905f-b01efe617996 admin admin] PATH_INFO: `/v3/projects/e3cc74368da14c17b8749ad17342d1b6/users/9716c2ef0042429cb9f7db6f709c7260/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.455991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c949f2-6abe-417a-905f-b01efe617996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cc74368da14c17b8749ad17342d1b6, user_id=9716c2ef0042429cb9f7db6f709c7260, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.458673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c949f2-6abe-417a-905f-b01efe617996 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.471860 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4051/8139] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:06 2022] PUT /identity/v3/projects/e3cc74368da14c17b8749ad17342d1b6/users/9716c2ef0042429cb9f7db6f709c7260/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:06.482989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3df63-afe2-4d9e-873a-9ada597778e2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.483306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3df63-afe2-4d9e-873a-9ada597778e2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.483615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac3df63-afe2-4d9e-873a-9ada597778e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.512212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9ac3df63-afe2-4d9e-873a-9ada597778e2 None None] MFA Rules not processed for user `9716c2ef0042429cb9f7db6f709c7260`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:06.514219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9ac3df63-afe2-4d9e-873a-9ada597778e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:06.582510 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4089/8140] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:06.584758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c949f2-6abe-417a-905f-b01efe617996 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.646384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c949f2-6abe-417a-905f-b01efe617996 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.652143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314b3e5-84fd-42d3-b84d-1672d7910ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.652808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314b3e5-84fd-42d3-b84d-1672d7910ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.653095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314b3e5-84fd-42d3-b84d-1672d7910ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.653374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314b3e5-84fd-42d3-b84d-1672d7910ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.654064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314b3e5-84fd-42d3-b84d-1672d7910ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.656009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314b3e5-84fd-42d3-b84d-1672d7910ba0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.689088 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4052/8141] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:06 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:06.690402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3df63-afe2-4d9e-873a-9ada597778e2 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.702076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac3df63-afe2-4d9e-873a-9ada597778e2 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.757586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3097-84af-430b-b048-78b2a04723a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.758257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3097-84af-430b-b048-78b2a04723a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.758541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3097-84af-430b-b048-78b2a04723a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.758818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c3097-84af-430b-b048-78b2a04723a7 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.759526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c3097-84af-430b-b048-78b2a04723a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.761472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c3097-84af-430b-b048-78b2a04723a7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.784334 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4090/8142] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:06 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:06.785549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314b3e5-84fd-42d3-b84d-1672d7910ba0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.796972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314b3e5-84fd-42d3-b84d-1672d7910ba0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.805837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b3d5c-7876-4f71-b327-e84419c4be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.806557 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b3d5c-7876-4f71-b327-e84419c4be07 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.806843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b3d5c-7876-4f71-b327-e84419c4be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.807137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b3d5c-7876-4f71-b327-e84419c4be07 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.807877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b3d5c-7876-4f71-b327-e84419c4be07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.810285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b3d5c-7876-4f71-b327-e84419c4be07 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.821699 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4053/8143] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:17:06.825962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3097-84af-430b-b048-78b2a04723a7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.836680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c3097-84af-430b-b048-78b2a04723a7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.841909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9ab3f-56d2-4a77-9c02-d6a578b8c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.842968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9ab3f-56d2-4a77-9c02-d6a578b8c4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.843271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9ab3f-56d2-4a77-9c02-d6a578b8c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.843555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9ab3f-56d2-4a77-9c02-d6a578b8c4fe admin admin] PATH_INFO: `/v3/projects/e7fe6f6e92f34dba85b2606eb2b0c150/users/bd333e672c734f7bbe367b605331548c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.859308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9ab3f-56d2-4a77-9c02-d6a578b8c4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fe6f6e92f34dba85b2606eb2b0c150, user_id=bd333e672c734f7bbe367b605331548c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.862026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9ab3f-56d2-4a77-9c02-d6a578b8c4fe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.875066 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4091/8144] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:06 2022] PUT /identity/v3/projects/e7fe6f6e92f34dba85b2606eb2b0c150/users/bd333e672c734f7bbe367b605331548c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:06.879000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b3d5c-7876-4f71-b327-e84419c4be07 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.889093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b3d5c-7876-4f71-b327-e84419c4be07 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.946941 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ed68e-407b-4343-833d-d565bec7088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.947606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ed68e-407b-4343-833d-d565bec7088d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.947887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ed68e-407b-4343-833d-d565bec7088d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.948195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ed68e-407b-4343-833d-d565bec7088d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.948934 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ed68e-407b-4343-833d-d565bec7088d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.950596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ed68e-407b-4343-833d-d565bec7088d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:06.963142 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4054/8145] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:06.964551 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9ab3f-56d2-4a77-9c02-d6a578b8c4fe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:06.975986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9ab3f-56d2-4a77-9c02-d6a578b8c4fe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:06.983010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beb72a-258b-4e0b-b360-de4b310d3788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:06.983602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beb72a-258b-4e0b-b360-de4b310d3788 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:06.983909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beb72a-258b-4e0b-b360-de4b310d3788 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:06.984298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beb72a-258b-4e0b-b360-de4b310d3788 admin admin] PATH_INFO: `/v3/projects/e7fe6f6e92f34dba85b2606eb2b0c150/users/bd333e672c734f7bbe367b605331548c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:06.986406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25beb72a-258b-4e0b-b360-de4b310d3788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fe6f6e92f34dba85b2606eb2b0c150, user_id=bd333e672c734f7bbe367b605331548c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:06.989219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25beb72a-258b-4e0b-b360-de4b310d3788 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:07.002127 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4092/8146] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:06 2022] PUT /identity/v3/projects/e7fe6f6e92f34dba85b2606eb2b0c150/users/bd333e672c734f7bbe367b605331548c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:07.012888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ed48f-b717-497b-a8dd-f87f8da5bcef None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:07.013207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ed48f-b717-497b-a8dd-f87f8da5bcef None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:07.013453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ed48f-b717-497b-a8dd-f87f8da5bcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:07.047070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-577ed48f-b717-497b-a8dd-f87f8da5bcef None None] MFA Rules not processed for user `bd333e672c734f7bbe367b605331548c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:07.048338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-577ed48f-b717-497b-a8dd-f87f8da5bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:07.122971 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4055/8147] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:07.134831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beb72a-258b-4e0b-b360-de4b310d3788 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:07.136702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-25beb72a-258b-4e0b-b360-de4b310d3788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:07.198153 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beb72a-258b-4e0b-b360-de4b310d3788 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:07.201989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395381e6-da00-4a26-bc98-0e92a1bf36f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:07.202672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395381e6-da00-4a26-bc98-0e92a1bf36f8 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:07.202958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395381e6-da00-4a26-bc98-0e92a1bf36f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:07.203238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395381e6-da00-4a26-bc98-0e92a1bf36f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:07.213080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395381e6-da00-4a26-bc98-0e92a1bf36f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:07.214538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395381e6-da00-4a26-bc98-0e92a1bf36f8 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:07.225157 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4093/8148] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:07.296928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ed48f-b717-497b-a8dd-f87f8da5bcef None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:07.309823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ed48f-b717-497b-a8dd-f87f8da5bcef None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:07.313690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fd2bf0-c4d9-459c-b8c5-1d2d12621d39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:07.314341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd2bf0-c4d9-459c-b8c5-1d2d12621d39 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:07.314624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd2bf0-c4d9-459c-b8c5-1d2d12621d39 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:07.314903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fd2bf0-c4d9-459c-b8c5-1d2d12621d39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:07.370576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd2bf0-c4d9-459c-b8c5-1d2d12621d39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:07.372140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fd2bf0-c4d9-459c-b8c5-1d2d12621d39 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:07.381833 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4056/8149] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:07.638934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395381e6-da00-4a26-bc98-0e92a1bf36f8 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:07.700876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395381e6-da00-4a26-bc98-0e92a1bf36f8 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:07.705443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:07.706245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:07.706601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:07.706882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] PATH_INFO: `/v3/users/9716c2ef0042429cb9f7db6f709c7260` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:07.708170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9716c2ef0042429cb9f7db6f709c7260)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:07.710205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:07.756053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9716c2ef0042429cb9f7db6f709c7260'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:07.763156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9716c2ef0042429cb9f7db6f709c7260'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:07.764006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9716c2ef0042429cb9f7db6f709c7260'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:07.764559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9716c2ef0042429cb9f7db6f709c7260'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:07.771928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9716c2ef0042429cb9f7db6f709c7260'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:07.790175 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4094/8150] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:07 2022] DELETE /identity/v3/users/9716c2ef0042429cb9f7db6f709c7260 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:07.794910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505bb55-f781-4e2d-8377-3e57766533b2 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:07.795321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505bb55-f781-4e2d-8377-3e57766533b2 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:07.795650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505bb55-f781-4e2d-8377-3e57766533b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:07.812789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4505bb55-f781-4e2d-8377-3e57766533b2 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:07.813982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4505bb55-f781-4e2d-8377-3e57766533b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:07.872231 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4057/8151] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:07.881981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:07.883453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:07.944565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1811056-9986-42bb-a85d-1adc36f0c6f8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:07.948179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f95b0b-69bd-42a2-a228-b5643f383be2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:07.948939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f95b0b-69bd-42a2-a228-b5643f383be2 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:07.949226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f95b0b-69bd-42a2-a228-b5643f383be2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:07.949499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f95b0b-69bd-42a2-a228-b5643f383be2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:07.960639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f95b0b-69bd-42a2-a228-b5643f383be2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:07.962089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f95b0b-69bd-42a2-a228-b5643f383be2 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:07.972258 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4095/8152] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:08.243601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505bb55-f781-4e2d-8377-3e57766533b2 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:08.245194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4505bb55-f781-4e2d-8377-3e57766533b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:08.258879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505bb55-f781-4e2d-8377-3e57766533b2 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:08.264311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:08.265179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:08.265466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:08.266281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] PATH_INFO: `/v3/projects/e3cc74368da14c17b8749ad17342d1b6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:08.267510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3cc74368da14c17b8749ad17342d1b6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:08.269852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:08.320391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3cc74368da14c17b8749ad17342d1b6', 'request_id': 'req-24b635e7-0274-4f37-9ffd-15e59e003f08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.328097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3cc74368da14c17b8749ad17342d1b6', 'request_id': 'req-24b635e7-0274-4f37-9ffd-15e59e003f08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.334220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3cc74368da14c17b8749ad17342d1b6', 'request_id': 'req-24b635e7-0274-4f37-9ffd-15e59e003f08'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.345241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] The token cache is being invalidate because project e3cc74368da14c17b8749ad17342d1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:08.345525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.346172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.347691 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4058/8153] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:08 2022] DELETE /identity/v3/projects/e3cc74368da14c17b8749ad17342d1b6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:08.351744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f95b0b-69bd-42a2-a228-b5643f383be2 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:08.361608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f95b0b-69bd-42a2-a228-b5643f383be2 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:08.416789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:08.417654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:08.417933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:08.418204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] PATH_INFO: `/v3/users/bd333e672c734f7bbe367b605331548c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:08.419944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd333e672c734f7bbe367b605331548c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:08.421858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:08.468590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd333e672c734f7bbe367b605331548c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.475385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd333e672c734f7bbe367b605331548c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.476154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd333e672c734f7bbe367b605331548c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.476878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd333e672c734f7bbe367b605331548c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.485760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-305021f5-28e9-45d6-9ea2-1e558a277bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd333e672c734f7bbe367b605331548c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.503828 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4096/8154] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:08 2022] DELETE /identity/v3/users/bd333e672c734f7bbe367b605331548c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:08.784285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:08.785736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:08.805733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b635e7-0274-4f37-9ffd-15e59e003f08 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:08.875101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:08.876061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:08.876350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:08.876629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] PATH_INFO: `/v3/projects/e7fe6f6e92f34dba85b2606eb2b0c150` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:08.877878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fe6f6e92f34dba85b2606eb2b0c150)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:08.879853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:08.927240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fe6f6e92f34dba85b2606eb2b0c150', 'request_id': 'req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.935057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fe6f6e92f34dba85b2606eb2b0c150', 'request_id': 'req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.940888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fe6f6e92f34dba85b2606eb2b0c150', 'request_id': 'req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.952308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] The token cache is being invalidate because project e7fe6f6e92f34dba85b2606eb2b0c150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:08.952784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.953472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-e83dd1bc-7197-4ec6-99b9-79a5def00f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:08.955528 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4059/8155] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:08 2022] DELETE /identity/v3/projects/e7fe6f6e92f34dba85b2606eb2b0c150 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:08.960545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856435f-d49e-41e7-8f81-6c0edb2c6f4f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:08.961009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856435f-d49e-41e7-8f81-6c0edb2c6f4f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:08.961241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856435f-d49e-41e7-8f81-6c0edb2c6f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:08.980966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6856435f-d49e-41e7-8f81-6c0edb2c6f4f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:08.983688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6856435f-d49e-41e7-8f81-6c0edb2c6f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:09.051320 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4097/8156] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:09.059553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497301a-83af-49f4-b70c-d20b75e8e7e4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.059944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497301a-83af-49f4-b70c-d20b75e8e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.060353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497301a-83af-49f4-b70c-d20b75e8e7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.079595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a497301a-83af-49f4-b70c-d20b75e8e7e4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:09.081132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a497301a-83af-49f4-b70c-d20b75e8e7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:09.093373 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4060/8157] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:09.097748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856435f-d49e-41e7-8f81-6c0edb2c6f4f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.107850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856435f-d49e-41e7-8f81-6c0edb2c6f4f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.112405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b546db-3df3-46e4-b776-8727eed03d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.113059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b546db-3df3-46e4-b776-8727eed03d76 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.113344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b546db-3df3-46e4-b776-8727eed03d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.113626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b546db-3df3-46e4-b776-8727eed03d76 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.114347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b546db-3df3-46e4-b776-8727eed03d76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:09.114656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b546db-3df3-46e4-b776-8727eed03d76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.116305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b546db-3df3-46e4-b776-8727eed03d76 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.127902 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4098/8158] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:09.132279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497301a-83af-49f4-b70c-d20b75e8e7e4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.142091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497301a-83af-49f4-b70c-d20b75e8e7e4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.146912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91e2bc-0a8c-4abd-888e-f17866a8e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.147634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91e2bc-0a8c-4abd-888e-f17866a8e460 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.147957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91e2bc-0a8c-4abd-888e-f17866a8e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.148239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91e2bc-0a8c-4abd-888e-f17866a8e460 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.148990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91e2bc-0a8c-4abd-888e-f17866a8e460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.150913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91e2bc-0a8c-4abd-888e-f17866a8e460 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.180294 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4061/8159] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:09 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:09.181488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b546db-3df3-46e4-b776-8727eed03d76 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.191618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b546db-3df3-46e4-b776-8727eed03d76 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.247466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181ef6b-c442-4d49-9068-02b5f34151cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.248158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181ef6b-c442-4d49-9068-02b5f34151cf admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.248444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181ef6b-c442-4d49-9068-02b5f34151cf admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.248719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181ef6b-c442-4d49-9068-02b5f34151cf admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.249421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181ef6b-c442-4d49-9068-02b5f34151cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.251351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181ef6b-c442-4d49-9068-02b5f34151cf admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.271806 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4099/8160] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:09 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:09.276169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91e2bc-0a8c-4abd-888e-f17866a8e460 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.287602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91e2bc-0a8c-4abd-888e-f17866a8e460 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.292744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e5b3a-4ca8-4bec-84fc-e9feb50df893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.293424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e5b3a-4ca8-4bec-84fc-e9feb50df893 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.293736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e5b3a-4ca8-4bec-84fc-e9feb50df893 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.294016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e5b3a-4ca8-4bec-84fc-e9feb50df893 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.294930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e5b3a-4ca8-4bec-84fc-e9feb50df893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.296582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e5b3a-4ca8-4bec-84fc-e9feb50df893 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.307230 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4062/8161] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:09.311338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181ef6b-c442-4d49-9068-02b5f34151cf admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.321614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181ef6b-c442-4d49-9068-02b5f34151cf admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.326973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8eac3-4c16-4a70-bebd-6c8808200d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.327731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8eac3-4c16-4a70-bebd-6c8808200d8e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.328052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8eac3-4c16-4a70-bebd-6c8808200d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.328346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8eac3-4c16-4a70-bebd-6c8808200d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.329044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8eac3-4c16-4a70-bebd-6c8808200d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.330635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8eac3-4c16-4a70-bebd-6c8808200d8e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.342316 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4100/8162] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:17:09.346531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e5b3a-4ca8-4bec-84fc-e9feb50df893 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.356638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e5b3a-4ca8-4bec-84fc-e9feb50df893 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.361302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5d39c-9cff-4153-ab58-4d7ee1d1de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.362179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5d39c-9cff-4153-ab58-4d7ee1d1de57 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.362461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5d39c-9cff-4153-ab58-4d7ee1d1de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.362792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5d39c-9cff-4153-ab58-4d7ee1d1de57 admin admin] PATH_INFO: `/v3/projects/8186063bcad64e01aaac232da670fcb2/users/4c2951d0babd4eb2a318f9f847477f71/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.377783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5d39c-9cff-4153-ab58-4d7ee1d1de57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8186063bcad64e01aaac232da670fcb2, user_id=4c2951d0babd4eb2a318f9f847477f71, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.380487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5d39c-9cff-4153-ab58-4d7ee1d1de57 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.394492 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4063/8163] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:09 2022] PUT /identity/v3/projects/8186063bcad64e01aaac232da670fcb2/users/4c2951d0babd4eb2a318f9f847477f71/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:09.405737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396f18c-860c-46ef-86cb-d175d9d35b11 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.406022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396f18c-860c-46ef-86cb-d175d9d35b11 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.406295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396f18c-860c-46ef-86cb-d175d9d35b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.432452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9396f18c-860c-46ef-86cb-d175d9d35b11 None None] MFA Rules not processed for user `4c2951d0babd4eb2a318f9f847477f71`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:09.433677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9396f18c-860c-46ef-86cb-d175d9d35b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:09.496369 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4101/8164] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:09.501526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5d39c-9cff-4153-ab58-4d7ee1d1de57 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.561150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5d39c-9cff-4153-ab58-4d7ee1d1de57 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.566015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49a87-0fb4-40f5-ac4e-9805afa7517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.566670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49a87-0fb4-40f5-ac4e-9805afa7517a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.566951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49a87-0fb4-40f5-ac4e-9805afa7517a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.567225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c49a87-0fb4-40f5-ac4e-9805afa7517a admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.567933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c49a87-0fb4-40f5-ac4e-9805afa7517a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.569865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c49a87-0fb4-40f5-ac4e-9805afa7517a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.595932 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4064/8165] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:09 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:09.600058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396f18c-860c-46ef-86cb-d175d9d35b11 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.610951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396f18c-860c-46ef-86cb-d175d9d35b11 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.676564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992e0d0-619c-4fb9-9445-f82368f76751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.677488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992e0d0-619c-4fb9-9445-f82368f76751 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.677769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992e0d0-619c-4fb9-9445-f82368f76751 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.678050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7992e0d0-619c-4fb9-9445-f82368f76751 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.678739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992e0d0-619c-4fb9-9445-f82368f76751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.680700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7992e0d0-619c-4fb9-9445-f82368f76751 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.701284 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4102/8166] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:09 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:09.705391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49a87-0fb4-40f5-ac4e-9805afa7517a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.716455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c49a87-0fb4-40f5-ac4e-9805afa7517a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.722180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d434-b697-448b-9370-d83b8d3220ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.723242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d434-b697-448b-9370-d83b8d3220ba admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.723721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d434-b697-448b-9370-d83b8d3220ba admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.724265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85d434-b697-448b-9370-d83b8d3220ba admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.725212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85d434-b697-448b-9370-d83b8d3220ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.726900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85d434-b697-448b-9370-d83b8d3220ba admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.739003 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4065/8167] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:09.743222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992e0d0-619c-4fb9-9445-f82368f76751 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.753412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7992e0d0-619c-4fb9-9445-f82368f76751 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.758174 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd814749-155c-4cd7-bb8f-64304d77acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.759041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd814749-155c-4cd7-bb8f-64304d77acbd admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.759327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd814749-155c-4cd7-bb8f-64304d77acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.759608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd814749-155c-4cd7-bb8f-64304d77acbd admin admin] PATH_INFO: `/v3/projects/6e2bbda0e5c24923b883105ba9ffe33d/users/d674ef49734e40858b2832a07730d31c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.774613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd814749-155c-4cd7-bb8f-64304d77acbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2bbda0e5c24923b883105ba9ffe33d, user_id=d674ef49734e40858b2832a07730d31c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.777332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd814749-155c-4cd7-bb8f-64304d77acbd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.791007 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4103/8168] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:09 2022] PUT /identity/v3/projects/6e2bbda0e5c24923b883105ba9ffe33d/users/d674ef49734e40858b2832a07730d31c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:09.795169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d434-b697-448b-9370-d83b8d3220ba admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.805856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85d434-b697-448b-9370-d83b8d3220ba admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.868019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11120c8e-ca2b-4d16-adc5-02090c91a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.868842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120c8e-ca2b-4d16-adc5-02090c91a21d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.869136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120c8e-ca2b-4d16-adc5-02090c91a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.869418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11120c8e-ca2b-4d16-adc5-02090c91a21d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.870141 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11120c8e-ca2b-4d16-adc5-02090c91a21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.871828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11120c8e-ca2b-4d16-adc5-02090c91a21d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.882724 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4066/8169] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:09.888054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd814749-155c-4cd7-bb8f-64304d77acbd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:09.899009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd814749-155c-4cd7-bb8f-64304d77acbd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:09.904322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875507-86ef-4a50-86e9-bab862673733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:09.905299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875507-86ef-4a50-86e9-bab862673733 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.905647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875507-86ef-4a50-86e9-bab862673733 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.905985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875507-86ef-4a50-86e9-bab862673733 admin admin] PATH_INFO: `/v3/projects/6e2bbda0e5c24923b883105ba9ffe33d/users/d674ef49734e40858b2832a07730d31c/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.908057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae875507-86ef-4a50-86e9-bab862673733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2bbda0e5c24923b883105ba9ffe33d, user_id=d674ef49734e40858b2832a07730d31c, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:09.910764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae875507-86ef-4a50-86e9-bab862673733 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:09.921882 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4104/8170] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:09 2022] PUT /identity/v3/projects/6e2bbda0e5c24923b883105ba9ffe33d/users/d674ef49734e40858b2832a07730d31c/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:09.932477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0625-c21c-4e3a-a234-a41af4825e6a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:09.932769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0625-c21c-4e3a-a234-a41af4825e6a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:09.933048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0625-c21c-4e3a-a234-a41af4825e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:09.961111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-388a0625-c21c-4e3a-a234-a41af4825e6a None None] MFA Rules not processed for user `d674ef49734e40858b2832a07730d31c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:09.962318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-388a0625-c21c-4e3a-a234-a41af4825e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:10.037739 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4067/8171] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:10.049853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875507-86ef-4a50-86e9-bab862673733 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:10.051856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ae875507-86ef-4a50-86e9-bab862673733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:10.113054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875507-86ef-4a50-86e9-bab862673733 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:10.116748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdabd8-7ead-47be-9a47-f191e988952d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:10.117389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdabd8-7ead-47be-9a47-f191e988952d service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:10.118420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdabd8-7ead-47be-9a47-f191e988952d service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:10.118710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdabd8-7ead-47be-9a47-f191e988952d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:10.173426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdabd8-7ead-47be-9a47-f191e988952d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:10.174877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdabd8-7ead-47be-9a47-f191e988952d service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:10.184753 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4105/8172] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:14.796038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0625-c21c-4e3a-a234-a41af4825e6a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:14.797513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-388a0625-c21c-4e3a-a234-a41af4825e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:14.811362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0625-c21c-4e3a-a234-a41af4825e6a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:14.815117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25960deb-6a50-443b-b0c2-77ce702a3a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:14.815939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25960deb-6a50-443b-b0c2-77ce702a3a22 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:14.816258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25960deb-6a50-443b-b0c2-77ce702a3a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:14.816533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25960deb-6a50-443b-b0c2-77ce702a3a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:14.825898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25960deb-6a50-443b-b0c2-77ce702a3a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:14.827339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25960deb-6a50-443b-b0c2-77ce702a3a22 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:14.836802 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4068/8173] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:16.106170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdabd8-7ead-47be-9a47-f191e988952d service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:16.108259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b0fdabd8-7ead-47be-9a47-f191e988952d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:16.209278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdabd8-7ead-47be-9a47-f191e988952d service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:16.214395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226de8e-10d4-4574-b0e5-32c1f5caab10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:16.215541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226de8e-10d4-4574-b0e5-32c1f5caab10 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:16.215833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226de8e-10d4-4574-b0e5-32c1f5caab10 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:16.216137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226de8e-10d4-4574-b0e5-32c1f5caab10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:16.217873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3226de8e-10d4-4574-b0e5-32c1f5caab10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:16.232715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226de8e-10d4-4574-b0e5-32c1f5caab10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:16.234234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226de8e-10d4-4574-b0e5-32c1f5caab10 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:16.247986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4106/8174] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:17.096292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25960deb-6a50-443b-b0c2-77ce702a3a22 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:17.097773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-25960deb-6a50-443b-b0c2-77ce702a3a22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:17.161371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25960deb-6a50-443b-b0c2-77ce702a3a22 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:17.166658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:17.167558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:17.167839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:17.168161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] PATH_INFO: `/v3/users/99a35b27367a4fa6a92d61e2f8e41134` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:17.169344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99a35b27367a4fa6a92d61e2f8e41134)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:17.171361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:17.216328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99a35b27367a4fa6a92d61e2f8e41134'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.223166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99a35b27367a4fa6a92d61e2f8e41134'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.223796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99a35b27367a4fa6a92d61e2f8e41134'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.224438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99a35b27367a4fa6a92d61e2f8e41134'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.236373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99a35b27367a4fa6a92d61e2f8e41134'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.248588 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4069/8175] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:17 2022] DELETE /identity/v3/users/99a35b27367a4fa6a92d61e2f8e41134 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:17.253023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411017ef-cb83-4a7d-b150-9e304ca87107 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:17.253474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411017ef-cb83-4a7d-b150-9e304ca87107 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:17.253560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411017ef-cb83-4a7d-b150-9e304ca87107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:17.271518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-411017ef-cb83-4a7d-b150-9e304ca87107 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:17.272733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-411017ef-cb83-4a7d-b150-9e304ca87107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:17.327897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4107/8176] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:17.337568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:17.338947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:17.398963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b0713-ec31-4921-beec-892b19185c95 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:17.404788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a688c1-efec-4a4c-b598-af2618990d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:17.405448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a688c1-efec-4a4c-b598-af2618990d1a service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:17.405731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a688c1-efec-4a4c-b598-af2618990d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:17.406007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a688c1-efec-4a4c-b598-af2618990d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:17.418857 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a688c1-efec-4a4c-b598-af2618990d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:17.420365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a688c1-efec-4a4c-b598-af2618990d1a service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:17.430862 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4070/8177] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:17.704610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411017ef-cb83-4a7d-b150-9e304ca87107 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:17.707008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-411017ef-cb83-4a7d-b150-9e304ca87107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:17.720459 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411017ef-cb83-4a7d-b150-9e304ca87107 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:17.725248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:17.726186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:17.726547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:17.726951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] PATH_INFO: `/v3/projects/3e8108ff8ea6449b8a6582f0f6722461` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:17.728244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8108ff8ea6449b8a6582f0f6722461)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:17.730268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:17.782586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8108ff8ea6449b8a6582f0f6722461', 'request_id': 'req-f307149e-a714-4d42-b657-565a3a317fcd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.789995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8108ff8ea6449b8a6582f0f6722461', 'request_id': 'req-f307149e-a714-4d42-b657-565a3a317fcd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.798520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8108ff8ea6449b8a6582f0f6722461', 'request_id': 'req-f307149e-a714-4d42-b657-565a3a317fcd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.809979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] The token cache is being invalidate because project 3e8108ff8ea6449b8a6582f0f6722461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:17.810346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.811084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.812753 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4108/8178] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:17 2022] DELETE /identity/v3/projects/3e8108ff8ea6449b8a6582f0f6722461 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:17.816719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a688c1-efec-4a4c-b598-af2618990d1a service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:17.826638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a688c1-efec-4a4c-b598-af2618990d1a service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:17.880479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:17.881349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:17.881634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:17.881908 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] PATH_INFO: `/v3/users/f60f7b23b1bf42ad99641295297cc5d0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:17.883070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60f7b23b1bf42ad99641295297cc5d0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:17.885018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:17.930867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60f7b23b1bf42ad99641295297cc5d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.937988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60f7b23b1bf42ad99641295297cc5d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.938612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60f7b23b1bf42ad99641295297cc5d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.939235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60f7b23b1bf42ad99641295297cc5d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.950740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-dd753633-636c-4c08-abf3-94bc3920f31b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60f7b23b1bf42ad99641295297cc5d0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:17.963149 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4071/8179] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:17 2022] DELETE /identity/v3/users/f60f7b23b1bf42ad99641295297cc5d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:18.145369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:18.146883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:18.162207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307149e-a714-4d42-b657-565a3a317fcd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:18.223613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:18.224508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.224790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.225069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] PATH_INFO: `/v3/projects/2173af40073f4cc58a6ddb6cfaab7373` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.226236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2173af40073f4cc58a6ddb6cfaab7373)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:18.228224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:18.278487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2173af40073f4cc58a6ddb6cfaab7373', 'request_id': 'req-f475df25-c42d-4d74-b9b3-470ee9db7718'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:18.285953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2173af40073f4cc58a6ddb6cfaab7373', 'request_id': 'req-f475df25-c42d-4d74-b9b3-470ee9db7718'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:18.292183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2173af40073f4cc58a6ddb6cfaab7373', 'request_id': 'req-f475df25-c42d-4d74-b9b3-470ee9db7718'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:18.304740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] The token cache is being invalidate because project 2173af40073f4cc58a6ddb6cfaab7373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:18.305029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:18.305686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-f475df25-c42d-4d74-b9b3-470ee9db7718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:18.307212 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4109/8180] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:18 2022] DELETE /identity/v3/projects/2173af40073f4cc58a6ddb6cfaab7373 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:18.312814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785fb3e-80f1-44ad-9d77-0ac3f127bfc3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.313294 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785fb3e-80f1-44ad-9d77-0ac3f127bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.313369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8785fb3e-80f1-44ad-9d77-0ac3f127bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.331831 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8785fb3e-80f1-44ad-9d77-0ac3f127bfc3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:18.333093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8785fb3e-80f1-44ad-9d77-0ac3f127bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:18.396695 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4072/8181] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:18.405293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9e479-279f-4170-be77-6d7c9c5f2639 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.405881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9e479-279f-4170-be77-6d7c9c5f2639 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.406274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9e479-279f-4170-be77-6d7c9c5f2639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.425498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-39a9e479-279f-4170-be77-6d7c9c5f2639 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:18.427047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-39a9e479-279f-4170-be77-6d7c9c5f2639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:18.435168 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4110/8182] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:18.441727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785fb3e-80f1-44ad-9d77-0ac3f127bfc3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:18.464210 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8785fb3e-80f1-44ad-9d77-0ac3f127bfc3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:18.472309 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5859937-a539-4a0f-946d-4804412db4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:18.473327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5859937-a539-4a0f-946d-4804412db4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.473801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5859937-a539-4a0f-946d-4804412db4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.474635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5859937-a539-4a0f-946d-4804412db4d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.476151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5859937-a539-4a0f-946d-4804412db4d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:18.476630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5859937-a539-4a0f-946d-4804412db4d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:18.478770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5859937-a539-4a0f-946d-4804412db4d4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:18.493785 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4073/8183] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:18.498298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9e479-279f-4170-be77-6d7c9c5f2639 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:18.509441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9e479-279f-4170-be77-6d7c9c5f2639 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:18.516549 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5777a-d832-47d4-a8ce-bc43b36b1c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:18.517175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5777a-d832-47d4-a8ce-bc43b36b1c5d admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.517461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5777a-d832-47d4-a8ce-bc43b36b1c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.517745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5777a-d832-47d4-a8ce-bc43b36b1c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.518489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5777a-d832-47d4-a8ce-bc43b36b1c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:18.520569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5777a-d832-47d4-a8ce-bc43b36b1c5d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:18.546091 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4111/8184] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:18 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:18.550337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5859937-a539-4a0f-946d-4804412db4d4 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:18.560641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5859937-a539-4a0f-946d-4804412db4d4 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:18.614871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8d53-06b3-46c3-9070-f316101adf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:18.615535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8d53-06b3-46c3-9070-f316101adf2a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.615824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8d53-06b3-46c3-9070-f316101adf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.616136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e8d53-06b3-46c3-9070-f316101adf2a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.616827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e8d53-06b3-46c3-9070-f316101adf2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:18.618798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e8d53-06b3-46c3-9070-f316101adf2a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:18.638338 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4074/8185] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:18 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:18.642352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5777a-d832-47d4-a8ce-bc43b36b1c5d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:18.652909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5777a-d832-47d4-a8ce-bc43b36b1c5d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:18.657403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e938bc3-c24a-4171-bd12-fd37ebefb64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:18.658070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e938bc3-c24a-4171-bd12-fd37ebefb64e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.658362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e938bc3-c24a-4171-bd12-fd37ebefb64e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.658634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e938bc3-c24a-4171-bd12-fd37ebefb64e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.659342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e938bc3-c24a-4171-bd12-fd37ebefb64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:18.660979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e938bc3-c24a-4171-bd12-fd37ebefb64e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:18.671563 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4112/8186] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:18.675250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8d53-06b3-46c3-9070-f316101adf2a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:18.685380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e8d53-06b3-46c3-9070-f316101adf2a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:18.690106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f19d81-2bec-4142-8ca3-a09cfd768da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:18.690753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f19d81-2bec-4142-8ca3-a09cfd768da7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.691036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f19d81-2bec-4142-8ca3-a09cfd768da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.691314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f19d81-2bec-4142-8ca3-a09cfd768da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.692091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f19d81-2bec-4142-8ca3-a09cfd768da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:18.693685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f19d81-2bec-4142-8ca3-a09cfd768da7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:18.703373 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4075/8187] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:18.707325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e938bc3-c24a-4171-bd12-fd37ebefb64e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:18.717893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e938bc3-c24a-4171-bd12-fd37ebefb64e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:18.722438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535bc4b-051d-416e-9984-bc36e576b155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:18.723298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535bc4b-051d-416e-9984-bc36e576b155 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.723582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535bc4b-051d-416e-9984-bc36e576b155 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.723862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535bc4b-051d-416e-9984-bc36e576b155 admin admin] PATH_INFO: `/v3/projects/19d2a05968e646edb3abd35705e38343/users/54920fad6ed74b33bfc9012bf2f1d462/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.738348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535bc4b-051d-416e-9984-bc36e576b155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d2a05968e646edb3abd35705e38343, user_id=54920fad6ed74b33bfc9012bf2f1d462, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:18.741060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535bc4b-051d-416e-9984-bc36e576b155 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:18.753880 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4113/8188] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:18 2022] PUT /identity/v3/projects/19d2a05968e646edb3abd35705e38343/users/54920fad6ed74b33bfc9012bf2f1d462/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:18.764825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02c40e-649b-4177-83ff-c23a13507db6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.765125 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02c40e-649b-4177-83ff-c23a13507db6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.765520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02c40e-649b-4177-83ff-c23a13507db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.792386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2c02c40e-649b-4177-83ff-c23a13507db6 None None] MFA Rules not processed for user `54920fad6ed74b33bfc9012bf2f1d462`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:18.793586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2c02c40e-649b-4177-83ff-c23a13507db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:18.855695 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4076/8189] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:18.860481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535bc4b-051d-416e-9984-bc36e576b155 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:18.918871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535bc4b-051d-416e-9984-bc36e576b155 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:18.923448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abbaf-400a-415b-a9db-7c9bf08ee14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:18.924122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abbaf-400a-415b-a9db-7c9bf08ee14c admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:18.924403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abbaf-400a-415b-a9db-7c9bf08ee14c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:18.924678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6abbaf-400a-415b-a9db-7c9bf08ee14c admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:18.925357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6abbaf-400a-415b-a9db-7c9bf08ee14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:18.927496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6abbaf-400a-415b-a9db-7c9bf08ee14c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:18.952495 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4114/8190] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:18 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:18.956480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02c40e-649b-4177-83ff-c23a13507db6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:18.968005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02c40e-649b-4177-83ff-c23a13507db6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:19.025955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8478-e5d1-491d-8941-27d89324fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:19.026619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8478-e5d1-491d-8941-27d89324fc0a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:19.026905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8478-e5d1-491d-8941-27d89324fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:19.027178 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8478-e5d1-491d-8941-27d89324fc0a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:19.028488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8478-e5d1-491d-8941-27d89324fc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:19.030407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d8478-e5d1-491d-8941-27d89324fc0a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:19.052961 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4077/8191] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:18 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:19.054212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abbaf-400a-415b-a9db-7c9bf08ee14c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:19.066213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6abbaf-400a-415b-a9db-7c9bf08ee14c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:19.070945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d8418-2609-4739-920c-c9ab46ca089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:19.071595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8418-2609-4739-920c-c9ab46ca089d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:19.071876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8418-2609-4739-920c-c9ab46ca089d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:19.072185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d8418-2609-4739-920c-c9ab46ca089d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:19.072903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d8418-2609-4739-920c-c9ab46ca089d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:19.075046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d8418-2609-4739-920c-c9ab46ca089d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:19.087992 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4115/8192] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:19.090841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d8418-2609-4739-920c-c9ab46ca089d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:19.091113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8478-e5d1-491d-8941-27d89324fc0a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:19.092787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3d9d8478-e5d1-491d-8941-27d89324fc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:19.100673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d8418-2609-4739-920c-c9ab46ca089d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:19.105383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e15d7-5e94-4df7-b652-a94d9784bda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:19.106441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e15d7-5e94-4df7-b652-a94d9784bda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:19.106730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e15d7-5e94-4df7-b652-a94d9784bda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:19.107011 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e15d7-5e94-4df7-b652-a94d9784bda4 admin admin] PATH_INFO: `/v3/projects/bb6081eacc364b6b816d255ea86c66a2/users/12b8756e82d34d1ebc5a7a5807dd894f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:19.121909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e15d7-5e94-4df7-b652-a94d9784bda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6081eacc364b6b816d255ea86c66a2, user_id=12b8756e82d34d1ebc5a7a5807dd894f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:19.124607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e15d7-5e94-4df7-b652-a94d9784bda4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:19.139205 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4116/8193] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:19 2022] PUT /identity/v3/projects/bb6081eacc364b6b816d255ea86c66a2/users/12b8756e82d34d1ebc5a7a5807dd894f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:19.142776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e15d7-5e94-4df7-b652-a94d9784bda4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:19.165549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8478-e5d1-491d-8941-27d89324fc0a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:19.211825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e15d7-5e94-4df7-b652-a94d9784bda4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:19.217126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863159b-db71-4f15-9a10-626d0953b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:19.217867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863159b-db71-4f15-9a10-626d0953b3da admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:19.218320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863159b-db71-4f15-9a10-626d0953b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:19.218762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863159b-db71-4f15-9a10-626d0953b3da admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:19.219394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863159b-db71-4f15-9a10-626d0953b3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:19.221046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863159b-db71-4f15-9a10-626d0953b3da admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:19.232671 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4117/8194] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:17:19.234910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4976b7e5-0f23-4389-89c1-849182612a94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:19.235888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b7e5-0f23-4389-89c1-849182612a94 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:19.236354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b7e5-0f23-4389-89c1-849182612a94 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:19.236681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863159b-db71-4f15-9a10-626d0953b3da admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:19.236971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976b7e5-0f23-4389-89c1-849182612a94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:19.239029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4976b7e5-0f23-4389-89c1-849182612a94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:19.248466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863159b-db71-4f15-9a10-626d0953b3da admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:19.254530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7520c-f6d6-45a2-be92-e6ccfbf40ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:19.255417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7520c-f6d6-45a2-be92-e6ccfbf40ada admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:19.255692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7520c-f6d6-45a2-be92-e6ccfbf40ada admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:19.255992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7520c-f6d6-45a2-be92-e6ccfbf40ada admin admin] PATH_INFO: `/v3/projects/bb6081eacc364b6b816d255ea86c66a2/users/12b8756e82d34d1ebc5a7a5807dd894f/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:19.256451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976b7e5-0f23-4389-89c1-849182612a94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:19.257987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7520c-f6d6-45a2-be92-e6ccfbf40ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6081eacc364b6b816d255ea86c66a2, user_id=12b8756e82d34d1ebc5a7a5807dd894f, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:19.258209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4976b7e5-0f23-4389-89c1-849182612a94 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:19.260657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7520c-f6d6-45a2-be92-e6ccfbf40ada admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:19.272237 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4078/8195] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:19.272600 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4118/8196] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:19 2022] PUT /identity/v3/projects/bb6081eacc364b6b816d255ea86c66a2/users/12b8756e82d34d1ebc5a7a5807dd894f/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:19.283786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16c55a-e8d2-48f5-a625-7b444bbc8a4e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:19.284061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16c55a-e8d2-48f5-a625-7b444bbc8a4e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:19.284430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16c55a-e8d2-48f5-a625-7b444bbc8a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:19.313752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9a16c55a-e8d2-48f5-a625-7b444bbc8a4e None None] MFA Rules not processed for user `12b8756e82d34d1ebc5a7a5807dd894f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:19.314963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9a16c55a-e8d2-48f5-a625-7b444bbc8a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:19.392704 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4079/8197] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:19.405589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7520c-f6d6-45a2-be92-e6ccfbf40ada admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:19.407713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4bc7520c-f6d6-45a2-be92-e6ccfbf40ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:19.470242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7520c-f6d6-45a2-be92-e6ccfbf40ada admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:19.473788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abee64-eb15-4571-b611-d3f9d2a6d9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:19.474422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abee64-eb15-4571-b611-d3f9d2a6d9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:19.474707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abee64-eb15-4571-b611-d3f9d2a6d9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:19.474987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abee64-eb15-4571-b611-d3f9d2a6d9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:19.484333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abee64-eb15-4571-b611-d3f9d2a6d9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:19.485735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abee64-eb15-4571-b611-d3f9d2a6d9a9 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:19.495229 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4119/8198] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:17:21.310085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16c55a-e8d2-48f5-a625-7b444bbc8a4e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:21.377081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16c55a-e8d2-48f5-a625-7b444bbc8a4e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:21.381850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:21.383639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:21.383990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:21.384476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] PATH_INFO: `/v3/users/54920fad6ed74b33bfc9012bf2f1d462` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:21.385921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54920fad6ed74b33bfc9012bf2f1d462)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:21.388364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:21.441744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54920fad6ed74b33bfc9012bf2f1d462'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:21.450188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54920fad6ed74b33bfc9012bf2f1d462'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:21.451035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54920fad6ed74b33bfc9012bf2f1d462'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:21.452019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54920fad6ed74b33bfc9012bf2f1d462'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:21.463711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54920fad6ed74b33bfc9012bf2f1d462'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:21.477644 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4080/8199] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:21 2022] DELETE /identity/v3/users/54920fad6ed74b33bfc9012bf2f1d462 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:21.483606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1ca8-4f4d-410f-911e-60f6a2d49711 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:21.484101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1ca8-4f4d-410f-911e-60f6a2d49711 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:21.484218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1ca8-4f4d-410f-911e-60f6a2d49711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:21.502906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-276c1ca8-4f4d-410f-911e-60f6a2d49711 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:21.504185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-276c1ca8-4f4d-410f-911e-60f6a2d49711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:21.565261 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4120/8200] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:21.574971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:21.576529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:21.635062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429820e-cd9f-4f22-a9a2-b5f641548b57 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:21.638950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa7e39-59d4-43f0-8a8e-89c2fe46cebe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:21.639583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa7e39-59d4-43f0-8a8e-89c2fe46cebe service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:21.639865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa7e39-59d4-43f0-8a8e-89c2fe46cebe service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:21.640168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa7e39-59d4-43f0-8a8e-89c2fe46cebe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:21.649096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa7e39-59d4-43f0-8a8e-89c2fe46cebe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:21.650539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa7e39-59d4-43f0-8a8e-89c2fe46cebe service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:21.660272 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4081/8201] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:21.951278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c1ca8-4f4d-410f-911e-60f6a2d49711 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:21.952699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-276c1ca8-4f4d-410f-911e-60f6a2d49711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:21.970207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c1ca8-4f4d-410f-911e-60f6a2d49711 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:21.983233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:21.984482 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:21.984892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:21.985251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] PATH_INFO: `/v3/projects/19d2a05968e646edb3abd35705e38343` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:21.993156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d2a05968e646edb3abd35705e38343)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:21.995321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:22.052826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d2a05968e646edb3abd35705e38343', 'request_id': 'req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.061657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d2a05968e646edb3abd35705e38343', 'request_id': 'req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.067132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d2a05968e646edb3abd35705e38343', 'request_id': 'req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.078632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] The token cache is being invalidate because project 19d2a05968e646edb3abd35705e38343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:22.078918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.079825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.081494 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4121/8202] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:21 2022] DELETE /identity/v3/projects/19d2a05968e646edb3abd35705e38343 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:22.085515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa7e39-59d4-43f0-8a8e-89c2fe46cebe service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:22.097534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa7e39-59d4-43f0-8a8e-89c2fe46cebe service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:22.156426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:22.157194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:22.157476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:22.157747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] PATH_INFO: `/v3/users/12b8756e82d34d1ebc5a7a5807dd894f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:22.159267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b8756e82d34d1ebc5a7a5807dd894f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:22.160903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:22.213378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b8756e82d34d1ebc5a7a5807dd894f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.225412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b8756e82d34d1ebc5a7a5807dd894f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.226510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b8756e82d34d1ebc5a7a5807dd894f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.227358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b8756e82d34d1ebc5a7a5807dd894f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.242928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b1fc7387-8640-4d57-930d-e1fe4fe25e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b8756e82d34d1ebc5a7a5807dd894f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.258695 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4082/8203] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:22 2022] DELETE /identity/v3/users/12b8756e82d34d1ebc5a7a5807dd894f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:22.586305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:22.588026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:22.601984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dde3a-32d1-4cc6-a34a-f8b1de31dd84 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:22.658237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:22.659094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:22.659378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:22.659658 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] PATH_INFO: `/v3/projects/bb6081eacc364b6b816d255ea86c66a2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:22.660869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6081eacc364b6b816d255ea86c66a2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:22.662773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:22.707170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6081eacc364b6b816d255ea86c66a2', 'request_id': 'req-99c60727-b48d-4d49-bada-21538dd2821f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.714206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6081eacc364b6b816d255ea86c66a2', 'request_id': 'req-99c60727-b48d-4d49-bada-21538dd2821f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.719556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6081eacc364b6b816d255ea86c66a2', 'request_id': 'req-99c60727-b48d-4d49-bada-21538dd2821f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.730119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] The token cache is being invalidate because project bb6081eacc364b6b816d255ea86c66a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:22.730929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.731570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-99c60727-b48d-4d49-bada-21538dd2821f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:22.733294 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4122/8204] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:22 2022] DELETE /identity/v3/projects/bb6081eacc364b6b816d255ea86c66a2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:22.738061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e68a-6b26-4569-97e1-3cbd3cbe5ad3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:22.738523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e68a-6b26-4569-97e1-3cbd3cbe5ad3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:22.738611 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f0e68a-6b26-4569-97e1-3cbd3cbe5ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:22.756465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-49f0e68a-6b26-4569-97e1-3cbd3cbe5ad3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:22.757676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49f0e68a-6b26-4569-97e1-3cbd3cbe5ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:22.815455 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4083/8205] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:22.823333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760008c-a5a6-4a52-a966-118bda0d9423 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:22.823627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760008c-a5a6-4a52-a966-118bda0d9423 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:22.823938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760008c-a5a6-4a52-a966-118bda0d9423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:22.842026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9760008c-a5a6-4a52-a966-118bda0d9423 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:22.843318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9760008c-a5a6-4a52-a966-118bda0d9423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:22.851722 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4123/8206] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:22.856401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e68a-6b26-4569-97e1-3cbd3cbe5ad3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:22.865965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f0e68a-6b26-4569-97e1-3cbd3cbe5ad3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:22.870528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa7dc-3f16-4673-9f12-8b91ddc984a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:22.871773 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa7dc-3f16-4673-9f12-8b91ddc984a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:22.872095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa7dc-3f16-4673-9f12-8b91ddc984a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:22.872376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efa7dc-3f16-4673-9f12-8b91ddc984a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:22.873093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efa7dc-3f16-4673-9f12-8b91ddc984a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:22.873405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efa7dc-3f16-4673-9f12-8b91ddc984a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:22.875017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efa7dc-3f16-4673-9f12-8b91ddc984a0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:22.886138 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4084/8207] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:22.890203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760008c-a5a6-4a52-a966-118bda0d9423 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:22.899434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760008c-a5a6-4a52-a966-118bda0d9423 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:22.904743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e35a4-8c1b-4308-8fd2-cf3699d1eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:22.905381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e35a4-8c1b-4308-8fd2-cf3699d1eb46 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:22.905679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e35a4-8c1b-4308-8fd2-cf3699d1eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:22.905938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e35a4-8c1b-4308-8fd2-cf3699d1eb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:22.906618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e35a4-8c1b-4308-8fd2-cf3699d1eb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:22.908593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e35a4-8c1b-4308-8fd2-cf3699d1eb46 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:22.935398 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4124/8208] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:22 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:22.939346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa7dc-3f16-4673-9f12-8b91ddc984a0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:22.949333 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efa7dc-3f16-4673-9f12-8b91ddc984a0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:23.008021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1096ea2-f1f6-4ab2-ae7a-6f1f98c2a72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:23.008698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096ea2-f1f6-4ab2-ae7a-6f1f98c2a72f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:23.008988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096ea2-f1f6-4ab2-ae7a-6f1f98c2a72f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:23.009265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1096ea2-f1f6-4ab2-ae7a-6f1f98c2a72f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:23.009999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1096ea2-f1f6-4ab2-ae7a-6f1f98c2a72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:23.011970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1096ea2-f1f6-4ab2-ae7a-6f1f98c2a72f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:23.033921 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4085/8209] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:22 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:23.038583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e35a4-8c1b-4308-8fd2-cf3699d1eb46 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:23.049423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e35a4-8c1b-4308-8fd2-cf3699d1eb46 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:23.054310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10827e07-2772-4f49-99a8-3ee5e5e69839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:23.054955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10827e07-2772-4f49-99a8-3ee5e5e69839 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:23.055357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10827e07-2772-4f49-99a8-3ee5e5e69839 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:23.055646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10827e07-2772-4f49-99a8-3ee5e5e69839 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:23.056406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10827e07-2772-4f49-99a8-3ee5e5e69839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:23.058015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10827e07-2772-4f49-99a8-3ee5e5e69839 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:23.068358 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4125/8210] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:23.072179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1096ea2-f1f6-4ab2-ae7a-6f1f98c2a72f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:23.081873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1096ea2-f1f6-4ab2-ae7a-6f1f98c2a72f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:23.086531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a68f84-3b13-40ea-8cdf-7f4d525424ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:23.087165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68f84-3b13-40ea-8cdf-7f4d525424ac admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:23.087449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68f84-3b13-40ea-8cdf-7f4d525424ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:23.087725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68f84-3b13-40ea-8cdf-7f4d525424ac admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:23.088476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a68f84-3b13-40ea-8cdf-7f4d525424ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:23.090556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a68f84-3b13-40ea-8cdf-7f4d525424ac admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:23.100782 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4086/8211] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:23.104701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10827e07-2772-4f49-99a8-3ee5e5e69839 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:23.114885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10827e07-2772-4f49-99a8-3ee5e5e69839 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:23.119443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60bd1-6f06-4217-9e88-ebc5c117179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:23.120344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60bd1-6f06-4217-9e88-ebc5c117179c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:23.120623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60bd1-6f06-4217-9e88-ebc5c117179c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:23.120894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae60bd1-6f06-4217-9e88-ebc5c117179c admin admin] PATH_INFO: `/v3/projects/e84b3528d0a2455fafe16011e49b4f57/users/08a2c91427ac43149a08233191b9556b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:23.135128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae60bd1-6f06-4217-9e88-ebc5c117179c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84b3528d0a2455fafe16011e49b4f57, user_id=08a2c91427ac43149a08233191b9556b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:23.137812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae60bd1-6f06-4217-9e88-ebc5c117179c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:23.150608 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4126/8212] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:23 2022] PUT /identity/v3/projects/e84b3528d0a2455fafe16011e49b4f57/users/08a2c91427ac43149a08233191b9556b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:23.162286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c65e3-bcc8-4cfc-a169-87183eb4072b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:23.162579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c65e3-bcc8-4cfc-a169-87183eb4072b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:23.162871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c65e3-bcc8-4cfc-a169-87183eb4072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:23.189997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b35c65e3-bcc8-4cfc-a169-87183eb4072b None None] MFA Rules not processed for user `08a2c91427ac43149a08233191b9556b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:23.191194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b35c65e3-bcc8-4cfc-a169-87183eb4072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:23.257654 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4087/8213] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:23.268863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60bd1-6f06-4217-9e88-ebc5c117179c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:23.270540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0ae60bd1-6f06-4217-9e88-ebc5c117179c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:23.337009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae60bd1-6f06-4217-9e88-ebc5c117179c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:23.338454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09965d03-e451-4d3d-8b3f-55f80224bc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:23.339299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965d03-e451-4d3d-8b3f-55f80224bc0c service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:23.339762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965d03-e451-4d3d-8b3f-55f80224bc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:23.340621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09965d03-e451-4d3d-8b3f-55f80224bc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:23.352001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09965d03-e451-4d3d-8b3f-55f80224bc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:23.353900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09965d03-e451-4d3d-8b3f-55f80224bc0c service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:23.363535 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4127/8214] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:23.891192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c65e3-bcc8-4cfc-a169-87183eb4072b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:23.952495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c65e3-bcc8-4cfc-a169-87183eb4072b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:23.956948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:23.957806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:23.958086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:23.958358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] PATH_INFO: `/v3/users/08a2c91427ac43149a08233191b9556b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:23.959537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a2c91427ac43149a08233191b9556b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:23.961508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:24.007437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a2c91427ac43149a08233191b9556b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.016300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a2c91427ac43149a08233191b9556b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.016943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a2c91427ac43149a08233191b9556b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.017645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a2c91427ac43149a08233191b9556b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.031133 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a2c91427ac43149a08233191b9556b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.043827 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4088/8215] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:23 2022] DELETE /identity/v3/users/08a2c91427ac43149a08233191b9556b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:24.048681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cecd1-3e6a-4b2b-8cd8-9768f822fad7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.049241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cecd1-3e6a-4b2b-8cd8-9768f822fad7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.049241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cecd1-3e6a-4b2b-8cd8-9768f822fad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.066520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d82cecd1-3e6a-4b2b-8cd8-9768f822fad7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:24.067724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d82cecd1-3e6a-4b2b-8cd8-9768f822fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:24.125359 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4128/8216] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:24.134827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:24.136234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:24.196363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d59ada-65c4-41db-b0a2-9d5d6b736d73 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:24.200806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99e5591-0281-4909-a182-bdae13c0a510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:24.201451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e5591-0281-4909-a182-bdae13c0a510 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.201735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e5591-0281-4909-a182-bdae13c0a510 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.202008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99e5591-0281-4909-a182-bdae13c0a510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.211665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e5591-0281-4909-a182-bdae13c0a510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:24.213291 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99e5591-0281-4909-a182-bdae13c0a510 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:24.223940 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4089/8217] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:17:24.497633 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cecd1-3e6a-4b2b-8cd8-9768f822fad7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:24.499050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d82cecd1-3e6a-4b2b-8cd8-9768f822fad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:24.510807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cecd1-3e6a-4b2b-8cd8-9768f822fad7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:24.515986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:24.516844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.517121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.517397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] PATH_INFO: `/v3/projects/e84b3528d0a2455fafe16011e49b4f57` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.518562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84b3528d0a2455fafe16011e49b4f57)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:24.520591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:24.565452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84b3528d0a2455fafe16011e49b4f57', 'request_id': 'req-d9180a58-363c-4a57-9b7c-f00c752639a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.572864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84b3528d0a2455fafe16011e49b4f57', 'request_id': 'req-d9180a58-363c-4a57-9b7c-f00c752639a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.578744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84b3528d0a2455fafe16011e49b4f57', 'request_id': 'req-d9180a58-363c-4a57-9b7c-f00c752639a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.589098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] The token cache is being invalidate because project e84b3528d0a2455fafe16011e49b4f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:24.589380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.590043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9180a58-363c-4a57-9b7c-f00c752639a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:24.591525 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4129/8218] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:24 2022] DELETE /identity/v3/projects/e84b3528d0a2455fafe16011e49b4f57 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:24.596466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0427e-788f-4ab3-b79a-64410428ae48 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.596763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0427e-788f-4ab3-b79a-64410428ae48 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.597048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0427e-788f-4ab3-b79a-64410428ae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.614227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-07e0427e-788f-4ab3-b79a-64410428ae48 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:24.615409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-07e0427e-788f-4ab3-b79a-64410428ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:24.674722 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4090/8219] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:24.682660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5d711-b441-4536-9393-dbfb980be292 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.682949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5d711-b441-4536-9393-dbfb980be292 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.683225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5d711-b441-4536-9393-dbfb980be292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.702002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-dfc5d711-b441-4536-9393-dbfb980be292 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:24.703183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dfc5d711-b441-4536-9393-dbfb980be292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:24.710896 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4130/8220] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:24.714901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0427e-788f-4ab3-b79a-64410428ae48 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:24.724367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0427e-788f-4ab3-b79a-64410428ae48 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:24.728920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614a2ff-9846-4034-a514-567998d32250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:24.729560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614a2ff-9846-4034-a514-567998d32250 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.729844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614a2ff-9846-4034-a514-567998d32250 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.730122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614a2ff-9846-4034-a514-567998d32250 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.730871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614a2ff-9846-4034-a514-567998d32250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:24.731175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614a2ff-9846-4034-a514-567998d32250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:24.732821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614a2ff-9846-4034-a514-567998d32250 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:24.744107 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4091/8221] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:17:24.748797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5d711-b441-4536-9393-dbfb980be292 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:24.757956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5d711-b441-4536-9393-dbfb980be292 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:24.763285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9e856-c557-42ac-8574-5e75cfb2e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:24.763863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e856-c557-42ac-8574-5e75cfb2e98b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.764175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e856-c557-42ac-8574-5e75cfb2e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.764475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9e856-c557-42ac-8574-5e75cfb2e98b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.765149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9e856-c557-42ac-8574-5e75cfb2e98b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:24.767041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9e856-c557-42ac-8574-5e75cfb2e98b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:24.791370 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4131/8222] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:24 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:24.796172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614a2ff-9846-4034-a514-567998d32250 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:24.806097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614a2ff-9846-4034-a514-567998d32250 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:24.859726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c58db-6e15-475d-ab0e-8539604c1641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:24.860413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c58db-6e15-475d-ab0e-8539604c1641 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.860695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c58db-6e15-475d-ab0e-8539604c1641 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.860971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c58db-6e15-475d-ab0e-8539604c1641 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.861656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c58db-6e15-475d-ab0e-8539604c1641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:24.863710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c58db-6e15-475d-ab0e-8539604c1641 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:24.883462 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4092/8223] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:24 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:24.887452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9e856-c557-42ac-8574-5e75cfb2e98b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:24.897490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9e856-c557-42ac-8574-5e75cfb2e98b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:24.902006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321871f3-0ed2-4e73-b339-aeabd21930df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:24.902640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321871f3-0ed2-4e73-b339-aeabd21930df admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.902919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321871f3-0ed2-4e73-b339-aeabd21930df admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.903191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321871f3-0ed2-4e73-b339-aeabd21930df admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.903895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321871f3-0ed2-4e73-b339-aeabd21930df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:24.905517 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321871f3-0ed2-4e73-b339-aeabd21930df admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:24.915438 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4132/8224] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:24.919691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c58db-6e15-475d-ab0e-8539604c1641 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:24.929770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c58db-6e15-475d-ab0e-8539604c1641 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:24.935006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362938a7-20df-411e-bcff-a56df3403f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:24.935648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362938a7-20df-411e-bcff-a56df3403f23 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.935944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362938a7-20df-411e-bcff-a56df3403f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.936268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362938a7-20df-411e-bcff-a56df3403f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.936982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362938a7-20df-411e-bcff-a56df3403f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:24.938728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362938a7-20df-411e-bcff-a56df3403f23 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:24.948711 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4093/8225] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:24.952709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321871f3-0ed2-4e73-b339-aeabd21930df admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:24.962418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321871f3-0ed2-4e73-b339-aeabd21930df admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:24.966921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202ff19-75ac-43e8-a342-d9d358204bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:24.967776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202ff19-75ac-43e8-a342-d9d358204bda admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:24.968101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202ff19-75ac-43e8-a342-d9d358204bda admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:24.968375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202ff19-75ac-43e8-a342-d9d358204bda admin admin] PATH_INFO: `/v3/projects/1119c921535d42d2804b6d68c326a6fc/users/93f0588813624fcaa806c0eeec1ed7e1/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:24.984990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202ff19-75ac-43e8-a342-d9d358204bda admin admin] RBAC: Authorizing `identity:create_grant(project_id=1119c921535d42d2804b6d68c326a6fc, user_id=93f0588813624fcaa806c0eeec1ed7e1, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:24.987736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202ff19-75ac-43e8-a342-d9d358204bda admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:25.001366 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4133/8226] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:24 2022] PUT /identity/v3/projects/1119c921535d42d2804b6d68c326a6fc/users/93f0588813624fcaa806c0eeec1ed7e1/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:25.011530 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5501b2-32c7-4d5a-b507-031eadd0f72d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:25.011877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5501b2-32c7-4d5a-b507-031eadd0f72d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:25.012252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5501b2-32c7-4d5a-b507-031eadd0f72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:25.042016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1e5501b2-32c7-4d5a-b507-031eadd0f72d None None] MFA Rules not processed for user `93f0588813624fcaa806c0eeec1ed7e1`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:25.044645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1e5501b2-32c7-4d5a-b507-031eadd0f72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:25.107682 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4094/8227] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:25.118006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202ff19-75ac-43e8-a342-d9d358204bda admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:25.119807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7202ff19-75ac-43e8-a342-d9d358204bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:25.177778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202ff19-75ac-43e8-a342-d9d358204bda admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:25.181555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeb0c4-7203-4cc6-8dbd-00b4f49fdc39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:25.182187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeb0c4-7203-4cc6-8dbd-00b4f49fdc39 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:25.182471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeb0c4-7203-4cc6-8dbd-00b4f49fdc39 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:25.182748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aeb0c4-7203-4cc6-8dbd-00b4f49fdc39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:25.190964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aeb0c4-7203-4cc6-8dbd-00b4f49fdc39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:25.192434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aeb0c4-7203-4cc6-8dbd-00b4f49fdc39 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:25.201065 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4134/8228] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:29.205699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5501b2-32c7-4d5a-b507-031eadd0f72d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:29.207354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1e5501b2-32c7-4d5a-b507-031eadd0f72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:29.283819 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5501b2-32c7-4d5a-b507-031eadd0f72d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:29.290516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a5e81-1b46-4168-821d-9a6f26b2912a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:29.291419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a5e81-1b46-4168-821d-9a6f26b2912a service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:29.291898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a5e81-1b46-4168-821d-9a6f26b2912a service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:29.292368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a5e81-1b46-4168-821d-9a6f26b2912a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:29.294918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c97a5e81-1b46-4168-821d-9a6f26b2912a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:29.311738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a5e81-1b46-4168-821d-9a6f26b2912a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:29.313982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a5e81-1b46-4168-821d-9a6f26b2912a service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:29.330174 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4095/8229] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:29.518500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeb0c4-7203-4cc6-8dbd-00b4f49fdc39 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:29.520471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f0aeb0c4-7203-4cc6-8dbd-00b4f49fdc39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:29.539543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aeb0c4-7203-4cc6-8dbd-00b4f49fdc39 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:29.545926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd246a8d-9166-4a76-a920-9fabfb2d5521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:29.546626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246a8d-9166-4a76-a920-9fabfb2d5521 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:29.546917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246a8d-9166-4a76-a920-9fabfb2d5521 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:29.547303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd246a8d-9166-4a76-a920-9fabfb2d5521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:29.549512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dd246a8d-9166-4a76-a920-9fabfb2d5521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:29.569297 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246a8d-9166-4a76-a920-9fabfb2d5521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:29.571101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd246a8d-9166-4a76-a920-9fabfb2d5521 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:29.583999 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4135/8230] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:29.738010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5e46d-b71d-4544-a5db-1ed3dfe3e77d None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:29.738599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5e46d-b71d-4544-a5db-1ed3dfe3e77d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:29.739099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5e46d-b71d-4544-a5db-1ed3dfe3e77d None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:29.740970 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4096/8231] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:17:29.746178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f6073-964d-4836-b8e3-faad0faa3475 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:29.746468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f6073-964d-4836-b8e3-faad0faa3475 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:29.746746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f6073-964d-4836-b8e3-faad0faa3475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:29.792251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-911f6073-964d-4836-b8e3-faad0faa3475 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:29.794017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-911f6073-964d-4836-b8e3-faad0faa3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:29.808792 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4136/8232] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:17:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:29.829324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5e46d-b71d-4544-a5db-1ed3dfe3e77d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:29.846135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5e46d-b71d-4544-a5db-1ed3dfe3e77d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:29.851483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f483e-4a36-48f8-ba56-f57d9b67a761 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:29.852232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f483e-4a36-48f8-ba56-f57d9b67a761 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:29.852632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f483e-4a36-48f8-ba56-f57d9b67a761 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:29.852973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7f483e-4a36-48f8-ba56-f57d9b67a761 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:29.862282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f483e-4a36-48f8-ba56-f57d9b67a761 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:29.863931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7f483e-4a36-48f8-ba56-f57d9b67a761 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:29.874099 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4097/8233] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:29.956110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f6073-964d-4836-b8e3-faad0faa3475 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:29.957487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-911f6073-964d-4836-b8e3-faad0faa3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:30.036086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f6073-964d-4836-b8e3-faad0faa3475 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:30.042125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:30.042999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:30.043276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:30.043547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] PATH_INFO: `/v3/users/4c2951d0babd4eb2a318f9f847477f71` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:30.044798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2951d0babd4eb2a318f9f847477f71)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:30.047144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:30.074569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f483e-4a36-48f8-ba56-f57d9b67a761 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:30.088189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7f483e-4a36-48f8-ba56-f57d9b67a761 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:30.092587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecb438-d27e-4355-8bf4-1dd1d7d8c8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:30.093250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecb438-d27e-4355-8bf4-1dd1d7d8c8bc service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:30.093491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecb438-d27e-4355-8bf4-1dd1d7d8c8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:30.093764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecb438-d27e-4355-8bf4-1dd1d7d8c8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:30.095526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-87ecb438-d27e-4355-8bf4-1dd1d7d8c8bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:30.102943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2951d0babd4eb2a318f9f847477f71'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.110879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2951d0babd4eb2a318f9f847477f71'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.111662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2951d0babd4eb2a318f9f847477f71'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.112440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2951d0babd4eb2a318f9f847477f71'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.121826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-97ad4856-e045-496b-b02a-1bce710c7045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2951d0babd4eb2a318f9f847477f71'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.143708 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4137/8234] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:29 2022] DELETE /identity/v3/users/4c2951d0babd4eb2a318f9f847477f71 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:30.149381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b498d7-d209-4f15-8569-2ad2c915117d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:30.149866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b498d7-d209-4f15-8569-2ad2c915117d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:30.150260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b498d7-d209-4f15-8569-2ad2c915117d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:30.168841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c0b498d7-d209-4f15-8569-2ad2c915117d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:30.170167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c0b498d7-d209-4f15-8569-2ad2c915117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:30.180853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecb438-d27e-4355-8bf4-1dd1d7d8c8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:30.182388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecb438-d27e-4355-8bf4-1dd1d7d8c8bc service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:30.196586 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4098/8235] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:17:30.230805 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4138/8236] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:30.240740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecb438-d27e-4355-8bf4-1dd1d7d8c8bc service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:30.252844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecb438-d27e-4355-8bf4-1dd1d7d8c8bc service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:30.305468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c76d-80a5-4916-8a28-b9ed49da5c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:30.306134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c76d-80a5-4916-8a28-b9ed49da5c08 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:30.306417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c76d-80a5-4916-8a28-b9ed49da5c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:30.306691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287c76d-80a5-4916-8a28-b9ed49da5c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:30.318677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287c76d-80a5-4916-8a28-b9ed49da5c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:30.320174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1287c76d-80a5-4916-8a28-b9ed49da5c08 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:30.336196 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4099/8237] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:17:30.667717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b498d7-d209-4f15-8569-2ad2c915117d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:30.669698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c0b498d7-d209-4f15-8569-2ad2c915117d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:30.683005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b498d7-d209-4f15-8569-2ad2c915117d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:30.688665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:30.689731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:30.697828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:30.698310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] PATH_INFO: `/v3/projects/8186063bcad64e01aaac232da670fcb2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:30.700440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8186063bcad64e01aaac232da670fcb2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:30.702822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:30.799474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8186063bcad64e01aaac232da670fcb2', 'request_id': 'req-c8149df4-f39b-4c30-a3c4-c211ed3427b5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.813166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8186063bcad64e01aaac232da670fcb2', 'request_id': 'req-c8149df4-f39b-4c30-a3c4-c211ed3427b5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.822579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8186063bcad64e01aaac232da670fcb2', 'request_id': 'req-c8149df4-f39b-4c30-a3c4-c211ed3427b5'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.836154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] The token cache is being invalidate because project 8186063bcad64e01aaac232da670fcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:30.836486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.837143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.838727 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4139/8238] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:30 2022] DELETE /identity/v3/projects/8186063bcad64e01aaac232da670fcb2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:30.842837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c76d-80a5-4916-8a28-b9ed49da5c08 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:30.853395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287c76d-80a5-4916-8a28-b9ed49da5c08 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:30.916613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:30.917508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:30.918320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:30.918597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] PATH_INFO: `/v3/users/d674ef49734e40858b2832a07730d31c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:30.919774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d674ef49734e40858b2832a07730d31c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:30.921753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:30.970063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd674ef49734e40858b2832a07730d31c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.977417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd674ef49734e40858b2832a07730d31c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.978112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd674ef49734e40858b2832a07730d31c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.978807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd674ef49734e40858b2832a07730d31c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:30.993353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-5840f73f-707e-4451-bc64-3c627fcfea29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd674ef49734e40858b2832a07730d31c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:31.007057 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4100/8239] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:30 2022] DELETE /identity/v3/users/d674ef49734e40858b2832a07730d31c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:31.328824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:31.330599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:31.354582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8149df4-f39b-4c30-a3c4-c211ed3427b5 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:31.419889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:31.420931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:31.421233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:31.421498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] PATH_INFO: `/v3/projects/6e2bbda0e5c24923b883105ba9ffe33d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:31.422745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2bbda0e5c24923b883105ba9ffe33d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:31.425432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:31.475513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2bbda0e5c24923b883105ba9ffe33d', 'request_id': 'req-4253c352-a7a4-4c9c-bd98-8c1993836d31'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:31.484562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2bbda0e5c24923b883105ba9ffe33d', 'request_id': 'req-4253c352-a7a4-4c9c-bd98-8c1993836d31'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:31.491405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2bbda0e5c24923b883105ba9ffe33d', 'request_id': 'req-4253c352-a7a4-4c9c-bd98-8c1993836d31'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:31.504885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] The token cache is being invalidate because project 6e2bbda0e5c24923b883105ba9ffe33d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:31.505187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:31.506255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4253c352-a7a4-4c9c-bd98-8c1993836d31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:31.509493 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4140/8240] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:31 2022] DELETE /identity/v3/projects/6e2bbda0e5c24923b883105ba9ffe33d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:31.514691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7f5b-1dba-4740-a4fb-e695033122b3 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:31.515150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7f5b-1dba-4740-a4fb-e695033122b3 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:31.515241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7f5b-1dba-4740-a4fb-e695033122b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:31.533774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-909e7f5b-1dba-4740-a4fb-e695033122b3 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:31.534972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-909e7f5b-1dba-4740-a4fb-e695033122b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:31.597260 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4101/8241] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:31.606435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e566-aadf-4a7d-bcbd-4abf37bf9547 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:31.606758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e566-aadf-4a7d-bcbd-4abf37bf9547 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:31.607043 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e566-aadf-4a7d-bcbd-4abf37bf9547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:31.627402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5484e566-aadf-4a7d-bcbd-4abf37bf9547 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:31.628163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5484e566-aadf-4a7d-bcbd-4abf37bf9547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:31.637106 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4141/8242] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:31.641417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7f5b-1dba-4740-a4fb-e695033122b3 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:31.651395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7f5b-1dba-4740-a4fb-e695033122b3 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:31.656922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb19fe9-414f-4fd2-9d6f-b1f4be072c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:31.657616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb19fe9-414f-4fd2-9d6f-b1f4be072c80 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:31.657900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb19fe9-414f-4fd2-9d6f-b1f4be072c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:31.658176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb19fe9-414f-4fd2-9d6f-b1f4be072c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:31.658902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb19fe9-414f-4fd2-9d6f-b1f4be072c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:31.659206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb19fe9-414f-4fd2-9d6f-b1f4be072c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:31.660978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb19fe9-414f-4fd2-9d6f-b1f4be072c80 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:31.674072 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4102/8243] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:31.678438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e566-aadf-4a7d-bcbd-4abf37bf9547 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:31.688653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e566-aadf-4a7d-bcbd-4abf37bf9547 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:31.693631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff66dd-e22a-4db0-95bc-f2f62107eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:31.694378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff66dd-e22a-4db0-95bc-f2f62107eba8 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:31.694760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff66dd-e22a-4db0-95bc-f2f62107eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:31.695367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ff66dd-e22a-4db0-95bc-f2f62107eba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:31.696285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff66dd-e22a-4db0-95bc-f2f62107eba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:31.698243 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ff66dd-e22a-4db0-95bc-f2f62107eba8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:31.728003 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4142/8244] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:31 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:31.731882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb19fe9-414f-4fd2-9d6f-b1f4be072c80 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:31.743058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb19fe9-414f-4fd2-9d6f-b1f4be072c80 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:31.814512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf393f-804c-46cb-8ac6-3ed8269f5e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:31.815844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf393f-804c-46cb-8ac6-3ed8269f5e2d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:31.816368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf393f-804c-46cb-8ac6-3ed8269f5e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:31.817094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf393f-804c-46cb-8ac6-3ed8269f5e2d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:31.818648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf393f-804c-46cb-8ac6-3ed8269f5e2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:31.822175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf393f-804c-46cb-8ac6-3ed8269f5e2d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:31.852409 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4103/8245] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:31 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:31.853802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff66dd-e22a-4db0-95bc-f2f62107eba8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:31.865342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ff66dd-e22a-4db0-95bc-f2f62107eba8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:31.870472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa832a59-c584-4c02-a694-e7ae3cd368ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:31.872015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa832a59-c584-4c02-a694-e7ae3cd368ef admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:31.872411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa832a59-c584-4c02-a694-e7ae3cd368ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:31.872776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa832a59-c584-4c02-a694-e7ae3cd368ef admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:31.873852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa832a59-c584-4c02-a694-e7ae3cd368ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:31.875554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa832a59-c584-4c02-a694-e7ae3cd368ef admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:31.889216 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4143/8246] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:17:31.893142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf393f-804c-46cb-8ac6-3ed8269f5e2d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:31.903845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf393f-804c-46cb-8ac6-3ed8269f5e2d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:31.909014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dcc1c-f626-4901-8808-f3c065faf4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:31.909824 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dcc1c-f626-4901-8808-f3c065faf4bf admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:31.910211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dcc1c-f626-4901-8808-f3c065faf4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:31.910593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dcc1c-f626-4901-8808-f3c065faf4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:31.911423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dcc1c-f626-4901-8808-f3c065faf4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:31.915223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dcc1c-f626-4901-8808-f3c065faf4bf admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:31.935671 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4104/8247] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:31.938020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa832a59-c584-4c02-a694-e7ae3cd368ef admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:31.952678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa832a59-c584-4c02-a694-e7ae3cd368ef admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:31.959463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee08ac-9017-4f4d-a365-901e5e7ee4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:31.960826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee08ac-9017-4f4d-a365-901e5e7ee4c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:31.961367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee08ac-9017-4f4d-a365-901e5e7ee4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:31.966808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee08ac-9017-4f4d-a365-901e5e7ee4c6 admin admin] PATH_INFO: `/v3/projects/1c2dc693fa9243e8b68eb9ff4a5c2d95/users/8dc229bba13b494dbbaf683ec3b1eb5f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:31.984822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee08ac-9017-4f4d-a365-901e5e7ee4c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2dc693fa9243e8b68eb9ff4a5c2d95, user_id=8dc229bba13b494dbbaf683ec3b1eb5f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:31.988860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee08ac-9017-4f4d-a365-901e5e7ee4c6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:32.003948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4144/8248] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:31 2022] PUT /identity/v3/projects/1c2dc693fa9243e8b68eb9ff4a5c2d95/users/8dc229bba13b494dbbaf683ec3b1eb5f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:32.015353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988f23-c81a-4bea-9e77-b9d8054c94fa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:32.015694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988f23-c81a-4bea-9e77-b9d8054c94fa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:32.016017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2988f23-c81a-4bea-9e77-b9d8054c94fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:32.044235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a2988f23-c81a-4bea-9e77-b9d8054c94fa None None] MFA Rules not processed for user `8dc229bba13b494dbbaf683ec3b1eb5f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:32.045590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a2988f23-c81a-4bea-9e77-b9d8054c94fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:32.119819 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4105/8249] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:32.125823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee08ac-9017-4f4d-a365-901e5e7ee4c6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:32.218385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee08ac-9017-4f4d-a365-901e5e7ee4c6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:32.224587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a7a7a-f352-445f-af0c-7058e7eadb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:32.225558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a7a7a-f352-445f-af0c-7058e7eadb9f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:32.226078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a7a7a-f352-445f-af0c-7058e7eadb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:32.226558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a7a7a-f352-445f-af0c-7058e7eadb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:32.227251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a7a7a-f352-445f-af0c-7058e7eadb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:32.229391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a7a7a-f352-445f-af0c-7058e7eadb9f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:32.257882 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4145/8250] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:32 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:32.263526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2988f23-c81a-4bea-9e77-b9d8054c94fa None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:32.276679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2988f23-c81a-4bea-9e77-b9d8054c94fa None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:32.333778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b54fcf-5372-4a30-a98f-9c27f4548c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:32.334436 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b54fcf-5372-4a30-a98f-9c27f4548c36 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:32.334720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b54fcf-5372-4a30-a98f-9c27f4548c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:32.334995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b54fcf-5372-4a30-a98f-9c27f4548c36 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:32.335671 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b54fcf-5372-4a30-a98f-9c27f4548c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:32.337712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b54fcf-5372-4a30-a98f-9c27f4548c36 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:32.358658 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4106/8251] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:32 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:32.362778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a7a7a-f352-445f-af0c-7058e7eadb9f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:32.373664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a7a7a-f352-445f-af0c-7058e7eadb9f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:32.378326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aa98c-f7ea-4c70-9035-abc5420b7379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:32.378969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aa98c-f7ea-4c70-9035-abc5420b7379 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:32.379255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aa98c-f7ea-4c70-9035-abc5420b7379 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:32.379535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596aa98c-f7ea-4c70-9035-abc5420b7379 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:32.380287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596aa98c-f7ea-4c70-9035-abc5420b7379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:32.381885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596aa98c-f7ea-4c70-9035-abc5420b7379 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:32.392666 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4146/8252] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:32.396691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b54fcf-5372-4a30-a98f-9c27f4548c36 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:32.406501 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b54fcf-5372-4a30-a98f-9c27f4548c36 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:32.411698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eaebd2-d4d0-43ff-acfa-7bf079888a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:32.412615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaebd2-d4d0-43ff-acfa-7bf079888a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:32.412897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaebd2-d4d0-43ff-acfa-7bf079888a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:32.413172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaebd2-d4d0-43ff-acfa-7bf079888a07 admin admin] PATH_INFO: `/v3/projects/750263ec3a0f4b24abe0971caa2875d7/users/871ae14dacdb49658326931151374e91/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:32.429058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaebd2-d4d0-43ff-acfa-7bf079888a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750263ec3a0f4b24abe0971caa2875d7, user_id=871ae14dacdb49658326931151374e91, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:32.431832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaebd2-d4d0-43ff-acfa-7bf079888a07 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:32.445865 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4107/8253] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:32 2022] PUT /identity/v3/projects/750263ec3a0f4b24abe0971caa2875d7/users/871ae14dacdb49658326931151374e91/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:32.449959 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aa98c-f7ea-4c70-9035-abc5420b7379 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:32.460374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596aa98c-f7ea-4c70-9035-abc5420b7379 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:32.515246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7aa6e-8fdc-4dce-b7e5-e51f3ed715e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:32.515937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7aa6e-8fdc-4dce-b7e5-e51f3ed715e1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:32.516235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7aa6e-8fdc-4dce-b7e5-e51f3ed715e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:32.516514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7aa6e-8fdc-4dce-b7e5-e51f3ed715e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:32.517262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7aa6e-8fdc-4dce-b7e5-e51f3ed715e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:32.518864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7aa6e-8fdc-4dce-b7e5-e51f3ed715e1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:32.528856 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4147/8254] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:32.533057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eaebd2-d4d0-43ff-acfa-7bf079888a07 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:32.544016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eaebd2-d4d0-43ff-acfa-7bf079888a07 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:32.548735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c21a0f-01ea-4067-af0e-e115fa395f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:32.549620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c21a0f-01ea-4067-af0e-e115fa395f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:32.549929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c21a0f-01ea-4067-af0e-e115fa395f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:32.550208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c21a0f-01ea-4067-af0e-e115fa395f0b admin admin] PATH_INFO: `/v3/projects/750263ec3a0f4b24abe0971caa2875d7/users/871ae14dacdb49658326931151374e91/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:32.552718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c21a0f-01ea-4067-af0e-e115fa395f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=750263ec3a0f4b24abe0971caa2875d7, user_id=871ae14dacdb49658326931151374e91, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:32.555424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c21a0f-01ea-4067-af0e-e115fa395f0b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:32.566790 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4108/8255] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:32 2022] PUT /identity/v3/projects/750263ec3a0f4b24abe0971caa2875d7/users/871ae14dacdb49658326931151374e91/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:32.577481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f04316-f3ec-4239-bd4c-fac30b69a12e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:32.577779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f04316-f3ec-4239-bd4c-fac30b69a12e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:32.578061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f04316-f3ec-4239-bd4c-fac30b69a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:32.607812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-78f04316-f3ec-4239-bd4c-fac30b69a12e None None] MFA Rules not processed for user `871ae14dacdb49658326931151374e91`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:32.609067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-78f04316-f3ec-4239-bd4c-fac30b69a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:32.679226 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4148/8256] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:32.690578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c21a0f-01ea-4067-af0e-e115fa395f0b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:32.692460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-72c21a0f-01ea-4067-af0e-e115fa395f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:32.750015 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c21a0f-01ea-4067-af0e-e115fa395f0b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:32.754559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540c94e-1556-4526-9e08-1b7e53318230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:32.755215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540c94e-1556-4526-9e08-1b7e53318230 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:32.755515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540c94e-1556-4526-9e08-1b7e53318230 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:32.755794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540c94e-1556-4526-9e08-1b7e53318230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:32.812651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540c94e-1556-4526-9e08-1b7e53318230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:32.814116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540c94e-1556-4526-9e08-1b7e53318230 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:32.823182 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4109/8257] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:36.157044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f04316-f3ec-4239-bd4c-fac30b69a12e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:36.158809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-78f04316-f3ec-4239-bd4c-fac30b69a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:36.231759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f04316-f3ec-4239-bd4c-fac30b69a12e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:36.237186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:36.238491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:36.238907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:36.239233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] PATH_INFO: `/v3/users/93f0588813624fcaa806c0eeec1ed7e1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:36.240506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f0588813624fcaa806c0eeec1ed7e1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:36.242477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:36.291016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f0588813624fcaa806c0eeec1ed7e1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.298121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f0588813624fcaa806c0eeec1ed7e1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.298794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f0588813624fcaa806c0eeec1ed7e1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.299412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f0588813624fcaa806c0eeec1ed7e1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.306317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f0588813624fcaa806c0eeec1ed7e1'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.324032 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4149/8258] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:36 2022] DELETE /identity/v3/users/93f0588813624fcaa806c0eeec1ed7e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:36.328734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718009a7-e613-4af3-9d38-b0b5420945f5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:36.329264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718009a7-e613-4af3-9d38-b0b5420945f5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:36.329264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718009a7-e613-4af3-9d38-b0b5420945f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:36.346104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-718009a7-e613-4af3-9d38-b0b5420945f5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:36.347281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-718009a7-e613-4af3-9d38-b0b5420945f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:36.404801 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4110/8259] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:36.414514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:36.415934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:36.474237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed127c-b530-457b-a3d8-45bd8b82ac53 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:36.477799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acecfb-a1eb-4ee3-bc31-46275dbf347a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:36.478432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acecfb-a1eb-4ee3-bc31-46275dbf347a service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:36.478716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acecfb-a1eb-4ee3-bc31-46275dbf347a service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:36.478992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acecfb-a1eb-4ee3-bc31-46275dbf347a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:36.487898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acecfb-a1eb-4ee3-bc31-46275dbf347a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:36.489473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acecfb-a1eb-4ee3-bc31-46275dbf347a service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:36.499156 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4150/8260] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:36.668429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718009a7-e613-4af3-9d38-b0b5420945f5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:36.670473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-718009a7-e613-4af3-9d38-b0b5420945f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:36.682767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718009a7-e613-4af3-9d38-b0b5420945f5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:36.687597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:36.688496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:36.688778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:36.689055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] PATH_INFO: `/v3/projects/1119c921535d42d2804b6d68c326a6fc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:36.690242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1119c921535d42d2804b6d68c326a6fc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:36.692202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:36.739398 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1119c921535d42d2804b6d68c326a6fc', 'request_id': 'req-fec87305-e8e9-44aa-848f-cbdd007a8a4b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.745845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1119c921535d42d2804b6d68c326a6fc', 'request_id': 'req-fec87305-e8e9-44aa-848f-cbdd007a8a4b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.751296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1119c921535d42d2804b6d68c326a6fc', 'request_id': 'req-fec87305-e8e9-44aa-848f-cbdd007a8a4b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.762787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] The token cache is being invalidate because project 1119c921535d42d2804b6d68c326a6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:36.763082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.763711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fec87305-e8e9-44aa-848f-cbdd007a8a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:36.765257 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4111/8261] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:36 2022] DELETE /identity/v3/projects/1119c921535d42d2804b6d68c326a6fc => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:36.770254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b55d38-c008-46a2-902f-b0e99f1aea49 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:36.770542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b55d38-c008-46a2-902f-b0e99f1aea49 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:36.770818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b55d38-c008-46a2-902f-b0e99f1aea49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:36.788925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b3b55d38-c008-46a2-902f-b0e99f1aea49 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:36.790106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b3b55d38-c008-46a2-902f-b0e99f1aea49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:36.845528 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4151/8262] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:36.853242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46414804-4a74-4cda-a000-b2578b9b535f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:36.853543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46414804-4a74-4cda-a000-b2578b9b535f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:36.853829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46414804-4a74-4cda-a000-b2578b9b535f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:36.871779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-46414804-4a74-4cda-a000-b2578b9b535f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:36.873012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-46414804-4a74-4cda-a000-b2578b9b535f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:36.881022 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4112/8263] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:36.885027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b55d38-c008-46a2-902f-b0e99f1aea49 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:36.895156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b55d38-c008-46a2-902f-b0e99f1aea49 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:36.899767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532458f-2ce3-4b56-bc34-6a4930c97ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:36.900438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532458f-2ce3-4b56-bc34-6a4930c97ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:36.900719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532458f-2ce3-4b56-bc34-6a4930c97ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:36.900994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532458f-2ce3-4b56-bc34-6a4930c97ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:36.902309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532458f-2ce3-4b56-bc34-6a4930c97ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:36.902620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532458f-2ce3-4b56-bc34-6a4930c97ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:36.904270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532458f-2ce3-4b56-bc34-6a4930c97ba1 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:36.915487 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4152/8264] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:36.919542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46414804-4a74-4cda-a000-b2578b9b535f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:36.928947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46414804-4a74-4cda-a000-b2578b9b535f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:36.933727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaa982-7c1c-4890-a247-be1f5e45b804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:36.934373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaa982-7c1c-4890-a247-be1f5e45b804 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:36.934654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaa982-7c1c-4890-a247-be1f5e45b804 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:36.934936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfaa982-7c1c-4890-a247-be1f5e45b804 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:36.935627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaa982-7c1c-4890-a247-be1f5e45b804 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:36.937578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfaa982-7c1c-4890-a247-be1f5e45b804 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:36.962764 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4113/8265] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:36 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:36.967457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532458f-2ce3-4b56-bc34-6a4930c97ba1 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:36.977340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532458f-2ce3-4b56-bc34-6a4930c97ba1 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:37.060628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefd7fb-cdcc-4d6b-817b-99cd0e22321f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:37.061294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefd7fb-cdcc-4d6b-817b-99cd0e22321f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:37.061577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefd7fb-cdcc-4d6b-817b-99cd0e22321f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:37.061847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefd7fb-cdcc-4d6b-817b-99cd0e22321f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:37.062523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefd7fb-cdcc-4d6b-817b-99cd0e22321f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:37.064750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefd7fb-cdcc-4d6b-817b-99cd0e22321f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:37.091239 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4153/8266] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:36 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:37.092541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaa982-7c1c-4890-a247-be1f5e45b804 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:37.105064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfaa982-7c1c-4890-a247-be1f5e45b804 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:37.113734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04824cd8-533e-468e-ae74-16d2666c40b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:37.114826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04824cd8-533e-468e-ae74-16d2666c40b9 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:37.115213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04824cd8-533e-468e-ae74-16d2666c40b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:37.115559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04824cd8-533e-468e-ae74-16d2666c40b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:37.115674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefd7fb-cdcc-4d6b-817b-99cd0e22321f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:37.116537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04824cd8-533e-468e-ae74-16d2666c40b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:37.118040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1fefd7fb-cdcc-4d6b-817b-99cd0e22321f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:37.118150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04824cd8-533e-468e-ae74-16d2666c40b9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:37.129858 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4114/8267] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:37.133269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04824cd8-533e-468e-ae74-16d2666c40b9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:37.146087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04824cd8-533e-468e-ae74-16d2666c40b9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:37.151270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa48f1-38f4-4d1a-8a2a-649ffe8fcb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:37.151991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa48f1-38f4-4d1a-8a2a-649ffe8fcb9b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:37.152279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa48f1-38f4-4d1a-8a2a-649ffe8fcb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:37.152554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa48f1-38f4-4d1a-8a2a-649ffe8fcb9b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:37.153268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa48f1-38f4-4d1a-8a2a-649ffe8fcb9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:37.154867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa48f1-38f4-4d1a-8a2a-649ffe8fcb9b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:37.168649 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4115/8268] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:17:37.170091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa48f1-38f4-4d1a-8a2a-649ffe8fcb9b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:37.181657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa48f1-38f4-4d1a-8a2a-649ffe8fcb9b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:37.187122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9e3d8-debe-4a5e-b8a8-eb64779f4f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:37.187531 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefd7fb-cdcc-4d6b-817b-99cd0e22321f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:37.188250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e3d8-debe-4a5e-b8a8-eb64779f4f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:37.188537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e3d8-debe-4a5e-b8a8-eb64779f4f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:37.188818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e3d8-debe-4a5e-b8a8-eb64779f4f75 admin admin] PATH_INFO: `/v3/projects/07306580366a451787264aef6ab8df91/users/586879b1df0947fd8a81c45d06b2dd78/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:37.191485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:37.192162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:37.192446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:37.192719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:37.194535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:37.205568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9e3d8-debe-4a5e-b8a8-eb64779f4f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07306580366a451787264aef6ab8df91, user_id=586879b1df0947fd8a81c45d06b2dd78, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:37.208988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9e3d8-debe-4a5e-b8a8-eb64779f4f75 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:37.233026 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4116/8269] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:37 2022] PUT /identity/v3/projects/07306580366a451787264aef6ab8df91/users/586879b1df0947fd8a81c45d06b2dd78/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:37.235013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78e16a-568b-4383-a706-db7fb8407381 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:37.235373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78e16a-568b-4383-a706-db7fb8407381 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:37.235724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78e16a-568b-4383-a706-db7fb8407381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:37.264807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7f78e16a-568b-4383-a706-db7fb8407381 None None] MFA Rules not processed for user `586879b1df0947fd8a81c45d06b2dd78`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:37.266004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7f78e16a-568b-4383-a706-db7fb8407381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:37.272347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:37.274132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:37.283474 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4154/8270] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:17:37.329185 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4117/8271] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:37.340307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:37.341696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:37.397873 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ecb3d-4720-4e09-a8b7-41c88b58d95d service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:37.449837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7774e-38ad-4977-8b47-efff5d8a3ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:37.450487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7774e-38ad-4977-8b47-efff5d8a3ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:37.450773 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7774e-38ad-4977-8b47-efff5d8a3ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:37.451053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7774e-38ad-4977-8b47-efff5d8a3ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:37.459553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7774e-38ad-4977-8b47-efff5d8a3ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:37.461137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7774e-38ad-4977-8b47-efff5d8a3ea7 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:37.470054 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4155/8272] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:37.786425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78e16a-568b-4383-a706-db7fb8407381 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:37.857105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78e16a-568b-4383-a706-db7fb8407381 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:37.862002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:37.862889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:37.863173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:37.863445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] PATH_INFO: `/v3/users/586879b1df0947fd8a81c45d06b2dd78` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:37.864667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=586879b1df0947fd8a81c45d06b2dd78)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:37.866595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:37.910226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586879b1df0947fd8a81c45d06b2dd78'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:37.917150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586879b1df0947fd8a81c45d06b2dd78'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:37.918330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586879b1df0947fd8a81c45d06b2dd78'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:37.918970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586879b1df0947fd8a81c45d06b2dd78'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:37.930529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586879b1df0947fd8a81c45d06b2dd78'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:37.942309 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4118/8273] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:37 2022] DELETE /identity/v3/users/586879b1df0947fd8a81c45d06b2dd78 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:37.946685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0e79a-b4bd-43c1-acc6-e30c1d91c020 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:37.946974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0e79a-b4bd-43c1-acc6-e30c1d91c020 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:37.947254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0e79a-b4bd-43c1-acc6-e30c1d91c020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:37.965917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-07d0e79a-b4bd-43c1-acc6-e30c1d91c020 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:37.967285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07d0e79a-b4bd-43c1-acc6-e30c1d91c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:38.027271 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4156/8274] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:38.035517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:38.036966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:38.096338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d798128-da6f-410f-a4eb-a01da06e7a2c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:38.100063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc9639-36e1-466b-a92e-1f4f003178cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:38.100709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc9639-36e1-466b-a92e-1f4f003178cf service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.100992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc9639-36e1-466b-a92e-1f4f003178cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.101273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc9639-36e1-466b-a92e-1f4f003178cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.110826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc9639-36e1-466b-a92e-1f4f003178cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:38.112319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc9639-36e1-466b-a92e-1f4f003178cf service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:38.121610 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4119/8275] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:38.383382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0e79a-b4bd-43c1-acc6-e30c1d91c020 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:38.384884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07d0e79a-b4bd-43c1-acc6-e30c1d91c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:38.397524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0e79a-b4bd-43c1-acc6-e30c1d91c020 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:38.403228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:38.404296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.404580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.404853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] PATH_INFO: `/v3/projects/07306580366a451787264aef6ab8df91` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.406060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07306580366a451787264aef6ab8df91)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:38.407977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:38.456258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07306580366a451787264aef6ab8df91', 'request_id': 'req-fba892aa-aed8-4018-a822-34517e903fc4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:38.463863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07306580366a451787264aef6ab8df91', 'request_id': 'req-fba892aa-aed8-4018-a822-34517e903fc4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:38.469736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07306580366a451787264aef6ab8df91', 'request_id': 'req-fba892aa-aed8-4018-a822-34517e903fc4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:38.480325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] The token cache is being invalidate because project 07306580366a451787264aef6ab8df91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:38.480610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:38.481244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fba892aa-aed8-4018-a822-34517e903fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:38.482766 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4157/8276] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:38 2022] DELETE /identity/v3/projects/07306580366a451787264aef6ab8df91 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:38.487744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a8ab9-93a9-4cde-88b9-1fac00464225 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.488227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a8ab9-93a9-4cde-88b9-1fac00464225 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.488334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a8ab9-93a9-4cde-88b9-1fac00464225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.505412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cf3a8ab9-93a9-4cde-88b9-1fac00464225 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:38.506600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cf3a8ab9-93a9-4cde-88b9-1fac00464225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:38.562929 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4120/8277] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:38.570964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da20c9-5556-46da-b053-e8b14da155bc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.571263 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da20c9-5556-46da-b053-e8b14da155bc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.571548 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da20c9-5556-46da-b053-e8b14da155bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.592868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-82da20c9-5556-46da-b053-e8b14da155bc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:38.594052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82da20c9-5556-46da-b053-e8b14da155bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:38.601976 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4158/8278] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:38.606529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a8ab9-93a9-4cde-88b9-1fac00464225 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:38.619658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a8ab9-93a9-4cde-88b9-1fac00464225 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:38.623777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab12db-0715-42da-9692-13ce40cd14ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:38.624470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab12db-0715-42da-9692-13ce40cd14ef admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.624751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab12db-0715-42da-9692-13ce40cd14ef admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.625023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab12db-0715-42da-9692-13ce40cd14ef admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.625737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab12db-0715-42da-9692-13ce40cd14ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:38.626041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab12db-0715-42da-9692-13ce40cd14ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:38.627705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab12db-0715-42da-9692-13ce40cd14ef admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:38.640200 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4121/8279] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:38.644611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da20c9-5556-46da-b053-e8b14da155bc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:38.653998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da20c9-5556-46da-b053-e8b14da155bc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:38.658587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4bc0a-8c83-40d5-a9cf-db48ce63b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:38.659228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4bc0a-8c83-40d5-a9cf-db48ce63b825 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.659505 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4bc0a-8c83-40d5-a9cf-db48ce63b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.659779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4bc0a-8c83-40d5-a9cf-db48ce63b825 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.660502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4bc0a-8c83-40d5-a9cf-db48ce63b825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:38.662395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4bc0a-8c83-40d5-a9cf-db48ce63b825 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:38.700079 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4159/8280] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:38 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:38.700185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab12db-0715-42da-9692-13ce40cd14ef admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:38.704094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab12db-0715-42da-9692-13ce40cd14ef admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:38.767863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb14bc7-0259-4aad-8252-0b7502cbda04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:38.767863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb14bc7-0259-4aad-8252-0b7502cbda04 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.767863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb14bc7-0259-4aad-8252-0b7502cbda04 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.768256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb14bc7-0259-4aad-8252-0b7502cbda04 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.768811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb14bc7-0259-4aad-8252-0b7502cbda04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:38.770761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb14bc7-0259-4aad-8252-0b7502cbda04 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:38.796651 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4122/8281] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:38 2022] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:38.800554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4bc0a-8c83-40d5-a9cf-db48ce63b825 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:38.817646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4bc0a-8c83-40d5-a9cf-db48ce63b825 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:38.823276 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c93ec-c276-43bd-82f7-a56277227bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:38.824638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c93ec-c276-43bd-82f7-a56277227bdb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.824911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c93ec-c276-43bd-82f7-a56277227bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.825197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c93ec-c276-43bd-82f7-a56277227bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.825938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c93ec-c276-43bd-82f7-a56277227bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:38.827690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c93ec-c276-43bd-82f7-a56277227bdb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:38.840157 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4160/8282] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:38.844337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb14bc7-0259-4aad-8252-0b7502cbda04 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:38.856075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb14bc7-0259-4aad-8252-0b7502cbda04 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:38.863245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0e739-4002-4523-bcf7-801570442fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:38.864168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e739-4002-4523-bcf7-801570442fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.866214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e739-4002-4523-bcf7-801570442fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.866665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e739-4002-4523-bcf7-801570442fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.867615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0e739-4002-4523-bcf7-801570442fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:38.869667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0e739-4002-4523-bcf7-801570442fd5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:38.882076 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4123/8283] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:38.887208 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c93ec-c276-43bd-82f7-a56277227bdb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:38.898953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c93ec-c276-43bd-82f7-a56277227bdb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:38.904599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8fcaa-d48b-4d5a-97b0-e9b11d16942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:38.905624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8fcaa-d48b-4d5a-97b0-e9b11d16942a admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.905910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8fcaa-d48b-4d5a-97b0-e9b11d16942a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.906282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8fcaa-d48b-4d5a-97b0-e9b11d16942a admin admin] PATH_INFO: `/v3/projects/df9f2672a6614bc68f8d4ca81e38dc5d/users/a9231545c795400b949ead61f884a92b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.924433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8fcaa-d48b-4d5a-97b0-e9b11d16942a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9f2672a6614bc68f8d4ca81e38dc5d, user_id=a9231545c795400b949ead61f884a92b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:38.927818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8fcaa-d48b-4d5a-97b0-e9b11d16942a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:38.943351 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4161/8284] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:38 2022] PUT /identity/v3/projects/df9f2672a6614bc68f8d4ca81e38dc5d/users/a9231545c795400b949ead61f884a92b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:38.954657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4ed8b-a6da-40d3-b6d5-456154e06374 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:38.955390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4ed8b-a6da-40d3-b6d5-456154e06374 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:38.955758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da4ed8b-a6da-40d3-b6d5-456154e06374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:38.991006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3da4ed8b-a6da-40d3-b6d5-456154e06374 None None] MFA Rules not processed for user `a9231545c795400b949ead61f884a92b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:38.992394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3da4ed8b-a6da-40d3-b6d5-456154e06374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:39.070889 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4124/8285] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:39.083389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8fcaa-d48b-4d5a-97b0-e9b11d16942a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:39.085202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-41a8fcaa-d48b-4d5a-97b0-e9b11d16942a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:39.155059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8fcaa-d48b-4d5a-97b0-e9b11d16942a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:39.159264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2379d60-ab8a-435d-b418-7a69fa410879 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:39.160030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379d60-ab8a-435d-b418-7a69fa410879 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:39.160402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379d60-ab8a-435d-b418-7a69fa410879 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:39.160707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2379d60-ab8a-435d-b418-7a69fa410879 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:39.170416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2379d60-ab8a-435d-b418-7a69fa410879 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:39.172118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2379d60-ab8a-435d-b418-7a69fa410879 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:39.182225 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4162/8286] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:39.197772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4ed8b-a6da-40d3-b6d5-456154e06374 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:39.265160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da4ed8b-a6da-40d3-b6d5-456154e06374 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:39.269711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:39.270870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:39.271150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:39.271428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] PATH_INFO: `/v3/users/a9231545c795400b949ead61f884a92b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:39.273031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9231545c795400b949ead61f884a92b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:39.275029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:39.325247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9231545c795400b949ead61f884a92b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.332221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9231545c795400b949ead61f884a92b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.332876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9231545c795400b949ead61f884a92b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.333538 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9231545c795400b949ead61f884a92b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.347092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9231545c795400b949ead61f884a92b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.360248 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4125/8287] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:39 2022] DELETE /identity/v3/users/a9231545c795400b949ead61f884a92b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:39.364938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25879-de38-4baf-bcb4-30d897878edc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:39.365228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25879-de38-4baf-bcb4-30d897878edc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:39.365508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c25879-de38-4baf-bcb4-30d897878edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:39.384203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c3c25879-de38-4baf-bcb4-30d897878edc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:39.385597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c3c25879-de38-4baf-bcb4-30d897878edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:39.449778 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4163/8288] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:39.460668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:39.462280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:39.523140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3689fb-e51b-4059-9a81-7b3813ec7105 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:39.527643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a400e12-33aa-4d86-811a-b1b9a2b6e37b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:39.528327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400e12-33aa-4d86-811a-b1b9a2b6e37b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:39.528615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400e12-33aa-4d86-811a-b1b9a2b6e37b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:39.528893 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a400e12-33aa-4d86-811a-b1b9a2b6e37b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:39.538355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a400e12-33aa-4d86-811a-b1b9a2b6e37b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:39.539757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a400e12-33aa-4d86-811a-b1b9a2b6e37b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:39.549924 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4126/8289] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:39.855511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25879-de38-4baf-bcb4-30d897878edc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:39.856986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c3c25879-de38-4baf-bcb4-30d897878edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:39.870840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c25879-de38-4baf-bcb4-30d897878edc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:39.875721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:39.877424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:39.877712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:39.878038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] PATH_INFO: `/v3/projects/df9f2672a6614bc68f8d4ca81e38dc5d` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:39.879272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9f2672a6614bc68f8d4ca81e38dc5d)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:39.882114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:39.932504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9f2672a6614bc68f8d4ca81e38dc5d', 'request_id': 'req-2993ab9d-3d0f-410f-bc51-a1a25217a703'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.940125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9f2672a6614bc68f8d4ca81e38dc5d', 'request_id': 'req-2993ab9d-3d0f-410f-bc51-a1a25217a703'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.946562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9f2672a6614bc68f8d4ca81e38dc5d', 'request_id': 'req-2993ab9d-3d0f-410f-bc51-a1a25217a703'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.959647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] The token cache is being invalidate because project df9f2672a6614bc68f8d4ca81e38dc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:39.959976 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.960652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2993ab9d-3d0f-410f-bc51-a1a25217a703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:39.962449 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4164/8290] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:39 2022] DELETE /identity/v3/projects/df9f2672a6614bc68f8d4ca81e38dc5d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:39.968120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90757-3636-409d-861b-f1b1a380312d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:39.968569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90757-3636-409d-861b-f1b1a380312d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:39.968754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b90757-3636-409d-861b-f1b1a380312d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:39.999947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-87b90757-3636-409d-861b-f1b1a380312d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:40.001261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-87b90757-3636-409d-861b-f1b1a380312d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:40.071388 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4127/8291] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:40.081189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eefd8-289a-40a1-b4b8-fd05d278fd5b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:40.081560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eefd8-289a-40a1-b4b8-fd05d278fd5b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:40.081810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7eefd8-289a-40a1-b4b8-fd05d278fd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:40.102410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0d7eefd8-289a-40a1-b4b8-fd05d278fd5b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:40.103625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0d7eefd8-289a-40a1-b4b8-fd05d278fd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:40.112382 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4165/8292] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:40.116765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b90757-3636-409d-861b-f1b1a380312d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:40.129096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b90757-3636-409d-861b-f1b1a380312d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:40.134494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1854bc6-63f7-4ec3-930c-a849cbc469eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:40.135225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1854bc6-63f7-4ec3-930c-a849cbc469eb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:40.135545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1854bc6-63f7-4ec3-930c-a849cbc469eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:40.135885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1854bc6-63f7-4ec3-930c-a849cbc469eb admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:40.136750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1854bc6-63f7-4ec3-930c-a849cbc469eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:40.137061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1854bc6-63f7-4ec3-930c-a849cbc469eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:40.138973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1854bc6-63f7-4ec3-930c-a849cbc469eb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:40.152353 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4128/8293] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:40.156738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eefd8-289a-40a1-b4b8-fd05d278fd5b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:40.166600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7eefd8-289a-40a1-b4b8-fd05d278fd5b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:40.176571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119945aa-f5b3-47b8-9b75-c3ae4e83050b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:40.177242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119945aa-f5b3-47b8-9b75-c3ae4e83050b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:40.177532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119945aa-f5b3-47b8-9b75-c3ae4e83050b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:40.177818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119945aa-f5b3-47b8-9b75-c3ae4e83050b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:40.178547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119945aa-f5b3-47b8-9b75-c3ae4e83050b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:40.180503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119945aa-f5b3-47b8-9b75-c3ae4e83050b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:40.207727 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4166/8294] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:40 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:40.212215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1854bc6-63f7-4ec3-930c-a849cbc469eb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:40.225136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1854bc6-63f7-4ec3-930c-a849cbc469eb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:40.285971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0519efc-8fe1-4061-aa7a-fc91f43a68be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:40.286645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0519efc-8fe1-4061-aa7a-fc91f43a68be admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:40.286929 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0519efc-8fe1-4061-aa7a-fc91f43a68be admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:40.287204 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0519efc-8fe1-4061-aa7a-fc91f43a68be admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:40.287890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0519efc-8fe1-4061-aa7a-fc91f43a68be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:40.289977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0519efc-8fe1-4061-aa7a-fc91f43a68be admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:40.313907 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4129/8295] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:40 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:40.315302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119945aa-f5b3-47b8-9b75-c3ae4e83050b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:40.326135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119945aa-f5b3-47b8-9b75-c3ae4e83050b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:40.330924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdea8f-d644-4ff4-afbb-452c92ab0d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:40.331593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdea8f-d644-4ff4-afbb-452c92ab0d96 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:40.331883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdea8f-d644-4ff4-afbb-452c92ab0d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:40.332197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdea8f-d644-4ff4-afbb-452c92ab0d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:40.333098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdea8f-d644-4ff4-afbb-452c92ab0d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:40.334897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdea8f-d644-4ff4-afbb-452c92ab0d96 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:40.348387 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4167/8296] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:40.352246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0519efc-8fe1-4061-aa7a-fc91f43a68be admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:40.364442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0519efc-8fe1-4061-aa7a-fc91f43a68be admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:40.369425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb309cf-4659-4206-bca4-0d76bf9c51d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:40.370118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb309cf-4659-4206-bca4-0d76bf9c51d7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:40.370438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb309cf-4659-4206-bca4-0d76bf9c51d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:40.370842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb309cf-4659-4206-bca4-0d76bf9c51d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:40.371580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb309cf-4659-4206-bca4-0d76bf9c51d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:40.373548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb309cf-4659-4206-bca4-0d76bf9c51d7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:40.387152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4130/8297] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:40.388427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdea8f-d644-4ff4-afbb-452c92ab0d96 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:40.398748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdea8f-d644-4ff4-afbb-452c92ab0d96 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:40.403962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea952e-376f-4b4e-8237-88273b61d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:40.404890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea952e-376f-4b4e-8237-88273b61d33d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:40.405178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea952e-376f-4b4e-8237-88273b61d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:40.405456 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ea952e-376f-4b4e-8237-88273b61d33d admin admin] PATH_INFO: `/v3/projects/621ac264ca9b4159912499c21dda18d2/users/9249b429f9ea429e80e18261918154df/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:40.420323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea952e-376f-4b4e-8237-88273b61d33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=621ac264ca9b4159912499c21dda18d2, user_id=9249b429f9ea429e80e18261918154df, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:40.423010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ea952e-376f-4b4e-8237-88273b61d33d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:40.436919 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4168/8298] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:40 2022] PUT /identity/v3/projects/621ac264ca9b4159912499c21dda18d2/users/9249b429f9ea429e80e18261918154df/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:40.446410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d7a32-638c-4ecf-80e4-bac7cbdc94b5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:40.446703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d7a32-638c-4ecf-80e4-bac7cbdc94b5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:40.446983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d7a32-638c-4ecf-80e4-bac7cbdc94b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:40.474597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-847d7a32-638c-4ecf-80e4-bac7cbdc94b5 None None] MFA Rules not processed for user `9249b429f9ea429e80e18261918154df`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:40.475777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-847d7a32-638c-4ecf-80e4-bac7cbdc94b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:40.538413 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4131/8299] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:40.548901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea952e-376f-4b4e-8237-88273b61d33d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:40.550653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-65ea952e-376f-4b4e-8237-88273b61d33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:40.607889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ea952e-376f-4b4e-8237-88273b61d33d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:40.611539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1cf9b-2ee9-41a1-be90-27b87671b3f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:40.612209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1cf9b-2ee9-41a1-be90-27b87671b3f7 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:40.612493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1cf9b-2ee9-41a1-be90-27b87671b3f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:40.612764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1cf9b-2ee9-41a1-be90-27b87671b3f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:40.620970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1cf9b-2ee9-41a1-be90-27b87671b3f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:40.622418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1cf9b-2ee9-41a1-be90-27b87671b3f7 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:40.630964 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4169/8300] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:42.179511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d7a32-638c-4ecf-80e4-bac7cbdc94b5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:42.180950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-847d7a32-638c-4ecf-80e4-bac7cbdc94b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:42.249479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d7a32-638c-4ecf-80e4-bac7cbdc94b5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:42.254744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:42.255615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:42.255896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:42.256200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] PATH_INFO: `/v3/users/8dc229bba13b494dbbaf683ec3b1eb5f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:42.257420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc229bba13b494dbbaf683ec3b1eb5f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:42.259444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:42.309869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc229bba13b494dbbaf683ec3b1eb5f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:42.317787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc229bba13b494dbbaf683ec3b1eb5f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:42.318546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc229bba13b494dbbaf683ec3b1eb5f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:42.319322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc229bba13b494dbbaf683ec3b1eb5f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:42.331787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc229bba13b494dbbaf683ec3b1eb5f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:42.344556 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4132/8301] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:42 2022] DELETE /identity/v3/users/8dc229bba13b494dbbaf683ec3b1eb5f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:42.349311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452310-dee4-43e5-b7b0-bf9823cc81c4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:42.349787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452310-dee4-43e5-b7b0-bf9823cc81c4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:42.349877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452310-dee4-43e5-b7b0-bf9823cc81c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:42.367175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9d452310-dee4-43e5-b7b0-bf9823cc81c4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:42.368419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9d452310-dee4-43e5-b7b0-bf9823cc81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:42.436154 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4170/8302] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:42.445065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:42.446562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:42.508313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f71c1a-9452-477d-9305-4cbdcbac3e43 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:42.512561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bdc4a-f835-453d-9e4c-746e1d087d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:42.513209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bdc4a-f835-453d-9e4c-746e1d087d53 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:42.513498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bdc4a-f835-453d-9e4c-746e1d087d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:42.513774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bdc4a-f835-453d-9e4c-746e1d087d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:42.522978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bdc4a-f835-453d-9e4c-746e1d087d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:42.524495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bdc4a-f835-453d-9e4c-746e1d087d53 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:42.536005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4133/8303] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:42.927460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d452310-dee4-43e5-b7b0-bf9823cc81c4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:42.929186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9d452310-dee4-43e5-b7b0-bf9823cc81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:42.945133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d452310-dee4-43e5-b7b0-bf9823cc81c4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:42.953826 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:42.954771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:42.955831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:42.955831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] PATH_INFO: `/v3/projects/1c2dc693fa9243e8b68eb9ff4a5c2d95` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:42.957409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2dc693fa9243e8b68eb9ff4a5c2d95)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:42.959823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:43.016819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2dc693fa9243e8b68eb9ff4a5c2d95', 'request_id': 'req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.029006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2dc693fa9243e8b68eb9ff4a5c2d95', 'request_id': 'req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.034979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2dc693fa9243e8b68eb9ff4a5c2d95', 'request_id': 'req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.046231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] The token cache is being invalidate because project 1c2dc693fa9243e8b68eb9ff4a5c2d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:43.046530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.047196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.048979 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4171/8304] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:42 2022] DELETE /identity/v3/projects/1c2dc693fa9243e8b68eb9ff4a5c2d95 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:43.053636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bdc4a-f835-453d-9e4c-746e1d087d53 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:43.065189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bdc4a-f835-453d-9e4c-746e1d087d53 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:43.125663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:43.127058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:43.127659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:43.128142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] PATH_INFO: `/v3/users/871ae14dacdb49658326931151374e91` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:43.130403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=871ae14dacdb49658326931151374e91)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:43.132422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:43.192811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871ae14dacdb49658326931151374e91'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.202124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871ae14dacdb49658326931151374e91'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.204308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871ae14dacdb49658326931151374e91'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.205198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871ae14dacdb49658326931151374e91'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.219323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4a85cc9b-478f-4a8e-88a9-d882faa776a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871ae14dacdb49658326931151374e91'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.232739 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4134/8305] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:43 2022] DELETE /identity/v3/users/871ae14dacdb49658326931151374e91 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:43.604460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:43.606450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:43.620830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9672e07-3fea-4ebb-ba1b-cb11ef92a64e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:43.684830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:43.685831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:43.686096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:43.686406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] PATH_INFO: `/v3/projects/750263ec3a0f4b24abe0971caa2875d7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:43.687637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] RBAC: Authorizing `identity:delete_project(project_id=750263ec3a0f4b24abe0971caa2875d7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:43.689602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:43.736944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750263ec3a0f4b24abe0971caa2875d7', 'request_id': 'req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.744030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750263ec3a0f4b24abe0971caa2875d7', 'request_id': 'req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.750178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750263ec3a0f4b24abe0971caa2875d7', 'request_id': 'req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.761792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] The token cache is being invalidate because project 750263ec3a0f4b24abe0971caa2875d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:43.762085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.762738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79d1d0d-df7a-4619-8c49-6164e2fbe11c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:43.764352 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4172/8306] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:43 2022] DELETE /identity/v3/projects/750263ec3a0f4b24abe0971caa2875d7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:43.770477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50952-cde6-4500-9c15-6e292c5c38a4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:43.770771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50952-cde6-4500-9c15-6e292c5c38a4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:43.771075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb50952-cde6-4500-9c15-6e292c5c38a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:43.789079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-deb50952-cde6-4500-9c15-6e292c5c38a4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:43.790311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-deb50952-cde6-4500-9c15-6e292c5c38a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:43.850348 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4135/8307] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:43.954713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4107f1-ded2-42f3-80f3-ee08d6f1ecb7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:43.955002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4107f1-ded2-42f3-80f3-ee08d6f1ecb7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:43.955279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4107f1-ded2-42f3-80f3-ee08d6f1ecb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:43.974486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2d4107f1-ded2-42f3-80f3-ee08d6f1ecb7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:43.976241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2d4107f1-ded2-42f3-80f3-ee08d6f1ecb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:43.988658 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4173/8308] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:43.995704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50952-cde6-4500-9c15-6e292c5c38a4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:44.006122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb50952-cde6-4500-9c15-6e292c5c38a4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:44.011378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ab7d7-5430-4800-8f79-b2b85b350efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:44.012089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ab7d7-5430-4800-8f79-b2b85b350efc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.012397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ab7d7-5430-4800-8f79-b2b85b350efc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.012673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ab7d7-5430-4800-8f79-b2b85b350efc admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.013392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ab7d7-5430-4800-8f79-b2b85b350efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:44.013697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ab7d7-5430-4800-8f79-b2b85b350efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:44.015314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ab7d7-5430-4800-8f79-b2b85b350efc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:44.032627 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4136/8309] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:44.033895 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4107f1-ded2-42f3-80f3-ee08d6f1ecb7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:44.045843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4107f1-ded2-42f3-80f3-ee08d6f1ecb7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:44.051275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777576f-bb46-437d-acb5-6a47f6da1ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:44.051966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777576f-bb46-437d-acb5-6a47f6da1ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.052255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777576f-bb46-437d-acb5-6a47f6da1ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.052544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777576f-bb46-437d-acb5-6a47f6da1ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.053235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777576f-bb46-437d-acb5-6a47f6da1ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:44.055165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d777576f-bb46-437d-acb5-6a47f6da1ac4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:44.081482 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4174/8310] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:44 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:44.085904 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ab7d7-5430-4800-8f79-b2b85b350efc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:44.096659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ab7d7-5430-4800-8f79-b2b85b350efc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:44.153596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78cfa-bdec-487d-a706-75d0ec32ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:44.154261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78cfa-bdec-487d-a706-75d0ec32ab5e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.154542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78cfa-bdec-487d-a706-75d0ec32ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.154816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef78cfa-bdec-487d-a706-75d0ec32ab5e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.155494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef78cfa-bdec-487d-a706-75d0ec32ab5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:44.157456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef78cfa-bdec-487d-a706-75d0ec32ab5e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:44.180682 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4137/8311] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:44 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:44.185116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777576f-bb46-437d-acb5-6a47f6da1ac4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:44.196657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d777576f-bb46-437d-acb5-6a47f6da1ac4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:44.204714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897dc6e-fa5f-488d-a1df-0d349bc432ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:44.205380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897dc6e-fa5f-488d-a1df-0d349bc432ea admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.205662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897dc6e-fa5f-488d-a1df-0d349bc432ea admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.205938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897dc6e-fa5f-488d-a1df-0d349bc432ea admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.206662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897dc6e-fa5f-488d-a1df-0d349bc432ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:44.208383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897dc6e-fa5f-488d-a1df-0d349bc432ea admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:44.219216 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4175/8312] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:44.223438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78cfa-bdec-487d-a706-75d0ec32ab5e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:44.233601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef78cfa-bdec-487d-a706-75d0ec32ab5e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:44.238242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773814b-5509-4eea-87c9-f914bf0a35bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:44.238962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773814b-5509-4eea-87c9-f914bf0a35bb admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.239315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773814b-5509-4eea-87c9-f914bf0a35bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.239659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773814b-5509-4eea-87c9-f914bf0a35bb admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.242198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773814b-5509-4eea-87c9-f914bf0a35bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:44.242198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773814b-5509-4eea-87c9-f914bf0a35bb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:44.253171 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4138/8313] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:44.257431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897dc6e-fa5f-488d-a1df-0d349bc432ea admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:44.268115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897dc6e-fa5f-488d-a1df-0d349bc432ea admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:44.273065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097962f-41a8-417e-8c38-aa5cadafadbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:44.273974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097962f-41a8-417e-8c38-aa5cadafadbe admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.274258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097962f-41a8-417e-8c38-aa5cadafadbe admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.274538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097962f-41a8-417e-8c38-aa5cadafadbe admin admin] PATH_INFO: `/v3/projects/5a3910e7ecac45ffa6720b4e8a340bb6/users/5e1273e21bb54e1d99ef5eef1953094c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.289887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097962f-41a8-417e-8c38-aa5cadafadbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a3910e7ecac45ffa6720b4e8a340bb6, user_id=5e1273e21bb54e1d99ef5eef1953094c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:44.293281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097962f-41a8-417e-8c38-aa5cadafadbe admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:44.307531 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4176/8314] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:44 2022] PUT /identity/v3/projects/5a3910e7ecac45ffa6720b4e8a340bb6/users/5e1273e21bb54e1d99ef5eef1953094c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:44.319507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1556e-c51a-45ad-afc5-b66e44d78a29 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.319805 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1556e-c51a-45ad-afc5-b66e44d78a29 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.320123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1556e-c51a-45ad-afc5-b66e44d78a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.347786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-58a1556e-c51a-45ad-afc5-b66e44d78a29 None None] MFA Rules not processed for user `5e1273e21bb54e1d99ef5eef1953094c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:44.349053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-58a1556e-c51a-45ad-afc5-b66e44d78a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:44.415160 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4139/8315] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:44.428999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097962f-41a8-417e-8c38-aa5cadafadbe admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:44.431152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1097962f-41a8-417e-8c38-aa5cadafadbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:44.498340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097962f-41a8-417e-8c38-aa5cadafadbe admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:44.502363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95139a-0832-471a-841a-c071402a186a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:44.503378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95139a-0832-471a-841a-c071402a186a service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.503605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95139a-0832-471a-841a-c071402a186a service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.503876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95139a-0832-471a-841a-c071402a186a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.515291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95139a-0832-471a-841a-c071402a186a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:44.516806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95139a-0832-471a-841a-c071402a186a service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:44.527407 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4177/8316] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:44.549453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1556e-c51a-45ad-afc5-b66e44d78a29 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:44.624218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1556e-c51a-45ad-afc5-b66e44d78a29 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:44.628830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:44.629695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.629980 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.630241 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] PATH_INFO: `/v3/users/5e1273e21bb54e1d99ef5eef1953094c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.631449 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1273e21bb54e1d99ef5eef1953094c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:44.633415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:44.682672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1273e21bb54e1d99ef5eef1953094c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:44.690196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1273e21bb54e1d99ef5eef1953094c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:44.690828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1273e21bb54e1d99ef5eef1953094c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:44.691434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1273e21bb54e1d99ef5eef1953094c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:44.704842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1273e21bb54e1d99ef5eef1953094c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:44.717258 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4140/8317] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:44 2022] DELETE /identity/v3/users/5e1273e21bb54e1d99ef5eef1953094c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:44.721494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752d1d-67b5-49b5-a877-147484e2c970 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.721960 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752d1d-67b5-49b5-a877-147484e2c970 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.722079 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752d1d-67b5-49b5-a877-147484e2c970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.739869 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0e752d1d-67b5-49b5-a877-147484e2c970 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:44.741084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0e752d1d-67b5-49b5-a877-147484e2c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:44.807167 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4178/8318] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:44.816789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:44.818216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:44.880200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994ec8-fdab-48b3-900d-c68fbec24449 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:44.884429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281c3a2-418d-4037-a810-b4c0b46120aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:44.885097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281c3a2-418d-4037-a810-b4c0b46120aa service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:44.885455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281c3a2-418d-4037-a810-b4c0b46120aa service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:44.885656 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281c3a2-418d-4037-a810-b4c0b46120aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:44.895539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281c3a2-418d-4037-a810-b4c0b46120aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:44.897092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281c3a2-418d-4037-a810-b4c0b46120aa service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:44.907238 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4141/8319] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:45.317764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752d1d-67b5-49b5-a877-147484e2c970 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.319187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0e752d1d-67b5-49b5-a877-147484e2c970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:45.337528 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752d1d-67b5-49b5-a877-147484e2c970 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.343114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.344183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.344519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.344885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] PATH_INFO: `/v3/projects/5a3910e7ecac45ffa6720b4e8a340bb6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.348335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a3910e7ecac45ffa6720b4e8a340bb6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.350677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.365577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281c3a2-418d-4037-a810-b4c0b46120aa service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.367649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6281c3a2-418d-4037-a810-b4c0b46120aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:45.382613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281c3a2-418d-4037-a810-b4c0b46120aa service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.388945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.390246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.390610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.390966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] PATH_INFO: `/v3/users/9249b429f9ea429e80e18261918154df` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.392249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9249b429f9ea429e80e18261918154df)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.394232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.405002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a3910e7ecac45ffa6720b4e8a340bb6', 'request_id': 'req-5291ba1f-9f59-44e9-9e75-0c755e88b022'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.412612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a3910e7ecac45ffa6720b4e8a340bb6', 'request_id': 'req-5291ba1f-9f59-44e9-9e75-0c755e88b022'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.418644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a3910e7ecac45ffa6720b4e8a340bb6', 'request_id': 'req-5291ba1f-9f59-44e9-9e75-0c755e88b022'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.430233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] The token cache is being invalidate because project 5a3910e7ecac45ffa6720b4e8a340bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:45.430602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.431250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5291ba1f-9f59-44e9-9e75-0c755e88b022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.433579 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4179/8320] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:45 2022] DELETE /identity/v3/projects/5a3910e7ecac45ffa6720b4e8a340bb6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:45.438105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4321b-4a0d-4008-9aaf-f6f291602ab4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.438398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4321b-4a0d-4008-9aaf-f6f291602ab4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.438681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4321b-4a0d-4008-9aaf-f6f291602ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.440502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9249b429f9ea429e80e18261918154df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.448052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9249b429f9ea429e80e18261918154df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.449284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9249b429f9ea429e80e18261918154df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.449890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9249b429f9ea429e80e18261918154df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.457271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c7a4321b-4a0d-4008-9aaf-f6f291602ab4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:45.458470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c7a4321b-4a0d-4008-9aaf-f6f291602ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:45.461639 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-fc5b5013-768e-4687-8ac7-ade6581c7b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9249b429f9ea429e80e18261918154df'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.474148 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4142/8321] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:45 2022] DELETE /identity/v3/users/9249b429f9ea429e80e18261918154df => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:45.478628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0927a4f-5a9d-48b4-848f-d24d20a66bde None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.478918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0927a4f-5a9d-48b4-848f-d24d20a66bde None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.479264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0927a4f-5a9d-48b4-848f-d24d20a66bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.496160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a0927a4f-5a9d-48b4-848f-d24d20a66bde None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:45.497349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a0927a4f-5a9d-48b4-848f-d24d20a66bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:45.518367 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4180/8322] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:45.526045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4b1b-bec9-476b-84e1-6535e3267cfb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.526397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4b1b-bec9-476b-84e1-6535e3267cfb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.526679 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d4b1b-bec9-476b-84e1-6535e3267cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.544169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-064d4b1b-bec9-476b-84e1-6535e3267cfb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:45.545349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-064d4b1b-bec9-476b-84e1-6535e3267cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:45.555290 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4143/8323] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:45.565353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0927a4f-5a9d-48b4-848f-d24d20a66bde None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.566703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a0927a4f-5a9d-48b4-848f-d24d20a66bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:45.605669 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4181/8324] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:45.606927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d4b1b-bec9-476b-84e1-6535e3267cfb None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.616054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d4b1b-bec9-476b-84e1-6535e3267cfb None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.621418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeb8bd-749e-484e-884d-353137a2500e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.622107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeb8bd-749e-484e-884d-353137a2500e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.622400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeb8bd-749e-484e-884d-353137a2500e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.622681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aeb8bd-749e-484e-884d-353137a2500e admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.623413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeb8bd-749e-484e-884d-353137a2500e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:45.623721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeb8bd-749e-484e-884d-353137a2500e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.625078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0927a4f-5a9d-48b4-848f-d24d20a66bde None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.625368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aeb8bd-749e-484e-884d-353137a2500e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.629694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29edea-3f72-4fa9-a0e3-f979490dcbf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.630341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29edea-3f72-4fa9-a0e3-f979490dcbf3 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.630626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29edea-3f72-4fa9-a0e3-f979490dcbf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.630902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29edea-3f72-4fa9-a0e3-f979490dcbf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.638027 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4182/8325] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:17:45.641014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29edea-3f72-4fa9-a0e3-f979490dcbf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.642226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeb8bd-749e-484e-884d-353137a2500e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.642474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29edea-3f72-4fa9-a0e3-f979490dcbf3 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.652373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aeb8bd-749e-484e-884d-353137a2500e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.653307 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4144/8326] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:17:45.657340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d994243-8dad-44d5-817d-b841954822ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.657973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d994243-8dad-44d5-817d-b841954822ce admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.658255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d994243-8dad-44d5-817d-b841954822ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.658529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d994243-8dad-44d5-817d-b841954822ce admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.659205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d994243-8dad-44d5-817d-b841954822ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.661134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d994243-8dad-44d5-817d-b841954822ce admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.689773 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4183/8327] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:45 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:45.693971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29edea-3f72-4fa9-a0e3-f979490dcbf3 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.703976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29edea-3f72-4fa9-a0e3-f979490dcbf3 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.773678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d56f60-5978-4a2d-8d08-8815f7486699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.774641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d56f60-5978-4a2d-8d08-8815f7486699 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.774938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d56f60-5978-4a2d-8d08-8815f7486699 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.775213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d56f60-5978-4a2d-8d08-8815f7486699 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.776071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d56f60-5978-4a2d-8d08-8815f7486699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.779072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d56f60-5978-4a2d-8d08-8815f7486699 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.804815 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4145/8328] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:45 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:45.808916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d994243-8dad-44d5-817d-b841954822ce admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.820539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d994243-8dad-44d5-817d-b841954822ce admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.827417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94695ba-2a12-4a8c-9ec5-f705b1b77d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.828138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94695ba-2a12-4a8c-9ec5-f705b1b77d1a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.828444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94695ba-2a12-4a8c-9ec5-f705b1b77d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.828720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94695ba-2a12-4a8c-9ec5-f705b1b77d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.829434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94695ba-2a12-4a8c-9ec5-f705b1b77d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.831053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94695ba-2a12-4a8c-9ec5-f705b1b77d1a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.842085 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4184/8329] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:45.845943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d56f60-5978-4a2d-8d08-8815f7486699 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.856767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d56f60-5978-4a2d-8d08-8815f7486699 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.862514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d75a8-c150-47ab-8360-82ab17dace9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.863733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d75a8-c150-47ab-8360-82ab17dace9f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.864373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d75a8-c150-47ab-8360-82ab17dace9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.864891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d75a8-c150-47ab-8360-82ab17dace9f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.866324 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d75a8-c150-47ab-8360-82ab17dace9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.868968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d75a8-c150-47ab-8360-82ab17dace9f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.880275 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4146/8330] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:45.884725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94695ba-2a12-4a8c-9ec5-f705b1b77d1a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.887777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d75a8-c150-47ab-8360-82ab17dace9f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:45.889860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9d2d75a8-c150-47ab-8360-82ab17dace9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:45.896090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94695ba-2a12-4a8c-9ec5-f705b1b77d1a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.902954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d75a8-c150-47ab-8360-82ab17dace9f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:45.904606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba752ef-23bc-4ed6-9b49-91e77755627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.905573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba752ef-23bc-4ed6-9b49-91e77755627a admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.906269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba752ef-23bc-4ed6-9b49-91e77755627a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.906269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba752ef-23bc-4ed6-9b49-91e77755627a admin admin] PATH_INFO: `/v3/projects/fe8ba0bfc1324e3291c1766562f379e3/users/e9cccd717d874ea294cf1b606a1e6adf/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.908191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:45.909117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.909478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.910455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] PATH_INFO: `/v3/projects/621ac264ca9b4159912499c21dda18d2` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.911097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=621ac264ca9b4159912499c21dda18d2)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.913223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.923886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba752ef-23bc-4ed6-9b49-91e77755627a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8ba0bfc1324e3291c1766562f379e3, user_id=e9cccd717d874ea294cf1b606a1e6adf, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:45.926924 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba752ef-23bc-4ed6-9b49-91e77755627a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:45.941014 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4185/8331] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:45 2022] PUT /identity/v3/projects/fe8ba0bfc1324e3291c1766562f379e3/users/e9cccd717d874ea294cf1b606a1e6adf/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:45.952411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128ab2-d093-4fd8-aa74-b1ac0fb3f833 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:45.952807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128ab2-d093-4fd8-aa74-b1ac0fb3f833 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:45.953191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b128ab2-d093-4fd8-aa74-b1ac0fb3f833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:45.964104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621ac264ca9b4159912499c21dda18d2', 'request_id': 'req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.973507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621ac264ca9b4159912499c21dda18d2', 'request_id': 'req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.980584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621ac264ca9b4159912499c21dda18d2', 'request_id': 'req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.981560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5b128ab2-d093-4fd8-aa74-b1ac0fb3f833 None None] MFA Rules not processed for user `e9cccd717d874ea294cf1b606a1e6adf`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:45.983133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b128ab2-d093-4fd8-aa74-b1ac0fb3f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:45.993290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] The token cache is being invalidate because project 621ac264ca9b4159912499c21dda18d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:45.993578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:45.994775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2e6b5c2d-ae73-4fb3-9438-d402e73e02dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:46.000438 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4147/8332] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:45 2022] DELETE /identity/v3/projects/621ac264ca9b4159912499c21dda18d2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:46.001832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfb945-566b-4e28-a1ff-fd7a7555b6c4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.002212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfb945-566b-4e28-a1ff-fd7a7555b6c4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.003016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bfb945-566b-4e28-a1ff-fd7a7555b6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.026393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-28bfb945-566b-4e28-a1ff-fd7a7555b6c4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:46.029091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-28bfb945-566b-4e28-a1ff-fd7a7555b6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:46.064481 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4186/8333] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:46.082282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128ab2-d093-4fd8-aa74-b1ac0fb3f833 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.084085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5b128ab2-d093-4fd8-aa74-b1ac0fb3f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:46.096737 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4148/8334] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:46.106371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764880f1-87b7-47fd-b2ae-84a6d7660d9b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.106983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764880f1-87b7-47fd-b2ae-84a6d7660d9b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.107415 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764880f1-87b7-47fd-b2ae-84a6d7660d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.128658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-764880f1-87b7-47fd-b2ae-84a6d7660d9b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:46.130079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-764880f1-87b7-47fd-b2ae-84a6d7660d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:46.141785 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4149/8335] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:46.146320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764880f1-87b7-47fd-b2ae-84a6d7660d9b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.157086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764880f1-87b7-47fd-b2ae-84a6d7660d9b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.161985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8644-11a4-4b89-99a9-77e7effb9493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.162691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8644-11a4-4b89-99a9-77e7effb9493 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.164013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8644-11a4-4b89-99a9-77e7effb9493 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.164013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e8644-11a4-4b89-99a9-77e7effb9493 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.164230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e8644-11a4-4b89-99a9-77e7effb9493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:46.165238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e8644-11a4-4b89-99a9-77e7effb9493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.167620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e8644-11a4-4b89-99a9-77e7effb9493 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.170750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b128ab2-d093-4fd8-aa74-b1ac0fb3f833 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.175062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512c0b0-ec99-48b6-a6f8-2a220cf9b567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.176260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512c0b0-ec99-48b6-a6f8-2a220cf9b567 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.176672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512c0b0-ec99-48b6-a6f8-2a220cf9b567 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.177076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512c0b0-ec99-48b6-a6f8-2a220cf9b567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.181670 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4150/8336] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:17:46.186035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8644-11a4-4b89-99a9-77e7effb9493 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.190082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512c0b0-ec99-48b6-a6f8-2a220cf9b567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.191762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512c0b0-ec99-48b6-a6f8-2a220cf9b567 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.197336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e8644-11a4-4b89-99a9-77e7effb9493 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.202068 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4187/8337] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:17:46.213045 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68961b90-b750-4ac3-96fd-961990bec7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.214495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68961b90-b750-4ac3-96fd-961990bec7be admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.215536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68961b90-b750-4ac3-96fd-961990bec7be admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.215536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68961b90-b750-4ac3-96fd-961990bec7be admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.215752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68961b90-b750-4ac3-96fd-961990bec7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.217957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68961b90-b750-4ac3-96fd-961990bec7be admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.252687 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4151/8338] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:46 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:46.256896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512c0b0-ec99-48b6-a6f8-2a220cf9b567 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.268493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512c0b0-ec99-48b6-a6f8-2a220cf9b567 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.324546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1f6d8-a8f1-4cba-a660-d674d941dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.325363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1f6d8-a8f1-4cba-a660-d674d941dc17 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.325749 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1f6d8-a8f1-4cba-a660-d674d941dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.326176 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1f6d8-a8f1-4cba-a660-d674d941dc17 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.327004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1f6d8-a8f1-4cba-a660-d674d941dc17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.329290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1f6d8-a8f1-4cba-a660-d674d941dc17 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.349419 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4188/8339] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:46 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:46.353955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68961b90-b750-4ac3-96fd-961990bec7be admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.364790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68961b90-b750-4ac3-96fd-961990bec7be admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.371104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64ea18-d6e4-4b53-86e3-739e10d4c9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.371833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64ea18-d6e4-4b53-86e3-739e10d4c9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.372187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64ea18-d6e4-4b53-86e3-739e10d4c9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.372521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc64ea18-d6e4-4b53-86e3-739e10d4c9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.373274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64ea18-d6e4-4b53-86e3-739e10d4c9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.375065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc64ea18-d6e4-4b53-86e3-739e10d4c9a0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.385399 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4152/8340] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:17:46.389984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1f6d8-a8f1-4cba-a660-d674d941dc17 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.399785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1f6d8-a8f1-4cba-a660-d674d941dc17 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.405271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f6882-1e87-422b-b032-9475bccd17b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.405995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f6882-1e87-422b-b032-9475bccd17b2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.406295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f6882-1e87-422b-b032-9475bccd17b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.406565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f6882-1e87-422b-b032-9475bccd17b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.407403 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f6882-1e87-422b-b032-9475bccd17b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.409264 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f6882-1e87-422b-b032-9475bccd17b2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.419661 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4189/8341] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:46.423889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64ea18-d6e4-4b53-86e3-739e10d4c9a0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.435215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc64ea18-d6e4-4b53-86e3-739e10d4c9a0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.440728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acf4e7-5cbc-46c4-a0a0-9ebe2df74bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.442149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf4e7-5cbc-46c4-a0a0-9ebe2df74bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.442149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf4e7-5cbc-46c4-a0a0-9ebe2df74bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.442468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf4e7-5cbc-46c4-a0a0-9ebe2df74bd7 admin admin] PATH_INFO: `/v3/projects/a5b69801e1ff4bf099150bfd6f8dc4a7/users/44eca36268a9492dbe1a36a3ed9a9ace/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.460769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acf4e7-5cbc-46c4-a0a0-9ebe2df74bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b69801e1ff4bf099150bfd6f8dc4a7, user_id=44eca36268a9492dbe1a36a3ed9a9ace, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.463743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acf4e7-5cbc-46c4-a0a0-9ebe2df74bd7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.478062 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4153/8342] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:46 2022] PUT /identity/v3/projects/a5b69801e1ff4bf099150bfd6f8dc4a7/users/44eca36268a9492dbe1a36a3ed9a9ace/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:46.488200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b928934-154f-440f-b8a5-24e8b0932e64 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.488501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b928934-154f-440f-b8a5-24e8b0932e64 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.488784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b928934-154f-440f-b8a5-24e8b0932e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.517990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2b928934-154f-440f-b8a5-24e8b0932e64 None None] MFA Rules not processed for user `44eca36268a9492dbe1a36a3ed9a9ace`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:46.519422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2b928934-154f-440f-b8a5-24e8b0932e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:46.588266 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4190/8343] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:46.592643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acf4e7-5cbc-46c4-a0a0-9ebe2df74bd7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.656960 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acf4e7-5cbc-46c4-a0a0-9ebe2df74bd7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.662754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd21052-58b1-43a0-bd1d-b8faa0620005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.663414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd21052-58b1-43a0-bd1d-b8faa0620005 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.663748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd21052-58b1-43a0-bd1d-b8faa0620005 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.664082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd21052-58b1-43a0-bd1d-b8faa0620005 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.664979 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd21052-58b1-43a0-bd1d-b8faa0620005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.667847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd21052-58b1-43a0-bd1d-b8faa0620005 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.696955 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4154/8344] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:46 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:46.701030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b928934-154f-440f-b8a5-24e8b0932e64 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.713883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b928934-154f-440f-b8a5-24e8b0932e64 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.768683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e8164-7cd1-4ff4-a1ff-d21fcbaf3643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.769337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e8164-7cd1-4ff4-a1ff-d21fcbaf3643 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.769619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e8164-7cd1-4ff4-a1ff-d21fcbaf3643 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.769894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e8164-7cd1-4ff4-a1ff-d21fcbaf3643 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.770563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e8164-7cd1-4ff4-a1ff-d21fcbaf3643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.772566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e8164-7cd1-4ff4-a1ff-d21fcbaf3643 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.792948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4191/8345] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:46 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:46.796450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd21052-58b1-43a0-bd1d-b8faa0620005 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.806869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd21052-58b1-43a0-bd1d-b8faa0620005 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.812246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857b21c-f947-4346-a97a-1ac2b63bc75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.812900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857b21c-f947-4346-a97a-1ac2b63bc75d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.813188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857b21c-f947-4346-a97a-1ac2b63bc75d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.813467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857b21c-f947-4346-a97a-1ac2b63bc75d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.814187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857b21c-f947-4346-a97a-1ac2b63bc75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.815801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857b21c-f947-4346-a97a-1ac2b63bc75d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.825461 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4155/8346] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:46.829564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e8164-7cd1-4ff4-a1ff-d21fcbaf3643 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.839783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e8164-7cd1-4ff4-a1ff-d21fcbaf3643 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.844498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979382d-7d3e-439a-b994-bea2846f70ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.845367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979382d-7d3e-439a-b994-bea2846f70ae admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.845651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979382d-7d3e-439a-b994-bea2846f70ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.845938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979382d-7d3e-439a-b994-bea2846f70ae admin admin] PATH_INFO: `/v3/projects/938e80bc5b2046139d008e31ef103355/users/0514ad498fd44759ae08d923fd15de8d/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.861952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979382d-7d3e-439a-b994-bea2846f70ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=938e80bc5b2046139d008e31ef103355, user_id=0514ad498fd44759ae08d923fd15de8d, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.864669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979382d-7d3e-439a-b994-bea2846f70ae admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.878592 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4192/8347] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:46 2022] PUT /identity/v3/projects/938e80bc5b2046139d008e31ef103355/users/0514ad498fd44759ae08d923fd15de8d/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:46.882594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857b21c-f947-4346-a97a-1ac2b63bc75d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.892702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857b21c-f947-4346-a97a-1ac2b63bc75d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.949954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a166-1f08-4900-ad3c-b1e1ed0d8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.950657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a166-1f08-4900-ad3c-b1e1ed0d8ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.950943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a166-1f08-4900-ad3c-b1e1ed0d8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.951218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a166-1f08-4900-ad3c-b1e1ed0d8ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.951955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a166-1f08-4900-ad3c-b1e1ed0d8ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.954192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a166-1f08-4900-ad3c-b1e1ed0d8ad4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:46.964423 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4156/8348] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:17:46.968345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979382d-7d3e-439a-b994-bea2846f70ae admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:46.978408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979382d-7d3e-439a-b994-bea2846f70ae admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:46.985134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bc268-f20e-481c-9d8d-e5a32531801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:46.986233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bc268-f20e-481c-9d8d-e5a32531801b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:46.986467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bc268-f20e-481c-9d8d-e5a32531801b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:46.986953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bc268-f20e-481c-9d8d-e5a32531801b admin admin] PATH_INFO: `/v3/projects/938e80bc5b2046139d008e31ef103355/users/0514ad498fd44759ae08d923fd15de8d/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:46.989313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bc268-f20e-481c-9d8d-e5a32531801b admin admin] RBAC: Authorizing `identity:create_grant(project_id=938e80bc5b2046139d008e31ef103355, user_id=0514ad498fd44759ae08d923fd15de8d, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:46.992319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bc268-f20e-481c-9d8d-e5a32531801b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:47.007066 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4193/8349] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:46 2022] PUT /identity/v3/projects/938e80bc5b2046139d008e31ef103355/users/0514ad498fd44759ae08d923fd15de8d/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:47.016425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219e29a-40ed-4a2c-82a6-e39ea06976bb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:47.016720 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219e29a-40ed-4a2c-82a6-e39ea06976bb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:47.017028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e219e29a-40ed-4a2c-82a6-e39ea06976bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:47.044540 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e219e29a-40ed-4a2c-82a6-e39ea06976bb None None] MFA Rules not processed for user `0514ad498fd44759ae08d923fd15de8d`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:47.045736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e219e29a-40ed-4a2c-82a6-e39ea06976bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:47.113148 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4157/8350] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:47.124903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bc268-f20e-481c-9d8d-e5a32531801b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:47.325097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bc268-f20e-481c-9d8d-e5a32531801b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:47.328665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78808f0a-50b8-49da-a969-6c45d99cfb24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:47.329288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78808f0a-50b8-49da-a969-6c45d99cfb24 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:47.329569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78808f0a-50b8-49da-a969-6c45d99cfb24 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:47.329842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78808f0a-50b8-49da-a969-6c45d99cfb24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:47.338512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78808f0a-50b8-49da-a969-6c45d99cfb24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:47.340589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78808f0a-50b8-49da-a969-6c45d99cfb24 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:47.349637 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4194/8351] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:47.418603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219e29a-40ed-4a2c-82a6-e39ea06976bb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:47.429790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e219e29a-40ed-4a2c-82a6-e39ea06976bb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:47.433343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b5d4f-d81f-43c2-90c4-8953710486a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:47.433972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5d4f-d81f-43c2-90c4-8953710486a0 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:47.434257 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5d4f-d81f-43c2-90c4-8953710486a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:47.434532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b5d4f-d81f-43c2-90c4-8953710486a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:47.489409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b5d4f-d81f-43c2-90c4-8953710486a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:47.490867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b5d4f-d81f-43c2-90c4-8953710486a0 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:47.499715 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4158/8352] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:48.749828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78808f0a-50b8-49da-a969-6c45d99cfb24 service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:48.751285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-78808f0a-50b8-49da-a969-6c45d99cfb24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:48.817047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78808f0a-50b8-49da-a969-6c45d99cfb24 service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:48.821825 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:48.822691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:48.822972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:48.823250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] PATH_INFO: `/v3/users/e9cccd717d874ea294cf1b606a1e6adf` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:48.824956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cccd717d874ea294cf1b606a1e6adf)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:48.826875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:48.872059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cccd717d874ea294cf1b606a1e6adf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:48.878725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cccd717d874ea294cf1b606a1e6adf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:48.879341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cccd717d874ea294cf1b606a1e6adf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:48.879965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cccd717d874ea294cf1b606a1e6adf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:48.888228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cccd717d874ea294cf1b606a1e6adf'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:48.909033 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4195/8353] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:48 2022] DELETE /identity/v3/users/e9cccd717d874ea294cf1b606a1e6adf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:48.910595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d167f96-291b-4f6c-ad5e-15f5a9567700 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:48.911052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d167f96-291b-4f6c-ad5e-15f5a9567700 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:48.911224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d167f96-291b-4f6c-ad5e-15f5a9567700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:48.928224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8d167f96-291b-4f6c-ad5e-15f5a9567700 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:48.929402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8d167f96-291b-4f6c-ad5e-15f5a9567700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:48.991607 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4159/8354] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:49.001424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:49.002885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:49.070285 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244c89f-364e-47d3-aa6e-7c4628131cc6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:49.074671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1d87c-9b91-450b-9a00-8f45074b1235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:49.075335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1d87c-9b91-450b-9a00-8f45074b1235 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.075602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1d87c-9b91-450b-9a00-8f45074b1235 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.075879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1d87c-9b91-450b-9a00-8f45074b1235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.086058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1d87c-9b91-450b-9a00-8f45074b1235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:49.088252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1d87c-9b91-450b-9a00-8f45074b1235 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:49.098988 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4196/8355] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:49.380432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d167f96-291b-4f6c-ad5e-15f5a9567700 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:49.382444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8d167f96-291b-4f6c-ad5e-15f5a9567700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:49.395641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d167f96-291b-4f6c-ad5e-15f5a9567700 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:49.412799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:49.413670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.413955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.414232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] PATH_INFO: `/v3/projects/fe8ba0bfc1324e3291c1766562f379e3` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.424635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8ba0bfc1324e3291c1766562f379e3)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:49.426886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:49.476494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8ba0bfc1324e3291c1766562f379e3', 'request_id': 'req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:49.485212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8ba0bfc1324e3291c1766562f379e3', 'request_id': 'req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:49.491025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8ba0bfc1324e3291c1766562f379e3', 'request_id': 'req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:49.502955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] The token cache is being invalidate because project fe8ba0bfc1324e3291c1766562f379e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:49.503252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:49.503897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d288069f-1ba2-45e6-86f7-d5ac3cd97fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:49.505492 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4160/8356] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:49 2022] DELETE /identity/v3/projects/fe8ba0bfc1324e3291c1766562f379e3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:49.510484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188233-ea80-4d24-90c7-2eb2dfc0adf9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.510770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188233-ea80-4d24-90c7-2eb2dfc0adf9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.511048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77188233-ea80-4d24-90c7-2eb2dfc0adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.529935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-77188233-ea80-4d24-90c7-2eb2dfc0adf9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:49.531122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-77188233-ea80-4d24-90c7-2eb2dfc0adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:49.589418 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4197/8357] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:49.597877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a43fa-12a3-4b63-abea-118d29967510 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.598337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a43fa-12a3-4b63-abea-118d29967510 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.598628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a43fa-12a3-4b63-abea-118d29967510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.617156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-467a43fa-12a3-4b63-abea-118d29967510 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:49.618347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-467a43fa-12a3-4b63-abea-118d29967510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:49.627283 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4161/8358] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:49.631415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188233-ea80-4d24-90c7-2eb2dfc0adf9 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:49.641146 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77188233-ea80-4d24-90c7-2eb2dfc0adf9 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:49.645648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e832-4913-407c-831b-c6eed9212732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:49.646292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e832-4913-407c-831b-c6eed9212732 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.646573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e832-4913-407c-831b-c6eed9212732 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.646847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73e832-4913-407c-831b-c6eed9212732 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.647642 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73e832-4913-407c-831b-c6eed9212732 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:49.647974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73e832-4913-407c-831b-c6eed9212732 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:49.649592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73e832-4913-407c-831b-c6eed9212732 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:49.662209 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4198/8359] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:17:49.667514 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a43fa-12a3-4b63-abea-118d29967510 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:49.682890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a43fa-12a3-4b63-abea-118d29967510 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:49.688321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff954f-c304-4ccd-90cd-9e86be64f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:49.689049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff954f-c304-4ccd-90cd-9e86be64f435 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.689403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff954f-c304-4ccd-90cd-9e86be64f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.689788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff954f-c304-4ccd-90cd-9e86be64f435 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.690556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff954f-c304-4ccd-90cd-9e86be64f435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:49.692591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff954f-c304-4ccd-90cd-9e86be64f435 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:49.719152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4162/8360] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:49 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:49.723427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e832-4913-407c-831b-c6eed9212732 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:49.734064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73e832-4913-407c-831b-c6eed9212732 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:49.789368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd2ba8-016f-4492-ae27-912bfc3f9cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:49.790086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd2ba8-016f-4492-ae27-912bfc3f9cce admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.790343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd2ba8-016f-4492-ae27-912bfc3f9cce admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.790587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd2ba8-016f-4492-ae27-912bfc3f9cce admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.791274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd2ba8-016f-4492-ae27-912bfc3f9cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:49.793779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bd2ba8-016f-4492-ae27-912bfc3f9cce admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:49.814402 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4199/8361] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:49 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:49.818440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff954f-c304-4ccd-90cd-9e86be64f435 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:49.829356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff954f-c304-4ccd-90cd-9e86be64f435 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:49.833976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643ebe9-44c2-4dd3-a37f-786c8ac65af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:49.834635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643ebe9-44c2-4dd3-a37f-786c8ac65af5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.835112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643ebe9-44c2-4dd3-a37f-786c8ac65af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.835413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643ebe9-44c2-4dd3-a37f-786c8ac65af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.836156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643ebe9-44c2-4dd3-a37f-786c8ac65af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:49.837792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643ebe9-44c2-4dd3-a37f-786c8ac65af5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:49.848687 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4163/8362] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:49.852329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd2ba8-016f-4492-ae27-912bfc3f9cce admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:49.862845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd2ba8-016f-4492-ae27-912bfc3f9cce admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:49.867453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6db5ea-d00b-43bf-95cb-68aca7f3fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:49.868136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6db5ea-d00b-43bf-95cb-68aca7f3fcda admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.868422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6db5ea-d00b-43bf-95cb-68aca7f3fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.868700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6db5ea-d00b-43bf-95cb-68aca7f3fcda admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.869412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6db5ea-d00b-43bf-95cb-68aca7f3fcda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:49.871557 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6db5ea-d00b-43bf-95cb-68aca7f3fcda admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:49.885316 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4200/8363] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:49.889632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643ebe9-44c2-4dd3-a37f-786c8ac65af5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:49.899689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643ebe9-44c2-4dd3-a37f-786c8ac65af5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:49.904817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c94ed-27ad-4fc7-842e-dadef9a1f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:49.905715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c94ed-27ad-4fc7-842e-dadef9a1f1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.906000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c94ed-27ad-4fc7-842e-dadef9a1f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.906275 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c94ed-27ad-4fc7-842e-dadef9a1f1f1 admin admin] PATH_INFO: `/v3/projects/b3a61b7fb62647d1a59a22c2aaf8c446/users/56c18eeabaeb40ee95c3617275be6ff9/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.921134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c94ed-27ad-4fc7-842e-dadef9a1f1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a61b7fb62647d1a59a22c2aaf8c446, user_id=56c18eeabaeb40ee95c3617275be6ff9, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:49.923777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c94ed-27ad-4fc7-842e-dadef9a1f1f1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:49.937037 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4164/8364] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:49 2022] PUT /identity/v3/projects/b3a61b7fb62647d1a59a22c2aaf8c446/users/56c18eeabaeb40ee95c3617275be6ff9/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:49.948392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858bff3-b139-4093-bf97-aadb45e153fc None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:49.948760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858bff3-b139-4093-bf97-aadb45e153fc None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:49.949252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858bff3-b139-4093-bf97-aadb45e153fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:49.976677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b858bff3-b139-4093-bf97-aadb45e153fc None None] MFA Rules not processed for user `56c18eeabaeb40ee95c3617275be6ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:49.978082 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b858bff3-b139-4093-bf97-aadb45e153fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:50.055181 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4201/8365] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:50.067679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c94ed-27ad-4fc7-842e-dadef9a1f1f1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:50.069757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-447c94ed-27ad-4fc7-842e-dadef9a1f1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:50.166512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c94ed-27ad-4fc7-842e-dadef9a1f1f1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:50.171435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a97eb-65df-4cbb-ae94-04b430412ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:50.172376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a97eb-65df-4cbb-ae94-04b430412ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:50.172837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a97eb-65df-4cbb-ae94-04b430412ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:50.173407 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53a97eb-65df-4cbb-ae94-04b430412ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:50.184954 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a97eb-65df-4cbb-ae94-04b430412ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:50.187463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53a97eb-65df-4cbb-ae94-04b430412ec7 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:50.200005 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4165/8366] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:50.215754 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858bff3-b139-4093-bf97-aadb45e153fc None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:50.217353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b858bff3-b139-4093-bf97-aadb45e153fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:50.232948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a97eb-65df-4cbb-ae94-04b430412ec7 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:50.307366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53a97eb-65df-4cbb-ae94-04b430412ec7 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:50.308089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858bff3-b139-4093-bf97-aadb45e153fc None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:50.313295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:50.313559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:50.314314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:50.314663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:50.314760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:50.315059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] PATH_INFO: `/v3/users/44eca36268a9492dbe1a36a3ed9a9ace` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:50.315154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:50.315474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] PATH_INFO: `/v3/users/56c18eeabaeb40ee95c3617275be6ff9` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:50.316554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] RBAC: Authorizing `identity:delete_user(user_id=44eca36268a9492dbe1a36a3ed9a9ace)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:50.317666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56c18eeabaeb40ee95c3617275be6ff9)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:50.318740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:50.320517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:50.380021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44eca36268a9492dbe1a36a3ed9a9ace'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.387431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44eca36268a9492dbe1a36a3ed9a9ace'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.388175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44eca36268a9492dbe1a36a3ed9a9ace'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.388307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56c18eeabaeb40ee95c3617275be6ff9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.388795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44eca36268a9492dbe1a36a3ed9a9ace'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.397175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56c18eeabaeb40ee95c3617275be6ff9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.398225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56c18eeabaeb40ee95c3617275be6ff9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.399756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-8c99fb03-c001-4647-9193-43e6fe29301a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44eca36268a9492dbe1a36a3ed9a9ace'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.400343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56c18eeabaeb40ee95c3617275be6ff9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.417194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-1670be02-9118-4030-a36f-cb2b8ceb8e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56c18eeabaeb40ee95c3617275be6ff9'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:50.422114 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4202/8367] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:50 2022] DELETE /identity/v3/users/44eca36268a9492dbe1a36a3ed9a9ace => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:50.423650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d6860-80d9-44dd-b0d5-fcc418faa3cf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:50.424240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d6860-80d9-44dd-b0d5-fcc418faa3cf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:50.424939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d6860-80d9-44dd-b0d5-fcc418faa3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:50.433049 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4166/8368] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:50 2022] DELETE /identity/v3/users/56c18eeabaeb40ee95c3617275be6ff9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:50.438166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad09a-34ca-4cbe-b69c-5bd5fd1b214a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:50.438756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad09a-34ca-4cbe-b69c-5bd5fd1b214a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:50.439038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ad09a-34ca-4cbe-b69c-5bd5fd1b214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:50.454101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c67d6860-80d9-44dd-b0d5-fcc418faa3cf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:50.455426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c67d6860-80d9-44dd-b0d5-fcc418faa3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:50.460231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6e7ad09a-34ca-4cbe-b69c-5bd5fd1b214a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:50.461472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6e7ad09a-34ca-4cbe-b69c-5bd5fd1b214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:50.521773 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4203/8369] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:50.532552 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4167/8370] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:50.538156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d6860-80d9-44dd-b0d5-fcc418faa3cf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:50.539636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c67d6860-80d9-44dd-b0d5-fcc418faa3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:50.549377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad09a-34ca-4cbe-b69c-5bd5fd1b214a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:50.551195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6e7ad09a-34ca-4cbe-b69c-5bd5fd1b214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:50.609060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d6860-80d9-44dd-b0d5-fcc418faa3cf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:50.612765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a8f1-1765-4767-9bf8-eee7d000b918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:50.614765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a8f1-1765-4767-9bf8-eee7d000b918 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:50.614765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a8f1-1765-4767-9bf8-eee7d000b918 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:50.614765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a8f1-1765-4767-9bf8-eee7d000b918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:50.619321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ad09a-34ca-4cbe-b69c-5bd5fd1b214a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:50.623665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456e50-7905-4e58-8b97-0599dfbfe05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:50.624364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456e50-7905-4e58-8b97-0599dfbfe05c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:50.624654 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456e50-7905-4e58-8b97-0599dfbfe05c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:50.624936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456e50-7905-4e58-8b97-0599dfbfe05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:50.625639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2a8f1-1765-4767-9bf8-eee7d000b918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:50.629828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2a8f1-1765-4767-9bf8-eee7d000b918 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:50.635404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9456e50-7905-4e58-8b97-0599dfbfe05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:50.637544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9456e50-7905-4e58-8b97-0599dfbfe05c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:50.649154 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4204/8371] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:50.649748 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4168/8372] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:17:50.978809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a8f1-1765-4767-9bf8-eee7d000b918 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:50.980909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cda2a8f1-1765-4767-9bf8-eee7d000b918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:51.007766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a8f1-1765-4767-9bf8-eee7d000b918 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:51.013842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:51.014715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:51.014996 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:51.015282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] PATH_INFO: `/v3/projects/a5b69801e1ff4bf099150bfd6f8dc4a7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:51.016534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b69801e1ff4bf099150bfd6f8dc4a7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:51.024523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:51.077611 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b69801e1ff4bf099150bfd6f8dc4a7', 'request_id': 'req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.086853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b69801e1ff4bf099150bfd6f8dc4a7', 'request_id': 'req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.094194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b69801e1ff4bf099150bfd6f8dc4a7', 'request_id': 'req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.106942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] The token cache is being invalidate because project a5b69801e1ff4bf099150bfd6f8dc4a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:51.107228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.108466 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.109913 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4205/8373] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:50 2022] DELETE /identity/v3/projects/a5b69801e1ff4bf099150bfd6f8dc4a7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:51.113605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456e50-7905-4e58-8b97-0599dfbfe05c service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:51.123499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456e50-7905-4e58-8b97-0599dfbfe05c service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:51.182942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:51.184990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:51.185131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:51.185413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:51.185779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] PATH_INFO: `/v3/users/0514ad498fd44759ae08d923fd15de8d` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:51.186705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:51.187001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0514ad498fd44759ae08d923fd15de8d)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:51.189009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:51.201491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed6c9-9c3b-4b2c-adf9-3e6d52074c89 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:51.212598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:51.213688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:51.214117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:51.214563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] PATH_INFO: `/v3/projects/b3a61b7fb62647d1a59a22c2aaf8c446` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:51.216900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a61b7fb62647d1a59a22c2aaf8c446)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:51.219404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:51.256087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0514ad498fd44759ae08d923fd15de8d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.265518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0514ad498fd44759ae08d923fd15de8d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.266337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0514ad498fd44759ae08d923fd15de8d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.267119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0514ad498fd44759ae08d923fd15de8d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.275714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a61b7fb62647d1a59a22c2aaf8c446', 'request_id': 'req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.282037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0514ad498fd44759ae08d923fd15de8d'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.285008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a61b7fb62647d1a59a22c2aaf8c446', 'request_id': 'req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.291132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a61b7fb62647d1a59a22c2aaf8c446', 'request_id': 'req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.296128 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4169/8374] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:51 2022] DELETE /identity/v3/users/0514ad498fd44759ae08d923fd15de8d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:51.303008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] The token cache is being invalidate because project b3a61b7fb62647d1a59a22c2aaf8c446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:51.303294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.303998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a8c9797c-5ac8-42e6-833f-3d5c07b2f99d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.305563 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4206/8375] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:51 2022] DELETE /identity/v3/projects/b3a61b7fb62647d1a59a22c2aaf8c446 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:51.632772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:51.634344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:51.716897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23c52-df5d-4b80-a780-7e4f53b89abe admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:51.721771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:51.722946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:51.723227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:51.723502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] PATH_INFO: `/v3/projects/938e80bc5b2046139d008e31ef103355` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:51.724748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=938e80bc5b2046139d008e31ef103355)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:51.726730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:51.776493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938e80bc5b2046139d008e31ef103355', 'request_id': 'req-49a0df6a-1535-4d09-a489-daf6c4742232'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.785828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938e80bc5b2046139d008e31ef103355', 'request_id': 'req-49a0df6a-1535-4d09-a489-daf6c4742232'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.792067 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938e80bc5b2046139d008e31ef103355', 'request_id': 'req-49a0df6a-1535-4d09-a489-daf6c4742232'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.804061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] The token cache is being invalidate because project 938e80bc5b2046139d008e31ef103355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:51.804504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.805156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-49a0df6a-1535-4d09-a489-daf6c4742232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:51.806699 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4170/8376] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:51 2022] DELETE /identity/v3/projects/938e80bc5b2046139d008e31ef103355 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:51.812201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf5871-1c07-477c-bc7b-5e3d34449aaf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:51.812491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf5871-1c07-477c-bc7b-5e3d34449aaf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:51.812772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf5871-1c07-477c-bc7b-5e3d34449aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:51.830460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-93cf5871-1c07-477c-bc7b-5e3d34449aaf None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:51.831639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-93cf5871-1c07-477c-bc7b-5e3d34449aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:51.903615 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4207/8377] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:51.905477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb743f1-ce4a-4aa0-8047-d215e8c9cbd0 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:51.905771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb743f1-ce4a-4aa0-8047-d215e8c9cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:51.906081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb743f1-ce4a-4aa0-8047-d215e8c9cbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:51.924967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9fb743f1-ce4a-4aa0-8047-d215e8c9cbd0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:51.926440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9fb743f1-ce4a-4aa0-8047-d215e8c9cbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:51.935132 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4171/8378] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:51.939332 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf5871-1c07-477c-bc7b-5e3d34449aaf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:51.948999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf5871-1c07-477c-bc7b-5e3d34449aaf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:51.953589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49bb98-9785-461a-979a-3e68d5c79089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:51.954234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49bb98-9785-461a-979a-3e68d5c79089 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:51.954538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49bb98-9785-461a-979a-3e68d5c79089 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:51.954811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49bb98-9785-461a-979a-3e68d5c79089 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:51.955547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49bb98-9785-461a-979a-3e68d5c79089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:51.955845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49bb98-9785-461a-979a-3e68d5c79089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:51.957463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49bb98-9785-461a-979a-3e68d5c79089 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:51.968773 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4208/8379] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:17:51.972942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb743f1-ce4a-4aa0-8047-d215e8c9cbd0 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:51.982655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb743f1-ce4a-4aa0-8047-d215e8c9cbd0 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:51.987575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84e48b-0ba5-4392-89d0-ad72b5e89d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:51.988260 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84e48b-0ba5-4392-89d0-ad72b5e89d9c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:51.988551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84e48b-0ba5-4392-89d0-ad72b5e89d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:51.988835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c84e48b-0ba5-4392-89d0-ad72b5e89d9c admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:51.989568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84e48b-0ba5-4392-89d0-ad72b5e89d9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:51.991486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c84e48b-0ba5-4392-89d0-ad72b5e89d9c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.018822 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4172/8380] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:51 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:52.023135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49bb98-9785-461a-979a-3e68d5c79089 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.033324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49bb98-9785-461a-979a-3e68d5c79089 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.088357 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a0a2-7bcc-4f31-990c-7e824e8573b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.089036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a0a2-7bcc-4f31-990c-7e824e8573b6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.089358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a0a2-7bcc-4f31-990c-7e824e8573b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.089765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832a0a2-7bcc-4f31-990c-7e824e8573b6 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.090454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832a0a2-7bcc-4f31-990c-7e824e8573b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.092444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832a0a2-7bcc-4f31-990c-7e824e8573b6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.113067 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4209/8381] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:52 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:52.116779 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84e48b-0ba5-4392-89d0-ad72b5e89d9c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.127717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c84e48b-0ba5-4392-89d0-ad72b5e89d9c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.132372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7a200-87af-41a9-adb6-a124349319bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.133027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7a200-87af-41a9-adb6-a124349319bc admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.133317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7a200-87af-41a9-adb6-a124349319bc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.133596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7a200-87af-41a9-adb6-a124349319bc admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.134354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7a200-87af-41a9-adb6-a124349319bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.135940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7a200-87af-41a9-adb6-a124349319bc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.146740 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4173/8382] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:17:52.150536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a0a2-7bcc-4f31-990c-7e824e8573b6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.161131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832a0a2-7bcc-4f31-990c-7e824e8573b6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.169395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227c704-291c-4694-ae53-fff0344148ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.170041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227c704-291c-4694-ae53-fff0344148ee admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.170320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227c704-291c-4694-ae53-fff0344148ee admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.170593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227c704-291c-4694-ae53-fff0344148ee admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.177805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227c704-291c-4694-ae53-fff0344148ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.179471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227c704-291c-4694-ae53-fff0344148ee admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.190360 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4210/8383] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:52.194618 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7a200-87af-41a9-adb6-a124349319bc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.206763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7a200-87af-41a9-adb6-a124349319bc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.211681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941aa6-d26a-44ff-ae10-498550402fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.212617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941aa6-d26a-44ff-ae10-498550402fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.212905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941aa6-d26a-44ff-ae10-498550402fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.213184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43941aa6-d26a-44ff-ae10-498550402fb9 admin admin] PATH_INFO: `/v3/projects/ae778533ad0b4965bb47fa562e8ac5e6/users/0f5dabc163aa4dd4889c62d6528bf3c4/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.229375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941aa6-d26a-44ff-ae10-498550402fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae778533ad0b4965bb47fa562e8ac5e6, user_id=0f5dabc163aa4dd4889c62d6528bf3c4, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.232665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43941aa6-d26a-44ff-ae10-498550402fb9 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.246417 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4174/8384] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:52 2022] PUT /identity/v3/projects/ae778533ad0b4965bb47fa562e8ac5e6/users/0f5dabc163aa4dd4889c62d6528bf3c4/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:52.256251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dd9b4-d1e2-4535-9397-f477fac4642c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.256543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dd9b4-d1e2-4535-9397-f477fac4642c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.256836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dd9b4-d1e2-4535-9397-f477fac4642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.285111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a48dd9b4-d1e2-4535-9397-f477fac4642c None None] MFA Rules not processed for user `0f5dabc163aa4dd4889c62d6528bf3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:52.286366 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a48dd9b4-d1e2-4535-9397-f477fac4642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:52.349988 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4211/8385] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:17:52.354488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941aa6-d26a-44ff-ae10-498550402fb9 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.416967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43941aa6-d26a-44ff-ae10-498550402fb9 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.422349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d3efe-5a61-4111-8ef3-20dd5f3bbe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.423021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d3efe-5a61-4111-8ef3-20dd5f3bbe07 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.423307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d3efe-5a61-4111-8ef3-20dd5f3bbe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.423588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d3efe-5a61-4111-8ef3-20dd5f3bbe07 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.424328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d3efe-5a61-4111-8ef3-20dd5f3bbe07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.426559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d3efe-5a61-4111-8ef3-20dd5f3bbe07 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.455056 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4175/8386] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:52 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:52.456260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dd9b4-d1e2-4535-9397-f477fac4642c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.467347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dd9b4-d1e2-4535-9397-f477fac4642c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.523590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d6154-2145-49c3-a4da-d92b474da20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.524203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d6154-2145-49c3-a4da-d92b474da20f admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.524487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d6154-2145-49c3-a4da-d92b474da20f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.524758 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d6154-2145-49c3-a4da-d92b474da20f admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.525437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d6154-2145-49c3-a4da-d92b474da20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.527965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d6154-2145-49c3-a4da-d92b474da20f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.547987 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4212/8387] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:52 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:52.552225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d3efe-5a61-4111-8ef3-20dd5f3bbe07 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.562945 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d3efe-5a61-4111-8ef3-20dd5f3bbe07 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.567796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a8f81-329e-4b22-94b7-3c52ff2c3620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.568494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a8f81-329e-4b22-94b7-3c52ff2c3620 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.568784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a8f81-329e-4b22-94b7-3c52ff2c3620 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.569071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a8f81-329e-4b22-94b7-3c52ff2c3620 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.569823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a8f81-329e-4b22-94b7-3c52ff2c3620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.571486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a8f81-329e-4b22-94b7-3c52ff2c3620 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.585892 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4176/8388] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:52.587125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d6154-2145-49c3-a4da-d92b474da20f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.597778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d6154-2145-49c3-a4da-d92b474da20f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.604629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab39640-7452-4cbe-8283-32bc60316d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.605554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39640-7452-4cbe-8283-32bc60316d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.605836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39640-7452-4cbe-8283-32bc60316d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.606112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39640-7452-4cbe-8283-32bc60316d1b admin admin] PATH_INFO: `/v3/projects/dbad5a4cfe954ffc82a2cef9981ed4b6/users/4f76a6aab6554c7c9754b81440a525dd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.620878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab39640-7452-4cbe-8283-32bc60316d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbad5a4cfe954ffc82a2cef9981ed4b6, user_id=4f76a6aab6554c7c9754b81440a525dd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.623544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab39640-7452-4cbe-8283-32bc60316d1b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.637561 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4213/8389] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:52 2022] PUT /identity/v3/projects/dbad5a4cfe954ffc82a2cef9981ed4b6/users/4f76a6aab6554c7c9754b81440a525dd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:52.641477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a8f81-329e-4b22-94b7-3c52ff2c3620 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.651971 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a8f81-329e-4b22-94b7-3c52ff2c3620 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.715566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425f9d2-bede-498a-980d-3387f5f0ac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.716485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425f9d2-bede-498a-980d-3387f5f0ac83 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.716818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425f9d2-bede-498a-980d-3387f5f0ac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.717166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425f9d2-bede-498a-980d-3387f5f0ac83 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.717964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425f9d2-bede-498a-980d-3387f5f0ac83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.719649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425f9d2-bede-498a-980d-3387f5f0ac83 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.729758 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4177/8390] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:52.734431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab39640-7452-4cbe-8283-32bc60316d1b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.745005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab39640-7452-4cbe-8283-32bc60316d1b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.750244 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651abcb1-b0af-4c7f-a332-929e6e74fbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.751115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651abcb1-b0af-4c7f-a332-929e6e74fbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.751400 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651abcb1-b0af-4c7f-a332-929e6e74fbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.751680 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651abcb1-b0af-4c7f-a332-929e6e74fbc4 admin admin] PATH_INFO: `/v3/projects/dbad5a4cfe954ffc82a2cef9981ed4b6/users/4f76a6aab6554c7c9754b81440a525dd/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.753935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651abcb1-b0af-4c7f-a332-929e6e74fbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbad5a4cfe954ffc82a2cef9981ed4b6, user_id=4f76a6aab6554c7c9754b81440a525dd, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.756665 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651abcb1-b0af-4c7f-a332-929e6e74fbc4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.769165 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4214/8391] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:52 2022] PUT /identity/v3/projects/dbad5a4cfe954ffc82a2cef9981ed4b6/users/4f76a6aab6554c7c9754b81440a525dd/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:52.780006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730364-e305-4db4-a0d4-001570f25c00 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.780316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730364-e305-4db4-a0d4-001570f25c00 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.780602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09730364-e305-4db4-a0d4-001570f25c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.807763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-09730364-e305-4db4-a0d4-001570f25c00 None None] MFA Rules not processed for user `4f76a6aab6554c7c9754b81440a525dd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:52.809682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-09730364-e305-4db4-a0d4-001570f25c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:52.875982 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4178/8392] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:52.887324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651abcb1-b0af-4c7f-a332-929e6e74fbc4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:52.889352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-651abcb1-b0af-4c7f-a332-929e6e74fbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:52.954250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651abcb1-b0af-4c7f-a332-929e6e74fbc4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:52.961929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25474b48-2f04-41de-a18e-7077aa4090db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:52.962831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25474b48-2f04-41de-a18e-7077aa4090db service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:52.963118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25474b48-2f04-41de-a18e-7077aa4090db service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:52.963395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25474b48-2f04-41de-a18e-7077aa4090db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:52.974233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25474b48-2f04-41de-a18e-7077aa4090db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:52.976842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25474b48-2f04-41de-a18e-7077aa4090db service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:52.989240 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4215/8393] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:53.045457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730364-e305-4db4-a0d4-001570f25c00 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:53.046963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-09730364-e305-4db4-a0d4-001570f25c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:53.066775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09730364-e305-4db4-a0d4-001570f25c00 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:53.070817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab720e2-28b2-4f0f-8506-99cbe7e007fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:53.071488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab720e2-28b2-4f0f-8506-99cbe7e007fa service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:53.071772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab720e2-28b2-4f0f-8506-99cbe7e007fa service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:53.072084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab720e2-28b2-4f0f-8506-99cbe7e007fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:53.142134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab720e2-28b2-4f0f-8506-99cbe7e007fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:53.143901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab720e2-28b2-4f0f-8506-99cbe7e007fa service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:53.154885 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4179/8394] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:56.456393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25474b48-2f04-41de-a18e-7077aa4090db service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:56.516507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25474b48-2f04-41de-a18e-7077aa4090db service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:56.521076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:56.522065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:56.522352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:56.522622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] PATH_INFO: `/v3/users/0f5dabc163aa4dd4889c62d6528bf3c4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:56.523781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f5dabc163aa4dd4889c62d6528bf3c4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:56.525741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:56.570318 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f5dabc163aa4dd4889c62d6528bf3c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:56.577196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f5dabc163aa4dd4889c62d6528bf3c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:56.577805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f5dabc163aa4dd4889c62d6528bf3c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:56.578417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f5dabc163aa4dd4889c62d6528bf3c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:56.584730 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f5dabc163aa4dd4889c62d6528bf3c4'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:56.600841 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4216/8395] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:56 2022] DELETE /identity/v3/users/0f5dabc163aa4dd4889c62d6528bf3c4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:56.605810 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37764-814c-4232-882c-e4e0b525aa2b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:56.606378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37764-814c-4232-882c-e4e0b525aa2b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:56.606519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37764-814c-4232-882c-e4e0b525aa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:56.623992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-53c37764-814c-4232-882c-e4e0b525aa2b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:56.625190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-53c37764-814c-4232-882c-e4e0b525aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:56.682255 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4180/8396] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:56.692044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:56.693564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:56.750692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180560e-99c5-4361-b1ca-6019a3fd6073 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:56.754609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb30231-eec5-401b-aa61-85ff900574ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:56.755273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30231-eec5-401b-aa61-85ff900574ca service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:56.755560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30231-eec5-401b-aa61-85ff900574ca service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:56.755870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30231-eec5-401b-aa61-85ff900574ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:56.764861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb30231-eec5-401b-aa61-85ff900574ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:56.766299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb30231-eec5-401b-aa61-85ff900574ca service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:56.775502 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4217/8397] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:57.048846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37764-814c-4232-882c-e4e0b525aa2b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:57.050848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-53c37764-814c-4232-882c-e4e0b525aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:57.065320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37764-814c-4232-882c-e4e0b525aa2b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:57.070895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:57.071887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:57.072062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:57.072341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] PATH_INFO: `/v3/projects/ae778533ad0b4965bb47fa562e8ac5e6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:57.073528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae778533ad0b4965bb47fa562e8ac5e6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:57.076027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:57.124788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae778533ad0b4965bb47fa562e8ac5e6', 'request_id': 'req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.132476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae778533ad0b4965bb47fa562e8ac5e6', 'request_id': 'req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.138926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae778533ad0b4965bb47fa562e8ac5e6', 'request_id': 'req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.150252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] The token cache is being invalidate because project ae778533ad0b4965bb47fa562e8ac5e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:57.150547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.151218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.153633 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4181/8398] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:57 2022] DELETE /identity/v3/projects/ae778533ad0b4965bb47fa562e8ac5e6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:57.157354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb30231-eec5-401b-aa61-85ff900574ca service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:57.167115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb30231-eec5-401b-aa61-85ff900574ca service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:57.237573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:57.238446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:57.238725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:57.238997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] PATH_INFO: `/v3/users/4f76a6aab6554c7c9754b81440a525dd` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:57.240202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f76a6aab6554c7c9754b81440a525dd)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:57.242148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:57.287181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f76a6aab6554c7c9754b81440a525dd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.293764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f76a6aab6554c7c9754b81440a525dd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.294433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f76a6aab6554c7c9754b81440a525dd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.295028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f76a6aab6554c7c9754b81440a525dd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.301954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-35e48d5e-40ae-45d6-abfc-5cd9baa953f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f76a6aab6554c7c9754b81440a525dd'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.318184 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4218/8399] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:17:57 2022] DELETE /identity/v3/users/4f76a6aab6554c7c9754b81440a525dd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:57.578603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:57.580057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:57.593944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d302dc8-3f45-4b8d-bb5a-09ccfbd31e4b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:57.649433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:57.650320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:57.650602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:57.650880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] PATH_INFO: `/v3/projects/dbad5a4cfe954ffc82a2cef9981ed4b6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:57.652585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbad5a4cfe954ffc82a2cef9981ed4b6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:57.654550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:57.699481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbad5a4cfe954ffc82a2cef9981ed4b6', 'request_id': 'req-d34de2c0-cae1-4b90-872b-aee1b4583001'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.706366 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbad5a4cfe954ffc82a2cef9981ed4b6', 'request_id': 'req-d34de2c0-cae1-4b90-872b-aee1b4583001'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.711572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbad5a4cfe954ffc82a2cef9981ed4b6', 'request_id': 'req-d34de2c0-cae1-4b90-872b-aee1b4583001'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.722685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] The token cache is being invalidate because project dbad5a4cfe954ffc82a2cef9981ed4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:17:57.722977 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.723622 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d34de2c0-cae1-4b90-872b-aee1b4583001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:17:57.725147 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4182/8400] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:17:57 2022] DELETE /identity/v3/projects/dbad5a4cfe954ffc82a2cef9981ed4b6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:57.730584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c188f7-2e93-4cf4-8607-c89238f1bb63 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:57.731038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c188f7-2e93-4cf4-8607-c89238f1bb63 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:57.731144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c188f7-2e93-4cf4-8607-c89238f1bb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:57.748957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-02c188f7-2e93-4cf4-8607-c89238f1bb63 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:57.750130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-02c188f7-2e93-4cf4-8607-c89238f1bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:57.809817 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4219/8401] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:57.817413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbaf75-ebef-4ec4-8160-983839d73060 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:57.817751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbaf75-ebef-4ec4-8160-983839d73060 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:57.818040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbaf75-ebef-4ec4-8160-983839d73060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:57.837606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-18fbaf75-ebef-4ec4-8160-983839d73060 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:57.838798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-18fbaf75-ebef-4ec4-8160-983839d73060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:57.847316 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4183/8402] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:57.851574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c188f7-2e93-4cf4-8607-c89238f1bb63 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:57.861411 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c188f7-2e93-4cf4-8607-c89238f1bb63 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:57.865911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab59f-6045-4a53-a9fb-bd1826404ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:57.866554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab59f-6045-4a53-a9fb-bd1826404ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:57.866830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab59f-6045-4a53-a9fb-bd1826404ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:57.867118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fab59f-6045-4a53-a9fb-bd1826404ce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:57.867816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fab59f-6045-4a53-a9fb-bd1826404ce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:17:57.868162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fab59f-6045-4a53-a9fb-bd1826404ce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:57.869760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fab59f-6045-4a53-a9fb-bd1826404ce2 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:57.881096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4220/8403] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:17:57.885645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbaf75-ebef-4ec4-8160-983839d73060 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:57.895480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbaf75-ebef-4ec4-8160-983839d73060 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:57.900254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4cc3-48c5-4ff2-9b65-7b7b815ccd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:57.900891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4cc3-48c5-4ff2-9b65-7b7b815ccd9c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:57.901180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4cc3-48c5-4ff2-9b65-7b7b815ccd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:57.901462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee4cc3-48c5-4ff2-9b65-7b7b815ccd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:57.902766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4cc3-48c5-4ff2-9b65-7b7b815ccd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:57.904717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee4cc3-48c5-4ff2-9b65-7b7b815ccd9c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:57.933192 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4184/8404] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:57 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:57.937256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab59f-6045-4a53-a9fb-bd1826404ce2 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:57.947253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fab59f-6045-4a53-a9fb-bd1826404ce2 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.005604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d3e4a-84b4-4f04-9359-52dd699cbafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.006215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d3e4a-84b4-4f04-9359-52dd699cbafd admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.006501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d3e4a-84b4-4f04-9359-52dd699cbafd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.006776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d3e4a-84b4-4f04-9359-52dd699cbafd admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.007450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d3e4a-84b4-4f04-9359-52dd699cbafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.009398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d3e4a-84b4-4f04-9359-52dd699cbafd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.030012 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4221/8405] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:57 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:17:58.034160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4cc3-48c5-4ff2-9b65-7b7b815ccd9c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.044235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee4cc3-48c5-4ff2-9b65-7b7b815ccd9c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.049770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982e52b-c755-4a37-b37a-659a705dcb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.050678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e52b-c755-4a37-b37a-659a705dcb46 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.050959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e52b-c755-4a37-b37a-659a705dcb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.051240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982e52b-c755-4a37-b37a-659a705dcb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.052028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982e52b-c755-4a37-b37a-659a705dcb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.053604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982e52b-c755-4a37-b37a-659a705dcb46 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.065577 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4185/8406] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:58.069686 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d3e4a-84b4-4f04-9359-52dd699cbafd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.080186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d3e4a-84b4-4f04-9359-52dd699cbafd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.085027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b32c98-b973-4b9f-8758-ab85646458ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.085664 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b32c98-b973-4b9f-8758-ab85646458ad admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.085946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b32c98-b973-4b9f-8758-ab85646458ad admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.086223 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b32c98-b973-4b9f-8758-ab85646458ad admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.086932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b32c98-b973-4b9f-8758-ab85646458ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.088566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b32c98-b973-4b9f-8758-ab85646458ad admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.098751 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4222/8407] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:58.102804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982e52b-c755-4a37-b37a-659a705dcb46 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.112933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982e52b-c755-4a37-b37a-659a705dcb46 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.117580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9be0-473c-4419-9b3a-2278c964d792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.118476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9be0-473c-4419-9b3a-2278c964d792 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.118761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9be0-473c-4419-9b3a-2278c964d792 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.119041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9be0-473c-4419-9b3a-2278c964d792 admin admin] PATH_INFO: `/v3/projects/141efad2a96843f4862051948ec5934b/users/0be9fff48c24443dbfe8c67b9deb3a74/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.134315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9be0-473c-4419-9b3a-2278c964d792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141efad2a96843f4862051948ec5934b, user_id=0be9fff48c24443dbfe8c67b9deb3a74, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.137807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9be0-473c-4419-9b3a-2278c964d792 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.150700 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4186/8408] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:58 2022] PUT /identity/v3/projects/141efad2a96843f4862051948ec5934b/users/0be9fff48c24443dbfe8c67b9deb3a74/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:17:58.160501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1262dc-ed92-4c40-b64b-51fae84f07ea None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.160907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1262dc-ed92-4c40-b64b-51fae84f07ea None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.161191 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1262dc-ed92-4c40-b64b-51fae84f07ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.187596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3a1262dc-ed92-4c40-b64b-51fae84f07ea None None] MFA Rules not processed for user `0be9fff48c24443dbfe8c67b9deb3a74`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:58.188836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3a1262dc-ed92-4c40-b64b-51fae84f07ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:58.250501 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4223/8409] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:58.254891 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9be0-473c-4419-9b3a-2278c964d792 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.315832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9be0-473c-4419-9b3a-2278c964d792 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.320541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d147d-a1db-4240-8057-7daaca2776e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.321196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d147d-a1db-4240-8057-7daaca2776e6 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.321485 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d147d-a1db-4240-8057-7daaca2776e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.321769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d147d-a1db-4240-8057-7daaca2776e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.322500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d147d-a1db-4240-8057-7daaca2776e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.325175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d147d-a1db-4240-8057-7daaca2776e6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.351094 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4187/8410] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:17:58 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:58.354863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1262dc-ed92-4c40-b64b-51fae84f07ea None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.365338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1262dc-ed92-4c40-b64b-51fae84f07ea None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.418462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87064ed-d0e3-41ff-986b-28551e733668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.419111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87064ed-d0e3-41ff-986b-28551e733668 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.419395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87064ed-d0e3-41ff-986b-28551e733668 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.419671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87064ed-d0e3-41ff-986b-28551e733668 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.420377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87064ed-d0e3-41ff-986b-28551e733668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.422284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87064ed-d0e3-41ff-986b-28551e733668 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.441832 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4224/8411] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:17:58 2022] POST /identity/v3/users => generated 297 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:17:58.445948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d147d-a1db-4240-8057-7daaca2776e6 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.456765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d147d-a1db-4240-8057-7daaca2776e6 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.461358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091f4b9-a985-4148-a34a-30a6913108e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.461999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f4b9-a985-4148-a34a-30a6913108e8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.462286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f4b9-a985-4148-a34a-30a6913108e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.462568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091f4b9-a985-4148-a34a-30a6913108e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.463280 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091f4b9-a985-4148-a34a-30a6913108e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.464922 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8091f4b9-a985-4148-a34a-30a6913108e8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.476265 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4188/8412] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:58.480714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87064ed-d0e3-41ff-986b-28551e733668 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.490516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87064ed-d0e3-41ff-986b-28551e733668 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.495125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aac1b9-a31f-4896-b1ff-aa51999ed622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.496651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aac1b9-a31f-4896-b1ff-aa51999ed622 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.496930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aac1b9-a31f-4896-b1ff-aa51999ed622 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.497203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aac1b9-a31f-4896-b1ff-aa51999ed622 admin admin] PATH_INFO: `/v3/projects/85b7344eb0484555bb9d4f1ed64697e6/users/a4826d176b9444b8bbfc66f5b6268546/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.511384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aac1b9-a31f-4896-b1ff-aa51999ed622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b7344eb0484555bb9d4f1ed64697e6, user_id=a4826d176b9444b8bbfc66f5b6268546, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.514087 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aac1b9-a31f-4896-b1ff-aa51999ed622 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.526674 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4225/8413] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:58 2022] PUT /identity/v3/projects/85b7344eb0484555bb9d4f1ed64697e6/users/a4826d176b9444b8bbfc66f5b6268546/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:58.530464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091f4b9-a985-4148-a34a-30a6913108e8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.540377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091f4b9-a985-4148-a34a-30a6913108e8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.594095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985109c2-1ac1-4818-84f3-37f755c1469c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.594747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985109c2-1ac1-4818-84f3-37f755c1469c admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.595032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985109c2-1ac1-4818-84f3-37f755c1469c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.595314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985109c2-1ac1-4818-84f3-37f755c1469c admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.596053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985109c2-1ac1-4818-84f3-37f755c1469c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.597658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985109c2-1ac1-4818-84f3-37f755c1469c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.607911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4189/8414] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:17:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:17:58.612221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aac1b9-a31f-4896-b1ff-aa51999ed622 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.623245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aac1b9-a31f-4896-b1ff-aa51999ed622 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.627981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff985f0-a89d-4cf4-a2f2-5ce9f42017ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.628849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff985f0-a89d-4cf4-a2f2-5ce9f42017ca admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.629133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff985f0-a89d-4cf4-a2f2-5ce9f42017ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.629410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff985f0-a89d-4cf4-a2f2-5ce9f42017ca admin admin] PATH_INFO: `/v3/projects/85b7344eb0484555bb9d4f1ed64697e6/users/a4826d176b9444b8bbfc66f5b6268546/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.631384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff985f0-a89d-4cf4-a2f2-5ce9f42017ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b7344eb0484555bb9d4f1ed64697e6, user_id=a4826d176b9444b8bbfc66f5b6268546, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.634085 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff985f0-a89d-4cf4-a2f2-5ce9f42017ca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.644063 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4226/8415] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:17:58 2022] PUT /identity/v3/projects/85b7344eb0484555bb9d4f1ed64697e6/users/a4826d176b9444b8bbfc66f5b6268546/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:17:58.743992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2b5a1-05aa-4ed4-a8da-cdd9e2730b18 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.744532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2b5a1-05aa-4ed4-a8da-cdd9e2730b18 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.744532 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2b5a1-05aa-4ed4-a8da-cdd9e2730b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.770528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ccb2b5a1-05aa-4ed4-a8da-cdd9e2730b18 None None] MFA Rules not processed for user `a4826d176b9444b8bbfc66f5b6268546`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:17:58.771718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ccb2b5a1-05aa-4ed4-a8da-cdd9e2730b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:58.838273 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4190/8416] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:17:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:17:58.848889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff985f0-a89d-4cf4-a2f2-5ce9f42017ca admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:58.850651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7ff985f0-a89d-4cf4-a2f2-5ce9f42017ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:17:58.909299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff985f0-a89d-4cf4-a2f2-5ce9f42017ca admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:58.912836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720460c-8684-4df6-8523-dbd6f97e414d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:58.913778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720460c-8684-4df6-8523-dbd6f97e414d service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:58.914060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720460c-8684-4df6-8523-dbd6f97e414d service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:58.914368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720460c-8684-4df6-8523-dbd6f97e414d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:58.923783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720460c-8684-4df6-8523-dbd6f97e414d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:58.925504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720460c-8684-4df6-8523-dbd6f97e414d service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:58.934705 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4227/8417] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:17:59.033026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2b5a1-05aa-4ed4-a8da-cdd9e2730b18 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:17:59.045756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2b5a1-05aa-4ed4-a8da-cdd9e2730b18 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:17:59.049419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3cb86f-a5da-4fb6-a119-a63951c2cf3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:17:59.050171 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cb86f-a5da-4fb6-a119-a63951c2cf3b service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:17:59.050676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cb86f-a5da-4fb6-a119-a63951c2cf3b service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:17:59.050955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3cb86f-a5da-4fb6-a119-a63951c2cf3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:17:59.104686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cb86f-a5da-4fb6-a119-a63951c2cf3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:17:59.106776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3cb86f-a5da-4fb6-a119-a63951c2cf3b service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:17:59.115604 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4191/8418] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:17:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:18:01.643761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720460c-8684-4df6-8523-dbd6f97e414d service cinder] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:01.703275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720460c-8684-4df6-8523-dbd6f97e414d service cinder] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:01.707702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:01.708576 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:01.708858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:01.709132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] PATH_INFO: `/v3/users/0be9fff48c24443dbfe8c67b9deb3a74` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:01.710282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be9fff48c24443dbfe8c67b9deb3a74)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:01.712415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:01.754981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be9fff48c24443dbfe8c67b9deb3a74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:01.761541 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be9fff48c24443dbfe8c67b9deb3a74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:01.762186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be9fff48c24443dbfe8c67b9deb3a74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:01.762781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be9fff48c24443dbfe8c67b9deb3a74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:01.769172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be9fff48c24443dbfe8c67b9deb3a74'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:01.785563 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4228/8419] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:18:01 2022] DELETE /identity/v3/users/0be9fff48c24443dbfe8c67b9deb3a74 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:01.790072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf256818-bf55-4595-9385-a5de1a75279b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:01.790558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf256818-bf55-4595-9385-a5de1a75279b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:01.790653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf256818-bf55-4595-9385-a5de1a75279b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:01.809218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-bf256818-bf55-4595-9385-a5de1a75279b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:01.810531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bf256818-bf55-4595-9385-a5de1a75279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:01.868713 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4192/8420] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:01.878946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:01.880308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:01.939270 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d6800-fde3-476f-b054-65fb4c139640 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:01.942998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c04a8-6053-4f05-a323-fd415521454b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:01.943636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c04a8-6053-4f05-a323-fd415521454b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:01.943943 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c04a8-6053-4f05-a323-fd415521454b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:01.944236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725c04a8-6053-4f05-a323-fd415521454b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:01.953173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c04a8-6053-4f05-a323-fd415521454b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:01.954622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725c04a8-6053-4f05-a323-fd415521454b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:01.964954 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4229/8421] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:18:02.232375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf256818-bf55-4595-9385-a5de1a75279b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:02.233853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bf256818-bf55-4595-9385-a5de1a75279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:02.249136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf256818-bf55-4595-9385-a5de1a75279b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:02.253839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:02.254692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:02.254972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:02.255318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] PATH_INFO: `/v3/projects/141efad2a96843f4862051948ec5934b` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:02.256536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141efad2a96843f4862051948ec5934b)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:02.258539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:02.304935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141efad2a96843f4862051948ec5934b', 'request_id': 'req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.311740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141efad2a96843f4862051948ec5934b', 'request_id': 'req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.316995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141efad2a96843f4862051948ec5934b', 'request_id': 'req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.328482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] The token cache is being invalidate because project 141efad2a96843f4862051948ec5934b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:18:02.328771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.329418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.330945 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4193/8422] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:18:02 2022] DELETE /identity/v3/projects/141efad2a96843f4862051948ec5934b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:02.334884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c04a8-6053-4f05-a323-fd415521454b service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:02.345145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725c04a8-6053-4f05-a323-fd415521454b service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:02.397485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:02.398330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:02.398609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:02.398881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] PATH_INFO: `/v3/users/a4826d176b9444b8bbfc66f5b6268546` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:02.400093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4826d176b9444b8bbfc66f5b6268546)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:02.402605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:02.444490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4826d176b9444b8bbfc66f5b6268546'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.451503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4826d176b9444b8bbfc66f5b6268546'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.452179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4826d176b9444b8bbfc66f5b6268546'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.452783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4826d176b9444b8bbfc66f5b6268546'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.459258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-10cd072b-2afc-4f0e-96c6-fb795d7daa96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4826d176b9444b8bbfc66f5b6268546'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.476665 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4230/8423] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:18:02 2022] DELETE /identity/v3/users/a4826d176b9444b8bbfc66f5b6268546 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:02.733771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:02.735244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:02.748822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0524e-9e94-4bc7-9cbf-b0924e3f9b61 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:02.805116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:02.805975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:02.806264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:02.806544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] PATH_INFO: `/v3/projects/85b7344eb0484555bb9d4f1ed64697e6` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:02.808368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b7344eb0484555bb9d4f1ed64697e6)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:02.810345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:02.859186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b7344eb0484555bb9d4f1ed64697e6', 'request_id': 'req-b8bc1212-2afe-47eb-acad-1a24ce67647e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.866364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b7344eb0484555bb9d4f1ed64697e6', 'request_id': 'req-b8bc1212-2afe-47eb-acad-1a24ce67647e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.872368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b7344eb0484555bb9d4f1ed64697e6', 'request_id': 'req-b8bc1212-2afe-47eb-acad-1a24ce67647e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.883010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] The token cache is being invalidate because project 85b7344eb0484555bb9d4f1ed64697e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:18:02.883303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.883955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b8bc1212-2afe-47eb-acad-1a24ce67647e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:02.885776 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4194/8424] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:18:02 2022] DELETE /identity/v3/projects/85b7344eb0484555bb9d4f1ed64697e6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:02.891206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6d92-998d-44a4-a17f-d4a5a1e479ca None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:02.891654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6d92-998d-44a4-a17f-d4a5a1e479ca None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:02.891765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e6d92-998d-44a4-a17f-d4a5a1e479ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:02.909321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-914e6d92-998d-44a4-a17f-d4a5a1e479ca None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:02.910504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-914e6d92-998d-44a4-a17f-d4a5a1e479ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:02.967126 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4231/8425] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:02.974713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2cae1-172f-4c0a-8581-90479efe675d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:02.975006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2cae1-172f-4c0a-8581-90479efe675d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:02.975315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c2cae1-172f-4c0a-8581-90479efe675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:02.994642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-08c2cae1-172f-4c0a-8581-90479efe675d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:02.996456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-08c2cae1-172f-4c0a-8581-90479efe675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:03.004260 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4195/8426] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:03.008445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6d92-998d-44a4-a17f-d4a5a1e479ca None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.018173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e6d92-998d-44a4-a17f-d4a5a1e479ca None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.022717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08921eea-a4cb-481d-8ee6-ba0dfaaf7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.023361 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08921eea-a4cb-481d-8ee6-ba0dfaaf7dca admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.023640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08921eea-a4cb-481d-8ee6-ba0dfaaf7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.023937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08921eea-a4cb-481d-8ee6-ba0dfaaf7dca admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.024683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08921eea-a4cb-481d-8ee6-ba0dfaaf7dca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:18:03.024971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08921eea-a4cb-481d-8ee6-ba0dfaaf7dca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.026606 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08921eea-a4cb-481d-8ee6-ba0dfaaf7dca admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.037968 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4232/8427] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:18:03.042827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2cae1-172f-4c0a-8581-90479efe675d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.052497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c2cae1-172f-4c0a-8581-90479efe675d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.057164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766bbd7-6852-495e-90ab-fc6cd48f096e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.058388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766bbd7-6852-495e-90ab-fc6cd48f096e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.058683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766bbd7-6852-495e-90ab-fc6cd48f096e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.058964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766bbd7-6852-495e-90ab-fc6cd48f096e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.059657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766bbd7-6852-495e-90ab-fc6cd48f096e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.061607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2766bbd7-6852-495e-90ab-fc6cd48f096e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.086741 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4196/8428] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:18:03 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:18:03.090945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08921eea-a4cb-481d-8ee6-ba0dfaaf7dca admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.100690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08921eea-a4cb-481d-8ee6-ba0dfaaf7dca admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.153605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08299a91-9e3f-4e0e-8d50-f9645caec864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.154314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08299a91-9e3f-4e0e-8d50-f9645caec864 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.154596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08299a91-9e3f-4e0e-8d50-f9645caec864 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.154872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08299a91-9e3f-4e0e-8d50-f9645caec864 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.155593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08299a91-9e3f-4e0e-8d50-f9645caec864 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.157618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08299a91-9e3f-4e0e-8d50-f9645caec864 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.178262 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4233/8429] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:18:03 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:18:03.182313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766bbd7-6852-495e-90ab-fc6cd48f096e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.193290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766bbd7-6852-495e-90ab-fc6cd48f096e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.197912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eba0b4-042a-4fbf-985a-fba15e8a3689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.198562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eba0b4-042a-4fbf-985a-fba15e8a3689 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.198849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eba0b4-042a-4fbf-985a-fba15e8a3689 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.199132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eba0b4-042a-4fbf-985a-fba15e8a3689 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.199853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eba0b4-042a-4fbf-985a-fba15e8a3689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.201550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eba0b4-042a-4fbf-985a-fba15e8a3689 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.211898 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4197/8430] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:18:03.215746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08299a91-9e3f-4e0e-8d50-f9645caec864 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.225731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08299a91-9e3f-4e0e-8d50-f9645caec864 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.231036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c37f4-ead2-4dbb-950d-c86507376b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.231704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c37f4-ead2-4dbb-950d-c86507376b1a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.232026 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c37f4-ead2-4dbb-950d-c86507376b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.232305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c37f4-ead2-4dbb-950d-c86507376b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.233042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c37f4-ead2-4dbb-950d-c86507376b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.234654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216c37f4-ead2-4dbb-950d-c86507376b1a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.244492 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4234/8431] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:18:03.248975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eba0b4-042a-4fbf-985a-fba15e8a3689 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.258765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eba0b4-042a-4fbf-985a-fba15e8a3689 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.263399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46744bab-9819-4549-be73-cc1fc3de0e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.264328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46744bab-9819-4549-be73-cc1fc3de0e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.264613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46744bab-9819-4549-be73-cc1fc3de0e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.264889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46744bab-9819-4549-be73-cc1fc3de0e4c admin admin] PATH_INFO: `/v3/projects/76dff10abf8b4335a7dd8c6721545687/users/891dc141cc4f4523bfb77c87efd3199a/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.279070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46744bab-9819-4549-be73-cc1fc3de0e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76dff10abf8b4335a7dd8c6721545687, user_id=891dc141cc4f4523bfb77c87efd3199a, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.281770 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46744bab-9819-4549-be73-cc1fc3de0e4c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.295209 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4198/8432] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:18:03 2022] PUT /identity/v3/projects/76dff10abf8b4335a7dd8c6721545687/users/891dc141cc4f4523bfb77c87efd3199a/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:18:03.305162 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c76b4-d4b9-48ca-99a2-13e29c6f0647 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.305457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c76b4-d4b9-48ca-99a2-13e29c6f0647 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.305738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c76b4-d4b9-48ca-99a2-13e29c6f0647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.333065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b90c76b4-d4b9-48ca-99a2-13e29c6f0647 None None] MFA Rules not processed for user `891dc141cc4f4523bfb77c87efd3199a`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:03.334256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b90c76b4-d4b9-48ca-99a2-13e29c6f0647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:03.394323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4235/8433] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:03.398707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46744bab-9819-4549-be73-cc1fc3de0e4c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.459131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46744bab-9819-4549-be73-cc1fc3de0e4c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.463830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9af2-abc8-4562-b644-ef1701953985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.465018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9af2-abc8-4562-b644-ef1701953985 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.465303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9af2-abc8-4562-b644-ef1701953985 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.465582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309b9af2-abc8-4562-b644-ef1701953985 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.466266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9af2-abc8-4562-b644-ef1701953985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.468212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309b9af2-abc8-4562-b644-ef1701953985 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.492641 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4199/8434] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:18:03 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:18:03.496736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c76b4-d4b9-48ca-99a2-13e29c6f0647 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.507256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c76b4-d4b9-48ca-99a2-13e29c6f0647 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.561267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d343d-c888-4ea0-baba-7a7c5c716ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.561914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d343d-c888-4ea0-baba-7a7c5c716ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.562193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d343d-c888-4ea0-baba-7a7c5c716ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.562489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d343d-c888-4ea0-baba-7a7c5c716ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.563186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d343d-c888-4ea0-baba-7a7c5c716ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.565145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d343d-c888-4ea0-baba-7a7c5c716ee4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.584148 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4236/8435] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:18:03 2022] POST /identity/v3/users => generated 301 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:18:03.588336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9af2-abc8-4562-b644-ef1701953985 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.599156 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309b9af2-abc8-4562-b644-ef1701953985 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.603709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1b344-d212-4883-8b71-938963548528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.604402 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b344-d212-4883-8b71-938963548528 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.605267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b344-d212-4883-8b71-938963548528 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.605546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c1b344-d212-4883-8b71-938963548528 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.606288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1b344-d212-4883-8b71-938963548528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.607884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c1b344-d212-4883-8b71-938963548528 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.617645 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4200/8436] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:18:03.621545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d343d-c888-4ea0-baba-7a7c5c716ee4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.631092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d343d-c888-4ea0-baba-7a7c5c716ee4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.635731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c957fae-db1f-4673-987c-4b8134b2520a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.636646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c957fae-db1f-4673-987c-4b8134b2520a admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.636931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c957fae-db1f-4673-987c-4b8134b2520a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.637204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c957fae-db1f-4673-987c-4b8134b2520a admin admin] PATH_INFO: `/v3/projects/7157d19cbf9f49d6a7569e38e947d930/users/a499d082786946778093851de21ba5e7/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.650887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c957fae-db1f-4673-987c-4b8134b2520a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7157d19cbf9f49d6a7569e38e947d930, user_id=a499d082786946778093851de21ba5e7, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.654172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c957fae-db1f-4673-987c-4b8134b2520a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.666816 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4237/8437] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:18:03 2022] PUT /identity/v3/projects/7157d19cbf9f49d6a7569e38e947d930/users/a499d082786946778093851de21ba5e7/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:18:03.671185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1b344-d212-4883-8b71-938963548528 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.681215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c1b344-d212-4883-8b71-938963548528 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.735227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85e6c5-3b50-4943-a3e7-0ae40037cc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.735873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85e6c5-3b50-4943-a3e7-0ae40037cc56 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.736188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85e6c5-3b50-4943-a3e7-0ae40037cc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.736464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85e6c5-3b50-4943-a3e7-0ae40037cc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.737169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85e6c5-3b50-4943-a3e7-0ae40037cc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.738763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85e6c5-3b50-4943-a3e7-0ae40037cc56 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.748219 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4201/8438] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:18:03.752265 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c957fae-db1f-4673-987c-4b8134b2520a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.762840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c957fae-db1f-4673-987c-4b8134b2520a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.767514 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd9b5c-f5f7-4ba8-9352-3a6a402a95b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.768435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd9b5c-f5f7-4ba8-9352-3a6a402a95b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.768715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd9b5c-f5f7-4ba8-9352-3a6a402a95b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.768987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd9b5c-f5f7-4ba8-9352-3a6a402a95b4 admin admin] PATH_INFO: `/v3/projects/7157d19cbf9f49d6a7569e38e947d930/users/a499d082786946778093851de21ba5e7/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.770975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd9b5c-f5f7-4ba8-9352-3a6a402a95b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7157d19cbf9f49d6a7569e38e947d930, user_id=a499d082786946778093851de21ba5e7, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.773645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd9b5c-f5f7-4ba8-9352-3a6a402a95b4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.784244 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4238/8439] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:18:03 2022] PUT /identity/v3/projects/7157d19cbf9f49d6a7569e38e947d930/users/a499d082786946778093851de21ba5e7/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:03.795219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcf174-fa97-4017-b620-fa1de707deb6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.795511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcf174-fa97-4017-b620-fa1de707deb6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.795790 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcf174-fa97-4017-b620-fa1de707deb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.822018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2cbcf174-fa97-4017-b620-fa1de707deb6 None None] MFA Rules not processed for user `a499d082786946778093851de21ba5e7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:03.823205 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2cbcf174-fa97-4017-b620-fa1de707deb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:03.888966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4202/8440] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:03.899566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd9b5c-f5f7-4ba8-9352-3a6a402a95b4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:03.901261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a4bd9b5c-f5f7-4ba8-9352-3a6a402a95b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:03.960600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd9b5c-f5f7-4ba8-9352-3a6a402a95b4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:03.964880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cf46b-2383-4f98-a392-5fcde68511f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:03.965512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf46b-2383-4f98-a392-5fcde68511f4 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:03.965837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf46b-2383-4f98-a392-5fcde68511f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:03.966072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cf46b-2383-4f98-a392-5fcde68511f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:03.975449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cf46b-2383-4f98-a392-5fcde68511f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:03.976918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cf46b-2383-4f98-a392-5fcde68511f4 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:03.987630 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4239/8441] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:18:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:18:04.124494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcf174-fa97-4017-b620-fa1de707deb6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:04.188589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcf174-fa97-4017-b620-fa1de707deb6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:04.193143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:04.194011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:04.194300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:04.194573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] PATH_INFO: `/v3/users/891dc141cc4f4523bfb77c87efd3199a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:04.195853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891dc141cc4f4523bfb77c87efd3199a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:04.197867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:04.243328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891dc141cc4f4523bfb77c87efd3199a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.252089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891dc141cc4f4523bfb77c87efd3199a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.252837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891dc141cc4f4523bfb77c87efd3199a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.253444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891dc141cc4f4523bfb77c87efd3199a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.265505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891dc141cc4f4523bfb77c87efd3199a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.277193 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4203/8442] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:18:04 2022] DELETE /identity/v3/users/891dc141cc4f4523bfb77c87efd3199a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:04.281613 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27064705-60e2-494e-9041-a2aab4a57159 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:04.281903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27064705-60e2-494e-9041-a2aab4a57159 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:04.282180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27064705-60e2-494e-9041-a2aab4a57159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:04.299715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-27064705-60e2-494e-9041-a2aab4a57159 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:04.301207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-27064705-60e2-494e-9041-a2aab4a57159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:04.357415 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4240/8443] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:04.366988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:04.368413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:04.427964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561e8cb-af83-4df4-9d08-aed027e60c35 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:04.431600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da272c-c7a9-4636-8091-46bebf9cf7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:04.432264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da272c-c7a9-4636-8091-46bebf9cf7fc service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:04.432550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da272c-c7a9-4636-8091-46bebf9cf7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:04.433343 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da272c-c7a9-4636-8091-46bebf9cf7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:04.442305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da272c-c7a9-4636-8091-46bebf9cf7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:04.443744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da272c-c7a9-4636-8091-46bebf9cf7fc service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:04.453684 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4204/8444] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:18:04.710812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27064705-60e2-494e-9041-a2aab4a57159 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:04.712358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-27064705-60e2-494e-9041-a2aab4a57159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:04.726105 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27064705-60e2-494e-9041-a2aab4a57159 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:04.732119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:04.733296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:04.733751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:04.734071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] PATH_INFO: `/v3/projects/76dff10abf8b4335a7dd8c6721545687` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:04.735365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76dff10abf8b4335a7dd8c6721545687)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:04.737309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:04.781293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76dff10abf8b4335a7dd8c6721545687', 'request_id': 'req-30a43ffa-6532-4027-91ac-915ffa1bc971'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.788434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76dff10abf8b4335a7dd8c6721545687', 'request_id': 'req-30a43ffa-6532-4027-91ac-915ffa1bc971'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.794605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76dff10abf8b4335a7dd8c6721545687', 'request_id': 'req-30a43ffa-6532-4027-91ac-915ffa1bc971'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.805356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] The token cache is being invalidate because project 76dff10abf8b4335a7dd8c6721545687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:18:04.805644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.806268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.808458 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4241/8445] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:18:04 2022] DELETE /identity/v3/projects/76dff10abf8b4335a7dd8c6721545687 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:04.812424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da272c-c7a9-4636-8091-46bebf9cf7fc service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:04.822167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da272c-c7a9-4636-8091-46bebf9cf7fc service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:04.877523 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:04.878400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:04.878689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:04.878967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] PATH_INFO: `/v3/users/a499d082786946778093851de21ba5e7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:04.880179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a499d082786946778093851de21ba5e7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:04.882120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:04.926311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a499d082786946778093851de21ba5e7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.933225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a499d082786946778093851de21ba5e7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.934048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a499d082786946778093851de21ba5e7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.934714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a499d082786946778093851de21ba5e7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.945988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-62d51f1d-8c81-4d8e-9206-661a8c9ad491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a499d082786946778093851de21ba5e7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:04.957690 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4205/8446] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:18:04 2022] DELETE /identity/v3/users/a499d082786946778093851de21ba5e7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:05.220723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:05.222138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:05.235317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43ffa-6532-4027-91ac-915ffa1bc971 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:05.291818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:05.292794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.293077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.293352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] PATH_INFO: `/v3/projects/7157d19cbf9f49d6a7569e38e947d930` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.294513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7157d19cbf9f49d6a7569e38e947d930)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:05.296567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:05.341074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7157d19cbf9f49d6a7569e38e947d930', 'request_id': 'req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:05.348272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7157d19cbf9f49d6a7569e38e947d930', 'request_id': 'req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:05.353571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7157d19cbf9f49d6a7569e38e947d930', 'request_id': 'req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:05.364090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] The token cache is being invalidate because project 7157d19cbf9f49d6a7569e38e947d930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:18:05.364380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:05.365007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-2c4a3494-aca9-46a6-86c6-c8d4dfdf8fa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:05.366525 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4242/8447] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:18:05 2022] DELETE /identity/v3/projects/7157d19cbf9f49d6a7569e38e947d930 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:18:05.371564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b440b-2983-469c-a7ec-f4ae9840cae6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.371852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b440b-2983-469c-a7ec-f4ae9840cae6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.372157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b440b-2983-469c-a7ec-f4ae9840cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.390293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3a8b440b-2983-469c-a7ec-f4ae9840cae6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:05.391546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a8b440b-2983-469c-a7ec-f4ae9840cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:05.452753 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4206/8448] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:05.460818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd2436-16e9-4815-b1e4-1ca5ba07a523 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.461110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd2436-16e9-4815-b1e4-1ca5ba07a523 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.461394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd2436-16e9-4815-b1e4-1ca5ba07a523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.479846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4ccd2436-16e9-4815-b1e4-1ca5ba07a523 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:05.481129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4ccd2436-16e9-4815-b1e4-1ca5ba07a523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:05.488969 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4243/8449] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:05.492964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b440b-2983-469c-a7ec-f4ae9840cae6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:05.502539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8b440b-2983-469c-a7ec-f4ae9840cae6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:05.507077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e349-47c6-4dd9-82f7-bba9c1846b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:05.507714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e349-47c6-4dd9-82f7-bba9c1846b74 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.508058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e349-47c6-4dd9-82f7-bba9c1846b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.508336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3e349-47c6-4dd9-82f7-bba9c1846b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.509040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e349-47c6-4dd9-82f7-bba9c1846b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:18:05.509344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e349-47c6-4dd9-82f7-bba9c1846b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:05.511429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3e349-47c6-4dd9-82f7-bba9c1846b74 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:05.522576 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4207/8450] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:18:05.527308 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd2436-16e9-4815-b1e4-1ca5ba07a523 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:05.536544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd2436-16e9-4815-b1e4-1ca5ba07a523 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:05.541120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3455c3-d940-407e-b5da-538684b09e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:05.541757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3455c3-d940-407e-b5da-538684b09e87 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.542143 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3455c3-d940-407e-b5da-538684b09e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.542509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3455c3-d940-407e-b5da-538684b09e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.543210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3455c3-d940-407e-b5da-538684b09e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:05.545136 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3455c3-d940-407e-b5da-538684b09e87 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:05.569535 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4244/8451] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:18:05 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:18:05.574412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e349-47c6-4dd9-82f7-bba9c1846b74 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:05.584311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3e349-47c6-4dd9-82f7-bba9c1846b74 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:05.639660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627af87e-2730-4c35-afaa-69834aa0dedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:05.640286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627af87e-2730-4c35-afaa-69834aa0dedc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.640575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627af87e-2730-4c35-afaa-69834aa0dedc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.640853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627af87e-2730-4c35-afaa-69834aa0dedc admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.641542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627af87e-2730-4c35-afaa-69834aa0dedc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:05.643479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627af87e-2730-4c35-afaa-69834aa0dedc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:05.663094 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4208/8452] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:18:05 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:18:05.667820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3455c3-d940-407e-b5da-538684b09e87 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:05.678303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3455c3-d940-407e-b5da-538684b09e87 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:05.682878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584e099-3c25-4cd6-9baf-455367bc57eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:05.683522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584e099-3c25-4cd6-9baf-455367bc57eb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.683814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584e099-3c25-4cd6-9baf-455367bc57eb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.684124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584e099-3c25-4cd6-9baf-455367bc57eb admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.684843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584e099-3c25-4cd6-9baf-455367bc57eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:05.686449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584e099-3c25-4cd6-9baf-455367bc57eb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:05.696827 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4245/8453] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:18:05.700698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627af87e-2730-4c35-afaa-69834aa0dedc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:05.710417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627af87e-2730-4c35-afaa-69834aa0dedc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:05.715480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf3259-7357-4b99-9b66-884ab9f69b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:05.716221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf3259-7357-4b99-9b66-884ab9f69b14 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.716505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf3259-7357-4b99-9b66-884ab9f69b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.716782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf3259-7357-4b99-9b66-884ab9f69b14 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.717486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf3259-7357-4b99-9b66-884ab9f69b14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:05.719077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf3259-7357-4b99-9b66-884ab9f69b14 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:05.731551 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4209/8454] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:18:05.735350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584e099-3c25-4cd6-9baf-455367bc57eb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:05.745084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584e099-3c25-4cd6-9baf-455367bc57eb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:05.749726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c4c29-f5c2-4540-b3d4-2f009ff6dd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:05.750587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c4c29-f5c2-4540-b3d4-2f009ff6dd16 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.750872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c4c29-f5c2-4540-b3d4-2f009ff6dd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.751163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c4c29-f5c2-4540-b3d4-2f009ff6dd16 admin admin] PATH_INFO: `/v3/projects/dd3ee9d1e7b94fc4a74f972e70c05257/users/92be875a64494d6dae76ee0c088c84c0/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.766106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c4c29-f5c2-4540-b3d4-2f009ff6dd16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3ee9d1e7b94fc4a74f972e70c05257, user_id=92be875a64494d6dae76ee0c088c84c0, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:05.768798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c4c29-f5c2-4540-b3d4-2f009ff6dd16 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:05.787788 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4246/8455] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:18:05 2022] PUT /identity/v3/projects/dd3ee9d1e7b94fc4a74f972e70c05257/users/92be875a64494d6dae76ee0c088c84c0/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:05.793531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e70fe-4c72-4f28-a2bd-20f645e234b1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.793821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e70fe-4c72-4f28-a2bd-20f645e234b1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.794098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e70fe-4c72-4f28-a2bd-20f645e234b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.811049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2e2e70fe-4c72-4f28-a2bd-20f645e234b1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:05.812355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e2e70fe-4c72-4f28-a2bd-20f645e234b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:05.868002 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4210/8456] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:05.877422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c4c29-f5c2-4540-b3d4-2f009ff6dd16 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:05.879084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-542c4c29-f5c2-4540-b3d4-2f009ff6dd16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:05.940193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c4c29-f5c2-4540-b3d4-2f009ff6dd16 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:05.943824 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d0df6-c017-4665-8a2f-dcf66d412368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:05.944494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0df6-c017-4665-8a2f-dcf66d412368 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:05.944780 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0df6-c017-4665-8a2f-dcf66d412368 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:05.945057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0df6-c017-4665-8a2f-dcf66d412368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:05.953820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d0df6-c017-4665-8a2f-dcf66d412368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:05.955256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d0df6-c017-4665-8a2f-dcf66d412368 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:05.964965 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4247/8457] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:18:06.541495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d44d1-adcb-4ca5-a069-7aa8fcbe7b4e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:06.541794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d44d1-adcb-4ca5-a069-7aa8fcbe7b4e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:06.542078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d44d1-adcb-4ca5-a069-7aa8fcbe7b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:06.568760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-944d44d1-adcb-4ca5-a069-7aa8fcbe7b4e None None] MFA Rules not processed for user `92be875a64494d6dae76ee0c088c84c0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:06.570099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-944d44d1-adcb-4ca5-a069-7aa8fcbe7b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:06.634708 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4211/8458] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:06.639646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d0df6-c017-4665-8a2f-dcf66d412368 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:06.649251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d0df6-c017-4665-8a2f-dcf66d412368 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:06.653834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349f9fb-c2b3-47b8-b3f5-91515d0b91a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:06.654473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349f9fb-c2b3-47b8-b3f5-91515d0b91a7 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:06.654759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349f9fb-c2b3-47b8-b3f5-91515d0b91a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:06.655039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349f9fb-c2b3-47b8-b3f5-91515d0b91a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:06.655712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349f9fb-c2b3-47b8-b3f5-91515d0b91a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:06.657704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349f9fb-c2b3-47b8-b3f5-91515d0b91a7 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:06.685033 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4248/8459] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:18:06 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:18:06.689014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d44d1-adcb-4ca5-a069-7aa8fcbe7b4e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:06.700164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d44d1-adcb-4ca5-a069-7aa8fcbe7b4e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:06.754139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f605c03-5908-4fdd-86cf-0952c5911f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:06.754729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f605c03-5908-4fdd-86cf-0952c5911f78 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:06.755010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f605c03-5908-4fdd-86cf-0952c5911f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:06.755283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f605c03-5908-4fdd-86cf-0952c5911f78 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:06.756005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f605c03-5908-4fdd-86cf-0952c5911f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:06.757924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f605c03-5908-4fdd-86cf-0952c5911f78 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:06.775866 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4212/8460] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:18:06 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:18:06.779795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349f9fb-c2b3-47b8-b3f5-91515d0b91a7 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:06.789870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349f9fb-c2b3-47b8-b3f5-91515d0b91a7 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:06.795453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee18447-9dba-4b39-85fd-c3013b47585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:06.796122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee18447-9dba-4b39-85fd-c3013b47585d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:06.796402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee18447-9dba-4b39-85fd-c3013b47585d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:06.796674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee18447-9dba-4b39-85fd-c3013b47585d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:06.797380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee18447-9dba-4b39-85fd-c3013b47585d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:06.798967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee18447-9dba-4b39-85fd-c3013b47585d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:06.810035 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4249/8461] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:18:06.814065 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f605c03-5908-4fdd-86cf-0952c5911f78 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:06.823814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f605c03-5908-4fdd-86cf-0952c5911f78 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:06.828448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbfa00-4bdd-4118-9ee1-9913182a18e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:06.829313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbfa00-4bdd-4118-9ee1-9913182a18e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:06.829601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbfa00-4bdd-4118-9ee1-9913182a18e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:06.829878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbfa00-4bdd-4118-9ee1-9913182a18e8 admin admin] PATH_INFO: `/v3/projects/213ca20564674202957fa1b39b07adad/users/0b461ac82d894c74b4defa1857be67dc/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:06.843822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbfa00-4bdd-4118-9ee1-9913182a18e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=213ca20564674202957fa1b39b07adad, user_id=0b461ac82d894c74b4defa1857be67dc, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:06.846509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbfa00-4bdd-4118-9ee1-9913182a18e8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:06.859261 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4213/8462] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:18:06 2022] PUT /identity/v3/projects/213ca20564674202957fa1b39b07adad/users/0b461ac82d894c74b4defa1857be67dc/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:06.863231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee18447-9dba-4b39-85fd-c3013b47585d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:06.873860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee18447-9dba-4b39-85fd-c3013b47585d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:06.927389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f4dc5-46b4-40c3-ba94-8532f7ae647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:06.928074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f4dc5-46b4-40c3-ba94-8532f7ae647e admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:06.928363 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f4dc5-46b4-40c3-ba94-8532f7ae647e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:06.928643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f4dc5-46b4-40c3-ba94-8532f7ae647e admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:06.929352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f4dc5-46b4-40c3-ba94-8532f7ae647e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:06.930954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f4dc5-46b4-40c3-ba94-8532f7ae647e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:06.940962 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4250/8463] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:18:06.945079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbfa00-4bdd-4118-9ee1-9913182a18e8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:06.955195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbfa00-4bdd-4118-9ee1-9913182a18e8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:06.959881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afcdc7d-d3c8-4578-804b-c1d7aad0f3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:06.960787 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcdc7d-d3c8-4578-804b-c1d7aad0f3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:06.961096 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcdc7d-d3c8-4578-804b-c1d7aad0f3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:06.961378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afcdc7d-d3c8-4578-804b-c1d7aad0f3b4 admin admin] PATH_INFO: `/v3/projects/213ca20564674202957fa1b39b07adad/users/0b461ac82d894c74b4defa1857be67dc/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:06.963365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcdc7d-d3c8-4578-804b-c1d7aad0f3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=213ca20564674202957fa1b39b07adad, user_id=0b461ac82d894c74b4defa1857be67dc, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:06.966124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afcdc7d-d3c8-4578-804b-c1d7aad0f3b4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:06.976164 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4214/8464] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:18:06 2022] PUT /identity/v3/projects/213ca20564674202957fa1b39b07adad/users/0b461ac82d894c74b4defa1857be67dc/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:07.598336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ae382-7eb7-48d8-942d-0cad737576ca None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:07.598631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ae382-7eb7-48d8-942d-0cad737576ca None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:07.598915 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ae382-7eb7-48d8-942d-0cad737576ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:07.625057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-584ae382-7eb7-48d8-942d-0cad737576ca None None] MFA Rules not processed for user `0b461ac82d894c74b4defa1857be67dc`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:07.626284 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-584ae382-7eb7-48d8-942d-0cad737576ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:07.695999 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4251/8465] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:07.706594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073017c-9a8e-4124-81bb-7129fdae7b64 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:07.706884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073017c-9a8e-4124-81bb-7129fdae7b64 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:07.707162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073017c-9a8e-4124-81bb-7129fdae7b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:07.724879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c073017c-9a8e-4124-81bb-7129fdae7b64 None None] MFA Rules not processed for user `92be875a64494d6dae76ee0c088c84c0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:07.726084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c073017c-9a8e-4124-81bb-7129fdae7b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:07.780765 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4215/8466] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:18:07.792692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ae382-7eb7-48d8-942d-0cad737576ca None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:07.794020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-584ae382-7eb7-48d8-942d-0cad737576ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:07.867448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ae382-7eb7-48d8-942d-0cad737576ca None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:07.873692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d76267-1da4-46f8-8002-b774e385b649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:07.874331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76267-1da4-46f8-8002-b774e385b649 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:07.874615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76267-1da4-46f8-8002-b774e385b649 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:07.874894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d76267-1da4-46f8-8002-b774e385b649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:07.882523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d76267-1da4-46f8-8002-b774e385b649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:07.884161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d76267-1da4-46f8-8002-b774e385b649 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:07.892910 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4252/8467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:18:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:18:21.069966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073017c-9a8e-4124-81bb-7129fdae7b64 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:21.071426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c073017c-9a8e-4124-81bb-7129fdae7b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:21.128745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073017c-9a8e-4124-81bb-7129fdae7b64 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:21.132221 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53c01-9874-4c4f-a0eb-dffa10823678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:21.132849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53c01-9874-4c4f-a0eb-dffa10823678 service cinder] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:21.133135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53c01-9874-4c4f-a0eb-dffa10823678 service cinder] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:21.133410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d53c01-9874-4c4f-a0eb-dffa10823678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:21.142665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d53c01-9874-4c4f-a0eb-dffa10823678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:21.144135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d53c01-9874-4c4f-a0eb-dffa10823678 service cinder] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:21.153837 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4216/8468] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:18:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:18:38.145715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9a2bd-5e86-4696-8c73-149fcc1de0fa None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:38.146277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9a2bd-5e86-4696-8c73-149fcc1de0fa None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:38.146375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9a2bd-5e86-4696-8c73-149fcc1de0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:38.167339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0ac9a2bd-5e86-4696-8c73-149fcc1de0fa None None] MFA Rules not processed for user `2ce0a0696d1244589ef6242917432858`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:18:38.168621 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0ac9a2bd-5e86-4696-8c73-149fcc1de0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:38.234343 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4253/8469] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:18:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:18:41.346123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53c01-9874-4c4f-a0eb-dffa10823678 service cinder] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:41.449589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d53c01-9874-4c4f-a0eb-dffa10823678 service cinder] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:41.456143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:41.457491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:41.457966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:41.458390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] PATH_INFO: `/v3/users/92be875a64494d6dae76ee0c088c84c0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:41.460163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92be875a64494d6dae76ee0c088c84c0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:41.463202 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:41.533435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92be875a64494d6dae76ee0c088c84c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:41.547589 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92be875a64494d6dae76ee0c088c84c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:41.548134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92be875a64494d6dae76ee0c088c84c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:41.548822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92be875a64494d6dae76ee0c088c84c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:41.564765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92be875a64494d6dae76ee0c088c84c0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:41.578870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4217/8470] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:18:41 2022] DELETE /identity/v3/users/92be875a64494d6dae76ee0c088c84c0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:41.799433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9a2bd-5e86-4696-8c73-149fcc1de0fa None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:41.819954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9a2bd-5e86-4696-8c73-149fcc1de0fa None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:41.896279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:41.897256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:41.898030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:41.898568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] PATH_INFO: `/v3/projects/dd3ee9d1e7b94fc4a74f972e70c05257` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:41.901193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3ee9d1e7b94fc4a74f972e70c05257)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:41.903907 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:41.964789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'request_id': 'req-236537f3-21e6-417b-a2e7-5e60c965bd32'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:41.974909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'request_id': 'req-236537f3-21e6-417b-a2e7-5e60c965bd32'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:41.981863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3ee9d1e7b94fc4a74f972e70c05257', 'request_id': 'req-236537f3-21e6-417b-a2e7-5e60c965bd32'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:41.997844 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] The token cache is being invalidate because project dd3ee9d1e7b94fc4a74f972e70c05257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:18:41.998227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:41.999025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.000666 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4254/8471] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:18:41 2022] DELETE /identity/v3/projects/dd3ee9d1e7b94fc4a74f972e70c05257 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:42.005014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:42.008806 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:42.025529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3d8f-bfbf-4d71-8195-0314d42cc462 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:42.099985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:42.101329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:42.101625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:42.101910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] PATH_INFO: `/v3/users/0b461ac82d894c74b4defa1857be67dc` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:42.103219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b461ac82d894c74b4defa1857be67dc)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:42.105220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:42.158258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b461ac82d894c74b4defa1857be67dc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.167077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b461ac82d894c74b4defa1857be67dc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.168525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b461ac82d894c74b4defa1857be67dc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.169352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b461ac82d894c74b4defa1857be67dc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.188301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b461ac82d894c74b4defa1857be67dc'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.204926 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4218/8472] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:18:42 2022] DELETE /identity/v3/users/0b461ac82d894c74b4defa1857be67dc => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:18:42.730207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:18:42.731952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:18:42.746971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236537f3-21e6-417b-a2e7-5e60c965bd32 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:18:42.810643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:18:42.811500 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:18:42.811785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:18:42.812100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] PATH_INFO: `/v3/projects/213ca20564674202957fa1b39b07adad` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:18:42.813384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=213ca20564674202957fa1b39b07adad)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:18:42.815365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:18:42.871669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '213ca20564674202957fa1b39b07adad', 'request_id': 'req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.879070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '213ca20564674202957fa1b39b07adad', 'request_id': 'req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.885646 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '213ca20564674202957fa1b39b07adad', 'request_id': 'req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.896745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] The token cache is being invalidate because project 213ca20564674202957fa1b39b07adad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:18:42.897035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.897692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:18:42.899358 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4255/8473] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:18:42 2022] DELETE /identity/v3/projects/213ca20564674202957fa1b39b07adad => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:19:29.578783 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:19:29.580225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:19:29.638082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780edf33-3bcb-4292-a80f-ef52bb0cc2d8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:19:29.685374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:19:29.686094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:19:29.686393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:19:29.686601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:19:29.688551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:19:29.757968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:19:29.760315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:19:29.774860 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4219/8474] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:19:29.937846 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:19:29.939293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:19:29.953579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b45b7-f7c5-4b8c-9097-c9ac6350f40a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:19:29.957202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e9667-dae1-4dad-8a45-c0db50df84a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:19:29.957858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9667-dae1-4dad-8a45-c0db50df84a3 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:19:29.958141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9667-dae1-4dad-8a45-c0db50df84a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:19:29.958418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e9667-dae1-4dad-8a45-c0db50df84a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:19:29.960210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bf7e9667-dae1-4dad-8a45-c0db50df84a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:19:29.975451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e9667-dae1-4dad-8a45-c0db50df84a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:19:29.976916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e9667-dae1-4dad-8a45-c0db50df84a3 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:19:29.990307 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4256/8475] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:19:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:19:30.623359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:19:30.624803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:19:30.638243 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e937c5b-81ad-4afa-bef0-03664448b0ad service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:19:30.642081 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2b573-0f13-4d93-9159-f20656d31b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:19:30.642726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2b573-0f13-4d93-9159-f20656d31b3c service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:19:30.643009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2b573-0f13-4d93-9159-f20656d31b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:19:30.643285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2b573-0f13-4d93-9159-f20656d31b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:19:30.645187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c9a2b573-0f13-4d93-9159-f20656d31b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:19:30.658347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2b573-0f13-4d93-9159-f20656d31b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:19:30.660089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2b573-0f13-4d93-9159-f20656d31b3c service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:19:30.670804 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4220/8476] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:19:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:19:30.795124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadec89-0cdc-44de-889c-31ee7d505b64 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:19:30.795424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadec89-0cdc-44de-889c-31ee7d505b64 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:19:30.795709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddadec89-0cdc-44de-889c-31ee7d505b64 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:19:30.798433 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4257/8477] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:19:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:19:30.806187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7464212-5b69-4a18-b215-9b87a76107f1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:19:30.806499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7464212-5b69-4a18-b215-9b87a76107f1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:19:30.806756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7464212-5b69-4a18-b215-9b87a76107f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:19:30.824796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c7464212-5b69-4a18-b215-9b87a76107f1 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:19:30.826004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c7464212-5b69-4a18-b215-9b87a76107f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:19:30.885585 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4221/8478] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:19:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:19:30.906554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadec89-0cdc-44de-889c-31ee7d505b64 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:19:30.908219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ddadec89-0cdc-44de-889c-31ee7d505b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:19:30.926843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddadec89-0cdc-44de-889c-31ee7d505b64 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:19:30.931690 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28b70-d162-49ac-b31f-63d73982a172 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:19:30.932346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28b70-d162-49ac-b31f-63d73982a172 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:19:30.932628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28b70-d162-49ac-b31f-63d73982a172 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:19:30.932927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28b70-d162-49ac-b31f-63d73982a172 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:19:30.940877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28b70-d162-49ac-b31f-63d73982a172 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:19:30.942437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28b70-d162-49ac-b31f-63d73982a172 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:19:30.952366 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4258/8479] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:19:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:19:31.108829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7464212-5b69-4a18-b215-9b87a76107f1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:19:31.120832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7464212-5b69-4a18-b215-9b87a76107f1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:19:31.124403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:19:31.125031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:19:31.125313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:19:31.125584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:19:31.127289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:19:31.143122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:19:31.144621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:19:31.157876 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4222/8480] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:19:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:20:23.781094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28b70-d162-49ac-b31f-63d73982a172 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:23.803328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28b70-d162-49ac-b31f-63d73982a172 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:23.806838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c252a4c-40d6-427d-a60e-b5d8c6594094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:23.807462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c252a4c-40d6-427d-a60e-b5d8c6594094 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:23.807746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c252a4c-40d6-427d-a60e-b5d8c6594094 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:23.808054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c252a4c-40d6-427d-a60e-b5d8c6594094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:23.809804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4c252a4c-40d6-427d-a60e-b5d8c6594094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:23.851077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c252a4c-40d6-427d-a60e-b5d8c6594094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:23.852543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c252a4c-40d6-427d-a60e-b5d8c6594094 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:23.863098 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4259/8481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:20:26.294034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:26.295373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:26.366675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc704b1e-9550-4e76-8a11-5d796d786c0e service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:26.372188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:26.372829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:26.373206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:26.373484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:26.375212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:26.378529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c252a4c-40d6-427d-a60e-b5d8c6594094 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:26.389629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c252a4c-40d6-427d-a60e-b5d8c6594094 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:26.393440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9104c67-6fa6-4ee0-bf28-092ab5074681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:26.394069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9104c67-6fa6-4ee0-bf28-092ab5074681 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:26.394347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9104c67-6fa6-4ee0-bf28-092ab5074681 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:26.394619 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9104c67-6fa6-4ee0-bf28-092ab5074681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:26.396499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d9104c67-6fa6-4ee0-bf28-092ab5074681 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:26.434632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:26.436281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:26.453488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9104c67-6fa6-4ee0-bf28-092ab5074681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:26.454919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9104c67-6fa6-4ee0-bf28-092ab5074681 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:26.455068 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4223/8482] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:20:26.464888 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4260/8483] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:20:27.444003 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:27.445434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:27.464442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2343ce-43f9-4540-a0fb-084b4a8149d3 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:27.470623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950049d4-3737-40f3-b13f-b00857bfa38d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:27.471279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950049d4-3737-40f3-b13f-b00857bfa38d service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:27.471563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950049d4-3737-40f3-b13f-b00857bfa38d service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:27.471843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950049d4-3737-40f3-b13f-b00857bfa38d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:27.473738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-950049d4-3737-40f3-b13f-b00857bfa38d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:27.489782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950049d4-3737-40f3-b13f-b00857bfa38d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:27.491396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950049d4-3737-40f3-b13f-b00857bfa38d service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:27.510486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4224/8484] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:20:29.537922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9104c67-6fa6-4ee0-bf28-092ab5074681 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:29.549035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9104c67-6fa6-4ee0-bf28-092ab5074681 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:29.552667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:29.553301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:29.553620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:29.553892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:29.556204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:29.638019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:29.639384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:29.649153 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4261/8485] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:20:35.996572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950049d4-3737-40f3-b13f-b00857bfa38d service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:36.012422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950049d4-3737-40f3-b13f-b00857bfa38d service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:36.021147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896e134-c43c-4126-ba05-b311e48648c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:36.021570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896e134-c43c-4126-ba05-b311e48648c1 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:36.021849 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896e134-c43c-4126-ba05-b311e48648c1 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:36.022295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896e134-c43c-4126-ba05-b311e48648c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:36.025110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3896e134-c43c-4126-ba05-b311e48648c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:36.041475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896e134-c43c-4126-ba05-b311e48648c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:36.043213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896e134-c43c-4126-ba05-b311e48648c1 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:36.069482 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4225/8486] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:20:37.165382 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:37.166964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:37.179737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26b21a-fbe7-42fe-a6c4-c9995f7189f1 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:37.184457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:37.185321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:37.185601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:37.185874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] PATH_INFO: `/v3/users/7ac02d48a08c4284ae0c82008c970e7f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:37.187045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac02d48a08c4284ae0c82008c970e7f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:37.189027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:37.233193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac02d48a08c4284ae0c82008c970e7f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.239728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac02d48a08c4284ae0c82008c970e7f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.240425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac02d48a08c4284ae0c82008c970e7f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.241034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac02d48a08c4284ae0c82008c970e7f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.248084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac02d48a08c4284ae0c82008c970e7f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.264553 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4262/8487] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:20:37 2022] DELETE /identity/v3/users/7ac02d48a08c4284ae0c82008c970e7f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:20:37.455115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896e134-c43c-4126-ba05-b311e48648c1 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:37.466906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896e134-c43c-4126-ba05-b311e48648c1 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:37.528181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:37.529198 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:37.529587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:37.529937 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] PATH_INFO: `/v3/projects/1a14cf15734c4aa881ff16a0bc734242` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:37.531227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a14cf15734c4aa881ff16a0bc734242)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:37.533296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:37.582313 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a14cf15734c4aa881ff16a0bc734242', 'request_id': 'req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.591092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a14cf15734c4aa881ff16a0bc734242', 'request_id': 'req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.597106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a14cf15734c4aa881ff16a0bc734242', 'request_id': 'req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.608672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] The token cache is being invalidate because project 1a14cf15734c4aa881ff16a0bc734242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:20:37.608966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.609645 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.611462 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4226/8488] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:20:37 2022] DELETE /identity/v3/projects/1a14cf15734c4aa881ff16a0bc734242 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:20:37.615507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:37.617088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:37.631303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812be0e-3f7c-4a39-952c-28c7c9a09c29 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:37.690521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:37.691417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:37.691724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:37.692052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] PATH_INFO: `/v3/users/10f32ba8b41641a4ac539ace0bb4ac5c` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:37.693302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f32ba8b41641a4ac539ace0bb4ac5c)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:37.695303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:37.746029 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f32ba8b41641a4ac539ace0bb4ac5c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.753454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f32ba8b41641a4ac539ace0bb4ac5c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.754097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f32ba8b41641a4ac539ace0bb4ac5c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.754719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f32ba8b41641a4ac539ace0bb4ac5c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.763206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-291d9fc6-6d93-42e2-97de-21a3539668ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f32ba8b41641a4ac539ace0bb4ac5c'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:37.783900 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4263/8489] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:20:37 2022] DELETE /identity/v3/users/10f32ba8b41641a4ac539ace0bb4ac5c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:20:37.958287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:37.959863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:37.973279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49bdb8-1dcb-43d1-928b-35a5519f2de5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:38.044184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:38.045055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.045338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.045613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] PATH_INFO: `/v3/projects/a586ca08318d4cdd862d7df097e9a736` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.047053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a586ca08318d4cdd862d7df097e9a736)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:38.049511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:38.099373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a586ca08318d4cdd862d7df097e9a736', 'request_id': 'req-a633b2ba-0bef-4384-9ec7-9dc253c8400a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:38.107095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a586ca08318d4cdd862d7df097e9a736', 'request_id': 'req-a633b2ba-0bef-4384-9ec7-9dc253c8400a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:38.113188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a586ca08318d4cdd862d7df097e9a736', 'request_id': 'req-a633b2ba-0bef-4384-9ec7-9dc253c8400a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:38.124959 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] The token cache is being invalidate because project a586ca08318d4cdd862d7df097e9a736 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:20:38.125381 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:38.126060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a633b2ba-0bef-4384-9ec7-9dc253c8400a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:20:38.127824 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4227/8490] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:20:37 2022] DELETE /identity/v3/projects/a586ca08318d4cdd862d7df097e9a736 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:20:38.133321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339aa2-358f-44e8-a3a8-99340664a388 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.134360 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339aa2-358f-44e8-a3a8-99340664a388 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.134951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57339aa2-358f-44e8-a3a8-99340664a388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.198932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-57339aa2-358f-44e8-a3a8-99340664a388 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:20:38.200169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-57339aa2-358f-44e8-a3a8-99340664a388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:38.260221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4264/8491] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:20:38.268335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5659-3a27-48bd-a790-9df081daaa13 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.268630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5659-3a27-48bd-a790-9df081daaa13 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.268916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb5659-3a27-48bd-a790-9df081daaa13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.289093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9bdb5659-3a27-48bd-a790-9df081daaa13 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:20:38.290718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9bdb5659-3a27-48bd-a790-9df081daaa13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:38.299058 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4228/8492] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:20:38.303563 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57339aa2-358f-44e8-a3a8-99340664a388 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:38.314515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57339aa2-358f-44e8-a3a8-99340664a388 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:38.319137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dc58c-ed74-4f89-ad71-afbddaaaf744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:38.319778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dc58c-ed74-4f89-ad71-afbddaaaf744 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.320094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dc58c-ed74-4f89-ad71-afbddaaaf744 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.320378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dc58c-ed74-4f89-ad71-afbddaaaf744 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.321623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dc58c-ed74-4f89-ad71-afbddaaaf744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:20:38.321936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dc58c-ed74-4f89-ad71-afbddaaaf744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:38.323553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4dc58c-ed74-4f89-ad71-afbddaaaf744 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:38.336319 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4265/8493] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:20:38.341208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb5659-3a27-48bd-a790-9df081daaa13 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:38.351088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb5659-3a27-48bd-a790-9df081daaa13 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:38.356958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538add82-292a-4896-8b19-217e37f5333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:38.357621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538add82-292a-4896-8b19-217e37f5333e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.357906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538add82-292a-4896-8b19-217e37f5333e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.358182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538add82-292a-4896-8b19-217e37f5333e admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.358874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538add82-292a-4896-8b19-217e37f5333e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:38.360899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538add82-292a-4896-8b19-217e37f5333e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:38.391532 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4229/8494] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:20:38 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:20:38.392629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dc58c-ed74-4f89-ad71-afbddaaaf744 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:38.403432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dc58c-ed74-4f89-ad71-afbddaaaf744 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:38.461071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396072b3-9c54-4d42-b228-77507c641867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:38.462299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396072b3-9c54-4d42-b228-77507c641867 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.462571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396072b3-9c54-4d42-b228-77507c641867 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.462847 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396072b3-9c54-4d42-b228-77507c641867 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.463538 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396072b3-9c54-4d42-b228-77507c641867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:38.465499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396072b3-9c54-4d42-b228-77507c641867 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:38.485802 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4266/8495] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:20:38 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:20:38.489788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538add82-292a-4896-8b19-217e37f5333e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:38.500924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538add82-292a-4896-8b19-217e37f5333e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:38.505619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0ff89-37e2-445e-b711-ef9e5aee0b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:38.506301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0ff89-37e2-445e-b711-ef9e5aee0b53 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.506585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0ff89-37e2-445e-b711-ef9e5aee0b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.506862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0ff89-37e2-445e-b711-ef9e5aee0b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.507578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0ff89-37e2-445e-b711-ef9e5aee0b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:38.509853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0ff89-37e2-445e-b711-ef9e5aee0b53 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:38.521618 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4230/8496] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:20:38.525088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396072b3-9c54-4d42-b228-77507c641867 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:38.535423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396072b3-9c54-4d42-b228-77507c641867 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:38.540532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b80ba-f252-4ba0-b965-95bb37135cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:38.541195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b80ba-f252-4ba0-b965-95bb37135cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.541544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b80ba-f252-4ba0-b965-95bb37135cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.541885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b80ba-f252-4ba0-b965-95bb37135cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.542673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b80ba-f252-4ba0-b965-95bb37135cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:38.544408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b80ba-f252-4ba0-b965-95bb37135cb0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:38.554876 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4267/8497] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:20:38.560448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0ff89-37e2-445e-b711-ef9e5aee0b53 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:38.570609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0ff89-37e2-445e-b711-ef9e5aee0b53 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:38.575876 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e221e2-bca2-4492-8c55-db464d691e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:38.576911 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e221e2-bca2-4492-8c55-db464d691e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.577211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e221e2-bca2-4492-8c55-db464d691e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.577479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e221e2-bca2-4492-8c55-db464d691e4e admin admin] PATH_INFO: `/v3/projects/c621f87120ad402a9d52cf6426f0cf1f/users/39d6d477fac5463a944d918490b7117f/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.592456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e221e2-bca2-4492-8c55-db464d691e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c621f87120ad402a9d52cf6426f0cf1f, user_id=39d6d477fac5463a944d918490b7117f, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:38.595126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e221e2-bca2-4492-8c55-db464d691e4e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:38.608632 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4231/8498] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:20:38 2022] PUT /identity/v3/projects/c621f87120ad402a9d52cf6426f0cf1f/users/39d6d477fac5463a944d918490b7117f/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:20:38.614107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761135d-e715-457b-be38-90174a371332 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.614472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761135d-e715-457b-be38-90174a371332 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.614939 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f761135d-e715-457b-be38-90174a371332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.634782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f761135d-e715-457b-be38-90174a371332 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:20:38.636821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f761135d-e715-457b-be38-90174a371332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:38.698668 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4268/8499] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:20:38.708874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e221e2-bca2-4492-8c55-db464d691e4e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:38.710878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-69e221e2-bca2-4492-8c55-db464d691e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:38.770246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e221e2-bca2-4492-8c55-db464d691e4e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:38.774799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a796f06-9838-412e-9899-afa3dd7108d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:38.775450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a796f06-9838-412e-9899-afa3dd7108d7 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:38.775732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a796f06-9838-412e-9899-afa3dd7108d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:38.776053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a796f06-9838-412e-9899-afa3dd7108d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:38.785643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a796f06-9838-412e-9899-afa3dd7108d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:38.787104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a796f06-9838-412e-9899-afa3dd7108d7 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:38.808381 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4232/8500] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:20:44.168661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb7923-a275-4083-844d-a84750c80c6f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:44.169183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb7923-a275-4083-844d-a84750c80c6f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:44.170294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb7923-a275-4083-844d-a84750c80c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:44.212393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9fbb7923-a275-4083-844d-a84750c80c6f None None] MFA Rules not processed for user `39d6d477fac5463a944d918490b7117f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:20:44.213888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9fbb7923-a275-4083-844d-a84750c80c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:44.292422 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4269/8501] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:20:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:20:44.297278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a796f06-9838-412e-9899-afa3dd7108d7 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:44.308377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a796f06-9838-412e-9899-afa3dd7108d7 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:44.313371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81b8eb-6086-41e5-ad46-4aba38879f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:44.314013 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81b8eb-6086-41e5-ad46-4aba38879f3f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:44.314293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81b8eb-6086-41e5-ad46-4aba38879f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:44.314567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c81b8eb-6086-41e5-ad46-4aba38879f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:44.315238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81b8eb-6086-41e5-ad46-4aba38879f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:44.317177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c81b8eb-6086-41e5-ad46-4aba38879f3f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:44.348177 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4233/8502] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:20:44 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:20:44.349413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb7923-a275-4083-844d-a84750c80c6f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:44.360620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb7923-a275-4083-844d-a84750c80c6f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:44.420261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fdd9c-f5b5-4d84-9964-00e5c29843ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:44.421188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fdd9c-f5b5-4d84-9964-00e5c29843ff admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:44.421473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fdd9c-f5b5-4d84-9964-00e5c29843ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:44.421752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fdd9c-f5b5-4d84-9964-00e5c29843ff admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:44.422442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fdd9c-f5b5-4d84-9964-00e5c29843ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:44.424418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fdd9c-f5b5-4d84-9964-00e5c29843ff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:44.447162 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4270/8503] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:20:44 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:20:44.451220 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81b8eb-6086-41e5-ad46-4aba38879f3f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:44.466061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c81b8eb-6086-41e5-ad46-4aba38879f3f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:44.471285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29017a1c-d3c4-4b7e-82f8-35bfa856c57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:44.472074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017a1c-d3c4-4b7e-82f8-35bfa856c57d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:44.472440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017a1c-d3c4-4b7e-82f8-35bfa856c57d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:44.472797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29017a1c-d3c4-4b7e-82f8-35bfa856c57d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:44.473606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29017a1c-d3c4-4b7e-82f8-35bfa856c57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:44.475332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29017a1c-d3c4-4b7e-82f8-35bfa856c57d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:44.487436 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4234/8504] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:20:44.491672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fdd9c-f5b5-4d84-9964-00e5c29843ff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:44.503123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fdd9c-f5b5-4d84-9964-00e5c29843ff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:44.509117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba6dec-63c4-4bb7-a402-08961ed94c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:44.510163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba6dec-63c4-4bb7-a402-08961ed94c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:44.510523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba6dec-63c4-4bb7-a402-08961ed94c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:44.510898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba6dec-63c4-4bb7-a402-08961ed94c0c admin admin] PATH_INFO: `/v3/projects/a9ce77f15c4746c78bcdb24051ff3833/users/dcd78f4c7fe94a3c9a3f03bf97a6d2b0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:44.526764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba6dec-63c4-4bb7-a402-08961ed94c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ce77f15c4746c78bcdb24051ff3833, user_id=dcd78f4c7fe94a3c9a3f03bf97a6d2b0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:44.529523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba6dec-63c4-4bb7-a402-08961ed94c0c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:44.543892 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4271/8505] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:20:44 2022] PUT /identity/v3/projects/a9ce77f15c4746c78bcdb24051ff3833/users/dcd78f4c7fe94a3c9a3f03bf97a6d2b0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:20:44.548384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29017a1c-d3c4-4b7e-82f8-35bfa856c57d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:44.559721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29017a1c-d3c4-4b7e-82f8-35bfa856c57d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:44.619814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b78ff-17fa-449f-9e98-c5a47dd52b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:44.620914 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b78ff-17fa-449f-9e98-c5a47dd52b98 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:44.621874 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b78ff-17fa-449f-9e98-c5a47dd52b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:44.622169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b78ff-17fa-449f-9e98-c5a47dd52b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:44.622907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b78ff-17fa-449f-9e98-c5a47dd52b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:44.624600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b78ff-17fa-449f-9e98-c5a47dd52b98 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:44.635963 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4235/8506] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:20:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:20:44.640334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba6dec-63c4-4bb7-a402-08961ed94c0c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:44.651004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba6dec-63c4-4bb7-a402-08961ed94c0c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:44.655768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e9c83f-6c32-4987-b0da-de60294b7674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:44.656703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9c83f-6c32-4987-b0da-de60294b7674 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:44.656987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9c83f-6c32-4987-b0da-de60294b7674 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:44.657266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e9c83f-6c32-4987-b0da-de60294b7674 admin admin] PATH_INFO: `/v3/projects/a9ce77f15c4746c78bcdb24051ff3833/users/dcd78f4c7fe94a3c9a3f03bf97a6d2b0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:44.659387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9c83f-6c32-4987-b0da-de60294b7674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ce77f15c4746c78bcdb24051ff3833, user_id=dcd78f4c7fe94a3c9a3f03bf97a6d2b0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:44.662125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e9c83f-6c32-4987-b0da-de60294b7674 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:44.686706 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4272/8507] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:20:44 2022] PUT /identity/v3/projects/a9ce77f15c4746c78bcdb24051ff3833/users/dcd78f4c7fe94a3c9a3f03bf97a6d2b0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:20:50.732878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da9ba-fb76-42cf-9aeb-2ef3032ea8c5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:50.733403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da9ba-fb76-42cf-9aeb-2ef3032ea8c5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:50.733897 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048da9ba-fb76-42cf-9aeb-2ef3032ea8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:50.761136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-048da9ba-fb76-42cf-9aeb-2ef3032ea8c5 None None] MFA Rules not processed for user `2ce0a0696d1244589ef6242917432858`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:20:50.762692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-048da9ba-fb76-42cf-9aeb-2ef3032ea8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:50.883603 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4236/8508] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:20:50.920183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4e90-a799-4102-b7d6-e701915d6460 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:50.921495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4e90-a799-4102-b7d6-e701915d6460 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:50.921495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab4e90-a799-4102-b7d6-e701915d6460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:50.979711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e9ab4e90-a799-4102-b7d6-e701915d6460 None None] MFA Rules not processed for user `dcd78f4c7fe94a3c9a3f03bf97a6d2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:20:50.980866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e9ab4e90-a799-4102-b7d6-e701915d6460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:51.172167 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4273/8509] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:20:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:20:51.180840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da9ba-fb76-42cf-9aeb-2ef3032ea8c5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:51.183050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-048da9ba-fb76-42cf-9aeb-2ef3032ea8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:51.303140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048da9ba-fb76-42cf-9aeb-2ef3032ea8c5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:51.308569 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa98a62-9fab-40da-914f-72bfc7e7b3fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:51.309344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa98a62-9fab-40da-914f-72bfc7e7b3fe service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:51.309726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa98a62-9fab-40da-914f-72bfc7e7b3fe service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:51.310100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa98a62-9fab-40da-914f-72bfc7e7b3fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:51.444820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa98a62-9fab-40da-914f-72bfc7e7b3fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:51.446820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa98a62-9fab-40da-914f-72bfc7e7b3fe service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:51.479576 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4237/8510] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:20:52.099885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab4e90-a799-4102-b7d6-e701915d6460 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:52.102060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e9ab4e90-a799-4102-b7d6-e701915d6460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:52.290294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab4e90-a799-4102-b7d6-e701915d6460 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:52.301868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0f952-6a97-4d6a-9dbd-3a3510526f8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:52.302892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0f952-6a97-4d6a-9dbd-3a3510526f8f service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:52.303286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0f952-6a97-4d6a-9dbd-3a3510526f8f service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:52.303696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0f952-6a97-4d6a-9dbd-3a3510526f8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:52.307438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dca0f952-6a97-4d6a-9dbd-3a3510526f8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:52.330712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0f952-6a97-4d6a-9dbd-3a3510526f8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:52.333547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0f952-6a97-4d6a-9dbd-3a3510526f8f service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:52.363398 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4274/8511] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:20:55.880730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1b22d-f008-48d0-b873-e425fb5646a6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:55.881223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1b22d-f008-48d0-b873-e425fb5646a6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:55.881428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1b22d-f008-48d0-b873-e425fb5646a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:55.899397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-cca1b22d-f008-48d0-b873-e425fb5646a6 None None] MFA Rules not processed for user `39d6d477fac5463a944d918490b7117f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:20:55.900721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cca1b22d-f008-48d0-b873-e425fb5646a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:55.908234 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4238/8512] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:20:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:20:58.555702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0f952-6a97-4d6a-9dbd-3a3510526f8f service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:20:58.665280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0f952-6a97-4d6a-9dbd-3a3510526f8f service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:20:58.669958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d51a2-494c-4baf-8a99-6e7963754030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:20:58.671183 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d51a2-494c-4baf-8a99-6e7963754030 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:20:58.671972 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d51a2-494c-4baf-8a99-6e7963754030 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:20:58.672398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d51a2-494c-4baf-8a99-6e7963754030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:20:58.674540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bb3d51a2-494c-4baf-8a99-6e7963754030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:20:58.694320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d51a2-494c-4baf-8a99-6e7963754030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:20:58.696725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d51a2-494c-4baf-8a99-6e7963754030 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:20:58.727250 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4275/8513] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:20:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:21:01.642669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1b22d-f008-48d0-b873-e425fb5646a6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:21:01.644199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cca1b22d-f008-48d0-b873-e425fb5646a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:01.734750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1b22d-f008-48d0-b873-e425fb5646a6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:21:01.740604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:21:01.741425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:01.742513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:01.742833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:01.744898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:01.761801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:21:01.763331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:21:01.777744 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4239/8514] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:21:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:21:19.821350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a81041-8266-43a4-9eb2-7962e63a45bb None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:19.821843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a81041-8266-43a4-9eb2-7962e63a45bb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:19.821948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a81041-8266-43a4-9eb2-7962e63a45bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:19.839303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-31a81041-8266-43a4-9eb2-7962e63a45bb None None] MFA Rules not processed for user `39d6d477fac5463a944d918490b7117f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:21:19.840534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-31a81041-8266-43a4-9eb2-7962e63a45bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:19.847393 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4276/8515] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:21:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:21:29.196038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:21:29.197422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:29.226668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2280b-c2e5-437e-b8e6-8635029081f2 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:21:29.232813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:21:29.233453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:29.233732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:29.234007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:29.236815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:29.247683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:21:29.249375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:21:29.258758 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4240/8516] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:21:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:21:30.785519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6b456-4553-4aef-bfb2-90d47f7017d2 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:30.785993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6b456-4553-4aef-bfb2-90d47f7017d2 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:30.786091 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e6b456-4553-4aef-bfb2-90d47f7017d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:30.814942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-18e6b456-4553-4aef-bfb2-90d47f7017d2 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:21:30.816383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-18e6b456-4553-4aef-bfb2-90d47f7017d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:30.878344 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4277/8517] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:21:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:21:30.924127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:21:30.925549 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:31.003500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4b9d6-da73-4b0b-9c46-7933ce62b1e0 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:21:31.008625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9ae2-c710-4148-8d1c-acdcb2e3823b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:21:31.009269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9ae2-c710-4148-8d1c-acdcb2e3823b service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:31.009555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9ae2-c710-4148-8d1c-acdcb2e3823b service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:31.009835 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9ae2-c710-4148-8d1c-acdcb2e3823b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:31.018303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af9ae2-c710-4148-8d1c-acdcb2e3823b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:21:31.019943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af9ae2-c710-4148-8d1c-acdcb2e3823b service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:21:31.028097 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4241/8518] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:21:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:21:31.260242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b399b-dd30-467d-b31e-49b14ee1230b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:31.260533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b399b-dd30-467d-b31e-49b14ee1230b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:31.260811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b399b-dd30-467d-b31e-49b14ee1230b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:31.278504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d29b399b-dd30-467d-b31e-49b14ee1230b None None] MFA Rules not processed for user `39d6d477fac5463a944d918490b7117f`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:21:31.279677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d29b399b-dd30-467d-b31e-49b14ee1230b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:31.286405 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4278/8519] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:21:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:21:40.849269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9ae2-c710-4148-8d1c-acdcb2e3823b service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:21:40.865561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9ae2-c710-4148-8d1c-acdcb2e3823b service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:21:40.871128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87341f34-c36c-455e-b928-9aad29e2d99e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:21:40.872669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341f34-c36c-455e-b928-9aad29e2d99e service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:40.872953 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341f34-c36c-455e-b928-9aad29e2d99e service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:40.873256 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87341f34-c36c-455e-b928-9aad29e2d99e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:40.875063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-87341f34-c36c-455e-b928-9aad29e2d99e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:40.942968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341f34-c36c-455e-b928-9aad29e2d99e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:21:40.944624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87341f34-c36c-455e-b928-9aad29e2d99e service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:21:40.954324 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4242/8520] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:21:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:21:41.167151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b399b-dd30-467d-b31e-49b14ee1230b None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:21:41.180989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b399b-dd30-467d-b31e-49b14ee1230b None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:21:41.184598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f876562-20ff-4a62-a3f3-87b8d6b27e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:21:41.185222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f876562-20ff-4a62-a3f3-87b8d6b27e06 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:41.185508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f876562-20ff-4a62-a3f3-87b8d6b27e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:41.185786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f876562-20ff-4a62-a3f3-87b8d6b27e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:41.187706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8f876562-20ff-4a62-a3f3-87b8d6b27e06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:41.204470 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f876562-20ff-4a62-a3f3-87b8d6b27e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:21:41.205883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f876562-20ff-4a62-a3f3-87b8d6b27e06 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:21:41.217176 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4279/8521] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:21:41.363877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3a215-cca7-4599-b07e-0e982406ed91 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:41.364122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3a215-cca7-4599-b07e-0e982406ed91 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:41.364433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3a215-cca7-4599-b07e-0e982406ed91 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:41.366299 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4243/8522] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:21:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:21:41.371044 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04171f-a5a9-4b42-ac53-2c9bc1c5578a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:41.372092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04171f-a5a9-4b42-ac53-2c9bc1c5578a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:41.372393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04171f-a5a9-4b42-ac53-2c9bc1c5578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:41.390998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-af04171f-a5a9-4b42-ac53-2c9bc1c5578a None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:21:41.392307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-af04171f-a5a9-4b42-ac53-2c9bc1c5578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:21:41.401877 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4280/8523] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:21:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:21:41.423179 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3a215-cca7-4599-b07e-0e982406ed91 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:21:41.441095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3a215-cca7-4599-b07e-0e982406ed91 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:21:41.446158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66676cff-7b58-4f72-b846-e0fb64c9414b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:21:41.446798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66676cff-7b58-4f72-b846-e0fb64c9414b service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:21:41.447083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66676cff-7b58-4f72-b846-e0fb64c9414b service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:21:41.447373 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66676cff-7b58-4f72-b846-e0fb64c9414b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:21:41.455655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66676cff-7b58-4f72-b846-e0fb64c9414b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:21:41.457284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66676cff-7b58-4f72-b846-e0fb64c9414b service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:21:41.467023 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4244/8524] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:21:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:22:05.638320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3d338-e3a7-461b-a265-1d7ba27e63d5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:22:05.638880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3d338-e3a7-461b-a265-1d7ba27e63d5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:22:05.638966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3d338-e3a7-461b-a265-1d7ba27e63d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:22:05.663790 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a2b3d338-e3a7-461b-a265-1d7ba27e63d5 None None] MFA Rules not processed for user `2ce0a0696d1244589ef6242917432858`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:22:05.665779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a2b3d338-e3a7-461b-a265-1d7ba27e63d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:22:05.675088 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4281/8525] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:22:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:22:22.110604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66676cff-7b58-4f72-b846-e0fb64c9414b service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:22:22.112062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-66676cff-7b58-4f72-b846-e0fb64c9414b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:22:22.143392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66676cff-7b58-4f72-b846-e0fb64c9414b service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:22:22.150047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a57747-e2ad-4988-a9a8-aa9c5c1ba87e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:22:22.151034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a57747-e2ad-4988-a9a8-aa9c5c1ba87e service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:22:22.151302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a57747-e2ad-4988-a9a8-aa9c5c1ba87e service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:22:22.151595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a57747-e2ad-4988-a9a8-aa9c5c1ba87e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:22:22.153885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-51a57747-e2ad-4988-a9a8-aa9c5c1ba87e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:22:22.171222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a57747-e2ad-4988-a9a8-aa9c5c1ba87e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:22:22.173327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a57747-e2ad-4988-a9a8-aa9c5c1ba87e service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:22:22.187556 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4245/8526] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:22:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:22:24.749498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3d338-e3a7-461b-a265-1d7ba27e63d5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:22:24.763762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3d338-e3a7-461b-a265-1d7ba27e63d5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:22:24.768765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090625d-52d6-434b-a6e8-8e631a1b5742 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:22:24.769393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090625d-52d6-434b-a6e8-8e631a1b5742 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:22:24.769677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090625d-52d6-434b-a6e8-8e631a1b5742 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:22:24.769956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090625d-52d6-434b-a6e8-8e631a1b5742 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:22:24.771701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c090625d-52d6-434b-a6e8-8e631a1b5742 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:22:24.785781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090625d-52d6-434b-a6e8-8e631a1b5742 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:22:24.787418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090625d-52d6-434b-a6e8-8e631a1b5742 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:22:24.801512 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4282/8527] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:22:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:22:26.023414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9328b4-ec8c-4a60-8848-e1e998d9038a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:22:26.023863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9328b4-ec8c-4a60-8848-e1e998d9038a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:22:26.024001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9328b4-ec8c-4a60-8848-e1e998d9038a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:22:26.041172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-5d9328b4-ec8c-4a60-8848-e1e998d9038a None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:22:26.042365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5d9328b4-ec8c-4a60-8848-e1e998d9038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:22:26.050392 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4246/8528] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:22:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:22:26.062853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090625d-52d6-434b-a6e8-8e631a1b5742 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:22:26.076696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090625d-52d6-434b-a6e8-8e631a1b5742 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:22:26.081700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431d3f-edf9-4a77-bda1-41eb89f7737e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:22:26.082328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431d3f-edf9-4a77-bda1-41eb89f7737e service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:22:26.082612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431d3f-edf9-4a77-bda1-41eb89f7737e service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:22:26.082891 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20431d3f-edf9-4a77-bda1-41eb89f7737e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:22:26.090883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431d3f-edf9-4a77-bda1-41eb89f7737e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:22:26.092511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20431d3f-edf9-4a77-bda1-41eb89f7737e service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:22:26.100776 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4283/8529] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:22:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:22:29.919043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f58c-a266-4461-9c59-71af520f55e1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:22:29.919553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f58c-a266-4461-9c59-71af520f55e1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:22:29.919649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529f58c-a266-4461-9c59-71af520f55e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:22:29.936794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6529f58c-a266-4461-9c59-71af520f55e1 None None] MFA Rules not processed for user `39d6d477fac5463a944d918490b7117f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:22:29.937956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6529f58c-a266-4461-9c59-71af520f55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:22:29.944714 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4247/8530] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:22:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:22:40.383327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431d3f-edf9-4a77-bda1-41eb89f7737e service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:22:40.384782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-20431d3f-edf9-4a77-bda1-41eb89f7737e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:22:40.399516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20431d3f-edf9-4a77-bda1-41eb89f7737e service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:22:40.403025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22766e-6f4f-4bd1-9625-a93c98743a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:22:40.404309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22766e-6f4f-4bd1-9625-a93c98743a8e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:22:40.404592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22766e-6f4f-4bd1-9625-a93c98743a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:22:40.404867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22766e-6f4f-4bd1-9625-a93c98743a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:22:40.413789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22766e-6f4f-4bd1-9625-a93c98743a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:22:40.415228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22766e-6f4f-4bd1-9625-a93c98743a8e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:22:40.424998 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4284/8531] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:22:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:23:57.510613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529f58c-a266-4461-9c59-71af520f55e1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:57.512054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6529f58c-a266-4461-9c59-71af520f55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:57.580534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529f58c-a266-4461-9c59-71af520f55e1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:57.582769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:57.583635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:57.583973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:57.584208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] PATH_INFO: `/v3/users/2ce0a0696d1244589ef6242917432858` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:57.585421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ce0a0696d1244589ef6242917432858)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:57.587318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:57.632832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ce0a0696d1244589ef6242917432858'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:57.639888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ce0a0696d1244589ef6242917432858'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:57.641107 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ce0a0696d1244589ef6242917432858'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:57.641736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ce0a0696d1244589ef6242917432858'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:57.653122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ce0a0696d1244589ef6242917432858'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:57.666361 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4248/8532] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:23:57 2022] DELETE /identity/v3/users/2ce0a0696d1244589ef6242917432858 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:23:57.670968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dd392-861c-4cda-8bd0-95514f462042 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:57.671506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dd392-861c-4cda-8bd0-95514f462042 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:57.671506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437dd392-861c-4cda-8bd0-95514f462042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:57.688927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-437dd392-861c-4cda-8bd0-95514f462042 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:23:57.690099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-437dd392-861c-4cda-8bd0-95514f462042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:57.745433 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4285/8533] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:23:57.755404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:57.756829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:57.815242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b6556-d314-4375-ac61-0577917cd6a5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:57.818928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6f79e-0794-4ed0-bc68-58a4fc9614e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:57.819597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6f79e-0794-4ed0-bc68-58a4fc9614e2 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:57.819879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6f79e-0794-4ed0-bc68-58a4fc9614e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:57.820184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6f79e-0794-4ed0-bc68-58a4fc9614e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:57.830020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6f79e-0794-4ed0-bc68-58a4fc9614e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:57.831567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6f79e-0794-4ed0-bc68-58a4fc9614e2 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:57.842248 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4249/8534] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:23:58.010791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dd392-861c-4cda-8bd0-95514f462042 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:58.012393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-437dd392-861c-4cda-8bd0-95514f462042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:58.027294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437dd392-861c-4cda-8bd0-95514f462042 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:58.031877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:58.032964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.033252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.033533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] PATH_INFO: `/v3/projects/39045df80a6f442b972ee88f13343d34` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.035094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39045df80a6f442b972ee88f13343d34)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:58.037110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:58.087485 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39045df80a6f442b972ee88f13343d34', 'request_id': 'req-c9793285-a368-4292-8a79-7b3b5f9cb63d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.095181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39045df80a6f442b972ee88f13343d34', 'request_id': 'req-c9793285-a368-4292-8a79-7b3b5f9cb63d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.100692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39045df80a6f442b972ee88f13343d34', 'request_id': 'req-c9793285-a368-4292-8a79-7b3b5f9cb63d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.113250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] The token cache is being invalidate because project 39045df80a6f442b972ee88f13343d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:23:58.113579 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.114206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.116654 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4286/8535] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:23:58 2022] DELETE /identity/v3/projects/39045df80a6f442b972ee88f13343d34 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:23:58.119668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6f79e-0794-4ed0-bc68-58a4fc9614e2 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:58.130073 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6f79e-0794-4ed0-bc68-58a4fc9614e2 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:58.189561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:58.190461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.190750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.191026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] PATH_INFO: `/v3/users/7ee61895e452426fa20d33778753d30f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.192255 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ee61895e452426fa20d33778753d30f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:58.194197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:58.237791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ee61895e452426fa20d33778753d30f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.244533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ee61895e452426fa20d33778753d30f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.245147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ee61895e452426fa20d33778753d30f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.245762 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ee61895e452426fa20d33778753d30f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.257999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-97b0a874-ec2c-49ea-a14d-d56c78542b2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ee61895e452426fa20d33778753d30f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.269882 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4250/8536] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:23:58 2022] DELETE /identity/v3/users/7ee61895e452426fa20d33778753d30f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:23:58.445507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:58.446950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:58.461778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9793285-a368-4292-8a79-7b3b5f9cb63d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:58.518894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:58.519745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.520069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.520349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] PATH_INFO: `/v3/projects/b3b6f802f2f946e9b7b7f069ab789e09` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.521554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b6f802f2f946e9b7b7f069ab789e09)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:58.523495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:58.569396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b6f802f2f946e9b7b7f069ab789e09', 'request_id': 'req-3555136e-58ae-4d53-9330-14e9ab0bbc2f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.576227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b6f802f2f946e9b7b7f069ab789e09', 'request_id': 'req-3555136e-58ae-4d53-9330-14e9ab0bbc2f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.581597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b6f802f2f946e9b7b7f069ab789e09', 'request_id': 'req-3555136e-58ae-4d53-9330-14e9ab0bbc2f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.592163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] The token cache is being invalidate because project b3b6f802f2f946e9b7b7f069ab789e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:23:58.592454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.593616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3555136e-58ae-4d53-9330-14e9ab0bbc2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:23:58.595114 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4287/8537] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:23:58 2022] DELETE /identity/v3/projects/b3b6f802f2f946e9b7b7f069ab789e09 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:23:58.600311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44a39-5e86-4f17-9e38-73dbde6d7f5b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.600782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44a39-5e86-4f17-9e38-73dbde6d7f5b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.600923 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44a39-5e86-4f17-9e38-73dbde6d7f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.619630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-20b44a39-5e86-4f17-9e38-73dbde6d7f5b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:23:58.620921 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-20b44a39-5e86-4f17-9e38-73dbde6d7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:58.678267 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4251/8538] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:23:58.686258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b031c-7053-40aa-8d54-e981acca0b10 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.686691 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b031c-7053-40aa-8d54-e981acca0b10 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.686837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b031c-7053-40aa-8d54-e981acca0b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.704892 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b00b031c-7053-40aa-8d54-e981acca0b10 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:23:58.706013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b00b031c-7053-40aa-8d54-e981acca0b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:58.713929 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4288/8539] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:23:58.718609 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44a39-5e86-4f17-9e38-73dbde6d7f5b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:58.728542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44a39-5e86-4f17-9e38-73dbde6d7f5b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:58.733251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b1334-13de-4aef-9bb8-cacdab1bb7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:58.734507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b1334-13de-4aef-9bb8-cacdab1bb7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.734786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b1334-13de-4aef-9bb8-cacdab1bb7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.735059 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25b1334-13de-4aef-9bb8-cacdab1bb7a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.735766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b1334-13de-4aef-9bb8-cacdab1bb7a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:23:58.736103 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b1334-13de-4aef-9bb8-cacdab1bb7a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:58.737709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25b1334-13de-4aef-9bb8-cacdab1bb7a8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:58.748860 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4252/8540] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:23:58.753164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b031c-7053-40aa-8d54-e981acca0b10 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:58.762341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b031c-7053-40aa-8d54-e981acca0b10 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:58.767491 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed2744-25d3-40c9-a45d-081684757f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:58.768156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed2744-25d3-40c9-a45d-081684757f84 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.768437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed2744-25d3-40c9-a45d-081684757f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.768710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed2744-25d3-40c9-a45d-081684757f84 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.769402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed2744-25d3-40c9-a45d-081684757f84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:58.771290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed2744-25d3-40c9-a45d-081684757f84 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:58.799624 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4289/8541] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:23:58 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:23:58.801062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b1334-13de-4aef-9bb8-cacdab1bb7a8 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:58.810793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25b1334-13de-4aef-9bb8-cacdab1bb7a8 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:58.865869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8a1b0-7edf-4750-910c-be819286f049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:58.866542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8a1b0-7edf-4750-910c-be819286f049 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.866827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8a1b0-7edf-4750-910c-be819286f049 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.867106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8a1b0-7edf-4750-910c-be819286f049 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.867784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8a1b0-7edf-4750-910c-be819286f049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:58.869756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8a1b0-7edf-4750-910c-be819286f049 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:58.888276 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4253/8542] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:23:58 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:23:58.893023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed2744-25d3-40c9-a45d-081684757f84 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:58.903251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed2744-25d3-40c9-a45d-081684757f84 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:58.908519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a90ab2-60d7-488a-8edc-c05302c72dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:58.909165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a90ab2-60d7-488a-8edc-c05302c72dea admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.909451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a90ab2-60d7-488a-8edc-c05302c72dea admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.909731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a90ab2-60d7-488a-8edc-c05302c72dea admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.910446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a90ab2-60d7-488a-8edc-c05302c72dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:58.912102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a90ab2-60d7-488a-8edc-c05302c72dea admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:58.922451 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4290/8543] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:23:58.926349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8a1b0-7edf-4750-910c-be819286f049 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:58.936250 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8a1b0-7edf-4750-910c-be819286f049 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:58.940839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187870c5-5278-447b-8c27-14c0febea411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:58.941479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187870c5-5278-447b-8c27-14c0febea411 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.941763 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187870c5-5278-447b-8c27-14c0febea411 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.942038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187870c5-5278-447b-8c27-14c0febea411 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.942758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187870c5-5278-447b-8c27-14c0febea411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:58.944400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187870c5-5278-447b-8c27-14c0febea411 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:58.954464 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4254/8544] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:23:58.958344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a90ab2-60d7-488a-8edc-c05302c72dea admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:58.967905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a90ab2-60d7-488a-8edc-c05302c72dea admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:58.973154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48355-14c5-46c0-9c9c-57eeeeeaec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:58.974009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48355-14c5-46c0-9c9c-57eeeeeaec4d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:58.974301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48355-14c5-46c0-9c9c-57eeeeeaec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:58.974581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f48355-14c5-46c0-9c9c-57eeeeeaec4d admin admin] PATH_INFO: `/v3/projects/b26aef9ef8394051ae733c44969f31ff/users/1f67809d45cf4f8b9139c5acbd7a046b/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:58.989952 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f48355-14c5-46c0-9c9c-57eeeeeaec4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26aef9ef8394051ae733c44969f31ff, user_id=1f67809d45cf4f8b9139c5acbd7a046b, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:58.992735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f48355-14c5-46c0-9c9c-57eeeeeaec4d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:59.005841 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4291/8545] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:23:58 2022] PUT /identity/v3/projects/b26aef9ef8394051ae733c44969f31ff/users/1f67809d45cf4f8b9139c5acbd7a046b/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:23:59.018496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afc9bd-bf81-4e49-8670-ae097b7d4002 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:59.018794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afc9bd-bf81-4e49-8670-ae097b7d4002 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:59.019100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afc9bd-bf81-4e49-8670-ae097b7d4002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:59.046416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-49afc9bd-bf81-4e49-8670-ae097b7d4002 None None] MFA Rules not processed for user `1f67809d45cf4f8b9139c5acbd7a046b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:23:59.047616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49afc9bd-bf81-4e49-8670-ae097b7d4002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:59.110946 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4255/8546] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:23:59.115474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48355-14c5-46c0-9c9c-57eeeeeaec4d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:59.174858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f48355-14c5-46c0-9c9c-57eeeeeaec4d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:59.179381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b405d12-da0d-48fd-a5ba-e85393a3ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:59.180053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b405d12-da0d-48fd-a5ba-e85393a3ff9b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:59.180334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b405d12-da0d-48fd-a5ba-e85393a3ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:59.180607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b405d12-da0d-48fd-a5ba-e85393a3ff9b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:59.181288 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b405d12-da0d-48fd-a5ba-e85393a3ff9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:59.183178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b405d12-da0d-48fd-a5ba-e85393a3ff9b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:59.208561 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4292/8547] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:23:59 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:23:59.212713 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afc9bd-bf81-4e49-8670-ae097b7d4002 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:59.223259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afc9bd-bf81-4e49-8670-ae097b7d4002 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:59.277543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be91d-d01a-4d9c-9994-d1459446820a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:59.278327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be91d-d01a-4d9c-9994-d1459446820a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:59.278724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be91d-d01a-4d9c-9994-d1459446820a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:59.279082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02be91d-d01a-4d9c-9994-d1459446820a admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:59.279757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be91d-d01a-4d9c-9994-d1459446820a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:59.281804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02be91d-d01a-4d9c-9994-d1459446820a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:59.300548 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4256/8548] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:23:59 2022] POST /identity/v3/users => generated 294 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:23:59.304457 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b405d12-da0d-48fd-a5ba-e85393a3ff9b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:59.315258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b405d12-da0d-48fd-a5ba-e85393a3ff9b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:59.319883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391829a6-829e-4f6a-b216-cdf9b4813dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:59.320580 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391829a6-829e-4f6a-b216-cdf9b4813dec admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:59.320865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391829a6-829e-4f6a-b216-cdf9b4813dec admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:59.321140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391829a6-829e-4f6a-b216-cdf9b4813dec admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:59.321851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391829a6-829e-4f6a-b216-cdf9b4813dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:59.323450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391829a6-829e-4f6a-b216-cdf9b4813dec admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:59.334214 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4293/8549] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:23:59.338077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be91d-d01a-4d9c-9994-d1459446820a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:59.347741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02be91d-d01a-4d9c-9994-d1459446820a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:59.352357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43c2a1-a976-49b2-b4fa-9a959ad9a853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:59.353222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43c2a1-a976-49b2-b4fa-9a959ad9a853 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:59.353509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43c2a1-a976-49b2-b4fa-9a959ad9a853 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:59.353789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43c2a1-a976-49b2-b4fa-9a959ad9a853 admin admin] PATH_INFO: `/v3/projects/d28211ddaca849d299097f8b4ddef745/users/7137903e954b4eb28ba0a7757f9ae425/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:59.368048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43c2a1-a976-49b2-b4fa-9a959ad9a853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28211ddaca849d299097f8b4ddef745, user_id=7137903e954b4eb28ba0a7757f9ae425, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:59.370729 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd43c2a1-a976-49b2-b4fa-9a959ad9a853 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:59.383801 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4257/8550] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:23:59 2022] PUT /identity/v3/projects/d28211ddaca849d299097f8b4ddef745/users/7137903e954b4eb28ba0a7757f9ae425/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:23:59.387583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391829a6-829e-4f6a-b216-cdf9b4813dec admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:59.397871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391829a6-829e-4f6a-b216-cdf9b4813dec admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:59.453820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd245b6c-5adc-485c-b782-45f2b210f0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:59.454476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd245b6c-5adc-485c-b782-45f2b210f0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:59.454760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd245b6c-5adc-485c-b782-45f2b210f0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:59.455034 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd245b6c-5adc-485c-b782-45f2b210f0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:59.455745 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd245b6c-5adc-485c-b782-45f2b210f0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:59.457377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd245b6c-5adc-485c-b782-45f2b210f0d8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:59.466763 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4294/8551] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:23:59.470912 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43c2a1-a976-49b2-b4fa-9a959ad9a853 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:59.481024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43c2a1-a976-49b2-b4fa-9a959ad9a853 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:59.485664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adae928-45b1-4a5f-aaa3-18598d158e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:59.486603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adae928-45b1-4a5f-aaa3-18598d158e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:59.486872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adae928-45b1-4a5f-aaa3-18598d158e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:59.487148 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adae928-45b1-4a5f-aaa3-18598d158e81 admin admin] PATH_INFO: `/v3/projects/d28211ddaca849d299097f8b4ddef745/users/7137903e954b4eb28ba0a7757f9ae425/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:59.489117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adae928-45b1-4a5f-aaa3-18598d158e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28211ddaca849d299097f8b4ddef745, user_id=7137903e954b4eb28ba0a7757f9ae425, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:59.491825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adae928-45b1-4a5f-aaa3-18598d158e81 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:59.502322 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4258/8552] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:23:59 2022] PUT /identity/v3/projects/d28211ddaca849d299097f8b4ddef745/users/7137903e954b4eb28ba0a7757f9ae425/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:23:59.512429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37394e88-01a8-4347-a9e3-44b8c66aab4e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:59.512725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37394e88-01a8-4347-a9e3-44b8c66aab4e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:59.513008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37394e88-01a8-4347-a9e3-44b8c66aab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:59.539170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-37394e88-01a8-4347-a9e3-44b8c66aab4e None None] MFA Rules not processed for user `7137903e954b4eb28ba0a7757f9ae425`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:23:59.540654 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-37394e88-01a8-4347-a9e3-44b8c66aab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:59.605551 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4295/8553] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:23:59.616706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adae928-45b1-4a5f-aaa3-18598d158e81 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:23:59.618566 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2adae928-45b1-4a5f-aaa3-18598d158e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:23:59.677352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adae928-45b1-4a5f-aaa3-18598d158e81 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:23:59.681038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac441b-0862-4233-8f0f-d8254efc11c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:23:59.681673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac441b-0862-4233-8f0f-d8254efc11c2 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:23:59.681986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac441b-0862-4233-8f0f-d8254efc11c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:23:59.682266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac441b-0862-4233-8f0f-d8254efc11c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:23:59.738820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac441b-0862-4233-8f0f-d8254efc11c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:23:59.740228 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac441b-0862-4233-8f0f-d8254efc11c2 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:23:59.748855 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4259/8554] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:24:01.766432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37394e88-01a8-4347-a9e3-44b8c66aab4e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:24:01.768109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-37394e88-01a8-4347-a9e3-44b8c66aab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:24:01.782616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37394e88-01a8-4347-a9e3-44b8c66aab4e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:24:01.786114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aad10-9dbc-4c2a-855e-8372fbbe4a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:24:01.786831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aad10-9dbc-4c2a-855e-8372fbbe4a97 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:24:01.787113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aad10-9dbc-4c2a-855e-8372fbbe4a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:24:01.787420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aad10-9dbc-4c2a-855e-8372fbbe4a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:24:01.797252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aad10-9dbc-4c2a-855e-8372fbbe4a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:24:01.798687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aad10-9dbc-4c2a-855e-8372fbbe4a97 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:24:01.808148 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4296/8555] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:24:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:24:06.715520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf5bb-98ca-4753-8002-05c090d5b361 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:24:06.716138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf5bb-98ca-4753-8002-05c090d5b361 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:24:06.716259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf5bb-98ca-4753-8002-05c090d5b361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:24:06.734932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-559cf5bb-98ca-4753-8002-05c090d5b361 None None] MFA Rules not processed for user `1f67809d45cf4f8b9139c5acbd7a046b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:24:06.736298 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-559cf5bb-98ca-4753-8002-05c090d5b361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:24:06.743824 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4260/8556] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:24:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:24:07.089005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aad10-9dbc-4c2a-855e-8372fbbe4a97 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:24:07.101108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aad10-9dbc-4c2a-855e-8372fbbe4a97 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:24:07.105887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85c763-4e6f-4731-9bd2-0a4c933e63d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:24:07.107214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85c763-4e6f-4731-9bd2-0a4c933e63d4 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:24:07.107507 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85c763-4e6f-4731-9bd2-0a4c933e63d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:24:07.107814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85c763-4e6f-4731-9bd2-0a4c933e63d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:24:07.117798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8f85c763-4e6f-4731-9bd2-0a4c933e63d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:24:07.147820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85c763-4e6f-4731-9bd2-0a4c933e63d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:24:07.150096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85c763-4e6f-4731-9bd2-0a4c933e63d4 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:24:07.169835 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4297/8557] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:24:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:24:47.211368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf5bb-98ca-4753-8002-05c090d5b361 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:24:47.223733 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf5bb-98ca-4753-8002-05c090d5b361 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:24:47.227283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3342f76-f408-4fd2-9273-204de81484c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:24:47.227910 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342f76-f408-4fd2-9273-204de81484c3 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:24:47.228219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342f76-f408-4fd2-9273-204de81484c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:24:47.228494 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3342f76-f408-4fd2-9273-204de81484c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:24:47.230223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a3342f76-f408-4fd2-9273-204de81484c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:24:47.300827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3342f76-f408-4fd2-9273-204de81484c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:24:47.302184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3342f76-f408-4fd2-9273-204de81484c3 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:24:47.315666 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4261/8558] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:24:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:24:48.505831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85c763-4e6f-4731-9bd2-0a4c933e63d4 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:24:48.517093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85c763-4e6f-4731-9bd2-0a4c933e63d4 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:24:48.520702 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301ed81-1fb2-46b3-9eb1-a875be68dbb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:24:48.521322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301ed81-1fb2-46b3-9eb1-a875be68dbb0 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:24:48.521624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301ed81-1fb2-46b3-9eb1-a875be68dbb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:24:48.521902 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301ed81-1fb2-46b3-9eb1-a875be68dbb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:24:48.523631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4301ed81-1fb2-46b3-9eb1-a875be68dbb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:24:48.539724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301ed81-1fb2-46b3-9eb1-a875be68dbb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:24:48.541184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301ed81-1fb2-46b3-9eb1-a875be68dbb0 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:24:48.554103 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4298/8559] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:24:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:24:50.866118 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25d51-80c9-4be4-ba29-4925a86154f6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:24:50.866600 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25d51-80c9-4be4-ba29-4925a86154f6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:24:50.866691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e25d51-80c9-4be4-ba29-4925a86154f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:24:50.885544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d2e25d51-80c9-4be4-ba29-4925a86154f6 None None] MFA Rules not processed for user `39d6d477fac5463a944d918490b7117f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:24:50.886754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d2e25d51-80c9-4be4-ba29-4925a86154f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:24:50.940080 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4262/8560] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:24:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:24:58.641006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476ae4-2299-446e-871e-c3ba4880d82c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:24:58.641564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476ae4-2299-446e-871e-c3ba4880d82c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:24:58.641564 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee476ae4-2299-446e-871e-c3ba4880d82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:24:58.659499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ee476ae4-2299-446e-871e-c3ba4880d82c None None] MFA Rules not processed for user `1f67809d45cf4f8b9139c5acbd7a046b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:24:58.660840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ee476ae4-2299-446e-871e-c3ba4880d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:24:58.668454 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4299/8561] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:24:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:25:24.761837 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25d51-80c9-4be4-ba29-4925a86154f6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:25:24.773778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e25d51-80c9-4be4-ba29-4925a86154f6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:25:24.778112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:25:24.778753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:25:24.779032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:25:24.779308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:25:24.781414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:25:24.794396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:25:24.796386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:25:24.808390 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4263/8562] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:25:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:25:38.676028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee476ae4-2299-446e-871e-c3ba4880d82c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:25:38.678351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ee476ae4-2299-446e-871e-c3ba4880d82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:25:38.699946 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee476ae4-2299-446e-871e-c3ba4880d82c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:25:38.705612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b9350-2264-486e-8a9e-a13bf53ce440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:25:38.706256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9350-2264-486e-8a9e-a13bf53ce440 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:25:38.706539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9350-2264-486e-8a9e-a13bf53ce440 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:25:38.706829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b9350-2264-486e-8a9e-a13bf53ce440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:25:38.708607 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b34b9350-2264-486e-8a9e-a13bf53ce440 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:25:38.723322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9350-2264-486e-8a9e-a13bf53ce440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:25:38.725177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b9350-2264-486e-8a9e-a13bf53ce440 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:25:38.738399 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4300/8563] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:25:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:25:42.394620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:25:42.396597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:25:42.415643 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1709ea0e-0223-4966-a783-8cd6d9753f6f service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:25:42.421820 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:25:42.422477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:25:42.422766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:25:42.423050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:25:42.425384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:25:42.440962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:25:42.442808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:25:42.460692 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4264/8564] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:25:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:25:56.837787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1a74-92e8-424a-8793-df05bc4a83c0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:25:56.838197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1a74-92e8-424a-8793-df05bc4a83c0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:25:56.838433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1a74-92e8-424a-8793-df05bc4a83c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:25:56.859292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-12ac1a74-92e8-424a-8793-df05bc4a83c0 None None] MFA Rules not processed for user `1f67809d45cf4f8b9139c5acbd7a046b`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:25:56.861035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-12ac1a74-92e8-424a-8793-df05bc4a83c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:25:56.870205 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4301/8565] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:25:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:25:57.649598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:25:57.651422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:25:57.753543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90bf35-ed77-4610-9ff1-214ab1b1e245 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:25:57.759484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f7df3-89ae-45de-a398-1791ea1fca4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:25:57.760172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f7df3-89ae-45de-a398-1791ea1fca4e service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:25:57.760452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f7df3-89ae-45de-a398-1791ea1fca4e service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:25:57.760771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f7df3-89ae-45de-a398-1791ea1fca4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:25:57.762736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-217f7df3-89ae-45de-a398-1791ea1fca4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:25:57.778982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f7df3-89ae-45de-a398-1791ea1fca4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:25:57.780841 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f7df3-89ae-45de-a398-1791ea1fca4e service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:25:57.796740 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4265/8566] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:25:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:26:04.917776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac1a74-92e8-424a-8793-df05bc4a83c0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:04.934123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac1a74-92e8-424a-8793-df05bc4a83c0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:04.939574 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c9a66-4ef1-458c-ac02-4d0f3441e305 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:04.940246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c9a66-4ef1-458c-ac02-4d0f3441e305 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:04.940532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c9a66-4ef1-458c-ac02-4d0f3441e305 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:04.940809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c9a66-4ef1-458c-ac02-4d0f3441e305 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:04.942616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b84c9a66-4ef1-458c-ac02-4d0f3441e305 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:04.957039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c9a66-4ef1-458c-ac02-4d0f3441e305 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:04.959142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c9a66-4ef1-458c-ac02-4d0f3441e305 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:04.972041 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4302/8567] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:26:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:26:23.835428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f7df3-89ae-45de-a398-1791ea1fca4e service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:23.856871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f7df3-89ae-45de-a398-1791ea1fca4e service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:23.860497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0331ab8-ff16-4ae3-bb84-ec8e0d017de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:23.861129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0331ab8-ff16-4ae3-bb84-ec8e0d017de5 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:23.861411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0331ab8-ff16-4ae3-bb84-ec8e0d017de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:23.861688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0331ab8-ff16-4ae3-bb84-ec8e0d017de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:23.863477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d0331ab8-ff16-4ae3-bb84-ec8e0d017de5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:23.876084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0331ab8-ff16-4ae3-bb84-ec8e0d017de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:23.877544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0331ab8-ff16-4ae3-bb84-ec8e0d017de5 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:23.887759 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4266/8568] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:26:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:26:53.235822 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c9a66-4ef1-458c-ac02-4d0f3441e305 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:53.321280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c9a66-4ef1-458c-ac02-4d0f3441e305 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:53.326098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:53.326955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:53.327255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:53.327534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] PATH_INFO: `/v3/users/1f67809d45cf4f8b9139c5acbd7a046b` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:53.328764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f67809d45cf4f8b9139c5acbd7a046b)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:53.330707 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:53.376630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f67809d45cf4f8b9139c5acbd7a046b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.384007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f67809d45cf4f8b9139c5acbd7a046b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.384705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f67809d45cf4f8b9139c5acbd7a046b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.385319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f67809d45cf4f8b9139c5acbd7a046b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.393942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f67809d45cf4f8b9139c5acbd7a046b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.413681 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4303/8569] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:26:53 2022] DELETE /identity/v3/users/1f67809d45cf4f8b9139c5acbd7a046b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:26:53.418438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42c3c-6e68-4153-aa10-62b8635ed7b7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:53.418882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42c3c-6e68-4153-aa10-62b8635ed7b7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:53.419161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa42c3c-6e68-4153-aa10-62b8635ed7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:53.438988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7aa42c3c-6e68-4153-aa10-62b8635ed7b7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:26:53.440337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7aa42c3c-6e68-4153-aa10-62b8635ed7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:53.501782 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4267/8570] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:26:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:26:53.512325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:53.513947 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:53.573451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1ca083-0c18-40f0-9015-7f97fa5f434c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:53.577126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898d8bb-4526-4ad2-a7fa-6eb1a744ff38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:53.577763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898d8bb-4526-4ad2-a7fa-6eb1a744ff38 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:53.578051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898d8bb-4526-4ad2-a7fa-6eb1a744ff38 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:53.578334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898d8bb-4526-4ad2-a7fa-6eb1a744ff38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:53.587871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898d8bb-4526-4ad2-a7fa-6eb1a744ff38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:53.589346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898d8bb-4526-4ad2-a7fa-6eb1a744ff38 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:53.598639 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4304/8571] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:26:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:26:53.768233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa42c3c-6e68-4153-aa10-62b8635ed7b7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:53.769687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7aa42c3c-6e68-4153-aa10-62b8635ed7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:53.781606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa42c3c-6e68-4153-aa10-62b8635ed7b7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:53.786483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:53.787345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:53.787634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:53.787933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] PATH_INFO: `/v3/projects/b26aef9ef8394051ae733c44969f31ff` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:53.789127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26aef9ef8394051ae733c44969f31ff)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:53.791066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:53.842253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26aef9ef8394051ae733c44969f31ff', 'request_id': 'req-f3e0c797-8031-4711-88d4-2d0800612602'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.850356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26aef9ef8394051ae733c44969f31ff', 'request_id': 'req-f3e0c797-8031-4711-88d4-2d0800612602'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.856217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26aef9ef8394051ae733c44969f31ff', 'request_id': 'req-f3e0c797-8031-4711-88d4-2d0800612602'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.868750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] The token cache is being invalidate because project b26aef9ef8394051ae733c44969f31ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:26:53.868939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.869623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.871302 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4268/8572] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:26:53 2022] DELETE /identity/v3/projects/b26aef9ef8394051ae733c44969f31ff => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:26:53.875273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898d8bb-4526-4ad2-a7fa-6eb1a744ff38 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:53.886083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898d8bb-4526-4ad2-a7fa-6eb1a744ff38 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:53.940327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:53.941216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:53.941494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:53.941766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] PATH_INFO: `/v3/users/7137903e954b4eb28ba0a7757f9ae425` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:53.943652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7137903e954b4eb28ba0a7757f9ae425)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:53.945626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:53.989061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7137903e954b4eb28ba0a7757f9ae425'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.996093 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7137903e954b4eb28ba0a7757f9ae425'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.996741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7137903e954b4eb28ba0a7757f9ae425'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:53.997339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7137903e954b4eb28ba0a7757f9ae425'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:54.004389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c31fae34-0513-43cd-b6a2-3459060a98a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7137903e954b4eb28ba0a7757f9ae425'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:54.020891 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4305/8573] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:26:53 2022] DELETE /identity/v3/users/7137903e954b4eb28ba0a7757f9ae425 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:26:54.280157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:54.281572 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:54.294879 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0c797-8031-4711-88d4-2d0800612602 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:54.351610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:54.352516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.352796 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.353077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] PATH_INFO: `/v3/projects/d28211ddaca849d299097f8b4ddef745` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.354238 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28211ddaca849d299097f8b4ddef745)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:54.356189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:54.401890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28211ddaca849d299097f8b4ddef745', 'request_id': 'req-8bb94cdf-5229-473b-92c0-20141bc96d9f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:54.408105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28211ddaca849d299097f8b4ddef745', 'request_id': 'req-8bb94cdf-5229-473b-92c0-20141bc96d9f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:54.413725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28211ddaca849d299097f8b4ddef745', 'request_id': 'req-8bb94cdf-5229-473b-92c0-20141bc96d9f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:54.424281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] The token cache is being invalidate because project d28211ddaca849d299097f8b4ddef745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:26:54.424864 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:54.425196 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8bb94cdf-5229-473b-92c0-20141bc96d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:26:54.426711 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4269/8574] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:26:54 2022] DELETE /identity/v3/projects/d28211ddaca849d299097f8b4ddef745 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:26:54.432471 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735599c-7bf8-4b80-b84c-2959085c2c3c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.432913 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735599c-7bf8-4b80-b84c-2959085c2c3c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.433028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735599c-7bf8-4b80-b84c-2959085c2c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.451376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-7735599c-7bf8-4b80-b84c-2959085c2c3c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:26:54.452656 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7735599c-7bf8-4b80-b84c-2959085c2c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:54.508639 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4306/8575] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:26:54.516931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078008a7-1289-42e3-89a4-fdfe764796cb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.517222 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078008a7-1289-42e3-89a4-fdfe764796cb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.517504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078008a7-1289-42e3-89a4-fdfe764796cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.536691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-078008a7-1289-42e3-89a4-fdfe764796cb None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:26:54.537872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-078008a7-1289-42e3-89a4-fdfe764796cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:54.546065 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4270/8576] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:26:54.550245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735599c-7bf8-4b80-b84c-2959085c2c3c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:54.560109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735599c-7bf8-4b80-b84c-2959085c2c3c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:54.564513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cd85c-594a-4c80-8461-7bdd8d748076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:54.565145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cd85c-594a-4c80-8461-7bdd8d748076 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.565423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cd85c-594a-4c80-8461-7bdd8d748076 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.565694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cd85c-594a-4c80-8461-7bdd8d748076 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.566422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cd85c-594a-4c80-8461-7bdd8d748076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:26:54.566722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cd85c-594a-4c80-8461-7bdd8d748076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:54.568964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cd85c-594a-4c80-8461-7bdd8d748076 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:54.581256 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4307/8577] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:26:54.585440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078008a7-1289-42e3-89a4-fdfe764796cb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:54.594517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078008a7-1289-42e3-89a4-fdfe764796cb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:54.599036 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416dd4f-25b4-4354-af5f-d8993e9b0740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:54.599691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416dd4f-25b4-4354-af5f-d8993e9b0740 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.600005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416dd4f-25b4-4354-af5f-d8993e9b0740 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.600283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416dd4f-25b4-4354-af5f-d8993e9b0740 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.600963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416dd4f-25b4-4354-af5f-d8993e9b0740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:54.602895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416dd4f-25b4-4354-af5f-d8993e9b0740 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:54.640559 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4271/8578] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:26:54 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:26:54.641738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cd85c-594a-4c80-8461-7bdd8d748076 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:54.652648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cd85c-594a-4c80-8461-7bdd8d748076 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:54.706601 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e92997-864d-404b-9b41-612a11d2afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:54.707258 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e92997-864d-404b-9b41-612a11d2afd0 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.707545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e92997-864d-404b-9b41-612a11d2afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.707823 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e92997-864d-404b-9b41-612a11d2afd0 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.709222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e92997-864d-404b-9b41-612a11d2afd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:54.711147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e92997-864d-404b-9b41-612a11d2afd0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:54.730653 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4308/8579] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:26:54 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:26:54.734833 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416dd4f-25b4-4354-af5f-d8993e9b0740 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:54.744939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416dd4f-25b4-4354-af5f-d8993e9b0740 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:54.749447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db0271-52e6-43ee-9b23-b10309d75b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:54.750091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db0271-52e6-43ee-9b23-b10309d75b80 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.750385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db0271-52e6-43ee-9b23-b10309d75b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.750651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db0271-52e6-43ee-9b23-b10309d75b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.751363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db0271-52e6-43ee-9b23-b10309d75b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:54.753058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19db0271-52e6-43ee-9b23-b10309d75b80 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:54.763347 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4272/8580] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:26:54.767299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e92997-864d-404b-9b41-612a11d2afd0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:54.777747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e92997-864d-404b-9b41-612a11d2afd0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:54.782227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b150d3-1d9d-407c-80e3-8a2ee2b2884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:54.782843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b150d3-1d9d-407c-80e3-8a2ee2b2884f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.783124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b150d3-1d9d-407c-80e3-8a2ee2b2884f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.783397 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b150d3-1d9d-407c-80e3-8a2ee2b2884f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.784137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b150d3-1d9d-407c-80e3-8a2ee2b2884f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:54.786016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b150d3-1d9d-407c-80e3-8a2ee2b2884f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:54.795545 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4309/8581] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:26:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:26:54.799350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db0271-52e6-43ee-9b23-b10309d75b80 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:54.809306 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db0271-52e6-43ee-9b23-b10309d75b80 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:54.813925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403f1a-7801-4bee-bc27-05e3cdb4795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:54.814786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403f1a-7801-4bee-bc27-05e3cdb4795f admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.815072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403f1a-7801-4bee-bc27-05e3cdb4795f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.815353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31403f1a-7801-4bee-bc27-05e3cdb4795f admin admin] PATH_INFO: `/v3/projects/70a75e2183794d609998d8ad6e651a36/users/82c3cfacf3ca4187a9ccf82e0563e0bc/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.829984 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31403f1a-7801-4bee-bc27-05e3cdb4795f admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a75e2183794d609998d8ad6e651a36, user_id=82c3cfacf3ca4187a9ccf82e0563e0bc, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:54.832701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31403f1a-7801-4bee-bc27-05e3cdb4795f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:54.845980 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4273/8582] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:26:54 2022] PUT /identity/v3/projects/70a75e2183794d609998d8ad6e651a36/users/82c3cfacf3ca4187a9ccf82e0563e0bc/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:26:54.851255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1568d59-c9bf-48be-b4ec-ded83ad09931 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:54.851555 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1568d59-c9bf-48be-b4ec-ded83ad09931 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:54.851838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1568d59-c9bf-48be-b4ec-ded83ad09931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:54.869385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a1568d59-c9bf-48be-b4ec-ded83ad09931 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:26:54.870583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a1568d59-c9bf-48be-b4ec-ded83ad09931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:54.927554 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4310/8583] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:26:54.937095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403f1a-7801-4bee-bc27-05e3cdb4795f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:54.938738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-31403f1a-7801-4bee-bc27-05e3cdb4795f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:54.995768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31403f1a-7801-4bee-bc27-05e3cdb4795f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:54.999513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2eb97-fc36-43ae-bf7a-a01692ceff73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:55.000182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2eb97-fc36-43ae-bf7a-a01692ceff73 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:55.000458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2eb97-fc36-43ae-bf7a-a01692ceff73 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:55.000732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2eb97-fc36-43ae-bf7a-a01692ceff73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:55.010194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2eb97-fc36-43ae-bf7a-a01692ceff73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:55.011638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2eb97-fc36-43ae-bf7a-a01692ceff73 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:55.021925 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4274/8584] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:26:55.111077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1568d59-c9bf-48be-b4ec-ded83ad09931 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:26:55.112509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a1568d59-c9bf-48be-b4ec-ded83ad09931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:55.185089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1568d59-c9bf-48be-b4ec-ded83ad09931 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:26:55.189890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e4835e-6c74-4614-a48a-9c9d574474a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '416ac158078b4b678c236e0ad811acad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:26:55.190631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4835e-6c74-4614-a48a-9c9d574474a9 service cinder] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:55.190927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4835e-6c74-4614-a48a-9c9d574474a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:55.191203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e4835e-6c74-4614-a48a-9c9d574474a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:55.194894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-88e4835e-6c74-4614-a48a-9c9d574474a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:55.256160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4835e-6c74-4614-a48a-9c9d574474a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:26:55.257766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e4835e-6c74-4614-a48a-9c9d574474a9 service cinder] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:26:55.268121 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4311/8585] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:26:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:26:57.986392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042358-e1e4-4250-854a-8f16df20ca0b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:26:57.986883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042358-e1e4-4250-854a-8f16df20ca0b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:26:57.986978 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21042358-e1e4-4250-854a-8f16df20ca0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:26:58.005865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-21042358-e1e4-4250-854a-8f16df20ca0b None None] MFA Rules not processed for user `39d6d477fac5463a944d918490b7117f`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:26:58.007098 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-21042358-e1e4-4250-854a-8f16df20ca0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:26:58.015216 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4275/8586] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:26:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:00.005981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e58172-1cdf-47d3-9eb1-85a954bd9710 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:00.006522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e58172-1cdf-47d3-9eb1-85a954bd9710 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:00.006628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e58172-1cdf-47d3-9eb1-85a954bd9710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:00.045175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f0e58172-1cdf-47d3-9eb1-85a954bd9710 None None] MFA Rules not processed for user `82c3cfacf3ca4187a9ccf82e0563e0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:00.046408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f0e58172-1cdf-47d3-9eb1-85a954bd9710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:00.113264 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4312/8587] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:00.118583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042358-e1e4-4250-854a-8f16df20ca0b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:00.129495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21042358-e1e4-4250-854a-8f16df20ca0b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:00.134158 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45566e0f-80a8-4671-aff3-9dab295c6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:00.134883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45566e0f-80a8-4671-aff3-9dab295c6655 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:00.135237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45566e0f-80a8-4671-aff3-9dab295c6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:00.135590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45566e0f-80a8-4671-aff3-9dab295c6655 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:00.136400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45566e0f-80a8-4671-aff3-9dab295c6655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:00.138428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45566e0f-80a8-4671-aff3-9dab295c6655 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:00.167970 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4276/8588] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:27:00 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:27:00.170359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e58172-1cdf-47d3-9eb1-85a954bd9710 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:00.189171 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e58172-1cdf-47d3-9eb1-85a954bd9710 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:00.268865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0fdca-ca90-40c2-be84-19417cf276e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:00.269543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0fdca-ca90-40c2-be84-19417cf276e9 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:00.269828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0fdca-ca90-40c2-be84-19417cf276e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:00.270104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0fdca-ca90-40c2-be84-19417cf276e9 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:00.270838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0fdca-ca90-40c2-be84-19417cf276e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:00.273170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0fdca-ca90-40c2-be84-19417cf276e9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:00.304093 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4313/8589] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:27:00 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:27:00.305548 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45566e0f-80a8-4671-aff3-9dab295c6655 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:00.316411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45566e0f-80a8-4671-aff3-9dab295c6655 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:00.321253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387151d-de76-40d3-a1d5-a6ab85e98d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:00.321988 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387151d-de76-40d3-a1d5-a6ab85e98d57 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:00.322346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387151d-de76-40d3-a1d5-a6ab85e98d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:00.322698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387151d-de76-40d3-a1d5-a6ab85e98d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:00.323525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387151d-de76-40d3-a1d5-a6ab85e98d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:00.325337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387151d-de76-40d3-a1d5-a6ab85e98d57 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:00.339689 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4277/8590] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:27:00.340922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0fdca-ca90-40c2-be84-19417cf276e9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:00.351998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0fdca-ca90-40c2-be84-19417cf276e9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:00.358226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccc77-43f6-441e-81e4-3f4a3659fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:00.359108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccc77-43f6-441e-81e4-3f4a3659fe74 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:00.359389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccc77-43f6-441e-81e4-3f4a3659fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:00.359663 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccc77-43f6-441e-81e4-3f4a3659fe74 admin admin] PATH_INFO: `/v3/projects/0458950035d548d8803ea0db9d8f1f3e/users/2a332796519b45989490098bf7a44637/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:00.379126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ccc77-43f6-441e-81e4-3f4a3659fe74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0458950035d548d8803ea0db9d8f1f3e, user_id=2a332796519b45989490098bf7a44637, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:00.381990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ccc77-43f6-441e-81e4-3f4a3659fe74 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:00.397071 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4314/8591] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:27:00 2022] PUT /identity/v3/projects/0458950035d548d8803ea0db9d8f1f3e/users/2a332796519b45989490098bf7a44637/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:00.401164 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387151d-de76-40d3-a1d5-a6ab85e98d57 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:00.413110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387151d-de76-40d3-a1d5-a6ab85e98d57 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:00.472946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc0454-2124-43ab-aeee-9e8b6092b1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:00.473675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc0454-2124-43ab-aeee-9e8b6092b1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:00.474723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc0454-2124-43ab-aeee-9e8b6092b1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:00.475014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc0454-2124-43ab-aeee-9e8b6092b1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:00.476355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc0454-2124-43ab-aeee-9e8b6092b1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:00.478469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc0454-2124-43ab-aeee-9e8b6092b1a5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:00.489795 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4278/8592] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:27:00.493855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccc77-43f6-441e-81e4-3f4a3659fe74 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:00.504709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccc77-43f6-441e-81e4-3f4a3659fe74 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:00.510634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483d53-a223-4657-b998-1af48c4f856e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:00.511821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483d53-a223-4657-b998-1af48c4f856e admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:00.513291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483d53-a223-4657-b998-1af48c4f856e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:00.513291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483d53-a223-4657-b998-1af48c4f856e admin admin] PATH_INFO: `/v3/projects/0458950035d548d8803ea0db9d8f1f3e/users/2a332796519b45989490098bf7a44637/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:00.516142 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae483d53-a223-4657-b998-1af48c4f856e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0458950035d548d8803ea0db9d8f1f3e, user_id=2a332796519b45989490098bf7a44637, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:00.519145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae483d53-a223-4657-b998-1af48c4f856e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:00.532997 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4315/8593] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:27:00 2022] PUT /identity/v3/projects/0458950035d548d8803ea0db9d8f1f3e/users/2a332796519b45989490098bf7a44637/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:27:06.394553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a24a9e-71b2-4922-94a6-f6b65f005bfb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:06.395111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a24a9e-71b2-4922-94a6-f6b65f005bfb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:06.395111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a24a9e-71b2-4922-94a6-f6b65f005bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:06.425706 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-49a24a9e-71b2-4922-94a6-f6b65f005bfb None None] MFA Rules not processed for user `2a332796519b45989490098bf7a44637`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:06.427175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49a24a9e-71b2-4922-94a6-f6b65f005bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:06.519656 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4279/8594] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:06.528089 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483d53-a223-4657-b998-1af48c4f856e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:06.530300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ae483d53-a223-4657-b998-1af48c4f856e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:06.630241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483d53-a223-4657-b998-1af48c4f856e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:06.637074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bdbbd-fee7-4dd3-bf9a-d3afb3af5e38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:06.637979 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bdbbd-fee7-4dd3-bf9a-d3afb3af5e38 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:06.638425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bdbbd-fee7-4dd3-bf9a-d3afb3af5e38 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:06.638849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bdbbd-fee7-4dd3-bf9a-d3afb3af5e38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:06.648586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bdbbd-fee7-4dd3-bf9a-d3afb3af5e38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:06.650473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bdbbd-fee7-4dd3-bf9a-d3afb3af5e38 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:06.663241 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4316/8595] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:27:06 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:27:06.713166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3549db9-42dc-44d2-9e22-c7f82a5fe2a1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:06.713685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3549db9-42dc-44d2-9e22-c7f82a5fe2a1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:06.714151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3549db9-42dc-44d2-9e22-c7f82a5fe2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:06.747120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a3549db9-42dc-44d2-9e22-c7f82a5fe2a1 None None] MFA Rules not processed for user `82c3cfacf3ca4187a9ccf82e0563e0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:06.750894 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a3549db9-42dc-44d2-9e22-c7f82a5fe2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:06.828657 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4280/8596] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:07.109224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bdbbd-fee7-4dd3-bf9a-d3afb3af5e38 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:07.110894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b68bdbbd-fee7-4dd3-bf9a-d3afb3af5e38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:07.185281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bdbbd-fee7-4dd3-bf9a-d3afb3af5e38 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:07.195858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:07.196635 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:07.196930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:07.197211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:07.199696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:07.212439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:07.213906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:07.229570 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4317/8597] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:27:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:27:17.733963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed04b6-120a-4f86-affd-39ec5f0575d6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:17.734573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed04b6-120a-4f86-affd-39ec5f0575d6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:17.734739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed04b6-120a-4f86-affd-39ec5f0575d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:17.753625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-8bed04b6-120a-4f86-affd-39ec5f0575d6 None None] MFA Rules not processed for user `82c3cfacf3ca4187a9ccf82e0563e0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:17.754838 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8bed04b6-120a-4f86-affd-39ec5f0575d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:17.762680 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4281/8598] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:26.076962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:26.078385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:26.173553 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab13f3a-53f9-40c0-8447-2fef2e81fc0e service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:26.179775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e22c92-b31a-494e-80bf-c6059498f2dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:26.181237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e22c92-b31a-494e-80bf-c6059498f2dd service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:26.181631 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e22c92-b31a-494e-80bf-c6059498f2dd service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:26.181912 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e22c92-b31a-494e-80bf-c6059498f2dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:26.184647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-89e22c92-b31a-494e-80bf-c6059498f2dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:26.218178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e22c92-b31a-494e-80bf-c6059498f2dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:26.219819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e22c92-b31a-494e-80bf-c6059498f2dd service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:26.234355 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4318/8599] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:27:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:27:30.076809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed04b6-120a-4f86-affd-39ec5f0575d6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:30.078761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-8bed04b6-120a-4f86-affd-39ec5f0575d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:30.097653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed04b6-120a-4f86-affd-39ec5f0575d6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:30.103385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9caa-69bb-4ade-a2db-6e265a96eea2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:30.104012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9caa-69bb-4ade-a2db-6e265a96eea2 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:30.104304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9caa-69bb-4ade-a2db-6e265a96eea2 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:30.104601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9caa-69bb-4ade-a2db-6e265a96eea2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:30.106547 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-960f9caa-69bb-4ade-a2db-6e265a96eea2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:30.121174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f9caa-69bb-4ade-a2db-6e265a96eea2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:30.122791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f9caa-69bb-4ade-a2db-6e265a96eea2 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:30.135690 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4282/8600] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:27:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:27:41.590114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e22c92-b31a-494e-80bf-c6059498f2dd service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:41.664219 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e22c92-b31a-494e-80bf-c6059498f2dd service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:41.669227 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:41.670198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:41.670481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:41.670761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] PATH_INFO: `/v3/users/82c3cfacf3ca4187a9ccf82e0563e0bc` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:41.672195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c3cfacf3ca4187a9ccf82e0563e0bc)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:41.674319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:41.723949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c3cfacf3ca4187a9ccf82e0563e0bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:41.731368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c3cfacf3ca4187a9ccf82e0563e0bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:41.732102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c3cfacf3ca4187a9ccf82e0563e0bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:41.732864 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c3cfacf3ca4187a9ccf82e0563e0bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:41.740894 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c3cfacf3ca4187a9ccf82e0563e0bc'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:41.760174 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4319/8601] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:27:41 2022] DELETE /identity/v3/users/82c3cfacf3ca4187a9ccf82e0563e0bc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:41.953509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9caa-69bb-4ade-a2db-6e265a96eea2 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:41.969630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9caa-69bb-4ade-a2db-6e265a96eea2 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:42.031704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:42.032862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:42.033233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:42.033648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] PATH_INFO: `/v3/projects/70a75e2183794d609998d8ad6e651a36` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:42.034863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a75e2183794d609998d8ad6e651a36)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:42.037564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:42.089461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a75e2183794d609998d8ad6e651a36', 'request_id': 'req-c63ebc12-0598-4c67-a9fb-438657ab64b1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.098023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a75e2183794d609998d8ad6e651a36', 'request_id': 'req-c63ebc12-0598-4c67-a9fb-438657ab64b1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.105541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a75e2183794d609998d8ad6e651a36', 'request_id': 'req-c63ebc12-0598-4c67-a9fb-438657ab64b1'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.119556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] The token cache is being invalidate because project 70a75e2183794d609998d8ad6e651a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:27:42.119723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.120517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.122586 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4283/8602] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:27:41 2022] DELETE /identity/v3/projects/70a75e2183794d609998d8ad6e651a36 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:42.126948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:42.128441 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:42.142809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb276d2-4287-4371-adcc-13d0f4cfd37c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:42.205672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:42.206659 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:42.206938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:42.207210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] PATH_INFO: `/v3/users/2a332796519b45989490098bf7a44637` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:42.209253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a332796519b45989490098bf7a44637)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:42.213855 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:42.269018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a332796519b45989490098bf7a44637'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.276970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a332796519b45989490098bf7a44637'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.277852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a332796519b45989490098bf7a44637'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.278522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a332796519b45989490098bf7a44637'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.286737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-5520e2d8-af60-4b1e-b78c-42fccd4cc01b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a332796519b45989490098bf7a44637'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.309581 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4320/8603] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:27:42 2022] DELETE /identity/v3/users/2a332796519b45989490098bf7a44637 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:27:42.502644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:42.504527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:42.518234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ebc12-0598-4c67-a9fb-438657ab64b1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:42.592870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:42.593767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:42.594049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:42.594391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] PATH_INFO: `/v3/projects/0458950035d548d8803ea0db9d8f1f3e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:42.595846 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0458950035d548d8803ea0db9d8f1f3e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:42.598007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:42.648760 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0458950035d548d8803ea0db9d8f1f3e', 'request_id': 'req-ebe1bd63-985f-4093-a90d-da12f0bc231b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.657063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0458950035d548d8803ea0db9d8f1f3e', 'request_id': 'req-ebe1bd63-985f-4093-a90d-da12f0bc231b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.663251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0458950035d548d8803ea0db9d8f1f3e', 'request_id': 'req-ebe1bd63-985f-4093-a90d-da12f0bc231b'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.676345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] The token cache is being invalidate because project 0458950035d548d8803ea0db9d8f1f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:27:42.676573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.677380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebe1bd63-985f-4093-a90d-da12f0bc231b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:42.679022 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4284/8604] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:27:42 2022] DELETE /identity/v3/projects/0458950035d548d8803ea0db9d8f1f3e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:42.685094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01bbce-d56f-43bf-8364-c10500b1f182 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:42.685657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01bbce-d56f-43bf-8364-c10500b1f182 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:42.685657 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01bbce-d56f-43bf-8364-c10500b1f182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:42.705295 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4c01bbce-d56f-43bf-8364-c10500b1f182 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:42.706569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4c01bbce-d56f-43bf-8364-c10500b1f182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:42.769884 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4321/8605] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:42.777955 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476343d5-d1d2-46c6-82d7-08de12b9b989 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:42.778244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476343d5-d1d2-46c6-82d7-08de12b9b989 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:42.778608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476343d5-d1d2-46c6-82d7-08de12b9b989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:42.800031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-476343d5-d1d2-46c6-82d7-08de12b9b989 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:42.801348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-476343d5-d1d2-46c6-82d7-08de12b9b989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:42.810470 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4285/8606] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:42.815163 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01bbce-d56f-43bf-8364-c10500b1f182 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:42.825544 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01bbce-d56f-43bf-8364-c10500b1f182 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:42.830636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82594a2e-a050-4f4a-8ec2-352e4c6a8003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:42.831325 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82594a2e-a050-4f4a-8ec2-352e4c6a8003 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:42.831640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82594a2e-a050-4f4a-8ec2-352e4c6a8003 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:42.832028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82594a2e-a050-4f4a-8ec2-352e4c6a8003 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:42.832722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82594a2e-a050-4f4a-8ec2-352e4c6a8003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:27:42.833066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82594a2e-a050-4f4a-8ec2-352e4c6a8003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:42.834756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82594a2e-a050-4f4a-8ec2-352e4c6a8003 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:42.848389 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4322/8607] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:27:42.853484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476343d5-d1d2-46c6-82d7-08de12b9b989 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:42.864154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476343d5-d1d2-46c6-82d7-08de12b9b989 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:42.869933 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d182a-4906-44fd-ad8d-56b235904e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:42.870681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d182a-4906-44fd-ad8d-56b235904e95 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:42.871089 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d182a-4906-44fd-ad8d-56b235904e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:42.871315 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d182a-4906-44fd-ad8d-56b235904e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:42.872265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d182a-4906-44fd-ad8d-56b235904e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:42.874423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50d182a-4906-44fd-ad8d-56b235904e95 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:42.903652 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4286/8608] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:27:42 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:27:42.908235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82594a2e-a050-4f4a-8ec2-352e4c6a8003 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:42.919468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82594a2e-a050-4f4a-8ec2-352e4c6a8003 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:42.980584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1845b-1593-472d-bc0b-97e96918db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:42.981178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1845b-1593-472d-bc0b-97e96918db5e admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:42.981488 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1845b-1593-472d-bc0b-97e96918db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:42.981764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1845b-1593-472d-bc0b-97e96918db5e admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:42.982545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1845b-1593-472d-bc0b-97e96918db5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:42.984836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a1845b-1593-472d-bc0b-97e96918db5e admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:43.006698 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4323/8609] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:27:42 2022] POST /identity/v3/users => generated 282 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:27:43.011818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d182a-4906-44fd-ad8d-56b235904e95 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:43.026610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d182a-4906-44fd-ad8d-56b235904e95 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:43.031747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a08d4-db65-4475-9e68-50722facd69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:43.032447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a08d4-db65-4475-9e68-50722facd69d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:43.032802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a08d4-db65-4475-9e68-50722facd69d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:43.033099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a08d4-db65-4475-9e68-50722facd69d admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:43.033950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a08d4-db65-4475-9e68-50722facd69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:43.035825 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a08d4-db65-4475-9e68-50722facd69d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:43.047621 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4287/8610] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:27:43.051650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1845b-1593-472d-bc0b-97e96918db5e admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:43.062374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1845b-1593-472d-bc0b-97e96918db5e admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:43.067708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca1254-ab51-4262-b0c3-d082d0941bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:43.068427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1254-ab51-4262-b0c3-d082d0941bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:43.068713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1254-ab51-4262-b0c3-d082d0941bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:43.068990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca1254-ab51-4262-b0c3-d082d0941bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:43.069793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca1254-ab51-4262-b0c3-d082d0941bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:43.072193 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca1254-ab51-4262-b0c3-d082d0941bf0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:43.082548 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4324/8611] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:27:43.087268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a08d4-db65-4475-9e68-50722facd69d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:43.097612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a08d4-db65-4475-9e68-50722facd69d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:43.103519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e45807-f75b-4b4b-a5c9-1c38b0d2402e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:43.104440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45807-f75b-4b4b-a5c9-1c38b0d2402e admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:43.104727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45807-f75b-4b4b-a5c9-1c38b0d2402e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:43.105010 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e45807-f75b-4b4b-a5c9-1c38b0d2402e admin admin] PATH_INFO: `/v3/projects/b87b21a4b1954ce2be46f8559de182b6/users/faa78d86087840269daf0f8cde42ef9e/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:43.122029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e45807-f75b-4b4b-a5c9-1c38b0d2402e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87b21a4b1954ce2be46f8559de182b6, user_id=faa78d86087840269daf0f8cde42ef9e, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:43.125068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e45807-f75b-4b4b-a5c9-1c38b0d2402e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:43.139567 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4288/8612] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:27:43 2022] PUT /identity/v3/projects/b87b21a4b1954ce2be46f8559de182b6/users/faa78d86087840269daf0f8cde42ef9e/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:27:43.145921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721c679-e05b-45b0-a9df-94278b3b8ef1 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:43.146266 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721c679-e05b-45b0-a9df-94278b3b8ef1 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:43.146594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721c679-e05b-45b0-a9df-94278b3b8ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:43.165589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b721c679-e05b-45b0-a9df-94278b3b8ef1 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:43.166806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b721c679-e05b-45b0-a9df-94278b3b8ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:43.230146 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4325/8613] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:43.241032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e45807-f75b-4b4b-a5c9-1c38b0d2402e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:43.243462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-75e45807-f75b-4b4b-a5c9-1c38b0d2402e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:43.308400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e45807-f75b-4b4b-a5c9-1c38b0d2402e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:43.312672 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2947f-3386-4a47-8d1a-40a1d5e46892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:43.313438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2947f-3386-4a47-8d1a-40a1d5e46892 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:43.313789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2947f-3386-4a47-8d1a-40a1d5e46892 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:43.314131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2947f-3386-4a47-8d1a-40a1d5e46892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:43.326185 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2947f-3386-4a47-8d1a-40a1d5e46892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:43.327753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f2947f-3386-4a47-8d1a-40a1d5e46892 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:43.338611 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4289/8614] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:27:47.300433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20544a-e0c4-4d45-9b59-f18d4470726e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:47.300950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20544a-e0c4-4d45-9b59-f18d4470726e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:47.301045 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20544a-e0c4-4d45-9b59-f18d4470726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:47.332145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4f20544a-e0c4-4d45-9b59-f18d4470726e None None] MFA Rules not processed for user `faa78d86087840269daf0f8cde42ef9e`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:47.333390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4f20544a-e0c4-4d45-9b59-f18d4470726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:47.399263 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4326/8615] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:47.403967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2947f-3386-4a47-8d1a-40a1d5e46892 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:47.414797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2947f-3386-4a47-8d1a-40a1d5e46892 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:47.420529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c319f3-7242-44f7-87a7-ce33926ab69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:47.421203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c319f3-7242-44f7-87a7-ce33926ab69d admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:47.421510 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c319f3-7242-44f7-87a7-ce33926ab69d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:47.421788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c319f3-7242-44f7-87a7-ce33926ab69d admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:47.422493 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c319f3-7242-44f7-87a7-ce33926ab69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:47.424504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c319f3-7242-44f7-87a7-ce33926ab69d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:47.446567 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4290/8616] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:27:47 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:27:47.450812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20544a-e0c4-4d45-9b59-f18d4470726e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:47.461687 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20544a-e0c4-4d45-9b59-f18d4470726e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:47.466373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fc5a8-6c6c-4990-928b-7c0761263f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:47.467031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc5a8-6c6c-4990-928b-7c0761263f50 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:47.467314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc5a8-6c6c-4990-928b-7c0761263f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:47.467588 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fc5a8-6c6c-4990-928b-7c0761263f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:47.468374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fc5a8-6c6c-4990-928b-7c0761263f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:47.470134 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fc5a8-6c6c-4990-928b-7c0761263f50 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:47.482101 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4327/8617] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:27:47.486200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c319f3-7242-44f7-87a7-ce33926ab69d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:47.497433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c319f3-7242-44f7-87a7-ce33926ab69d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:47.502337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a506-2f8b-4a83-882c-59a0486ac961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:47.503378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a506-2f8b-4a83-882c-59a0486ac961 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:47.503665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a506-2f8b-4a83-882c-59a0486ac961 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:47.504042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15a506-2f8b-4a83-882c-59a0486ac961 admin admin] PATH_INFO: `/v3/system/users/764a8af66a2248078669319ef7568cca/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:47.522568 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a506-2f8b-4a83-882c-59a0486ac961 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=764a8af66a2248078669319ef7568cca, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:47.523707 ncdv-master-1 devstack@keystone.service[97203]: WARNING py.warnings [None req-de15a506-2f8b-4a83-882c-59a0486ac961 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 26 21:27:47.523707 ncdv-master-1 devstack@keystone.service[97203]: warnings.warn(msg) Mar 26 21:27:47.523707 ncdv-master-1 devstack@keystone.service[97203]: Mar 26 21:27:47.524822 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de15a506-2f8b-4a83-882c-59a0486ac961 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:47.533470 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4291/8618] 10.222.0.16 () {60 vars in 1377 bytes} [Sat Mar 26 21:27:47 2022] PUT /identity/v3/system/users/764a8af66a2248078669319ef7568cca/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:47.545004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba1ead-4ed0-4111-95f8-1d86d1ddbae4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:47.545299 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba1ead-4ed0-4111-95f8-1d86d1ddbae4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:47.545581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba1ead-4ed0-4111-95f8-1d86d1ddbae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:47.572013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-d5ba1ead-4ed0-4111-95f8-1d86d1ddbae4 None None] MFA Rules not processed for user `764a8af66a2248078669319ef7568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:47.573370 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d5ba1ead-4ed0-4111-95f8-1d86d1ddbae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:47.652203 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4328/8619] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:47 2022] POST /identity/v3/auth/tokens => generated 2404 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 26 21:27:47.656519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a506-2f8b-4a83-882c-59a0486ac961 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:47.757668 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15a506-2f8b-4a83-882c-59a0486ac961 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:47.795058 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315d15c-46dd-4ff8-afc9-b9adb1505c4d None tempest-ImageQuotaTest-196509831-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '764a8af66a2248078669319ef7568cca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:47.795726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315d15c-46dd-4ff8-afc9-b9adb1505c4d None tempest-ImageQuotaTest-196509831-system-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:47.796040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315d15c-46dd-4ff8-afc9-b9adb1505c4d None tempest-ImageQuotaTest-196509831-system-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:47.796317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3315d15c-46dd-4ff8-afc9-b9adb1505c4d None tempest-ImageQuotaTest-196509831-system-admin] PATH_INFO: `/v3/services` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:47.796996 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315d15c-46dd-4ff8-afc9-b9adb1505c4d None tempest-ImageQuotaTest-196509831-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:47.798395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3315d15c-46dd-4ff8-afc9-b9adb1505c4d None tempest-ImageQuotaTest-196509831-system-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:47.805255 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4292/8620] 10.222.0.16 () {58 vars in 1109 bytes} [Sat Mar 26 21:27:47 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:27:47.809955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba1ead-4ed0-4111-95f8-1d86d1ddbae4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:47.905520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba1ead-4ed0-4111-95f8-1d86d1ddbae4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:47.938005 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e766d-621b-463a-b959-4f3c815a77f0 None tempest-ImageQuotaTest-196509831-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '764a8af66a2248078669319ef7568cca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:47.938671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e766d-621b-463a-b959-4f3c815a77f0 None tempest-ImageQuotaTest-196509831-system-admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:47.938957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e766d-621b-463a-b959-4f3c815a77f0 None tempest-ImageQuotaTest-196509831-system-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:47.939236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e766d-621b-463a-b959-4f3c815a77f0 None tempest-ImageQuotaTest-196509831-system-admin] PATH_INFO: `/v3/limits` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:47.939990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e766d-621b-463a-b959-4f3c815a77f0 None tempest-ImageQuotaTest-196509831-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:47.941321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e766d-621b-463a-b959-4f3c815a77f0 None tempest-ImageQuotaTest-196509831-system-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:47.961562 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-434e766d-621b-463a-b959-4f3c815a77f0 None tempest-ImageQuotaTest-196509831-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Mar 26 21:27:47.962752 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4329/8621] 10.222.0.16 () {60 vars in 1125 bytes} [Sat Mar 26 21:27:47 2022] POST /identity/v3/limits => generated 124 bytes in 153 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Mar 26 21:27:47.968624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315d15c-46dd-4ff8-afc9-b9adb1505c4d None tempest-ImageQuotaTest-196509831-system-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:48.066769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3315d15c-46dd-4ff8-afc9-b9adb1505c4d None tempest-ImageQuotaTest-196509831-system-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:48.101132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16f1aa-0dfa-479f-9e93-56cb20182686 None tempest-ImageQuotaTest-196509831-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '764a8af66a2248078669319ef7568cca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:48.101782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16f1aa-0dfa-479f-9e93-56cb20182686 None tempest-ImageQuotaTest-196509831-system-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:48.102062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16f1aa-0dfa-479f-9e93-56cb20182686 None tempest-ImageQuotaTest-196509831-system-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:48.102336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b16f1aa-0dfa-479f-9e93-56cb20182686 None tempest-ImageQuotaTest-196509831-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:48.103007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16f1aa-0dfa-479f-9e93-56cb20182686 None tempest-ImageQuotaTest-196509831-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:48.104187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b16f1aa-0dfa-479f-9e93-56cb20182686 None tempest-ImageQuotaTest-196509831-system-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:48.110398 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4293/8622] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 21:27:47 2022] GET /identity/v3/registered_limits => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:27:48.116468 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e766d-621b-463a-b959-4f3c815a77f0 None tempest-ImageQuotaTest-196509831-system-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:48.216461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e766d-621b-463a-b959-4f3c815a77f0 None tempest-ImageQuotaTest-196509831-system-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:48.253881 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7070ab2-f82f-426c-aabd-2bca0465d5a0 None tempest-ImageQuotaTest-196509831-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '764a8af66a2248078669319ef7568cca', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:48.254624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7070ab2-f82f-426c-aabd-2bca0465d5a0 None tempest-ImageQuotaTest-196509831-system-admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:48.254906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7070ab2-f82f-426c-aabd-2bca0465d5a0 None tempest-ImageQuotaTest-196509831-system-admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:48.255181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7070ab2-f82f-426c-aabd-2bca0465d5a0 None tempest-ImageQuotaTest-196509831-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:48.255877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7070ab2-f82f-426c-aabd-2bca0465d5a0 None tempest-ImageQuotaTest-196509831-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:48.257035 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7070ab2-f82f-426c-aabd-2bca0465d5a0 None tempest-ImageQuotaTest-196509831-system-admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:48.268377 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4330/8623] 10.222.0.16 () {58 vars in 1136 bytes} [Sat Mar 26 21:27:48 2022] GET /identity/v3/registered_limits => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:27:51.609755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16f1aa-0dfa-479f-9e93-56cb20182686 None tempest-ImageQuotaTest-196509831-system-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:51.622150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b16f1aa-0dfa-479f-9e93-56cb20182686 None tempest-ImageQuotaTest-196509831-system-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:51.626817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:51.627673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:51.627986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:51.628266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] PATH_INFO: `/v3/users/faa78d86087840269daf0f8cde42ef9e` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:51.629456 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa78d86087840269daf0f8cde42ef9e)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:51.631445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:51.678788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa78d86087840269daf0f8cde42ef9e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:51.685993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa78d86087840269daf0f8cde42ef9e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:51.686655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa78d86087840269daf0f8cde42ef9e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:51.687351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa78d86087840269daf0f8cde42ef9e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:51.698884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa78d86087840269daf0f8cde42ef9e'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:51.710675 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4294/8624] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:27:51 2022] DELETE /identity/v3/users/faa78d86087840269daf0f8cde42ef9e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:51.885961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7070ab2-f82f-426c-aabd-2bca0465d5a0 None tempest-ImageQuotaTest-196509831-system-admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:51.888230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a7070ab2-f82f-426c-aabd-2bca0465d5a0 None tempest-ImageQuotaTest-196509831-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:51.954757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7070ab2-f82f-426c-aabd-2bca0465d5a0 None tempest-ImageQuotaTest-196509831-system-admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:51.959699 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:51.960622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:51.960906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:51.961184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] PATH_INFO: `/v3/projects/b87b21a4b1954ce2be46f8559de182b6` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:51.962414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87b21a4b1954ce2be46f8559de182b6)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:51.964392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:52.009781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87b21a4b1954ce2be46f8559de182b6', 'request_id': 'req-0c963d5e-be35-4477-9108-72b7375c30c9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.016587 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87b21a4b1954ce2be46f8559de182b6', 'request_id': 'req-0c963d5e-be35-4477-9108-72b7375c30c9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.021882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87b21a4b1954ce2be46f8559de182b6', 'request_id': 'req-0c963d5e-be35-4477-9108-72b7375c30c9'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.033492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] The token cache is being invalidate because project b87b21a4b1954ce2be46f8559de182b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:27:52.033783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.034469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.036085 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4331/8625] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:27:51 2022] DELETE /identity/v3/projects/b87b21a4b1954ce2be46f8559de182b6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:52.040422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:52.051240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08554-1124-494f-9d65-4e4f479b907e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:52.105292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:52.106188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.106468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.106746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] PATH_INFO: `/v3/users/764a8af66a2248078669319ef7568cca` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.107944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764a8af66a2248078669319ef7568cca)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:52.109880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:52.163368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764a8af66a2248078669319ef7568cca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.170964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764a8af66a2248078669319ef7568cca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.171591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764a8af66a2248078669319ef7568cca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.172214 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764a8af66a2248078669319ef7568cca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.184909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4db9ec64-2ec7-4bb0-9549-cd769387c281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764a8af66a2248078669319ef7568cca'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:27:52.196657 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4295/8626] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:27:52 2022] DELETE /identity/v3/users/764a8af66a2248078669319ef7568cca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:52.459055 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:52.460554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:52.474667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c963d5e-be35-4477-9108-72b7375c30c9 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:52.531331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32416bb-c5ac-453e-82d3-63adfd9f2623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:52.532152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32416bb-c5ac-453e-82d3-63adfd9f2623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.532439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32416bb-c5ac-453e-82d3-63adfd9f2623 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.532720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32416bb-c5ac-453e-82d3-63adfd9f2623 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.539572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32416bb-c5ac-453e-82d3-63adfd9f2623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:52.541515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32416bb-c5ac-453e-82d3-63adfd9f2623 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:52.554052 ncdv-master-1 devstack@keystone.service[97202]: WARNING keystone.server.flask.application [None req-d32416bb-c5ac-453e-82d3-63adfd9f2623 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Mar 26 21:27:52.555224 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4332/8627] 10.222.0.16 () {58 vars in 1148 bytes} [Sat Mar 26 21:27:52 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 26 21:27:52.562076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090df317-851e-447e-859c-3fb3d89ebd7d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.562374 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090df317-851e-447e-859c-3fb3d89ebd7d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.562662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090df317-851e-447e-859c-3fb3d89ebd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.581136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-090df317-851e-447e-859c-3fb3d89ebd7d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:52.582340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-090df317-851e-447e-859c-3fb3d89ebd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:52.590817 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4296/8628] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:52.598948 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d759b-5190-4d1c-b3ad-0b2067abf213 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.599235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d759b-5190-4d1c-b3ad-0b2067abf213 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.599511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d759b-5190-4d1c-b3ad-0b2067abf213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.617286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-be3d759b-5190-4d1c-b3ad-0b2067abf213 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:52.618494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-be3d759b-5190-4d1c-b3ad-0b2067abf213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:52.626289 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4333/8629] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:52.630308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090df317-851e-447e-859c-3fb3d89ebd7d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:52.640587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090df317-851e-447e-859c-3fb3d89ebd7d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:52.645143 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0f5a-f137-4db4-a202-005b4a420e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:52.645789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0f5a-f137-4db4-a202-005b4a420e1a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.646077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0f5a-f137-4db4-a202-005b4a420e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.646358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94f0f5a-f137-4db4-a202-005b4a420e1a admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.647078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f0f5a-f137-4db4-a202-005b4a420e1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:27:52.647419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f0f5a-f137-4db4-a202-005b4a420e1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:52.649060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94f0f5a-f137-4db4-a202-005b4a420e1a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:52.660952 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4297/8630] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:27:52.665452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d759b-5190-4d1c-b3ad-0b2067abf213 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:52.674572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d759b-5190-4d1c-b3ad-0b2067abf213 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:52.679110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb860b-ce35-45d6-a6ec-1d071155c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:52.679756 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb860b-ce35-45d6-a6ec-1d071155c8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.680041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb860b-ce35-45d6-a6ec-1d071155c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.680321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb860b-ce35-45d6-a6ec-1d071155c8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.681008 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb860b-ce35-45d6-a6ec-1d071155c8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:52.683023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb860b-ce35-45d6-a6ec-1d071155c8d4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:52.708010 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4334/8631] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:27:52 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:27:52.711877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0f5a-f137-4db4-a202-005b4a420e1a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:52.722462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94f0f5a-f137-4db4-a202-005b4a420e1a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:52.776453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d7a1e-d764-4eb4-9749-74bb7c4d675e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:52.777108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d7a1e-d764-4eb4-9749-74bb7c4d675e admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.777397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d7a1e-d764-4eb4-9749-74bb7c4d675e admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.777677 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d7a1e-d764-4eb4-9749-74bb7c4d675e admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.778365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d7a1e-d764-4eb4-9749-74bb7c4d675e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:52.780335 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d7a1e-d764-4eb4-9749-74bb7c4d675e admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:52.799051 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4298/8632] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:27:52 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:27:52.803069 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb860b-ce35-45d6-a6ec-1d071155c8d4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:52.813713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb860b-ce35-45d6-a6ec-1d071155c8d4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:52.818302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf3abb-5339-4992-8815-3afb0a90ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:52.818944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf3abb-5339-4992-8815-3afb0a90ac09 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.819226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf3abb-5339-4992-8815-3afb0a90ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.819503 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf3abb-5339-4992-8815-3afb0a90ac09 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.820583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf3abb-5339-4992-8815-3afb0a90ac09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:52.822187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf3abb-5339-4992-8815-3afb0a90ac09 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:52.834550 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4335/8633] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:27:52.838844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d7a1e-d764-4eb4-9749-74bb7c4d675e admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:52.848688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d7a1e-d764-4eb4-9749-74bb7c4d675e admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:52.853302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7617be7-5168-4838-a3b6-078089a98da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:52.853943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7617be7-5168-4838-a3b6-078089a98da5 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.854223 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7617be7-5168-4838-a3b6-078089a98da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.854499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7617be7-5168-4838-a3b6-078089a98da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.855207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7617be7-5168-4838-a3b6-078089a98da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:52.856848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7617be7-5168-4838-a3b6-078089a98da5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:52.866375 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4299/8634] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:27:52.870794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf3abb-5339-4992-8815-3afb0a90ac09 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:52.880502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf3abb-5339-4992-8815-3afb0a90ac09 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:52.885836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1422-e563-42f3-add6-9415237f7379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:52.886904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1422-e563-42f3-add6-9415237f7379 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.887582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1422-e563-42f3-add6-9415237f7379 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.887722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f1422-e563-42f3-add6-9415237f7379 admin admin] PATH_INFO: `/v3/projects/d7d600597d044d62bfa72df67a61c0bb/users/d2954748f375411b87550803a8b2d3ad/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.902267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f1422-e563-42f3-add6-9415237f7379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d600597d044d62bfa72df67a61c0bb, user_id=d2954748f375411b87550803a8b2d3ad, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:52.904973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f1422-e563-42f3-add6-9415237f7379 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:52.917668 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4336/8635] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:27:52 2022] PUT /identity/v3/projects/d7d600597d044d62bfa72df67a61c0bb/users/d2954748f375411b87550803a8b2d3ad/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:52.922638 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb5ec1-f06e-404e-ad5f-84d984adc2c6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:52.922943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb5ec1-f06e-404e-ad5f-84d984adc2c6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:52.923253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb5ec1-f06e-404e-ad5f-84d984adc2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:52.941094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d2bb5ec1-f06e-404e-ad5f-84d984adc2c6 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:52.942251 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d2bb5ec1-f06e-404e-ad5f-84d984adc2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:52.998089 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4300/8636] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:53.007428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1422-e563-42f3-add6-9415237f7379 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:53.009240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a28f1422-e563-42f3-add6-9415237f7379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:53.067373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f1422-e563-42f3-add6-9415237f7379 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:53.071007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c26c4-464a-4d47-8dce-c170f073bc20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:53.071643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c26c4-464a-4d47-8dce-c170f073bc20 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:53.071985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c26c4-464a-4d47-8dce-c170f073bc20 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:53.072903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c26c4-464a-4d47-8dce-c170f073bc20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:53.081810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c26c4-464a-4d47-8dce-c170f073bc20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:53.083254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c26c4-464a-4d47-8dce-c170f073bc20 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:53.092620 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4337/8637] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:27:57.112071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2057270-2df0-44e0-aed3-34388dda693e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:57.112607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2057270-2df0-44e0-aed3-34388dda693e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:57.112769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2057270-2df0-44e0-aed3-34388dda693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:57.144106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f2057270-2df0-44e0-aed3-34388dda693e None None] MFA Rules not processed for user `d2954748f375411b87550803a8b2d3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:27:57.145605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f2057270-2df0-44e0-aed3-34388dda693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:27:57.217701 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4301/8638] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:27:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:27:57.218594 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c26c4-464a-4d47-8dce-c170f073bc20 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:57.230111 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c26c4-464a-4d47-8dce-c170f073bc20 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:57.234885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34752b28-3385-4a8b-8d9b-e6f1e5dde2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:57.235672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752b28-3385-4a8b-8d9b-e6f1e5dde2dc admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:57.236131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752b28-3385-4a8b-8d9b-e6f1e5dde2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:57.236417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34752b28-3385-4a8b-8d9b-e6f1e5dde2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:57.237130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34752b28-3385-4a8b-8d9b-e6f1e5dde2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:57.239078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34752b28-3385-4a8b-8d9b-e6f1e5dde2dc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:57.272866 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4338/8639] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:27:57 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:27:57.274145 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2057270-2df0-44e0-aed3-34388dda693e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:57.285646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2057270-2df0-44e0-aed3-34388dda693e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:57.348138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e5559-5496-42b2-a8cc-0c20b0c70417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:57.348935 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e5559-5496-42b2-a8cc-0c20b0c70417 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:57.349218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e5559-5496-42b2-a8cc-0c20b0c70417 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:57.349497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e5559-5496-42b2-a8cc-0c20b0c70417 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:57.350297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e5559-5496-42b2-a8cc-0c20b0c70417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:57.352432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e5559-5496-42b2-a8cc-0c20b0c70417 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:57.380233 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4302/8640] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:27:57 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:27:57.381571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34752b28-3385-4a8b-8d9b-e6f1e5dde2dc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:57.394792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34752b28-3385-4a8b-8d9b-e6f1e5dde2dc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:57.399767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce353223-d05c-4da5-94c3-c045044dcf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:57.400518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce353223-d05c-4da5-94c3-c045044dcf16 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:57.400850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce353223-d05c-4da5-94c3-c045044dcf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:57.401133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce353223-d05c-4da5-94c3-c045044dcf16 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:57.401875 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce353223-d05c-4da5-94c3-c045044dcf16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:57.403539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce353223-d05c-4da5-94c3-c045044dcf16 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:57.414872 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4339/8641] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:27:57.419236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e5559-5496-42b2-a8cc-0c20b0c70417 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:57.430473 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e5559-5496-42b2-a8cc-0c20b0c70417 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:57.436030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04354-ad47-4c4f-a195-656e0befb773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:57.437019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04354-ad47-4c4f-a195-656e0befb773 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:57.437304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04354-ad47-4c4f-a195-656e0befb773 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:57.437658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d04354-ad47-4c4f-a195-656e0befb773 admin admin] PATH_INFO: `/v3/projects/55b8ed5509de47159f3b0000151c6286/users/fa1a2116b37948b8af7d0b1c9eafd317/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:57.455142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d04354-ad47-4c4f-a195-656e0befb773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b8ed5509de47159f3b0000151c6286, user_id=fa1a2116b37948b8af7d0b1c9eafd317, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:57.457827 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d04354-ad47-4c4f-a195-656e0befb773 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:57.471585 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4303/8642] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:27:57 2022] PUT /identity/v3/projects/55b8ed5509de47159f3b0000151c6286/users/fa1a2116b37948b8af7d0b1c9eafd317/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:27:57.475697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce353223-d05c-4da5-94c3-c045044dcf16 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:57.486387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce353223-d05c-4da5-94c3-c045044dcf16 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:57.546250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1297c7-8558-4db1-93c3-80261c3542c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:57.546922 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1297c7-8558-4db1-93c3-80261c3542c9 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:57.547207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1297c7-8558-4db1-93c3-80261c3542c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:57.547481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1297c7-8558-4db1-93c3-80261c3542c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:57.548290 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1297c7-8558-4db1-93c3-80261c3542c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:57.549918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1297c7-8558-4db1-93c3-80261c3542c9 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:57.562096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4340/8643] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:27:57.566446 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04354-ad47-4c4f-a195-656e0befb773 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:27:57.577490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d04354-ad47-4c4f-a195-656e0befb773 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:27:57.582245 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf0506-61ea-47b5-9d14-572bea00eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:27:57.583127 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf0506-61ea-47b5-9d14-572bea00eea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:27:57.583410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf0506-61ea-47b5-9d14-572bea00eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:27:57.583686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf0506-61ea-47b5-9d14-572bea00eea1 admin admin] PATH_INFO: `/v3/projects/55b8ed5509de47159f3b0000151c6286/users/fa1a2116b37948b8af7d0b1c9eafd317/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:27:57.585689 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf0506-61ea-47b5-9d14-572bea00eea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b8ed5509de47159f3b0000151c6286, user_id=fa1a2116b37948b8af7d0b1c9eafd317, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:27:57.589021 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf0506-61ea-47b5-9d14-572bea00eea1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:27:57.599870 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4304/8644] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:27:57 2022] PUT /identity/v3/projects/55b8ed5509de47159f3b0000151c6286/users/fa1a2116b37948b8af7d0b1c9eafd317/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:28:02.615776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43900ae-fd76-432e-8737-25cd47520c09 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:28:02.616439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43900ae-fd76-432e-8737-25cd47520c09 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:28:02.616439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43900ae-fd76-432e-8737-25cd47520c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:28:02.650307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e43900ae-fd76-432e-8737-25cd47520c09 None None] MFA Rules not processed for user `fa1a2116b37948b8af7d0b1c9eafd317`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:28:02.652473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e43900ae-fd76-432e-8737-25cd47520c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:28:02.745601 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4341/8645] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:28:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:28:02.761564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf0506-61ea-47b5-9d14-572bea00eea1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:28:02.764137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-30cf0506-61ea-47b5-9d14-572bea00eea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:28:02.860162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf0506-61ea-47b5-9d14-572bea00eea1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:28:02.866968 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a657d-9b8d-4a20-b458-879fa7680a88 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:28:02.867664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a657d-9b8d-4a20-b458-879fa7680a88 service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:28:02.868629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a657d-9b8d-4a20-b458-879fa7680a88 service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:28:02.868925 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a657d-9b8d-4a20-b458-879fa7680a88 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:28:02.941580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a657d-9b8d-4a20-b458-879fa7680a88 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:28:02.943052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a657d-9b8d-4a20-b458-879fa7680a88 service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:28:02.953269 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4305/8646] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:28:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:28:19.804684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf838d-f410-4ef9-89a6-7b925c0d1b35 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:28:19.805257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf838d-f410-4ef9-89a6-7b925c0d1b35 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:28:19.805257 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf838d-f410-4ef9-89a6-7b925c0d1b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:28:19.823697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-38bf838d-f410-4ef9-89a6-7b925c0d1b35 None None] MFA Rules not processed for user `d2954748f375411b87550803a8b2d3ad`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:28:19.824981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-38bf838d-f410-4ef9-89a6-7b925c0d1b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:28:19.833196 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4342/8647] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:28:32.668916 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a657d-9b8d-4a20-b458-879fa7680a88 service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:28:32.670665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-314a657d-9b8d-4a20-b458-879fa7680a88 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:28:32.739715 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a657d-9b8d-4a20-b458-879fa7680a88 service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:28:32.744272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a01f-fae3-487a-b375-2cbd3db1fcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:28:32.745244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a01f-fae3-487a-b375-2cbd3db1fcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:28:32.745564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a01f-fae3-487a-b375-2cbd3db1fcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:28:32.745847 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06a01f-fae3-487a-b375-2cbd3db1fcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:28:32.758499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a01f-fae3-487a-b375-2cbd3db1fcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:28:32.760203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06a01f-fae3-487a-b375-2cbd3db1fcd6 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:28:32.769687 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4306/8648] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:28:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:29:31.137898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf838d-f410-4ef9-89a6-7b925c0d1b35 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:29:31.200137 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf838d-f410-4ef9-89a6-7b925c0d1b35 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:29:31.204723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:29:31.205618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:29:31.205901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:29:31.206179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] PATH_INFO: `/v3/users/d2954748f375411b87550803a8b2d3ad` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:29:31.207414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2954748f375411b87550803a8b2d3ad)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:29:31.209387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:29:31.253950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2954748f375411b87550803a8b2d3ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.260454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2954748f375411b87550803a8b2d3ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.261104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2954748f375411b87550803a8b2d3ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.261705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2954748f375411b87550803a8b2d3ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.268625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2954748f375411b87550803a8b2d3ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.285428 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4343/8649] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:29:31 2022] DELETE /identity/v3/users/d2954748f375411b87550803a8b2d3ad => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:29:31.759930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a01f-fae3-487a-b375-2cbd3db1fcd6 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:29:31.771479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06a01f-fae3-487a-b375-2cbd3db1fcd6 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:29:31.826712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:29:31.828211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:29:31.828496 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:29:31.828771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] PATH_INFO: `/v3/projects/d7d600597d044d62bfa72df67a61c0bb` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:29:31.829966 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d600597d044d62bfa72df67a61c0bb)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:29:31.831892 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:29:31.878852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d600597d044d62bfa72df67a61c0bb', 'request_id': 'req-b826d06e-b00d-4495-b714-dff1ee06fc45'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.885191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d600597d044d62bfa72df67a61c0bb', 'request_id': 'req-b826d06e-b00d-4495-b714-dff1ee06fc45'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.891076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d600597d044d62bfa72df67a61c0bb', 'request_id': 'req-b826d06e-b00d-4495-b714-dff1ee06fc45'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.901808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] The token cache is being invalidate because project d7d600597d044d62bfa72df67a61c0bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:29:31.902100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.902743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:31.904327 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4307/8650] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:29:31 2022] DELETE /identity/v3/projects/d7d600597d044d62bfa72df67a61c0bb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:29:31.908590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:29:31.909994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:29:31.923561 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b960f7-e97a-448f-a3f7-9269d5b0fa25 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:29:31.976828 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:29:31.977617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:29:31.977903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:29:31.978184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] PATH_INFO: `/v3/users/fa1a2116b37948b8af7d0b1c9eafd317` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:29:31.979378 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa1a2116b37948b8af7d0b1c9eafd317)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:29:31.981345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:29:32.026214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa1a2116b37948b8af7d0b1c9eafd317'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.033401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa1a2116b37948b8af7d0b1c9eafd317'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.034092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa1a2116b37948b8af7d0b1c9eafd317'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.034724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa1a2116b37948b8af7d0b1c9eafd317'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.042951 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa1a2116b37948b8af7d0b1c9eafd317'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.061897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4344/8651] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:29:31 2022] DELETE /identity/v3/users/fa1a2116b37948b8af7d0b1c9eafd317 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:29:32.231181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:29:32.232817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:29:32.251218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826d06e-b00d-4495-b714-dff1ee06fc45 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:29:32.305807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:29:32.306666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:29:32.306950 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:29:32.307226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] PATH_INFO: `/v3/projects/55b8ed5509de47159f3b0000151c6286` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:29:32.308512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b8ed5509de47159f3b0000151c6286)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:29:32.310429 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:29:32.354420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b8ed5509de47159f3b0000151c6286', 'request_id': 'req-3442566c-24e2-4e6b-a8f5-896ea7ddf885'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.362477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b8ed5509de47159f3b0000151c6286', 'request_id': 'req-3442566c-24e2-4e6b-a8f5-896ea7ddf885'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.368379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b8ed5509de47159f3b0000151c6286', 'request_id': 'req-3442566c-24e2-4e6b-a8f5-896ea7ddf885'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.380562 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] The token cache is being invalidate because project 55b8ed5509de47159f3b0000151c6286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:29:32.380862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.381520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:32.383047 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4308/8652] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:29:32 2022] DELETE /identity/v3/projects/55b8ed5509de47159f3b0000151c6286 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:29:46.370151 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:29:46.371535 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:29:46.432590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40d214-63ab-4413-b61a-a880c59515f8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:29:46.478608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0f81e-77c3-4c2a-8d5b-f67e9feed1ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:29:46.479249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0f81e-77c3-4c2a-8d5b-f67e9feed1ba service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:29:46.479530 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0f81e-77c3-4c2a-8d5b-f67e9feed1ba service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:29:46.479805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0f81e-77c3-4c2a-8d5b-f67e9feed1ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:29:46.481592 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-aec0f81e-77c3-4c2a-8d5b-f67e9feed1ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:29:46.540502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0f81e-77c3-4c2a-8d5b-f67e9feed1ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:29:46.541990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0f81e-77c3-4c2a-8d5b-f67e9feed1ba service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:29:46.552110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4345/8653] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:29:53.145262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:29:53.147421 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:29:53.160520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442566c-24e2-4e6b-a8f5-896ea7ddf885 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:29:53.165084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:29:53.166004 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:29:53.166237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:29:53.166516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] PATH_INFO: `/v3/users/39d6d477fac5463a944d918490b7117f` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:29:53.167970 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39d6d477fac5463a944d918490b7117f)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:29:53.169918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:29:53.214165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39d6d477fac5463a944d918490b7117f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.220382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39d6d477fac5463a944d918490b7117f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.221095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39d6d477fac5463a944d918490b7117f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.221709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39d6d477fac5463a944d918490b7117f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.232993 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39d6d477fac5463a944d918490b7117f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.245237 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4309/8654] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:29:53 2022] DELETE /identity/v3/users/39d6d477fac5463a944d918490b7117f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:29:53.416598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0f81e-77c3-4c2a-8d5b-f67e9feed1ba service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:29:53.427362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0f81e-77c3-4c2a-8d5b-f67e9feed1ba service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:29:53.483515 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:29:53.484401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:29:53.484685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:29:53.484963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] PATH_INFO: `/v3/projects/c621f87120ad402a9d52cf6426f0cf1f` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:29:53.486155 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c621f87120ad402a9d52cf6426f0cf1f)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:29:53.488121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:29:53.532750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c621f87120ad402a9d52cf6426f0cf1f', 'request_id': 'req-898054f0-8bbf-4d51-a959-83dfcc24f58a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.539233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c621f87120ad402a9d52cf6426f0cf1f', 'request_id': 'req-898054f0-8bbf-4d51-a959-83dfcc24f58a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.544705 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c621f87120ad402a9d52cf6426f0cf1f', 'request_id': 'req-898054f0-8bbf-4d51-a959-83dfcc24f58a'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.555279 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] The token cache is being invalidate because project c621f87120ad402a9d52cf6426f0cf1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:29:53.555560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.556235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.557801 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4346/8655] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:29:53 2022] DELETE /identity/v3/projects/c621f87120ad402a9d52cf6426f0cf1f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:29:53.561850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:29:53.563319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:29:53.577218 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a60b8-d75f-4e0e-8743-3bd029362043 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:29:53.630676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:29:53.631541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:29:53.631823 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:29:53.632131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] PATH_INFO: `/v3/users/dcd78f4c7fe94a3c9a3f03bf97a6d2b0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:29:53.633318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd78f4c7fe94a3c9a3f03bf97a6d2b0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:29:53.635236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:29:53.677842 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd78f4c7fe94a3c9a3f03bf97a6d2b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.684678 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd78f4c7fe94a3c9a3f03bf97a6d2b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.685322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd78f4c7fe94a3c9a3f03bf97a6d2b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.685939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd78f4c7fe94a3c9a3f03bf97a6d2b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.698341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-4aa25589-edf8-4f8b-9e40-bb14bb2373d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd78f4c7fe94a3c9a3f03bf97a6d2b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:53.710739 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4310/8656] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:29:53 2022] DELETE /identity/v3/users/dcd78f4c7fe94a3c9a3f03bf97a6d2b0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:29:53.882081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:29:53.883502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:29:53.897256 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898054f0-8bbf-4d51-a959-83dfcc24f58a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:29:53.952235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:29:53.953014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:29:53.953294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:29:53.953565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] PATH_INFO: `/v3/projects/a9ce77f15c4746c78bcdb24051ff3833` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:29:53.954764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ce77f15c4746c78bcdb24051ff3833)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:29:53.956714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:29:54.002784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ce77f15c4746c78bcdb24051ff3833', 'request_id': 'req-66b754fc-c993-4e13-8b9f-416bbe717504'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:54.011123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ce77f15c4746c78bcdb24051ff3833', 'request_id': 'req-66b754fc-c993-4e13-8b9f-416bbe717504'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:54.016461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ce77f15c4746c78bcdb24051ff3833', 'request_id': 'req-66b754fc-c993-4e13-8b9f-416bbe717504'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:54.027570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] The token cache is being invalidate because project a9ce77f15c4746c78bcdb24051ff3833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:29:54.027857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:54.028526 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-66b754fc-c993-4e13-8b9f-416bbe717504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:29:54.030071 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4347/8657] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:29:53 2022] DELETE /identity/v3/projects/a9ce77f15c4746c78bcdb24051ff3833 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:30:03.688144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe934-5617-49d5-822f-c592ce13079d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:03.688695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe934-5617-49d5-822f-c592ce13079d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:03.688695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe934-5617-49d5-822f-c592ce13079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:03.707180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9edfe934-5617-49d5-822f-c592ce13079d None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:03.708435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9edfe934-5617-49d5-822f-c592ce13079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:03.763911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4311/8658] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:03.775083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f563e1d-c52d-4a48-9605-2a21c9ceb04c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:03.775573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f563e1d-c52d-4a48-9605-2a21c9ceb04c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:03.775670 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f563e1d-c52d-4a48-9605-2a21c9ceb04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:03.794228 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4f563e1d-c52d-4a48-9605-2a21c9ceb04c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:03.795410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4f563e1d-c52d-4a48-9605-2a21c9ceb04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:03.803203 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4348/8659] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:03.807940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfe934-5617-49d5-822f-c592ce13079d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:03.817419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfe934-5617-49d5-822f-c592ce13079d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:03.821958 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2172f6f-7a25-4f7f-b8aa-f20962f121b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:03.822595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2172f6f-7a25-4f7f-b8aa-f20962f121b1 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:03.822881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2172f6f-7a25-4f7f-b8aa-f20962f121b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:03.823160 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2172f6f-7a25-4f7f-b8aa-f20962f121b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:03.823871 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2172f6f-7a25-4f7f-b8aa-f20962f121b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:30:03.824213 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2172f6f-7a25-4f7f-b8aa-f20962f121b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:03.825834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2172f6f-7a25-4f7f-b8aa-f20962f121b1 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:03.837578 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4312/8660] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:30:03.846543 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f563e1d-c52d-4a48-9605-2a21c9ceb04c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:03.855510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f563e1d-c52d-4a48-9605-2a21c9ceb04c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:03.860067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7f6d1-fa2b-4c65-b83a-7863e133392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:03.860693 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7f6d1-fa2b-4c65-b83a-7863e133392b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:03.860975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7f6d1-fa2b-4c65-b83a-7863e133392b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:03.861246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da7f6d1-fa2b-4c65-b83a-7863e133392b admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:03.861918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7f6d1-fa2b-4c65-b83a-7863e133392b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:03.863964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da7f6d1-fa2b-4c65-b83a-7863e133392b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:03.891167 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4349/8661] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:30:03 2022] POST /identity/v3/projects => generated 391 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:30:03.892890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2172f6f-7a25-4f7f-b8aa-f20962f121b1 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:03.902888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2172f6f-7a25-4f7f-b8aa-f20962f121b1 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:03.959282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5deded-cb6c-4fef-b890-5db9ee6a4150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:03.959870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5deded-cb6c-4fef-b890-5db9ee6a4150 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:03.960187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5deded-cb6c-4fef-b890-5db9ee6a4150 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:03.960467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5deded-cb6c-4fef-b890-5db9ee6a4150 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:03.961152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5deded-cb6c-4fef-b890-5db9ee6a4150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:03.963087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5deded-cb6c-4fef-b890-5db9ee6a4150 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:03.984412 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4313/8662] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:30:03 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:30:03.985981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7f6d1-fa2b-4c65-b83a-7863e133392b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:03.996330 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da7f6d1-fa2b-4c65-b83a-7863e133392b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.001349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c58e8-9866-4ce2-9498-ca0be49c8650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.002506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c58e8-9866-4ce2-9498-ca0be49c8650 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.002784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c58e8-9866-4ce2-9498-ca0be49c8650 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.003053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c58e8-9866-4ce2-9498-ca0be49c8650 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.003802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c58e8-9866-4ce2-9498-ca0be49c8650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.005458 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c58e8-9866-4ce2-9498-ca0be49c8650 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.016040 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4350/8663] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:30:04.020917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5deded-cb6c-4fef-b890-5db9ee6a4150 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.030662 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5deded-cb6c-4fef-b890-5db9ee6a4150 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.035212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095bfbc-17ee-4fae-a37d-aadf68669b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.035859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bfbc-17ee-4fae-a37d-aadf68669b05 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.036176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bfbc-17ee-4fae-a37d-aadf68669b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.036453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095bfbc-17ee-4fae-a37d-aadf68669b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.037184 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095bfbc-17ee-4fae-a37d-aadf68669b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.038781 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095bfbc-17ee-4fae-a37d-aadf68669b05 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.048607 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4314/8664] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:30:04.052629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c58e8-9866-4ce2-9498-ca0be49c8650 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.064077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c58e8-9866-4ce2-9498-ca0be49c8650 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.069590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419ca91-e8c5-46c9-a4a0-b2a72b314257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.070490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ca91-e8c5-46c9-a4a0-b2a72b314257 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.070799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ca91-e8c5-46c9-a4a0-b2a72b314257 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.071051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419ca91-e8c5-46c9-a4a0-b2a72b314257 admin admin] PATH_INFO: `/v3/projects/9c448b2663f745ba974a354ab3cdcdd1/users/f126505ca3764003887a54c270b442fd/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.087433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419ca91-e8c5-46c9-a4a0-b2a72b314257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c448b2663f745ba974a354ab3cdcdd1, user_id=f126505ca3764003887a54c270b442fd, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.090723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419ca91-e8c5-46c9-a4a0-b2a72b314257 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.104398 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4351/8665] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:30:04 2022] PUT /identity/v3/projects/9c448b2663f745ba974a354ab3cdcdd1/users/f126505ca3764003887a54c270b442fd/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:30:04.117818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee931c56-304b-4da8-a12a-6e8e3990768e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.118105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee931c56-304b-4da8-a12a-6e8e3990768e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.118507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee931c56-304b-4da8-a12a-6e8e3990768e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.153774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ee931c56-304b-4da8-a12a-6e8e3990768e None None] MFA Rules not processed for user `f126505ca3764003887a54c270b442fd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:04.155302 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ee931c56-304b-4da8-a12a-6e8e3990768e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:04.216792 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4315/8666] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:04.221218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419ca91-e8c5-46c9-a4a0-b2a72b314257 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.280752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419ca91-e8c5-46c9-a4a0-b2a72b314257 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.285373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaadef-8de3-4db9-8f85-4b56fb87b0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.286015 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaadef-8de3-4db9-8f85-4b56fb87b0cc admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.286301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaadef-8de3-4db9-8f85-4b56fb87b0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.286603 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaaadef-8de3-4db9-8f85-4b56fb87b0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.287271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaadef-8de3-4db9-8f85-4b56fb87b0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.289240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaaadef-8de3-4db9-8f85-4b56fb87b0cc admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.316498 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4352/8667] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:30:04 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:30:04.318516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee931c56-304b-4da8-a12a-6e8e3990768e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.329053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee931c56-304b-4da8-a12a-6e8e3990768e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.387384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28003c-a7e7-4978-b7de-83751216f6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.388086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28003c-a7e7-4978-b7de-83751216f6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.388375 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28003c-a7e7-4978-b7de-83751216f6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.388655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28003c-a7e7-4978-b7de-83751216f6f0 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.389332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28003c-a7e7-4978-b7de-83751216f6f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.391267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28003c-a7e7-4978-b7de-83751216f6f0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.409896 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4316/8668] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:30:04 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:30:04.414130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaadef-8de3-4db9-8f85-4b56fb87b0cc admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.424995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaaadef-8de3-4db9-8f85-4b56fb87b0cc admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.429539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c229-3561-4f23-947b-7f6be23d7b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.430180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c229-3561-4f23-947b-7f6be23d7b0f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.430469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c229-3561-4f23-947b-7f6be23d7b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.430746 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40c229-3561-4f23-947b-7f6be23d7b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.431460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40c229-3561-4f23-947b-7f6be23d7b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.433096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc40c229-3561-4f23-947b-7f6be23d7b0f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.443986 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4353/8669] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:30:04.447989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28003c-a7e7-4978-b7de-83751216f6f0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.457828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28003c-a7e7-4978-b7de-83751216f6f0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.462397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36406098-73d4-4546-b4c7-1aafa74a2316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.463266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36406098-73d4-4546-b4c7-1aafa74a2316 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.463553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36406098-73d4-4546-b4c7-1aafa74a2316 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.463826 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36406098-73d4-4546-b4c7-1aafa74a2316 admin admin] PATH_INFO: `/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469/users/02360e9ad5ae48619072c872ec8c1c66/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.477976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36406098-73d4-4546-b4c7-1aafa74a2316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbc5d70cf564fecbde7aeeaf1d58469, user_id=02360e9ad5ae48619072c872ec8c1c66, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.480626 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36406098-73d4-4546-b4c7-1aafa74a2316 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.493687 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4317/8670] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:30:04 2022] PUT /identity/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469/users/02360e9ad5ae48619072c872ec8c1c66/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:30:04.497842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c229-3561-4f23-947b-7f6be23d7b0f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.508324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40c229-3561-4f23-947b-7f6be23d7b0f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.562666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691a571-8e44-4289-bf5c-67b60977bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.563315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a571-8e44-4289-bf5c-67b60977bce4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.563596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a571-8e44-4289-bf5c-67b60977bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.563871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691a571-8e44-4289-bf5c-67b60977bce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.565192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a571-8e44-4289-bf5c-67b60977bce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.566788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691a571-8e44-4289-bf5c-67b60977bce4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.576112 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4354/8671] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:30:04.580320 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36406098-73d4-4546-b4c7-1aafa74a2316 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.590442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36406098-73d4-4546-b4c7-1aafa74a2316 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.595011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d8782-3b3d-49c0-89f5-e674edfa9a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.595946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d8782-3b3d-49c0-89f5-e674edfa9a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.596246 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d8782-3b3d-49c0-89f5-e674edfa9a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.596519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d8782-3b3d-49c0-89f5-e674edfa9a45 admin admin] PATH_INFO: `/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469/users/02360e9ad5ae48619072c872ec8c1c66/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.598471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d8782-3b3d-49c0-89f5-e674edfa9a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbc5d70cf564fecbde7aeeaf1d58469, user_id=02360e9ad5ae48619072c872ec8c1c66, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.601131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d8782-3b3d-49c0-89f5-e674edfa9a45 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.610863 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4318/8672] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:30:04 2022] PUT /identity/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469/users/02360e9ad5ae48619072c872ec8c1c66/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:30:04.621340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf6834-77c6-401b-8ea1-f117f9cda424 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.621626 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf6834-77c6-401b-8ea1-f117f9cda424 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.621903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf6834-77c6-401b-8ea1-f117f9cda424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.647492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-32cf6834-77c6-401b-8ea1-f117f9cda424 None None] MFA Rules not processed for user `02360e9ad5ae48619072c872ec8c1c66`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:04.648719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-32cf6834-77c6-401b-8ea1-f117f9cda424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:04.714203 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4355/8673] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:04.727687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e65d3c-322b-475e-9908-ab8f19e628bb None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.728279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e65d3c-322b-475e-9908-ab8f19e628bb None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.728279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e65d3c-322b-475e-9908-ab8f19e628bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.746360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e4e65d3c-322b-475e-9908-ab8f19e628bb None None] MFA Rules not processed for user `f126505ca3764003887a54c270b442fd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:04.747556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e4e65d3c-322b-475e-9908-ab8f19e628bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:04.800853 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4319/8674] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:30:04.811985 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf6834-77c6-401b-8ea1-f117f9cda424 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.813393 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-32cf6834-77c6-401b-8ea1-f117f9cda424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:04.886017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf6834-77c6-401b-8ea1-f117f9cda424 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:04.891795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b04930-951d-4f50-a154-8b3bac0aacf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:04.892524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b04930-951d-4f50-a154-8b3bac0aacf8 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:04.892814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b04930-951d-4f50-a154-8b3bac0aacf8 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:04.893097 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b04930-951d-4f50-a154-8b3bac0aacf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:04.900904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b04930-951d-4f50-a154-8b3bac0aacf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:04.902704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b04930-951d-4f50-a154-8b3bac0aacf8 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:04.912300 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4356/8675] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:04.942114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e65d3c-322b-475e-9908-ab8f19e628bb None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:04.943467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e4e65d3c-322b-475e-9908-ab8f19e628bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:05.000769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e65d3c-322b-475e-9908-ab8f19e628bb None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:05.004365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e935-ad80-403c-a357-866a6345566a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:05.005005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e935-ad80-403c-a357-866a6345566a service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:05.005293 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e935-ad80-403c-a357-866a6345566a service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:05.005577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8e935-ad80-403c-a357-866a6345566a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:05.007358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-52a8e935-ad80-403c-a357-866a6345566a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:05.023821 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e935-ad80-403c-a357-866a6345566a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:05.025249 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8e935-ad80-403c-a357-866a6345566a service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:05.039152 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4320/8676] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:05.474993 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b04930-951d-4f50-a154-8b3bac0aacf8 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:05.476474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d8b04930-951d-4f50-a154-8b3bac0aacf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:05.534803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b04930-951d-4f50-a154-8b3bac0aacf8 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:05.538420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c60feb-029f-471b-be18-6a10203ce79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:05.539059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c60feb-029f-471b-be18-6a10203ce79e service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:05.539346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c60feb-029f-471b-be18-6a10203ce79e service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:05.539622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c60feb-029f-471b-be18-6a10203ce79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:05.541406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f5c60feb-029f-471b-be18-6a10203ce79e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:05.557597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c60feb-029f-471b-be18-6a10203ce79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:05.559178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c60feb-029f-471b-be18-6a10203ce79e service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:05.574169 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4357/8677] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:16.359174 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e935-ad80-403c-a357-866a6345566a service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:16.373264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8e935-ad80-403c-a357-866a6345566a service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:16.379428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da379cd-307c-4e05-821f-1122d3b4e304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:16.380082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da379cd-307c-4e05-821f-1122d3b4e304 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:16.380370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da379cd-307c-4e05-821f-1122d3b4e304 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:16.380648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da379cd-307c-4e05-821f-1122d3b4e304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:16.388681 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da379cd-307c-4e05-821f-1122d3b4e304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:16.390279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da379cd-307c-4e05-821f-1122d3b4e304 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:16.399549 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4321/8678] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:30:16.413051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0572676-1198-475b-affd-95643d04f4eb None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:16.413516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0572676-1198-475b-affd-95643d04f4eb None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:16.413624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0572676-1198-475b-affd-95643d04f4eb None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:16.415779 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4358/8679] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 21:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:30:16.420663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da379cd-307c-4e05-821f-1122d3b4e304 service nova] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 21:30:16.434408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da379cd-307c-4e05-821f-1122d3b4e304 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:16.443027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da379cd-307c-4e05-821f-1122d3b4e304 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:16.447683 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02360e9ad5ae48619072c872ec8c1c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcbc5d70cf564fecbde7aeeaf1d58469', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:16.448457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:16.448738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:16.449011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] PATH_INFO: `/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:16.450187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] RBAC: Authorizing `identity:get_project(project_id=fcbc5d70cf564fecbde7aeeaf1d58469)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:16.452027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:16.453688 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4322/8680] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 21:30:16 2022] GET /identity/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469 => generated 393 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:30:16.734036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc22919-68e6-4881-b9bb-2b22fa0f71c8 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:16.734319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc22919-68e6-4881-b9bb-2b22fa0f71c8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:16.734595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc22919-68e6-4881-b9bb-2b22fa0f71c8 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:16.737119 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4359/8681] 10.222.0.16 () {54 vars in 912 bytes} [Sat Mar 26 21:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:30:16.741479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Authenticating service token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Mar 26 21:30:16.743191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:16.761686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:16.770104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc32d0-5943-456a-b172-fec40b405c31 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:16.774628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc403b-c1e1-41ff-a77d-3f4be143c7a8 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02360e9ad5ae48619072c872ec8c1c66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fcbc5d70cf564fecbde7aeeaf1d58469', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:16.775466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc403b-c1e1-41ff-a77d-3f4be143c7a8 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:16.775753 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc403b-c1e1-41ff-a77d-3f4be143c7a8 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:16.776070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc403b-c1e1-41ff-a77d-3f4be143c7a8 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] PATH_INFO: `/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:16.777253 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc403b-c1e1-41ff-a77d-3f4be143c7a8 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] RBAC: Authorizing `identity:get_project(project_id=fcbc5d70cf564fecbde7aeeaf1d58469)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:16.779041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc403b-c1e1-41ff-a77d-3f4be143c7a8 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:16.780731 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4323/8682] 10.222.0.16 () {58 vars in 1443 bytes} [Sat Mar 26 21:30:16 2022] GET /identity/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469 => generated 393 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:30:16.923246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc22919-68e6-4881-b9bb-2b22fa0f71c8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:16.937565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc22919-68e6-4881-b9bb-2b22fa0f71c8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:16.941271 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb37933-3d9d-4653-a88c-f6e6c07134a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:16.941909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb37933-3d9d-4653-a88c-f6e6c07134a6 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:16.942194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb37933-3d9d-4653-a88c-f6e6c07134a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:16.942496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb37933-3d9d-4653-a88c-f6e6c07134a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:16.944278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ecb37933-3d9d-4653-a88c-f6e6c07134a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:16.956060 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb37933-3d9d-4653-a88c-f6e6c07134a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:16.957492 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb37933-3d9d-4653-a88c-f6e6c07134a6 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:16.967522 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4360/8683] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:20.694286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc403b-c1e1-41ff-a77d-3f4be143c7a8 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:20.754761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc403b-c1e1-41ff-a77d-3f4be143c7a8 tempest-ServersAdminNegativeTestJSON-1180006812 tempest-ServersAdminNegativeTestJSON-1180006812-project-admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:20.759233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:20.760128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:20.760413 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:20.760691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] PATH_INFO: `/v3/users/f126505ca3764003887a54c270b442fd` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:20.761861 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f126505ca3764003887a54c270b442fd)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:20.763791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:20.808086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f126505ca3764003887a54c270b442fd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:20.816017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f126505ca3764003887a54c270b442fd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:20.816661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f126505ca3764003887a54c270b442fd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:20.817266 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f126505ca3764003887a54c270b442fd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:20.828644 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f126505ca3764003887a54c270b442fd'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:20.840635 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4324/8684] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:30:20 2022] DELETE /identity/v3/users/f126505ca3764003887a54c270b442fd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:30:20.845128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7a7cf-be47-4598-92ac-78a557905182 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:20.845650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7a7cf-be47-4598-92ac-78a557905182 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:20.845753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7a7cf-be47-4598-92ac-78a557905182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:20.863390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6ac7a7cf-be47-4598-92ac-78a557905182 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:20.864627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6ac7a7cf-be47-4598-92ac-78a557905182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:20.920007 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4361/8685] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:20.930516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:20.932037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:20.989268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1df74-ccee-4285-ab61-c5caf160f696 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:20.992869 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01edbb-4c7c-49de-9133-440f5786ab47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:20.993500 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01edbb-4c7c-49de-9133-440f5786ab47 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:20.993782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01edbb-4c7c-49de-9133-440f5786ab47 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:20.994054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01edbb-4c7c-49de-9133-440f5786ab47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:21.003462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01edbb-4c7c-49de-9133-440f5786ab47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:21.004976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01edbb-4c7c-49de-9133-440f5786ab47 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:21.014587 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4325/8686] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:21.179748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7a7cf-be47-4598-92ac-78a557905182 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:21.181261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6ac7a7cf-be47-4598-92ac-78a557905182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:21.193667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7a7cf-be47-4598-92ac-78a557905182 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:21.198421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:21.199287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:21.199566 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:21.199841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] PATH_INFO: `/v3/projects/9c448b2663f745ba974a354ab3cdcdd1` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:21.201086 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c448b2663f745ba974a354ab3cdcdd1)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:21.202973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:21.248968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c448b2663f745ba974a354ab3cdcdd1', 'request_id': 'req-cd52abc1-f5f2-437d-ac85-33980ca39027'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.256852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c448b2663f745ba974a354ab3cdcdd1', 'request_id': 'req-cd52abc1-f5f2-437d-ac85-33980ca39027'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.262185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c448b2663f745ba974a354ab3cdcdd1', 'request_id': 'req-cd52abc1-f5f2-437d-ac85-33980ca39027'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.272925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] The token cache is being invalidate because project 9c448b2663f745ba974a354ab3cdcdd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:30:21.273210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.273829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.275379 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4362/8687] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:30:21 2022] DELETE /identity/v3/projects/9c448b2663f745ba974a354ab3cdcdd1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:30:21.279604 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01edbb-4c7c-49de-9133-440f5786ab47 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:21.289754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01edbb-4c7c-49de-9133-440f5786ab47 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:21.344854 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:21.345714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:21.346518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:21.346829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] PATH_INFO: `/v3/users/02360e9ad5ae48619072c872ec8c1c66` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:21.348031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02360e9ad5ae48619072c872ec8c1c66)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:21.350264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:21.394385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02360e9ad5ae48619072c872ec8c1c66'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.401469 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02360e9ad5ae48619072c872ec8c1c66'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.402097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02360e9ad5ae48619072c872ec8c1c66'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.402730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02360e9ad5ae48619072c872ec8c1c66'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.414486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d6d8a152-32e6-4368-b4ba-2b3263625f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02360e9ad5ae48619072c872ec8c1c66'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.427436 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4326/8688] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:30:21 2022] DELETE /identity/v3/users/02360e9ad5ae48619072c872ec8c1c66 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:30:21.686852 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:21.688453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:21.703590 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52abc1-f5f2-437d-ac85-33980ca39027 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:21.760493 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:21.761338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:21.761617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:21.761893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] PATH_INFO: `/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:21.763049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbc5d70cf564fecbde7aeeaf1d58469)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:21.764986 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:21.808982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbc5d70cf564fecbde7aeeaf1d58469', 'request_id': 'req-00251e14-1239-4fa7-98a0-509ea40d7c2b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.815740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbc5d70cf564fecbde7aeeaf1d58469', 'request_id': 'req-00251e14-1239-4fa7-98a0-509ea40d7c2b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.821194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbc5d70cf564fecbde7aeeaf1d58469', 'request_id': 'req-00251e14-1239-4fa7-98a0-509ea40d7c2b'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.832435 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] The token cache is being invalidate because project fcbc5d70cf564fecbde7aeeaf1d58469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:30:21.832725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.833350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00251e14-1239-4fa7-98a0-509ea40d7c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:30:21.834844 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4363/8689] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:30:21 2022] DELETE /identity/v3/projects/fcbc5d70cf564fecbde7aeeaf1d58469 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:30:21.840895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63222fb6-10f0-4f96-852d-b436902a9e4e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:21.841391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63222fb6-10f0-4f96-852d-b436902a9e4e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:21.841488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63222fb6-10f0-4f96-852d-b436902a9e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:21.859116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-63222fb6-10f0-4f96-852d-b436902a9e4e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:21.860318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-63222fb6-10f0-4f96-852d-b436902a9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:21.917213 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4327/8690] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:21.925712 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1463ee0-a4ec-4bac-98eb-f478fdb1bef7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:21.926188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1463ee0-a4ec-4bac-98eb-f478fdb1bef7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:21.926303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1463ee0-a4ec-4bac-98eb-f478fdb1bef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:21.945697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e1463ee0-a4ec-4bac-98eb-f478fdb1bef7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:21.946966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e1463ee0-a4ec-4bac-98eb-f478fdb1bef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:21.954791 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4364/8691] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:21.959564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63222fb6-10f0-4f96-852d-b436902a9e4e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:21.969001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63222fb6-10f0-4f96-852d-b436902a9e4e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:21.973433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a77a-2cf4-48b6-9607-716c0ed62b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:21.974071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a77a-2cf4-48b6-9607-716c0ed62b6f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:21.974349 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a77a-2cf4-48b6-9607-716c0ed62b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:21.974621 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25a77a-2cf4-48b6-9607-716c0ed62b6f admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:21.975330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a77a-2cf4-48b6-9607-716c0ed62b6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:30:21.975633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a77a-2cf4-48b6-9607-716c0ed62b6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:21.977283 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25a77a-2cf4-48b6-9607-716c0ed62b6f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:21.988428 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4328/8692] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:30:21.992476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1463ee0-a4ec-4bac-98eb-f478fdb1bef7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:22.001577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1463ee0-a4ec-4bac-98eb-f478fdb1bef7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:22.006675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1000-f04f-45b3-a57d-2ea824f999ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:22.007342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1000-f04f-45b3-a57d-2ea824f999ff admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:22.007617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1000-f04f-45b3-a57d-2ea824f999ff admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:22.007890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e1000-f04f-45b3-a57d-2ea824f999ff admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:22.008608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e1000-f04f-45b3-a57d-2ea824f999ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:22.010511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e1000-f04f-45b3-a57d-2ea824f999ff admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:22.036125 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4365/8693] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:30:21 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:30:22.040201 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a77a-2cf4-48b6-9607-716c0ed62b6f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:22.050608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25a77a-2cf4-48b6-9607-716c0ed62b6f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:22.105232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fef32d-1b06-4175-a0bf-c8720eaffd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:22.105813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fef32d-1b06-4175-a0bf-c8720eaffd2f admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:22.106094 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fef32d-1b06-4175-a0bf-c8720eaffd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:22.106367 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fef32d-1b06-4175-a0bf-c8720eaffd2f admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:22.107047 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fef32d-1b06-4175-a0bf-c8720eaffd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:22.109002 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fef32d-1b06-4175-a0bf-c8720eaffd2f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:22.128410 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4329/8694] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:30:22 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:30:22.132684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1000-f04f-45b3-a57d-2ea824f999ff admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:22.143334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e1000-f04f-45b3-a57d-2ea824f999ff admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:22.147793 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844f4b-7613-49f6-8aaf-cd53262eb6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:22.148455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844f4b-7613-49f6-8aaf-cd53262eb6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:22.148737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844f4b-7613-49f6-8aaf-cd53262eb6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:22.149019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71844f4b-7613-49f6-8aaf-cd53262eb6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:22.149747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71844f4b-7613-49f6-8aaf-cd53262eb6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:22.151345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71844f4b-7613-49f6-8aaf-cd53262eb6c4 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:22.161396 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4366/8695] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:30:22.165116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fef32d-1b06-4175-a0bf-c8720eaffd2f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:22.175180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fef32d-1b06-4175-a0bf-c8720eaffd2f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:22.179761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347bf54b-82c2-4992-b3c4-7cd5a784f4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:22.180440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bf54b-82c2-4992-b3c4-7cd5a784f4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:22.180730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bf54b-82c2-4992-b3c4-7cd5a784f4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:22.181011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347bf54b-82c2-4992-b3c4-7cd5a784f4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:22.181752 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bf54b-82c2-4992-b3c4-7cd5a784f4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:22.183353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347bf54b-82c2-4992-b3c4-7cd5a784f4b0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:22.193750 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4330/8696] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:30:22.197519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844f4b-7613-49f6-8aaf-cd53262eb6c4 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:22.207795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71844f4b-7613-49f6-8aaf-cd53262eb6c4 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:22.212334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049e439-5ab5-43e1-8c9c-00cb7b34ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:22.213190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e439-5ab5-43e1-8c9c-00cb7b34ba7a admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:22.213465 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e439-5ab5-43e1-8c9c-00cb7b34ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:22.213735 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049e439-5ab5-43e1-8c9c-00cb7b34ba7a admin admin] PATH_INFO: `/v3/projects/0eed8f4e27f84b00a9e92e4cfdc378ac/users/5bfd467da71e47b18438c0b75a5d7836/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:22.228650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049e439-5ab5-43e1-8c9c-00cb7b34ba7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eed8f4e27f84b00a9e92e4cfdc378ac, user_id=5bfd467da71e47b18438c0b75a5d7836, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:22.231282 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049e439-5ab5-43e1-8c9c-00cb7b34ba7a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:22.243481 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4367/8697] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:30:22 2022] PUT /identity/v3/projects/0eed8f4e27f84b00a9e92e4cfdc378ac/users/5bfd467da71e47b18438c0b75a5d7836/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:30:22.248552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746be36-758f-4f45-ba92-6019fb0f8b45 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:22.248851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746be36-758f-4f45-ba92-6019fb0f8b45 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:22.249136 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746be36-758f-4f45-ba92-6019fb0f8b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:22.267410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a746be36-758f-4f45-ba92-6019fb0f8b45 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:22.269261 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a746be36-758f-4f45-ba92-6019fb0f8b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:22.326530 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4331/8698] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:22.336313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049e439-5ab5-43e1-8c9c-00cb7b34ba7a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:22.337965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2049e439-5ab5-43e1-8c9c-00cb7b34ba7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:22.394451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049e439-5ab5-43e1-8c9c-00cb7b34ba7a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:22.398048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2402479-9ece-48a3-a0a8-2217288dbbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:22.398682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2402479-9ece-48a3-a0a8-2217288dbbaf service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:22.398964 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2402479-9ece-48a3-a0a8-2217288dbbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:22.399239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2402479-9ece-48a3-a0a8-2217288dbbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:22.408352 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2402479-9ece-48a3-a0a8-2217288dbbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:22.409781 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2402479-9ece-48a3-a0a8-2217288dbbaf service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:22.419265 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4368/8699] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:22.997967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7df1-6753-4c3d-91f0-aa2f35905509 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:22.998495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7df1-6753-4c3d-91f0-aa2f35905509 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:22.998616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a7df1-6753-4c3d-91f0-aa2f35905509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:23.028286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-850a7df1-6753-4c3d-91f0-aa2f35905509 None None] MFA Rules not processed for user `5bfd467da71e47b18438c0b75a5d7836`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:23.029498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-850a7df1-6753-4c3d-91f0-aa2f35905509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:23.092970 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4332/8700] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:23.104973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65215-c8f0-488b-a38d-8a2688740605 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:23.105487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65215-c8f0-488b-a38d-8a2688740605 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:23.105604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a65215-c8f0-488b-a38d-8a2688740605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:23.133235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-85a65215-c8f0-488b-a38d-8a2688740605 None None] MFA Rules not processed for user `5bfd467da71e47b18438c0b75a5d7836`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:23.134432 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-85a65215-c8f0-488b-a38d-8a2688740605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:23.141544 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4369/8701] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:30:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:30:23.153483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7df1-6753-4c3d-91f0-aa2f35905509 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:23.154905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-850a7df1-6753-4c3d-91f0-aa2f35905509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:23.230216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a7df1-6753-4c3d-91f0-aa2f35905509 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:23.235667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ecdbd-bf18-45c4-90b6-23aea126a3a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:23.236331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ecdbd-bf18-45c4-90b6-23aea126a3a4 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:23.236666 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ecdbd-bf18-45c4-90b6-23aea126a3a4 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:23.236946 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ecdbd-bf18-45c4-90b6-23aea126a3a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:23.244541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ecdbd-bf18-45c4-90b6-23aea126a3a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:23.246134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ecdbd-bf18-45c4-90b6-23aea126a3a4 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:23.254879 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4333/8702] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:25.810023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a65215-c8f0-488b-a38d-8a2688740605 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:25.811442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-85a65215-c8f0-488b-a38d-8a2688740605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:25.837898 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a65215-c8f0-488b-a38d-8a2688740605 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:25.841396 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c3d65-9334-422c-a013-6566bfe8d029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:25.842023 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3d65-9334-422c-a013-6566bfe8d029 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:25.842302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3d65-9334-422c-a013-6566bfe8d029 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:25.842578 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c3d65-9334-422c-a013-6566bfe8d029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:25.844751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d55c3d65-9334-422c-a013-6566bfe8d029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:25.856909 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3d65-9334-422c-a013-6566bfe8d029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:25.858334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c3d65-9334-422c-a013-6566bfe8d029 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:25.869140 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4370/8703] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:34.045181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ecdbd-bf18-45c4-90b6-23aea126a3a4 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:34.069268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ecdbd-bf18-45c4-90b6-23aea126a3a4 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:34.072884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1756bae-96e7-4cb6-841c-a3d38e7812cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:34.073800 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1756bae-96e7-4cb6-841c-a3d38e7812cf service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:34.074079 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1756bae-96e7-4cb6-841c-a3d38e7812cf service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:34.074351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1756bae-96e7-4cb6-841c-a3d38e7812cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:34.076354 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a1756bae-96e7-4cb6-841c-a3d38e7812cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:34.107480 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1756bae-96e7-4cb6-841c-a3d38e7812cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:34.109005 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1756bae-96e7-4cb6-841c-a3d38e7812cf service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:34.121598 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4334/8704] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:34.212247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0adf7a-f886-4554-a17a-167d64bc5719 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:34.212778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0adf7a-f886-4554-a17a-167d64bc5719 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:34.212878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0adf7a-f886-4554-a17a-167d64bc5719 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:34.214688 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4371/8705] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:30:34.219278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049040-e6bd-4955-a44a-c3c24fc71c70 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:34.219571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049040-e6bd-4955-a44a-c3c24fc71c70 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:34.219881 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049040-e6bd-4955-a44a-c3c24fc71c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:34.255216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-10049040-e6bd-4955-a44a-c3c24fc71c70 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:30:34.256462 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-10049040-e6bd-4955-a44a-c3c24fc71c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:34.336653 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4335/8706] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:30:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:30:34.356206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0adf7a-f886-4554-a17a-167d64bc5719 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:34.357866 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9e0adf7a-f886-4554-a17a-167d64bc5719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:34.376882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0adf7a-f886-4554-a17a-167d64bc5719 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:34.382522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866008-6c60-4d39-9606-e2d353fd72f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:34.383144 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866008-6c60-4d39-9606-e2d353fd72f8 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:34.383429 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866008-6c60-4d39-9606-e2d353fd72f8 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:34.383709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866008-6c60-4d39-9606-e2d353fd72f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:34.391942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1866008-6c60-4d39-9606-e2d353fd72f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:34.393523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1866008-6c60-4d39-9606-e2d353fd72f8 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:34.403009 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4372/8707] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:30:34.560511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049040-e6bd-4955-a44a-c3c24fc71c70 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:30:34.572903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049040-e6bd-4955-a44a-c3c24fc71c70 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:30:34.576515 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd3d1a-4ec3-4381-8f4c-3bc91ce25e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:30:34.577159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd3d1a-4ec3-4381-8f4c-3bc91ce25e73 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:30:34.577468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd3d1a-4ec3-4381-8f4c-3bc91ce25e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:30:34.577747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd3d1a-4ec3-4381-8f4c-3bc91ce25e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:30:34.579539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7fcd3d1a-4ec3-4381-8f4c-3bc91ce25e73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:30:34.602182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd3d1a-4ec3-4381-8f4c-3bc91ce25e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:30:34.603597 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd3d1a-4ec3-4381-8f4c-3bc91ce25e73 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:30:34.617151 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4336/8708] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:30:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:31:03.705260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866008-6c60-4d39-9606-e2d353fd72f8 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:03.707830 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-d1866008-6c60-4d39-9606-e2d353fd72f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:03.728014 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866008-6c60-4d39-9606-e2d353fd72f8 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:03.733376 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924d6fe-5a42-415a-81be-8d30ff1b0de0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:03.734010 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d6fe-5a42-415a-81be-8d30ff1b0de0 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:03.734292 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d6fe-5a42-415a-81be-8d30ff1b0de0 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:03.734570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a924d6fe-5a42-415a-81be-8d30ff1b0de0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:03.736344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a924d6fe-5a42-415a-81be-8d30ff1b0de0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:03.752348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924d6fe-5a42-415a-81be-8d30ff1b0de0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:03.753955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a924d6fe-5a42-415a-81be-8d30ff1b0de0 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:03.767314 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4373/8709] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:31:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:31:09.026899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd3d1a-4ec3-4381-8f4c-3bc91ce25e73 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:09.040903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd3d1a-4ec3-4381-8f4c-3bc91ce25e73 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:09.046732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb463c-07e3-4981-b80f-280b58f32984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:09.047368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb463c-07e3-4981-b80f-280b58f32984 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:09.047651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb463c-07e3-4981-b80f-280b58f32984 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:09.047949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb463c-07e3-4981-b80f-280b58f32984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:09.049749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d2bb463c-07e3-4981-b80f-280b58f32984 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:09.065518 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb463c-07e3-4981-b80f-280b58f32984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:09.067691 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb463c-07e3-4981-b80f-280b58f32984 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:09.083180 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4337/8710] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:31:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:31:11.570428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924d6fe-5a42-415a-81be-8d30ff1b0de0 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:11.581732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a924d6fe-5a42-415a-81be-8d30ff1b0de0 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:11.586876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:11.587728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:11.588166 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:11.588445 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] PATH_INFO: `/v3/users/5bfd467da71e47b18438c0b75a5d7836` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:11.589614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfd467da71e47b18438c0b75a5d7836)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:11.591536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:11.634413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfd467da71e47b18438c0b75a5d7836'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:11.640982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfd467da71e47b18438c0b75a5d7836'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:11.641632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfd467da71e47b18438c0b75a5d7836'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:11.642237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfd467da71e47b18438c0b75a5d7836'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:11.650518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b855be82-ad60-4eba-90e8-67a5ef651828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfd467da71e47b18438c0b75a5d7836'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:11.667015 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4374/8711] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:31:11 2022] DELETE /identity/v3/users/5bfd467da71e47b18438c0b75a5d7836 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:31:11.836093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb463c-07e3-4981-b80f-280b58f32984 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:11.849437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb463c-07e3-4981-b80f-280b58f32984 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:11.914784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:11.915634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:11.916124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:11.916406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] PATH_INFO: `/v3/projects/0eed8f4e27f84b00a9e92e4cfdc378ac` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:11.917596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eed8f4e27f84b00a9e92e4cfdc378ac)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:11.919511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:11.965468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'request_id': 'req-13f2dcba-33c4-4546-add9-7286b6c932a8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:11.972486 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'request_id': 'req-13f2dcba-33c4-4546-add9-7286b6c932a8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:11.977612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eed8f4e27f84b00a9e92e4cfdc378ac', 'request_id': 'req-13f2dcba-33c4-4546-add9-7286b6c932a8'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:12.000272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] The token cache is being invalidate because project 0eed8f4e27f84b00a9e92e4cfdc378ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:31:12.000556 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:12.001176 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-13f2dcba-33c4-4546-add9-7286b6c932a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:31:12.002681 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4338/8712] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:31:11 2022] DELETE /identity/v3/projects/0eed8f4e27f84b00a9e92e4cfdc378ac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:31:12.008387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac73801-953c-4703-b62c-42c264b7b23c None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.008688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac73801-953c-4703-b62c-42c264b7b23c None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.008975 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac73801-953c-4703-b62c-42c264b7b23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.064216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6ac73801-953c-4703-b62c-42c264b7b23c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:31:12.065426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6ac73801-953c-4703-b62c-42c264b7b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:12.121483 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4375/8713] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:31:12.129794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1cf00-06b3-4300-ad6a-07ad87677a25 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.130138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1cf00-06b3-4300-ad6a-07ad87677a25 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.130427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1cf00-06b3-4300-ad6a-07ad87677a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.147768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e1f1cf00-06b3-4300-ad6a-07ad87677a25 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:31:12.148986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e1f1cf00-06b3-4300-ad6a-07ad87677a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:12.157163 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4339/8714] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:31:12.161748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac73801-953c-4703-b62c-42c264b7b23c None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:12.171496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac73801-953c-4703-b62c-42c264b7b23c None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:12.176694 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9abd7-29a9-4c1a-8ce2-88c0dd6b1ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:12.177335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9abd7-29a9-4c1a-8ce2-88c0dd6b1ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.177620 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9abd7-29a9-4c1a-8ce2-88c0dd6b1ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.177899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9abd7-29a9-4c1a-8ce2-88c0dd6b1ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.178614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9abd7-29a9-4c1a-8ce2-88c0dd6b1ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:31:12.178918 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9abd7-29a9-4c1a-8ce2-88c0dd6b1ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:12.180550 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c9abd7-29a9-4c1a-8ce2-88c0dd6b1ff8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:12.192341 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4376/8715] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:31:12.196121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1cf00-06b3-4300-ad6a-07ad87677a25 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:12.205258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1cf00-06b3-4300-ad6a-07ad87677a25 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:12.209902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c45b4-76a8-4d2e-8cbc-d5a06852b053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:12.210542 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c45b4-76a8-4d2e-8cbc-d5a06852b053 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.210834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c45b4-76a8-4d2e-8cbc-d5a06852b053 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.211116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c45b4-76a8-4d2e-8cbc-d5a06852b053 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.211809 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c45b4-76a8-4d2e-8cbc-d5a06852b053 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:12.213769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c45b4-76a8-4d2e-8cbc-d5a06852b053 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:12.239590 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4340/8716] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:31:12 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:31:12.244698 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9abd7-29a9-4c1a-8ce2-88c0dd6b1ff8 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:12.254410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c9abd7-29a9-4c1a-8ce2-88c0dd6b1ff8 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:12.309373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab46dc-d7f2-41a6-8a12-8e8cbf3d964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:12.310027 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab46dc-d7f2-41a6-8a12-8e8cbf3d964b admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.310313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab46dc-d7f2-41a6-8a12-8e8cbf3d964b admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.310593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab46dc-d7f2-41a6-8a12-8e8cbf3d964b admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.311269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab46dc-d7f2-41a6-8a12-8e8cbf3d964b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:12.313232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab46dc-d7f2-41a6-8a12-8e8cbf3d964b admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:12.332435 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4377/8717] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:31:12 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:31:12.336602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c45b4-76a8-4d2e-8cbc-d5a06852b053 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:12.346731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c45b4-76a8-4d2e-8cbc-d5a06852b053 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:12.351899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c26f3f-70bf-4240-ac37-2494d78d86a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:12.352575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26f3f-70bf-4240-ac37-2494d78d86a7 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.352880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26f3f-70bf-4240-ac37-2494d78d86a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.353159 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c26f3f-70bf-4240-ac37-2494d78d86a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.353877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c26f3f-70bf-4240-ac37-2494d78d86a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:12.355495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c26f3f-70bf-4240-ac37-2494d78d86a7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:12.365812 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4341/8718] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:31:12.369610 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab46dc-d7f2-41a6-8a12-8e8cbf3d964b admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:12.379786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab46dc-d7f2-41a6-8a12-8e8cbf3d964b admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:12.384302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29915c4-dbd0-4407-b500-0b2342ddd9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:12.384937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29915c4-dbd0-4407-b500-0b2342ddd9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.385214 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29915c4-dbd0-4407-b500-0b2342ddd9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.385487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29915c4-dbd0-4407-b500-0b2342ddd9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.386194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29915c4-dbd0-4407-b500-0b2342ddd9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:12.387776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29915c4-dbd0-4407-b500-0b2342ddd9b8 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:12.397305 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4378/8719] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:31:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:31:12.401529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c26f3f-70bf-4240-ac37-2494d78d86a7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:12.411866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c26f3f-70bf-4240-ac37-2494d78d86a7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:12.416479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660269-7c15-4013-bd98-505d6d4177ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:12.417378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660269-7c15-4013-bd98-505d6d4177ab admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.417664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660269-7c15-4013-bd98-505d6d4177ab admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.417943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89660269-7c15-4013-bd98-505d6d4177ab admin admin] PATH_INFO: `/v3/projects/150ede058f8c4b61a827850135921da2/users/1af836fd9f5f405e9f4f885c6b6970fa/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.432917 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89660269-7c15-4013-bd98-505d6d4177ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=150ede058f8c4b61a827850135921da2, user_id=1af836fd9f5f405e9f4f885c6b6970fa, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:12.435587 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89660269-7c15-4013-bd98-505d6d4177ab admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:12.448911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4342/8720] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:31:12 2022] PUT /identity/v3/projects/150ede058f8c4b61a827850135921da2/users/1af836fd9f5f405e9f4f885c6b6970fa/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:31:12.453783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0d10c-08ab-4421-a0af-e407f2b3b366 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.454101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0d10c-08ab-4421-a0af-e407f2b3b366 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.454406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0d10c-08ab-4421-a0af-e407f2b3b366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.472398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c8b0d10c-08ab-4421-a0af-e407f2b3b366 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:31:12.474068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c8b0d10c-08ab-4421-a0af-e407f2b3b366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:12.530221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4379/8721] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:31:12.540484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660269-7c15-4013-bd98-505d6d4177ab admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:12.542248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-89660269-7c15-4013-bd98-505d6d4177ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:12.599702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89660269-7c15-4013-bd98-505d6d4177ab admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:12.603288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb830b2-561d-446b-b954-4aca8547df37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:12.603952 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb830b2-561d-446b-b954-4aca8547df37 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:12.604240 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb830b2-561d-446b-b954-4aca8547df37 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:12.604516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb830b2-561d-446b-b954-4aca8547df37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:12.613472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb830b2-561d-446b-b954-4aca8547df37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:12.614920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb830b2-561d-446b-b954-4aca8547df37 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:12.625127 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4343/8722] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:31:13.233593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80d34-803d-41e8-8355-eca136486f59 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:13.234103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80d34-803d-41e8-8355-eca136486f59 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:13.234231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb80d34-803d-41e8-8355-eca136486f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:13.261506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-bdb80d34-803d-41e8-8355-eca136486f59 None None] MFA Rules not processed for user `1af836fd9f5f405e9f4f885c6b6970fa`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:31:13.262704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bdb80d34-803d-41e8-8355-eca136486f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:13.329163 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4380/8723] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:31:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:31:13.339616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e393-2070-4845-ab7d-aac00c36c2b7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:13.340182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e393-2070-4845-ab7d-aac00c36c2b7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:13.340289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35e393-2070-4845-ab7d-aac00c36c2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:13.357000 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6f35e393-2070-4845-ab7d-aac00c36c2b7 None None] MFA Rules not processed for user `1af836fd9f5f405e9f4f885c6b6970fa`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:31:13.358175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f35e393-2070-4845-ab7d-aac00c36c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:13.365478 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4344/8724] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:31:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:31:13.377209 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb80d34-803d-41e8-8355-eca136486f59 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:13.378733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-bdb80d34-803d-41e8-8355-eca136486f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:13.452771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb80d34-803d-41e8-8355-eca136486f59 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:13.458210 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824964e2-dad3-4c58-b13c-665f9f26416b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:13.458843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824964e2-dad3-4c58-b13c-665f9f26416b service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:13.459126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824964e2-dad3-4c58-b13c-665f9f26416b service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:13.459401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824964e2-dad3-4c58-b13c-665f9f26416b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:13.466842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824964e2-dad3-4c58-b13c-665f9f26416b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:13.468460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824964e2-dad3-4c58-b13c-665f9f26416b service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:13.476999 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4381/8725] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:31:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:31:14.015504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35e393-2070-4845-ab7d-aac00c36c2b7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:14.017632 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f35e393-2070-4845-ab7d-aac00c36c2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:14.090987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35e393-2070-4845-ab7d-aac00c36c2b7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:14.095943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f888081-77c5-4630-ac56-d00a2cf8fe9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:14.096578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f888081-77c5-4630-ac56-d00a2cf8fe9d service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:14.096858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f888081-77c5-4630-ac56-d00a2cf8fe9d service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:14.097131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f888081-77c5-4630-ac56-d00a2cf8fe9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:14.099504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6f888081-77c5-4630-ac56-d00a2cf8fe9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:14.113072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f888081-77c5-4630-ac56-d00a2cf8fe9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:14.114727 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f888081-77c5-4630-ac56-d00a2cf8fe9d service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:14.127079 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4345/8726] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:31:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:31:24.335196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10546c6a-902a-48b6-9c5c-5058ebe1e662 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:24.335643 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10546c6a-902a-48b6-9c5c-5058ebe1e662 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:24.335809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10546c6a-902a-48b6-9c5c-5058ebe1e662 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:24.337683 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4382/8727] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:31:24.342676 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4df3-660f-468e-9112-f1c014e8563f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:24.343144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4df3-660f-468e-9112-f1c014e8563f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:24.343274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b4df3-660f-468e-9112-f1c014e8563f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:24.362166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-063b4df3-660f-468e-9112-f1c014e8563f None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:31:24.363360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-063b4df3-660f-468e-9112-f1c014e8563f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:24.372616 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4346/8728] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:31:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:31:24.392598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10546c6a-902a-48b6-9c5c-5058ebe1e662 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:24.394298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-10546c6a-902a-48b6-9c5c-5058ebe1e662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:24.414048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10546c6a-902a-48b6-9c5c-5058ebe1e662 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:24.418868 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb18d6-8dba-432d-a560-acbe0a4a783e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:24.419487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb18d6-8dba-432d-a560-acbe0a4a783e service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:24.419775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb18d6-8dba-432d-a560-acbe0a4a783e service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:24.420088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb18d6-8dba-432d-a560-acbe0a4a783e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:24.428431 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb18d6-8dba-432d-a560-acbe0a4a783e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:24.430618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb18d6-8dba-432d-a560-acbe0a4a783e service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:24.440144 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4383/8729] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:31:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:31:25.465965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b4df3-660f-468e-9112-f1c014e8563f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:25.477902 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b4df3-660f-468e-9112-f1c014e8563f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:25.481541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165054e-4fcc-49c4-8d58-ba77e4ee1c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:25.482268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165054e-4fcc-49c4-8d58-ba77e4ee1c14 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:25.482550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165054e-4fcc-49c4-8d58-ba77e4ee1c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:25.483050 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165054e-4fcc-49c4-8d58-ba77e4ee1c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:25.484974 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e165054e-4fcc-49c4-8d58-ba77e4ee1c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:25.498348 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165054e-4fcc-49c4-8d58-ba77e4ee1c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:25.499830 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165054e-4fcc-49c4-8d58-ba77e4ee1c14 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:25.510882 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4347/8730] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:31:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:31:53.883897 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb18d6-8dba-432d-a560-acbe0a4a783e service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:31:53.885454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2abb18d6-8dba-432d-a560-acbe0a4a783e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:53.917818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb18d6-8dba-432d-a560-acbe0a4a783e service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:31:53.923973 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec39f30-99c5-4085-9b92-1920a7869241 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:31:53.924627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec39f30-99c5-4085-9b92-1920a7869241 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:53.924911 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec39f30-99c5-4085-9b92-1920a7869241 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:53.925212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec39f30-99c5-4085-9b92-1920a7869241 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:53.927024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9ec39f30-99c5-4085-9b92-1920a7869241 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:53.941999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec39f30-99c5-4085-9b92-1920a7869241 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:31:53.943604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec39f30-99c5-4085-9b92-1920a7869241 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:31:53.957733 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4384/8731] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:31:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:31:59.619229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826fad1-3b7d-42b0-bf38-b5ff0dcd981a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:31:59.620301 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826fad1-3b7d-42b0-bf38-b5ff0dcd981a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:31:59.620401 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826fad1-3b7d-42b0-bf38-b5ff0dcd981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:31:59.637928 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3826fad1-3b7d-42b0-bf38-b5ff0dcd981a None None] MFA Rules not processed for user `1af836fd9f5f405e9f4f885c6b6970fa`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:31:59.639091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3826fad1-3b7d-42b0-bf38-b5ff0dcd981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:31:59.646009 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4348/8732] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:31:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:32:11.569294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008be762-4af0-405d-a6e9-e8ea4dec51b4 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:11.569819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008be762-4af0-405d-a6e9-e8ea4dec51b4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:11.569914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008be762-4af0-405d-a6e9-e8ea4dec51b4 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:11.571699 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4385/8733] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:32:11.579404 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab6bf-54a3-4ac7-adb9-b5ebec4f572e None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:11.579884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab6bf-54a3-4ac7-adb9-b5ebec4f572e None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:11.580024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab6bf-54a3-4ac7-adb9-b5ebec4f572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:11.609208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-624ab6bf-54a3-4ac7-adb9-b5ebec4f572e None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:32:11.610386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-624ab6bf-54a3-4ac7-adb9-b5ebec4f572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:11.619236 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4349/8734] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:32:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:32:11.640301 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008be762-4af0-405d-a6e9-e8ea4dec51b4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:11.656030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008be762-4af0-405d-a6e9-e8ea4dec51b4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:11.660853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9be08-9b43-4105-b576-bf941afff679 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:11.661472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9be08-9b43-4105-b576-bf941afff679 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:11.661752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9be08-9b43-4105-b576-bf941afff679 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:11.662028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf9be08-9b43-4105-b576-bf941afff679 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:11.670477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9be08-9b43-4105-b576-bf941afff679 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:11.672409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf9be08-9b43-4105-b576-bf941afff679 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:11.682982 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4386/8735] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:32:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:32:30.108031 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab6bf-54a3-4ac7-adb9-b5ebec4f572e None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:30.120772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab6bf-54a3-4ac7-adb9-b5ebec4f572e None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:30.125675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97789ea1-41a2-4b0a-a65f-b00315d4b96c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:30.126317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97789ea1-41a2-4b0a-a65f-b00315d4b96c service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:30.126598 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97789ea1-41a2-4b0a-a65f-b00315d4b96c service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:30.126873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97789ea1-41a2-4b0a-a65f-b00315d4b96c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:30.128640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-97789ea1-41a2-4b0a-a65f-b00315d4b96c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:30.156998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97789ea1-41a2-4b0a-a65f-b00315d4b96c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:30.158605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97789ea1-41a2-4b0a-a65f-b00315d4b96c service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:30.171213 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4350/8736] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:32:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:32:34.104389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9be08-9b43-4105-b576-bf941afff679 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:34.117794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf9be08-9b43-4105-b576-bf941afff679 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:34.122786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7319c-decb-47ce-833f-7cefda12a31e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:34.123413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7319c-decb-47ce-833f-7cefda12a31e service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:34.123700 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7319c-decb-47ce-833f-7cefda12a31e service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:34.124022 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7319c-decb-47ce-833f-7cefda12a31e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:34.125769 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b3d7319c-decb-47ce-833f-7cefda12a31e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:34.139117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7319c-decb-47ce-833f-7cefda12a31e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:34.140805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7319c-decb-47ce-833f-7cefda12a31e service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:34.153449 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4387/8737] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:32:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:32:48.479151 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97789ea1-41a2-4b0a-a65f-b00315d4b96c service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:48.493545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97789ea1-41a2-4b0a-a65f-b00315d4b96c service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:48.498169 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:48.499032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:48.499319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:48.499613 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] PATH_INFO: `/v3/users/1af836fd9f5f405e9f4f885c6b6970fa` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:48.500944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af836fd9f5f405e9f4f885c6b6970fa)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:48.502927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:48.554161 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af836fd9f5f405e9f4f885c6b6970fa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.561579 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af836fd9f5f405e9f4f885c6b6970fa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.562248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af836fd9f5f405e9f4f885c6b6970fa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.562863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af836fd9f5f405e9f4f885c6b6970fa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.574364 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8aba04e7-93f9-4205-a443-b7de9501d2b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af836fd9f5f405e9f4f885c6b6970fa'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.586236 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4351/8738] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:32:48 2022] DELETE /identity/v3/users/1af836fd9f5f405e9f4f885c6b6970fa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:32:48.754840 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7319c-decb-47ce-833f-7cefda12a31e service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:48.769118 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7319c-decb-47ce-833f-7cefda12a31e service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:48.825372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:48.826269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:48.826583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:48.826861 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] PATH_INFO: `/v3/projects/150ede058f8c4b61a827850135921da2` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:48.828126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=150ede058f8c4b61a827850135921da2)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:48.830067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:48.874072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150ede058f8c4b61a827850135921da2', 'request_id': 'req-6c10d534-c449-48c2-89fb-5d7aeb5675f0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.881133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150ede058f8c4b61a827850135921da2', 'request_id': 'req-6c10d534-c449-48c2-89fb-5d7aeb5675f0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.886848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150ede058f8c4b61a827850135921da2', 'request_id': 'req-6c10d534-c449-48c2-89fb-5d7aeb5675f0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.897343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] The token cache is being invalidate because project 150ede058f8c4b61a827850135921da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:32:48.897636 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.898268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-6c10d534-c449-48c2-89fb-5d7aeb5675f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:32:48.899776 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4388/8739] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:32:48 2022] DELETE /identity/v3/projects/150ede058f8c4b61a827850135921da2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:32:48.905461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ccfc-36d2-4efd-9dae-b583f224a4d9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:48.905940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ccfc-36d2-4efd-9dae-b583f224a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:48.906226 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ccfc-36d2-4efd-9dae-b583f224a4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:48.925288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-3362ccfc-36d2-4efd-9dae-b583f224a4d9 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:32:48.926470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3362ccfc-36d2-4efd-9dae-b583f224a4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:48.984021 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4352/8740] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:32:48.995786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b5e2-dcd7-4869-99ac-59be4453bab4 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:48.996112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b5e2-dcd7-4869-99ac-59be4453bab4 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:48.996395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b5e2-dcd7-4869-99ac-59be4453bab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:49.014997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6e25b5e2-dcd7-4869-99ac-59be4453bab4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:32:49.016164 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6e25b5e2-dcd7-4869-99ac-59be4453bab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:49.024242 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4389/8741] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:32:49.029037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ccfc-36d2-4efd-9dae-b583f224a4d9 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:49.038860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ccfc-36d2-4efd-9dae-b583f224a4d9 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:49.043355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1599c-3ea4-40c5-b0cd-178a06d11959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:49.044034 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1599c-3ea4-40c5-b0cd-178a06d11959 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:49.044314 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1599c-3ea4-40c5-b0cd-178a06d11959 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:49.044614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1599c-3ea4-40c5-b0cd-178a06d11959 admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:49.045351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1599c-3ea4-40c5-b0cd-178a06d11959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:32:49.045652 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1599c-3ea4-40c5-b0cd-178a06d11959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:49.047282 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1599c-3ea4-40c5-b0cd-178a06d11959 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:49.058800 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4353/8742] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:32:49.062858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b5e2-dcd7-4869-99ac-59be4453bab4 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:49.072584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b5e2-dcd7-4869-99ac-59be4453bab4 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:49.077736 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa6acb-320c-461a-8de6-18d50bed1a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:49.078369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa6acb-320c-461a-8de6-18d50bed1a07 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:49.078653 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa6acb-320c-461a-8de6-18d50bed1a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:49.078930 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa6acb-320c-461a-8de6-18d50bed1a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:49.079649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa6acb-320c-461a-8de6-18d50bed1a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:49.081600 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa6acb-320c-461a-8de6-18d50bed1a07 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:49.106050 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4390/8743] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:32:49 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:32:49.110167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1599c-3ea4-40c5-b0cd-178a06d11959 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:49.120075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1599c-3ea4-40c5-b0cd-178a06d11959 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:49.173901 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5ee31-2e02-4390-a5c0-2d50cf80d8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:49.174564 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5ee31-2e02-4390-a5c0-2d50cf80d8dc admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:49.174850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5ee31-2e02-4390-a5c0-2d50cf80d8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:49.175129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5ee31-2e02-4390-a5c0-2d50cf80d8dc admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:49.175807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5ee31-2e02-4390-a5c0-2d50cf80d8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:49.177798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5ee31-2e02-4390-a5c0-2d50cf80d8dc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:49.197134 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4354/8744] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:32:49 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:32:49.201938 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa6acb-320c-461a-8de6-18d50bed1a07 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:49.212200 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa6acb-320c-461a-8de6-18d50bed1a07 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:49.217084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bfc01-1a2d-4554-93db-abf758bf0243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:49.217738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bfc01-1a2d-4554-93db-abf758bf0243 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:49.218025 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bfc01-1a2d-4554-93db-abf758bf0243 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:49.218303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bfc01-1a2d-4554-93db-abf758bf0243 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:49.219084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bfc01-1a2d-4554-93db-abf758bf0243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:49.220738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bfc01-1a2d-4554-93db-abf758bf0243 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:49.230966 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4391/8745] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:32:49.234659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5ee31-2e02-4390-a5c0-2d50cf80d8dc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:49.244441 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5ee31-2e02-4390-a5c0-2d50cf80d8dc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:49.249560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd008b7-19dc-48e5-af64-d324936e26e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:49.250199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd008b7-19dc-48e5-af64-d324936e26e3 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:49.250484 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd008b7-19dc-48e5-af64-d324936e26e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:49.250761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd008b7-19dc-48e5-af64-d324936e26e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:49.251504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd008b7-19dc-48e5-af64-d324936e26e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:49.253131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd008b7-19dc-48e5-af64-d324936e26e3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:49.263630 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4355/8746] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:32:49.267743 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bfc01-1a2d-4554-93db-abf758bf0243 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:49.277829 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bfc01-1a2d-4554-93db-abf758bf0243 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:49.282304 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c978246-36bd-4881-8d91-0e763b0cd199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:49.283157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c978246-36bd-4881-8d91-0e763b0cd199 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:49.283438 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c978246-36bd-4881-8d91-0e763b0cd199 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:49.283711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c978246-36bd-4881-8d91-0e763b0cd199 admin admin] PATH_INFO: `/v3/projects/ed4a3c1555504ccaaa90ea06f794d09a/users/dc934eed0dcd45a3a4967a219b7d84a7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:49.298048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c978246-36bd-4881-8d91-0e763b0cd199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4a3c1555504ccaaa90ea06f794d09a, user_id=dc934eed0dcd45a3a4967a219b7d84a7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:49.300739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c978246-36bd-4881-8d91-0e763b0cd199 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:49.314400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4392/8747] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:32:49 2022] PUT /identity/v3/projects/ed4a3c1555504ccaaa90ea06f794d09a/users/dc934eed0dcd45a3a4967a219b7d84a7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:32:49.319836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5451b35-34fa-449d-9adf-1fc7807bc8bc None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:49.320230 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5451b35-34fa-449d-9adf-1fc7807bc8bc None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:49.320576 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5451b35-34fa-449d-9adf-1fc7807bc8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:49.338745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d5451b35-34fa-449d-9adf-1fc7807bc8bc None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:32:49.339985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d5451b35-34fa-449d-9adf-1fc7807bc8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:49.396335 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4356/8748] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:32:49.405981 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c978246-36bd-4881-8d91-0e763b0cd199 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:49.407666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2c978246-36bd-4881-8d91-0e763b0cd199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:49.465047 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c978246-36bd-4881-8d91-0e763b0cd199 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:49.468732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5af7f-9eff-42d3-8f90-723557bd8d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:49.469365 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5af7f-9eff-42d3-8f90-723557bd8d98 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:49.469651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5af7f-9eff-42d3-8f90-723557bd8d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:49.469929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5af7f-9eff-42d3-8f90-723557bd8d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:49.478726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5af7f-9eff-42d3-8f90-723557bd8d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:49.480740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b5af7f-9eff-42d3-8f90-723557bd8d98 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:49.490085 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4393/8749] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:32:53.628082 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0b8b-e9db-4027-ab8a-f5bb918108da None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:53.628573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0b8b-e9db-4027-ab8a-f5bb918108da None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:53.628684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a0b8b-e9db-4027-ab8a-f5bb918108da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:53.657797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-360a0b8b-e9db-4027-ab8a-f5bb918108da None None] MFA Rules not processed for user `dc934eed0dcd45a3a4967a219b7d84a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:32:53.659122 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-360a0b8b-e9db-4027-ab8a-f5bb918108da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:53.728030 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4357/8750] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:32:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:32:53.740229 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5af7f-9eff-42d3-8f90-723557bd8d98 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:53.741753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-89b5af7f-9eff-42d3-8f90-723557bd8d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:53.820177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5af7f-9eff-42d3-8f90-723557bd8d98 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:53.825763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa7070-e12f-49db-b5c3-734e43be4c89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:53.826419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa7070-e12f-49db-b5c3-734e43be4c89 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:53.826703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa7070-e12f-49db-b5c3-734e43be4c89 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:53.826980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa7070-e12f-49db-b5c3-734e43be4c89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:53.835384 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa7070-e12f-49db-b5c3-734e43be4c89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:53.837033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa7070-e12f-49db-b5c3-734e43be4c89 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:53.846919 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4394/8751] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:32:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:32:55.495037 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedd468-d117-4977-956e-2dba321e32a7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:55.495535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedd468-d117-4977-956e-2dba321e32a7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:55.495634 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedd468-d117-4977-956e-2dba321e32a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:55.514192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6dedd468-d117-4977-956e-2dba321e32a7 None None] MFA Rules not processed for user `dc934eed0dcd45a3a4967a219b7d84a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:32:55.515308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6dedd468-d117-4977-956e-2dba321e32a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:55.522285 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4358/8752] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:32:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:32:55.866358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa7070-e12f-49db-b5c3-734e43be4c89 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:32:55.879417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa7070-e12f-49db-b5c3-734e43be4c89 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:32:55.883502 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8fe8b-c5c5-416b-b6b2-4d332f0208be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:32:55.884399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8fe8b-c5c5-416b-b6b2-4d332f0208be service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:32:55.884692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8fe8b-c5c5-416b-b6b2-4d332f0208be service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:32:55.884977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8fe8b-c5c5-416b-b6b2-4d332f0208be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:32:55.887489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-05e8fe8b-c5c5-416b-b6b2-4d332f0208be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:32:55.900722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8fe8b-c5c5-416b-b6b2-4d332f0208be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:32:55.902246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8fe8b-c5c5-416b-b6b2-4d332f0208be service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:32:55.914386 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4395/8753] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:32:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:33:09.110191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3dc47-52c3-43dc-8a20-14aa65dd2b8b None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:33:09.110793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3dc47-52c3-43dc-8a20-14aa65dd2b8b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:33:09.110793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3dc47-52c3-43dc-8a20-14aa65dd2b8b None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:33:09.112646 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4359/8754] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:33:09.117519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984160b-572c-48a3-b7c8-bc81f696570a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:33:09.118007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984160b-572c-48a3-b7c8-bc81f696570a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:33:09.118108 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984160b-572c-48a3-b7c8-bc81f696570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:33:09.137188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e984160b-572c-48a3-b7c8-bc81f696570a None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:33:09.138380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e984160b-572c-48a3-b7c8-bc81f696570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:33:09.198217 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4396/8755] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:33:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:33:09.219382 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3dc47-52c3-43dc-8a20-14aa65dd2b8b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:33:09.221076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-69f3dc47-52c3-43dc-8a20-14aa65dd2b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:33:09.239740 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f3dc47-52c3-43dc-8a20-14aa65dd2b8b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:33:09.244755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e04c2-4cc1-4d8a-bd9f-4f439b291d1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:33:09.245377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e04c2-4cc1-4d8a-bd9f-4f439b291d1d service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:33:09.245664 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e04c2-4cc1-4d8a-bd9f-4f439b291d1d service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:33:09.245942 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e04c2-4cc1-4d8a-bd9f-4f439b291d1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:33:09.254155 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e04c2-4cc1-4d8a-bd9f-4f439b291d1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:33:09.255739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e04c2-4cc1-4d8a-bd9f-4f439b291d1d service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:33:09.265684 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4360/8756] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:33:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:33:37.111583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687f586-052d-440a-8924-13009ca56884 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:33:37.112128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687f586-052d-440a-8924-13009ca56884 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:33:37.112314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687f586-052d-440a-8924-13009ca56884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:33:37.131547 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e687f586-052d-440a-8924-13009ca56884 None None] MFA Rules not processed for user `dc934eed0dcd45a3a4967a219b7d84a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:33:37.132802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e687f586-052d-440a-8924-13009ca56884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:33:37.140307 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4397/8757] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:33:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:34:14.590487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153ce8e-126f-43e6-862f-b0fe28edf985 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:34:14.591030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153ce8e-126f-43e6-862f-b0fe28edf985 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:34:14.591135 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a153ce8e-126f-43e6-862f-b0fe28edf985 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:34:14.593318 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4361/8758] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:34:14.598211 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d087b-7e3a-474d-b21c-c80fd0d94a1b None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:34:14.598651 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d087b-7e3a-474d-b21c-c80fd0d94a1b None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:34:14.598832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d087b-7e3a-474d-b21c-c80fd0d94a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:34:14.617545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-3b6d087b-7e3a-474d-b21c-c80fd0d94a1b None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:34:14.618731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-3b6d087b-7e3a-474d-b21c-c80fd0d94a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:34:14.628357 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4398/8759] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:34:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:34:14.648426 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153ce8e-126f-43e6-862f-b0fe28edf985 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:34:14.650193 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a153ce8e-126f-43e6-862f-b0fe28edf985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:34:14.669237 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a153ce8e-126f-43e6-862f-b0fe28edf985 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:34:14.674286 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f1be5-dc1b-4f98-b866-afcfee19d323 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:34:14.675183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f1be5-dc1b-4f98-b866-afcfee19d323 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:34:14.675453 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f1be5-dc1b-4f98-b866-afcfee19d323 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:34:14.675731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f1be5-dc1b-4f98-b866-afcfee19d323 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:34:14.684074 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f1be5-dc1b-4f98-b866-afcfee19d323 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:34:14.686206 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f1be5-dc1b-4f98-b866-afcfee19d323 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:34:14.695692 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4362/8760] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:34:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:34:27.683145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4c52d-1505-4cf5-bc3e-117fbe54e5b9 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:34:27.683676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4c52d-1505-4cf5-bc3e-117fbe54e5b9 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:34:27.683676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4c52d-1505-4cf5-bc3e-117fbe54e5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:34:27.700595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a4e4c52d-1505-4cf5-bc3e-117fbe54e5b9 None None] MFA Rules not processed for user `dc934eed0dcd45a3a4967a219b7d84a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:34:27.702321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a4e4c52d-1505-4cf5-bc3e-117fbe54e5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:34:27.709128 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4399/8761] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:34:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:34:39.197581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c92d2-9c5c-40d9-8786-96d4b6d41d60 None None] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:34:39.198648 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c92d2-9c5c-40d9-8786-96d4b6d41d60 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:34:39.199149 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c92d2-9c5c-40d9-8786-96d4b6d41d60 None None] PATH_INFO: `/` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:34:39.201861 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4363/8762] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:34:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:34:39.208333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23f876-68ab-4384-8660-509820fcc4d7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:34:39.209280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23f876-68ab-4384-8660-509820fcc4d7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:34:39.209766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23f876-68ab-4384-8660-509820fcc4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:34:39.231084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-1b23f876-68ab-4384-8660-509820fcc4d7 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:34:39.233190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b23f876-68ab-4384-8660-509820fcc4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:34:39.245402 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4400/8763] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:34:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:34:39.269561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c92d2-9c5c-40d9-8786-96d4b6d41d60 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:34:39.287863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c92d2-9c5c-40d9-8786-96d4b6d41d60 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:34:39.294758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955e596-82dd-41c8-9ba8-e28fee21d6fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:34:39.295836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955e596-82dd-41c8-9ba8-e28fee21d6fc service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:34:39.296215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955e596-82dd-41c8-9ba8-e28fee21d6fc service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:34:39.296707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955e596-82dd-41c8-9ba8-e28fee21d6fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:34:39.306177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955e596-82dd-41c8-9ba8-e28fee21d6fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:34:39.307872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955e596-82dd-41c8-9ba8-e28fee21d6fc service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:34:39.323506 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4364/8764] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:34:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:35:06.018641 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23f876-68ab-4384-8660-509820fcc4d7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:35:06.031226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23f876-68ab-4384-8660-509820fcc4d7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:35:06.034725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edffd32-284e-4bdd-939f-7a1b53c05f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:35:06.035381 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edffd32-284e-4bdd-939f-7a1b53c05f4b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:06.035688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edffd32-284e-4bdd-939f-7a1b53c05f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:06.036000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edffd32-284e-4bdd-939f-7a1b53c05f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:06.037728 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5edffd32-284e-4bdd-939f-7a1b53c05f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:35:06.053252 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edffd32-284e-4bdd-939f-7a1b53c05f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:35:06.054675 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edffd32-284e-4bdd-939f-7a1b53c05f4b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:35:06.067694 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4401/8765] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:35:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:35:07.242281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955e596-82dd-41c8-9ba8-e28fee21d6fc service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:35:07.243778 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5955e596-82dd-41c8-9ba8-e28fee21d6fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:35:07.257812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955e596-82dd-41c8-9ba8-e28fee21d6fc service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:35:07.261346 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bae477-d171-4736-9a86-7581e11f29df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:35:07.261965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bae477-d171-4736-9a86-7581e11f29df service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:07.262247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bae477-d171-4736-9a86-7581e11f29df service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:07.262519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bae477-d171-4736-9a86-7581e11f29df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:07.264326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-73bae477-d171-4736-9a86-7581e11f29df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:35:07.279386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bae477-d171-4736-9a86-7581e11f29df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:35:07.281268 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bae477-d171-4736-9a86-7581e11f29df service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:35:07.294412 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4365/8766] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:35:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:35:27.781841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61618-f4e4-4b45-b113-a58ecfce6abf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:27.782452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61618-f4e4-4b45-b113-a58ecfce6abf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:27.782559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b61618-f4e4-4b45-b113-a58ecfce6abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:27.802099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-59b61618-f4e4-4b45-b113-a58ecfce6abf None None] MFA Rules not processed for user `dc934eed0dcd45a3a4967a219b7d84a7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:35:27.803327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-59b61618-f4e4-4b45-b113-a58ecfce6abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:35:27.810811 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4402/8767] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:35:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:35:28.126075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bae477-d171-4736-9a86-7581e11f29df service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:35:28.136918 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bae477-d171-4736-9a86-7581e11f29df service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:35:28.140768 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5318979-a5e5-4fa7-b653-3fde6376f010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:35:28.141395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5318979-a5e5-4fa7-b653-3fde6376f010 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:28.141688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5318979-a5e5-4fa7-b653-3fde6376f010 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:28.142088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5318979-a5e5-4fa7-b653-3fde6376f010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:28.143844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c5318979-a5e5-4fa7-b653-3fde6376f010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:35:28.156416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5318979-a5e5-4fa7-b653-3fde6376f010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:35:28.157866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5318979-a5e5-4fa7-b653-3fde6376f010 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:35:28.168245 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4366/8768] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:35:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:35:30.102424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61618-f4e4-4b45-b113-a58ecfce6abf None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:35:30.115237 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b61618-f4e4-4b45-b113-a58ecfce6abf None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:35:30.119324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95edab1-c94b-42dc-a80e-eaf077ecce86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:35:30.120068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95edab1-c94b-42dc-a80e-eaf077ecce86 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:30.120356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95edab1-c94b-42dc-a80e-eaf077ecce86 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:30.120831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95edab1-c94b-42dc-a80e-eaf077ecce86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:30.122759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e95edab1-c94b-42dc-a80e-eaf077ecce86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:35:30.135778 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95edab1-c94b-42dc-a80e-eaf077ecce86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:35:30.137320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95edab1-c94b-42dc-a80e-eaf077ecce86 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:35:30.149445 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4403/8769] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:35:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:35:43.422995 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5318979-a5e5-4fa7-b653-3fde6376f010 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:35:43.434574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5318979-a5e5-4fa7-b653-3fde6376f010 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:35:43.438258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4bfa8-ec9d-41ba-baa5-dc39f01b0446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:35:43.438896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4bfa8-ec9d-41ba-baa5-dc39f01b0446 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:43.439235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4bfa8-ec9d-41ba-baa5-dc39f01b0446 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:43.439636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4bfa8-ec9d-41ba-baa5-dc39f01b0446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:43.441465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d9f4bfa8-ec9d-41ba-baa5-dc39f01b0446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:35:43.454509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4bfa8-ec9d-41ba-baa5-dc39f01b0446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:35:43.456023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4bfa8-ec9d-41ba-baa5-dc39f01b0446 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:35:43.466571 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4367/8770] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:35:43.566932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04602e-1b55-480a-8873-bdb1ff794269 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:43.567453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04602e-1b55-480a-8873-bdb1ff794269 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:43.567453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04602e-1b55-480a-8873-bdb1ff794269 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:43.569433 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4404/8771] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:35:43.575207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cbf82-93fd-40c9-b0fb-95340ddc42a8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:43.575575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cbf82-93fd-40c9-b0fb-95340ddc42a8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:43.575943 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cbf82-93fd-40c9-b0fb-95340ddc42a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:43.595172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-684cbf82-93fd-40c9-b0fb-95340ddc42a8 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:35:43.596492 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-684cbf82-93fd-40c9-b0fb-95340ddc42a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:35:43.605100 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4368/8772] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:35:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:35:43.624434 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04602e-1b55-480a-8873-bdb1ff794269 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:35:43.640863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04602e-1b55-480a-8873-bdb1ff794269 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:35:43.646100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f0d3-df9c-4627-839e-5a0aa8b60649 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:35:43.646720 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f0d3-df9c-4627-839e-5a0aa8b60649 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:43.646999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f0d3-df9c-4627-839e-5a0aa8b60649 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:43.647273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574f0d3-df9c-4627-839e-5a0aa8b60649 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:43.656020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574f0d3-df9c-4627-839e-5a0aa8b60649 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:35:43.657644 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b574f0d3-df9c-4627-839e-5a0aa8b60649 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:35:43.667075 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4405/8773] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:35:43.819038 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cbf82-93fd-40c9-b0fb-95340ddc42a8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:35:43.832030 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cbf82-93fd-40c9-b0fb-95340ddc42a8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:35:43.835616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24a51-6c5a-403e-9f72-4f0599778fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:35:43.836287 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24a51-6c5a-403e-9f72-4f0599778fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:35:43.836574 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24a51-6c5a-403e-9f72-4f0599778fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:35:43.836853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24a51-6c5a-403e-9f72-4f0599778fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:35:43.838590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-85e24a51-6c5a-403e-9f72-4f0599778fd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:35:43.853989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24a51-6c5a-403e-9f72-4f0599778fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:35:43.855477 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24a51-6c5a-403e-9f72-4f0599778fd3 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:35:43.868482 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4369/8774] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:35:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:36:08.505453 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f0d3-df9c-4627-839e-5a0aa8b60649 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:08.507024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b574f0d3-df9c-4627-839e-5a0aa8b60649 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:08.525779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574f0d3-df9c-4627-839e-5a0aa8b60649 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:08.531147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f9098-a68f-47d0-8aa2-ea5fc1f9bd22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:08.531782 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f9098-a68f-47d0-8aa2-ea5fc1f9bd22 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:08.532169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f9098-a68f-47d0-8aa2-ea5fc1f9bd22 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:08.532449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f9098-a68f-47d0-8aa2-ea5fc1f9bd22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:08.534198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fc1f9098-a68f-47d0-8aa2-ea5fc1f9bd22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:08.549327 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f9098-a68f-47d0-8aa2-ea5fc1f9bd22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:08.551187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f9098-a68f-47d0-8aa2-ea5fc1f9bd22 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:08.567511 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4406/8775] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:36:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:36:16.555697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24a51-6c5a-403e-9f72-4f0599778fd3 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:16.569519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24a51-6c5a-403e-9f72-4f0599778fd3 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:16.575100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceeabd-85d5-4fce-a04a-91a780395a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:16.575736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceeabd-85d5-4fce-a04a-91a780395a8b service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:16.576053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceeabd-85d5-4fce-a04a-91a780395a8b service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:16.576336 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceeabd-85d5-4fce-a04a-91a780395a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:16.578612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-51ceeabd-85d5-4fce-a04a-91a780395a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:16.593091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceeabd-85d5-4fce-a04a-91a780395a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:16.595380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceeabd-85d5-4fce-a04a-91a780395a8b service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:16.608516 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4370/8776] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:36:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:36:34.621689 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f9098-a68f-47d0-8aa2-ea5fc1f9bd22 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:34.632133 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f9098-a68f-47d0-8aa2-ea5fc1f9bd22 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:34.636673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:34.637534 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:34.637821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:34.638099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] PATH_INFO: `/v3/users/dc934eed0dcd45a3a4967a219b7d84a7` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:34.639314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc934eed0dcd45a3a4967a219b7d84a7)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:34.641784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:34.690510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc934eed0dcd45a3a4967a219b7d84a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:34.697460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc934eed0dcd45a3a4967a219b7d84a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:34.698152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc934eed0dcd45a3a4967a219b7d84a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:34.698842 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc934eed0dcd45a3a4967a219b7d84a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:34.706931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-464e914e-fcd3-4f44-bd7e-956e7db2514f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc934eed0dcd45a3a4967a219b7d84a7'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:34.724643 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4407/8777] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:36:34 2022] DELETE /identity/v3/users/dc934eed0dcd45a3a4967a219b7d84a7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:36:34.896872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceeabd-85d5-4fce-a04a-91a780395a8b service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:34.908361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceeabd-85d5-4fce-a04a-91a780395a8b service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:34.965460 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:34.966317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:34.966605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:34.966886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] PATH_INFO: `/v3/projects/ed4a3c1555504ccaaa90ea06f794d09a` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:34.968099 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4a3c1555504ccaaa90ea06f794d09a)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:34.970068 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:35.016317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4a3c1555504ccaaa90ea06f794d09a', 'request_id': 'req-c869c30d-64b4-4737-a56d-6e4e50273f79'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:35.025775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4a3c1555504ccaaa90ea06f794d09a', 'request_id': 'req-c869c30d-64b4-4737-a56d-6e4e50273f79'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:35.031087 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4a3c1555504ccaaa90ea06f794d09a', 'request_id': 'req-c869c30d-64b4-4737-a56d-6e4e50273f79'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:35.041801 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] The token cache is being invalidate because project ed4a3c1555504ccaaa90ea06f794d09a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:36:35.042011 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:35.042628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c869c30d-64b4-4737-a56d-6e4e50273f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:36:35.044184 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4371/8778] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:36:34 2022] DELETE /identity/v3/projects/ed4a3c1555504ccaaa90ea06f794d09a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:36:35.049128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73d3cf-871b-47a8-a12c-51d8f9c22851 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.049474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73d3cf-871b-47a8-a12c-51d8f9c22851 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.049765 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73d3cf-871b-47a8-a12c-51d8f9c22851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.068733 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ac73d3cf-871b-47a8-a12c-51d8f9c22851 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:36:35.069931 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ac73d3cf-871b-47a8-a12c-51d8f9c22851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:35.128051 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4408/8779] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:36:35.136093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff77958-66af-472e-9fd4-960ae3da3c98 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.136376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff77958-66af-472e-9fd4-960ae3da3c98 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.136657 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff77958-66af-472e-9fd4-960ae3da3c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.154350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fff77958-66af-472e-9fd4-960ae3da3c98 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:36:35.155517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fff77958-66af-472e-9fd4-960ae3da3c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:35.163349 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4372/8780] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:36:35.167369 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73d3cf-871b-47a8-a12c-51d8f9c22851 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:35.177775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73d3cf-871b-47a8-a12c-51d8f9c22851 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:35.182306 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c06a45-fc95-44f5-8bf9-8e6681cc8a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:35.182944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c06a45-fc95-44f5-8bf9-8e6681cc8a5a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.183225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c06a45-fc95-44f5-8bf9-8e6681cc8a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.183501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c06a45-fc95-44f5-8bf9-8e6681cc8a5a admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.184272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c06a45-fc95-44f5-8bf9-8e6681cc8a5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:36:35.184575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c06a45-fc95-44f5-8bf9-8e6681cc8a5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:35.186173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c06a45-fc95-44f5-8bf9-8e6681cc8a5a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:35.197909 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4409/8781] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:36:35.202040 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff77958-66af-472e-9fd4-960ae3da3c98 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:35.211254 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff77958-66af-472e-9fd4-960ae3da3c98 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:35.215962 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd16047-267b-4755-9ff9-6ef2dcdd559a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:35.216531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd16047-267b-4755-9ff9-6ef2dcdd559a admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.216817 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd16047-267b-4755-9ff9-6ef2dcdd559a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.217097 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd16047-267b-4755-9ff9-6ef2dcdd559a admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.217811 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd16047-267b-4755-9ff9-6ef2dcdd559a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:35.219786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd16047-267b-4755-9ff9-6ef2dcdd559a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:35.245359 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4373/8782] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:36:35 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:36:35.249178 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c06a45-fc95-44f5-8bf9-8e6681cc8a5a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:35.259508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c06a45-fc95-44f5-8bf9-8e6681cc8a5a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:35.314521 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cb607-114b-4a92-8038-04f88feb3444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:35.315181 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb607-114b-4a92-8038-04f88feb3444 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.315669 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb607-114b-4a92-8038-04f88feb3444 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.316053 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8cb607-114b-4a92-8038-04f88feb3444 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.317165 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cb607-114b-4a92-8038-04f88feb3444 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:35.319268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8cb607-114b-4a92-8038-04f88feb3444 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:35.339046 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4410/8783] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:36:35 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:36:35.343278 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd16047-267b-4755-9ff9-6ef2dcdd559a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:35.353454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd16047-267b-4755-9ff9-6ef2dcdd559a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:35.358071 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78262cb6-4b1c-4930-a855-a97568cba21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:35.358717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78262cb6-4b1c-4930-a855-a97568cba21b admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.359511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78262cb6-4b1c-4930-a855-a97568cba21b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.359789 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78262cb6-4b1c-4930-a855-a97568cba21b admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.360554 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78262cb6-4b1c-4930-a855-a97568cba21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:35.362180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78262cb6-4b1c-4930-a855-a97568cba21b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:35.373488 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4374/8784] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:36:35.377772 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cb607-114b-4a92-8038-04f88feb3444 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:35.387559 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8cb607-114b-4a92-8038-04f88feb3444 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:35.392161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b7664-6405-433d-90bf-ae81975ed336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:35.392794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b7664-6405-433d-90bf-ae81975ed336 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.393076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b7664-6405-433d-90bf-ae81975ed336 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.393348 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b7664-6405-433d-90bf-ae81975ed336 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.394052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b7664-6405-433d-90bf-ae81975ed336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:35.395638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b7664-6405-433d-90bf-ae81975ed336 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:35.405221 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4411/8785] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:36:35.409144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78262cb6-4b1c-4930-a855-a97568cba21b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:35.418890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78262cb6-4b1c-4930-a855-a97568cba21b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:35.424053 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb552b9-d603-4900-9f37-644fa92550c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:35.424915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb552b9-d603-4900-9f37-644fa92550c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.425199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb552b9-d603-4900-9f37-644fa92550c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.425475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb552b9-d603-4900-9f37-644fa92550c7 admin admin] PATH_INFO: `/v3/projects/e0f5a23725414492b27c2c670de3c618/users/0ad1f122bc764018a18ed3d7de21be56/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.440369 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb552b9-d603-4900-9f37-644fa92550c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f5a23725414492b27c2c670de3c618, user_id=0ad1f122bc764018a18ed3d7de21be56, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:35.443032 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb552b9-d603-4900-9f37-644fa92550c7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:35.455890 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4375/8786] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:36:35 2022] PUT /identity/v3/projects/e0f5a23725414492b27c2c670de3c618/users/0ad1f122bc764018a18ed3d7de21be56/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:36:35.461058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf01809-7440-47ae-a565-3590055399b7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.461419 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf01809-7440-47ae-a565-3590055399b7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.461762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf01809-7440-47ae-a565-3590055399b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.480149 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-edf01809-7440-47ae-a565-3590055399b7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:36:35.481333 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-edf01809-7440-47ae-a565-3590055399b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:35.537778 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4412/8787] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:36:35.547537 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb552b9-d603-4900-9f37-644fa92550c7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:35.549247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-5bb552b9-d603-4900-9f37-644fa92550c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:35.614744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb552b9-d603-4900-9f37-644fa92550c7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:35.618345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057121b-590b-46e8-874e-0bbf8701fa84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:35.618976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057121b-590b-46e8-874e-0bbf8701fa84 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:35.619279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057121b-590b-46e8-874e-0bbf8701fa84 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:35.619541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057121b-590b-46e8-874e-0bbf8701fa84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:35.628858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057121b-590b-46e8-874e-0bbf8701fa84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:35.630289 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057121b-590b-46e8-874e-0bbf8701fa84 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:35.639546 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4376/8788] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:36:36.234786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fae124-c979-4e79-8e74-d54b6d69cd6a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:36.235293 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fae124-c979-4e79-8e74-d54b6d69cd6a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:36.235379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fae124-c979-4e79-8e74-d54b6d69cd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:36.262041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b3fae124-c979-4e79-8e74-d54b6d69cd6a None None] MFA Rules not processed for user `0ad1f122bc764018a18ed3d7de21be56`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:36:36.263255 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b3fae124-c979-4e79-8e74-d54b6d69cd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:36.332601 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4413/8789] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:36:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:36:36.342617 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243ac21-2046-40da-b080-65c8fd08644f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:36.343130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243ac21-2046-40da-b080-65c8fd08644f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:36.343742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243ac21-2046-40da-b080-65c8fd08644f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:36.360976 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1243ac21-2046-40da-b080-65c8fd08644f None None] MFA Rules not processed for user `0ad1f122bc764018a18ed3d7de21be56`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:36:36.362186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1243ac21-2046-40da-b080-65c8fd08644f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:36.369153 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4377/8790] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:36:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:36:36.380608 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fae124-c979-4e79-8e74-d54b6d69cd6a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:36.382019 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b3fae124-c979-4e79-8e74-d54b6d69cd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:36.455575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fae124-c979-4e79-8e74-d54b6d69cd6a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:36.460942 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c2ef-5b00-4fc4-b12b-87e0a2686648 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:36.461577 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c2ef-5b00-4fc4-b12b-87e0a2686648 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:36.461857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c2ef-5b00-4fc4-b12b-87e0a2686648 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:36.462132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157c2ef-5b00-4fc4-b12b-87e0a2686648 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:36.470221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157c2ef-5b00-4fc4-b12b-87e0a2686648 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:36.471810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157c2ef-5b00-4fc4-b12b-87e0a2686648 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:36.480412 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4414/8791] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:36:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:36:37.003334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243ac21-2046-40da-b080-65c8fd08644f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:37.011061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1243ac21-2046-40da-b080-65c8fd08644f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:37.083035 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243ac21-2046-40da-b080-65c8fd08644f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:37.088339 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be8c8e4-ae1c-46fc-b222-3493e204caff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:37.088985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c8e4-ae1c-46fc-b222-3493e204caff service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:37.089270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c8e4-ae1c-46fc-b222-3493e204caff service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:37.089543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8c8e4-ae1c-46fc-b222-3493e204caff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:37.091310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4be8c8e4-ae1c-46fc-b222-3493e204caff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:37.104776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8c8e4-ae1c-46fc-b222-3493e204caff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:37.106371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be8c8e4-ae1c-46fc-b222-3493e204caff service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:37.118353 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4378/8792] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:36:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:36:38.608597 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c2ef-5b00-4fc4-b12b-87e0a2686648 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:36:38.620170 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157c2ef-5b00-4fc4-b12b-87e0a2686648 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:36:38.623625 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74138bcf-dca4-4aeb-b4ff-4e56afaadf16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:36:38.624280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74138bcf-dca4-4aeb-b4ff-4e56afaadf16 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:38.625235 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74138bcf-dca4-4aeb-b4ff-4e56afaadf16 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:38.625516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74138bcf-dca4-4aeb-b4ff-4e56afaadf16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:38.627254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-74138bcf-dca4-4aeb-b4ff-4e56afaadf16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:38.638879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74138bcf-dca4-4aeb-b4ff-4e56afaadf16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:36:38.641028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74138bcf-dca4-4aeb-b4ff-4e56afaadf16 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:36:38.651282 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4415/8793] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:36:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:36:46.432580 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359cf13-8b1c-4663-b867-95c7635f0e47 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:36:46.433132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359cf13-8b1c-4663-b867-95c7635f0e47 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:36:46.433132 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359cf13-8b1c-4663-b867-95c7635f0e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:36:46.450350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-e359cf13-8b1c-4663-b867-95c7635f0e47 None None] MFA Rules not processed for user `0ad1f122bc764018a18ed3d7de21be56`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:36:46.451526 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e359cf13-8b1c-4663-b867-95c7635f0e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:36:46.458881 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4379/8794] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:36:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:06.309767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74138bcf-dca4-4aeb-b4ff-4e56afaadf16 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:06.331233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74138bcf-dca4-4aeb-b4ff-4e56afaadf16 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:06.335797 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:06.336696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:06.336982 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:06.337262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] PATH_INFO: `/v3/users/0ad1f122bc764018a18ed3d7de21be56` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:06.338467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad1f122bc764018a18ed3d7de21be56)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:06.340440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:06.385573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad1f122bc764018a18ed3d7de21be56'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.392413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad1f122bc764018a18ed3d7de21be56'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.393076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad1f122bc764018a18ed3d7de21be56'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.393714 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad1f122bc764018a18ed3d7de21be56'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.399966 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-914a16f3-cc26-473c-ba78-9153effbde53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad1f122bc764018a18ed3d7de21be56'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.416933 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4416/8795] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:37:06 2022] DELETE /identity/v3/users/0ad1f122bc764018a18ed3d7de21be56 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:06.585539 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359cf13-8b1c-4663-b867-95c7635f0e47 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:06.598112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359cf13-8b1c-4663-b867-95c7635f0e47 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:06.652731 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:06.653525 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:06.653812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:06.654091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] PATH_INFO: `/v3/projects/e0f5a23725414492b27c2c670de3c618` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:06.655269 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f5a23725414492b27c2c670de3c618)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:06.657271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:06.701424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f5a23725414492b27c2c670de3c618', 'request_id': 'req-a87f3e97-bc93-4473-bf6c-45e1f876085f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.709119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f5a23725414492b27c2c670de3c618', 'request_id': 'req-a87f3e97-bc93-4473-bf6c-45e1f876085f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.714371 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f5a23725414492b27c2c670de3c618', 'request_id': 'req-a87f3e97-bc93-4473-bf6c-45e1f876085f'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.725386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] The token cache is being invalidate because project e0f5a23725414492b27c2c670de3c618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:37:06.725669 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.726290 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-a87f3e97-bc93-4473-bf6c-45e1f876085f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:06.727783 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4380/8796] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:37:06 2022] DELETE /identity/v3/projects/e0f5a23725414492b27c2c670de3c618 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:06.732814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2c8cc-fcf1-4bfe-a047-fb149abd2b6a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:06.733135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2c8cc-fcf1-4bfe-a047-fb149abd2b6a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:06.733416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2c8cc-fcf1-4bfe-a047-fb149abd2b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:06.751212 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a9b2c8cc-fcf1-4bfe-a047-fb149abd2b6a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:06.752454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a9b2c8cc-fcf1-4bfe-a047-fb149abd2b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:06.809668 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4417/8797] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:06.817675 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a9e69-72db-43f8-84e8-51601a09a8f7 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:06.817963 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a9e69-72db-43f8-84e8-51601a09a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:06.818247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a9e69-72db-43f8-84e8-51601a09a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:06.836560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-680a9e69-72db-43f8-84e8-51601a09a8f7 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:06.837730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-680a9e69-72db-43f8-84e8-51601a09a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:06.845501 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4381/8798] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:37:06.850262 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2c8cc-fcf1-4bfe-a047-fb149abd2b6a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:06.859863 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2c8cc-fcf1-4bfe-a047-fb149abd2b6a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:06.864484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0ad5-6a35-4758-8d34-a28524f926bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:06.865122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0ad5-6a35-4758-8d34-a28524f926bb admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:06.865407 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0ad5-6a35-4758-8d34-a28524f926bb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:06.865682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0ad5-6a35-4758-8d34-a28524f926bb admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:06.866389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda0ad5-6a35-4758-8d34-a28524f926bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:37:06.866692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda0ad5-6a35-4758-8d34-a28524f926bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:06.868324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda0ad5-6a35-4758-8d34-a28524f926bb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:06.880210 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4418/8799] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:37:06.884270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a9e69-72db-43f8-84e8-51601a09a8f7 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:06.893247 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a9e69-72db-43f8-84e8-51601a09a8f7 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:06.898472 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23337288-c1a4-4a32-a5b9-6596653f1b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:06.899102 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23337288-c1a4-4a32-a5b9-6596653f1b8c admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:06.899385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23337288-c1a4-4a32-a5b9-6596653f1b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:06.899661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23337288-c1a4-4a32-a5b9-6596653f1b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:06.900412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23337288-c1a4-4a32-a5b9-6596653f1b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:06.902308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23337288-c1a4-4a32-a5b9-6596653f1b8c admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:06.936203 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4382/8800] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:37:06 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:37:06.940296 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0ad5-6a35-4758-8d34-a28524f926bb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:06.950845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0ad5-6a35-4758-8d34-a28524f926bb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:07.005354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db35e3-d1cd-4467-b4be-6feda7b86156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:07.006021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db35e3-d1cd-4467-b4be-6feda7b86156 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:07.006305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db35e3-d1cd-4467-b4be-6feda7b86156 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:07.006583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db35e3-d1cd-4467-b4be-6feda7b86156 admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:07.007269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db35e3-d1cd-4467-b4be-6feda7b86156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:07.009240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db35e3-d1cd-4467-b4be-6feda7b86156 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:07.030644 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4419/8801] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:37:06 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:37:07.034724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23337288-c1a4-4a32-a5b9-6596653f1b8c admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:07.044859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23337288-c1a4-4a32-a5b9-6596653f1b8c admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:07.049427 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfafeb-43ac-4bcb-94bb-f246781bb02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:07.050069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfafeb-43ac-4bcb-94bb-f246781bb02f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:07.050351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfafeb-43ac-4bcb-94bb-f246781bb02f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:07.050623 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bfafeb-43ac-4bcb-94bb-f246781bb02f admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:07.051327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfafeb-43ac-4bcb-94bb-f246781bb02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:07.053227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bfafeb-43ac-4bcb-94bb-f246781bb02f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:07.063390 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4383/8802] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:37:07.067987 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db35e3-d1cd-4467-b4be-6feda7b86156 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:07.077928 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db35e3-d1cd-4467-b4be-6feda7b86156 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:07.083156 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9a4b0-8e21-4a90-8396-3ce8daec6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:07.083800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9a4b0-8e21-4a90-8396-3ce8daec6a3a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:07.084114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9a4b0-8e21-4a90-8396-3ce8daec6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:07.084395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9a4b0-8e21-4a90-8396-3ce8daec6a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:07.085120 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9a4b0-8e21-4a90-8396-3ce8daec6a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:07.086933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9a4b0-8e21-4a90-8396-3ce8daec6a3a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:07.097088 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4420/8803] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:37:07.101403 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfafeb-43ac-4bcb-94bb-f246781bb02f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:07.111387 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bfafeb-43ac-4bcb-94bb-f246781bb02f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:07.116085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f17598-ab45-42e2-b8de-9434eeffd3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:07.116948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f17598-ab45-42e2-b8de-9434eeffd3ca admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:07.117229 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f17598-ab45-42e2-b8de-9434eeffd3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:07.117505 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f17598-ab45-42e2-b8de-9434eeffd3ca admin admin] PATH_INFO: `/v3/projects/b1a809697bb84c9891a19af6aec49fd3/users/3444a0a8bbf8403ab7b2f457354104a0/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:07.132131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f17598-ab45-42e2-b8de-9434eeffd3ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a809697bb84c9891a19af6aec49fd3, user_id=3444a0a8bbf8403ab7b2f457354104a0, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:07.134798 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f17598-ab45-42e2-b8de-9434eeffd3ca admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:07.147048 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4384/8804] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:37:07 2022] PUT /identity/v3/projects/b1a809697bb84c9891a19af6aec49fd3/users/3444a0a8bbf8403ab7b2f457354104a0/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:07.157313 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c27ee5-e491-4091-adab-e3b058b21641 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:07.157622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c27ee5-e491-4091-adab-e3b058b21641 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:07.157926 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c27ee5-e491-4091-adab-e3b058b21641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:07.183799 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-50c27ee5-e491-4091-adab-e3b058b21641 None None] MFA Rules not processed for user `3444a0a8bbf8403ab7b2f457354104a0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:07.185020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-50c27ee5-e491-4091-adab-e3b058b21641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:07.246341 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4421/8805] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:37:07.256318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644992fd-3938-4861-bdac-27553b111ecf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:07.256606 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644992fd-3938-4861-bdac-27553b111ecf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:07.256883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644992fd-3938-4861-bdac-27553b111ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:07.291704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-644992fd-3938-4861-bdac-27553b111ecf None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:07.292907 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-644992fd-3938-4861-bdac-27553b111ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:07.341383 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4385/8806] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Mar 26 21:37:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:07.347294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c27ee5-e491-4091-adab-e3b058b21641 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:07.356763 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c27ee5-e491-4091-adab-e3b058b21641 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:07.360307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51807206-5339-4901-9930-5f1bdef8bb16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:07.360929 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51807206-5339-4901-9930-5f1bdef8bb16 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:07.361207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51807206-5339-4901-9930-5f1bdef8bb16 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:07.361481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51807206-5339-4901-9930-5f1bdef8bb16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:07.370065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51807206-5339-4901-9930-5f1bdef8bb16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:07.371490 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51807206-5339-4901-9930-5f1bdef8bb16 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:07.380698 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4422/8807] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:37:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:37:17.455207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644992fd-3938-4861-bdac-27553b111ecf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:17.517163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644992fd-3938-4861-bdac-27553b111ecf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:17.521658 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:17.522541 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:17.522843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:17.523111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] PATH_INFO: `/v3/users/3444a0a8bbf8403ab7b2f457354104a0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:17.524321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3444a0a8bbf8403ab7b2f457354104a0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:17.526236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:17.571139 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3444a0a8bbf8403ab7b2f457354104a0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:17.580511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3444a0a8bbf8403ab7b2f457354104a0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:17.581070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3444a0a8bbf8403ab7b2f457354104a0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:17.581659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3444a0a8bbf8403ab7b2f457354104a0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:17.592919 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3444a0a8bbf8403ab7b2f457354104a0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:17.604966 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4386/8808] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:37:17 2022] DELETE /identity/v3/users/3444a0a8bbf8403ab7b2f457354104a0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:17.609524 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78a2a-4852-4138-b8f8-0a3b4b736200 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:17.610012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78a2a-4852-4138-b8f8-0a3b4b736200 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:17.610112 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78a2a-4852-4138-b8f8-0a3b4b736200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:17.627572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-f7d78a2a-4852-4138-b8f8-0a3b4b736200 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:17.628819 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f7d78a2a-4852-4138-b8f8-0a3b4b736200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:17.684818 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4423/8809] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:37:17.694686 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:17.696235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:17.751172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228fee8-7cf4-4189-a759-b82ce8ed411f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:17.754926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5e50-3bfe-4bef-8aaa-d5adfb98cb9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:17.755559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5e50-3bfe-4bef-8aaa-d5adfb98cb9b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:17.755840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5e50-3bfe-4bef-8aaa-d5adfb98cb9b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:17.756140 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5e50-3bfe-4bef-8aaa-d5adfb98cb9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:17.765029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d5e50-3bfe-4bef-8aaa-d5adfb98cb9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:17.766465 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d5e50-3bfe-4bef-8aaa-d5adfb98cb9b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:17.776265 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4387/8810] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:37:17.939742 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d78a2a-4852-4138-b8f8-0a3b4b736200 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:17.941195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f7d78a2a-4852-4138-b8f8-0a3b4b736200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:17.953192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d78a2a-4852-4138-b8f8-0a3b4b736200 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:17.958572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:17.959498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:17.959871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:17.960344 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] PATH_INFO: `/v3/projects/b1a809697bb84c9891a19af6aec49fd3` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:17.961533 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a809697bb84c9891a19af6aec49fd3)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:17.963446 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:18.008124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a809697bb84c9891a19af6aec49fd3', 'request_id': 'req-47f4d8cd-bc24-476b-baa3-ac19e906a590'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:18.015117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a809697bb84c9891a19af6aec49fd3', 'request_id': 'req-47f4d8cd-bc24-476b-baa3-ac19e906a590'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:18.021234 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a809697bb84c9891a19af6aec49fd3', 'request_id': 'req-47f4d8cd-bc24-476b-baa3-ac19e906a590'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:18.032298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] The token cache is being invalidate because project b1a809697bb84c9891a19af6aec49fd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:37:18.032582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:18.033215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-47f4d8cd-bc24-476b-baa3-ac19e906a590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:18.035369 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4424/8811] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:37:17 2022] DELETE /identity/v3/projects/b1a809697bb84c9891a19af6aec49fd3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:18.040749 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314bc17-9045-43ea-ba41-bc55453e61be None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.041113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314bc17-9045-43ea-ba41-bc55453e61be None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.041400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314bc17-9045-43ea-ba41-bc55453e61be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.061386 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b314bc17-9045-43ea-ba41-bc55453e61be None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:18.062582 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b314bc17-9045-43ea-ba41-bc55453e61be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:18.119576 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4388/8812] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:18.127248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62483a16-be0f-4df7-a451-f6c63e69a06f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.127542 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62483a16-be0f-4df7-a451-f6c63e69a06f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.127821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62483a16-be0f-4df7-a451-f6c63e69a06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.147204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-62483a16-be0f-4df7-a451-f6c63e69a06f None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:18.148433 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-62483a16-be0f-4df7-a451-f6c63e69a06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:18.156341 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4425/8813] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:18.160684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314bc17-9045-43ea-ba41-bc55453e61be None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:18.170128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314bc17-9045-43ea-ba41-bc55453e61be None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:18.174845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80cb0f-510a-411d-88ed-18004b0c627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:18.175520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80cb0f-510a-411d-88ed-18004b0c627d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.175802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80cb0f-510a-411d-88ed-18004b0c627d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.176108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80cb0f-510a-411d-88ed-18004b0c627d admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.177072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80cb0f-510a-411d-88ed-18004b0c627d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:37:18.177380 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80cb0f-510a-411d-88ed-18004b0c627d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:18.178991 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80cb0f-510a-411d-88ed-18004b0c627d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:18.190427 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4389/8814] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:37:18.195437 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62483a16-be0f-4df7-a451-f6c63e69a06f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:18.205147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62483a16-be0f-4df7-a451-f6c63e69a06f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:18.210426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e68da-c7b0-4ed4-a079-315231e6e185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:18.211063 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e68da-c7b0-4ed4-a079-315231e6e185 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.211356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e68da-c7b0-4ed4-a079-315231e6e185 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.211630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e68da-c7b0-4ed4-a079-315231e6e185 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.212356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e68da-c7b0-4ed4-a079-315231e6e185 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:18.214277 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e68da-c7b0-4ed4-a079-315231e6e185 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:18.238476 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4426/8815] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:37:18 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:37:18.244745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80cb0f-510a-411d-88ed-18004b0c627d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:18.255111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80cb0f-510a-411d-88ed-18004b0c627d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:18.308163 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dc8f3-3dfa-4457-80f1-5d35fbe79d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:18.308808 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dc8f3-3dfa-4457-80f1-5d35fbe79d48 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.309088 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dc8f3-3dfa-4457-80f1-5d35fbe79d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.309361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dc8f3-3dfa-4457-80f1-5d35fbe79d48 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.310066 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dc8f3-3dfa-4457-80f1-5d35fbe79d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:18.311999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dc8f3-3dfa-4457-80f1-5d35fbe79d48 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:18.332010 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4390/8816] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:37:18 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:37:18.336207 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e68da-c7b0-4ed4-a079-315231e6e185 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:18.346390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e68da-c7b0-4ed4-a079-315231e6e185 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:18.350954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ef2f-618c-48f7-ae04-efd70955addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:18.351593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ef2f-618c-48f7-ae04-efd70955addd admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.351877 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ef2f-618c-48f7-ae04-efd70955addd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.352186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10ef2f-618c-48f7-ae04-efd70955addd admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.352921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10ef2f-618c-48f7-ae04-efd70955addd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:18.354562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10ef2f-618c-48f7-ae04-efd70955addd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:18.365715 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4427/8817] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:37:18.369694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dc8f3-3dfa-4457-80f1-5d35fbe79d48 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:18.379956 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dc8f3-3dfa-4457-80f1-5d35fbe79d48 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:18.384506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03915834-1615-4ca0-8f9a-96b1f54a202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:18.385146 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03915834-1615-4ca0-8f9a-96b1f54a202a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.385428 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03915834-1615-4ca0-8f9a-96b1f54a202a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.385704 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03915834-1615-4ca0-8f9a-96b1f54a202a admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.386409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03915834-1615-4ca0-8f9a-96b1f54a202a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:18.388114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03915834-1615-4ca0-8f9a-96b1f54a202a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:18.398217 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4391/8818] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:37:18.402249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ef2f-618c-48f7-ae04-efd70955addd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:18.412021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10ef2f-618c-48f7-ae04-efd70955addd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:18.416499 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6423f4d-83e4-4c2b-bae3-a88989729c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:18.417350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6423f4d-83e4-4c2b-bae3-a88989729c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.417629 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6423f4d-83e4-4c2b-bae3-a88989729c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.417899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6423f4d-83e4-4c2b-bae3-a88989729c79 admin admin] PATH_INFO: `/v3/projects/b329909bbfb746bebe37b9324889d7e4/users/47a16bb33047455c94c0471dd42a4297/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.432324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6423f4d-83e4-4c2b-bae3-a88989729c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b329909bbfb746bebe37b9324889d7e4, user_id=47a16bb33047455c94c0471dd42a4297, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:18.435116 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6423f4d-83e4-4c2b-bae3-a88989729c79 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:18.448347 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4428/8819] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:37:18 2022] PUT /identity/v3/projects/b329909bbfb746bebe37b9324889d7e4/users/47a16bb33047455c94c0471dd42a4297/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:37:18.458693 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afba25-0521-438a-8ea6-5574f426e31d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.459173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afba25-0521-438a-8ea6-5574f426e31d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.459305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afba25-0521-438a-8ea6-5574f426e31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.485495 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-52afba25-0521-438a-8ea6-5574f426e31d None None] MFA Rules not processed for user `47a16bb33047455c94c0471dd42a4297`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:18.486714 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-52afba25-0521-438a-8ea6-5574f426e31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:18.548125 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4392/8820] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:18.558425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487458-a221-4fdf-a542-baf5ab606ffd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.558718 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487458-a221-4fdf-a542-baf5ab606ffd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.558998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32487458-a221-4fdf-a542-baf5ab606ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.577328 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-32487458-a221-4fdf-a542-baf5ab606ffd None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:18.578508 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-32487458-a221-4fdf-a542-baf5ab606ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:18.630245 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4429/8821] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Mar 26 21:37:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:18.636182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afba25-0521-438a-8ea6-5574f426e31d None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:18.645570 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afba25-0521-438a-8ea6-5574f426e31d None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:18.649203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd50ee9-545d-461f-ad9b-18eaeec4a6db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:18.649829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd50ee9-545d-461f-ad9b-18eaeec4a6db service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:18.650109 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd50ee9-545d-461f-ad9b-18eaeec4a6db service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:18.650384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd50ee9-545d-461f-ad9b-18eaeec4a6db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:18.658642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd50ee9-545d-461f-ad9b-18eaeec4a6db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:18.660126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd50ee9-545d-461f-ad9b-18eaeec4a6db service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:18.668719 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4393/8822] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:37:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:37:22.791268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487458-a221-4fdf-a542-baf5ab606ffd None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:22.852239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32487458-a221-4fdf-a542-baf5ab606ffd None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:22.856630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:22.857484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:22.857762 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:22.858033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] PATH_INFO: `/v3/users/47a16bb33047455c94c0471dd42a4297` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:22.859218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a16bb33047455c94c0471dd42a4297)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:22.861188 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:22.905065 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a16bb33047455c94c0471dd42a4297'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:22.911673 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a16bb33047455c94c0471dd42a4297'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:22.912373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a16bb33047455c94c0471dd42a4297'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:22.912963 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a16bb33047455c94c0471dd42a4297'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:22.920248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a16bb33047455c94c0471dd42a4297'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:22.937341 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4430/8823] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:37:22 2022] DELETE /identity/v3/users/47a16bb33047455c94c0471dd42a4297 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:22.942377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e911fd-c5f2-4561-8bf2-5634aa96a8c8 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:22.942880 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e911fd-c5f2-4561-8bf2-5634aa96a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:22.942987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e911fd-c5f2-4561-8bf2-5634aa96a8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:22.960567 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-96e911fd-c5f2-4561-8bf2-5634aa96a8c8 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:22.961737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-96e911fd-c5f2-4561-8bf2-5634aa96a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:23.016304 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4394/8824] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:23.026584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:23.028056 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:23.084157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdcd01-cccb-4b8c-b4e9-f0bd7458081a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:23.088121 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c055d6e-2eec-4c33-b53f-f2da0448a9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:23.088989 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c055d6e-2eec-4c33-b53f-f2da0448a9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.089281 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c055d6e-2eec-4c33-b53f-f2da0448a9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.089630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c055d6e-2eec-4c33-b53f-f2da0448a9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.099226 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c055d6e-2eec-4c33-b53f-f2da0448a9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:23.100726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c055d6e-2eec-4c33-b53f-f2da0448a9b0 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:23.110196 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4431/8825] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:37:23.279028 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e911fd-c5f2-4561-8bf2-5634aa96a8c8 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:23.280476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-96e911fd-c5f2-4561-8bf2-5634aa96a8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:23.292742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e911fd-c5f2-4561-8bf2-5634aa96a8c8 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:23.297416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:23.298326 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.298614 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.298886 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] PATH_INFO: `/v3/projects/b329909bbfb746bebe37b9324889d7e4` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.300794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b329909bbfb746bebe37b9324889d7e4)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:23.303007 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:23.347448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b329909bbfb746bebe37b9324889d7e4', 'request_id': 'req-c6803986-42d5-4357-8097-cb513a47ee41'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:23.354199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b329909bbfb746bebe37b9324889d7e4', 'request_id': 'req-c6803986-42d5-4357-8097-cb513a47ee41'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:23.359646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b329909bbfb746bebe37b9324889d7e4', 'request_id': 'req-c6803986-42d5-4357-8097-cb513a47ee41'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:23.371353 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] The token cache is being invalidate because project b329909bbfb746bebe37b9324889d7e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:37:23.371605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:23.372248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-c6803986-42d5-4357-8097-cb513a47ee41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:37:23.373758 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4395/8826] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:37:23 2022] DELETE /identity/v3/projects/b329909bbfb746bebe37b9324889d7e4 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:23.380230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a595e7-a134-4730-a9cb-fa7d6d0b96f0 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.380522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a595e7-a134-4730-a9cb-fa7d6d0b96f0 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.380804 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a595e7-a134-4730-a9cb-fa7d6d0b96f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.398630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-e6a595e7-a134-4730-a9cb-fa7d6d0b96f0 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:23.399821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e6a595e7-a134-4730-a9cb-fa7d6d0b96f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:23.456599 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4432/8827] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:37:23.464370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707909-79d1-492a-9e8d-547035987a5c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.464663 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707909-79d1-492a-9e8d-547035987a5c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.464939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d707909-79d1-492a-9e8d-547035987a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.483418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-6d707909-79d1-492a-9e8d-547035987a5c None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:23.484619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6d707909-79d1-492a-9e8d-547035987a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:23.493125 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4396/8828] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:23.497414 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a595e7-a134-4730-a9cb-fa7d6d0b96f0 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:23.506949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a595e7-a134-4730-a9cb-fa7d6d0b96f0 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:23.511380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dd421-8fb3-45c0-aa09-c0d74a9f0044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:23.512049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dd421-8fb3-45c0-aa09-c0d74a9f0044 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.512331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dd421-8fb3-45c0-aa09-c0d74a9f0044 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.512605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dd421-8fb3-45c0-aa09-c0d74a9f0044 admin admin] PATH_INFO: `/v3/domains` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.513312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dd421-8fb3-45c0-aa09-c0d74a9f0044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97202) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:37:23.513612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dd421-8fb3-45c0-aa09-c0d74a9f0044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:23.515204 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dd421-8fb3-45c0-aa09-c0d74a9f0044 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:23.526318 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4433/8829] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 26 21:37:23.530519 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d707909-79d1-492a-9e8d-547035987a5c None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:23.540166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d707909-79d1-492a-9e8d-547035987a5c None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:23.544862 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e89813-47da-4946-ab83-8532c4ed8d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:23.545497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e89813-47da-4946-ab83-8532c4ed8d59 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.545780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e89813-47da-4946-ab83-8532c4ed8d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.546057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e89813-47da-4946-ab83-8532c4ed8d59 admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.546743 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e89813-47da-4946-ab83-8532c4ed8d59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:23.548688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e89813-47da-4946-ab83-8532c4ed8d59 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:23.573594 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4397/8830] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:37:23 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:37:23.577738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dd421-8fb3-45c0-aa09-c0d74a9f0044 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:23.587496 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dd421-8fb3-45c0-aa09-c0d74a9f0044 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:23.640920 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cda788-5c71-4db1-958e-cbb0e692834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:23.641645 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cda788-5c71-4db1-958e-cbb0e692834a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.641935 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cda788-5c71-4db1-958e-cbb0e692834a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.642216 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cda788-5c71-4db1-958e-cbb0e692834a admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.642906 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cda788-5c71-4db1-958e-cbb0e692834a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:23.644883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cda788-5c71-4db1-958e-cbb0e692834a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:23.664110 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4434/8831] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:37:23 2022] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:37:23.668279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e89813-47da-4946-ab83-8532c4ed8d59 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:23.679425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e89813-47da-4946-ab83-8532c4ed8d59 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:23.684128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2477e-d999-4d58-b03d-2c91cc515030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:23.684794 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2477e-d999-4d58-b03d-2c91cc515030 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.685075 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2477e-d999-4d58-b03d-2c91cc515030 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.685345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2477e-d999-4d58-b03d-2c91cc515030 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.686054 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2477e-d999-4d58-b03d-2c91cc515030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:23.687646 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2477e-d999-4d58-b03d-2c91cc515030 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:23.697763 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4398/8832] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:37:23.701452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cda788-5c71-4db1-958e-cbb0e692834a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:23.711286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cda788-5c71-4db1-958e-cbb0e692834a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:23.715865 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c569-e7fa-4bae-a23c-e87880cce971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:23.716536 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c569-e7fa-4bae-a23c-e87880cce971 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.716821 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c569-e7fa-4bae-a23c-e87880cce971 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.717095 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c569-e7fa-4bae-a23c-e87880cce971 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.717802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14c569-e7fa-4bae-a23c-e87880cce971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:23.719388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14c569-e7fa-4bae-a23c-e87880cce971 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:23.729452 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4435/8833] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:37:23.733455 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2477e-d999-4d58-b03d-2c91cc515030 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:23.744110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2477e-d999-4d58-b03d-2c91cc515030 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:23.748699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79253e-c135-4c10-ae0e-15db5754e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:23.749559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79253e-c135-4c10-ae0e-15db5754e3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.749843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79253e-c135-4c10-ae0e-15db5754e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.750119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79253e-c135-4c10-ae0e-15db5754e3f7 admin admin] PATH_INFO: `/v3/projects/3f9ed2569761414ba8a5c29042b497d5/users/77f6288194244de28dc65b917c20c3c7/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.765406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79253e-c135-4c10-ae0e-15db5754e3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9ed2569761414ba8a5c29042b497d5, user_id=77f6288194244de28dc65b917c20c3c7, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:23.768172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79253e-c135-4c10-ae0e-15db5754e3f7 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:23.781593 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4399/8834] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:37:23 2022] PUT /identity/v3/projects/3f9ed2569761414ba8a5c29042b497d5/users/77f6288194244de28dc65b917c20c3c7/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:23.787197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b4d1-db0e-4718-a054-18d2d2c1ac63 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.787489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b4d1-db0e-4718-a054-18d2d2c1ac63 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.787768 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322b4d1-db0e-4718-a054-18d2d2c1ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.805167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4322b4d1-db0e-4718-a054-18d2d2c1ac63 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:23.806345 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4322b4d1-db0e-4718-a054-18d2d2c1ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:23.862099 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4436/8835] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:23.871603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79253e-c135-4c10-ae0e-15db5754e3f7 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:23.873318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ee79253e-c135-4c10-ae0e-15db5754e3f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:23.928607 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79253e-c135-4c10-ae0e-15db5754e3f7 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:23.932209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0282eb-34c6-47b9-b03a-87b2e7008efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:23.932845 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0282eb-34c6-47b9-b03a-87b2e7008efa service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:23.933129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0282eb-34c6-47b9-b03a-87b2e7008efa service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:23.933408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0282eb-34c6-47b9-b03a-87b2e7008efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:23.942328 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0282eb-34c6-47b9-b03a-87b2e7008efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:23.943765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0282eb-34c6-47b9-b03a-87b2e7008efa service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:23.953092 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4400/8836] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:37:27.952957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572e75-b7e7-43e2-a410-99b8b466c242 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:27.953850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572e75-b7e7-43e2-a410-99b8b466c242 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:27.954139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572e75-b7e7-43e2-a410-99b8b466c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:27.982337 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-b7572e75-b7e7-43e2-a410-99b8b466c242 None None] MFA Rules not processed for user `77f6288194244de28dc65b917c20c3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:27.983759 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-b7572e75-b7e7-43e2-a410-99b8b466c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:28.058732 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4437/8837] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:28.063297 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0282eb-34c6-47b9-b03a-87b2e7008efa service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:28.073209 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0282eb-34c6-47b9-b03a-87b2e7008efa service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:28.077860 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b40e-0197-48ff-8c00-46535434e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:28.078503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b40e-0197-48ff-8c00-46535434e9fb admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:28.078786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b40e-0197-48ff-8c00-46535434e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:28.079063 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2b40e-0197-48ff-8c00-46535434e9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:28.079750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2b40e-0197-48ff-8c00-46535434e9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:28.081812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2b40e-0197-48ff-8c00-46535434e9fb admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:28.109878 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4401/8838] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:37:28 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:37:28.114617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572e75-b7e7-43e2-a410-99b8b466c242 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:28.126354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572e75-b7e7-43e2-a410-99b8b466c242 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:28.197138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad96f7-fbf6-4efa-88ba-d43ee41af3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:28.197760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad96f7-fbf6-4efa-88ba-d43ee41af3dd admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:28.198042 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad96f7-fbf6-4efa-88ba-d43ee41af3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:28.198320 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad96f7-fbf6-4efa-88ba-d43ee41af3dd admin admin] PATH_INFO: `/v3/users` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:28.199016 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad96f7-fbf6-4efa-88ba-d43ee41af3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:28.202324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad96f7-fbf6-4efa-88ba-d43ee41af3dd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:28.226834 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4438/8839] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:37:28 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:37:28.228116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b40e-0197-48ff-8c00-46535434e9fb admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:28.239661 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2b40e-0197-48ff-8c00-46535434e9fb admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:28.244517 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb29a1a-863c-4e2c-9c34-a5fc08a92c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:28.245183 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29a1a-863c-4e2c-9c34-a5fc08a92c99 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:28.245466 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29a1a-863c-4e2c-9c34-a5fc08a92c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:28.245742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb29a1a-863c-4e2c-9c34-a5fc08a92c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:28.246464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb29a1a-863c-4e2c-9c34-a5fc08a92c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:28.248117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb29a1a-863c-4e2c-9c34-a5fc08a92c99 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:28.259227 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4402/8840] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:37:28.263818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad96f7-fbf6-4efa-88ba-d43ee41af3dd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:28.274884 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad96f7-fbf6-4efa-88ba-d43ee41af3dd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:28.282347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1a71-2d7f-40d5-9e50-c34087977624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:28.283329 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1a71-2d7f-40d5-9e50-c34087977624 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:28.283624 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1a71-2d7f-40d5-9e50-c34087977624 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:28.283905 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1a71-2d7f-40d5-9e50-c34087977624 admin admin] PATH_INFO: `/v3/projects/ad00308141aa417cad3dbd5158dbacd8/users/244babb0b86c479186fada97182755c7/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:28.301049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba1a71-2d7f-40d5-9e50-c34087977624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad00308141aa417cad3dbd5158dbacd8, user_id=244babb0b86c479186fada97182755c7, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:28.304100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba1a71-2d7f-40d5-9e50-c34087977624 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:28.317869 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4439/8841] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:37:28 2022] PUT /identity/v3/projects/ad00308141aa417cad3dbd5158dbacd8/users/244babb0b86c479186fada97182755c7/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:28.321903 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb29a1a-863c-4e2c-9c34-a5fc08a92c99 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:28.332599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb29a1a-863c-4e2c-9c34-a5fc08a92c99 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:28.389242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bdd532-738c-40c0-be35-87272b7bb6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:28.389913 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd532-738c-40c0-be35-87272b7bb6dd admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:28.390194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd532-738c-40c0-be35-87272b7bb6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:28.390470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd532-738c-40c0-be35-87272b7bb6dd admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:28.391188 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdd532-738c-40c0-be35-87272b7bb6dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:28.392855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bdd532-738c-40c0-be35-87272b7bb6dd admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:28.403821 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4403/8842] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:37:28.407998 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1a71-2d7f-40d5-9e50-c34087977624 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:28.419195 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1a71-2d7f-40d5-9e50-c34087977624 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:28.424030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df353f3f-89f2-4a73-8f4a-bd665b8f754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:28.424954 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df353f3f-89f2-4a73-8f4a-bd665b8f754f admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:28.425801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df353f3f-89f2-4a73-8f4a-bd665b8f754f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:28.425801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df353f3f-89f2-4a73-8f4a-bd665b8f754f admin admin] PATH_INFO: `/v3/projects/ad00308141aa417cad3dbd5158dbacd8/users/244babb0b86c479186fada97182755c7/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:28.427786 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df353f3f-89f2-4a73-8f4a-bd665b8f754f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad00308141aa417cad3dbd5158dbacd8, user_id=244babb0b86c479186fada97182755c7, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:28.430522 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df353f3f-89f2-4a73-8f4a-bd665b8f754f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:28.441633 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4440/8843] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:37:28 2022] PUT /identity/v3/projects/ad00308141aa417cad3dbd5158dbacd8/users/244babb0b86c479186fada97182755c7/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:37:32.701747 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d75d-63c3-4c56-abec-cc6011d54f49 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:32.702191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d75d-63c3-4c56-abec-cc6011d54f49 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:32.702376 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1d75d-63c3-4c56-abec-cc6011d54f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:32.736608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d5a1d75d-63c3-4c56-abec-cc6011d54f49 None None] MFA Rules not processed for user `244babb0b86c479186fada97182755c7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:32.738077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d5a1d75d-63c3-4c56-abec-cc6011d54f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:32.835805 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4404/8844] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:32.873331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df353f3f-89f2-4a73-8f4a-bd665b8f754f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:32.875068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df353f3f-89f2-4a73-8f4a-bd665b8f754f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:32.946280 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df353f3f-89f2-4a73-8f4a-bd665b8f754f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:32.950409 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b06833-4886-4455-8566-6ed2334c2f62 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:32.951057 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06833-4886-4455-8566-6ed2334c2f62 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:32.951343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06833-4886-4455-8566-6ed2334c2f62 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:32.951618 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b06833-4886-4455-8566-6ed2334c2f62 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:33.025585 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b06833-4886-4455-8566-6ed2334c2f62 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:33.027623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b06833-4886-4455-8566-6ed2334c2f62 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:33.038827 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4441/8845] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:37:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:37:33.172318 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5dc70-2b91-4ad3-9560-f87df960b99f None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:33.172736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5dc70-2b91-4ad3-9560-f87df960b99f None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:33.173120 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5dc70-2b91-4ad3-9560-f87df960b99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:33.232190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-ebf5dc70-2b91-4ad3-9560-f87df960b99f None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:33.233451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ebf5dc70-2b91-4ad3-9560-f87df960b99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:33.298789 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4405/8846] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:37:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:33.355425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b06833-4886-4455-8566-6ed2334c2f62 service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:33.356923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-f7b06833-4886-4455-8566-6ed2334c2f62 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:33.468570 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b06833-4886-4455-8566-6ed2334c2f62 service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:33.474259 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d47e81-3c8d-4de8-be01-2b309294d61e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:33.474917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d47e81-3c8d-4de8-be01-2b309294d61e service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:33.475194 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d47e81-3c8d-4de8-be01-2b309294d61e service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:33.475472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d47e81-3c8d-4de8-be01-2b309294d61e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:33.484701 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d47e81-3c8d-4de8-be01-2b309294d61e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:33.486218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d47e81-3c8d-4de8-be01-2b309294d61e service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:33.495578 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4442/8847] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:37:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 21:37:36.080212 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5dc70-2b91-4ad3-9560-f87df960b99f None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:36.081964 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ebf5dc70-2b91-4ad3-9560-f87df960b99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:36.190802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5dc70-2b91-4ad3-9560-f87df960b99f None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:36.196635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aaf70a-b0fe-411e-8221-08ca85c22953 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:36.197285 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf70a-b0fe-411e-8221-08ca85c22953 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:36.197593 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf70a-b0fe-411e-8221-08ca85c22953 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:36.197877 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aaf70a-b0fe-411e-8221-08ca85c22953 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:36.199722 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-27aaf70a-b0fe-411e-8221-08ca85c22953 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:36.215521 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaf70a-b0fe-411e-8221-08ca85c22953 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:36.218208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aaf70a-b0fe-411e-8221-08ca85c22953 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:36.281000 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4406/8848] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:37:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:37:41.091373 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d47e81-3c8d-4de8-be01-2b309294d61e service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:41.111572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-70d47e81-3c8d-4de8-be01-2b309294d61e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:41.130415 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d47e81-3c8d-4de8-be01-2b309294d61e service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:41.136030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df69bd-0116-4fb8-a85a-f7b35620fd57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:41.136936 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df69bd-0116-4fb8-a85a-f7b35620fd57 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:41.137444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df69bd-0116-4fb8-a85a-f7b35620fd57 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:41.138051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df69bd-0116-4fb8-a85a-f7b35620fd57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:41.140062 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a9df69bd-0116-4fb8-a85a-f7b35620fd57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:41.170031 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df69bd-0116-4fb8-a85a-f7b35620fd57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:41.171713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df69bd-0116-4fb8-a85a-f7b35620fd57 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:41.186161 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4443/8849] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:37:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:37:42.894615 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f464e87-fea4-411b-92b9-2362733c4c13 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:42.895200 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f464e87-fea4-411b-92b9-2362733c4c13 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:42.895307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f464e87-fea4-411b-92b9-2362733c4c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:42.913080 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2f464e87-fea4-411b-92b9-2362733c4c13 None None] MFA Rules not processed for user `77f6288194244de28dc65b917c20c3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:42.914270 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2f464e87-fea4-411b-92b9-2362733c4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:42.921086 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4407/8850] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:37:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:37:44.802154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cf2fb-c437-4e70-9d95-b9b6d6ac496d None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:44.802796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cf2fb-c437-4e70-9d95-b9b6d6ac496d None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:44.802916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633cf2fb-c437-4e70-9d95-b9b6d6ac496d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:44.821565 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-633cf2fb-c437-4e70-9d95-b9b6d6ac496d None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:37:44.822764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-633cf2fb-c437-4e70-9d95-b9b6d6ac496d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:37:44.830132 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4444/8851] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:37:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:37:44.842459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f464e87-fea4-411b-92b9-2362733c4c13 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:37:44.857434 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f464e87-fea4-411b-92b9-2362733c4c13 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:37:44.862867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c360a-a608-46e3-b50f-9376fb8ccd7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:37:44.863546 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c360a-a608-46e3-b50f-9376fb8ccd7a service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:37:44.863899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c360a-a608-46e3-b50f-9376fb8ccd7a service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:37:44.864211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c360a-a608-46e3-b50f-9376fb8ccd7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:37:44.872591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c360a-a608-46e3-b50f-9376fb8ccd7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:37:44.874186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c360a-a608-46e3-b50f-9376fb8ccd7a service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:37:44.882746 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4408/8852] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:37:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:38:06.414552 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cf2fb-c437-4e70-9d95-b9b6d6ac496d None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:38:06.466454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633cf2fb-c437-4e70-9d95-b9b6d6ac496d None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:38:06.470041 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a293ec2-4da0-44c7-bb74-32f9645996fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:38:06.470671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293ec2-4da0-44c7-bb74-32f9645996fe service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:38:06.470957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293ec2-4da0-44c7-bb74-32f9645996fe service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:38:06.471239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293ec2-4da0-44c7-bb74-32f9645996fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:38:06.480343 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a293ec2-4da0-44c7-bb74-32f9645996fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:38:06.481792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a293ec2-4da0-44c7-bb74-32f9645996fe service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:38:06.491832 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4445/8853] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:38:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:38:08.139737 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c360a-a608-46e3-b50f-9376fb8ccd7a service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:38:08.141406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-108c360a-a608-46e3-b50f-9376fb8ccd7a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:38:08.251272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c360a-a608-46e3-b50f-9376fb8ccd7a service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:38:08.264394 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e7f17-cf8b-4743-a46a-c43005730786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:38:08.265134 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e7f17-cf8b-4743-a46a-c43005730786 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:38:08.265420 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e7f17-cf8b-4743-a46a-c43005730786 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:38:08.265703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e7f17-cf8b-4743-a46a-c43005730786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:38:08.268395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-156e7f17-cf8b-4743-a46a-c43005730786 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:38:08.295019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e7f17-cf8b-4743-a46a-c43005730786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:38:08.296951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e7f17-cf8b-4743-a46a-c43005730786 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:38:08.320209 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4409/8854] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:38:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:39:27.850036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b2a9d-67f4-4b2a-8f39-d8a80f4269d7 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:27.850599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b2a9d-67f4-4b2a-8f39-d8a80f4269d7 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:27.850599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b2a9d-67f4-4b2a-8f39-d8a80f4269d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:27.868298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c86b2a9d-67f4-4b2a-8f39-d8a80f4269d7 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:39:27.869596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c86b2a9d-67f4-4b2a-8f39-d8a80f4269d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:27.877776 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4446/8855] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:39:27.917443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb519c1-d656-4552-8942-4de6c37076bf None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:27.917949 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb519c1-d656-4552-8942-4de6c37076bf None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:27.918061 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb519c1-d656-4552-8942-4de6c37076bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:27.954673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2eb519c1-d656-4552-8942-4de6c37076bf None None] MFA Rules not processed for user `08d764c8ff5f48a092bd69030c5e1b47`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:39:27.955850 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2eb519c1-d656-4552-8942-4de6c37076bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:27.964865 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4410/8856] 10.222.0.16 () {58 vars in 1039 bytes} [Sat Mar 26 21:39:27 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:39:27.970971 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b2a9d-67f4-4b2a-8f39-d8a80f4269d7 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:27.982567 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b2a9d-67f4-4b2a-8f39-d8a80f4269d7 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:27.988217 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c5f44-8a3a-4f4d-8dc3-e42ee55e36e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:27.988854 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c5f44-8a3a-4f4d-8dc3-e42ee55e36e5 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:27.989139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c5f44-8a3a-4f4d-8dc3-e42ee55e36e5 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:27.989416 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c5f44-8a3a-4f4d-8dc3-e42ee55e36e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:27.997540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c5f44-8a3a-4f4d-8dc3-e42ee55e36e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:27.999131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c5f44-8a3a-4f4d-8dc3-e42ee55e36e5 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:28.010303 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4447/8857] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:39:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 21:39:35.298491 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb519c1-d656-4552-8942-4de6c37076bf None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:35.359690 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb519c1-d656-4552-8942-4de6c37076bf None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:35.364189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:35.365043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:35.365323 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:35.365596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] PATH_INFO: `/v3/users/77f6288194244de28dc65b917c20c3c7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:35.366750 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77f6288194244de28dc65b917c20c3c7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:35.368725 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:35.413288 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77f6288194244de28dc65b917c20c3c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.419867 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77f6288194244de28dc65b917c20c3c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.420527 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77f6288194244de28dc65b917c20c3c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.421124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77f6288194244de28dc65b917c20c3c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.432766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77f6288194244de28dc65b917c20c3c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.444664 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4411/8858] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:39:35 2022] DELETE /identity/v3/users/77f6288194244de28dc65b917c20c3c7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:39:35.615131 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c5f44-8a3a-4f4d-8dc3-e42ee55e36e5 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:35.629425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c5f44-8a3a-4f4d-8dc3-e42ee55e36e5 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:35.687575 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:35.688483 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:35.688770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:35.689046 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] PATH_INFO: `/v3/projects/3f9ed2569761414ba8a5c29042b497d5` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:35.690310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9ed2569761414ba8a5c29042b497d5)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:35.692747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:35.742771 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9ed2569761414ba8a5c29042b497d5', 'request_id': 'req-00977cc5-f52d-407e-a17c-ca07c00904ce'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.750380 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9ed2569761414ba8a5c29042b497d5', 'request_id': 'req-00977cc5-f52d-407e-a17c-ca07c00904ce'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.758206 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9ed2569761414ba8a5c29042b497d5', 'request_id': 'req-00977cc5-f52d-407e-a17c-ca07c00904ce'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.770049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] The token cache is being invalidate because project 3f9ed2569761414ba8a5c29042b497d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:39:35.770336 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.770997 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.772567 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4448/8859] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:39:35 2022] DELETE /identity/v3/projects/3f9ed2569761414ba8a5c29042b497d5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:39:35.776640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:35.778056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:35.791479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a6dbfd-68bf-4c9e-8c3f-b9775d719936 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:35.850340 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:35.851215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:35.851488 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:35.851759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] PATH_INFO: `/v3/users/244babb0b86c479186fada97182755c7` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:35.853017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=244babb0b86c479186fada97182755c7)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:35.854983 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:35.899692 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '244babb0b86c479186fada97182755c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.905998 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '244babb0b86c479186fada97182755c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.906679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '244babb0b86c479186fada97182755c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.907284 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '244babb0b86c479186fada97182755c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.918482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-08230995-94d3-41cb-aad8-5900fa204327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '244babb0b86c479186fada97182755c7'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:35.930923 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4412/8860] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:39:35 2022] DELETE /identity/v3/users/244babb0b86c479186fada97182755c7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:39:36.104406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.106050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:36.119353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00977cc5-f52d-407e-a17c-ca07c00904ce admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.173250 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.174101 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.174383 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.174660 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] PATH_INFO: `/v3/projects/ad00308141aa417cad3dbd5158dbacd8` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.175833 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad00308141aa417cad3dbd5158dbacd8)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.178037 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.223422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad00308141aa417cad3dbd5158dbacd8', 'request_id': 'req-b7dd1b24-9878-4b99-9e1f-4eb681267478'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:36.230510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad00308141aa417cad3dbd5158dbacd8', 'request_id': 'req-b7dd1b24-9878-4b99-9e1f-4eb681267478'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:36.236100 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad00308141aa417cad3dbd5158dbacd8', 'request_id': 'req-b7dd1b24-9878-4b99-9e1f-4eb681267478'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:36.248103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] The token cache is being invalidate because project ad00308141aa417cad3dbd5158dbacd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:39:36.248394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:36.249049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b7dd1b24-9878-4b99-9e1f-4eb681267478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:39:36.250604 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4449/8861] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:39:36 2022] DELETE /identity/v3/projects/ad00308141aa417cad3dbd5158dbacd8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:39:36.255757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964a86-3cfd-419b-aeab-dbc119e7ced4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.256144 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964a86-3cfd-419b-aeab-dbc119e7ced4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.256430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89964a86-3cfd-419b-aeab-dbc119e7ced4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.273513 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-89964a86-3cfd-419b-aeab-dbc119e7ced4 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:39:36.274682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-89964a86-3cfd-419b-aeab-dbc119e7ced4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:36.332880 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4413/8862] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:39:36.340637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4bad-f6a8-4ed5-a313-09425bd7aa51 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.340934 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4bad-f6a8-4ed5-a313-09425bd7aa51 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.341213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4bad-f6a8-4ed5-a313-09425bd7aa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.359562 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-948c4bad-f6a8-4ed5-a313-09425bd7aa51 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:39:36.360807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-948c4bad-f6a8-4ed5-a313-09425bd7aa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:36.369306 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4450/8863] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:39:36.373296 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89964a86-3cfd-419b-aeab-dbc119e7ced4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.382795 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89964a86-3cfd-419b-aeab-dbc119e7ced4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.387592 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1676b-cdd2-4350-8c75-6738d5481a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.388295 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1676b-cdd2-4350-8c75-6738d5481a4a admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.388586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1676b-cdd2-4350-8c75-6738d5481a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.388870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1676b-cdd2-4350-8c75-6738d5481a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.389591 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1676b-cdd2-4350-8c75-6738d5481a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:39:36.389900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1676b-cdd2-4350-8c75-6738d5481a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.391596 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1676b-cdd2-4350-8c75-6738d5481a4a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.403660 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4414/8864] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:39:36.407810 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4bad-f6a8-4ed5-a313-09425bd7aa51 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.417573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4bad-f6a8-4ed5-a313-09425bd7aa51 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.422218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b62e-448d-4852-9f83-9bd8ba39da7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.422856 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b62e-448d-4852-9f83-9bd8ba39da7a admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.423139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b62e-448d-4852-9f83-9bd8ba39da7a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.423417 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49b62e-448d-4852-9f83-9bd8ba39da7a admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.424177 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b62e-448d-4852-9f83-9bd8ba39da7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.426113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49b62e-448d-4852-9f83-9bd8ba39da7a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.450893 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4451/8865] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:39:36 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:39:36.455062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1676b-cdd2-4350-8c75-6738d5481a4a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.465452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1676b-cdd2-4350-8c75-6738d5481a4a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.518829 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcbc49-1659-4500-9b01-081948c5bfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.519417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcbc49-1659-4500-9b01-081948c5bfff admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.519701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcbc49-1659-4500-9b01-081948c5bfff admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.520014 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcbc49-1659-4500-9b01-081948c5bfff admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.520705 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcbc49-1659-4500-9b01-081948c5bfff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.522630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcbc49-1659-4500-9b01-081948c5bfff admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.545469 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4415/8866] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:39:36 2022] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:39:36.546661 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b62e-448d-4852-9f83-9bd8ba39da7a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.557443 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49b62e-448d-4852-9f83-9bd8ba39da7a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.562126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0229582-e3c3-43d6-82a6-7f73371a2f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.562774 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0229582-e3c3-43d6-82a6-7f73371a2f13 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.563061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0229582-e3c3-43d6-82a6-7f73371a2f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.563342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0229582-e3c3-43d6-82a6-7f73371a2f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.564119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0229582-e3c3-43d6-82a6-7f73371a2f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.565770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0229582-e3c3-43d6-82a6-7f73371a2f13 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.576197 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4452/8867] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:39:36.580041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcbc49-1659-4500-9b01-081948c5bfff admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.590685 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcbc49-1659-4500-9b01-081948c5bfff admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.595439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c00230-fa5c-42dd-aa25-235f5e73c044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.596126 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00230-fa5c-42dd-aa25-235f5e73c044 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.596419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00230-fa5c-42dd-aa25-235f5e73c044 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.596701 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c00230-fa5c-42dd-aa25-235f5e73c044 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.597417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c00230-fa5c-42dd-aa25-235f5e73c044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.599020 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c00230-fa5c-42dd-aa25-235f5e73c044 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.609466 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4416/8868] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:39:36.613398 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0229582-e3c3-43d6-82a6-7f73371a2f13 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.623173 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0229582-e3c3-43d6-82a6-7f73371a2f13 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.627779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6d133-e88a-482a-8831-e0c39b1d4f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.628674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d133-e88a-482a-8831-e0c39b1d4f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.628961 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d133-e88a-482a-8831-e0c39b1d4f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.629241 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d133-e88a-482a-8831-e0c39b1d4f91 admin admin] PATH_INFO: `/v3/projects/01928d3d430a4ee085f0f02b34539ca4/users/aed79c52100946f2aa1052b012f8aa3c/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.643182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6d133-e88a-482a-8831-e0c39b1d4f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01928d3d430a4ee085f0f02b34539ca4, user_id=aed79c52100946f2aa1052b012f8aa3c, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.645888 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6d133-e88a-482a-8831-e0c39b1d4f91 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.659097 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4453/8869] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:39:36 2022] PUT /identity/v3/projects/01928d3d430a4ee085f0f02b34539ca4/users/aed79c52100946f2aa1052b012f8aa3c/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:39:36.669815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40430ebc-5d00-49da-ab30-250e78832aac None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.670112 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40430ebc-5d00-49da-ab30-250e78832aac None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.670397 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40430ebc-5d00-49da-ab30-250e78832aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.696741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-40430ebc-5d00-49da-ab30-250e78832aac None None] MFA Rules not processed for user `aed79c52100946f2aa1052b012f8aa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:39:36.697920 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-40430ebc-5d00-49da-ab30-250e78832aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:36.760777 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4417/8870] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:39:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:39:36.765254 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6d133-e88a-482a-8831-e0c39b1d4f91 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.826732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6d133-e88a-482a-8831-e0c39b1d4f91 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.831422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cf8c9-1ec2-4a15-95c0-7c4f16c9fe31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.832106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cf8c9-1ec2-4a15-95c0-7c4f16c9fe31 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.832391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cf8c9-1ec2-4a15-95c0-7c4f16c9fe31 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.832681 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cf8c9-1ec2-4a15-95c0-7c4f16c9fe31 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.833362 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cf8c9-1ec2-4a15-95c0-7c4f16c9fe31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.835350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cf8c9-1ec2-4a15-95c0-7c4f16c9fe31 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.860075 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4454/8871] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:39:36 2022] POST /identity/v3/projects => generated 393 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:39:36.864234 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40430ebc-5d00-49da-ab30-250e78832aac None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.874697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40430ebc-5d00-49da-ab30-250e78832aac None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.928552 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba104156-35e7-4b97-996a-c38f92f5cc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.929217 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba104156-35e7-4b97-996a-c38f92f5cc00 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.929502 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba104156-35e7-4b97-996a-c38f92f5cc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.929780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba104156-35e7-4b97-996a-c38f92f5cc00 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.930458 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba104156-35e7-4b97-996a-c38f92f5cc00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.932414 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba104156-35e7-4b97-996a-c38f92f5cc00 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.951430 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4418/8872] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:39:36 2022] POST /identity/v3/users => generated 303 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:39:36.955342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cf8c9-1ec2-4a15-95c0-7c4f16c9fe31 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.965984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cf8c9-1ec2-4a15-95c0-7c4f16c9fe31 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:36.970540 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1714bd-bd0a-4e6a-9e44-0e60422e317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:36.971182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1714bd-bd0a-4e6a-9e44-0e60422e317f admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:36.971464 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1714bd-bd0a-4e6a-9e44-0e60422e317f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:36.971740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1714bd-bd0a-4e6a-9e44-0e60422e317f admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:36.972512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1714bd-bd0a-4e6a-9e44-0e60422e317f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:36.974098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1714bd-bd0a-4e6a-9e44-0e60422e317f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:36.984786 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4455/8873] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:39:36.988329 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba104156-35e7-4b97-996a-c38f92f5cc00 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:36.998117 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba104156-35e7-4b97-996a-c38f92f5cc00 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:37.002882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09702bbd-b992-4a90-b429-64dee940b42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:37.003784 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09702bbd-b992-4a90-b429-64dee940b42b admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:37.004093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09702bbd-b992-4a90-b429-64dee940b42b admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:37.004370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09702bbd-b992-4a90-b429-64dee940b42b admin admin] PATH_INFO: `/v3/projects/25969e4895b6478ea59ac480629ee323/users/6e7140c206f94ddbbafe87e141651211/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:37.019761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09702bbd-b992-4a90-b429-64dee940b42b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25969e4895b6478ea59ac480629ee323, user_id=6e7140c206f94ddbbafe87e141651211, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:37.022471 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09702bbd-b992-4a90-b429-64dee940b42b admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:37.035972 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4419/8874] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:39:36 2022] PUT /identity/v3/projects/25969e4895b6478ea59ac480629ee323/users/6e7140c206f94ddbbafe87e141651211/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:39:37.039817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1714bd-bd0a-4e6a-9e44-0e60422e317f admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:37.049595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1714bd-bd0a-4e6a-9e44-0e60422e317f admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:37.103272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dc778-0a2c-40ff-bd48-0209755ce705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:37.103932 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc778-0a2c-40ff-bd48-0209755ce705 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:37.104240 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc778-0a2c-40ff-bd48-0209755ce705 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:37.104516 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc778-0a2c-40ff-bd48-0209755ce705 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:37.105251 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dc778-0a2c-40ff-bd48-0209755ce705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:37.106843 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135dc778-0a2c-40ff-bd48-0209755ce705 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:37.116453 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4456/8875] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:39:37.121085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09702bbd-b992-4a90-b429-64dee940b42b admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:37.131416 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09702bbd-b992-4a90-b429-64dee940b42b admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:37.136890 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df27c0-b7db-4c4e-a019-61b79a3b8ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:37.137769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df27c0-b7db-4c4e-a019-61b79a3b8ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:37.138077 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df27c0-b7db-4c4e-a019-61b79a3b8ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:37.138351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df27c0-b7db-4c4e-a019-61b79a3b8ddc admin admin] PATH_INFO: `/v3/projects/25969e4895b6478ea59ac480629ee323/users/6e7140c206f94ddbbafe87e141651211/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:37.142723 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df27c0-b7db-4c4e-a019-61b79a3b8ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=25969e4895b6478ea59ac480629ee323, user_id=6e7140c206f94ddbbafe87e141651211, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:37.143165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df27c0-b7db-4c4e-a019-61b79a3b8ddc admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:37.158041 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4420/8876] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:39:37 2022] PUT /identity/v3/projects/25969e4895b6478ea59ac480629ee323/users/6e7140c206f94ddbbafe87e141651211/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:39:37.169776 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a3366-33c1-4fb4-8567-f1c81ee88716 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:37.170070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a3366-33c1-4fb4-8567-f1c81ee88716 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:37.170353 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a3366-33c1-4fb4-8567-f1c81ee88716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:37.197387 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6f1a3366-33c1-4fb4-8567-f1c81ee88716 None None] MFA Rules not processed for user `6e7140c206f94ddbbafe87e141651211`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:39:37.198609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6f1a3366-33c1-4fb4-8567-f1c81ee88716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:37.265595 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4457/8877] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:39:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:39:37.277679 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df27c0-b7db-4c4e-a019-61b79a3b8ddc admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:37.279447 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f3df27c0-b7db-4c4e-a019-61b79a3b8ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:37.358119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df27c0-b7db-4c4e-a019-61b79a3b8ddc admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:37.363599 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ca5b6-c265-4e51-a6d3-fa39a46e5810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:37.364273 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ca5b6-c265-4e51-a6d3-fa39a46e5810 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:37.364559 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ca5b6-c265-4e51-a6d3-fa39a46e5810 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:37.364834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ca5b6-c265-4e51-a6d3-fa39a46e5810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:37.419187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ca5b6-c265-4e51-a6d3-fa39a46e5810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:37.420834 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ca5b6-c265-4e51-a6d3-fa39a46e5810 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:37.430267 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4421/8878] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:39:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:39:40.346634 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a3366-33c1-4fb4-8567-f1c81ee88716 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:40.348220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6f1a3366-33c1-4fb4-8567-f1c81ee88716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:40.404853 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a3366-33c1-4fb4-8567-f1c81ee88716 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:40.408473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f922a6d-895b-4e9c-bade-a5b444a7191c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:40.409110 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f922a6d-895b-4e9c-bade-a5b444a7191c service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:40.409390 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f922a6d-895b-4e9c-bade-a5b444a7191c service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:40.409662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f922a6d-895b-4e9c-bade-a5b444a7191c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:40.419523 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f922a6d-895b-4e9c-bade-a5b444a7191c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:40.421024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f922a6d-895b-4e9c-bade-a5b444a7191c service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:40.430686 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4458/8879] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:39:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:39:43.361018 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9ccea-482b-46af-a2d2-4946a03f8388 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:43.361550 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9ccea-482b-46af-a2d2-4946a03f8388 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:43.361653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9ccea-482b-46af-a2d2-4946a03f8388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:43.379659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7cf9ccea-482b-46af-a2d2-4946a03f8388 None None] MFA Rules not processed for user `aed79c52100946f2aa1052b012f8aa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:39:43.381019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7cf9ccea-482b-46af-a2d2-4946a03f8388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:43.388770 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4422/8880] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:39:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:39:43.726001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f922a6d-895b-4e9c-bade-a5b444a7191c service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:43.735885 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f922a6d-895b-4e9c-bade-a5b444a7191c service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:43.739737 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:43.740650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:43.741004 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:43.741347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:43.744059 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:43.757253 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:43.758752 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:43.771664 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4459/8881] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:39:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:39:44.145759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b214aa-cdaf-4924-9dff-336e2a9ad989 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:44.146056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b214aa-cdaf-4924-9dff-336e2a9ad989 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:44.146363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b214aa-cdaf-4924-9dff-336e2a9ad989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:44.170248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-13b214aa-cdaf-4924-9dff-336e2a9ad989 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:39:44.171670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-13b214aa-cdaf-4924-9dff-336e2a9ad989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:44.273343 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4423/8882] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:39:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:39:44.284739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:39:44.286198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:39:44.307724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a5924-9542-4e55-af22-fbdf527b6cd9 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:39:44.313201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405e4f-b20c-4cbe-9c21-dfb84f4246cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:39:44.313857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405e4f-b20c-4cbe-9c21-dfb84f4246cb service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:39:44.314145 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405e4f-b20c-4cbe-9c21-dfb84f4246cb service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:39:44.314418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b405e4f-b20c-4cbe-9c21-dfb84f4246cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:39:44.324652 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b405e4f-b20c-4cbe-9c21-dfb84f4246cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:39:44.326272 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b405e4f-b20c-4cbe-9c21-dfb84f4246cb service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:39:44.339350 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4460/8883] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:39:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:40:28.375896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b214aa-cdaf-4924-9dff-336e2a9ad989 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:40:28.385448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b214aa-cdaf-4924-9dff-336e2a9ad989 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:40:28.388990 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27089a-de66-4886-84fe-e89fecb01700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:40:28.389653 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27089a-de66-4886-84fe-e89fecb01700 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:40:28.389944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27089a-de66-4886-84fe-e89fecb01700 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:40:28.390216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27089a-de66-4886-84fe-e89fecb01700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:40:28.391957 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-cd27089a-de66-4886-84fe-e89fecb01700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:40:28.407870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27089a-de66-4886-84fe-e89fecb01700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:40:28.409327 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27089a-de66-4886-84fe-e89fecb01700 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:40:28.422911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4424/8884] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:40:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:40:29.603831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405e4f-b20c-4cbe-9c21-dfb84f4246cb service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:40:29.605275 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0b405e4f-b20c-4cbe-9c21-dfb84f4246cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:40:29.630554 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b405e4f-b20c-4cbe-9c21-dfb84f4246cb service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:40:29.634185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb73265-d092-4b48-958b-179c28264d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:40:29.634816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb73265-d092-4b48-958b-179c28264d8b service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:40:29.635098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb73265-d092-4b48-958b-179c28264d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:40:29.635377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb73265-d092-4b48-958b-179c28264d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:40:29.637058 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6fb73265-d092-4b48-958b-179c28264d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:40:29.652967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb73265-d092-4b48-958b-179c28264d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:40:29.654405 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb73265-d092-4b48-958b-179c28264d8b service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:40:29.668250 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4461/8885] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:40:45.351432 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e333f-cdce-48af-9ba3-c50ff00b5467 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:40:45.352746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e333f-cdce-48af-9ba3-c50ff00b5467 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:40:45.352746 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e333f-cdce-48af-9ba3-c50ff00b5467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:40:45.380761 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-447e333f-cdce-48af-9ba3-c50ff00b5467 None None] MFA Rules not processed for user `aed79c52100946f2aa1052b012f8aa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:40:45.381969 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-447e333f-cdce-48af-9ba3-c50ff00b5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:40:45.415490 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4425/8886] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:40:47.132358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2b429-d21a-4803-9b77-33a2dbe169ba None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:40:47.132814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2b429-d21a-4803-9b77-33a2dbe169ba None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:40:47.133083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2b429-d21a-4803-9b77-33a2dbe169ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:40:47.170753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-26f2b429-d21a-4803-9b77-33a2dbe169ba None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:40:47.172088 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-26f2b429-d21a-4803-9b77-33a2dbe169ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:40:47.209728 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4462/8887] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:40:47.225699 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e333f-cdce-48af-9ba3-c50ff00b5467 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:40:47.227267 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-447e333f-cdce-48af-9ba3-c50ff00b5467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:40:47.244756 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e333f-cdce-48af-9ba3-c50ff00b5467 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:40:47.250483 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce432e-5d95-4a56-a520-d052b5b5b9a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:40:47.251332 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce432e-5d95-4a56-a520-d052b5b5b9a4 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:40:47.251792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce432e-5d95-4a56-a520-d052b5b5b9a4 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:40:47.252365 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce432e-5d95-4a56-a520-d052b5b5b9a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:40:47.263056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce432e-5d95-4a56-a520-d052b5b5b9a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:40:47.265180 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce432e-5d95-4a56-a520-d052b5b5b9a4 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:40:47.275782 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4426/8888] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:40:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:42:22.693273 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2b429-d21a-4803-9b77-33a2dbe169ba None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:42:22.718123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2b429-d21a-4803-9b77-33a2dbe169ba None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:42:22.725970 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953f151-e165-4b4f-9b34-bd891180029f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:42:22.726649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953f151-e165-4b4f-9b34-bd891180029f service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:42:22.727009 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953f151-e165-4b4f-9b34-bd891180029f service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:42:22.727315 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953f151-e165-4b4f-9b34-bd891180029f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:42:22.728990 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1953f151-e165-4b4f-9b34-bd891180029f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:42:22.763955 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953f151-e165-4b4f-9b34-bd891180029f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:42:22.765650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953f151-e165-4b4f-9b34-bd891180029f service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:42:22.780771 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4463/8889] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:42:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:42:22.850153 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce432e-5d95-4a56-a520-d052b5b5b9a4 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:42:22.860437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce432e-5d95-4a56-a520-d052b5b5b9a4 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:42:22.864497 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94b50-699e-47bd-8026-904406633ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:42:22.865216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94b50-699e-47bd-8026-904406633ddd service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:42:22.865583 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94b50-699e-47bd-8026-904406633ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:42:22.865932 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb94b50-699e-47bd-8026-904406633ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:42:22.868023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-3bb94b50-699e-47bd-8026-904406633ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:42:22.886718 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb94b50-699e-47bd-8026-904406633ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:42:22.888292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb94b50-699e-47bd-8026-904406633ddd service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:42:22.899486 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4427/8890] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:42:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:42:35.731233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a4929-9ac3-41bf-a46b-69cf279ca577 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:42:35.732354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a4929-9ac3-41bf-a46b-69cf279ca577 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:42:35.732818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a4929-9ac3-41bf-a46b-69cf279ca577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:42:35.752028 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5c3a4929-9ac3-41bf-a46b-69cf279ca577 None None] MFA Rules not processed for user `aed79c52100946f2aa1052b012f8aa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:42:35.754098 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5c3a4929-9ac3-41bf-a46b-69cf279ca577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:42:35.761808 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4464/8891] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:42:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:42:38.472194 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94b50-699e-47bd-8026-904406633ddd service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:42:38.482152 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb94b50-699e-47bd-8026-904406633ddd service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:42:38.486197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473386-8988-4cd8-b931-f5b87baeda69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:42:38.486992 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473386-8988-4cd8-b931-f5b87baeda69 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:42:38.487378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473386-8988-4cd8-b931-f5b87baeda69 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:42:38.487755 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473386-8988-4cd8-b931-f5b87baeda69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:42:38.489887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e9473386-8988-4cd8-b931-f5b87baeda69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:42:38.507575 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9473386-8988-4cd8-b931-f5b87baeda69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:42:38.509231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9473386-8988-4cd8-b931-f5b87baeda69 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:42:38.521224 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4428/8892] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:42:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:42:39.099048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a4929-9ac3-41bf-a46b-69cf279ca577 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:42:39.117716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a4929-9ac3-41bf-a46b-69cf279ca577 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:42:39.132291 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:42:39.133379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:42:39.133901 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:42:39.134410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:42:39.139067 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:42:39.182386 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:42:39.185537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:42:39.212125 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4465/8893] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:42:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:42:45.101150 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473386-8988-4cd8-b931-f5b87baeda69 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:42:45.115709 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9473386-8988-4cd8-b931-f5b87baeda69 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:42:45.121828 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3eea1-3daf-453d-a2d3-3d47c683d023 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:42:45.122464 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3eea1-3daf-453d-a2d3-3d47c683d023 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:42:45.122748 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3eea1-3daf-453d-a2d3-3d47c683d023 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:42:45.123025 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3eea1-3daf-453d-a2d3-3d47c683d023 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:42:45.124868 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-00d3eea1-3daf-453d-a2d3-3d47c683d023 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:42:45.139258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3eea1-3daf-453d-a2d3-3d47c683d023 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:42:45.140882 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3eea1-3daf-453d-a2d3-3d47c683d023 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:42:45.153665 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4429/8894] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:42:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:42:45.461092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:42:45.462572 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:42:45.480494 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd765be9-214f-44ba-b4ec-3cbceff1b6d3 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:42:45.485980 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c22be-93db-4b11-9708-56df3d80df1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:42:45.486616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c22be-93db-4b11-9708-56df3d80df1a service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:42:45.486899 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c22be-93db-4b11-9708-56df3d80df1a service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:42:45.487189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c22be-93db-4b11-9708-56df3d80df1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:42:45.488967 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-241c22be-93db-4b11-9708-56df3d80df1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:42:45.504426 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c22be-93db-4b11-9708-56df3d80df1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:42:45.506021 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c22be-93db-4b11-9708-56df3d80df1a service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:42:45.519952 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4466/8895] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:42:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:43:25.957815 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3eea1-3daf-453d-a2d3-3d47c683d023 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:43:25.967363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3eea1-3daf-453d-a2d3-3d47c683d023 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:43:25.970931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63bde8-e490-4921-bc07-9f4d5310d53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:43:25.971558 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63bde8-e490-4921-bc07-9f4d5310d53f service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:43:25.971836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63bde8-e490-4921-bc07-9f4d5310d53f service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:43:25.972215 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63bde8-e490-4921-bc07-9f4d5310d53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:43:25.973986 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0b63bde8-e490-4921-bc07-9f4d5310d53f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:43:25.986702 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63bde8-e490-4921-bc07-9f4d5310d53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:43:25.988793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63bde8-e490-4921-bc07-9f4d5310d53f service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:43:26.000234 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4430/8896] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:43:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:43:26.126589 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680d5c-0831-4336-883f-93981cdf6241 None None] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:43:26.127103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680d5c-0831-4336-883f-93981cdf6241 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:43:26.127218 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96680d5c-0831-4336-883f-93981cdf6241 None None] PATH_INFO: `/` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:43:26.128948 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4467/8897] 10.222.0.16 () {54 vars in 921 bytes} [Sat Mar 26 21:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 26 21:43:26.133744 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564704d-e86e-4c67-85f0-7c2dff46723a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:43:26.134227 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564704d-e86e-4c67-85f0-7c2dff46723a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:43:26.134571 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564704d-e86e-4c67-85f0-7c2dff46723a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:43:26.172786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d564704d-e86e-4c67-85f0-7c2dff46723a None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:43:26.173967 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d564704d-e86e-4c67-85f0-7c2dff46723a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:43:26.182759 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4431/8898] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:43:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:43:26.205331 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96680d5c-0831-4336-883f-93981cdf6241 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:43:26.221650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96680d5c-0831-4336-883f-93981cdf6241 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:43:26.226532 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fc066-f0da-46f8-bc83-9cd5120e82ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:43:26.227160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc066-f0da-46f8-bc83-9cd5120e82ad service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:43:26.227442 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc066-f0da-46f8-bc83-9cd5120e82ad service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:43:26.227723 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fc066-f0da-46f8-bc83-9cd5120e82ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:43:26.236498 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fc066-f0da-46f8-bc83-9cd5120e82ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:43:26.238083 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fc066-f0da-46f8-bc83-9cd5120e82ad service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:43:26.248128 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4468/8899] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:43:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:43:26.403433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564704d-e86e-4c67-85f0-7c2dff46723a None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:43:26.412930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564704d-e86e-4c67-85f0-7c2dff46723a None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:43:26.416470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019d14e-029b-43f7-97da-a07f3e821c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:43:26.417110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019d14e-029b-43f7-97da-a07f3e821c72 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:43:26.417395 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019d14e-029b-43f7-97da-a07f3e821c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:43:26.417703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019d14e-029b-43f7-97da-a07f3e821c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:43:26.420168 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6019d14e-029b-43f7-97da-a07f3e821c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:43:26.436356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019d14e-029b-43f7-97da-a07f3e821c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:43:26.437803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019d14e-029b-43f7-97da-a07f3e821c72 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:43:26.450925 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4432/8900] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:43:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:44:32.034708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdc72-6dd1-4184-bb2b-7daa4092e9f6 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:44:32.035309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdc72-6dd1-4184-bb2b-7daa4092e9f6 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:44:32.035309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdc72-6dd1-4184-bb2b-7daa4092e9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:44:32.054068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-589bdc72-6dd1-4184-bb2b-7daa4092e9f6 None None] MFA Rules not processed for user `aed79c52100946f2aa1052b012f8aa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:44:32.055305 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-589bdc72-6dd1-4184-bb2b-7daa4092e9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:44:32.063309 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4469/8901] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:44:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:44:37.393341 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019d14e-029b-43f7-97da-a07f3e821c72 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:44:37.407586 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019d14e-029b-43f7-97da-a07f3e821c72 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:44:37.413276 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9b8c5-8ff6-4441-ad26-71d9e61cc56d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:44:37.413915 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9b8c5-8ff6-4441-ad26-71d9e61cc56d service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:44:37.414199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9b8c5-8ff6-4441-ad26-71d9e61cc56d service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:44:37.414475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9b8c5-8ff6-4441-ad26-71d9e61cc56d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:44:37.422804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9b8c5-8ff6-4441-ad26-71d9e61cc56d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:44:37.424418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9b8c5-8ff6-4441-ad26-71d9e61cc56d service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:44:37.433518 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4433/8902] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:44:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:44:44.815893 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bdc72-6dd1-4184-bb2b-7daa4092e9f6 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:44:44.825322 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bdc72-6dd1-4184-bb2b-7daa4092e9f6 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:44:44.828870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ce891-1c8b-40c4-b8d2-190b4e2ada90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:44:44.829501 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce891-1c8b-40c4-b8d2-190b4e2ada90 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:44:44.829785 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce891-1c8b-40c4-b8d2-190b4e2ada90 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:44:44.830080 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ce891-1c8b-40c4-b8d2-190b4e2ada90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:44:44.838816 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ce891-1c8b-40c4-b8d2-190b4e2ada90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:44:44.840298 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ce891-1c8b-40c4-b8d2-190b4e2ada90 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:44:44.849573 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4470/8903] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:44:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:45:29.237780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9b8c5-8ff6-4441-ad26-71d9e61cc56d service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:45:29.247064 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9b8c5-8ff6-4441-ad26-71d9e61cc56d service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:45:29.250839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d330b-9f61-4685-bb85-e8305e965ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:45:29.251476 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d330b-9f61-4685-bb85-e8305e965ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:45:29.251764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d330b-9f61-4685-bb85-e8305e965ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:45:29.252186 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d330b-9f61-4685-bb85-e8305e965ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:45:29.265360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d330b-9f61-4685-bb85-e8305e965ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:45:29.266799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d330b-9f61-4685-bb85-e8305e965ec9 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:45:29.280843 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4434/8904] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:45:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:45:30.454249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ce891-1c8b-40c4-b8d2-190b4e2ada90 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:45:30.463395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ce891-1c8b-40c4-b8d2-190b4e2ada90 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:45:30.467017 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e91d8-4a9f-42e8-a0d2-97205926a843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:45:30.467767 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e91d8-4a9f-42e8-a0d2-97205926a843 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:45:30.468020 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e91d8-4a9f-42e8-a0d2-97205926a843 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:45:30.468289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e91d8-4a9f-42e8-a0d2-97205926a843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:45:30.481803 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e91d8-4a9f-42e8-a0d2-97205926a843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:45:30.483246 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e91d8-4a9f-42e8-a0d2-97205926a843 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:45:30.496539 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4471/8905] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:45:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:45:43.076936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852e45-699d-4271-acbc-a5d50a384855 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:45:43.077535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852e45-699d-4271-acbc-a5d50a384855 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:45:43.077535 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c852e45-699d-4271-acbc-a5d50a384855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:45:43.095129 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4c852e45-699d-4271-acbc-a5d50a384855 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:45:43.096345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4c852e45-699d-4271-acbc-a5d50a384855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:45:43.104809 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4435/8906] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Mar 26 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:45:43.116957 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0098ed2-9d02-4d1e-b68a-51d8f71202cf None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:45:43.117395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0098ed2-9d02-4d1e-b68a-51d8f71202cf None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:45:43.117513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0098ed2-9d02-4d1e-b68a-51d8f71202cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:45:43.136385 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-a0098ed2-9d02-4d1e-b68a-51d8f71202cf None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:45:43.137583 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-a0098ed2-9d02-4d1e-b68a-51d8f71202cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:45:43.146356 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4472/8907] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:45:43.152182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c852e45-699d-4271-acbc-a5d50a384855 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:45:43.162454 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c852e45-699d-4271-acbc-a5d50a384855 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:45:43.167422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e36aa-f5c2-40c2-9976-efa6f5e9a70a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:45:43.168078 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e36aa-f5c2-40c2-9976-efa6f5e9a70a service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:45:43.168359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e36aa-f5c2-40c2-9976-efa6f5e9a70a service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:45:43.168630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e36aa-f5c2-40c2-9976-efa6f5e9a70a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:45:43.177444 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e36aa-f5c2-40c2-9976-efa6f5e9a70a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:45:43.179203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e36aa-f5c2-40c2-9976-efa6f5e9a70a service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:45:43.188582 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4436/8908] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:45:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:45:46.036761 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79e41-134e-4dc9-8ef6-7d11c0d3ccb5 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:45:46.037236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79e41-134e-4dc9-8ef6-7d11c0d3ccb5 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:45:46.037354 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa79e41-134e-4dc9-8ef6-7d11c0d3ccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:45:46.056841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4aa79e41-134e-4dc9-8ef6-7d11c0d3ccb5 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:45:46.058032 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4aa79e41-134e-4dc9-8ef6-7d11c0d3ccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:45:46.067070 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4473/8909] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Mar 26 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:45:46.086754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6d0f-56e3-40f4-8042-95a10aad3b25 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:45:46.087219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6d0f-56e3-40f4-8042-95a10aad3b25 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:45:46.087334 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6d0f-56e3-40f4-8042-95a10aad3b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:45:46.105114 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-894a6d0f-56e3-40f4-8042-95a10aad3b25 None None] MFA Rules not processed for user `de5b3a8b36da4df7b905b26aa3e680e2`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:45:46.106312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-894a6d0f-56e3-40f4-8042-95a10aad3b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:45:46.115553 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4437/8910] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 21:45:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:45:46.121455 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa79e41-134e-4dc9-8ef6-7d11c0d3ccb5 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:45:46.132791 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa79e41-134e-4dc9-8ef6-7d11c0d3ccb5 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:45:46.137788 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33743e-d43d-4707-a384-34a983d5f75c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:45:46.138412 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33743e-d43d-4707-a384-34a983d5f75c service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:45:46.138692 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33743e-d43d-4707-a384-34a983d5f75c service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:45:46.138968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33743e-d43d-4707-a384-34a983d5f75c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:45:46.147346 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33743e-d43d-4707-a384-34a983d5f75c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:45:46.148962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33743e-d43d-4707-a384-34a983d5f75c service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:45:46.158388 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4474/8911] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:45:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:46:08.129531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a6d0f-56e3-40f4-8042-95a10aad3b25 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:46:08.146545 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a6d0f-56e3-40f4-8042-95a10aad3b25 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:46:08.152840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22542b-39d8-4d8c-96b9-3357f7d96959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:46:08.153703 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22542b-39d8-4d8c-96b9-3357f7d96959 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:46:08.153994 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22542b-39d8-4d8c-96b9-3357f7d96959 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:46:08.154279 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22542b-39d8-4d8c-96b9-3357f7d96959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:46:08.156195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9e22542b-39d8-4d8c-96b9-3357f7d96959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:46:08.171642 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22542b-39d8-4d8c-96b9-3357f7d96959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:46:08.174807 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22542b-39d8-4d8c-96b9-3357f7d96959 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:46:08.187656 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4438/8912] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:46:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:46:20.991074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2a35-8448-4a31-afd8-6d82751b233e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:46:20.991650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2a35-8448-4a31-afd8-6d82751b233e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:46:20.991650 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e2a35-8448-4a31-afd8-6d82751b233e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:46:21.030260 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-df1e2a35-8448-4a31-afd8-6d82751b233e None None] MFA Rules not processed for user `aed79c52100946f2aa1052b012f8aa3c`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:46:21.031506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-df1e2a35-8448-4a31-afd8-6d82751b233e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:46:21.039730 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4475/8913] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:46:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:46:21.408093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22542b-39d8-4d8c-96b9-3357f7d96959 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:46:21.418534 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22542b-39d8-4d8c-96b9-3357f7d96959 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:46:21.422730 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936380b2-225d-458e-b525-1b62575e1d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:46:21.438100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936380b2-225d-458e-b525-1b62575e1d2d service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:46:21.438438 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936380b2-225d-458e-b525-1b62575e1d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:46:21.438728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936380b2-225d-458e-b525-1b62575e1d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:46:21.444489 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-936380b2-225d-458e-b525-1b62575e1d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:46:21.461392 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936380b2-225d-458e-b525-1b62575e1d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:46:21.463264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936380b2-225d-458e-b525-1b62575e1d2d service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:46:21.480907 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4439/8914] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:46:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:46:21.948107 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e2a35-8448-4a31-afd8-6d82751b233e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:46:21.967049 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e2a35-8448-4a31-afd8-6d82751b233e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:46:21.973933 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea51dab-f839-44a7-ba75-d7d2d0116a88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:46:21.974595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea51dab-f839-44a7-ba75-d7d2d0116a88 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:46:21.974879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea51dab-f839-44a7-ba75-d7d2d0116a88 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:46:21.975157 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea51dab-f839-44a7-ba75-d7d2d0116a88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:46:21.987114 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea51dab-f839-44a7-ba75-d7d2d0116a88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:46:22.002150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea51dab-f839-44a7-ba75-d7d2d0116a88 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:46:22.024362 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4476/8915] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:46:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:03.341927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979cf61-6f23-48c5-9dc9-48ca9f7c0e7d None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:03.342516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979cf61-6f23-48c5-9dc9-48ca9f7c0e7d None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:03.342516 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979cf61-6f23-48c5-9dc9-48ca9f7c0e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:03.377175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-a979cf61-6f23-48c5-9dc9-48ca9f7c0e7d None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:03.378895 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-a979cf61-6f23-48c5-9dc9-48ca9f7c0e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:03.388214 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4440/8916] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 21:47:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:04.570350 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0a41a-066b-468d-947c-a605ae8e62ba None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:04.570900 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0a41a-066b-468d-947c-a605ae8e62ba None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:04.571013 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e0a41a-066b-468d-947c-a605ae8e62ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:04.589510 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-15e0a41a-066b-468d-947c-a605ae8e62ba None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:04.590725 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-15e0a41a-066b-468d-947c-a605ae8e62ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:04.599941 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4477/8917] 10.222.0.16 () {58 vars in 1057 bytes} [Sat Mar 26 21:47:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:10.199786 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff20f00-ea96-45b8-8e95-51cfdd17318c None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:10.200451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff20f00-ea96-45b8-8e95-51cfdd17318c None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:10.200451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff20f00-ea96-45b8-8e95-51cfdd17318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:10.222052 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-fff20f00-ea96-45b8-8e95-51cfdd17318c None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:10.224043 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fff20f00-ea96-45b8-8e95-51cfdd17318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:10.237510 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4441/8918] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:10.249040 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0a41a-066b-468d-947c-a605ae8e62ba None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:10.269341 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e0a41a-066b-468d-947c-a605ae8e62ba None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:10.273364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10149e-f51d-4945-a09c-8c972b431292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:10.274205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10149e-f51d-4945-a09c-8c972b431292 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:10.274684 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10149e-f51d-4945-a09c-8c972b431292 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:10.275128 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10149e-f51d-4945-a09c-8c972b431292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:10.288185 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10149e-f51d-4945-a09c-8c972b431292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:10.289683 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10149e-f51d-4945-a09c-8c972b431292 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:10.302315 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4478/8919] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:47:11.542358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adbacf-fed3-4d59-ae15-7b0f22f1a779 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:11.542926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adbacf-fed3-4d59-ae15-7b0f22f1a779 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:11.542926 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adbacf-fed3-4d59-ae15-7b0f22f1a779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:11.563707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d8adbacf-fed3-4d59-ae15-7b0f22f1a779 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:11.565635 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d8adbacf-fed3-4d59-ae15-7b0f22f1a779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:11.575095 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4442/8920] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:47:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:47:11.585734 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10149e-f51d-4945-a09c-8c972b431292 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:11.594179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10149e-f51d-4945-a09c-8c972b431292 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:11.597770 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92dd8e3-abe6-47cf-8cb0-22986c4149ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:11.598394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd8e3-abe6-47cf-8cb0-22986c4149ff service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:11.598674 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd8e3-abe6-47cf-8cb0-22986c4149ff service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:11.598945 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dd8e3-abe6-47cf-8cb0-22986c4149ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:11.608695 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dd8e3-abe6-47cf-8cb0-22986c4149ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:11.610117 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92dd8e3-abe6-47cf-8cb0-22986c4149ff service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:11.621496 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4479/8921] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:16.201695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adbacf-fed3-4d59-ae15-7b0f22f1a779 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:16.282499 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adbacf-fed3-4d59-ae15-7b0f22f1a779 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:16.287855 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:16.288797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:16.289083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:16.289361 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] PATH_INFO: `/v3/users/aed79c52100946f2aa1052b012f8aa3c` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:16.290561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed79c52100946f2aa1052b012f8aa3c)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:16.292522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:16.339233 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed79c52100946f2aa1052b012f8aa3c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.346511 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed79c52100946f2aa1052b012f8aa3c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.347123 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed79c52100946f2aa1052b012f8aa3c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.347735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed79c52100946f2aa1052b012f8aa3c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.358898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed79c52100946f2aa1052b012f8aa3c'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.370437 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4443/8922] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:47:16 2022] DELETE /identity/v3/users/aed79c52100946f2aa1052b012f8aa3c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:47:16.375148 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded63db4-3e7c-446c-a969-722a5d9fd3ee None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:16.375662 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded63db4-3e7c-446c-a969-722a5d9fd3ee None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:16.375848 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded63db4-3e7c-446c-a969-722a5d9fd3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:16.419161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-ded63db4-3e7c-446c-a969-722a5d9fd3ee None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:16.420420 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ded63db4-3e7c-446c-a969-722a5d9fd3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:16.478319 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4480/8923] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:47:16.488172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:16.489585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:16.546667 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22655c67-709d-4d09-993a-3d64600135c0 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:16.550659 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96fa8-abf9-483b-991e-fe68cd90f2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:16.551300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96fa8-abf9-483b-991e-fe68cd90f2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:16.551585 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96fa8-abf9-483b-991e-fe68cd90f2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:16.551863 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee96fa8-abf9-483b-991e-fe68cd90f2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:16.560888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee96fa8-abf9-483b-991e-fe68cd90f2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:16.562393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee96fa8-abf9-483b-991e-fe68cd90f2a8 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:16.572296 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4444/8924] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:16.736751 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded63db4-3e7c-446c-a969-722a5d9fd3ee None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:16.738388 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ded63db4-3e7c-446c-a969-722a5d9fd3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:16.750392 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded63db4-3e7c-446c-a969-722a5d9fd3ee None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:16.755617 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:16.756919 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:16.757401 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:16.757682 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] PATH_INFO: `/v3/projects/01928d3d430a4ee085f0f02b34539ca4` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:16.758878 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=01928d3d430a4ee085f0f02b34539ca4)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:16.760845 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:16.806030 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01928d3d430a4ee085f0f02b34539ca4', 'request_id': 'req-c0791323-4b95-41e6-9105-dc85862dad2d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.812605 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01928d3d430a4ee085f0f02b34539ca4', 'request_id': 'req-c0791323-4b95-41e6-9105-dc85862dad2d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.818604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01928d3d430a4ee085f0f02b34539ca4', 'request_id': 'req-c0791323-4b95-41e6-9105-dc85862dad2d'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.829326 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] The token cache is being invalidate because project 01928d3d430a4ee085f0f02b34539ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:47:16.829615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.830391 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.832036 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4481/8925] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:47:16 2022] DELETE /identity/v3/projects/01928d3d430a4ee085f0f02b34539ca4 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:47:16.836166 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96fa8-abf9-483b-991e-fe68cd90f2a8 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:16.845680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee96fa8-abf9-483b-991e-fe68cd90f2a8 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:16.899885 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:16.900728 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:16.900997 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:16.901271 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] PATH_INFO: `/v3/users/6e7140c206f94ddbbafe87e141651211` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:16.902459 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7140c206f94ddbbafe87e141651211)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:16.904451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:16.949252 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7140c206f94ddbbafe87e141651211'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.956470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7140c206f94ddbbafe87e141651211'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.957142 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7140c206f94ddbbafe87e141651211'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.957791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7140c206f94ddbbafe87e141651211'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.969199 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-8f93bd6f-874e-4b25-8ba1-e6f5c6ae8bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7140c206f94ddbbafe87e141651211'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:16.984686 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4445/8926] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:47:16 2022] DELETE /identity/v3/users/6e7140c206f94ddbbafe87e141651211 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:47:17.261364 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:17.262802 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:17.276604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0791323-4b95-41e6-9105-dc85862dad2d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:17.331709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:17.332598 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.332883 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.333161 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] PATH_INFO: `/v3/projects/25969e4895b6478ea59ac480629ee323` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.334356 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=25969e4895b6478ea59ac480629ee323)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:17.336286 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:17.380399 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25969e4895b6478ea59ac480629ee323', 'request_id': 'req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:17.387628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25969e4895b6478ea59ac480629ee323', 'request_id': 'req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:17.392949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25969e4895b6478ea59ac480629ee323', 'request_id': 'req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:17.403309 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] The token cache is being invalidate because project 25969e4895b6478ea59ac480629ee323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:47:17.403596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:17.404225 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-b79e227b-e997-4bd7-b0f1-c0f13ca6b14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:47:17.405722 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4482/8927] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:47:17 2022] DELETE /identity/v3/projects/25969e4895b6478ea59ac480629ee323 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:47:17.411745 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919649d-36e4-4e6d-9c13-feef87c97d8b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.412248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919649d-36e4-4e6d-9c13-feef87c97d8b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.412359 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919649d-36e4-4e6d-9c13-feef87c97d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.449475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9919649d-36e4-4e6d-9c13-feef87c97d8b None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:17.450578 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9919649d-36e4-4e6d-9c13-feef87c97d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:17.508327 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4446/8928] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:17.516903 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec5ea4-407f-4bbd-9072-e20759177a8e None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.517192 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec5ea4-407f-4bbd-9072-e20759177a8e None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.517968 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec5ea4-407f-4bbd-9072-e20759177a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.536937 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-07ec5ea4-407f-4bbd-9072-e20759177a8e None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:17.538126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-07ec5ea4-407f-4bbd-9072-e20759177a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:17.546005 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4483/8929] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:17.550350 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919649d-36e4-4e6d-9c13-feef87c97d8b None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:17.559948 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919649d-36e4-4e6d-9c13-feef87c97d8b None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:17.564528 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067f09-07d0-42cb-b66d-c5954a2a9c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:17.565167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067f09-07d0-42cb-b66d-c5954a2a9c2f admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.565448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067f09-07d0-42cb-b66d-c5954a2a9c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.565721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7067f09-07d0-42cb-b66d-c5954a2a9c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.566430 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067f09-07d0-42cb-b66d-c5954a2a9c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:47:17.566735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067f09-07d0-42cb-b66d-c5954a2a9c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:17.568372 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7067f09-07d0-42cb-b66d-c5954a2a9c2f admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:17.579432 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4447/8930] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:47:17.584129 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec5ea4-407f-4bbd-9072-e20759177a8e None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:17.593628 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec5ea4-407f-4bbd-9072-e20759177a8e None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:17.598874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ee195-1168-443b-8a26-f993cd6f7c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:17.599504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ee195-1168-443b-8a26-f993cd6f7c75 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.599789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ee195-1168-443b-8a26-f993cd6f7c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.600092 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ee195-1168-443b-8a26-f993cd6f7c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.600775 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ee195-1168-443b-8a26-f993cd6f7c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:17.602710 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ee195-1168-443b-8a26-f993cd6f7c75 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:17.636906 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4484/8931] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:47:17 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 26 21:47:17.640487 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067f09-07d0-42cb-b66d-c5954a2a9c2f admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:17.650816 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7067f09-07d0-42cb-b66d-c5954a2a9c2f admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:17.703799 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8dc58-388b-487c-aa21-b52cf578f3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:17.704409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8dc58-388b-487c-aa21-b52cf578f3ae admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.704696 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8dc58-388b-487c-aa21-b52cf578f3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.705448 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8dc58-388b-487c-aa21-b52cf578f3ae admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.706138 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8dc58-388b-487c-aa21-b52cf578f3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:17.708110 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8dc58-388b-487c-aa21-b52cf578f3ae admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:17.728020 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4448/8932] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:47:17 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:47:17.732180 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ee195-1168-443b-8a26-f993cd6f7c75 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:17.742582 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ee195-1168-443b-8a26-f993cd6f7c75 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:17.747160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5b696-2ab2-4330-83ab-f6c43b340a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:17.747805 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5b696-2ab2-4330-83ab-f6c43b340a8a admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.748187 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5b696-2ab2-4330-83ab-f6c43b340a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.748467 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5b696-2ab2-4330-83ab-f6c43b340a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.749213 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5b696-2ab2-4330-83ab-f6c43b340a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:17.750818 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5b696-2ab2-4330-83ab-f6c43b340a8a admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:17.760668 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4485/8933] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:47:17.764608 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8dc58-388b-487c-aa21-b52cf578f3ae admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:17.774782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8dc58-388b-487c-aa21-b52cf578f3ae admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:17.779307 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f56ab-8bb9-415d-b989-849b9ddaf9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:17.780001 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f56ab-8bb9-415d-b989-849b9ddaf9ae admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.780258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f56ab-8bb9-415d-b989-849b9ddaf9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.780531 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f56ab-8bb9-415d-b989-849b9ddaf9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.781265 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f56ab-8bb9-415d-b989-849b9ddaf9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:17.782888 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f56ab-8bb9-415d-b989-849b9ddaf9ae admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:17.793035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4449/8934] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:47:17.797054 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5b696-2ab2-4330-83ab-f6c43b340a8a admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:17.807179 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5b696-2ab2-4330-83ab-f6c43b340a8a admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:17.811688 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6cd4-2bdb-41dd-8511-76272fb497bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:17.812639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6cd4-2bdb-41dd-8511-76272fb497bd admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.812921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6cd4-2bdb-41dd-8511-76272fb497bd admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.813196 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6cd4-2bdb-41dd-8511-76272fb497bd admin admin] PATH_INFO: `/v3/projects/7f82e50b0f4249b889d84b7c46dbb448/users/6687c6fa06d244b0a3ddad87237a5d30/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.827367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b6cd4-2bdb-41dd-8511-76272fb497bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f82e50b0f4249b889d84b7c46dbb448, user_id=6687c6fa06d244b0a3ddad87237a5d30, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:17.830584 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b6cd4-2bdb-41dd-8511-76272fb497bd admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:17.842871 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4486/8935] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:47:17 2022] PUT /identity/v3/projects/7f82e50b0f4249b889d84b7c46dbb448/users/6687c6fa06d244b0a3ddad87237a5d30/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:47:17.848734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b281f-0361-457a-91f5-873a21b31034 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.849113 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b281f-0361-457a-91f5-873a21b31034 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.849440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8b281f-0361-457a-91f5-873a21b31034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:17.866836 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9e8b281f-0361-457a-91f5-873a21b31034 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:17.868055 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9e8b281f-0361-457a-91f5-873a21b31034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:17.923489 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4450/8936] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:17.933487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6cd4-2bdb-41dd-8511-76272fb497bd admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:17.935119 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-fa6b6cd4-2bdb-41dd-8511-76272fb497bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:17.990198 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6cd4-2bdb-41dd-8511-76272fb497bd admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:17.993739 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427df2-4f82-4d0c-b771-16a9b42f2dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:17.994367 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427df2-4f82-4d0c-b771-16a9b42f2dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:17.994647 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427df2-4f82-4d0c-b771-16a9b42f2dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:17.994921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3427df2-4f82-4d0c-b771-16a9b42f2dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:18.004406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3427df2-4f82-4d0c-b771-16a9b42f2dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:18.005876 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3427df2-4f82-4d0c-b771-16a9b42f2dc9 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:18.015484 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4487/8937] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:21.804121 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f3057-1791-4499-b762-cb62b5e01382 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:21.804602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f3057-1791-4499-b762-cb62b5e01382 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:21.804719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f3057-1791-4499-b762-cb62b5e01382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:21.833695 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-050f3057-1791-4499-b762-cb62b5e01382 None None] MFA Rules not processed for user `6687c6fa06d244b0a3ddad87237a5d30`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:21.835056 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-050f3057-1791-4499-b762-cb62b5e01382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:21.904408 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4451/8938] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:47:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:21.908965 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427df2-4f82-4d0c-b771-16a9b42f2dc9 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:21.918732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3427df2-4f82-4d0c-b771-16a9b42f2dc9 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:21.923289 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032eb19-366a-47a2-8e84-6dad78315deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:21.924024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032eb19-366a-47a2-8e84-6dad78315deb admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:21.924314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032eb19-366a-47a2-8e84-6dad78315deb admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:21.924591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032eb19-366a-47a2-8e84-6dad78315deb admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:21.925539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032eb19-366a-47a2-8e84-6dad78315deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:21.927460 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032eb19-366a-47a2-8e84-6dad78315deb admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:21.956010 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4488/8939] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:47:21 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:47:21.960070 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f3057-1791-4499-b762-cb62b5e01382 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:21.971211 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f3057-1791-4499-b762-cb62b5e01382 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:22.030437 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba6aba-fb5c-4c3d-9c37-87d151b0e5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:22.031173 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6aba-fb5c-4c3d-9c37-87d151b0e5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:22.031602 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6aba-fb5c-4c3d-9c37-87d151b0e5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:22.031900 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba6aba-fb5c-4c3d-9c37-87d151b0e5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:22.032625 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba6aba-fb5c-4c3d-9c37-87d151b0e5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:22.034628 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba6aba-fb5c-4c3d-9c37-87d151b0e5c5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:22.057256 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4452/8940] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:47:21 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:47:22.065402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032eb19-366a-47a2-8e84-6dad78315deb admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:22.079113 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032eb19-366a-47a2-8e84-6dad78315deb admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:22.084124 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d048a-17c8-49ec-89dc-30f89cb37004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:22.084896 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d048a-17c8-49ec-89dc-30f89cb37004 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:22.085267 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d048a-17c8-49ec-89dc-30f89cb37004 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:22.085678 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d048a-17c8-49ec-89dc-30f89cb37004 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:22.086469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d048a-17c8-49ec-89dc-30f89cb37004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:22.088239 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d048a-17c8-49ec-89dc-30f89cb37004 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:22.099650 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4489/8941] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:47:22.103832 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba6aba-fb5c-4c3d-9c37-87d151b0e5c5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:22.114629 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba6aba-fb5c-4c3d-9c37-87d151b0e5c5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:22.119620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e278cd3-c9e4-444d-b91b-8f69c0a9e979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:22.120553 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e278cd3-c9e4-444d-b91b-8f69c0a9e979 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:22.120843 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e278cd3-c9e4-444d-b91b-8f69c0a9e979 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:22.121124 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e278cd3-c9e4-444d-b91b-8f69c0a9e979 admin admin] PATH_INFO: `/v3/projects/bab6ea3329fa4e9fa807bc593b00d5fb/users/61920f735447445f81f4a9e745f334b0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:22.137345 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e278cd3-c9e4-444d-b91b-8f69c0a9e979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab6ea3329fa4e9fa807bc593b00d5fb, user_id=61920f735447445f81f4a9e745f334b0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:22.140197 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e278cd3-c9e4-444d-b91b-8f69c0a9e979 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:22.155535 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4453/8942] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:47:22 2022] PUT /identity/v3/projects/bab6ea3329fa4e9fa807bc593b00d5fb/users/61920f735447445f81f4a9e745f334b0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:47:22.159581 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d048a-17c8-49ec-89dc-30f89cb37004 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:22.169862 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d048a-17c8-49ec-89dc-30f89cb37004 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:22.227766 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bee6c1d-84c9-4f95-8149-a47f7c0c5b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:22.228473 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6c1d-84c9-4f95-8149-a47f7c0c5b8d admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:22.228760 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6c1d-84c9-4f95-8149-a47f7c0c5b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:22.229038 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee6c1d-84c9-4f95-8149-a47f7c0c5b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:22.229831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6c1d-84c9-4f95-8149-a47f7c0c5b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:22.231368 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bee6c1d-84c9-4f95-8149-a47f7c0c5b8d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:22.242959 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4490/8943] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:47:22.246543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e278cd3-c9e4-444d-b91b-8f69c0a9e979 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:22.258417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e278cd3-c9e4-444d-b91b-8f69c0a9e979 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:22.263154 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4775c-6cea-42f1-8441-4b288592ea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:22.264076 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4775c-6cea-42f1-8441-4b288592ea08 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:22.264362 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4775c-6cea-42f1-8441-4b288592ea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:22.264641 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4775c-6cea-42f1-8441-4b288592ea08 admin admin] PATH_INFO: `/v3/projects/bab6ea3329fa4e9fa807bc593b00d5fb/users/61920f735447445f81f4a9e745f334b0/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:22.266624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4775c-6cea-42f1-8441-4b288592ea08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bab6ea3329fa4e9fa807bc593b00d5fb, user_id=61920f735447445f81f4a9e745f334b0, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:22.269330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4775c-6cea-42f1-8441-4b288592ea08 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:22.279439 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4454/8944] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:47:22 2022] PUT /identity/v3/projects/bab6ea3329fa4e9fa807bc593b00d5fb/users/61920f735447445f81f4a9e745f334b0/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:47:27.378127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e9753-a99c-484e-8a18-8f484967055a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:27.378711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e9753-a99c-484e-8a18-8f484967055a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:27.378711 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e9753-a99c-484e-8a18-8f484967055a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:27.408474 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-283e9753-a99c-484e-8a18-8f484967055a None None] MFA Rules not processed for user `61920f735447445f81f4a9e745f334b0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:27.409841 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-283e9753-a99c-484e-8a18-8f484967055a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:27.488583 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4491/8945] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:27.500508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4775c-6cea-42f1-8441-4b288592ea08 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:27.502319 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f2b4775c-6cea-42f1-8441-4b288592ea08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:27.584259 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4775c-6cea-42f1-8441-4b288592ea08 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:27.590719 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f014437-b1a8-4f9d-b739-dd1966f9b788 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:27.592100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f014437-b1a8-4f9d-b739-dd1966f9b788 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:27.592100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f014437-b1a8-4f9d-b739-dd1966f9b788 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:27.592100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f014437-b1a8-4f9d-b739-dd1966f9b788 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:27.656931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f014437-b1a8-4f9d-b739-dd1966f9b788 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:27.659093 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f014437-b1a8-4f9d-b739-dd1966f9b788 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:27.669832 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4455/8946] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:28.986977 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681cfa8-9f5d-4804-be16-1c37d058251a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:28.988230 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681cfa8-9f5d-4804-be16-1c37d058251a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:28.988519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681cfa8-9f5d-4804-be16-1c37d058251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:29.014724 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-c681cfa8-9f5d-4804-be16-1c37d058251a None None] MFA Rules not processed for user `6687c6fa06d244b0a3ddad87237a5d30`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:29.016374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c681cfa8-9f5d-4804-be16-1c37d058251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:29.026505 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4492/8947] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:47:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:29.341520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f014437-b1a8-4f9d-b739-dd1966f9b788 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:29.395445 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f014437-b1a8-4f9d-b739-dd1966f9b788 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:29.399192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886e061-89b9-4d65-ae70-1e99e5c266fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:29.400016 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886e061-89b9-4d65-ae70-1e99e5c266fe service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:29.400308 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886e061-89b9-4d65-ae70-1e99e5c266fe service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:29.400627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886e061-89b9-4d65-ae70-1e99e5c266fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:29.402423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-e886e061-89b9-4d65-ae70-1e99e5c266fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:29.415108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886e061-89b9-4d65-ae70-1e99e5c266fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:29.416619 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886e061-89b9-4d65-ae70-1e99e5c266fe service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:29.427889 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4456/8948] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:29.773294 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681cfa8-9f5d-4804-be16-1c37d058251a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:29.774838 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c681cfa8-9f5d-4804-be16-1c37d058251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:29.855867 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681cfa8-9f5d-4804-be16-1c37d058251a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:29.862319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82602c6b-8974-4ffa-8270-f1dd6c241440 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:29.863236 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602c6b-8974-4ffa-8270-f1dd6c241440 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:29.863614 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602c6b-8974-4ffa-8270-f1dd6c241440 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:29.863995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82602c6b-8974-4ffa-8270-f1dd6c241440 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:29.866071 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-82602c6b-8974-4ffa-8270-f1dd6c241440 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:29.887242 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82602c6b-8974-4ffa-8270-f1dd6c241440 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:29.889094 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82602c6b-8974-4ffa-8270-f1dd6c241440 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:29.902443 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4493/8949] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:31.720057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433366e8-6888-4093-9371-5d2b9fdfea72 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:31.720637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433366e8-6888-4093-9371-5d2b9fdfea72 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:31.720637 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433366e8-6888-4093-9371-5d2b9fdfea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:31.761379 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-433366e8-6888-4093-9371-5d2b9fdfea72 None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:31.762601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-433366e8-6888-4093-9371-5d2b9fdfea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:31.769373 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4457/8950] 10.222.0.21 () {58 vars in 1015 bytes} [Sat Mar 26 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:31.785461 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82602c6b-8974-4ffa-8270-f1dd6c241440 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:31.794740 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82602c6b-8974-4ffa-8270-f1dd6c241440 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:31.799099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5062a17-d3d4-4096-a90e-1ee9cf15893d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:31.799750 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5062a17-d3d4-4096-a90e-1ee9cf15893d service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:31.800338 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5062a17-d3d4-4096-a90e-1ee9cf15893d service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:31.800616 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5062a17-d3d4-4096-a90e-1ee9cf15893d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:31.808422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5062a17-d3d4-4096-a90e-1ee9cf15893d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:31.809809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5062a17-d3d4-4096-a90e-1ee9cf15893d service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:31.818539 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4494/8951] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:32.439304 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40b58-286c-468a-8fa7-74ef21f775a9 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:32.439601 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40b58-286c-468a-8fa7-74ef21f775a9 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:32.439878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40b58-286c-468a-8fa7-74ef21f775a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:32.467236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-9aa40b58-286c-468a-8fa7-74ef21f775a9 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:32.474651 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-9aa40b58-286c-468a-8fa7-74ef21f775a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:32.485996 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4458/8952] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:47:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:32.502527 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5062a17-d3d4-4096-a90e-1ee9cf15893d service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:32.506012 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-c5062a17-d3d4-4096-a90e-1ee9cf15893d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:32.543090 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5062a17-d3d4-4096-a90e-1ee9cf15893d service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:32.550342 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7574d-89c8-487d-9d0a-49ba39bad908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:32.551395 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7574d-89c8-487d-9d0a-49ba39bad908 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:32.551753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7574d-89c8-487d-9d0a-49ba39bad908 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:32.552205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7574d-89c8-487d-9d0a-49ba39bad908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:32.563719 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7574d-89c8-487d-9d0a-49ba39bad908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:32.565637 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7574d-89c8-487d-9d0a-49ba39bad908 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:32.577382 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4495/8953] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:36.892033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f051a-bbab-4b2a-a966-bac544c643b6 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:36.893092 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f051a-bbab-4b2a-a966-bac544c643b6 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:36.893208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f051a-bbab-4b2a-a966-bac544c643b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:36.911742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-da1f051a-bbab-4b2a-a966-bac544c643b6 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:47:36.912985 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-da1f051a-bbab-4b2a-a966-bac544c643b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:47:36.924004 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4459/8954] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:47:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:47:36.941649 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7574d-89c8-487d-9d0a-49ba39bad908 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:36.953007 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7574d-89c8-487d-9d0a-49ba39bad908 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:36.959160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c282d-4118-4c26-b7d6-403d31495981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:36.959807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c282d-4118-4c26-b7d6-403d31495981 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:36.960377 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c282d-4118-4c26-b7d6-403d31495981 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:36.960511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c282d-4118-4c26-b7d6-403d31495981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:36.970001 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c282d-4118-4c26-b7d6-403d31495981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:36.971640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c282d-4118-4c26-b7d6-403d31495981 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:36.982102 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4496/8955] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:47:39.317924 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f051a-bbab-4b2a-a966-bac544c643b6 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:47:39.326872 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f051a-bbab-4b2a-a966-bac544c643b6 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:47:39.330368 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9f94c-aef7-4831-bdce-6552843b519b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:47:39.331026 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9f94c-aef7-4831-bdce-6552843b519b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:47:39.331311 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9f94c-aef7-4831-bdce-6552843b519b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:47:39.331584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9f94c-aef7-4831-bdce-6552843b519b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:47:39.340264 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9f94c-aef7-4831-bdce-6552843b519b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:47:39.341698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d9f94c-aef7-4831-bdce-6552843b519b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:47:39.351063 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4460/8956] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:47:39 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:49:51.925717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f3bf9-f811-45d1-b4a9-6897854643c3 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:49:51.926248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f3bf9-f811-45d1-b4a9-6897854643c3 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:49:51.926358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f3bf9-f811-45d1-b4a9-6897854643c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:49:51.972560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-4e3f3bf9-f811-45d1-b4a9-6897854643c3 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:49:51.973789 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4e3f3bf9-f811-45d1-b4a9-6897854643c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:49:52.043335 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4497/8957] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:49:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 21:49:52.100192 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9f94c-aef7-4831-bdce-6552843b519b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:49:52.103355 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-64d9f94c-aef7-4831-bdce-6552843b519b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:49:52.203561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d9f94c-aef7-4831-bdce-6552843b519b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:49:52.208680 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20022688-92ce-4997-8680-c4dd5abb33dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:49:52.209317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20022688-92ce-4997-8680-c4dd5abb33dc service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:49:52.209603 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20022688-92ce-4997-8680-c4dd5abb33dc service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:49:52.209883 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20022688-92ce-4997-8680-c4dd5abb33dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:49:52.217707 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20022688-92ce-4997-8680-c4dd5abb33dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:49:52.219292 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20022688-92ce-4997-8680-c4dd5abb33dc service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:49:52.227626 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4461/8958] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:49:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:50:05.294672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5fc6-d7eb-4d96-87bc-686328d26dcd None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:05.295190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5fc6-d7eb-4d96-87bc-686328d26dcd None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:05.295190 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d5fc6-d7eb-4d96-87bc-686328d26dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:05.313956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-5c2d5fc6-d7eb-4d96-87bc-686328d26dcd None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:50:05.315135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-5c2d5fc6-d7eb-4d96-87bc-686328d26dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:05.322169 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4498/8959] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:50:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:50:05.333503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20022688-92ce-4997-8680-c4dd5abb33dc service swift] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:50:05.334878 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-20022688-92ce-4997-8680-c4dd5abb33dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:05.346844 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20022688-92ce-4997-8680-c4dd5abb33dc service swift] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:50:05.350684 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d38ed-bc63-4ab0-b54e-0363c2b782be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:50:05.351317 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d38ed-bc63-4ab0-b54e-0363c2b782be service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:05.351595 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d38ed-bc63-4ab0-b54e-0363c2b782be service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:05.351873 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d38ed-bc63-4ab0-b54e-0363c2b782be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:05.359104 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d38ed-bc63-4ab0-b54e-0363c2b782be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:50:05.360581 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d38ed-bc63-4ab0-b54e-0363c2b782be service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:50:05.369070 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4462/8960] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:50:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:50:05.472764 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3d7b-dd87-4b45-911a-1ac12a3bafca None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:05.473175 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3d7b-dd87-4b45-911a-1ac12a3bafca None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:05.473677 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f3d7b-dd87-4b45-911a-1ac12a3bafca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:05.496199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-308f3d7b-dd87-4b45-911a-1ac12a3bafca None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:50:05.497454 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-308f3d7b-dd87-4b45-911a-1ac12a3bafca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:05.518435 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4499/8961] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:50:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:50:05.530435 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5f6d-89db-4909-aa8d-21492f38292a None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:05.530840 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5f6d-89db-4909-aa8d-21492f38292a None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:05.531358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee5f6d-89db-4909-aa8d-21492f38292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:05.582388 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-65ee5f6d-89db-4909-aa8d-21492f38292a None None] MFA Rules not processed for user `82c1da5e55da4bf380e86064d66e638b`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:50:05.583938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-65ee5f6d-89db-4909-aa8d-21492f38292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:05.643391 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4463/8962] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Mar 26 21:50:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:50:05.649324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f3d7b-dd87-4b45-911a-1ac12a3bafca None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:50:05.658268 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f3d7b-dd87-4b45-911a-1ac12a3bafca None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:50:05.661887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1bf40-5584-42de-abe1-59a106fa8517 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:50:05.662509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1bf40-5584-42de-abe1-59a106fa8517 service glance] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:05.662792 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1bf40-5584-42de-abe1-59a106fa8517 service glance] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:05.663072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1bf40-5584-42de-abe1-59a106fa8517 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:05.672984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1bf40-5584-42de-abe1-59a106fa8517 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:50:05.674671 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a1bf40-5584-42de-abe1-59a106fa8517 service glance] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:50:05.685877 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4500/8963] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:50:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:50:05.743896 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec1b6b-8bd5-4288-a3df-7c8de4da5f23 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:05.744225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec1b6b-8bd5-4288-a3df-7c8de4da5f23 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:05.744508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec1b6b-8bd5-4288-a3df-7c8de4da5f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:05.762418 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-93ec1b6b-8bd5-4288-a3df-7c8de4da5f23 None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:50:05.763633 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-93ec1b6b-8bd5-4288-a3df-7c8de4da5f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:05.770140 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4464/8964] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:50:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:50:05.780914 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1bf40-5584-42de-abe1-59a106fa8517 service glance] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:50:05.790627 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1bf40-5584-42de-abe1-59a106fa8517 service glance] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:50:05.794231 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7458d0-ed23-4add-a4e2-551c975cef38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:50:05.794851 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7458d0-ed23-4add-a4e2-551c975cef38 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:05.795130 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7458d0-ed23-4add-a4e2-551c975cef38 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:05.795402 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7458d0-ed23-4add-a4e2-551c975cef38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:05.803427 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7458d0-ed23-4add-a4e2-551c975cef38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:50:05.804834 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7458d0-ed23-4add-a4e2-551c975cef38 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:50:05.812659 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4501/8965] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:50:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:50:05.884231 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63950d4-b4d0-4fbf-a612-5fdd7e8ec7a5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:05.884522 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63950d4-b4d0-4fbf-a612-5fdd7e8ec7a5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:05.884802 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63950d4-b4d0-4fbf-a612-5fdd7e8ec7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:05.903358 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f63950d4-b4d0-4fbf-a612-5fdd7e8ec7a5 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:50:05.904561 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f63950d4-b4d0-4fbf-a612-5fdd7e8ec7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:05.914122 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4465/8966] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:50:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:50:05.924132 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7458d0-ed23-4add-a4e2-551c975cef38 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:50:05.933323 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7458d0-ed23-4add-a4e2-551c975cef38 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:50:05.936950 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72b367-907e-4b16-89e4-07a10604ff93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:50:05.937569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72b367-907e-4b16-89e4-07a10604ff93 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:05.937849 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72b367-907e-4b16-89e4-07a10604ff93 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:05.938123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72b367-907e-4b16-89e4-07a10604ff93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:05.948569 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72b367-907e-4b16-89e4-07a10604ff93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:50:05.950002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72b367-907e-4b16-89e4-07a10604ff93 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:50:05.961084 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4502/8967] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:50:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:50:06.695048 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0479e-7e28-453f-8d5b-27b8f8d989fa None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:06.695610 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0479e-7e28-453f-8d5b-27b8f8d989fa None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:06.695717 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0479e-7e28-453f-8d5b-27b8f8d989fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:06.713590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-96e0479e-7e28-453f-8d5b-27b8f8d989fa None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:50:06.714782 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-96e0479e-7e28-453f-8d5b-27b8f8d989fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:06.721248 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4466/8968] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Mar 26 21:50:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:50:06.733127 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72b367-907e-4b16-89e4-07a10604ff93 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:50:06.742221 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72b367-907e-4b16-89e4-07a10604ff93 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:50:06.745882 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de66e9-b10b-4d51-88ad-2d84d2950629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:50:06.746518 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de66e9-b10b-4d51-88ad-2d84d2950629 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:06.746801 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de66e9-b10b-4d51-88ad-2d84d2950629 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:06.747077 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de66e9-b10b-4d51-88ad-2d84d2950629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:06.754374 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de66e9-b10b-4d51-88ad-2d84d2950629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:50:06.755827 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de66e9-b10b-4d51-88ad-2d84d2950629 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:50:06.763748 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4503/8969] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:50:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:50:08.196848 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8f3e7-3894-43b1-af87-548f12c2a49b None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:08.197385 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8f3e7-3894-43b1-af87-548f12c2a49b None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:08.197498 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8f3e7-3894-43b1-af87-548f12c2a49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:08.214774 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-7ad8f3e7-3894-43b1-af87-548f12c2a49b None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:50:08.216086 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-7ad8f3e7-3894-43b1-af87-548f12c2a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:08.223188 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4467/8970] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:50:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:50:08.237324 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de66e9-b10b-4d51-88ad-2d84d2950629 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:50:08.249887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de66e9-b10b-4d51-88ad-2d84d2950629 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:50:08.254962 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de387cbf-6d81-48f5-8222-e066225312ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:50:08.255602 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de387cbf-6d81-48f5-8222-e066225312ad service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:08.255887 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de387cbf-6d81-48f5-8222-e066225312ad service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:08.256201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de387cbf-6d81-48f5-8222-e066225312ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:08.264513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de387cbf-6d81-48f5-8222-e066225312ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:50:08.266106 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de387cbf-6d81-48f5-8222-e066225312ad service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:50:08.274785 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4504/8971] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:50:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:50:23.048442 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789640f-c162-4859-960f-a93df5b41788 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:23.048965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789640f-c162-4859-960f-a93df5b41788 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:23.048965 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789640f-c162-4859-960f-a93df5b41788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:23.066351 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-d789640f-c162-4859-960f-a93df5b41788 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:50:23.067520 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d789640f-c162-4859-960f-a93df5b41788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:23.075338 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4468/8972] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 21:50:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:50:23.087807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de387cbf-6d81-48f5-8222-e066225312ad service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:50:23.098513 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de387cbf-6d81-48f5-8222-e066225312ad service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:50:23.103537 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbdc6d-83e9-4152-859c-1619193dc859 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:50:23.104201 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbdc6d-83e9-4152-859c-1619193dc859 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:23.104484 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbdc6d-83e9-4152-859c-1619193dc859 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:23.104798 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfbdc6d-83e9-4152-859c-1619193dc859 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:23.113126 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbdc6d-83e9-4152-859c-1619193dc859 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:50:23.114717 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfbdc6d-83e9-4152-859c-1619193dc859 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:50:23.122663 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4505/8973] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:50:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 26 21:50:45.718509 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789640f-c162-4859-960f-a93df5b41788 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:50:45.719906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-d789640f-c162-4859-960f-a93df5b41788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:45.772859 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789640f-c162-4859-960f-a93df5b41788 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:50:45.778457 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc252f7-0517-4ede-bc67-db17ebb896dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:50:45.779305 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc252f7-0517-4ede-bc67-db17ebb896dc service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:45.779590 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc252f7-0517-4ede-bc67-db17ebb896dc service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:45.779866 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc252f7-0517-4ede-bc67-db17ebb896dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:45.781694 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ffc252f7-0517-4ede-bc67-db17ebb896dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:45.793060 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc252f7-0517-4ede-bc67-db17ebb896dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:50:45.794650 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc252f7-0517-4ede-bc67-db17ebb896dc service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:50:45.805049 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4469/8974] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:50:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:50:52.028831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbdc6d-83e9-4152-859c-1619193dc859 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:50:52.069571 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfbdc6d-83e9-4152-859c-1619193dc859 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:50:52.074568 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad9a8-48a2-446f-90f7-255dc7b8144f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:50:52.075199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad9a8-48a2-446f-90f7-255dc7b8144f service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:50:52.075481 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad9a8-48a2-446f-90f7-255dc7b8144f service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:50:52.075757 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad9a8-48a2-446f-90f7-255dc7b8144f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:50:52.077546 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-ad7ad9a8-48a2-446f-90f7-255dc7b8144f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:50:52.097591 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ad9a8-48a2-446f-90f7-255dc7b8144f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:50:52.099160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ad9a8-48a2-446f-90f7-255dc7b8144f service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:50:52.108781 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4506/8975] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:50:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:51:37.474175 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ce10-0d80-4978-a10d-a8a13997d0c1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:51:37.475244 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ce10-0d80-4978-a10d-a8a13997d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:51:37.475478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ce10-0d80-4978-a10d-a8a13997d0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:51:37.493451 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-0270ce10-0d80-4978-a10d-a8a13997d0c1 None None] MFA Rules not processed for user `07e77369a94844529947de0f46a54edd`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:51:37.494660 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0270ce10-0d80-4978-a10d-a8a13997d0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:51:37.504642 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4470/8976] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Mar 26 21:51:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:51:37.517640 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad9a8-48a2-446f-90f7-255dc7b8144f service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:51:37.530953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad9a8-48a2-446f-90f7-255dc7b8144f service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:51:37.540704 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426e468-9fab-4522-81ce-dadf6833857b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:51:37.541784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426e468-9fab-4522-81ce-dadf6833857b service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:51:37.541921 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426e468-9fab-4522-81ce-dadf6833857b service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:51:37.542103 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426e468-9fab-4522-81ce-dadf6833857b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:51:37.552287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426e468-9fab-4522-81ce-dadf6833857b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:51:37.553923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426e468-9fab-4522-81ce-dadf6833857b service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:51:37.565235 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4507/8977] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:51:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:51:42.276463 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d33d7-e62a-4c35-9e88-f5d82cacc441 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:51:42.276975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d33d7-e62a-4c35-9e88-f5d82cacc441 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:51:42.277106 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d33d7-e62a-4c35-9e88-f5d82cacc441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:51:42.295412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-4e1d33d7-e62a-4c35-9e88-f5d82cacc441 None None] MFA Rules not processed for user `6687c6fa06d244b0a3ddad87237a5d30`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:51:42.296636 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-4e1d33d7-e62a-4c35-9e88-f5d82cacc441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:51:42.303777 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4471/8978] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:51:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:51:45.107520 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33121-fa6f-458e-8e9e-3bc6dbf55058 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:51:45.108074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33121-fa6f-458e-8e9e-3bc6dbf55058 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:51:45.108074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef33121-fa6f-458e-8e9e-3bc6dbf55058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:51:45.136731 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-2ef33121-fa6f-458e-8e9e-3bc6dbf55058 None None] MFA Rules not processed for user `71808360397a42cab9196c51547e33e0`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:51:45.137923 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-2ef33121-fa6f-458e-8e9e-3bc6dbf55058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:51:45.144323 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4508/8979] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:51:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:51:45.156406 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d33d7-e62a-4c35-9e88-f5d82cacc441 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:51:45.167732 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d33d7-e62a-4c35-9e88-f5d82cacc441 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:51:45.171216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e8a4-ea4b-4f76-a3b3-7ef419acd443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:51:45.171839 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e8a4-ea4b-4f76-a3b3-7ef419acd443 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:51:45.172157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e8a4-ea4b-4f76-a3b3-7ef419acd443 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:51:45.172688 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391e8a4-ea4b-4f76-a3b3-7ef419acd443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:51:45.179665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e8a4-ea4b-4f76-a3b3-7ef419acd443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:51:45.181128 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391e8a4-ea4b-4f76-a3b3-7ef419acd443 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:51:45.189204 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4472/8980] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:51:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:52:47.756358 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef33121-fa6f-458e-8e9e-3bc6dbf55058 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:52:47.766379 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef33121-fa6f-458e-8e9e-3bc6dbf55058 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:52:47.770158 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d88bb-ea74-46c0-b634-7a6eb8e064e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:52:47.770795 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d88bb-ea74-46c0-b634-7a6eb8e064e3 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:52:47.771076 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d88bb-ea74-46c0-b634-7a6eb8e064e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:52:47.771351 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d88bb-ea74-46c0-b634-7a6eb8e064e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:52:47.780215 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d88bb-ea74-46c0-b634-7a6eb8e064e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:52:47.781806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d88bb-ea74-46c0-b634-7a6eb8e064e3 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:52:47.791895 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4509/8981] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:52:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:54:16.283330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e8a4-ea4b-4f76-a3b3-7ef419acd443 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:54:16.304594 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391e8a4-ea4b-4f76-a3b3-7ef419acd443 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:54:16.310108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bafbd-3124-409c-b94d-9b68ce382872 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:54:16.310736 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bafbd-3124-409c-b94d-9b68ce382872 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:54:16.311024 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bafbd-3124-409c-b94d-9b68ce382872 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:54:16.311300 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bafbd-3124-409c-b94d-9b68ce382872 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:54:16.318972 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bafbd-3124-409c-b94d-9b68ce382872 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:54:16.320605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bafbd-3124-409c-b94d-9b68ce382872 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:54:16.329267 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4473/8982] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:54:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:54:16.781489 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d88bb-ea74-46c0-b634-7a6eb8e064e3 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:54:16.789956 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d88bb-ea74-46c0-b634-7a6eb8e064e3 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:54:16.793558 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b32fd6-526f-40c1-8479-9a013d2c5bdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:54:16.794184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b32fd6-526f-40c1-8479-9a013d2c5bdd service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:54:16.794463 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b32fd6-526f-40c1-8479-9a013d2c5bdd service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:54:16.794738 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b32fd6-526f-40c1-8479-9a013d2c5bdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:54:16.796753 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-04b32fd6-526f-40c1-8479-9a013d2c5bdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:54:16.821999 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b32fd6-526f-40c1-8479-9a013d2c5bdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:54:16.823511 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b32fd6-526f-40c1-8479-9a013d2c5bdd service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:54:16.834662 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4510/8983] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:54:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:54:18.021927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bafbd-3124-409c-b94d-9b68ce382872 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:54:18.031116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bafbd-3124-409c-b94d-9b68ce382872 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:54:18.035242 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda8b4-8ea4-48b8-8075-a9891859ea98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:54:18.035884 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda8b4-8ea4-48b8-8075-a9891859ea98 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:54:18.036191 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda8b4-8ea4-48b8-8075-a9891859ea98 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:54:18.036470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bda8b4-8ea4-48b8-8075-a9891859ea98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:54:18.038224 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-49bda8b4-8ea4-48b8-8075-a9891859ea98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:54:18.052069 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bda8b4-8ea4-48b8-8075-a9891859ea98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:54:18.053507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bda8b4-8ea4-48b8-8075-a9891859ea98 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:54:18.064189 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4474/8984] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:54:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:54:30.242703 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b32fd6-526f-40c1-8479-9a013d2c5bdd service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:54:30.253512 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b32fd6-526f-40c1-8479-9a013d2c5bdd service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:54:30.258406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46282c-ee1f-49f2-9b98-e2012dd4df86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:54:30.259024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46282c-ee1f-49f2-9b98-e2012dd4df86 service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:54:30.259303 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46282c-ee1f-49f2-9b98-e2012dd4df86 service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:54:30.259573 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46282c-ee1f-49f2-9b98-e2012dd4df86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:54:30.261317 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-8a46282c-ee1f-49f2-9b98-e2012dd4df86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:54:30.284421 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46282c-ee1f-49f2-9b98-e2012dd4df86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:54:30.286018 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46282c-ee1f-49f2-9b98-e2012dd4df86 service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:54:30.297096 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4511/8985] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:54:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:54:32.304384 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda8b4-8ea4-48b8-8075-a9891859ea98 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:54:32.316573 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bda8b4-8ea4-48b8-8075-a9891859ea98 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:54:32.323321 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fc75a-950e-48ff-b076-2f9004557363 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:54:32.323989 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fc75a-950e-48ff-b076-2f9004557363 service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:54:32.324274 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fc75a-950e-48ff-b076-2f9004557363 service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:54:32.324551 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fc75a-950e-48ff-b076-2f9004557363 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:54:32.333772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fc75a-950e-48ff-b076-2f9004557363 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:54:32.336062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fc75a-950e-48ff-b076-2f9004557363 service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:54:32.355700 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4475/8986] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:54:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 21:54:40.000811 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46282c-ee1f-49f2-9b98-e2012dd4df86 service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:54:40.014074 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46282c-ee1f-49f2-9b98-e2012dd4df86 service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:54:40.019812 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23351392-e805-4704-b388-aa116e45952c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:54:40.020713 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351392-e805-4704-b388-aa116e45952c service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:54:40.021182 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351392-e805-4704-b388-aa116e45952c service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:54:40.022152 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23351392-e805-4704-b388-aa116e45952c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:54:40.031874 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23351392-e805-4704-b388-aa116e45952c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:54:40.033599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23351392-e805-4704-b388-aa116e45952c service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:54:40.045655 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4512/8987] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:54:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:55:48.102410 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fc75a-950e-48ff-b076-2f9004557363 service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:55:48.113377 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fc75a-950e-48ff-b076-2f9004557363 service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:55:48.118584 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ac16-2f30-4800-8cfc-298106ad607d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:55:48.119219 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ac16-2f30-4800-8cfc-298106ad607d service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:55:48.119504 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ac16-2f30-4800-8cfc-298106ad607d service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:55:48.119812 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ac16-2f30-4800-8cfc-298106ad607d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:55:48.128172 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23ac16-2f30-4800-8cfc-298106ad607d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:55:48.129769 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23ac16-2f30-4800-8cfc-298106ad607d service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:55:48.140079 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4476/8988] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:55:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:55:50.384452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23351392-e805-4704-b388-aa116e45952c service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:55:50.393860 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23351392-e805-4704-b388-aa116e45952c service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:55:50.397479 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9aca-8ea6-47c2-a856-d98f5c6d906f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:55:50.398167 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9aca-8ea6-47c2-a856-d98f5c6d906f service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:55:50.398452 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9aca-8ea6-47c2-a856-d98f5c6d906f service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:55:50.398732 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f9aca-8ea6-47c2-a856-d98f5c6d906f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:55:50.405870 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f9aca-8ea6-47c2-a856-d98f5c6d906f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:55:50.407310 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f9aca-8ea6-47c2-a856-d98f5c6d906f service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:55:50.414897 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4513/8989] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:55:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:55:57.115312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ac16-2f30-4800-8cfc-298106ad607d service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:55:57.126363 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ac16-2f30-4800-8cfc-298106ad607d service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:55:57.131338 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ec684-6036-4383-92a5-1726d52c04ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:55:57.131999 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ec684-6036-4383-92a5-1726d52c04ad service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:55:57.132281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ec684-6036-4383-92a5-1726d52c04ad service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:55:57.132555 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8ec684-6036-4383-92a5-1726d52c04ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:55:57.140852 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ec684-6036-4383-92a5-1726d52c04ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:55:57.142419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8ec684-6036-4383-92a5-1726d52c04ad service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:55:57.151816 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4477/8990] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:55:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:56:05.569147 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9aca-8ea6-47c2-a856-d98f5c6d906f service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:05.579064 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f9aca-8ea6-47c2-a856-d98f5c6d906f service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:05.582796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf46d2-9114-4de6-b75d-014732f06494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:05.583428 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf46d2-9114-4de6-b75d-014732f06494 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:05.583708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf46d2-9114-4de6-b75d-014732f06494 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:05.584050 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf46d2-9114-4de6-b75d-014732f06494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:05.643595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf46d2-9114-4de6-b75d-014732f06494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:05.645068 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf46d2-9114-4de6-b75d-014732f06494 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:05.655441 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4514/8991] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:56:12.336588 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ec684-6036-4383-92a5-1726d52c04ad service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:12.348927 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8ec684-6036-4383-92a5-1726d52c04ad service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:12.353757 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:12.354627 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:12.354909 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:12.355187 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] PATH_INFO: `/v3/users/6687c6fa06d244b0a3ddad87237a5d30` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:12.356400 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6687c6fa06d244b0a3ddad87237a5d30)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:12.358409 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:12.402232 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6687c6fa06d244b0a3ddad87237a5d30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.409682 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6687c6fa06d244b0a3ddad87237a5d30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.410303 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6687c6fa06d244b0a3ddad87237a5d30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.410906 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6687c6fa06d244b0a3ddad87237a5d30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.422503 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6687c6fa06d244b0a3ddad87237a5d30'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.434479 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4478/8992] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:56:12 2022] DELETE /identity/v3/users/6687c6fa06d244b0a3ddad87237a5d30 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:56:12.604495 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf46d2-9114-4de6-b75d-014732f06494 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:12.617410 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf46d2-9114-4de6-b75d-014732f06494 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:12.674302 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:12.675154 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:12.675439 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:12.675715 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] PATH_INFO: `/v3/projects/7f82e50b0f4249b889d84b7c46dbb448` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:12.676958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f82e50b0f4249b889d84b7c46dbb448)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:12.678871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:12.723449 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f82e50b0f4249b889d84b7c46dbb448', 'request_id': 'req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.730708 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f82e50b0f4249b889d84b7c46dbb448', 'request_id': 'req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.736084 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f82e50b0f4249b889d84b7c46dbb448', 'request_id': 'req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.746639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] The token cache is being invalidate because project 7f82e50b0f4249b889d84b7c46dbb448 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:56:12.746927 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.747560 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.749609 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4515/8993] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:56:12 2022] DELETE /identity/v3/projects/7f82e50b0f4249b889d84b7c46dbb448 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:56:12.753560 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:12.754987 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:12.768433 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a1ae61-090f-4fb5-9778-8f49aa9947f5 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:12.821982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:12.822758 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:12.823041 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:12.823310 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] PATH_INFO: `/v3/users/61920f735447445f81f4a9e745f334b0` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:12.824512 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61920f735447445f81f4a9e745f334b0)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:12.826467 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:12.870370 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61920f735447445f81f4a9e745f334b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.877417 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61920f735447445f81f4a9e745f334b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.878165 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61920f735447445f81f4a9e745f334b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.878764 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61920f735447445f81f4a9e745f334b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.890726 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-068f565c-bac2-47f5-a4ba-c1d6ea954cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61920f735447445f81f4a9e745f334b0'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:12.902659 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4479/8994] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 21:56:12 2022] DELETE /identity/v3/users/61920f735447445f81f4a9e745f334b0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:56:13.072202 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:13.073622 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:13.087199 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37eb7fe-adf3-4bdc-ae06-f463b76ac3b0 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:13.143169 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:13.144051 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.144334 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.144604 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] PATH_INFO: `/v3/projects/bab6ea3329fa4e9fa807bc593b00d5fb` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.145817 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bab6ea3329fa4e9fa807bc593b00d5fb)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:13.147721 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:13.191949 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bab6ea3329fa4e9fa807bc593b00d5fb', 'request_id': 'req-3f1e1293-6663-4678-9487-7c7882590955'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:13.198186 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bab6ea3329fa4e9fa807bc593b00d5fb', 'request_id': 'req-3f1e1293-6663-4678-9487-7c7882590955'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:13.203422 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bab6ea3329fa4e9fa807bc593b00d5fb', 'request_id': 'req-3f1e1293-6663-4678-9487-7c7882590955'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:13.213706 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] The token cache is being invalidate because project bab6ea3329fa4e9fa807bc593b00d5fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97202) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 21:56:13.213992 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:13.214612 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-3f1e1293-6663-4678-9487-7c7882590955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 21:56:13.216131 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4516/8995] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 21:56:13 2022] DELETE /identity/v3/projects/bab6ea3329fa4e9fa807bc593b00d5fb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:56:13.222108 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b9813-470b-4201-a699-5936f28ea3d5 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.222405 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b9813-470b-4201-a699-5936f28ea3d5 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.222687 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b9813-470b-4201-a699-5936f28ea3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.251708 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-b63b9813-470b-4201-a699-5936f28ea3d5 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:56:13.252931 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-b63b9813-470b-4201-a699-5936f28ea3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:13.313138 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4480/8996] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:56:13.321006 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193e9b4-093c-4c28-b02d-46dc525ae74a None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.321509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193e9b4-093c-4c28-b02d-46dc525ae74a None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.321916 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193e9b4-093c-4c28-b02d-46dc525ae74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.340203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-6193e9b4-093c-4c28-b02d-46dc525ae74a None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:56:13.341545 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6193e9b4-093c-4c28-b02d-46dc525ae74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:13.353226 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4517/8997] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:56:13.357084 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b9813-470b-4201-a699-5936f28ea3d5 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:13.367239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b9813-470b-4201-a699-5936f28ea3d5 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:13.371775 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e65b4-574f-4474-b91e-3d3fe0a59b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:13.372452 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e65b4-574f-4474-b91e-3d3fe0a59b8d admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.372734 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e65b4-574f-4474-b91e-3d3fe0a59b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.373009 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e65b4-574f-4474-b91e-3d3fe0a59b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.373721 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e65b4-574f-4474-b91e-3d3fe0a59b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=97203) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 26 21:56:13.374023 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e65b4-574f-4474-b91e-3d3fe0a59b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:13.375620 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e65b4-574f-4474-b91e-3d3fe0a59b8d admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:13.386725 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4481/8998] 10.222.0.16 () {58 vars in 1152 bytes} [Sat Mar 26 21:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 26 21:56:13.390796 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193e9b4-093c-4c28-b02d-46dc525ae74a None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:13.399779 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193e9b4-093c-4c28-b02d-46dc525ae74a None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:13.404815 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55148752-f17b-46c2-9b31-fd0ea2d96455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:13.405444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148752-f17b-46c2-9b31-fd0ea2d96455 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.405722 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148752-f17b-46c2-9b31-fd0ea2d96455 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.405995 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55148752-f17b-46c2-9b31-fd0ea2d96455 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.406676 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55148752-f17b-46c2-9b31-fd0ea2d96455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:13.408632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55148752-f17b-46c2-9b31-fd0ea2d96455 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:13.434696 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4518/8999] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:56:13 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:56:13.438507 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e65b4-574f-4474-b91e-3d3fe0a59b8d admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:13.448236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e65b4-574f-4474-b91e-3d3fe0a59b8d admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:13.502116 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115ca59-c84d-4d98-9fd9-ce28a1fbe3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:13.502777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115ca59-c84d-4d98-9fd9-ce28a1fbe3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.503062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115ca59-c84d-4d98-9fd9-ce28a1fbe3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.503344 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115ca59-c84d-4d98-9fd9-ce28a1fbe3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.504100 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115ca59-c84d-4d98-9fd9-ce28a1fbe3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:13.506046 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115ca59-c84d-4d98-9fd9-ce28a1fbe3d2 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:13.528659 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4482/9000] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:56:13 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:56:13.530477 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55148752-f17b-46c2-9b31-fd0ea2d96455 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:13.540615 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55148752-f17b-46c2-9b31-fd0ea2d96455 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:13.545476 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d46ef-4a74-4c4b-bd85-40ddf0279732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:13.546115 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d46ef-4a74-4c4b-bd85-40ddf0279732 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.546394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d46ef-4a74-4c4b-bd85-40ddf0279732 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.546666 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d46ef-4a74-4c4b-bd85-40ddf0279732 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.547404 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d46ef-4a74-4c4b-bd85-40ddf0279732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:13.549024 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d46ef-4a74-4c4b-bd85-40ddf0279732 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:13.559109 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4519/9001] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 26 21:56:13.562940 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115ca59-c84d-4d98-9fd9-ce28a1fbe3d2 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:13.572936 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115ca59-c84d-4d98-9fd9-ce28a1fbe3d2 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:13.578425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3d2e0-606b-4aab-ba82-d2e53952eb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:13.579119 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3d2e0-606b-4aab-ba82-d2e53952eb56 admin admin] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.579411 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3d2e0-606b-4aab-ba82-d2e53952eb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.579697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3d2e0-606b-4aab-ba82-d2e53952eb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.580461 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3d2e0-606b-4aab-ba82-d2e53952eb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:13.582083 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3d2e0-606b-4aab-ba82-d2e53952eb56 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:13.593297 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4483/9002] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:56:13.597123 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d46ef-4a74-4c4b-bd85-40ddf0279732 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:13.606858 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d46ef-4a74-4c4b-bd85-40ddf0279732 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:13.611451 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f5e2-7959-427e-826e-b89403177d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:13.612347 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f5e2-7959-427e-826e-b89403177d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.612630 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f5e2-7959-427e-826e-b89403177d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.612904 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43f5e2-7959-427e-826e-b89403177d3d admin admin] PATH_INFO: `/v3/projects/91377f5443a24bebb01fc02288b2f172/users/87eef87dfbe04b4f8fadb5d4a9287a14/roles/c7e02bca0ee343c0a8cb78d837b5ad30` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.626783 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f5e2-7959-427e-826e-b89403177d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91377f5443a24bebb01fc02288b2f172, user_id=87eef87dfbe04b4f8fadb5d4a9287a14, role_id=c7e02bca0ee343c0a8cb78d837b5ad30)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:13.629472 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43f5e2-7959-427e-826e-b89403177d3d admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:13.642678 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4520/9003] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:56:13 2022] PUT /identity/v3/projects/91377f5443a24bebb01fc02288b2f172/users/87eef87dfbe04b4f8fadb5d4a9287a14/roles/c7e02bca0ee343c0a8cb78d837b5ad30 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:56:13.647742 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb28f9-e02d-451e-8a5f-23f834ba7d61 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.648085 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb28f9-e02d-451e-8a5f-23f834ba7d61 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.648479 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb28f9-e02d-451e-8a5f-23f834ba7d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.667544 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-c0eb28f9-e02d-451e-8a5f-23f834ba7d61 None None] MFA Rules not processed for user `ebbe1a3c461148b98c3d0846726c2888`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:56:13.668777 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-c0eb28f9-e02d-451e-8a5f-23f834ba7d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:13.726035 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4484/9004] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:56:13.735623 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f5e2-7959-427e-826e-b89403177d3d admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:13.737349 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-6d43f5e2-7959-427e-826e-b89403177d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:13.792052 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43f5e2-7959-427e-826e-b89403177d3d admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:13.796078 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae37d9e-aaa7-4acc-a853-18e6765deaa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:13.796716 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae37d9e-aaa7-4acc-a853-18e6765deaa9 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:13.797000 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae37d9e-aaa7-4acc-a853-18e6765deaa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:13.797278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae37d9e-aaa7-4acc-a853-18e6765deaa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:13.806102 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae37d9e-aaa7-4acc-a853-18e6765deaa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:13.807539 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae37d9e-aaa7-4acc-a853-18e6765deaa9 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:13.817127 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4521/9005] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:56:17.919393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1d790-bcfb-4d0f-9da2-920eaba29dd1 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:17.920017 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1d790-bcfb-4d0f-9da2-920eaba29dd1 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:17.921235 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1d790-bcfb-4d0f-9da2-920eaba29dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:17.956425 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-1fb1d790-bcfb-4d0f-9da2-920eaba29dd1 None None] MFA Rules not processed for user `87eef87dfbe04b4f8fadb5d4a9287a14`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:56:17.958330 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-1fb1d790-bcfb-4d0f-9da2-920eaba29dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:18.050039 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4485/9006] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:56:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:56:18.054890 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae37d9e-aaa7-4acc-a853-18e6765deaa9 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:18.066139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae37d9e-aaa7-4acc-a853-18e6765deaa9 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:18.071140 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517b105-bc4e-4a1b-bb50-2668463f09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:18.071806 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b105-bc4e-4a1b-bb50-2668463f09a6 admin admin] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:18.072135 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b105-bc4e-4a1b-bb50-2668463f09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:18.072413 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b105-bc4e-4a1b-bb50-2668463f09a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:18.073109 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517b105-bc4e-4a1b-bb50-2668463f09a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:18.075039 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0517b105-bc4e-4a1b-bb50-2668463f09a6 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:18.111968 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4522/9007] 10.222.0.16 () {60 vars in 1152 bytes} [Sat Mar 26 21:56:18 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:56:18.113474 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1d790-bcfb-4d0f-9da2-920eaba29dd1 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:18.129439 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1d790-bcfb-4d0f-9da2-920eaba29dd1 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:18.188533 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4e80-1040-42c3-b58f-6cb2c56d5826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:18.189208 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4e80-1040-42c3-b58f-6cb2c56d5826 admin admin] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:18.189490 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4e80-1040-42c3-b58f-6cb2c56d5826 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:18.189765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4e80-1040-42c3-b58f-6cb2c56d5826 admin admin] PATH_INFO: `/v3/users` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:18.190450 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4e80-1040-42c3-b58f-6cb2c56d5826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:18.192412 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4e80-1040-42c3-b58f-6cb2c56d5826 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:18.215602 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4486/9008] 10.222.0.16 () {60 vars in 1143 bytes} [Sat Mar 26 21:56:18 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 26 21:56:18.220197 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517b105-bc4e-4a1b-bb50-2668463f09a6 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:18.230910 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517b105-bc4e-4a1b-bb50-2668463f09a6 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:18.236233 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123341-56c7-44e0-bf8f-7608197d4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:18.236917 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123341-56c7-44e0-bf8f-7608197d4635 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:18.237205 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123341-56c7-44e0-bf8f-7608197d4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:18.237486 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123341-56c7-44e0-bf8f-7608197d4635 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:18.238372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1123341-56c7-44e0-bf8f-7608197d4635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:18.240048 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1123341-56c7-44e0-bf8f-7608197d4635 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:18.251958 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4523/9009] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:56:18.256072 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4e80-1040-42c3-b58f-6cb2c56d5826 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:18.266813 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4e80-1040-42c3-b58f-6cb2c56d5826 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:18.271468 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492ef6b-b632-46ce-bb7c-14e8692433ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:18.272390 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492ef6b-b632-46ce-bb7c-14e8692433ae admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:18.272673 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492ef6b-b632-46ce-bb7c-14e8692433ae admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:18.272947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492ef6b-b632-46ce-bb7c-14e8692433ae admin admin] PATH_INFO: `/v3/projects/aa972b0087944c5fa135bda1fa3f09c1/users/8e9fee820e0f41a8bc660d3a1c90f1ad/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:18.289115 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492ef6b-b632-46ce-bb7c-14e8692433ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa972b0087944c5fa135bda1fa3f09c1, user_id=8e9fee820e0f41a8bc660d3a1c90f1ad, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:18.291803 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492ef6b-b632-46ce-bb7c-14e8692433ae admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:18.307711 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4487/9010] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:56:18 2022] PUT /identity/v3/projects/aa972b0087944c5fa135bda1fa3f09c1/users/8e9fee820e0f41a8bc660d3a1c90f1ad/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 21:56:18.311857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123341-56c7-44e0-bf8f-7608197d4635 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:18.322150 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123341-56c7-44e0-bf8f-7608197d4635 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:18.380632 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d4578-de36-41f2-83ed-e5e392529631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:18.381307 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d4578-de36-41f2-83ed-e5e392529631 admin admin] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:18.381596 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d4578-de36-41f2-83ed-e5e392529631 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:18.381880 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d4578-de36-41f2-83ed-e5e392529631 admin admin] PATH_INFO: `/v3/roles` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:18.382599 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d4578-de36-41f2-83ed-e5e392529631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:18.384245 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d4578-de36-41f2-83ed-e5e392529631 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:18.395410 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4524/9011] 10.222.0.16 () {58 vars in 1121 bytes} [Sat Mar 26 21:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 26 21:56:18.399793 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492ef6b-b632-46ce-bb7c-14e8692433ae admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:18.411162 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492ef6b-b632-46ce-bb7c-14e8692433ae admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:18.416111 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a1bb9-f1f9-4793-9028-c78210f16b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:18.417012 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a1bb9-f1f9-4793-9028-c78210f16b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:18.417347 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a1bb9-f1f9-4793-9028-c78210f16b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:18.417630 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a1bb9-f1f9-4793-9028-c78210f16b36 admin admin] PATH_INFO: `/v3/projects/aa972b0087944c5fa135bda1fa3f09c1/users/8e9fee820e0f41a8bc660d3a1c90f1ad/roles/8160adb3a8504dd3b239b60abf8bde28` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:18.420091 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a1bb9-f1f9-4793-9028-c78210f16b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa972b0087944c5fa135bda1fa3f09c1, user_id=8e9fee820e0f41a8bc660d3a1c90f1ad, role_id=8160adb3a8504dd3b239b60abf8bde28)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:18.422776 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a1bb9-f1f9-4793-9028-c78210f16b36 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:18.434139 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4488/9012] 10.222.0.16 () {60 vars in 1482 bytes} [Sat Mar 26 21:56:18 2022] PUT /identity/v3/projects/aa972b0087944c5fa135bda1fa3f09c1/users/8e9fee820e0f41a8bc660d3a1c90f1ad/roles/8160adb3a8504dd3b239b60abf8bde28 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 26 21:56:23.177506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa09f-d578-4b0e-bce1-5808522e9a15 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:23.178002 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa09f-d578-4b0e-bce1-5808522e9a15 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:23.178519 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa09f-d578-4b0e-bce1-5808522e9a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:23.215609 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-15baa09f-d578-4b0e-bce1-5808522e9a15 None None] MFA Rules not processed for user `8e9fee820e0f41a8bc660d3a1c90f1ad`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:56:23.217837 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-15baa09f-d578-4b0e-bce1-5808522e9a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:23.341324 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4525/9013] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:56:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:56:23.354851 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a1bb9-f1f9-4793-9028-c78210f16b36 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:23.357057 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-643a1bb9-f1f9-4793-9028-c78210f16b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:23.446042 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a1bb9-f1f9-4793-9028-c78210f16b36 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:23.454337 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5dae8-55f6-4711-8161-827abfbfed4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:23.455216 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5dae8-55f6-4711-8161-827abfbfed4f service nova] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:23.456272 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5dae8-55f6-4711-8161-827abfbfed4f service nova] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:23.456771 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5dae8-55f6-4711-8161-827abfbfed4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:23.530470 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5dae8-55f6-4711-8161-827abfbfed4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:23.532312 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5dae8-55f6-4711-8161-827abfbfed4f service nova] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:23.542709 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4489/9014] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:56:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:56:24.673925 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110f345-f471-470b-be69-813792ffdd60 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:24.674487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110f345-f471-470b-be69-813792ffdd60 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:24.674487 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110f345-f471-470b-be69-813792ffdd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:24.692261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-0110f345-f471-470b-be69-813792ffdd60 None None] MFA Rules not processed for user `87eef87dfbe04b4f8fadb5d4a9287a14`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:56:24.693469 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0110f345-f471-470b-be69-813792ffdd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:24.700400 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4526/9015] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:56:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:56:25.009898 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5dae8-55f6-4711-8161-827abfbfed4f service nova] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:25.011262 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-02d5dae8-55f6-4711-8161-827abfbfed4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:25.069360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5dae8-55f6-4711-8161-827abfbfed4f service nova] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:25.072982 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefacff-40bf-41f9-8444-e448aeb14113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:25.073624 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefacff-40bf-41f9-8444-e448aeb14113 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:25.073905 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefacff-40bf-41f9-8444-e448aeb14113 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:25.074177 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefacff-40bf-41f9-8444-e448aeb14113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:25.076536 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bfefacff-40bf-41f9-8444-e448aeb14113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:25.086258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefacff-40bf-41f9-8444-e448aeb14113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:25.087712 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefacff-40bf-41f9-8444-e448aeb14113 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:25.096911 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4490/9016] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:56:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:56:25.450639 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110f345-f471-470b-be69-813792ffdd60 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:25.453189 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-0110f345-f471-470b-be69-813792ffdd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:25.527944 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110f345-f471-470b-be69-813792ffdd60 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:25.533104 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609626-18dc-4f1b-ab21-13e32f39edcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:25.533747 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609626-18dc-4f1b-ab21-13e32f39edcc service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:25.534033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609626-18dc-4f1b-ab21-13e32f39edcc service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:25.534339 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d609626-18dc-4f1b-ab21-13e32f39edcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:25.536138 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-4d609626-18dc-4f1b-ab21-13e32f39edcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:25.548203 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d609626-18dc-4f1b-ab21-13e32f39edcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:25.549808 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d609626-18dc-4f1b-ab21-13e32f39edcc service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:25.560000 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4527/9017] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:56:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:56:35.262356 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefacff-40bf-41f9-8444-e448aeb14113 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:35.270947 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefacff-40bf-41f9-8444-e448aeb14113 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:35.274563 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf0a70-dfea-48ca-bc92-aa3d9ed2b7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:35.275190 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf0a70-dfea-48ca-bc92-aa3d9ed2b7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:35.275475 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf0a70-dfea-48ca-bc92-aa3d9ed2b7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:35.275751 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf0a70-dfea-48ca-bc92-aa3d9ed2b7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:35.284738 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf0a70-dfea-48ca-bc92-aa3d9ed2b7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:35.286170 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf0a70-dfea-48ca-bc92-aa3d9ed2b7e4 service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:35.296551 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4491/9018] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:56:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:56:37.264300 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609626-18dc-4f1b-ab21-13e32f39edcc service placement] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:56:37.277375 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d609626-18dc-4f1b-ab21-13e32f39edcc service placement] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:56:37.283125 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b753d-9f69-4fdc-adec-e38dda0dd46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:56:37.283787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b753d-9f69-4fdc-adec-e38dda0dd46a service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:56:37.284122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b753d-9f69-4fdc-adec-e38dda0dd46a service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:56:37.284424 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b753d-9f69-4fdc-adec-e38dda0dd46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:56:37.286274 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-331b753d-9f69-4fdc-adec-e38dda0dd46a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:56:37.299879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b753d-9f69-4fdc-adec-e38dda0dd46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:56:37.301648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b753d-9f69-4fdc-adec-e38dda0dd46a service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:56:37.312879 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4528/9019] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:56:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:57:49.754735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf0a70-dfea-48ca-bc92-aa3d9ed2b7e4 service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:57:49.772765 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf0a70-dfea-48ca-bc92-aa3d9ed2b7e4 service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:57:49.776322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:57:49.776944 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:57:49.777225 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:57:49.777506 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:57:49.779239 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:57:49.789408 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:57:49.790853 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:57:49.799944 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4492/9020] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 21:57:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 21:58:39.246224 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51783d1c-8d38-42f8-b651-297a5248ba03 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:58:39.246709 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51783d1c-8d38-42f8-b651-297a5248ba03 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:58:39.246800 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51783d1c-8d38-42f8-b651-297a5248ba03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:58:39.275139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-51783d1c-8d38-42f8-b651-297a5248ba03 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:58:39.276372 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-51783d1c-8d38-42f8-b651-297a5248ba03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:58:39.330729 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4529/9021] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:58:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:58:39.376378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:58:39.377766 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:58:39.444754 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bf360-b632-4490-8f70-596fb18a52cb service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:58:39.449616 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dba8d27-d1b2-4bc6-8863-893732b9bb55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:58:39.450248 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8d27-d1b2-4bc6-8863-893732b9bb55 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:58:39.450529 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8d27-d1b2-4bc6-8863-893732b9bb55 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:58:39.450804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dba8d27-d1b2-4bc6-8863-893732b9bb55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:58:39.459357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8d27-d1b2-4bc6-8863-893732b9bb55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:58:39.460973 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dba8d27-d1b2-4bc6-8863-893732b9bb55 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:58:39.470613 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4493/9022] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 21:58:48.504321 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb52991-7212-40c7-bc5e-98853116aba8 None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:58:48.504794 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb52991-7212-40c7-bc5e-98853116aba8 None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:58:48.504879 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb52991-7212-40c7-bc5e-98853116aba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:58:48.522319 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-9eb52991-7212-40c7-bc5e-98853116aba8 None None] MFA Rules not processed for user `87eef87dfbe04b4f8fadb5d4a9287a14`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:58:48.523525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9eb52991-7212-40c7-bc5e-98853116aba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:58:48.530471 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4530/9023] 10.222.0.16 () {58 vars in 957 bytes} [Sat Mar 26 21:58:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:58:51.252360 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c3364-baf8-4c44-a66a-37ac45e13135 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:58:51.253189 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c3364-baf8-4c44-a66a-37ac45e13135 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:58:51.253640 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c3364-baf8-4c44-a66a-37ac45e13135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:58:51.271870 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-659c3364-baf8-4c44-a66a-37ac45e13135 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 21:58:51.273101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-659c3364-baf8-4c44-a66a-37ac45e13135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 21:58:51.285872 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4494/9024] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 21:58:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 21:58:51.293249 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb52991-7212-40c7-bc5e-98853116aba8 None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 21:58:51.307648 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb52991-7212-40c7-bc5e-98853116aba8 None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 21:58:51.313340 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d0fe5-06d4-42f0-847a-0a97158aacf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 21:58:51.314160 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d0fe5-06d4-42f0-847a-0a97158aacf7 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 21:58:51.314685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d0fe5-06d4-42f0-847a-0a97158aacf7 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 21:58:51.315672 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d0fe5-06d4-42f0-847a-0a97158aacf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 21:58:51.332685 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d0fe5-06d4-42f0-847a-0a97158aacf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 21:58:51.334312 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d0fe5-06d4-42f0-847a-0a97158aacf7 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 21:58:51.342969 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4531/9025] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 21:58:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 22:00:36.855482 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c3364-baf8-4c44-a66a-37ac45e13135 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:36.856887 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-659c3364-baf8-4c44-a66a-37ac45e13135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:36.931167 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c3364-baf8-4c44-a66a-37ac45e13135 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:36.934791 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f91d5-b95e-4bea-9853-e92c528c6e04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '82c1da5e55da4bf380e86064d66e638b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:36.935424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f91d5-b95e-4bea-9853-e92c528c6e04 service glance] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:36.935710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f91d5-b95e-4bea-9853-e92c528c6e04 service glance] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:36.936019 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f91d5-b95e-4bea-9853-e92c528c6e04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:36.938299 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-fb8f91d5-b95e-4bea-9853-e92c528c6e04 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:36.951481 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f91d5-b95e-4bea-9853-e92c528c6e04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:36.953006 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f91d5-b95e-4bea-9853-e92c528c6e04 service glance] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:36.972802 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4495/9026] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 22:00:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 22:00:40.039287 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18035415-40de-4422-94ff-838c5b6bf10f None None] REQUEST_METHOD: `POST` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:40.039748 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18035415-40de-4422-94ff-838c5b6bf10f None None] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:40.039836 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18035415-40de-4422-94ff-838c5b6bf10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:40.087238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.auth.core [None req-18035415-40de-4422-94ff-838c5b6bf10f None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97202) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 22:00:40.088389 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-18035415-40de-4422-94ff-838c5b6bf10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:40.104480 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4532/9027] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Mar 26 22:00:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 22:00:40.145739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f91d5-b95e-4bea-9853-e92c528c6e04 service glance] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:40.166393 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f91d5-b95e-4bea-9853-e92c528c6e04 service glance] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:40.172258 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d89c1-fd7c-430b-b004-cb8202fb6c12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:40.172899 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d89c1-fd7c-430b-b004-cb8202fb6c12 service swift] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:40.173182 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d89c1-fd7c-430b-b004-cb8202fb6c12 service swift] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:40.173478 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d89c1-fd7c-430b-b004-cb8202fb6c12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:40.181818 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d89c1-fd7c-430b-b004-cb8202fb6c12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:40.183443 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d89c1-fd7c-430b-b004-cb8202fb6c12 service swift] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:40.192065 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4496/9028] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 22:00:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 22:00:41.676408 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18035415-40de-4422-94ff-838c5b6bf10f None None] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:41.695586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18035415-40de-4422-94ff-838c5b6bf10f None None] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:41.701777 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c6cd0-2c7c-48ef-8502-2b25b5545ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:41.703450 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6cd0-2c7c-48ef-8502-2b25b5545ed5 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:41.703984 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6cd0-2c7c-48ef-8502-2b25b5545ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:41.704475 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6cd0-2c7c-48ef-8502-2b25b5545ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:41.709141 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-822c6cd0-2c7c-48ef-8502-2b25b5545ed5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:41.726784 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c6cd0-2c7c-48ef-8502-2b25b5545ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:41.728850 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c6cd0-2c7c-48ef-8502-2b25b5545ed5 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:41.743086 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4533/9029] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 22:00:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 26 22:00:49.650033 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9016f7-2998-4cf6-aa80-ecf88b70ac74 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:49.650524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9016f7-2998-4cf6-aa80-ecf88b70ac74 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:49.650524 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9016f7-2998-4cf6-aa80-ecf88b70ac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:49.683207 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-2e9016f7-2998-4cf6-aa80-ecf88b70ac74 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 22:00:49.684508 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-2e9016f7-2998-4cf6-aa80-ecf88b70ac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:49.691633 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4497/9030] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 22:00:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 26 22:00:49.709099 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c6cd0-2c7c-48ef-8502-2b25b5545ed5 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:49.720994 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c6cd0-2c7c-48ef-8502-2b25b5545ed5 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:49.726033 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5359c2-c465-4c96-9740-6c2ed885be08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:49.726667 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5359c2-c465-4c96-9740-6c2ed885be08 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:49.726953 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5359c2-c465-4c96-9740-6c2ed885be08 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:49.727238 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5359c2-c465-4c96-9740-6c2ed885be08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:49.735232 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5359c2-c465-4c96-9740-6c2ed885be08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:49.736857 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5359c2-c465-4c96-9740-6c2ed885be08 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:49.744775 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4534/9031] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 22:00:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 22:00:50.959951 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9016f7-2998-4cf6-aa80-ecf88b70ac74 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:50.970655 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9016f7-2998-4cf6-aa80-ecf88b70ac74 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:50.975236 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3570b-253a-449b-9d68-f2e69c14805b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:50.976008 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3570b-253a-449b-9d68-f2e69c14805b service neutron] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:50.976649 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3570b-253a-449b-9d68-f2e69c14805b service neutron] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:50.976939 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3570b-253a-449b-9d68-f2e69c14805b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:50.979378 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-51a3570b-253a-449b-9d68-f2e69c14805b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:50.992181 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3570b-253a-449b-9d68-f2e69c14805b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:50.994543 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3570b-253a-449b-9d68-f2e69c14805b service neutron] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:51.004987 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4498/9032] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 22:00:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 22:00:51.092423 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5359c2-c465-4c96-9740-6c2ed885be08 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:51.102696 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5359c2-c465-4c96-9740-6c2ed885be08 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:51.106807 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d0566-db45-4537-8d3b-32f061d93d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71808360397a42cab9196c51547e33e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:51.107444 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d0566-db45-4537-8d3b-32f061d93d59 service neutron] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:51.107741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d0566-db45-4537-8d3b-32f061d93d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:51.108222 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8d0566-db45-4537-8d3b-32f061d93d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:51.109969 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-9f8d0566-db45-4537-8d3b-32f061d93d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:51.124278 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d0566-db45-4537-8d3b-32f061d93d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:51.125726 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8d0566-db45-4537-8d3b-32f061d93d59 service neutron] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:51.137790 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4535/9033] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 22:00:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 22:00:53.067938 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3570b-253a-449b-9d68-f2e69c14805b service neutron] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:53.137203 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3570b-253a-449b-9d68-f2e69c14805b service neutron] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:53.142399 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf1401-5f6e-4e00-86d9-ad18b75c2b57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:53.143049 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf1401-5f6e-4e00-86d9-ad18b75c2b57 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:53.143331 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf1401-5f6e-4e00-86d9-ad18b75c2b57 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:53.143605 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf1401-5f6e-4e00-86d9-ad18b75c2b57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:53.145440 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bcdf1401-5f6e-4e00-86d9-ad18b75c2b57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:53.156930 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf1401-5f6e-4e00-86d9-ad18b75c2b57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:53.159137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf1401-5f6e-4e00-86d9-ad18b75c2b57 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:53.169243 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4499/9034] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 22:00:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 22:00:53.211248 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d0566-db45-4537-8d3b-32f061d93d59 service neutron] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:53.260697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8d0566-db45-4537-8d3b-32f061d93d59 service neutron] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:53.268529 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92275bac-cc6d-4b58-948f-6712a948a292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07e77369a94844529947de0f46a54edd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:53.268974 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92275bac-cc6d-4b58-948f-6712a948a292 service nova] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:53.269261 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92275bac-cc6d-4b58-948f-6712a948a292 service nova] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:53.269556 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92275bac-cc6d-4b58-948f-6712a948a292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:53.272036 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-92275bac-cc6d-4b58-948f-6712a948a292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:53.286586 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92275bac-cc6d-4b58-948f-6712a948a292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:53.288220 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92275bac-cc6d-4b58-948f-6712a948a292 service nova] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:53.300549 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4536/9035] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 22:00:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 22:00:53.944322 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0897ea3-a8e9-4717-b6be-18029e4c21b4 None None] REQUEST_METHOD: `POST` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:53.944612 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0897ea3-a8e9-4717-b6be-18029e4c21b4 None None] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:53.944889 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0897ea3-a8e9-4717-b6be-18029e4c21b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:53.962759 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.auth.core [None req-f0897ea3-a8e9-4717-b6be-18029e4c21b4 None None] MFA Rules not processed for user `0df218115be74b8692728293c326be08`. Rule list: `[]` (Enabled: `True`). {{(pid=97203) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 26 22:00:53.963865 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-f0897ea3-a8e9-4717-b6be-18029e4c21b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:53.971179 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4500/9036] 10.222.0.16 () {58 vars in 967 bytes} [Sat Mar 26 22:00:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 26 22:00:53.982958 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92275bac-cc6d-4b58-948f-6712a948a292 service nova] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:53.993832 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92275bac-cc6d-4b58-948f-6712a948a292 service nova] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:53.998697 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5445-202e-43bf-bece-7e45b2648d00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08d764c8ff5f48a092bd69030c5e1b47', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:53.999314 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5445-202e-43bf-bece-7e45b2648d00 service swift] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:53.999593 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5445-202e-43bf-bece-7e45b2648d00 service swift] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:53.999889 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d5445-202e-43bf-bece-7e45b2648d00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:54.008509 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5445-202e-43bf-bece-7e45b2648d00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:54.010184 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d5445-202e-43bf-bece-7e45b2648d00 service swift] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:54.019258 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4537/9037] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Mar 26 22:00:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 26 22:00:58.465804 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0897ea3-a8e9-4717-b6be-18029e4c21b4 None None] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:00:58.477814 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0897ea3-a8e9-4717-b6be-18029e4c21b4 None None] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:00:58.482792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be809ea7-acd4-4be5-afad-e70dd2440280 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:00:58.483422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be809ea7-acd4-4be5-afad-e70dd2440280 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:00:58.483710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be809ea7-acd4-4be5-afad-e70dd2440280 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:00:58.484027 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be809ea7-acd4-4be5-afad-e70dd2440280 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:00:58.485767 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-be809ea7-acd4-4be5-afad-e70dd2440280 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:00:58.496698 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be809ea7-acd4-4be5-afad-e70dd2440280 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:00:58.498281 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be809ea7-acd4-4be5-afad-e70dd2440280 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:00:58.508552 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4501/9038] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 22:00:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 22:01:05.803504 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5445-202e-43bf-bece-7e45b2648d00 service swift] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:01:05.882425 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d5445-202e-43bf-bece-7e45b2648d00 service swift] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:01:05.887139 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:01:05.888066 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:01:05.888406 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:01:05.888638 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] PATH_INFO: `/v3/users/87eef87dfbe04b4f8fadb5d4a9287a14` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:01:05.889831 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87eef87dfbe04b4f8fadb5d4a9287a14)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:01:05.891787 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:01:05.937418 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87eef87dfbe04b4f8fadb5d4a9287a14'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:05.944096 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87eef87dfbe04b4f8fadb5d4a9287a14'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:05.944744 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87eef87dfbe04b4f8fadb5d4a9287a14'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:05.945335 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87eef87dfbe04b4f8fadb5d4a9287a14'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:05.952081 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87eef87dfbe04b4f8fadb5d4a9287a14'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:05.968070 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4538/9039] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 22:01:05 2022] DELETE /identity/v3/users/87eef87dfbe04b4f8fadb5d4a9287a14 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 22:01:06.137735 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be809ea7-acd4-4be5-afad-e70dd2440280 service placement] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:01:06.151157 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be809ea7-acd4-4be5-afad-e70dd2440280 service placement] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:01:06.208147 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:01:06.209105 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:01:06.209389 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:01:06.209665 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] PATH_INFO: `/v3/projects/91377f5443a24bebb01fc02288b2f172` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:01:06.210856 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91377f5443a24bebb01fc02288b2f172)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:01:06.212797 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:01:06.257130 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91377f5443a24bebb01fc02288b2f172', 'request_id': 'req-ebb6b6cf-9b36-48c7-b104-9950536d838a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.264396 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91377f5443a24bebb01fc02288b2f172', 'request_id': 'req-ebb6b6cf-9b36-48c7-b104-9950536d838a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.270195 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91377f5443a24bebb01fc02288b2f172', 'request_id': 'req-ebb6b6cf-9b36-48c7-b104-9950536d838a'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.293062 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] The token cache is being invalidate because project 91377f5443a24bebb01fc02288b2f172 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 22:01:06.293352 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.293975 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.295482 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4502/9040] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 22:01:06 2022] DELETE /identity/v3/projects/91377f5443a24bebb01fc02288b2f172 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 22:01:06.299440 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:01:06.300839 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:01:06.313506 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b237dcc-c45d-48b7-9b7f-0071ea57643c admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:01:06.368448 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:01:06.369311 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:01:06.369595 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:01:06.369872 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] PATH_INFO: `/v3/users/8e9fee820e0f41a8bc660d3a1c90f1ad` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:01:06.371061 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9fee820e0f41a8bc660d3a1c90f1ad)` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:01:06.373070 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:01:06.419269 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9fee820e0f41a8bc660d3a1c90f1ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.426072 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9fee820e0f41a8bc660d3a1c90f1ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.426741 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9fee820e0f41a8bc660d3a1c90f1ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.427359 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9fee820e0f41a8bc660d3a1c90f1ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.434462 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.notifications [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9fee820e0f41a8bc660d3a1c90f1ad'} {{(pid=97202) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.451038 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4539/9041] 10.222.0.16 () {58 vars in 1223 bytes} [Sat Mar 26 22:01:06 2022] DELETE /identity/v3/users/8e9fee820e0f41a8bc660d3a1c90f1ad => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 22:01:06.620670 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:01:06.622131 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:01:06.635788 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6b6cf-9b36-48c7-b104-9950536d838a admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:01:06.691316 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ebbe1a3c461148b98c3d0846726c2888', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3c773729259f41fda13a8dbc3d1e265c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:01:06.692137 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:01:06.692422 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:01:06.692697 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] PATH_INFO: `/v3/projects/aa972b0087944c5fa135bda1fa3f09c1` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:01:06.693858 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa972b0087944c5fa135bda1fa3f09c1)` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:01:06.695772 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:01:06.740095 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa972b0087944c5fa135bda1fa3f09c1', 'request_id': 'req-0641b5c3-0c7c-4cfe-89da-ffaa25388601'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.746577 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa972b0087944c5fa135bda1fa3f09c1', 'request_id': 'req-0641b5c3-0c7c-4cfe-89da-ffaa25388601'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.752419 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa972b0087944c5fa135bda1fa3f09c1', 'request_id': 'req-0641b5c3-0c7c-4cfe-89da-ffaa25388601'} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.763423 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] The token cache is being invalidate because project aa972b0087944c5fa135bda1fa3f09c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=97203) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 26 22:01:06.763710 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.764357 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.notifications [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=97203) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 26 22:01:06.766224 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4503/9042] 10.222.0.16 () {58 vars in 1232 bytes} [Sat Mar 26 22:01:06 2022] DELETE /identity/v3/projects/aa972b0087944c5fa135bda1fa3f09c1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 26 22:05:59.046394 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] Authenticating user token {{(pid=97202) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:05:59.047820 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:05:59.130172 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c24d81-dce2-466c-bd31-8a0aaa5b1080 admin admin] Validating token access rules against request {{(pid=97202) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:05:59.186886 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b907498-130c-4ba8-a903-392a5f172dcf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97202) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:05:59.187525 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907498-130c-4ba8-a903-392a5f172dcf service placement] REQUEST_METHOD: `GET` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:05:59.187809 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907498-130c-4ba8-a903-392a5f172dcf service placement] SCRIPT_NAME: `/identity` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:05:59.188122 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b907498-130c-4ba8-a903-392a5f172dcf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97202) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:05:59.189871 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.fernet_utils [None req-1b907498-130c-4ba8-a903-392a5f172dcf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97202) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:05:59.201247 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b907498-130c-4ba8-a903-392a5f172dcf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:05:59.202814 ncdv-master-1 devstack@keystone.service[97202]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b907498-130c-4ba8-a903-392a5f172dcf service placement] RBAC: Authorization granted {{(pid=97202) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:05:59.212571 ncdv-master-1 devstack@keystone.service[97202]: [pid: 97202|app: 0|req: 4540/9043] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 22:05:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 26 22:06:03.041724 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] Authenticating user token {{(pid=97203) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 26 22:06:03.043101 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:06:03.057741 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641b5c3-0c7c-4cfe-89da-ffaa25388601 admin admin] Validating token access rules against request {{(pid=97203) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 26 22:06:03.062780 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaa19a-2398-4132-98ce-cac26fb6eee0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de5b3a8b36da4df7b905b26aa3e680e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d311a58db4c44ebbd88fbdf463fab47', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=97203) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 26 22:06:03.063424 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa19a-2398-4132-98ce-cac26fb6eee0 service placement] REQUEST_METHOD: `GET` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 26 22:06:03.063711 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa19a-2398-4132-98ce-cac26fb6eee0 service placement] SCRIPT_NAME: `/identity` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 26 22:06:03.064029 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaa19a-2398-4132-98ce-cac26fb6eee0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=97203) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 26 22:06:03.065739 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.fernet_utils [None req-bcfaa19a-2398-4132-98ce-cac26fb6eee0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=97203) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 26 22:06:03.076792 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa19a-2398-4132-98ce-cac26fb6eee0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 26 22:06:03.078391 ncdv-master-1 devstack@keystone.service[97203]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaa19a-2398-4132-98ce-cac26fb6eee0 service placement] RBAC: Authorization granted {{(pid=97203) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 26 22:06:03.088479 ncdv-master-1 devstack@keystone.service[97203]: [pid: 97203|app: 0|req: 4504/9044] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Mar 26 22:06:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)